2024-05-30T16:28:05.990 INFO:root:teuthology version: 0.0.1.dev296+ge1979f0 2024-05-30T16:28:05.991 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141 --verbose -- /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/orig.config.yaml 2024-05-30T16:28:06.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-30T16:28:06.120 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141 branch: rishabh-clone-stats description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} email: null first_in_suite: false job_id: '7734141' kernel: client: branch: testing flavor: default kdb: 1 sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-clone-stats ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-clone-stats sha1: 019a0d1fdedb1237f85e8a3711761fae4e094286 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 964 sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-clone-stats suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 019a0d1fdedb1237f85e8a3711761fae4e094286 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrcicrBADWVD0q7rxwQ1BfUwl4jfpMUgLNKIzifz++aoiJVNcXVveB92ryPNgN8gQyvUN6dlJF6k2al2BU1ePE= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlDmCus2pwb29tGiY02t6+jMXwzMs7vlKpqSaO/UU9+xHmoJChF3sg83tHcD5/52mkGqgSxAkQjj4ZgxAjuLkA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestCloneProgressReporter teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e1979f064b0becde2020282c7e87cf3c5e98026c timestamp: 2024-05-30_16:10:36 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-30T16:28:06.121 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa; will attempt to use it 2024-05-30T16:28:06.121 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks 2024-05-30T16:28:06.121 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-30T16:28:06.123 INFO:teuthology.task.internal:Checking packages... 2024-05-30T16:28:06.157 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9ed025fbf4406fb54980a0647506b15895b6d863' 2024-05-30T16:28:06.157 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-30T16:28:06.157 INFO:teuthology.packaging:ref: None 2024-05-30T16:28:06.157 INFO:teuthology.packaging:tag: None 2024-05-30T16:28:06.157 INFO:teuthology.packaging:branch: rishabh-clone-stats 2024-05-30T16:28:06.157 INFO:teuthology.packaging:sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:28:06.157 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-clone-stats 2024-05-30T16:28:06.303 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3154.g9ed025fb 2024-05-30T16:28:06.305 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-30T16:28:06.311 INFO:teuthology.task.internal:no buildpackages task found 2024-05-30T16:28:06.312 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-30T16:28:06.354 INFO:teuthology.task.internal:Saving configuration 2024-05-30T16:28:06.370 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-30T16:28:06.387 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-30T16:28:06.413 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-30 16:23:06.556137', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrcicrBADWVD0q7rxwQ1BfUwl4jfpMUgLNKIzifz++aoiJVNcXVveB92ryPNgN8gQyvUN6dlJF6k2al2BU1ePE='} 2024-05-30T16:28:06.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-30 16:23:06.554557', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlDmCus2pwb29tGiY02t6+jMXwzMs7vlKpqSaO/UU9+xHmoJChF3sg83tHcD5/52mkGqgSxAkQjj4ZgxAjuLkA='} 2024-05-30T16:28:06.436 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-30T16:28:06.441 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-30T16:28:06.441 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-30T16:28:06.441 INFO:teuthology.run_tasks:Running task console_log... 2024-05-30T16:28:06.551 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8e8115fbe0>, signals=[15]) 2024-05-30T16:28:06.551 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-30T16:28:06.557 INFO:teuthology.task.internal:Opening connections... 2024-05-30T16:28:06.557 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:28:06.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:28:06.633 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:28:06.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:28:06.705 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-30T16:28:06.711 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-05-30T16:28:06.729 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-05-30T16:28:06.729 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-05-30T16:28:06.786 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-30T16:28:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-30T16:28:06.788 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-30T16:28:06.788 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-05-30T16:28:06.810 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-05-30T16:28:06.828 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-05-30T16:28:06.828 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-05-30T16:28:06.885 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-05-30T16:28:06.885 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-05-30T16:28:06.885 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-05-30T16:28:06.885 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-30T16:28:06.886 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-30T16:28:06.886 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-05-30T16:28:06.910 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-30T16:28:06.919 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-30T16:28:06.967 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-30T16:28:06.968 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-05-30T16:28:06.970 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-05-30T16:28:06.986 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-30T16:28:06.999 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-30T16:28:06.999 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-05-30T16:28:07.026 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-05-30T16:28:07.132 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-30T16:28:07.183 INFO:teuthology.run_tasks:Running task kernel... 2024-05-30T16:28:07.197 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'} 2024-05-30T16:28:07.197 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-05-30T16:28:07.197 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-30T16:28:07.197 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-30T16:28:07.198 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-30T16:28:07.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:28:07.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:28:07.215 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-30T16:28:07.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-30T16:28:07.382 DEBUG:teuthology.task.kernel:sha1 for client.0 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:28:07.382 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-30T16:28:07.382 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-05-30T16:28:07.399 INFO:teuthology.orchestra.run.smithi144.stdout:5.14.0-437.el9.x86_64 2024-05-30T16:28:07.399 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:28:07.400 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-30T16:28:07.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum upgrade -y linux-firmware 2024-05-30T16:28:07.475 DEBUG:teuthology.task.kernel:sha1 for client.1 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:28:07.475 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-30T16:28:07.475 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-05-30T16:28:07.492 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-437.el9.x86_64 2024-05-30T16:28:07.492 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:28:07.492 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-30T16:28:07.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum upgrade -y linux-firmware 2024-05-30T16:28:09.837 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-30T16:28:09.944 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-30T16:28:13.095 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 19 MB 00:02 2024-05-30T16:28:18.221 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.2 MB 00:01 2024-05-30T16:28:19.344 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 19 MB 00:08 2024-05-30T16:28:20.022 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 17 kB 00:00 2024-05-30T16:28:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 21 MB 00:02 2024-05-30T16:28:23.711 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-05-30T16:28:25.087 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 17 kB 00:00 2024-05-30T16:28:26.113 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-05-30T16:28:28.081 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-05-30T16:28:30.174 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-05-30T16:28:30.174 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-05-30T16:28:30.174 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-05-30T16:28:30.298 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-30T16:28:30.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:28:30.526 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-05-30T16:28:30.526 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-30T16:28:30.529 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi144.front.sepia.ceph.com to complete... 2024-05-30T16:28:31.263 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-30T16:28:33.379 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-05-30T16:28:33.380 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-05-30T16:28:33.380 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-05-30T16:28:33.491 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-05-30T16:28:33.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T16:28:33.725 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-05-30T16:28:33.726 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-30T16:28:33.728 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi149.front.sepia.ceph.com to complete... 2024-05-30T16:28:45.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30 16:28:45 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-30T16:28:45.418 INFO:teuthology.orchestra.run.smithi144.stderr:FINISHED --2024-05-30 16:28:45-- 2024-05-30T16:28:45.418 INFO:teuthology.orchestra.run.smithi144.stderr:Total wall clock time: 15s 2024-05-30T16:28:45.418 INFO:teuthology.orchestra.run.smithi144.stderr:Downloaded: 1 files, 340M in 15s (23.4 MB/s) 2024-05-30T16:28:45.421 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-30T16:28:45.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-30T16:28:47.521 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying... ######################################## 2024-05-30T16:28:47.715 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing... ######################################## 2024-05-30T16:28:47.829 INFO:teuthology.orchestra.run.smithi144.stdout:Updating / installing... 2024-05-30T16:28:55.779 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-05-30T16:28:55.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30 16:28:55 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-30T16:28:55.848 INFO:teuthology.orchestra.run.smithi149.stderr:FINISHED --2024-05-30 16:28:55-- 2024-05-30T16:28:55.848 INFO:teuthology.orchestra.run.smithi149.stderr:Total wall clock time: 22s 2024-05-30T16:28:55.848 INFO:teuthology.orchestra.run.smithi149.stderr:Downloaded: 1 files, 340M in 22s (15.8 MB/s) 2024-05-30T16:28:55.851 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-05-30T16:28:55.851 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-30T16:28:57.935 INFO:teuthology.orchestra.run.smithi149.stdout:Verifying... ######################################## 2024-05-30T16:28:58.191 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing... ######################################## 2024-05-30T16:28:58.306 INFO:teuthology.orchestra.run.smithi149.stdout:Updating / installing... 2024-05-30T16:29:06.307 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-05-30T16:29:35.248 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-30T16:29:35.248 DEBUG:teuthology.orchestra.run.smithi144:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-30T16:29:35.330 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-05-30T16:29:35.330 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/config-6.9.0-gb9459a26b088 2024-05-30T16:29:35.330 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-30T16:29:35.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-30T16:29:35.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-30T16:29:35.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-30T16:29:35.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-30T16:29:35.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-30T16:29:35.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-30T16:29:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-30T16:29:35.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-30T16:29:35.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-30T16:29:35.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-30T16:29:35.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-05-30T16:29:35.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-30T16:29:35.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-30T16:29:35.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-05-30T16:29:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-30T16:29:35.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-30T16:29:35.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-30T16:29:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-30T16:29:35.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-30T16:29:35.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-30T16:29:35.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-30T16:29:35.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-30T16:29:35.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-05-30T16:29:35.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-30T16:29:35.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-30T16:29:35.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-30T16:29:35.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-30T16:29:35.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-30T16:29:35.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-30T16:29:35.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-30T16:29:35.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-30T16:29:35.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-30T16:29:35.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-30T16:29:35.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-30T16:29:35.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-05-30T16:29:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-30T16:29:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-30T16:29:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-30T16:29:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-30T16:29:35.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-30T16:29:35.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-30T16:29:35.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-30T16:29:35.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-30T16:29:35.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-30T16:29:35.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-05-30T16:29:35.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-30T16:29:35.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-30T16:29:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-30T16:29:35.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-30T16:29:35.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-30T16:29:35.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-30T16:29:35.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-30T16:29:35.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-05-30T16:29:35.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-30T16:29:35.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-30T16:29:35.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-30T16:29:35.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-30T16:29:35.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-30T16:29:35.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-30T16:29:35.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-05-30T16:29:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-30T16:29:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-30T16:29:35.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-30T16:29:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-30T16:29:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-05-30T16:29:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-30T16:29:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-05-30T16:29:35.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-30T16:29:35.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-30T16:29:35.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-05-30T16:29:35.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-30T16:29:35.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-30T16:29:35.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-30T16:29:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-05-30T16:29:35.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-30T16:29:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-30T16:29:35.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-05-30T16:29:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-30T16:29:35.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-30T16:29:35.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-30T16:29:35.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-30T16:29:35.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-30T16:29:35.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-30T16:29:35.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-30T16:29:35.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-05-30T16:29:35.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-30T16:29:35.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-30T16:29:35.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-30T16:29:35.419 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-30T16:29:35.420 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-30T16:29:35.421 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-30T16:29:35.422 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-30T16:29:35.423 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-30T16:29:35.424 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-30T16:29:35.425 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-30T16:29:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-05-30T16:29:35.427 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-05-30T16:29:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-05-30T16:29:35.429 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-05-30T16:29:35.430 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-05-30T16:29:35.431 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-30T16:29:35.432 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-30T16:29:35.433 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-30T16:29:35.434 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-05-30T16:29:35.435 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-05-30T16:29:35.436 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-30T16:29:35.437 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-30T16:29:35.438 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-05-30T16:29:35.439 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-30T16:29:35.440 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-30T16:29:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-30T16:29:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-05-30T16:29:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-30T16:29:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-30T16:29:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-30T16:29:35.446 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-30T16:29:35.447 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-30T16:29:35.448 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-30T16:29:35.449 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-30T16:29:35.450 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-05-30T16:29:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-30T16:29:35.452 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-30T16:29:35.453 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-30T16:29:35.454 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-30T16:29:35.455 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-30T16:29:35.456 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-05-30T16:29:35.457 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-30T16:29:35.458 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-30T16:29:35.459 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-30T16:29:35.460 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-30T16:29:35.461 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-05-30T16:29:35.462 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-30T16:29:35.463 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-30T16:29:35.464 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-30T16:29:35.465 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-30T16:29:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-05-30T16:29:35.467 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-05-30T16:29:35.468 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-30T16:29:35.469 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-30T16:29:35.473 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-30T16:29:35.473 DEBUG:teuthology.orchestra.run.smithi144:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-30T16:29:35.496 INFO:teuthology.orchestra.run.smithi144.stdout:postinstall scriptlet (using /bin/sh): 2024-05-30T16:29:35.496 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-30T16:29:35.496 INFO:teuthology.orchestra.run.smithi144.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-30T16:29:35.496 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-05-30T16:29:35.496 INFO:teuthology.orchestra.run.smithi144.stdout:for file in vmlinuz System.map config; do 2024-05-30T16:29:35.496 INFO:teuthology.orchestra.run.smithi144.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout: fi 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:done 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-05-30T16:29:35.497 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-05-30T16:29:35.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.06 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 68.el9 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Group : Unspecified 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 8264254 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : builder@centos.org 2024-05-30T16:29:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : CentOS 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:29:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2024-05-30T16:29:35.581 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-30T16:29:35.581 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 6.9.0-gb9459a26b088 2024-05-30T16:29:35.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-30T16:29:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-05-30T16:29:37.471 INFO:teuthology.orchestra.run.smithi144.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-30T16:29:37.500 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-05-30T16:29:37.502 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-05-30T16:29:37.517 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.29GKBeCv4m 2024-05-30T16:29:37.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.29GKBeCv4m 2024-05-30T16:29:37.592 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.29GKBeCv4m 2024-05-30T16:29:37.735 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.29GKBeCv4m is 6KB 2024-05-30T16:29:37.783 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.29GKBeCv4m 2024-05-30T16:29:37.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2024-05-30T16:29:37.866 INFO:teuthology.orchestra.run.smithi144.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-30T16:29:37.866 INFO:teuthology.orchestra.run.smithi144.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-30T16:29:37.866 INFO:teuthology.orchestra.run.smithi144.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-30T16:29:37.866 INFO:teuthology.orchestra.run.smithi144.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-05-30T16:29:37.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-05-30T16:29:38.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2024-05-30T16:29:42.956 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-30T16:29:42.956 DEBUG:teuthology.orchestra.run.smithi149:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-30T16:29:43.037 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/config-6.9.0-gb9459a26b088 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-30T16:29:43.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-30T16:29:43.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-30T16:29:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-30T16:29:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-30T16:29:43.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-30T16:29:43.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-30T16:29:43.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-30T16:29:43.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-30T16:29:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-30T16:29:43.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-30T16:29:43.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-05-30T16:29:43.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-05-30T16:29:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-30T16:29:43.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-30T16:29:43.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-30T16:29:43.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-30T16:29:43.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-30T16:29:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-30T16:29:43.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-30T16:29:43.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-30T16:29:43.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-30T16:29:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-30T16:29:43.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-30T16:29:43.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-30T16:29:43.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-30T16:29:43.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-30T16:29:43.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-30T16:29:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-30T16:29:43.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-30T16:29:43.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-30T16:29:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-30T16:29:43.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-30T16:29:43.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-30T16:29:43.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-05-30T16:29:43.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-30T16:29:43.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-05-30T16:29:43.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-30T16:29:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-30T16:29:43.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-30T16:29:43.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-30T16:29:43.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-30T16:29:43.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-30T16:29:43.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-30T16:29:43.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-30T16:29:43.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-05-30T16:29:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-30T16:29:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-05-30T16:29:43.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-30T16:29:43.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-30T16:29:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-05-30T16:29:43.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-30T16:29:43.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-05-30T16:29:43.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-05-30T16:29:43.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-05-30T16:29:43.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-30T16:29:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-30T16:29:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-30T16:29:43.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-05-30T16:29:43.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-30T16:29:43.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-30T16:29:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-30T16:29:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-30T16:29:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-30T16:29:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-30T16:29:43.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-30T16:29:43.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-05-30T16:29:43.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-30T16:29:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-30T16:29:43.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-30T16:29:43.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-30T16:29:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-30T16:29:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-30T16:29:43.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-30T16:29:43.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-30T16:29:43.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-30T16:29:43.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-30T16:29:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-30T16:29:43.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-30T16:29:43.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-05-30T16:29:43.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-30T16:29:43.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-30T16:29:43.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-30T16:29:43.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-30T16:29:43.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-05-30T16:29:43.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-30T16:29:43.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-30T16:29:43.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-30T16:29:43.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-30T16:29:43.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-30T16:29:43.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-30T16:29:43.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-30T16:29:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-30T16:29:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-30T16:29:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-05-30T16:29:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-30T16:29:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-30T16:29:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-30T16:29:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-05-30T16:29:43.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-05-30T16:29:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-05-30T16:29:43.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-05-30T16:29:43.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-30T16:29:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-30T16:29:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-30T16:29:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-30T16:29:43.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-30T16:29:43.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-05-30T16:29:43.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-30T16:29:43.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-30T16:29:43.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-30T16:29:43.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-30T16:29:43.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-30T16:29:43.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-30T16:29:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-30T16:29:43.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-05-30T16:29:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-30T16:29:43.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-30T16:29:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-30T16:29:43.156 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-30T16:29:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-30T16:29:43.158 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-30T16:29:43.159 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-30T16:29:43.160 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-05-30T16:29:43.161 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-30T16:29:43.162 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-30T16:29:43.163 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-30T16:29:43.164 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-30T16:29:43.165 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-30T16:29:43.166 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-30T16:29:43.167 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-30T16:29:43.170 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-30T16:29:43.171 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-30T16:29:43.172 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-30T16:29:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-30T16:29:43.174 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-30T16:29:43.175 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-05-30T16:29:43.176 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-30T16:29:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-30T16:29:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-30T16:29:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-30T16:29:43.180 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-05-30T16:29:43.181 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-05-30T16:29:43.182 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-30T16:29:43.183 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-30T16:29:43.187 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-30T16:29:43.187 DEBUG:teuthology.orchestra.run.smithi149:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout:postinstall scriptlet (using /bin/sh): 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout:for file in vmlinuz System.map config; do 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout: fi 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout:done 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-05-30T16:29:43.209 INFO:teuthology.orchestra.run.smithi149.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-30T16:29:43.210 INFO:teuthology.orchestra.run.smithi149.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-30T16:29:43.210 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-05-30T16:29:43.210 INFO:teuthology.orchestra.run.smithi149.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-05-30T16:29:43.210 INFO:teuthology.orchestra.run.smithi149.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-05-30T16:29:43.210 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-05-30T16:29:43.210 INFO:teuthology.orchestra.run.smithi149.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-30T16:29:43.210 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-30T16:29:43.210 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-05-30T16:29:43.210 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-05-30T16:29:43.211 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-05-30T16:29:43.282 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-05-30T16:29:43.282 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-05-30T16:29:43.282 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-05-30T16:29:43.282 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 68.el9 2024-05-30T16:29:43.282 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-05-30T16:29:43.282 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8264254 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-30T16:29:43.283 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-30T16:29:43.284 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-30T16:29:43.284 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-05-30T16:29:43.284 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:29:43.284 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-05-30T16:29:43.285 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-30T16:29:43.285 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 6.9.0-gb9459a26b088 2024-05-30T16:29:43.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-30T16:29:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-05-30T16:29:45.216 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-30T16:29:45.257 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-05-30T16:29:45.259 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-05-30T16:29:45.274 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.W7ABPRuV0d 2024-05-30T16:29:45.274 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.W7ABPRuV0d 2024-05-30T16:29:45.351 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.W7ABPRuV0d 2024-05-30T16:29:45.491 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.W7ABPRuV0d is 6KB 2024-05-30T16:29:45.539 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.W7ABPRuV0d 2024-05-30T16:29:45.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-05-30T16:29:45.614 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-30T16:29:45.614 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-30T16:29:45.614 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-30T16:29:45.614 INFO:teuthology.orchestra.run.smithi149.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-05-30T16:29:45.616 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-05-30T16:29:45.764 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-05-30T16:30:08.035 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-30T16:30:08.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-05-30T16:30:08.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:30:15.775 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-30T16:30:15.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-30T16:30:15.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:30:26.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-05-30T16:30:34.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-05-30T16:30:35.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-05-30T16:30:35.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:30:38.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-05-30T16:30:43.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-30T16:30:43.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:30:46.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-05-30T16:30:50.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-05-30T16:30:50.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:30:58.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-30T16:30:58.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:31:09.086 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-05-30T16:31:16.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-05-30T16:31:24.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-05-30T16:31:24.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:31:26.669 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-05-30T16:31:27.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-05-30T16:31:27.258 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gb9459a26b088"... 2024-05-30T16:31:27.258 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-05-30T16:31:27.297 INFO:teuthology.orchestra.run.smithi144.stdout:6.9.0-gb9459a26b088 2024-05-30T16:31:27.298 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-30T16:31:27.298 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-30T16:31:27.298 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-30T16:31:28.299 DEBUG:teuthology.parallel:result is None 2024-05-30T16:31:31.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-30T16:31:31.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:31:33.767 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-05-30T16:31:34.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-30T16:31:34.476 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-gb9459a26b088"... 2024-05-30T16:31:34.476 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-05-30T16:31:34.515 INFO:teuthology.orchestra.run.smithi149.stdout:6.9.0-gb9459a26b088 2024-05-30T16:31:34.515 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-30T16:31:34.515 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-30T16:31:34.516 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-30T16:31:35.518 DEBUG:teuthology.parallel:result is None 2024-05-30T16:31:35.518 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-30T16:31:35.526 INFO:teuthology.task.internal:Creating test directory... 2024-05-30T16:31:35.526 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-30T16:31:35.533 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-30T16:31:35.577 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-30T16:31:35.590 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-30T16:31:35.634 INFO:teuthology.task.internal:Creating archive directory... 2024-05-30T16:31:35.634 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-30T16:31:35.638 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-30T16:31:35.701 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-30T16:31:35.707 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-30T16:31:35.707 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-30T16:31:35.718 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-30T16:31:35.832 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T16:31:35.877 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T16:31:35.904 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T16:31:35.925 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T16:31:35.930 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-30T16:31:35.937 INFO:teuthology.task.internal:Configuring sudo... 2024-05-30T16:31:35.938 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-30T16:31:35.942 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-30T16:31:36.023 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-30T16:31:36.032 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-30T16:31:36.032 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-30T16:31:36.036 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-30T16:31:36.080 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-30T16:31:36.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-30T16:31:36.264 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-30T16:31:36.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-30T16:31:36.412 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:31:36.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-30T16:31:36.474 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-30T16:31:36.554 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-30T16:31:36.622 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-30T16:31:36.690 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-30T16:31:36.778 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:31:36.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-30T16:31:36.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-05-30T16:31:36.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-05-30T16:31:36.963 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-30T16:31:37.003 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-30T16:31:37.127 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-30T16:31:37.134 INFO:teuthology.task.internal:Starting timer... 2024-05-30T16:31:37.134 INFO:teuthology.run_tasks:Running task pcp... 2024-05-30T16:31:37.205 INFO:teuthology.run_tasks:Running task selinux... 2024-05-30T16:31:37.240 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-30T16:31:37.240 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-05-30T16:31:37.338 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-05-30T16:31:37.343 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-05-30T16:31:37.443 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-05-30T16:31:37.448 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-30T16:31:37.448 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-05-30T16:31:37.509 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-05-30T16:31:37.510 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-05-30T16:31:37.568 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-05-30T16:31:37.568 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi144.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2024-05-30T16:31:37.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-30T16:31:37.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:31:37.629 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-30T16:31:37.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:31:37.696 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-30T16:31:37.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-05-30T16:31:37.753 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-05-30T16:31:37.867 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-30T16:31:37.877 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-30T16:31:37.880 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-30T16:31:38.022 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-30T16:31:38.033 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-30T16:31:38.034 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi144.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-30T16:38:18.053 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi144.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-05-30T16:38:18.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-05-30T16:38:18.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:38:18.163 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-05-30T16:38:18.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-05-30T16:38:18.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-30T16:38:18.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T16:38:18.428 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-05-30T16:38:18.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-30T16:38:18.583 INFO:teuthology.run_tasks:Running task clock... 2024-05-30T16:38:18.593 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-30T16:38:18.594 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-30T16:38:18.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T16:38:18.602 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-30T16:38:18.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T16:38:18.683 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-30T16:38:18.685 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-30T16:38:18.723 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-30T16:38:18.728 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-30T16:38:18.793 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-05-30T16:38:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-05-30T16:38:18.824 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-05-30T16:38:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-05-30T16:38:18.864 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-30T16:38:18.876 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-30T16:38:18.907 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-30T16:38:18.918 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-30T16:38:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-05-30T16:38:19.057 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-05-30T16:38:19.064 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-30T16:38:19.064 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-05-30T16:38:19.064 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:38:19.064 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:38:19.064 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:38:19.064 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:38:19.067 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-30T16:38:19.067 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-05-30T16:38:19.067 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:38:19.067 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:38:19.067 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:38:19.067 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:38:19.069 INFO:teuthology.run_tasks:Running task install... 2024-05-30T16:38:19.077 DEBUG:teuthology.task.install:project ceph 2024-05-30T16:38:19.077 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}} 2024-05-30T16:38:19.077 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'} 2024-05-30T16:38:19.078 INFO:teuthology.task.install:Using flavor: default 2024-05-30T16:38:19.083 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-30T16:38:19.083 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-30T16:38:19.083 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'tag': None, 'wait_for_package': False} 2024-05-30T16:38:19.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:38:19.086 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'tag': None, 'wait_for_package': False} 2024-05-30T16:38:19.086 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:38:19.229 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/centos/9/flavors/default/ 2024-05-30T16:38:19.229 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3154.g9ed025fb 2024-05-30T16:38:19.308 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/centos/9/flavors/default/ 2024-05-30T16:38:19.309 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3154.g9ed025fb 2024-05-30T16:38:19.403 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-30T16:38:19.404 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:38:19.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-30T16:38:19.420 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-30T16:38:19.421 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:38:19.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-30T16:38:19.489 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-30T16:38:19.489 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9ed025fbf4406fb54980a0647506b15895b6d863/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-30T16:38:19.506 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-30T16:38:19.507 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9ed025fbf4406fb54980a0647506b15895b6d863/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-30T16:38:19.619 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-30T16:38:19.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-30T16:38:19.724 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-30T16:38:19.748 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-30T16:38:19.806 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-05-30T16:38:19.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-05-30T16:38:19.825 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-05-30T16:38:19.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-05-30T16:38:20.139 INFO:teuthology.orchestra.run.smithi149.stdout:45 files removed 2024-05-30T16:38:20.172 INFO:teuthology.orchestra.run.smithi144.stdout:45 files removed 2024-05-30T16:38:20.178 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-30T16:38:20.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-30T16:38:21.139 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 169 kB/s | 83 kB 00:00 2024-05-30T16:38:21.160 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 155 kB/s | 83 kB 00:00 2024-05-30T16:38:21.640 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-05-30T16:38:21.652 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-05-30T16:38:22.198 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-05-30T16:38:22.203 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-05-30T16:38:22.910 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.1 MB 00:00 2024-05-30T16:38:22.932 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-30T16:38:24.961 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-05-30T16:38:31.945 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.2 MB 00:03 2024-05-30T16:38:34.604 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 17 kB 00:01 2024-05-30T16:38:36.302 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-30T16:38:40.654 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:16 2024-05-30T16:38:42.588 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-05-30T16:38:45.190 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-30T16:38:45.192 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-30T16:38:45.212 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-30T16:38:45.214 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-30T16:38:45.215 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-30T16:38:45.216 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-30T16:38:45.219 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-30T16:38:45.222 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-30T16:38:45.223 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-30T16:38:45.296 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-05-30T16:38:45.315 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-05-30T16:38:45.315 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-05-30T16:38:45.315 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-05-30T16:38:45.315 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-05-30T16:38:45.315 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 6.6 k 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 5.4 M 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 890 k 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 145 k 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 1.5 M 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 142 k 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 3.5 M 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 7.4 M 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 49 k 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 11 M 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 49 M 2024-05-30T16:38:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 273 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 762 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 225 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-shell x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 27 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 18 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 32 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 746 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 127 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-30T16:38:45.317 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 161 k 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 321 k 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 298 k 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 100 k 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 85 k 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 3.1 M 2024-05-30T16:38:45.318 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 170 k 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 3.4 M 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 3.1 M 2024-05-30T16:38:45.319 INFO:teuthology.orchestra.run.smithi149.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 21 M 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 34 k 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 2.4 M 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 252 k 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 4.7 M 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 17 M 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 16 k 2024-05-30T16:38:45.320 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 25 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 164 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-30T16:38:45.321 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 501 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 5.4 M 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-30T16:38:45.322 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 45 k 2024-05-30T16:38:45.323 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 135 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-30T16:38:45.324 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-30T16:38:45.325 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-30T16:38:45.326 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-30T16:38:45.327 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-30T16:38:45.328 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-05-30T16:38:45.329 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-30T16:38:45.329 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:38:45.329 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-05-30T16:38:45.329 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-05-30T16:38:45.329 INFO:teuthology.orchestra.run.smithi149.stdout:Install 148 Packages 2024-05-30T16:38:45.329 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 11 Packages 2024-05-30T16:38:45.329 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:38:45.329 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 227 M 2024-05-30T16:38:45.330 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-05-30T16:38:46.032 INFO:teuthology.orchestra.run.smithi149.stdout:(1/159): ceph-19.0.0-3154.g9ed025fb.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-05-30T16:38:46.072 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.2 MB 00:01 2024-05-30T16:38:46.432 INFO:teuthology.orchestra.run.smithi149.stdout:(2/159): ceph-base-19.0.0-3154.g9ed025fb.el9.x8 8.2 MB/s | 5.4 MB 00:00 2024-05-30T16:38:46.482 INFO:teuthology.orchestra.run.smithi149.stdout:(3/159): ceph-fuse-19.0.0-3154.g9ed025fb.el9.x8 1.9 MB/s | 890 kB 00:00 2024-05-30T16:38:46.524 INFO:teuthology.orchestra.run.smithi149.stdout:(4/159): ceph-immutable-object-cache-19.0.0-315 1.6 MB/s | 145 kB 00:00 2024-05-30T16:38:46.850 INFO:teuthology.orchestra.run.smithi149.stdout:(5/159): ceph-mds-19.0.0-3154.g9ed025fb.el9.x86 6.5 MB/s | 2.4 MB 00:00 2024-05-30T16:38:46.908 INFO:teuthology.orchestra.run.smithi149.stdout:(6/159): ceph-mgr-19.0.0-3154.g9ed025fb.el9.x86 3.9 MB/s | 1.5 MB 00:00 2024-05-30T16:38:48.030 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 17 kB 00:00 2024-05-30T16:38:48.033 INFO:teuthology.orchestra.run.smithi149.stdout:(7/159): ceph-osd-19.0.0-3154.g9ed025fb.el9.x86 15 MB/s | 17 MB 00:01 2024-05-30T16:38:48.492 INFO:teuthology.orchestra.run.smithi149.stdout:(8/159): ceph-mon-19.0.0-3154.g9ed025fb.el9.x86 2.9 MB/s | 4.7 MB 00:01 2024-05-30T16:38:48.592 INFO:teuthology.orchestra.run.smithi149.stdout:(9/159): ceph-selinux-19.0.0-3154.g9ed025fb.el9 254 kB/s | 25 kB 00:00 2024-05-30T16:38:48.734 INFO:teuthology.orchestra.run.smithi149.stdout:(10/159): ceph-radosgw-19.0.0-3154.g9ed025fb.el 15 MB/s | 11 MB 00:00 2024-05-30T16:38:48.818 INFO:teuthology.orchestra.run.smithi149.stdout:(11/159): cephfs-mirror-19.0.0-3154.g9ed025fb.e 2.7 MB/s | 225 kB 00:00 2024-05-30T16:38:48.902 INFO:teuthology.orchestra.run.smithi149.stdout:(12/159): cephfs-shell-19.0.0-3154.g9ed025fb.el 327 kB/s | 27 kB 00:00 2024-05-30T16:38:49.119 INFO:teuthology.orchestra.run.smithi149.stdout:(13/159): libcephfs-devel-19.0.0-3154.g9ed025fb 147 kB/s | 32 kB 00:00 2024-05-30T16:38:49.294 INFO:teuthology.orchestra.run.smithi149.stdout:(14/159): libcephfs2-19.0.0-3154.g9ed025fb.el9. 4.2 MB/s | 746 kB 00:00 2024-05-30T16:38:49.420 INFO:teuthology.orchestra.run.smithi149.stdout:(15/159): libcephsqlite-19.0.0-3154.g9ed025fb.e 1.3 MB/s | 164 kB 00:00 2024-05-30T16:38:49.545 INFO:teuthology.orchestra.run.smithi149.stdout:(16/159): librados-devel-19.0.0-3154.g9ed025fb. 1.0 MB/s | 127 kB 00:00 2024-05-30T16:38:50.082 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-30T16:38:50.100 INFO:teuthology.orchestra.run.smithi149.stdout:(17/159): libradosstriper1-19.0.0-3154.g9ed025f 903 kB/s | 501 kB 00:00 2024-05-30T16:38:51.237 INFO:teuthology.orchestra.run.smithi149.stdout:(18/159): librgw2-19.0.0-3154.g9ed025fb.el9.x86 4.7 MB/s | 5.4 MB 00:01 2024-05-30T16:38:52.054 INFO:teuthology.orchestra.run.smithi149.stdout:(19/159): ceph-common-19.0.0-3154.g9ed025fb.el9 3.4 MB/s | 21 MB 00:06 2024-05-30T16:38:52.079 INFO:teuthology.orchestra.run.smithi149.stdout:(20/159): python3-ceph-argparse-19.0.0-3154.g9e 54 kB/s | 45 kB 00:00 2024-05-30T16:38:52.679 INFO:teuthology.orchestra.run.smithi149.stdout:(21/159): ceph-test-19.0.0-3154.g9ed025fb.el9.x 12 MB/s | 49 MB 00:04 2024-05-30T16:38:52.713 INFO:teuthology.orchestra.run.smithi149.stdout:(22/159): python3-ceph-common-19.0.0-3154.g9ed0 205 kB/s | 135 kB 00:00 2024-05-30T16:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout:(23/159): python3-cephfs-19.0.0-3154.g9ed025fb. 242 kB/s | 161 kB 00:00 2024-05-30T16:38:52.788 INFO:teuthology.orchestra.run.smithi149.stdout:(24/159): python3-rados-19.0.0-3154.g9ed025fb.e 2.9 MB/s | 321 kB 00:00 2024-05-30T16:38:52.822 INFO:teuthology.orchestra.run.smithi149.stdout:(25/159): python3-rgw-19.0.0-3154.g9ed025fb.el9 1.3 MB/s | 100 kB 00:00 2024-05-30T16:38:52.856 INFO:teuthology.orchestra.run.smithi149.stdout:(26/159): python3-rbd-19.0.0-3154.g9ed025fb.el9 2.1 MB/s | 298 kB 00:00 2024-05-30T16:38:52.881 INFO:teuthology.orchestra.run.smithi149.stdout:(27/159): rbd-fuse-19.0.0-3154.g9ed025fb.el9.x8 934 kB/s | 85 kB 00:00 2024-05-30T16:38:52.948 INFO:teuthology.orchestra.run.smithi149.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3154.g 517 kB/s | 34 kB 00:00 2024-05-30T16:38:52.981 INFO:teuthology.orchestra.run.smithi149.stdout:(29/159): rbd-nbd-19.0.0-3154.g9ed025fb.el9.x86 1.3 MB/s | 170 kB 00:00 2024-05-30T16:38:53.040 INFO:teuthology.orchestra.run.smithi149.stdout:(30/159): ceph-mgr-cephadm-19.0.0-3154.g9ed025f 1.5 MB/s | 142 kB 00:00 2024-05-30T16:38:53.124 INFO:teuthology.orchestra.run.smithi149.stdout:(31/159): rbd-mirror-19.0.0-3154.g9ed025fb.el9. 10 MB/s | 3.1 MB 00:00 2024-05-30T16:38:53.574 INFO:teuthology.orchestra.run.smithi149.stdout:(32/159): ceph-mgr-dashboard-19.0.0-3154.g9ed02 6.0 MB/s | 3.5 MB 00:00 2024-05-30T16:38:53.716 INFO:teuthology.orchestra.run.smithi149.stdout:(33/159): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-05-30T16:38:53.741 INFO:teuthology.orchestra.run.smithi149.stdout:(34/159): ceph-mgr-rook-19.0.0-3154.g9ed025fb.e 297 kB/s | 49 kB 00:00 2024-05-30T16:38:53.767 INFO:teuthology.orchestra.run.smithi149.stdout:(35/159): ceph-prometheus-alerts-19.0.0-3154.g9 334 kB/s | 16 kB 00:00 2024-05-30T16:38:53.792 INFO:teuthology.orchestra.run.smithi149.stdout:(36/159): ceph-mgr-modules-core-19.0.0-3154.g9e 378 kB/s | 252 kB 00:00 2024-05-30T16:38:53.826 INFO:teuthology.orchestra.run.smithi149.stdout:(37/159): ceph-volume-19.0.0-3154.g9ed025fb.el9 3.2 MB/s | 273 kB 00:00 2024-05-30T16:38:53.851 INFO:teuthology.orchestra.run.smithi149.stdout:(38/159): cephfs-top-19.0.0-3154.g9ed025fb.el9. 315 kB/s | 18 kB 00:00 2024-05-30T16:38:53.893 INFO:teuthology.orchestra.run.smithi149.stdout:(39/159): cephadm-19.0.0-3154.g9ed025fb.el9.noa 5.9 MB/s | 762 kB 00:00 2024-05-30T16:38:53.985 INFO:teuthology.orchestra.run.smithi149.stdout:(40/159): fuse-2.9.9-15.el9.x86_64.rpm 508 kB/s | 80 kB 00:00 2024-05-30T16:38:54.035 INFO:teuthology.orchestra.run.smithi149.stdout:(41/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-05-30T16:38:54.086 INFO:teuthology.orchestra.run.smithi149.stdout:(42/159): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-05-30T16:38:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:(43/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-05-30T16:38:54.161 INFO:teuthology.orchestra.run.smithi149.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-05-30T16:38:54.220 INFO:teuthology.orchestra.run.smithi149.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-30T16:38:54.253 INFO:teuthology.orchestra.run.smithi149.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-05-30T16:38:54.287 INFO:teuthology.orchestra.run.smithi149.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-05-30T16:38:54.337 INFO:teuthology.orchestra.run.smithi149.stdout:(48/159): python3-cryptography-36.0.1-4.el9.x86 4.1 MB/s | 1.2 MB 00:00 2024-05-30T16:38:54.838 INFO:teuthology.orchestra.run.smithi149.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 214 kB/s | 107 kB 00:00 2024-05-30T16:38:54.954 INFO:teuthology.orchestra.run.smithi149.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 187 kB/s | 22 kB 00:00 2024-05-30T16:38:55.055 INFO:teuthology.orchestra.run.smithi149.stdout:(51/159): automake-1.16.2-8.el9.noarch.rpm 861 kB/s | 689 kB 00:00 2024-05-30T16:38:55.188 INFO:teuthology.orchestra.run.smithi149.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 246 kB/s | 33 kB 00:00 2024-05-30T16:38:55.247 INFO:teuthology.orchestra.run.smithi149.stdout:(53/159): bison-3.7.4-5.el9.x86_64.rpm 983 kB/s | 943 kB 00:00 2024-05-30T16:38:55.415 INFO:teuthology.orchestra.run.smithi149.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 109 kB/s | 18 kB 00:00 2024-05-30T16:38:55.448 INFO:teuthology.orchestra.run.smithi149.stdout:(55/159): flex-2.6.4-9.el9.x86_64.rpm 637 kB/s | 313 kB 00:00 2024-05-30T16:38:55.523 INFO:teuthology.orchestra.run.smithi149.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 104 kB/s | 11 kB 00:00 2024-05-30T16:38:55.556 INFO:teuthology.orchestra.run.smithi149.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.5 MB/s | 160 kB 00:00 2024-05-30T16:38:55.665 INFO:teuthology.orchestra.run.smithi149.stdout:(58/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.3 MB/s | 3.0 MB 00:00 2024-05-30T16:38:55.690 INFO:teuthology.orchestra.run.smithi149.stdout:(59/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 271 kB/s | 45 kB 00:00 2024-05-30T16:38:55.791 INFO:teuthology.orchestra.run.smithi149.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 4.6 MB/s | 582 kB 00:00 2024-05-30T16:38:55.816 INFO:teuthology.orchestra.run.smithi149.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 204 kB/s | 25 kB 00:00 2024-05-30T16:38:55.858 INFO:teuthology.orchestra.run.smithi149.stdout:(62/159): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-05-30T16:38:55.908 INFO:teuthology.orchestra.run.smithi149.stdout:(63/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 407 kB/s | 47 kB 00:00 2024-05-30T16:38:55.942 INFO:teuthology.orchestra.run.smithi149.stdout:(64/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-05-30T16:38:55.984 INFO:teuthology.orchestra.run.smithi149.stdout:(65/159): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-30T16:38:56.009 INFO:teuthology.orchestra.run.smithi149.stdout:(66/159): openblas-0.3.21-2.el9.x86_64.rpm 352 kB/s | 35 kB 00:00 2024-05-30T16:38:56.168 INFO:teuthology.orchestra.run.smithi149.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-30T16:38:56.273 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-30T16:38:56.710 INFO:teuthology.orchestra.run.smithi149.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 6.2 MB/s | 4.7 MB 00:00 2024-05-30T16:38:56.977 INFO:teuthology.orchestra.run.smithi149.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 501 kB/s | 133 kB 00:00 2024-05-30T16:38:57.452 INFO:teuthology.orchestra.run.smithi149.stdout:(70/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.0 MB/s | 4.4 MB 00:01 2024-05-30T16:38:57.511 INFO:teuthology.orchestra.run.smithi149.stdout:(71/159): postgresql-contrib-13.14-1.el9.x86_64 679 kB/s | 911 kB 00:01 2024-05-30T16:38:57.702 INFO:teuthology.orchestra.run.smithi149.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 458 kB/s | 87 kB 00:00 2024-05-30T16:38:58.876 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-30T16:38:58.878 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-30T16:38:58.894 INFO:teuthology.orchestra.run.smithi149.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 717 kB/s | 1.0 MB 00:01 2024-05-30T16:38:58.898 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-30T16:38:58.899 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-30T16:38:58.901 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-30T16:38:58.902 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-30T16:38:58.905 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-30T16:38:58.908 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-30T16:38:58.909 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-30T16:38:58.982 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-05-30T16:38:59.006 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-05-30T16:38:59.006 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 6.6 k 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 5.4 M 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 890 k 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 145 k 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 1.5 M 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 142 k 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 3.5 M 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 7.4 M 2024-05-30T16:38:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 49 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 11 M 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 49 M 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 273 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 762 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 225 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 27 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 18 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 32 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 746 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 127 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-30T16:38:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 161 k 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 321 k 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 298 k 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 100 k 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 85 k 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 3.1 M 2024-05-30T16:38:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 170 k 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 3.4 M 2024-05-30T16:38:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 3.1 M 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 21 M 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 34 k 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 2.4 M 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 252 k 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 4.7 M 2024-05-30T16:38:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 17 M 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3154.g9ed025fb.el9 ceph-noarch 16 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 25 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 164 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-30T16:38:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 501 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 5.4 M 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-30T16:38:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-30T16:38:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 45 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:19.0.0-3154.g9ed025fb.el9 ceph 135 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-30T16:38:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-30T16:38:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-30T16:38:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-30T16:38:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-30T16:38:59.019 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-05-30T16:38:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-30T16:38:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:38:59.020 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-05-30T16:38:59.020 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-05-30T16:38:59.020 INFO:teuthology.orchestra.run.smithi144.stdout:Install 148 Packages 2024-05-30T16:38:59.020 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 11 Packages 2024-05-30T16:38:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:38:59.020 INFO:teuthology.orchestra.run.smithi149.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 529 kB/s | 61 kB 00:00 2024-05-30T16:38:59.021 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 227 M 2024-05-30T16:38:59.021 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-05-30T16:38:59.362 INFO:teuthology.orchestra.run.smithi149.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 698 kB/s | 244 kB 00:00 2024-05-30T16:38:59.712 INFO:teuthology.orchestra.run.smithi149.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 710 kB/s | 248 kB 00:00 2024-05-30T16:38:59.820 INFO:teuthology.orchestra.run.smithi149.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 238 kB/s | 26 kB 00:00 2024-05-30T16:38:59.825 INFO:teuthology.orchestra.run.smithi144.stdout:(1/159): ceph-19.0.0-3154.g9ed025fb.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-05-30T16:38:59.929 INFO:teuthology.orchestra.run.smithi149.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 178 kB/s | 19 kB 00:00 2024-05-30T16:39:00.196 INFO:teuthology.orchestra.run.smithi149.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 647 kB/s | 172 kB 00:00 2024-05-30T16:39:00.305 INFO:teuthology.orchestra.run.smithi149.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 323 kB/s | 35 kB 00:00 2024-05-30T16:39:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:(2/159): ceph-fuse-19.0.0-3154.g9ed025fb.el9.x8 1.4 MB/s | 890 kB 00:00 2024-05-30T16:39:00.569 INFO:teuthology.orchestra.run.smithi144.stdout:(3/159): ceph-immutable-object-cache-19.0.0-315 1.2 MB/s | 145 kB 00:00 2024-05-30T16:39:01.035 INFO:teuthology.orchestra.run.smithi144.stdout:(4/159): ceph-common-19.0.0-3154.g9ed025fb.el9. 14 MB/s | 21 MB 00:01 2024-05-30T16:39:01.168 INFO:teuthology.orchestra.run.smithi144.stdout:(5/159): ceph-mgr-19.0.0-3154.g9ed025fb.el9.x86 11 MB/s | 1.5 MB 00:00 2024-05-30T16:39:01.435 INFO:teuthology.orchestra.run.smithi144.stdout:(6/159): ceph-mds-19.0.0-3154.g9ed025fb.el9.x86 2.7 MB/s | 2.4 MB 00:00 2024-05-30T16:39:01.544 INFO:teuthology.orchestra.run.smithi144.stdout:(7/159): ceph-mon-19.0.0-3154.g9ed025fb.el9.x86 13 MB/s | 4.7 MB 00:00 2024-05-30T16:39:01.694 INFO:teuthology.orchestra.run.smithi144.stdout:(8/159): ceph-base-19.0.0-3154.g9ed025fb.el9.x8 2.5 MB/s | 5.4 MB 00:02 2024-05-30T16:39:01.753 INFO:teuthology.orchestra.run.smithi144.stdout:(9/159): ceph-selinux-19.0.0-3154.g9ed025fb.el9 439 kB/s | 25 kB 00:00 2024-05-30T16:39:02.211 INFO:teuthology.orchestra.run.smithi144.stdout:(10/159): ceph-radosgw-19.0.0-3154.g9ed025fb.el 16 MB/s | 11 MB 00:00 2024-05-30T16:39:02.311 INFO:teuthology.orchestra.run.smithi144.stdout:(11/159): cephfs-mirror-19.0.0-3154.g9ed025fb.e 2.2 MB/s | 225 kB 00:00 2024-05-30T16:39:02.362 INFO:teuthology.orchestra.run.smithi144.stdout:(12/159): cephfs-shell-19.0.0-3154.g9ed025fb.el 551 kB/s | 27 kB 00:00 2024-05-30T16:39:02.420 INFO:teuthology.orchestra.run.smithi144.stdout:(13/159): libcephfs-devel-19.0.0-3154.g9ed025fb 554 kB/s | 32 kB 00:00 2024-05-30T16:39:02.529 INFO:teuthology.orchestra.run.smithi144.stdout:(14/159): libcephfs2-19.0.0-3154.g9ed025fb.el9. 6.8 MB/s | 746 kB 00:00 2024-05-30T16:39:02.621 INFO:teuthology.orchestra.run.smithi144.stdout:(15/159): libcephsqlite-19.0.0-3154.g9ed025fb.e 1.8 MB/s | 164 kB 00:00 2024-05-30T16:39:02.663 INFO:teuthology.orchestra.run.smithi149.stdout:(81/159): postgresql-server-13.14-1.el9.x86_64. 1.0 MB/s | 5.8 MB 00:05 2024-05-30T16:39:02.680 INFO:teuthology.orchestra.run.smithi144.stdout:(16/159): librados-devel-19.0.0-3154.g9ed025fb. 2.2 MB/s | 127 kB 00:00 2024-05-30T16:39:02.771 INFO:teuthology.orchestra.run.smithi144.stdout:(17/159): libradosstriper1-19.0.0-3154.g9ed025f 5.4 MB/s | 501 kB 00:00 2024-05-30T16:39:03.014 INFO:teuthology.orchestra.run.smithi149.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 718 kB/s | 250 kB 00:00 2024-05-30T16:39:03.188 INFO:teuthology.orchestra.run.smithi144.stdout:(18/159): librgw2-19.0.0-3154.g9ed025fb.el9.x86 13 MB/s | 5.4 MB 00:00 2024-05-30T16:39:03.255 INFO:teuthology.orchestra.run.smithi144.stdout:(19/159): python3-ceph-argparse-19.0.0-3154.g9e 683 kB/s | 45 kB 00:00 2024-05-30T16:39:03.364 INFO:teuthology.orchestra.run.smithi149.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 636 kB/s | 222 kB 00:00 2024-05-30T16:39:03.497 INFO:teuthology.orchestra.run.smithi144.stdout:(20/159): ceph-osd-19.0.0-3154.g9ed025fb.el9.x8 8.2 MB/s | 17 MB 00:02 2024-05-30T16:39:03.564 INFO:teuthology.orchestra.run.smithi149.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 387 kB/s | 77 kB 00:00 2024-05-30T16:39:03.564 INFO:teuthology.orchestra.run.smithi144.stdout:(21/159): python3-ceph-common-19.0.0-3154.g9ed0 438 kB/s | 135 kB 00:00 2024-05-30T16:39:03.598 INFO:teuthology.orchestra.run.smithi144.stdout:(22/159): python3-cephfs-19.0.0-3154.g9ed025fb. 1.6 MB/s | 161 kB 00:00 2024-05-30T16:39:03.648 INFO:teuthology.orchestra.run.smithi144.stdout:(23/159): python3-rados-19.0.0-3154.g9ed025fb.e 3.8 MB/s | 321 kB 00:00 2024-05-30T16:39:03.673 INFO:teuthology.orchestra.run.smithi149.stdout:(85/159): python3-prettytable-0.7.2-27.el9.noar 392 kB/s | 42 kB 00:00 2024-05-30T16:39:03.682 INFO:teuthology.orchestra.run.smithi144.stdout:(24/159): python3-rbd-19.0.0-3154.g9ed025fb.el9 3.5 MB/s | 298 kB 00:00 2024-05-30T16:39:03.715 INFO:teuthology.orchestra.run.smithi144.stdout:(25/159): python3-rgw-19.0.0-3154.g9ed025fb.el9 1.5 MB/s | 100 kB 00:00 2024-05-30T16:39:03.741 INFO:teuthology.orchestra.run.smithi144.stdout:(26/159): rbd-fuse-19.0.0-3154.g9ed025fb.el9.x8 1.4 MB/s | 85 kB 00:00 2024-05-30T16:39:03.844 INFO:teuthology.orchestra.run.smithi144.stdout:(27/159): rbd-nbd-19.0.0-3154.g9ed025fb.el9.x86 1.6 MB/s | 170 kB 00:00 2024-05-30T16:39:03.942 INFO:teuthology.orchestra.run.smithi144.stdout:(28/159): rbd-mirror-19.0.0-3154.g9ed025fb.el9. 14 MB/s | 3.1 MB 00:00 2024-05-30T16:39:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:(29/159): ceph-grafana-dashboards-19.0.0-3154.g 281 kB/s | 34 kB 00:00 2024-05-30T16:39:04.001 INFO:teuthology.orchestra.run.smithi144.stdout:(30/159): ceph-mgr-cephadm-19.0.0-3154.g9ed025f 2.4 MB/s | 142 kB 00:00 2024-05-30T16:39:04.106 INFO:teuthology.orchestra.run.smithi149.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 622 kB/s | 269 kB 00:00 2024-05-30T16:39:04.373 INFO:teuthology.orchestra.run.smithi149.stdout:(87/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 596 kB/s | 159 kB 00:00 2024-05-30T16:39:04.471 INFO:teuthology.orchestra.run.smithi144.stdout:(31/159): ceph-mgr-dashboard-19.0.0-3154.g9ed02 7.0 MB/s | 3.5 MB 00:00 2024-05-30T16:39:04.618 INFO:teuthology.orchestra.run.smithi144.stdout:(32/159): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-05-30T16:39:04.652 INFO:teuthology.orchestra.run.smithi144.stdout:(33/159): ceph-mgr-modules-core-19.0.0-3154.g9e 1.4 MB/s | 252 kB 00:00 2024-05-30T16:39:04.677 INFO:teuthology.orchestra.run.smithi144.stdout:(34/159): ceph-mgr-rook-19.0.0-3154.g9ed025fb.e 855 kB/s | 49 kB 00:00 2024-05-30T16:39:04.719 INFO:teuthology.orchestra.run.smithi144.stdout:(35/159): ceph-prometheus-alerts-19.0.0-3154.g9 249 kB/s | 16 kB 00:00 2024-05-30T16:39:04.753 INFO:teuthology.orchestra.run.smithi144.stdout:(36/159): ceph-volume-19.0.0-3154.g9ed025fb.el9 3.6 MB/s | 273 kB 00:00 2024-05-30T16:39:04.807 INFO:teuthology.orchestra.run.smithi149.stdout:(88/159): python3-pyasn1-modules-0.4.8-6.el9.no 644 kB/s | 279 kB 00:00 2024-05-30T16:39:04.834 INFO:teuthology.orchestra.run.smithi144.stdout:(37/159): cephfs-top-19.0.0-3154.g9ed025fb.el9. 227 kB/s | 18 kB 00:00 2024-05-30T16:39:04.878 INFO:teuthology.orchestra.run.smithi144.stdout:(38/159): cephadm-19.0.0-3154.g9ed025fb.el9.noa 4.7 MB/s | 762 kB 00:00 2024-05-30T16:39:04.924 INFO:teuthology.orchestra.run.smithi149.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 440 kB/s | 51 kB 00:00 2024-05-30T16:39:05.032 INFO:teuthology.orchestra.run.smithi149.stdout:(90/159): python3-requests-oauthlib-1.3.0-12.el 498 kB/s | 54 kB 00:00 2024-05-30T16:39:05.253 INFO:teuthology.orchestra.run.smithi144.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 192 kB/s | 80 kB 00:00 2024-05-30T16:39:05.638 INFO:teuthology.orchestra.run.smithi144.stdout:(40/159): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-05-30T16:39:05.777 INFO:teuthology.orchestra.run.smithi144.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-05-30T16:39:05.804 INFO:teuthology.orchestra.run.smithi144.stdout:(42/159): libquadmath-11.4.1-3.el9.x86_64.rpm 355 kB/s | 195 kB 00:00 2024-05-30T16:39:05.975 INFO:teuthology.orchestra.run.smithi149.stdout:(91/159): python3-babel-2.9.1-2.el9.noarch.rpm 738 kB/s | 6.0 MB 00:08 2024-05-30T16:39:06.083 INFO:teuthology.orchestra.run.smithi149.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 388 kB/s | 42 kB 00:00 2024-05-30T16:39:06.096 INFO:teuthology.orchestra.run.smithi144.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 366 kB/s | 106 kB 00:00 2024-05-30T16:39:06.155 INFO:teuthology.orchestra.run.smithi144.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 3.2 MB/s | 1.2 MB 00:00 2024-05-30T16:39:06.217 INFO:teuthology.orchestra.run.smithi149.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 332 kB/s | 44 kB 00:00 2024-05-30T16:39:06.280 INFO:teuthology.orchestra.run.smithi144.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-05-30T16:39:06.416 INFO:teuthology.orchestra.run.smithi144.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-05-30T16:39:06.472 INFO:teuthology.orchestra.run.smithi144.stdout:(47/159): python3-pycparser-2.20-6.el9.noarch.r 361 kB/s | 135 kB 00:00 2024-05-30T16:39:06.570 INFO:teuthology.orchestra.run.smithi149.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 632 kB/s | 221 kB 00:00 2024-05-30T16:39:06.598 INFO:teuthology.orchestra.run.smithi144.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-05-30T16:39:06.648 INFO:teuthology.orchestra.run.smithi144.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-05-30T16:39:06.676 INFO:teuthology.orchestra.run.smithi149.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 333 kB/s | 36 kB 00:00 2024-05-30T16:39:06.756 INFO:teuthology.orchestra.run.smithi144.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 202 kB/s | 22 kB 00:00 2024-05-30T16:39:06.784 INFO:teuthology.orchestra.run.smithi149.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 440 kB/s | 47 kB 00:00 2024-05-30T16:39:06.849 INFO:teuthology.orchestra.run.smithi144.stdout:(51/159): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 943 kB 00:00 2024-05-30T16:39:06.882 INFO:teuthology.orchestra.run.smithi144.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-05-30T16:39:06.933 INFO:teuthology.orchestra.run.smithi144.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 393 kB/s | 33 kB 00:00 2024-05-30T16:39:06.975 INFO:teuthology.orchestra.run.smithi144.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 448 kB/s | 18 kB 00:00 2024-05-30T16:39:07.056 INFO:teuthology.orchestra.run.smithi144.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 139 kB/s | 11 kB 00:00 2024-05-30T16:39:07.117 INFO:teuthology.orchestra.run.smithi144.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.6 MB/s | 160 kB 00:00 2024-05-30T16:39:07.167 INFO:teuthology.orchestra.run.smithi144.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 916 kB/s | 45 kB 00:00 2024-05-30T16:39:07.218 INFO:teuthology.orchestra.run.smithi149.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 705 kB/s | 305 kB 00:00 2024-05-30T16:39:07.251 INFO:teuthology.orchestra.run.smithi144.stdout:(58/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.1 MB/s | 3.0 MB 00:00 2024-05-30T16:39:07.301 INFO:teuthology.orchestra.run.smithi144.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-05-30T16:39:07.367 INFO:teuthology.orchestra.run.smithi144.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 5.0 MB/s | 582 kB 00:00 2024-05-30T16:39:07.376 INFO:teuthology.orchestra.run.smithi149.stdout:(98/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 738 kB/s | 5.1 MB 00:07 2024-05-30T16:39:07.402 INFO:teuthology.orchestra.run.smithi149.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 316 kB/s | 58 kB 00:00 2024-05-30T16:39:07.410 INFO:teuthology.orchestra.run.smithi144.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 236 kB/s | 25 kB 00:00 2024-05-30T16:39:07.485 INFO:teuthology.orchestra.run.smithi144.stdout:(62/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-05-30T16:39:07.569 INFO:teuthology.orchestra.run.smithi144.stdout:(63/159): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-05-30T16:39:07.577 INFO:teuthology.orchestra.run.smithi149.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 470 kB/s | 94 kB 00:00 2024-05-30T16:39:07.602 INFO:teuthology.orchestra.run.smithi149.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 319 kB/s | 64 kB 00:00 2024-05-30T16:39:07.619 INFO:teuthology.orchestra.run.smithi144.stdout:(64/159): openblas-0.3.21-2.el9.x86_64.rpm 714 kB/s | 35 kB 00:00 2024-05-30T16:39:07.686 INFO:teuthology.orchestra.run.smithi149.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 414 kB/s | 45 kB 00:00 2024-05-30T16:39:07.711 INFO:teuthology.orchestra.run.smithi149.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-05-30T16:39:07.728 INFO:teuthology.orchestra.run.smithi144.stdout:(65/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 132 kB/s | 47 kB 00:00 2024-05-30T16:39:07.862 INFO:teuthology.orchestra.run.smithi149.stdout:(104/159): abseil-cpp-20211102.0-3.el9.x86_64.r 3.6 MB/s | 548 kB 00:00 2024-05-30T16:39:07.928 INFO:teuthology.orchestra.run.smithi149.stdout:(105/159): gperftools-libs-2.9.1-2.el9.x86_64.r 4.6 MB/s | 309 kB 00:00 2024-05-30T16:39:07.970 INFO:teuthology.orchestra.run.smithi149.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 472 kB/s | 19 kB 00:00 2024-05-30T16:39:07.998 INFO:teuthology.orchestra.run.smithi144.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-05-30T16:39:08.104 INFO:teuthology.orchestra.run.smithi144.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-30T16:39:08.146 INFO:teuthology.orchestra.run.smithi149.stdout:(107/159): libarrow-9.0.0-11.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-05-30T16:39:08.179 INFO:teuthology.orchestra.run.smithi149.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 794 kB/s | 26 kB 00:00 2024-05-30T16:39:08.213 INFO:teuthology.orchestra.run.smithi149.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-05-30T16:39:08.247 INFO:teuthology.orchestra.run.smithi149.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-05-30T16:39:08.297 INFO:teuthology.orchestra.run.smithi149.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-05-30T16:39:08.354 INFO:teuthology.orchestra.run.smithi144.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 3.6 MB/s | 911 kB 00:00 2024-05-30T16:39:08.372 INFO:teuthology.orchestra.run.smithi149.stdout:(112/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-05-30T16:39:08.431 INFO:teuthology.orchestra.run.smithi149.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 9.3 MB/s | 548 kB 00:00 2024-05-30T16:39:08.473 INFO:teuthology.orchestra.run.smithi149.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-05-30T16:39:08.496 INFO:teuthology.orchestra.run.smithi144.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 944 kB/s | 133 kB 00:00 2024-05-30T16:39:08.556 INFO:teuthology.orchestra.run.smithi149.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 390 kB/s | 32 kB 00:00 2024-05-30T16:39:08.607 INFO:teuthology.orchestra.run.smithi149.stdout:(116/159): python3-certifi-2021.10.8-2.el9.noar 305 kB/s | 15 kB 00:00 2024-05-30T16:39:08.648 INFO:teuthology.orchestra.run.smithi149.stdout:(117/159): python3-cheroot-8.6.0-4.el9.noarch.r 4.1 MB/s | 172 kB 00:00 2024-05-30T16:39:08.699 INFO:teuthology.orchestra.run.smithi149.stdout:(118/159): python3-cherrypy-18.6.1-2.el9.noarch 7.1 MB/s | 358 kB 00:00 2024-05-30T16:39:08.758 INFO:teuthology.orchestra.run.smithi149.stdout:(119/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-05-30T16:39:08.804 INFO:teuthology.orchestra.run.smithi144.stdout:(70/159): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-05-30T16:39:08.816 INFO:teuthology.orchestra.run.smithi149.stdout:(120/159): python3-google-auth-2.29.0-1.el9.noa 3.5 MB/s | 206 kB 00:00 2024-05-30T16:39:08.897 INFO:teuthology.orchestra.run.smithi144.stdout:(71/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-05-30T16:39:08.958 INFO:teuthology.orchestra.run.smithi149.stdout:(121/159): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-05-30T16:39:09.000 INFO:teuthology.orchestra.run.smithi149.stdout:(122/159): protobuf-compiler-3.14.0-13.el9.x86_ 657 kB/s | 863 kB 00:01 2024-05-30T16:39:09.022 INFO:teuthology.orchestra.run.smithi144.stdout:(72/159): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-05-30T16:39:09.034 INFO:teuthology.orchestra.run.smithi149.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-05-30T16:39:09.047 INFO:teuthology.orchestra.run.smithi144.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 586 kB/s | 87 kB 00:00 2024-05-30T16:39:09.084 INFO:teuthology.orchestra.run.smithi149.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2024-05-30T16:39:09.110 INFO:teuthology.orchestra.run.smithi149.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 237 kB/s | 18 kB 00:00 2024-05-30T16:39:09.135 INFO:teuthology.orchestra.run.smithi149.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 467 kB/s | 23 kB 00:00 2024-05-30T16:39:09.160 INFO:teuthology.orchestra.run.smithi149.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 393 kB/s | 19 kB 00:00 2024-05-30T16:39:09.185 INFO:teuthology.orchestra.run.smithi149.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 398 kB/s | 20 kB 00:00 2024-05-30T16:39:09.219 INFO:teuthology.orchestra.run.smithi149.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-05-30T16:39:09.306 INFO:teuthology.orchestra.run.smithi144.stdout:(74/159): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-05-30T16:39:09.311 INFO:teuthology.orchestra.run.smithi149.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-05-30T16:39:09.331 INFO:teuthology.orchestra.run.smithi144.stdout:(75/159): python3-colorama-0.4.6-3.el9.noarch.r 216 kB/s | 61 kB 00:00 2024-05-30T16:39:09.336 INFO:teuthology.orchestra.run.smithi149.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 678 kB/s | 79 kB 00:00 2024-05-30T16:39:09.362 INFO:teuthology.orchestra.run.smithi149.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-30T16:39:09.365 INFO:teuthology.orchestra.run.smithi144.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-05-30T16:39:09.403 INFO:teuthology.orchestra.run.smithi149.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-30T16:39:09.415 INFO:teuthology.orchestra.run.smithi144.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 521 kB/s | 26 kB 00:00 2024-05-30T16:39:09.429 INFO:teuthology.orchestra.run.smithi149.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 247 kB/s | 16 kB 00:00 2024-05-30T16:39:09.454 INFO:teuthology.orchestra.run.smithi149.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-30T16:39:09.482 INFO:teuthology.orchestra.run.smithi144.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 290 kB/s | 19 kB 00:00 2024-05-30T16:39:09.488 INFO:teuthology.orchestra.run.smithi149.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 488 kB/s | 28 kB 00:00 2024-05-30T16:39:09.513 INFO:teuthology.orchestra.run.smithi149.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 529 kB/s | 31 kB 00:00 2024-05-30T16:39:09.580 INFO:teuthology.orchestra.run.smithi149.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-05-30T16:39:09.587 INFO:teuthology.orchestra.run.smithi144.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-05-30T16:39:09.605 INFO:teuthology.orchestra.run.smithi149.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 648 kB/s | 59 kB 00:00 2024-05-30T16:39:09.630 INFO:teuthology.orchestra.run.smithi149.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 723 kB/s | 36 kB 00:00 2024-05-30T16:39:09.641 INFO:teuthology.orchestra.run.smithi144.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 655 kB/s | 35 kB 00:00 2024-05-30T16:39:09.656 INFO:teuthology.orchestra.run.smithi149.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-30T16:39:09.689 INFO:teuthology.orchestra.run.smithi149.stdout:(142/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-05-30T16:39:09.715 INFO:teuthology.orchestra.run.smithi149.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-05-30T16:39:09.757 INFO:teuthology.orchestra.run.smithi149.stdout:(144/159): python3-werkzeug-2.0.3-3.el9.1.noarc 6.3 MB/s | 427 kB 00:00 2024-05-30T16:39:09.766 INFO:teuthology.orchestra.run.smithi144.stdout:(81/159): python3-jinja2-2.11.3-6.el9.noarch.rp 572 kB/s | 248 kB 00:00 2024-05-30T16:39:09.773 INFO:teuthology.orchestra.run.smithi149.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 345 kB/s | 20 kB 00:00 2024-05-30T16:39:09.807 INFO:teuthology.orchestra.run.smithi149.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-05-30T16:39:09.883 INFO:teuthology.orchestra.run.smithi149.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-30T16:39:09.958 INFO:teuthology.orchestra.run.smithi144.stdout:(82/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-05-30T16:39:10.017 INFO:teuthology.orchestra.run.smithi144.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-05-30T16:39:10.067 INFO:teuthology.orchestra.run.smithi144.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-30T16:39:10.101 INFO:teuthology.orchestra.run.smithi144.stdout:(85/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 751 kB/s | 250 kB 00:00 2024-05-30T16:39:10.158 INFO:teuthology.orchestra.run.smithi149.stdout:(148/159): librados2-19.0.0-3154.g9ed025fb.el9. 9.7 MB/s | 3.4 MB 00:00 2024-05-30T16:39:10.218 INFO:teuthology.orchestra.run.smithi144.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-05-30T16:39:10.251 INFO:teuthology.orchestra.run.smithi144.stdout:(87/159): python3-prettytable-0.7.2-27.el9.noar 231 kB/s | 42 kB 00:00 2024-05-30T16:39:10.325 INFO:teuthology.orchestra.run.smithi149.stdout:(149/159): librbd1-19.0.0-3154.g9ed025fb.el9.x8 7.1 MB/s | 3.1 MB 00:00 2024-05-30T16:39:10.343 INFO:teuthology.orchestra.run.smithi144.stdout:(88/159): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-05-30T16:39:10.394 INFO:teuthology.orchestra.run.smithi144.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-30T16:39:10.452 INFO:teuthology.orchestra.run.smithi144.stdout:(90/159): python3-requests-oauthlib-1.3.0-12.el 931 kB/s | 54 kB 00:00 2024-05-30T16:39:10.459 INFO:teuthology.orchestra.run.smithi149.stdout:(150/159): NetworkManager-1.47.91-1.el9.x86_64. 7.7 MB/s | 2.3 MB 00:00 2024-05-30T16:39:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:(151/159): NetworkManager-libnm-1.47.91-1.el9.x 8.3 MB/s | 1.8 MB 00:00 2024-05-30T16:39:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:(152/159): NetworkManager-team-1.47.91-1.el9.x8 312 kB/s | 41 kB 00:00 2024-05-30T16:39:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:(153/159): NetworkManager-tui-1.47.91-1.el9.x86 2.2 MB/s | 248 kB 00:00 2024-05-30T16:39:10.677 INFO:teuthology.orchestra.run.smithi149.stdout:(154/159): elfutils-debuginfod-client-0.191-4.e 443 kB/s | 37 kB 00:00 2024-05-30T16:39:10.703 INFO:teuthology.orchestra.run.smithi144.stdout:(91/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 328 kB/s | 159 kB 00:00 2024-05-30T16:39:10.918 INFO:teuthology.orchestra.run.smithi149.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 777 kB/s | 207 kB 00:00 2024-05-30T16:39:10.952 INFO:teuthology.orchestra.run.smithi149.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 946 kB/s | 260 kB 00:00 2024-05-30T16:39:11.019 INFO:teuthology.orchestra.run.smithi149.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 14 MB/s | 1.3 MB 00:00 2024-05-30T16:39:11.061 INFO:teuthology.orchestra.run.smithi144.stdout:(92/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-05-30T16:39:11.087 INFO:teuthology.orchestra.run.smithi144.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 109 kB/s | 42 kB 00:00 2024-05-30T16:39:11.128 INFO:teuthology.orchestra.run.smithi149.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-05-30T16:39:11.128 INFO:teuthology.orchestra.run.smithi144.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 672 kB/s | 44 kB 00:00 2024-05-30T16:39:11.187 INFO:teuthology.orchestra.run.smithi144.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 622 kB/s | 36 kB 00:00 2024-05-30T16:39:11.221 INFO:teuthology.orchestra.run.smithi144.stdout:(96/159): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-05-30T16:39:11.246 INFO:teuthology.orchestra.run.smithi144.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 820 kB/s | 47 kB 00:00 2024-05-30T16:39:11.305 INFO:teuthology.orchestra.run.smithi144.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-30T16:39:11.372 INFO:teuthology.orchestra.run.smithi144.stdout:(99/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-05-30T16:39:11.439 INFO:teuthology.orchestra.run.smithi144.stdout:(100/159): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 305 kB 00:00 2024-05-30T16:39:11.497 INFO:teuthology.orchestra.run.smithi144.stdout:(101/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 779 kB/s | 45 kB 00:00 2024-05-30T16:39:11.522 INFO:teuthology.orchestra.run.smithi144.stdout:(102/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 425 kB/s | 64 kB 00:00 2024-05-30T16:39:11.548 INFO:teuthology.orchestra.run.smithi144.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 451 kB/s | 22 kB 00:00 2024-05-30T16:39:11.606 INFO:teuthology.orchestra.run.smithi144.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-05-30T16:39:12.199 INFO:teuthology.orchestra.run.smithi144.stdout:(105/159): ceph-test-19.0.0-3154.g9ed025fb.el9. 4.7 MB/s | 49 MB 00:10 2024-05-30T16:39:12.457 INFO:teuthology.orchestra.run.smithi144.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 76 kB/s | 19 kB 00:00 2024-05-30T16:39:12.716 INFO:teuthology.orchestra.run.smithi144.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 279 kB/s | 309 kB 00:01 2024-05-30T16:39:12.825 INFO:teuthology.orchestra.run.smithi144.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 241 kB/s | 26 kB 00:00 2024-05-30T16:39:12.858 INFO:teuthology.orchestra.run.smithi144.stdout:(109/159): abseil-cpp-20211102.0-3.el9.x86_64.r 419 kB/s | 548 kB 00:01 2024-05-30T16:39:12.925 INFO:teuthology.orchestra.run.smithi144.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 488 kB/s | 49 kB 00:00 2024-05-30T16:39:13.009 INFO:teuthology.orchestra.run.smithi144.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 450 kB/s | 67 kB 00:00 2024-05-30T16:39:13.084 INFO:teuthology.orchestra.run.smithi144.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 958 kB/s | 151 kB 00:00 2024-05-30T16:39:13.318 INFO:teuthology.orchestra.run.smithi144.stdout:(113/159): libarrow-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-05-30T16:39:13.372 INFO:teuthology.orchestra.run.smithi144.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 1.9 MB/s | 548 kB 00:00 2024-05-30T16:39:13.427 INFO:teuthology.orchestra.run.smithi144.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 403 kB/s | 43 kB 00:00 2024-05-30T16:39:13.477 INFO:teuthology.orchestra.run.smithi144.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 311 kB/s | 32 kB 00:00 2024-05-30T16:39:13.519 INFO:teuthology.orchestra.run.smithi144.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2024-05-30T16:39:13.594 INFO:teuthology.orchestra.run.smithi144.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-05-30T16:39:13.636 INFO:teuthology.orchestra.run.smithi144.stdout:(119/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.3 MB/s | 839 kB 00:00 2024-05-30T16:39:13.700 INFO:teuthology.orchestra.run.smithi144.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-05-30T16:39:13.737 INFO:teuthology.orchestra.run.smithi144.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-05-30T16:39:13.887 INFO:teuthology.orchestra.run.smithi144.stdout:(122/159): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-05-30T16:39:13.912 INFO:teuthology.orchestra.run.smithi144.stdout:(123/159): python3-google-auth-2.29.0-1.el9.noa 747 kB/s | 206 kB 00:00 2024-05-30T16:39:13.938 INFO:teuthology.orchestra.run.smithi144.stdout:(124/159): python3-grpcio-tools-1.46.7-10.el9.x 723 kB/s | 144 kB 00:00 2024-05-30T16:39:14.020 INFO:teuthology.orchestra.run.smithi144.stdout:(125/159): python3-jaraco-8.2.1-3.el9.noarch.rp 81 kB/s | 11 kB 00:00 2024-05-30T16:39:14.046 INFO:teuthology.orchestra.run.smithi144.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 133 kB/s | 18 kB 00:00 2024-05-30T16:39:14.071 INFO:teuthology.orchestra.run.smithi144.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 174 kB/s | 23 kB 00:00 2024-05-30T16:39:14.122 INFO:teuthology.orchestra.run.smithi144.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-05-30T16:39:14.180 INFO:teuthology.orchestra.run.smithi144.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-05-30T16:39:14.222 INFO:teuthology.orchestra.run.smithi144.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 464 kB/s | 46 kB 00:00 2024-05-30T16:39:14.273 INFO:teuthology.orchestra.run.smithi144.stdout:(131/159): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-05-30T16:39:14.348 INFO:teuthology.orchestra.run.smithi144.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 463 kB/s | 58 kB 00:00 2024-05-30T16:39:14.373 INFO:teuthology.orchestra.run.smithi144.stdout:(133/159): python3-more-itertools-8.12.0-2.el9. 410 kB/s | 79 kB 00:00 2024-05-30T16:39:14.407 INFO:teuthology.orchestra.run.smithi144.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-05-30T16:39:14.457 INFO:teuthology.orchestra.run.smithi144.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-05-30T16:39:14.482 INFO:teuthology.orchestra.run.smithi144.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 833 kB/s | 90 kB 00:00 2024-05-30T16:39:14.508 INFO:teuthology.orchestra.run.smithi144.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 282 kB/s | 28 kB 00:00 2024-05-30T16:39:14.575 INFO:teuthology.orchestra.run.smithi144.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 264 kB/s | 31 kB 00:00 2024-05-30T16:39:14.609 INFO:teuthology.orchestra.run.smithi144.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-05-30T16:39:14.659 INFO:teuthology.orchestra.run.smithi144.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 394 kB/s | 59 kB 00:00 2024-05-30T16:39:14.692 INFO:teuthology.orchestra.run.smithi144.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 307 kB/s | 36 kB 00:00 2024-05-30T16:39:14.717 INFO:teuthology.orchestra.run.smithi144.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 471 kB/s | 51 kB 00:00 2024-05-30T16:39:14.768 INFO:teuthology.orchestra.run.smithi144.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-30T16:39:14.826 INFO:teuthology.orchestra.run.smithi144.stdout:(144/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.9 MB/s | 427 kB 00:00 2024-05-30T16:39:14.852 INFO:teuthology.orchestra.run.smithi144.stdout:(145/159): python3-websocket-client-1.2.3-2.el9 566 kB/s | 90 kB 00:00 2024-05-30T16:39:14.877 INFO:teuthology.orchestra.run.smithi144.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-05-30T16:39:14.927 INFO:teuthology.orchestra.run.smithi144.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-05-30T16:39:15.336 INFO:teuthology.orchestra.run.smithi144.stdout:(148/159): librados2-19.0.0-3154.g9ed025fb.el9. 7.4 MB/s | 3.4 MB 00:00 2024-05-30T16:39:15.595 INFO:teuthology.orchestra.run.smithi144.stdout:(149/159): librbd1-19.0.0-3154.g9ed025fb.el9.x8 4.7 MB/s | 3.1 MB 00:00 2024-05-30T16:39:15.653 INFO:teuthology.orchestra.run.smithi144.stdout:(150/159): thrift-0.15.0-2.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-05-30T16:39:16.012 INFO:teuthology.orchestra.run.smithi144.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 116 kB/s | 41 kB 00:00 2024-05-30T16:39:16.421 INFO:teuthology.orchestra.run.smithi144.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 608 kB/s | 248 kB 00:00 2024-05-30T16:39:16.529 INFO:teuthology.orchestra.run.smithi144.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 342 kB/s | 37 kB 00:00 2024-05-30T16:39:16.605 INFO:teuthology.orchestra.run.smithi144.stdout:(154/159): NetworkManager-1.47.91-1.el9.x86_64. 1.8 MB/s | 2.3 MB 00:01 2024-05-30T16:39:16.663 INFO:teuthology.orchestra.run.smithi144.stdout:(155/159): NetworkManager-libnm-1.47.91-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-05-30T16:39:16.722 INFO:teuthology.orchestra.run.smithi144.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 2.2 MB/s | 260 kB 00:00 2024-05-30T16:39:16.755 INFO:teuthology.orchestra.run.smithi144.stdout:(157/159): elfutils-libelf-0.191-4.el9.x86_64.r 919 kB/s | 207 kB 00:00 2024-05-30T16:39:16.906 INFO:teuthology.orchestra.run.smithi144.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 5.6 MB/s | 1.3 MB 00:00 2024-05-30T16:39:16.989 INFO:teuthology.orchestra.run.smithi144.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.0 MB/s | 2.4 MB 00:00 2024-05-30T16:39:16.996 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-05-30T16:39:16.997 INFO:teuthology.orchestra.run.smithi144.stdout:Total 13 MB/s | 227 MB 00:17 2024-05-30T16:39:20.064 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-05-30T16:39:20.317 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-05-30T16:39:20.317 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-05-30T16:39:22.836 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-05-30T16:39:22.836 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-05-30T16:39:27.177 INFO:teuthology.orchestra.run.smithi149.stdout:(159/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 752 kB/s | 16 MB 00:22 2024-05-30T16:39:27.183 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-05-30T16:39:27.184 INFO:teuthology.orchestra.run.smithi149.stdout:Total 5.4 MB/s | 227 MB 00:41 2024-05-30T16:39:29.933 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-05-30T16:39:30.032 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-30T16:39:30.143 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-30T16:39:30.204 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-05-30T16:39:30.274 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-30T16:39:30.338 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-30T16:39:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-30T16:39:30.453 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-05-30T16:39:30.453 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-05-30T16:39:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-30T16:39:30.968 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-30T16:39:31.106 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:19.0.0-3154.g9ed025fb.el9.x86_64 8/170 2024-05-30T16:39:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:19.0.0-3154.g9ed025fb.el9.x86_64 8/170 2024-05-30T16:39:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:19.0.0-3154.g9ed025fb.el9.x86_64 9/170 2024-05-30T16:39:31.452 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:19.0.0-3154.g9ed025fb.el9.x86_64 9/170 2024-05-30T16:39:31.491 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:19.0.0-3154.g9ed025fb.el9.x86_64 10/170 2024-05-30T16:39:31.556 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-30T16:39:31.855 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-30T16:39:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-30T16:39:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:19.0.0-3154.g9ed025fb.el9.x86_64 14/170 2024-05-30T16:39:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3154.g9ed025fb.el9.x86_64 14/170 2024-05-30T16:39:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:19.0.0-3154.g9ed025fb.el9.x86 15/170 2024-05-30T16:39:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3154.g9ed025fb.el9.x86 15/170 2024-05-30T16:39:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-30T16:39:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-30T16:39:32.720 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-30T16:39:33.083 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-30T16:39:33.336 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-05-30T16:39:33.386 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-05-30T16:39:33.387 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-05-30T16:39:33.435 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-05-30T16:39:33.618 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-05-30T16:39:33.742 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-05-30T16:39:34.118 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-05-30T16:39:34.313 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-30T16:39:34.441 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-30T16:39:34.490 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-30T16:39:34.539 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-30T16:39:34.669 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-30T16:39:34.713 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-30T16:39:34.776 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-30T16:39:34.826 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-30T16:39:34.900 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-30T16:39:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-30T16:39:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-30T16:39:35.151 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-30T16:39:35.225 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-30T16:39:35.347 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-30T16:39:35.404 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:19.0.0-3154.g9ed025fb.el9. 34/170 2024-05-30T16:39:35.460 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:19.0.0-3154.g9ed025fb.el 35/170 2024-05-30T16:39:35.495 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:19.0.0-3154.g9ed025fb.el9.x86_6 36/170 2024-05-30T16:39:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-30T16:39:35.697 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-30T16:39:35.797 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-30T16:39:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-30T16:39:36.067 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-30T16:39:36.754 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-30T16:39:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-30T16:39:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-30T16:39:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-30T16:39:37.014 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-30T16:39:37.077 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:19.0.0-3154.g9ed025fb.el9.x86_6 47/170 2024-05-30T16:39:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-30T16:39:37.383 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-30T16:39:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-30T16:39:37.592 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-30T16:39:37.684 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-30T16:39:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-30T16:39:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-30T16:39:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-30T16:39:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-30T16:39:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-30T16:39:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-30T16:39:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-30T16:39:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-30T16:39:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-30T16:39:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-30T16:39:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-30T16:39:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-30T16:39:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-30T16:39:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-30T16:39:38.878 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-30T16:39:39.055 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-30T16:39:39.107 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-30T16:39:39.146 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-30T16:39:39.202 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-30T16:39:39.269 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-30T16:39:39.319 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-30T16:39:39.369 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-30T16:39:39.416 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-30T16:39:39.464 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-30T16:39:39.541 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-30T16:39:39.589 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-30T16:39:39.769 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-30T16:39:39.834 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-30T16:39:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-30T16:39:39.930 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-05-30T16:39:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-30T16:39:40.032 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-30T16:39:40.108 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-30T16:39:40.108 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-30T16:39:40.175 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-30T16:39:40.216 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-30T16:39:40.269 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-30T16:39:40.301 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-30T16:39:40.401 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-30T16:39:40.842 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-30T16:39:40.957 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:19.0.0-3154.g9ed025fb.el9.x86_64 8/170 2024-05-30T16:39:41.126 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-30T16:39:41.134 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:19.0.0-3154.g9ed025fb.el9.x86_64 8/170 2024-05-30T16:39:41.166 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:19.0.0-3154.g9ed025fb.el9.x86_64 9/170 2024-05-30T16:39:41.182 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-30T16:39:41.241 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-30T16:39:41.283 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:19.0.0-3154.g9ed025fb.el9.x86_64 9/170 2024-05-30T16:39:41.332 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:19.0.0-3154.g9ed025fb.el9.x86_64 10/170 2024-05-30T16:39:41.365 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-30T16:39:41.402 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-30T16:39:41.424 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-30T16:39:41.477 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-30T16:39:41.611 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-30T16:39:41.659 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-30T16:39:41.706 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-30T16:39:41.770 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-30T16:39:41.797 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:19.0.0-3154.g9ed025fb.el9.x86_64 14/170 2024-05-30T16:39:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-30T16:39:41.940 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-30T16:39:41.993 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3154.g9ed025fb.el9.x86_64 14/170 2024-05-30T16:39:42.023 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:19.0.0-3154.g9ed025fb.el9.x86 15/170 2024-05-30T16:39:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-30T16:39:42.159 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3154.g9ed025fb.el9.x86 15/170 2024-05-30T16:39:42.191 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-30T16:39:42.266 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-30T16:39:42.741 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-30T16:39:42.891 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-30T16:39:43.036 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-30T16:39:43.074 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-30T16:39:43.264 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-05-30T16:39:43.402 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-05-30T16:39:43.595 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-05-30T16:39:43.709 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-05-30T16:39:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-05-30T16:39:44.238 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-30T16:39:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-30T16:39:44.408 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-30T16:39:44.455 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-30T16:39:44.570 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-30T16:39:44.619 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-30T16:39:44.681 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-30T16:39:44.686 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-30T16:39:44.732 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-30T16:39:44.772 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-30T16:39:44.813 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-30T16:39:44.851 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-30T16:39:44.892 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-30T16:39:44.895 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-30T16:39:44.969 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-30T16:39:45.007 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-30T16:39:45.063 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-30T16:39:45.172 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-30T16:39:45.219 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:19.0.0-3154.g9ed025fb.el9. 34/170 2024-05-30T16:39:45.269 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:19.0.0-3154.g9ed025fb.el 35/170 2024-05-30T16:39:45.273 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-30T16:39:45.301 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:19.0.0-3154.g9ed025fb.el9.x86_6 36/170 2024-05-30T16:39:45.333 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:19.0.0-3154.g9ed025fb.el9.x86_64 103/170 2024-05-30T16:39:45.419 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-30T16:39:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:19.0.0-3154.g9ed025fb.el9.x86_64 103/170 2024-05-30T16:39:45.479 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-30T16:39:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 104/170 2024-05-30T16:39:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-30T16:39:45.580 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-30T16:39:45.763 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-30T16:39:45.834 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-30T16:39:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-30T16:39:46.387 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:19.0.0-3154.g9ed025fb.el9.x86_64 107/170 2024-05-30T16:39:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:19.0.0-3154.g9ed025fb.el9.x86_64 107/170 2024-05-30T16:39:46.539 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 108/170 2024-05-30T16:39:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-30T16:39:46.656 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-30T16:39:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-30T16:39:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-30T16:39:46.814 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-30T16:39:46.871 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:19.0.0-3154.g9ed025fb.el9.x86_6 47/170 2024-05-30T16:39:46.944 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-30T16:39:47.163 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-30T16:39:47.222 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-30T16:39:47.292 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-30T16:39:47.375 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-30T16:39:47.421 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-30T16:39:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-30T16:39:47.540 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-30T16:39:47.593 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-30T16:39:47.656 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-30T16:39:47.723 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-30T16:39:47.933 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-30T16:39:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-30T16:39:48.033 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-30T16:39:48.171 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-30T16:39:48.220 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-30T16:39:48.267 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-30T16:39:48.301 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-30T16:39:48.334 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-30T16:39:48.541 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-30T16:39:48.726 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-30T16:39:48.766 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-30T16:39:48.804 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-30T16:39:48.860 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-30T16:39:48.926 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-30T16:39:48.980 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-30T16:39:49.037 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-30T16:39:49.091 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-30T16:39:49.142 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-30T16:39:49.194 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-30T16:39:49.237 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-30T16:39:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 109/170 2024-05-30T16:39:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 109/170 2024-05-30T16:39:49.374 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-30T16:39:49.436 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-30T16:39:49.512 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-30T16:39:49.586 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-30T16:39:49.758 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-30T16:39:49.836 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-30T16:39:49.989 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 109/170 2024-05-30T16:39:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:19.0.0-3154.g9ed025fb.el9.x86_64 110/170 2024-05-30T16:39:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:19.0.0-3154.g9ed025fb.el9.x86_64 110/170 2024-05-30T16:39:50.235 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-30T16:39:50.235 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-30T16:39:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:39:50.280 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:19.0.0-3154.g9ed025fb.el9.x86_64 111/170 2024-05-30T16:39:50.817 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-30T16:39:50.876 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-30T16:39:50.909 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-30T16:39:51.037 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-30T16:39:51.109 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-30T16:39:51.163 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-30T16:39:51.275 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-30T16:39:51.311 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-30T16:39:51.543 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-30T16:39:51.575 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-30T16:39:51.681 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-30T16:39:52.506 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-30T16:39:52.675 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-30T16:39:54.318 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-30T16:39:54.716 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-30T16:39:54.774 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-30T16:39:54.822 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-30T16:39:55.245 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-30T16:39:55.294 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:19.0.0-3154.g9ed025fb.el9.x86_64 103/170 2024-05-30T16:39:55.417 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:19.0.0-3154.g9ed025fb.el9.x86_64 103/170 2024-05-30T16:39:55.451 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 104/170 2024-05-30T16:39:55.507 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-30T16:39:56.090 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-30T16:39:56.122 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:19.0.0-3154.g9ed025fb.el9.x86_64 107/170 2024-05-30T16:39:56.223 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:19.0.0-3154.g9ed025fb.el9.x86_64 107/170 2024-05-30T16:39:56.266 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 108/170 2024-05-30T16:39:58.913 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 109/170 2024-05-30T16:39:58.955 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 109/170 2024-05-30T16:39:59.613 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 109/170 2024-05-30T16:39:59.658 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:19.0.0-3154.g9ed025fb.el9.x86_64 110/170 2024-05-30T16:39:59.823 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:19.0.0-3154.g9ed025fb.el9.x86_64 110/170 2024-05-30T16:39:59.823 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-30T16:39:59.824 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-30T16:39:59.824 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:00.009 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:19.0.0-3154.g9ed025fb.el9.x86_64 111/170 2024-05-30T16:40:03.182 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3154.g9ed025fb.el9.x86_64 111/170 2024-05-30T16:40:03.182 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-05-30T16:40:03.183 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-05-30T16:40:03.183 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-05-30T16:40:03.183 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-05-30T16:40:03.183 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-05-30T16:40:03.183 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-05-30T16:40:03.183 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-05-30T16:40:03.183 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:19.0.0-3154.g9ed025fb.el9.noarch 112/170 2024-05-30T16:40:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:19.0.0-3154.g9ed025fb.el9.noarch 112/170 2024-05-30T16:40:03.479 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:03.479 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-30T16:40:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:05.096 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:19.0.0-3154.g9ed025fb.el9.x86_64 113/170 2024-05-30T16:40:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:19.0.0-3154.g9ed025fb.el9.x86_64 113/170 2024-05-30T16:40:05.174 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:05.174 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-30T16:40:05.174 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-30T16:40:05.175 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-30T16:40:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:05.450 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:19.0.0-3154.g9ed025fb.el9.x86_64 114/170 2024-05-30T16:40:05.523 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:19.0.0-3154.g9ed025fb.el9.x86_64 114/170 2024-05-30T16:40:05.524 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:05.524 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-30T16:40:05.524 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-30T16:40:05.524 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-30T16:40:05.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:06.022 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:19.0.0-3154.g9ed025fb.el9.x86_64 115/170 2024-05-30T16:40:06.088 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:19.0.0-3154.g9ed025fb.el9.x86_64 115/170 2024-05-30T16:40:06.088 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:06.088 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-30T16:40:06.088 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-30T16:40:06.089 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-30T16:40:06.089 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:06.222 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-30T16:40:06.285 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-30T16:40:06.360 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-30T16:40:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-30T16:40:06.676 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-30T16:40:06.786 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-30T16:40:06.896 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-30T16:40:07.059 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-30T16:40:07.118 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-30T16:40:07.171 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-30T16:40:07.210 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-30T16:40:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 127/170 2024-05-30T16:40:07.989 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 127/170 2024-05-30T16:40:08.046 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3154.g9ed025fb.e 128/170 2024-05-30T16:40:08.154 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3154.g9ed025fb. 129/170 2024-05-30T16:40:08.191 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3154.g9ed025fb.el9.noa 130/170 2024-05-30T16:40:09.441 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3154.g9ed025fb.el9.noa 130/170 2024-05-30T16:40:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3154.g9ed025fb.el9.n 131/170 2024-05-30T16:40:10.583 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3154.g9ed025fb.el9.n 131/170 2024-05-30T16:40:10.617 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3154.g9ed 132/170 2024-05-30T16:40:10.765 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3154.g9ed 132/170 2024-05-30T16:40:10.950 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3154.g9ed025fb.el 133/170 2024-05-30T16:40:10.994 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:19.0.0-3154.g9ed025fb.el9.x86_64 134/170 2024-05-30T16:40:11.079 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3154.g9ed025fb.el9.x86_64 134/170 2024-05-30T16:40:11.080 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:11.080 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-30T16:40:11.080 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-30T16:40:11.080 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-30T16:40:11.080 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:19.0.0-3154.g9ed025fb.el9.noarch 135/170 2024-05-30T16:40:11.192 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3154.g9ed025fb.el9.noarch 135/170 2024-05-30T16:40:11.341 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:19.0.0-3154.g9ed025fb.el9.x86_64 136/170 2024-05-30T16:40:11.418 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 137/170 2024-05-30T16:40:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-30T16:40:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 139/170 2024-05-30T16:40:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 139/170 2024-05-30T16:40:12.617 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:12.617 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-30T16:40:12.617 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-30T16:40:12.618 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-30T16:40:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:12.682 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3154.g9ed02 140/170 2024-05-30T16:40:12.752 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3154.g9ed02 140/170 2024-05-30T16:40:12.752 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:12.752 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-30T16:40:12.752 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:12.812 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3154.g9ed025fb.el9.x86_64 111/170 2024-05-30T16:40:12.812 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-05-30T16:40:12.812 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-05-30T16:40:12.812 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-05-30T16:40:12.812 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-05-30T16:40:12.812 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-05-30T16:40:12.812 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-05-30T16:40:12.812 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-05-30T16:40:12.812 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:12.841 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 141/170 2024-05-30T16:40:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 141/170 2024-05-30T16:40:12.927 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:12.927 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-30T16:40:12.927 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-30T16:40:12.927 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-30T16:40:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:13.056 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:19.0.0-3154.g9ed025fb.el9.noarch 112/170 2024-05-30T16:40:13.103 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:19.0.0-3154.g9ed025fb.el9.noarch 112/170 2024-05-30T16:40:13.103 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:13.103 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-30T16:40:13.104 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 142/170 2024-05-30T16:40:13.372 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 142/170 2024-05-30T16:40:13.373 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:13.373 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-30T16:40:13.373 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-30T16:40:13.373 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-30T16:40:13.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:14.752 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:19.0.0-3154.g9ed025fb.el9.x86_64 113/170 2024-05-30T16:40:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:19.0.0-3154.g9ed025fb.el9.x86_64 113/170 2024-05-30T16:40:14.839 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:14.840 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-30T16:40:14.840 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-30T16:40:14.840 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-30T16:40:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:15.110 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:19.0.0-3154.g9ed025fb.el9.x86_64 114/170 2024-05-30T16:40:15.181 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:19.0.0-3154.g9ed025fb.el9.x86_64 114/170 2024-05-30T16:40:15.181 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:15.181 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-30T16:40:15.181 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-30T16:40:15.181 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-30T16:40:15.181 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:15.711 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:19.0.0-3154.g9ed025fb.el9.x86_64 115/170 2024-05-30T16:40:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:19.0.0-3154.g9ed025fb.el9.x86_64 115/170 2024-05-30T16:40:15.780 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:15.780 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-30T16:40:15.780 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-30T16:40:15.780 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-30T16:40:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:15.920 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-30T16:40:15.985 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-30T16:40:16.059 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-30T16:40:16.303 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-30T16:40:16.366 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-30T16:40:16.453 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-30T16:40:16.563 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-30T16:40:16.740 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-30T16:40:16.799 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-30T16:40:16.847 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-30T16:40:16.881 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-30T16:40:17.425 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 127/170 2024-05-30T16:40:17.467 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 127/170 2024-05-30T16:40:17.522 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3154.g9ed025fb.e 128/170 2024-05-30T16:40:17.634 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3154.g9ed025fb. 129/170 2024-05-30T16:40:17.669 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3154.g9ed025fb.el9.noa 130/170 2024-05-30T16:40:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:19.0.0-3154.g9ed025fb.el9.x86_64 143/170 2024-05-30T16:40:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 144/170 2024-05-30T16:40:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 145/170 2024-05-30T16:40:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-30T16:40:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-30T16:40:19.001 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3154.g9ed025fb.el9.noa 130/170 2024-05-30T16:40:19.038 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3154.g9ed025fb.el9.n 131/170 2024-05-30T16:40:19.038 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-shell-2:19.0.0-3154.g9ed025fb.el9.x86_64 148/170 2024-05-30T16:40:19.096 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-30T16:40:19.131 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:19.0.0-3154.g9ed025fb.el9.x86_ 150/170 2024-05-30T16:40:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-30T16:40:19.262 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-05-30T16:40:19.321 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-05-30T16:40:20.148 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3154.g9ed025fb.el9.n 131/170 2024-05-30T16:40:20.180 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3154.g9ed 132/170 2024-05-30T16:40:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-30T16:40:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-30T16:40:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3154.g9ed 132/170 2024-05-30T16:40:20.376 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-30T16:40:20.506 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3154.g9ed025fb.el 133/170 2024-05-30T16:40:20.549 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:19.0.0-3154.g9ed025fb.el9.x86_64 134/170 2024-05-30T16:40:20.618 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3154.g9ed025fb.el9.x86_64 134/170 2024-05-30T16:40:20.618 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:20.619 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-30T16:40:20.619 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-30T16:40:20.619 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-30T16:40:20.619 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:20.683 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:19.0.0-3154.g9ed025fb.el9.noarch 135/170 2024-05-30T16:40:20.722 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3154.g9ed025fb.el9.noarch 135/170 2024-05-30T16:40:20.833 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:19.0.0-3154.g9ed025fb.el9.x86_64 136/170 2024-05-30T16:40:20.900 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 137/170 2024-05-30T16:40:21.699 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:19.0.0-3154.g9ed025fb.el9.noarch 155/170 2024-05-30T16:40:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-30T16:40:21.884 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-30T16:40:21.907 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-30T16:40:21.944 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 139/170 2024-05-30T16:40:22.014 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 139/170 2024-05-30T16:40:22.014 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:22.014 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-30T16:40:22.014 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-30T16:40:22.014 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-30T16:40:22.014 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:22.027 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-30T16:40:22.069 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3154.g9ed02 140/170 2024-05-30T16:40:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-30T16:40:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-30T16:40:22.156 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3154.g9ed02 140/170 2024-05-30T16:40:22.157 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:22.157 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-30T16:40:22.157 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-30T16:40:22.204 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-30T16:40:22.204 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-30T16:40:22.228 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 141/170 2024-05-30T16:40:22.323 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 141/170 2024-05-30T16:40:22.324 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:22.324 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-30T16:40:22.324 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-30T16:40:22.324 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-30T16:40:22.324 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-30T16:40:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-30T16:40:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-30T16:40:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-30T16:40:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-30T16:40:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-30T16:40:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-30T16:40:22.712 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 142/170 2024-05-30T16:40:22.793 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 142/170 2024-05-30T16:40:22.793 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-30T16:40:22.793 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-30T16:40:22.793 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-30T16:40:22.793 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-30T16:40:22.793 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:22.969 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-30T16:40:22.969 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-30T16:40:23.114 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-30T16:40:23.159 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-30T16:40:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-30T16:40:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-30T16:40:23.525 INFO:teuthology.orchestra.run.smithi144.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-30T16:40:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:27.905 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:19.0.0-3154.g9ed025fb.el9.x86_64 143/170 2024-05-30T16:40:27.990 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 144/170 2024-05-30T16:40:28.060 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 145/170 2024-05-30T16:40:28.111 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-30T16:40:28.150 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-30T16:40:28.469 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-shell-2:19.0.0-3154.g9ed025fb.el9.x86_64 148/170 2024-05-30T16:40:28.532 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-30T16:40:28.565 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:19.0.0-3154.g9ed025fb.el9.x86_ 150/170 2024-05-30T16:40:28.603 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-30T16:40:28.649 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-05-30T16:40:28.697 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-05-30T16:40:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:19.0.0-3154.g9ed025fb.el9.x86_64 1/170 2024-05-30T16:40:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:19.0.0-3154.g9ed025fb.el9.x86_64 2/170 2024-05-30T16:40:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 3/170 2024-05-30T16:40:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 4/170 2024-05-30T16:40:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3154.g9ed02 5/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:19.0.0-3154.g9ed025fb.el9.x86_64 6/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:19.0.0-3154.g9ed025fb.el9.x86_64 7/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:19.0.0-3154.g9ed025fb.el9.x86_64 8/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:19.0.0-3154.g9ed025fb.el9.x86_64 9/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 10/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:19.0.0-3154.g9ed025fb.el9.x86_64 11/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:19.0.0-3154.g9ed025fb.el9.x86_64 12/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 13/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-shell-2:19.0.0-3154.g9ed025fb.el9.x86_64 14/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:19.0.0-3154.g9ed025fb.el9.x86_ 15/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:19.0.0-3154.g9ed025fb.el9.x86_64 16/170 2024-05-30T16:40:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:19.0.0-3154.g9ed025fb.el9.x86_64 17/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:19.0.0-3154.g9ed025fb.el9.x86_6 18/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:19.0.0-3154.g9ed025fb.el9.x86 19/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:19.0.0-3154.g9ed025fb.el9.x86_64 20/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3154.g9ed025fb.el 21/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:19.0.0-3154.g9ed025fb.el9. 22/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:19.0.0-3154.g9ed025fb.el9.x86_6 23/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:19.0.0-3154.g9ed025fb.el9.x86_64 24/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 25/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 26/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 27/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 28/170 2024-05-30T16:40:29.336 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 29/170 2024-05-30T16:40:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3154.g9ed025fb. 30/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3154.g9ed025fb.el9.noa 31/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3154.g9ed025fb.el9.n 32/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3154.g9ed 33/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3154.g9ed025fb.el 34/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3154.g9ed025fb.el9.noarch 35/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3154.g9ed025fb.e 36/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:19.0.0-3154.g9ed025fb.el9.noarch 37/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 38/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:19.0.0-3154.g9ed025fb.el9.noarch 39/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-30T16:40:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-30T16:40:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-30T16:40:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-30T16:40:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-30T16:40:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-30T16:40:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-30T16:40:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-30T16:40:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-30T16:40:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:19.0.0-3154.g9ed025fb.el9.x86_64 149/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:19.0.0-3154.g9ed025fb.el9.x86_64 151/170 2024-05-30T16:40:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-30T16:40:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-30T16:40:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-30T16:40:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-30T16:40:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-30T16:40:29.611 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-30T16:40:29.660 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-30T16:40:29.715 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-30T16:40:31.113 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:19.0.0-3154.g9ed025fb.el9.noarch 155/170 2024-05-30T16:40:31.385 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-30T16:40:31.466 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-30T16:40:31.614 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-30T16:40:31.661 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-30T16:40:31.694 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-30T16:40:31.729 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-30T16:40:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-30T16:40:31.771 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-30T16:40:31.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.835 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.2-8.el9.noarch 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.7.4-5.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.4-9.el9.x86_64 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-30T16:40:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.839 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: lua-5.4.4-4.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-30T16:40:31.840 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-13.14-1.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-30T16:40:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-30T16:40:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-30T16:40:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-30T16:40:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-3.el9.x86_64 2024-05-30T16:40:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-30T16:40:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-30T16:40:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-30T16:40:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-30T16:40:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-30T16:40:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-30T16:40:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:31.847 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-05-30T16:40:31.954 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-30T16:40:32.000 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-30T16:40:32.000 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-30T16:40:32.187 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-30T16:40:32.226 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-30T16:40:32.259 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-30T16:40:32.260 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-30T16:40:32.555 DEBUG:teuthology.parallel:result is None 2024-05-30T16:40:32.597 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-30T16:40:32.597 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-30T16:40:32.759 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-30T16:40:32.804 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-30T16:40:32.923 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-30T16:40:33.236 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-30T16:40:33.236 INFO:teuthology.orchestra.run.smithi149.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-30T16:40:33.236 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:19.0.0-3154.g9ed025fb.el9.x86_64 1/170 2024-05-30T16:40:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:19.0.0-3154.g9ed025fb.el9.x86_64 2/170 2024-05-30T16:40:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 3/170 2024-05-30T16:40:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 4/170 2024-05-30T16:40:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3154.g9ed02 5/170 2024-05-30T16:40:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:19.0.0-3154.g9ed025fb.el9.x86_64 6/170 2024-05-30T16:40:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:19.0.0-3154.g9ed025fb.el9.x86_64 7/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:19.0.0-3154.g9ed025fb.el9.x86_64 8/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:19.0.0-3154.g9ed025fb.el9.x86_64 9/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 10/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:19.0.0-3154.g9ed025fb.el9.x86_64 11/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:19.0.0-3154.g9ed025fb.el9.x86_64 12/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 13/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-shell-2:19.0.0-3154.g9ed025fb.el9.x86_64 14/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:19.0.0-3154.g9ed025fb.el9.x86_ 15/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:19.0.0-3154.g9ed025fb.el9.x86_64 16/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:19.0.0-3154.g9ed025fb.el9.x86_64 17/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:19.0.0-3154.g9ed025fb.el9.x86_6 18/170 2024-05-30T16:40:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:19.0.0-3154.g9ed025fb.el9.x86 19/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:19.0.0-3154.g9ed025fb.el9.x86_64 20/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3154.g9ed025fb.el 21/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:19.0.0-3154.g9ed025fb.el9. 22/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:19.0.0-3154.g9ed025fb.el9.x86_6 23/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:19.0.0-3154.g9ed025fb.el9.x86_64 24/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 25/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 26/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 27/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 28/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 29/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3154.g9ed025fb. 30/170 2024-05-30T16:40:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3154.g9ed025fb.el9.noa 31/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3154.g9ed025fb.el9.n 32/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3154.g9ed 33/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3154.g9ed025fb.el 34/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3154.g9ed025fb.el9.noarch 35/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3154.g9ed025fb.e 36/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:19.0.0-3154.g9ed025fb.el9.noarch 37/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 38/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:19.0.0-3154.g9ed025fb.el9.noarch 39/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-30T16:40:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-30T16:40:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-30T16:40:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-30T16:40:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-30T16:40:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-30T16:40:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-30T16:40:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-30T16:40:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-30T16:40:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-30T16:40:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-30T16:40:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-30T16:40:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-30T16:40:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-30T16:40:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-30T16:40:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-30T16:40:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-30T16:40:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-30T16:40:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-30T16:40:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-30T16:40:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-30T16:40:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-30T16:40:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-30T16:40:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:19.0.0-3154.g9ed025fb.el9.x86_64 149/170 2024-05-30T16:40:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:19.0.0-3154.g9ed025fb.el9.x86_64 151/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-30T16:40:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-30T16:40:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-30T16:40:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-30T16:40:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-30T16:40:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-30T16:40:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-30T16:40:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-30T16:40:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.2-8.el9.noarch 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.7.4-5.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-shell-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:19.0.0-3154.g9ed025fb.el9.noarch 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.4-9.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-30T16:40:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-30T16:40:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: lua-5.4.4-4.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-30T16:40:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-13.14-1.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-30T16:40:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-30T16:40:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-30T16:40:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-30T16:40:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-30T16:40:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:19.0.0-3154.g9ed025fb.el9.x86_64 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-3.el9.x86_64 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-30T16:40:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-30T16:40:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-30T16:40:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-30T16:40:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-30T16:40:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-30T16:40:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:41.424 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-05-30T16:40:42.125 DEBUG:teuthology.parallel:result is None 2024-05-30T16:40:42.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:40:42.267 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-30T16:40:42.339 INFO:teuthology.orchestra.run.smithi144.stdout:19.0.0-3154.g9ed025fb.el9 2024-05-30T16:40:42.340 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154.g9ed025fb.el9 2024-05-30T16:40:42.340 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154.g9ed025fb is installed. 2024-05-30T16:40:42.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T16:40:42.480 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-30T16:40:42.533 INFO:teuthology.orchestra.run.smithi149.stdout:19.0.0-3154.g9ed025fb.el9 2024-05-30T16:40:42.533 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154.g9ed025fb.el9 2024-05-30T16:40:42.533 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154.g9ed025fb is installed. 2024-05-30T16:40:42.535 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-30T16:40:42.535 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:42.535 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-30T16:40:42.630 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:40:42.630 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-30T16:40:42.693 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-30T16:40:42.694 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:42.694 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-05-30T16:40:42.780 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-30T16:40:42.909 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:40:42.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-05-30T16:40:42.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-30T16:40:43.075 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-30T16:40:43.076 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:43.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-30T16:40:43.162 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-30T16:40:43.291 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:40:43.292 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-30T16:40:43.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-30T16:40:43.465 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-30T16:40:43.466 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:43.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-05-30T16:40:43.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-30T16:40:43.637 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:40:43.638 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-05-30T16:40:43.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-30T16:40:43.802 INFO:teuthology.run_tasks:Running task ceph... 2024-05-30T16:40:43.879 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-30T16:40:43.880 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2024-05-30T16:40:43.887 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2024-05-30T16:40:43.961 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-30T16:40:43.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-30T16:40:43.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-30T16:40:44.042 INFO:tasks.ceph:Creating extra log directories... 2024-05-30T16:40:44.042 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-30T16:40:44.047 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-30T16:40:44.128 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-30T16:40:44.128 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-30T16:40:44.128 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-30T16:40:44.128 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:44.129 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-30T16:40:44.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-30T16:40:44.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-30T16:40:44.479 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:40:44.480 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-30T16:40:44.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-30T16:40:44.713 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-30T16:40:44.779 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-30T16:40:44.779 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-30T16:40:44.780 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141', 'branch': 'rishabh-clone-stats', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}}', 'email': None, 'first_in_suite': False, 'job_id': '7734141', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-clone-stats'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-clone-stats', 'sha1': '019a0d1fdedb1237f85e8a3711761fae4e094286'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 964, 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-clone-stats', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '019a0d1fdedb1237f85e8a3711761fae4e094286', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrcicrBADWVD0q7rxwQ1BfUwl4jfpMUgLNKIzifz++aoiJVNcXVveB92ryPNgN8gQyvUN6dlJF6k2al2BU1ePE=', 'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlDmCus2pwb29tGiY02t6+jMXwzMs7vlKpqSaO/UU9+xHmoJChF3sg83tHcD5/52mkGqgSxAkQjj4ZgxAjuLkA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestCloneProgressReporter']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e1979f064b0becde2020282c7e87cf3c5e98026c', 'timestamp': '2024-05-30_16:10:36', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-30T16:40:44.780 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-30T16:40:44.787 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-30T16:40:44.838 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2024-05-30T16:40:44.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-05-30T16:40:44.933 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:44.933 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-05-30T16:40:44.989 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-30T16:40:44.989 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-05-30T16:40:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-30T16:40:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:40:45.039 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-30T16:40:45.039 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:40:45.039 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-05-30T16:40:45.039 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-05-30 16:40:24.017509732 +0000 2024-05-30T16:40:45.039 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-05-30 16:37:12.507653393 +0000 2024-05-30T16:40:45.039 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-05-30 16:37:12.508653376 +0000 2024-05-30T16:40:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-05-30 16:37:12.507653393 +0000 2024-05-30T16:40:45.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-30T16:40:45.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-05-30T16:40:45.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-05-30T16:40:45.116 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000323804 s, 1.6 MB/s 2024-05-30T16:40:45.121 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-30T16:40:45.177 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-05-30T16:40:45.225 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-30T16:40:45.225 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:40:45.225 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-05-30T16:40:45.226 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:40:45.226 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-05-30T16:40:45.226 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-05-30 16:40:24.018509714 +0000 2024-05-30T16:40:45.226 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-05-30 16:37:13.135642335 +0000 2024-05-30T16:40:45.226 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-05-30 16:37:13.135642335 +0000 2024-05-30T16:40:45.226 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-05-30 16:37:13.135642335 +0000 2024-05-30T16:40:45.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-30T16:40:45.300 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-05-30T16:40:45.300 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-05-30T16:40:45.300 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000346689 s, 1.5 MB/s 2024-05-30T16:40:45.304 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-30T16:40:45.362 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-05-30T16:40:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-30T16:40:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:40:45.412 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-30T16:40:45.412 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:40:45.412 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-05-30T16:40:45.412 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-05-30 16:40:24.018509714 +0000 2024-05-30T16:40:45.412 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-05-30 16:37:13.747631558 +0000 2024-05-30T16:40:45.412 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-05-30 16:37:13.747631558 +0000 2024-05-30T16:40:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-05-30 16:37:13.747631558 +0000 2024-05-30T16:40:45.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-30T16:40:45.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-05-30T16:40:45.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-05-30T16:40:45.489 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000371391 s, 1.4 MB/s 2024-05-30T16:40:45.493 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-30T16:40:45.549 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-05-30T16:40:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-30T16:40:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:40:45.600 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-30T16:40:45.600 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:40:45.600 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-05-30T16:40:45.601 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-05-30 16:40:24.020509680 +0000 2024-05-30T16:40:45.601 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-05-30 16:37:14.364620693 +0000 2024-05-30T16:40:45.601 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-05-30 16:37:14.364620693 +0000 2024-05-30T16:40:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-05-30 16:37:14.364620693 +0000 2024-05-30T16:40:45.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-30T16:40:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-05-30T16:40:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-05-30T16:40:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000376314 s, 1.4 MB/s 2024-05-30T16:40:45.683 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-30T16:40:45.734 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:40:45.734 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:40:45.734 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-05-30T16:40:45.778 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-30T16:40:45.781 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-05-30T16:40:45.859 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-30T16:40:45.859 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:40:45.859 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-30T16:40:45.859 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:40:45.859 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-05-30T16:40:45.859 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-30 16:40:33.704925488 +0000 2024-05-30T16:40:45.860 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-30 16:37:12.786207257 +0000 2024-05-30T16:40:45.860 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-30 16:37:12.786207257 +0000 2024-05-30T16:40:45.860 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-30 16:37:12.786207257 +0000 2024-05-30T16:40:45.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-30T16:40:45.958 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-30T16:40:45.958 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-30T16:40:45.958 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000365374 s, 1.4 MB/s 2024-05-30T16:40:45.962 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-30T16:40:46.002 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-05-30T16:40:46.091 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-30T16:40:46.091 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:40:46.091 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-05-30T16:40:46.091 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:40:46.091 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-05-30T16:40:46.091 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-30 16:40:33.704925488 +0000 2024-05-30T16:40:46.091 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-30 16:37:13.383195336 +0000 2024-05-30T16:40:46.091 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-30 16:37:13.383195336 +0000 2024-05-30T16:40:46.091 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-30 16:37:13.383195336 +0000 2024-05-30T16:40:46.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-30T16:40:46.194 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-30T16:40:46.194 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-30T16:40:46.194 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000311356 s, 1.6 MB/s 2024-05-30T16:40:46.198 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-30T16:40:46.238 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-05-30T16:40:46.322 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-30T16:40:46.322 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:40:46.322 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-05-30T16:40:46.322 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:40:46.322 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-05-30T16:40:46.323 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-30 16:40:33.705925469 +0000 2024-05-30T16:40:46.323 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-30 16:37:13.943184155 +0000 2024-05-30T16:40:46.323 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-30 16:37:13.943184155 +0000 2024-05-30T16:40:46.323 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-30 16:37:13.943184155 +0000 2024-05-30T16:40:46.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-30T16:40:46.441 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-30T16:40:46.441 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-30T16:40:46.441 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000345603 s, 1.5 MB/s 2024-05-30T16:40:46.445 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-30T16:40:46.497 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-05-30T16:40:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-30T16:40:46.545 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T16:40:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-05-30T16:40:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T16:40:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-05-30T16:40:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-30 16:40:33.706925449 +0000 2024-05-30T16:40:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-30 16:37:14.554171955 +0000 2024-05-30T16:40:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-30 16:37:14.554171955 +0000 2024-05-30T16:40:46.546 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-30 16:37:14.554171955 +0000 2024-05-30T16:40:46.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-30T16:40:46.615 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-30T16:40:46.616 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-30T16:40:46.616 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000368155 s, 1.4 MB/s 2024-05-30T16:40:46.619 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-30T16:40:46.668 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:40:46.668 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-30T16:40:46.668 INFO:tasks.ceph:Generating config... 2024-05-30T16:40:46.670 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-30T16:40:46.670 INFO:tasks.ceph:[client] debug client = 20 2024-05-30T16:40:46.670 INFO:tasks.ceph:[client] debug ms = 1 2024-05-30T16:40:46.670 INFO:tasks.ceph:[client] pid file = 2024-05-30T16:40:46.670 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-30T16:40:46.670 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-30T16:40:46.670 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-30T16:40:46.670 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-30T16:40:46.670 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-30T16:40:46.670 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-30T16:40:46.670 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-30T16:40:46.670 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-30T16:40:46.671 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-30T16:40:46.672 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-30T16:40:46.673 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-30T16:40:46.673 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-30T16:40:46.673 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-30T16:40:46.673 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-30T16:40:46.673 INFO:tasks.ceph:Setting up mon.a... 2024-05-30T16:40:46.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-30T16:40:46.798 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.keyring 2024-05-30T16:40:46.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-30T16:40:46.918 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-30T16:40:46.991 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.144'), ('mon.b', '172.21.15.149'), ('mon.c', '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]')] 2024-05-30T16:40:46.991 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.144,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-30T16:40:46.992 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:46.992 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-30T16:40:47.042 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.144 --add b 172.21.15.149 --addv c '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: generated fsid 865cdc9a-e28b-4870-8751-0312b261bc38 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:setting min_mon_release = quincy 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:epoch 0 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:fsid 865cdc9a-e28b-4870-8751-0312b261bc38 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:last_changed 2024-05-30T16:40:47.193409+0000 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:created 2024-05-30T16:40:47.193409+0000 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:min_mon_release 17 (quincy) 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:election_strategy: 1 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-05-30T16:40:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-05-30T16:40:47.194 INFO:teuthology.orchestra.run.smithi144.stdout:2: [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] mon.c 2024-05-30T16:40:47.194 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-30T16:40:47.196 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-30T16:40:47.247 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 865cdc9a-e28b-4870-8751-0312b261bc38... 2024-05-30T16:40:47.248 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-30T16:40:47.252 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-30T16:40:47.384 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-05-30T16:40:47.384 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-05-30T16:40:47.384 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-30T16:40:47.384 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-05-30T16:40:47.384 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.384 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-05-30T16:40:47.384 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.384 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-05-30T16:40:47.384 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.385 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.386 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.144,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 865cdc9a-e28b-4870-8751-0312b261bc38 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.387 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug trim objects = true 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.388 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-05-30T16:40:47.389 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-05-30T16:40:47.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.389 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-05-30T16:40:47.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.389 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-05-30T16:40:47.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.389 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-05-30T16:40:47.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.389 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: bdev async discard = True 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: bdev enable discard = True 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore allocator = bitmap 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-05-30T16:40:47.390 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-05-30T16:40:47.391 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: debug finisher = 20 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-05-30T16:40:47.392 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: mon down mkfs grace = 300 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:40:47.394 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = "" 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2024-05-30T16:40:47.395 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds balancer = 20 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-05-30T16:40:47.396 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-05-30T16:40:47.454 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2024-05-30T16:40:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2024-05-30T16:40:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-30T16:40:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2024-05-30T16:40:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2024-05-30T16:40:47.455 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-30T16:40:47.456 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2024-05-30T16:40:47.457 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.144,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 865cdc9a-e28b-4870-8751-0312b261bc38 2024-05-30T16:40:47.458 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2024-05-30T16:40:47.459 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2024-05-30T16:40:47.460 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: bdev async discard = True 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: bdev enable discard = True 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = bitmap 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2024-05-30T16:40:47.461 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2024-05-30T16:40:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: debug finisher = 20 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-05-30T16:40:47.463 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: mon down mkfs grace = 300 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2024-05-30T16:40:47.464 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2024-05-30T16:40:47.465 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds balancer = 20 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2024-05-30T16:40:47.466 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2024-05-30T16:40:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2024-05-30T16:40:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2024-05-30T16:40:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2024-05-30T16:40:47.467 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2024-05-30T16:40:47.492 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-30T16:40:47.493 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-30T16:40:47.626 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-30T16:40:47.626 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:47.626 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-30T16:40:47.677 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:47.677 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-30T16:40:47.725 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:40:47.725 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:47.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-30T16:40:47.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-30T16:40:47.884 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:40:47.885 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:40:47.981 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:40:47.981 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:40:47.981 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-30T16:40:47.981 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-30T16:40:48.114 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:40:48.114 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:40:48.212 INFO:tasks.ceph:Setting up mon nodes... 2024-05-30T16:40:48.212 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-30T16:40:48.212 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-30T16:40:48.354 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-30T16:40:48.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-30T16:40:48.539 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-30T16:40:48.551 INFO:tasks.ceph:Setting up mds nodes... 2024-05-30T16:40:48.551 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-30T16:40:48.719 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-30T16:40:48.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-30T16:40:48.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-30T16:40:48.960 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-30T16:40:48.968 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-30T16:40:49.053 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-30T16:40:49.222 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-30T16:40:49.231 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-30T16:40:49.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-30T16:40:49.459 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-30T16:40:49.467 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-30T16:40:49.540 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-30T16:40:49.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-30T16:40:49.656 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-30T16:40:49.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-30T16:40:49.816 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-30T16:40:49.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-30T16:40:49.990 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-30T16:40:50.043 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-30T16:40:50.160 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-30T16:40:50.216 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-30T16:40:50.216 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-30T16:40:50.216 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-30T16:40:50.305 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:40:50.305 INFO:tasks.ceph:role: osd.0 2024-05-30T16:40:50.305 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:40:50.306 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-30T16:40:50.394 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:40:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:40:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:40:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-30T16:40:50.394 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:40:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:40:50.394 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:40:50.394 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-30T16:40:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:40:50.395 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:40:50.811 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-05-30T16:40:50.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-05-30T16:40:50.818 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-30T16:40:50.991 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-30T16:40:51.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-30T16:40:51.148 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:40:51.149 INFO:tasks.ceph:role: osd.1 2024-05-30T16:40:51.149 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:40:51.149 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-30T16:40:51.224 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:40:51.224 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:40:51.224 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:40:51.224 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-30T16:40:51.224 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:40:51.224 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:40:51.224 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:40:51.224 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-30T16:40:51.224 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:40:51.225 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:40:51.579 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-05-30T16:40:51.585 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-05-30T16:40:51.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-30T16:40:51.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-30T16:40:51.771 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-30T16:40:51.832 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:40:51.832 INFO:tasks.ceph:role: osd.2 2024-05-30T16:40:51.832 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:40:51.832 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-30T16:40:51.902 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:40:51.902 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:40:51.902 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:40:51.903 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-30T16:40:51.903 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:40:51.903 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:40:51.903 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:40:51.903 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-30T16:40:51.903 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:40:51.903 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:40:52.287 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-05-30T16:40:52.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-05-30T16:40:52.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-30T16:40:52.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-30T16:40:52.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-30T16:40:52.531 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T16:40:52.531 INFO:tasks.ceph:role: osd.3 2024-05-30T16:40:52.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:40:52.531 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-30T16:40:52.606 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:40:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:40:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:40:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-30T16:40:52.607 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:40:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:40:52.607 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:40:52.607 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-30T16:40:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:40:52.607 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:40:53.003 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-05-30T16:40:53.010 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-05-30T16:40:53.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-30T16:40:53.170 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-30T16:40:53.258 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:40:53.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:53.395+0000 7ffb6e62d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-30T16:40:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:53.396+0000 7ffb6e62d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-30T16:40:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:53.396+0000 7ffb6e62d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-30T16:40:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:53.396+0000 7ffb6e62d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-30T16:40:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:53.396+0000 7ffb6e62d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-30T16:40:53.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:53.400+0000 7ffb6e62d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-30T16:40:56.368 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-30T16:40:56.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:40:56.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:56.574+0000 7fb84c29d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-30T16:40:56.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:56.575+0000 7fb84c29d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-30T16:40:56.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:56.575+0000 7fb84c29d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-30T16:40:56.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:56.575+0000 7fb84c29d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-30T16:40:56.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:56.575+0000 7fb84c29d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-30T16:40:56.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:56.578+0000 7fb84c29d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-30T16:40:59.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-30T16:40:59.624 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:40:59.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:59.755+0000 7f5caa92a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-30T16:40:59.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:59.756+0000 7f5caa92a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-30T16:40:59.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:59.756+0000 7f5caa92a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-30T16:40:59.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:59.756+0000 7f5caa92a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-30T16:40:59.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:59.756+0000 7f5caa92a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-30T16:40:59.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:40:59.759+0000 7f5caa92a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-30T16:41:02.711 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-30T16:41:02.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:41:02.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:02.916+0000 7fd708a30640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-30T16:41:02.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:02.916+0000 7fd708a30640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-30T16:41:02.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:02.916+0000 7fd708a30640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-30T16:41:02.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:02.916+0000 7fd708a30640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-30T16:41:02.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:02.917+0000 7fd708a30640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-30T16:41:02.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:02.919+0000 7fd708a30640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-30T16:41:05.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-30T16:41:05.983 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-30T16:41:06.074 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:41:06.074 INFO:tasks.ceph:role: osd.4 2024-05-30T16:41:06.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:41:06.075 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-30T16:41:06.167 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:41:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:41:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:41:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-30T16:41:06.168 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:41:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:41:06.168 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:41:06.168 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-30T16:41:06.168 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:41:06.168 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:41:06.579 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-05-30T16:41:06.586 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-05-30T16:41:06.587 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-30T16:41:06.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-30T16:41:06.822 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-30T16:41:06.891 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:41:06.891 INFO:tasks.ceph:role: osd.5 2024-05-30T16:41:06.892 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:41:06.892 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-30T16:41:06.962 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:41:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:41:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:41:06.962 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-30T16:41:06.963 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:41:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:41:06.963 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:41:06.963 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-30T16:41:06.963 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:41:06.963 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:41:07.316 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-05-30T16:41:07.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-05-30T16:41:07.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-30T16:41:07.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-30T16:41:07.499 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-30T16:41:07.560 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:41:07.560 INFO:tasks.ceph:role: osd.6 2024-05-30T16:41:07.560 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:41:07.560 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-30T16:41:07.633 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:41:07.633 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:41:07.633 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:41:07.633 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-30T16:41:07.634 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:41:07.634 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:41:07.634 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:41:07.634 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-30T16:41:07.634 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:41:07.634 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:41:08.018 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-05-30T16:41:08.022 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-05-30T16:41:08.023 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-30T16:41:08.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-30T16:41:08.212 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-30T16:41:08.287 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T16:41:08.287 INFO:tasks.ceph:role: osd.7 2024-05-30T16:41:08.287 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:41:08.287 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-30T16:41:08.370 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T16:41:08.370 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T16:41:08.370 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T16:41:08.370 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-30T16:41:08.371 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T16:41:08.371 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-05-30T16:41:08.371 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T16:41:08.371 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-30T16:41:08.371 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T16:41:08.371 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T16:41:08.784 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-05-30T16:41:08.790 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-05-30T16:41:08.790 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-30T16:41:08.958 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-30T16:41:09.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:41:09.196 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:09.195+0000 7f664fc22640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-30T16:41:09.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:09.196+0000 7f664fc22640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-30T16:41:09.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:09.196+0000 7f664fc22640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-30T16:41:09.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:09.196+0000 7f664fc22640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-30T16:41:09.197 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:09.196+0000 7f664fc22640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-30T16:41:09.200 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:09.199+0000 7f664fc22640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-30T16:41:12.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-30T16:41:12.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:41:12.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:12.651+0000 7f64e4da7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-30T16:41:12.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:12.651+0000 7f64e4da7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-30T16:41:12.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:12.651+0000 7f64e4da7640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-30T16:41:12.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:12.651+0000 7f64e4da7640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-30T16:41:12.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:12.651+0000 7f64e4da7640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-30T16:41:12.654 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:12.654+0000 7f64e4da7640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-30T16:41:14.782 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:41:14.790 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:41:15.852 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-30T16:41:15.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:41:16.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:16.064+0000 7f41daee3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-30T16:41:16.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:16.065+0000 7f41daee3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-30T16:41:16.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:16.065+0000 7f41daee3640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-30T16:41:16.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:16.065+0000 7f41daee3640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-30T16:41:16.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:16.065+0000 7f41daee3640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-30T16:41:16.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:16.067+0000 7f41daee3640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-30T16:41:19.038 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-30T16:41:19.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:41:19.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:19.252+0000 7ffa8fe1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-30T16:41:19.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:19.253+0000 7ffa8fe1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-30T16:41:19.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:19.253+0000 7ffa8fe1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-30T16:41:19.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:19.253+0000 7ffa8fe1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-30T16:41:19.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:19.253+0000 7ffa8fe1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-30T16:41:19.255 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:19.255+0000 7ffa8fe1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-30T16:41:22.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-30T16:41:22.330 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-30T16:41:22.330 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:22.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-30T16:41:22.419 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:22.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-30T16:41:22.498 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:22.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-30T16:41:22.571 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:22.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-30T16:41:22.701 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:22.701 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-30T16:41:22.787 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:22.787 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-30T16:41:22.869 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:22.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-30T16:41:22.955 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:22.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-30T16:41:23.045 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:23.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-30T16:41:23.125 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:23.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-30T16:41:23.205 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:23.205 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-30T16:41:23.281 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:23.281 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-30T16:41:23.359 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:23.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-30T16:41:23.487 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:23.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-30T16:41:23.575 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:23.575 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-30T16:41:23.633 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:23.633 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-30T16:41:23.687 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:23.687 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-30T16:41:23.742 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:23.743 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-30T16:41:23.793 INFO:tasks.ceph:Adding keys to all mons... 2024-05-30T16:41:23.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-30T16:41:23.801 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-30T16:41:23.878 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2024-05-30T16:41:23.878 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAQrFhm8GMmFRAAtPZbiQkY1GfShaqCf3b4Zw== 2024-05-30T16:41:23.878 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-05-30T16:41:23.878 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAQrFhmF+/kKhAA0L6yP95TzJQ6K4jpCd5+tg== 2024-05-30T16:41:23.878 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-05-30T16:41:23.878 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAQrFhmuIxAORAA/N4DIL7c+EuojamnyYrt8Q== 2024-05-30T16:41:23.878 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2024-05-30T16:41:23.878 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAVrFhmdJ6TFxAAFhv8K0nLudGT9rT6oHmhvQ== 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAYrFhmC1VXIhAAyyeKMhil2CcMD+5mm3xcvg== 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAbrFhmid0VLRAA/StAYue0HlyInB/n42h3wg== 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAerFhmJwCyNhAAkvkgyy7RRMOwwfYhyd19XA== 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAQrFhmn/cwIBAAc0kCDj+gFH2f0tY5cbGrjg== 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQARrFhmn8xEDRAAjwGDHViLwz305wNijyo18g== 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQARrFhmohxgGxAA4vjzBoeVO37nSNV38b13jQ== 2024-05-30T16:41:23.879 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAlrFhm/8G1CxAAAlDJwijmpj2gS8x2BhgIpA== 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAorFhmO1zgJhAAxdZsdLD/lBuyuhEdX2AF6g== 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAsrFhmPtDmAxAA1+YfFHQ7XLtQQIOp4BLnwQ== 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAvrFhmbqIVDxAAr6NR0hbs+v/4CP4/WRT1SA== 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA== 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout:[client.2] 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQARrFhmvzKvMBAAIPPum2n8LgNjGXjueMBuqQ== 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQARrFhmVgMROxAA2SCdaM/Q+v9jhyfF7SZoWg== 2024-05-30T16:41:23.880 INFO:teuthology.orchestra.run.smithi144.stdout:[client.3] 2024-05-30T16:41:23.881 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQASrFhmdx2UCRAAFENiZ9XGo/B0vBmixV0k0A== 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAQrFhm8GMmFRAAtPZbiQkY1GfShaqCf3b4Zw== 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAQrFhmF+/kKhAA0L6yP95TzJQ6K4jpCd5+tg== 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAQrFhmuIxAORAA/N4DIL7c+EuojamnyYrt8Q== 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAVrFhmdJ6TFxAAFhv8K0nLudGT9rT6oHmhvQ== 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2024-05-30T16:41:23.914 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAYrFhmC1VXIhAAyyeKMhil2CcMD+5mm3xcvg== 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAbrFhmid0VLRAA/StAYue0HlyInB/n42h3wg== 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAerFhmJwCyNhAAkvkgyy7RRMOwwfYhyd19XA== 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAQrFhmn/cwIBAAc0kCDj+gFH2f0tY5cbGrjg== 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQARrFhmn8xEDRAAjwGDHViLwz305wNijyo18g== 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQARrFhmohxgGxAA4vjzBoeVO37nSNV38b13jQ== 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2024-05-30T16:41:23.915 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAlrFhm/8G1CxAAAlDJwijmpj2gS8x2BhgIpA== 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAorFhmO1zgJhAAxdZsdLD/lBuyuhEdX2AF6g== 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAsrFhmPtDmAxAA1+YfFHQ7XLtQQIOp4BLnwQ== 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAvrFhmbqIVDxAAr6NR0hbs+v/4CP4/WRT1SA== 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA== 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQARrFhmvzKvMBAAIPPum2n8LgNjGXjueMBuqQ== 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQARrFhmVgMROxAA2SCdaM/Q+v9jhyfF7SZoWg== 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout:[client.3] 2024-05-30T16:41:23.916 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQASrFhmdx2UCRAAFENiZ9XGo/B0vBmixV0k0A== 2024-05-30T16:41:23.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T16:41:23.930 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T16:41:24.091 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:41:24.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:41:24.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:41:24.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:41:24.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:24.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:24.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:24.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:24.628 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:24.634 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:24.765 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:24.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:24.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T16:41:24.907 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T16:41:25.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:41:25.048 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:41:25.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:41:25.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T16:41:25.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:25.326 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:25.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:25.460 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:25.591 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:25.596 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:25.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:25.736 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T16:41:25.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:41:25.874 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:41:26.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:41:26.014 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:41:26.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:41:26.159 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:41:26.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:41:26.293 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T16:41:26.421 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-30T16:41:26.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-30T16:41:26.506 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-30T16:41:26.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-30T16:41:26.717 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-30T16:41:26.801 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-30T16:41:26.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-30T16:41:27.023 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-30T16:41:27.106 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-30T16:41:27.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-30T16:41:27.317 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:41:27.325 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-30T16:41:27.374 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-30T16:41:27.374 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-30T16:41:27.374 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-30T16:41:27.382 INFO:tasks.ceph.mon.a:Started 2024-05-30T16:41:27.382 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-30T16:41:27.382 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-30T16:41:27.387 INFO:tasks.ceph.mon.b:Started 2024-05-30T16:41:27.387 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-30T16:41:27.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-30T16:41:27.392 INFO:tasks.ceph.mon.c:Started 2024-05-30T16:41:27.392 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-30T16:41:27.392 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-30T16:41:27.392 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-30T16:41:27.399 INFO:tasks.ceph.mgr.y:Started 2024-05-30T16:41:27.399 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-30T16:41:27.399 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-30T16:41:27.403 INFO:tasks.ceph.mgr.x:Started 2024-05-30T16:41:27.403 INFO:tasks.ceph:Setting crush tunables to default 2024-05-30T16:41:27.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd crush tunables default 2024-05-30T16:41:27.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.572+0000 7fe789000640 1 Processor -- start 2024-05-30T16:41:27.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.572+0000 7fe789000640 1 -- start start 2024-05-30T16:41:27.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.573+0000 7fe789000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe78415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:27.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe789000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7840b3fd0 con 0x7fe784144020 2024-05-30T16:41:27.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe789000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe784144790 con 0x7fe784141510 2024-05-30T16:41:27.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe789000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe78406dfc0 con 0x7fe7841418f0 2024-05-30T16:41:27.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe782800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe784144020 0x7fe78406e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49998/0 (socket says 172.21.15.144:49998) 2024-05-30T16:41:27.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe782800640 1 -- 172.21.15.144:0/3686477802 learned_addr learned my addr 172.21.15.144:0/3686477802 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:27.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe779400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe78415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:27.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe779400640 1 -- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 msgr2=0x7fe78415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-30T16:41:27.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe779400640 1 -- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 msgr2=0x7fe78415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T16:41:27.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe779400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe78415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T16:41:27.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.574+0000 7fe779400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe78415f8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-30T16:41:27.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.775+0000 7fe779400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe78415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:27.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.776+0000 7fe779400640 1 -- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 msgr2=0x7fe78415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-30T16:41:27.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.776+0000 7fe779400640 1 -- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 msgr2=0x7fe78415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T16:41:27.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.776+0000 7fe779400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe78415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T16:41:27.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.776+0000 7fe779400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe78415f8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-30T16:41:27.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.834+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3434294475 0 0) 0x7fe7840b3fd0 con 0x7fe784144020 2024-05-30T16:41:27.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.834+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe768003520 con 0x7fe784144020 2024-05-30T16:41:27.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.835+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860743847 0 0) 0x7fe784144790 con 0x7fe784141510 2024-05-30T16:41:27.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.835+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7840b3fd0 con 0x7fe784141510 2024-05-30T16:41:27.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 541889889 0 0) 0x7fe7840b3fd0 con 0x7fe784141510 2024-05-30T16:41:27.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 msgr2=0x7fe78415f8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:41:27.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe78415f8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:27.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 >> v1:172.21.15.144:6789/0 conn(0x7fe784144020 legacy=0x7fe78406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:27.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe784144a70 con 0x7fe784141510 2024-05-30T16:41:27.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fe774001670 con 0x7fe784141510 2024-05-30T16:41:27.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 >> v1:172.21.15.149:6789/0 conn(0x7fe784141510 legacy=0x7fe7840b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:27.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe768003b40 0x7fe768003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:27.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768004800 0x7fe768004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:27.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe76800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:27.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.837+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe78406dfc0 con 0x7fe768003b40 2024-05-30T16:41:27.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.838+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe768005570 con 0x7fe768004800 2024-05-30T16:41:27.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.838+0000 7fe781e00640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe768003b40 0x7fe768003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.838+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe76800bf00 con 0x7fe7841418f0 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.838+0000 7fe779400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768004800 0x7fe768004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.838+0000 7fe782800640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe76800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.839+0000 7fe781e00640 1 -- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 msgr2=0x7fe76800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.839+0000 7fe781e00640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe76800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.839+0000 7fe781e00640 1 -- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768004800 msgr2=0x7fe768004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.839+0000 7fe781e00640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768004800 0x7fe768004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.839+0000 7fe781e00640 1 -- 172.21.15.144:0/3686477802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7840b3fd0 con 0x7fe768003b40 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.839+0000 7fe779400640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768004800 0x7fe768004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:41:27.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.839+0000 7fe782800640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7841418f0 0x7fe76800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:27.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.842+0000 7fe781e00640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe768003b40 0x7fe768003f40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe774007ed0 tx=0x7fe768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626063f0c302a22c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:27.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.842+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774007af0 con 0x7fe768003b40 2024-05-30T16:41:27.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.842+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe774031620 con 0x7fe768003b40 2024-05-30T16:41:27.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.842+0000 7fe781400640 1 -- 172.21.15.144:0/3686477802 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774031a10 con 0x7fe768003b40 2024-05-30T16:41:27.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.843+0000 7fe789000640 1 -- 172.21.15.144:0/3686477802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe768003b40 msgr2=0x7fe768003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:27.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.843+0000 7fe789000640 1 --2- 172.21.15.144:0/3686477802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe768003b40 0x7fe768003f40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe774007ed0 tx=0x7fe768005830 comp rx=0 tx=0).stop 2024-05-30T16:41:27.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.843+0000 7fe782800640 1 -- 172.21.15.144:0/3686477802 reap_dead start 2024-05-30T16:41:27.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.843+0000 7fe789000640 1 -- 172.21.15.144:0/3686477802 shutdown_connections 2024-05-30T16:41:27.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.843+0000 7fe789000640 1 -- 172.21.15.144:0/3686477802 >> 172.21.15.144:0/3686477802 conn(0x7fe78406bd00 msgr2=0x7fe78406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:27.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.844+0000 7fe789000640 1 -- 172.21.15.144:0/3686477802 shutdown_connections 2024-05-30T16:41:27.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.844+0000 7fe789000640 1 -- 172.21.15.144:0/3686477802 wait complete. 2024-05-30T16:41:27.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.848+0000 7fe789000640 1 Processor -- start 2024-05-30T16:41:27.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.849+0000 7fe789000640 1 -- start start 2024-05-30T16:41:27.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.850+0000 7fe789000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768003b40 0x7fe7840b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:27.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.850+0000 7fe789000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe784158700 0x7fe784158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:27.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.850+0000 7fe789000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe78413e440 0x7fe78413e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:27.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.850+0000 7fe789000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe784144450 con 0x7fe784158700 2024-05-30T16:41:27.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.850+0000 7fe789000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe78406e210 con 0x7fe768003b40 2024-05-30T16:41:27.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.850+0000 7fe789000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7840b5b50 con 0x7fe78413e440 2024-05-30T16:41:27.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.851+0000 7fe779400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe784158700 0x7fe784158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:27.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.851+0000 7fe779400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe784158700 0x7fe784158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36100/0 (socket says 172.21.15.144:36100) 2024-05-30T16:41:27.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.851+0000 7fe779400640 1 -- 172.21.15.144:0/2792169692 learned_addr learned my addr 172.21.15.144:0/2792169692 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:27.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.851+0000 7fe781e00640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768003b40 0x7fe7840b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:27.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.851+0000 7fe782800640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe78413e440 0x7fe78413e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:27.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.852+0000 7fe782800640 1 -- 172.21.15.144:0/2792169692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768003b40 msgr2=0x7fe7840b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:27.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.852+0000 7fe782800640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768003b40 0x7fe7840b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:27.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.852+0000 7fe782800640 1 -- 172.21.15.144:0/2792169692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe784158700 msgr2=0x7fe784158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:27.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.852+0000 7fe782800640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe784158700 0x7fe784158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:27.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.852+0000 7fe782800640 1 -- 172.21.15.144:0/2792169692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe784148180 con 0x7fe78413e440 2024-05-30T16:41:27.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.852+0000 7fe779400640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe784158700 0x7fe784158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:41:27.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.853+0000 7fe782800640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe78413e440 0x7fe78413e8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe784070180 tx=0x7fe77c00df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:27.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.853+0000 7fe77aa00640 1 -- 172.21.15.144:0/2792169692 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c00b720 con 0x7fe78413e440 2024-05-30T16:41:27.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.853+0000 7fe77aa00640 1 -- 172.21.15.144:0/2792169692 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c00b8c0 con 0x7fe78413e440 2024-05-30T16:41:27.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.853+0000 7fe77aa00640 1 -- 172.21.15.144:0/2792169692 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c00bcf0 con 0x7fe78413e440 2024-05-30T16:41:27.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.853+0000 7fe789000640 1 -- 172.21.15.144:0/2792169692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe784147bc0 con 0x7fe78413e440 2024-05-30T16:41:27.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.854+0000 7fe77aa00640 1 -- 172.21.15.144:0/2792169692 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe77c01b060 con 0x7fe78413e440 2024-05-30T16:41:27.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.854+0000 7fe789000640 1 -- 172.21.15.144:0/2792169692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe784156020 con 0x7fe78413e440 2024-05-30T16:41:27.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.855+0000 7fe77aa00640 1 -- 172.21.15.144:0/2792169692 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe77c0073b0 con 0x7fe78413e440 2024-05-30T16:41:27.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.855+0000 7fe789000640 1 -- 172.21.15.144:0/2792169692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe784068b90 con 0x7fe78413e440 2024-05-30T16:41:27.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.859+0000 7fe77aa00640 1 -- 172.21.15.144:0/2792169692 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe77c0075b0 con 0x7fe78413e440 2024-05-30T16:41:27.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.933+0000 7fe789000640 1 -- 172.21.15.144:0/2792169692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe784160360 con 0x7fe78413e440 2024-05-30T16:41:27.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.940+0000 7fe77aa00640 1 -- 172.21.15.144:0/2792169692 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe77c007790 con 0x7fe78413e440 2024-05-30T16:41:27.941 INFO:teuthology.orchestra.run.smithi144.stderr:adjusted tunables profile to default 2024-05-30T16:41:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.941+0000 7fe789000640 1 -- 172.21.15.144:0/2792169692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe78413e440 msgr2=0x7fe78413e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.941+0000 7fe789000640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe78413e440 0x7fe78413e8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe784070180 tx=0x7fe77c00df70 comp rx=0 tx=0).stop 2024-05-30T16:41:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.942+0000 7fe789000640 1 -- 172.21.15.144:0/2792169692 shutdown_connections 2024-05-30T16:41:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.942+0000 7fe789000640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe78413e440 0x7fe78413e8c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.942+0000 7fe789000640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe784158700 0x7fe784158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.942+0000 7fe789000640 1 --2- 172.21.15.144:0/2792169692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe768003b40 0x7fe7840b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.942+0000 7fe789000640 1 -- 172.21.15.144:0/2792169692 >> 172.21.15.144:0/2792169692 conn(0x7fe78406bd00 msgr2=0x7fe7840b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.942+0000 7fe789000640 1 -- 172.21.15.144:0/2792169692 shutdown_connections 2024-05-30T16:41:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:27.942+0000 7fe789000640 1 -- 172.21.15.144:0/2792169692 wait complete. 2024-05-30T16:41:27.961 INFO:tasks.ceph:check_enable_crimson: False 2024-05-30T16:41:27.961 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-30T16:41:27.961 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:27.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-30T16:41:28.002 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:28.001+0000 7fe253321040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-30T16:41:28.003 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:28.001+0000 7fba9b5d5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-30T16:41:28.025 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:28.025 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-30T16:41:28.142 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:28.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-30T16:41:28.198 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:28.197+0000 7fe253321040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-30T16:41:28.203 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:28.202+0000 7fba9b5d5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-30T16:41:28.262 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:41:28.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-30T16:41:28.266 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:28.265+0000 7fe253321040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-30T16:41:28.270 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:28.269+0000 7fba9b5d5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-30T16:41:28.340 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:28.340 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-30T16:41:28.417 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:28.418 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-30T16:41:28.491 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:28.491 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-30T16:41:28.547 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:28.547+0000 7fe253321040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-30T16:41:28.571 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:28.570+0000 7fba9b5d5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-30T16:41:28.602 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:28.601+0000 7fe253321040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-30T16:41:28.606 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:41:28.606 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-30T16:41:28.628 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:28.627+0000 7fba9b5d5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-30T16:41:28.705 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 60f0288d-c086-4142-ae20-b61210ef3b5e 0 2024-05-30T16:41:28.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.932+0000 7f13cbe00640 1 Processor -- start 2024-05-30T16:41:28.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.932+0000 7f13cbe00640 1 -- start start 2024-05-30T16:41:28.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.934+0000 7f13cbe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f13cc160070 0x7f13cc0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:28.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.934+0000 7f13cbe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13cc1605c0 con 0x7f13cc0cf9d0 2024-05-30T16:41:28.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.934+0000 7f13cbe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13cc1608a0 con 0x7f13cc15e820 2024-05-30T16:41:28.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.934+0000 7f13cbe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f13cc160b80 con 0x7f13cc160070 2024-05-30T16:41:28.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.934+0000 7f13caa00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f13cc15e820 0x7f13cc162c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:52012/0 (socket says 172.21.15.149:52012) 2024-05-30T16:41:28.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.934+0000 7f13caa00640 1 -- 172.21.15.149:0/420754017 learned_addr learned my addr 172.21.15.149:0/420754017 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-30T16:41:28.935 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.934+0000 7f13c3e00640 1 --2- 172.21.15.149:0/420754017 >> v2:172.21.15.149:3300/0 conn(0x7f13cc160070 0x7f13cc0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:28.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.934+0000 7f13c3e00640 1 -- 172.21.15.149:0/420754017 >> v1:172.21.15.149:6789/0 conn(0x7f13cc15e820 legacy=0x7f13cc162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:28.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.935+0000 7f13c3e00640 1 -- 172.21.15.149:0/420754017 >> v1:172.21.15.144:6789/0 conn(0x7f13cc0cf9d0 legacy=0x7f13cc0d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:28.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.935+0000 7f13c3e00640 1 -- 172.21.15.149:0/420754017 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc160e60 con 0x7f13cc160070 2024-05-30T16:41:28.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.935+0000 7f13c3e00640 1 --2- 172.21.15.149:0/420754017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 0x7f13cc0cf490 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f13b40097a0 tx=0x7f13b402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25de45f2b00bf9bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:28.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.936+0000 7f13ca000640 1 -- 172.21.15.149:0/420754017 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4037070 con 0x7f13cc160070 2024-05-30T16:41:28.937 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.936+0000 7f13ca000640 1 -- 172.21.15.149:0/420754017 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b4032440 con 0x7f13cc160070 2024-05-30T16:41:28.937 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.936+0000 7f13ca000640 1 -- 172.21.15.149:0/420754017 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4032810 con 0x7f13cc160070 2024-05-30T16:41:28.937 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.936+0000 7f13cbe00640 1 -- 172.21.15.149:0/420754017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 msgr2=0x7f13cc0cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:28.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.936+0000 7f13cbe00640 1 --2- 172.21.15.149:0/420754017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 0x7f13cc0cf490 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f13b40097a0 tx=0x7f13b402a1e0 comp rx=0 tx=0).stop 2024-05-30T16:41:28.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.937+0000 7f13cbe00640 1 -- 172.21.15.149:0/420754017 shutdown_connections 2024-05-30T16:41:28.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.937+0000 7f13cbe00640 1 --2- 172.21.15.149:0/420754017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 0x7f13cc0cf490 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:28.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.937+0000 7f13cbe00640 1 -- 172.21.15.149:0/420754017 >> 172.21.15.149:0/420754017 conn(0x7f13cc08bfc0 msgr2=0x7f13cc0d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:28.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.937+0000 7f13cbe00640 1 -- 172.21.15.149:0/420754017 shutdown_connections 2024-05-30T16:41:28.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.937+0000 7f13cbe00640 1 -- 172.21.15.149:0/420754017 wait complete. 2024-05-30T16:41:28.939 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.938+0000 7f13cbe00640 1 Processor -- start 2024-05-30T16:41:28.939 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.938+0000 7f13cbe00640 1 -- start start 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.939+0000 7f13cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13cc0cf9d0 0x7f13cc1f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.939+0000 7f13cbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13cc15e820 0x7f13cc06e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.939+0000 7f13cbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 0x7f13cc0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.939+0000 7f13cbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc0d34a0 con 0x7f13cc0cf9d0 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.939+0000 7f13cbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc0d3320 con 0x7f13cc160070 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.939+0000 7f13cbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f13cc161660 con 0x7f13cc15e820 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13cb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 0x7f13cc0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13cb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 0x7f13cc0ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:53738/0 (socket says 172.21.15.149:53738) 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13c3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13cc15e820 0x7f13cc06e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13cb400640 1 -- 172.21.15.149:0/2247357871 learned_addr learned my addr 172.21.15.149:0/2247357871 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13caa00640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13cc0cf9d0 0x7f13cc1f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:28.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13cb400640 1 -- 172.21.15.149:0/2247357871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13cc15e820 msgr2=0x7f13cc06e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13cb400640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13cc15e820 0x7f13cc06e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13cb400640 1 -- 172.21.15.149:0/2247357871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13cc0cf9d0 msgr2=0x7f13cc1f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13cb400640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13cc0cf9d0 0x7f13cc1f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13cb400640 1 -- 172.21.15.149:0/2247357871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc0cae40 con 0x7f13cc160070 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13caa00640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13cc0cf9d0 0x7f13cc1f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13c3e00640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13cc15e820 0x7f13cc06e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.940+0000 7f13cb400640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 0x7f13cc0ca4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f13c400c780 tx=0x7f13c400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.941+0000 7f13c3400640 1 -- 172.21.15.149:0/2247357871 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4004b60 con 0x7f13cc160070 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.941+0000 7f13c3400640 1 -- 172.21.15.149:0/2247357871 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c4004d00 con 0x7f13cc160070 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.941+0000 7f13c3400640 1 -- 172.21.15.149:0/2247357871 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c400aa90 con 0x7f13cc160070 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.941+0000 7f13cbe00640 1 -- 172.21.15.149:0/2247357871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc0cb120 con 0x7f13cc160070 2024-05-30T16:41:28.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.941+0000 7f13cbe00640 1 -- 172.21.15.149:0/2247357871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc0cb400 con 0x7f13cc160070 2024-05-30T16:41:28.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.941+0000 7f13c3400640 1 -- 172.21.15.149:0/2247357871 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f13c4006b50 con 0x7f13cc160070 2024-05-30T16:41:28.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.941+0000 7f13c3400640 1 -- 172.21.15.149:0/2247357871 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f13c4007530 con 0x7f13cc160070 2024-05-30T16:41:28.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.942+0000 7f13cbe00640 1 -- 172.21.15.149:0/2247357871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13cc075570 con 0x7f13cc160070 2024-05-30T16:41:28.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:28.947+0000 7f13c3400640 1 -- 172.21.15.149:0/2247357871 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f13c4020070 con 0x7f13cc160070 2024-05-30T16:41:29.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.027+0000 7f13cbe00640 1 -- 172.21.15.149:0/2247357871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "60f0288d-c086-4142-ae20-b61210ef3b5e", "id": 0} v 0) -- 0x7f13cc0d1e50 con 0x7f13cc160070 2024-05-30T16:41:29.035 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.034+0000 7f13c3400640 1 -- 172.21.15.149:0/2247357871 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60f0288d-c086-4142-ae20-b61210ef3b5e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f13c4007730 con 0x7f13cc160070 2024-05-30T16:41:29.036 INFO:teuthology.orchestra.run.smithi149.stdout:0 2024-05-30T16:41:29.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.036+0000 7f13cbe00640 1 -- 172.21.15.149:0/2247357871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 msgr2=0x7f13cc0ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.036+0000 7f13cbe00640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 0x7f13cc0ca4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f13c400c780 tx=0x7f13c400cc40 comp rx=0 tx=0).stop 2024-05-30T16:41:29.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.036+0000 7f13cbe00640 1 -- 172.21.15.149:0/2247357871 shutdown_connections 2024-05-30T16:41:29.037 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.036+0000 7f13cbe00640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13cc160070 0x7f13cc0ca4d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.036+0000 7f13cbe00640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13cc15e820 0x7f13cc06e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.036+0000 7f13cbe00640 1 --2- 172.21.15.149:0/2247357871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13cc0cf9d0 0x7f13cc1f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.036+0000 7f13cbe00640 1 -- 172.21.15.149:0/2247357871 >> 172.21.15.149:0/2247357871 conn(0x7f13cc08bfc0 msgr2=0x7f13cc06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:29.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.036+0000 7f13cbe00640 1 -- 172.21.15.149:0/2247357871 shutdown_connections 2024-05-30T16:41:29.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.036+0000 7f13cbe00640 1 -- 172.21.15.149:0/2247357871 wait complete. 2024-05-30T16:41:29.054 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 838a88b8-1093-4b43-b194-16e269ca5819 1 2024-05-30T16:41:29.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.236+0000 7f95ca600640 1 Processor -- start 2024-05-30T16:41:29.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.236+0000 7f95ca600640 1 -- start start 2024-05-30T16:41:29.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.237+0000 7f95ca600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c40ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.237+0000 7f95ca600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f95c40d3b70 0x7f95c40b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.237+0000 7f95ca600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c40b91c0 con 0x7f95c415ea90 2024-05-30T16:41:29.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.237+0000 7f95ca600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f95c40b9dd0 con 0x7f95c40d3b70 2024-05-30T16:41:29.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.237+0000 7f95ca600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95c40b8f00 con 0x7f95c40b6a10 2024-05-30T16:41:29.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.238+0000 7f95bbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c40ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.238+0000 7f95c3400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f95c415ea90 0x7f95c40b6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:52020/0 (socket says 172.21.15.149:52020) 2024-05-30T16:41:29.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.238+0000 7f95c3400640 1 -- 172.21.15.149:0/346722058 learned_addr learned my addr 172.21.15.149:0/346722058 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-30T16:41:29.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.238+0000 7f95c3e00640 1 --2- 172.21.15.149:0/346722058 >> v2:172.21.15.144:3300/0 conn(0x7f95c40d3b70 0x7f95c40b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.238+0000 7f95bbe00640 1 -- 172.21.15.149:0/346722058 >> v2:172.21.15.144:3300/0 conn(0x7f95c40d3b70 msgr2=0x7f95c40b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:29.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.238+0000 7f95bbe00640 1 --2- 172.21.15.149:0/346722058 >> v2:172.21.15.144:3300/0 conn(0x7f95c40d3b70 0x7f95c40b79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.238+0000 7f95c2a00640 1 -- 172.21.15.149:0/346722058 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323890199 0 0) 0x7f95c40b91c0 con 0x7f95c415ea90 2024-05-30T16:41:29.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.238+0000 7f95bbe00640 1 -- 172.21.15.149:0/346722058 >> v1:172.21.15.149:6789/0 conn(0x7f95c415ea90 legacy=0x7f95c40b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.238+0000 7f95bbe00640 1 -- 172.21.15.149:0/346722058 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c40b94a0 con 0x7f95c40b6a10 2024-05-30T16:41:29.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.239+0000 7f95bbe00640 1 --2- 172.21.15.149:0/346722058 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c40ba330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0097a0 tx=0x7f95ac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1aae56eaed09076 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:29.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.239+0000 7f95c2a00640 1 -- 172.21.15.149:0/346722058 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac037070 con 0x7f95c40b6a10 2024-05-30T16:41:29.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.239+0000 7f95c2a00640 1 -- 172.21.15.149:0/346722058 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac032440 con 0x7f95c40b6a10 2024-05-30T16:41:29.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.239+0000 7f95c2a00640 1 -- 172.21.15.149:0/346722058 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac032810 con 0x7f95c40b6a10 2024-05-30T16:41:29.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.240+0000 7f95ca600640 1 -- 172.21.15.149:0/346722058 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 msgr2=0x7f95c40ba330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.240+0000 7f95ca600640 1 --2- 172.21.15.149:0/346722058 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c40ba330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0097a0 tx=0x7f95ac02a180 comp rx=0 tx=0).stop 2024-05-30T16:41:29.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.240+0000 7f95ca600640 1 -- 172.21.15.149:0/346722058 shutdown_connections 2024-05-30T16:41:29.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.240+0000 7f95ca600640 1 --2- 172.21.15.149:0/346722058 >> v2:172.21.15.144:3300/0 conn(0x7f95c40d3b70 0x7f95c40b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.240+0000 7f95ca600640 1 --2- 172.21.15.149:0/346722058 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c40ba330 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.240+0000 7f95ca600640 1 -- 172.21.15.149:0/346722058 >> 172.21.15.149:0/346722058 conn(0x7f95c40627b0 msgr2=0x7f95c4062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:29.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.240+0000 7f95ca600640 1 -- 172.21.15.149:0/346722058 shutdown_connections 2024-05-30T16:41:29.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.240+0000 7f95ca600640 1 -- 172.21.15.149:0/346722058 wait complete. 2024-05-30T16:41:29.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.242+0000 7f95ca600640 1 Processor -- start 2024-05-30T16:41:29.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.242+0000 7f95ca600640 1 -- start start 2024-05-30T16:41:29.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.243+0000 7f95ca600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.243+0000 7f95ca600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c40d3b70 0x7f95c40b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.243+0000 7f95ca600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c415ea90 0x7f95c40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.243+0000 7f95ca600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f95c415ee70 con 0x7f95c40d3b70 2024-05-30T16:41:29.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.243+0000 7f95ca600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95c40b9a60 con 0x7f95c415ea90 2024-05-30T16:41:29.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.243+0000 7f95ca600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95c40b7ef0 con 0x7f95c40b6a10 2024-05-30T16:41:29.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.243+0000 7f95c3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.243+0000 7f95c3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c414ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:41522/0 (socket says 172.21.15.149:41522) 2024-05-30T16:41:29.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.243+0000 7f95c3400640 1 -- 172.21.15.149:0/3852410611 learned_addr learned my addr 172.21.15.149:0/3852410611 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:29.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.244+0000 7f95c3e00640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c415ea90 0x7f95c40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.244+0000 7f95bbe00640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c40d3b70 0x7f95c40b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.244+0000 7f95c3400640 1 -- 172.21.15.149:0/3852410611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c415ea90 msgr2=0x7f95c40b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.244+0000 7f95c3400640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c415ea90 0x7f95c40b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.244+0000 7f95c3400640 1 -- 172.21.15.149:0/3852410611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c40d3b70 msgr2=0x7f95c40b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.244+0000 7f95c3400640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c40d3b70 0x7f95c40b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.244+0000 7f95c3400640 1 -- 172.21.15.149:0/3852410611 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c40c9eb0 con 0x7f95c40b6a10 2024-05-30T16:41:29.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.244+0000 7f95bbe00640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c40d3b70 0x7f95c40b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:41:29.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.244+0000 7f95c3400640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c414ed50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c460 tx=0x7f95b400c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:29.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.245+0000 7f95bb400640 1 -- 172.21.15.149:0/3852410611 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4018070 con 0x7f95c40b6a10 2024-05-30T16:41:29.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.245+0000 7f95bb400640 1 -- 172.21.15.149:0/3852410611 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b4007500 con 0x7f95c40b6a10 2024-05-30T16:41:29.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.245+0000 7f95bb400640 1 -- 172.21.15.149:0/3852410611 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4004a20 con 0x7f95c40b6a10 2024-05-30T16:41:29.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.245+0000 7f95ca600640 1 -- 172.21.15.149:0/3852410611 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c40ca150 con 0x7f95c40b6a10 2024-05-30T16:41:29.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.245+0000 7f95ca600640 1 -- 172.21.15.149:0/3852410611 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c40ca710 con 0x7f95c40b6a10 2024-05-30T16:41:29.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.245+0000 7f95bb400640 1 -- 172.21.15.149:0/3852410611 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f95b4004bc0 con 0x7f95c40b6a10 2024-05-30T16:41:29.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.245+0000 7f95bb400640 1 -- 172.21.15.149:0/3852410611 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f95b401c7a0 con 0x7f95c40b6a10 2024-05-30T16:41:29.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.246+0000 7f95ca600640 1 -- 172.21.15.149:0/3852410611 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c4068b90 con 0x7f95c40b6a10 2024-05-30T16:41:29.249 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.249+0000 7f95bb400640 1 -- 172.21.15.149:0/3852410611 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f95b4021070 con 0x7f95c40b6a10 2024-05-30T16:41:29.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.328+0000 7f95ca600640 1 -- 172.21.15.149:0/3852410611 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "838a88b8-1093-4b43-b194-16e269ca5819", "id": 1} v 0) -- 0x7f95c406bc70 con 0x7f95c40b6a10 2024-05-30T16:41:29.337 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.336+0000 7f95bb400640 1 -- 172.21.15.149:0/3852410611 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "838a88b8-1093-4b43-b194-16e269ca5819", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f95b4012400 con 0x7f95c40b6a10 2024-05-30T16:41:29.337 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-05-30T16:41:29.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.338+0000 7f95ca600640 1 -- 172.21.15.149:0/3852410611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 msgr2=0x7f95c414ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.338+0000 7f95ca600640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c414ed50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c460 tx=0x7f95b400c920 comp rx=0 tx=0).stop 2024-05-30T16:41:29.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.338+0000 7f95ca600640 1 -- 172.21.15.149:0/3852410611 shutdown_connections 2024-05-30T16:41:29.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.338+0000 7f95ca600640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c415ea90 0x7f95c40b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.338+0000 7f95ca600640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c40d3b70 0x7f95c40b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.338+0000 7f95ca600640 1 --2- 172.21.15.149:0/3852410611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c40b6a10 0x7f95c414ed50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.339 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.338+0000 7f95ca600640 1 -- 172.21.15.149:0/3852410611 >> 172.21.15.149:0/3852410611 conn(0x7f95c40627b0 msgr2=0x7f95c415dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:29.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.338+0000 7f95ca600640 1 -- 172.21.15.149:0/3852410611 shutdown_connections 2024-05-30T16:41:29.340 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.338+0000 7f95ca600640 1 -- 172.21.15.149:0/3852410611 wait complete. 2024-05-30T16:41:29.358 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new e4dd2d18-ea5a-40c9-a231-9178b930c60f 2 2024-05-30T16:41:29.529 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.528+0000 7fe291600640 1 Processor -- start 2024-05-30T16:41:29.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.529+0000 7fe291600640 1 -- start start 2024-05-30T16:41:29.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.530+0000 7fe291600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe28c0b6890 0x7fe28c169810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.530+0000 7fe291600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28c0d2740 con 0x7fe28c0d2240 2024-05-30T16:41:29.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.530+0000 7fe291600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28c0d2a20 con 0x7fe28c06e790 2024-05-30T16:41:29.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.530+0000 7fe291600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe28c0d07c0 con 0x7fe28c0b6890 2024-05-30T16:41:29.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.530+0000 7fe28be00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe28c06e790 0x7fe28c0d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:52030/0 (socket says 172.21.15.149:52030) 2024-05-30T16:41:29.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.530+0000 7fe28be00640 1 -- 172.21.15.149:0/1049078835 learned_addr learned my addr 172.21.15.149:0/1049078835 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-30T16:41:29.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.530+0000 7fe290c00640 1 --2- 172.21.15.149:0/1049078835 >> v2:172.21.15.144:3300/0 conn(0x7fe28c0b6890 0x7fe28c169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1246114218 0 0) 0x7fe28c0d2a20 con 0x7fe28c06e790 2024-05-30T16:41:29.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe270003520 con 0x7fe28c06e790 2024-05-30T16:41:29.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3135504856 0 0) 0x7fe270003520 con 0x7fe28c06e790 2024-05-30T16:41:29.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 >> v2:172.21.15.144:3300/0 conn(0x7fe28c0b6890 msgr2=0x7fe28c169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 --2- 172.21.15.149:0/1049078835 >> v2:172.21.15.144:3300/0 conn(0x7fe28c0b6890 0x7fe28c169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 >> v1:172.21.15.144:6789/0 conn(0x7fe28c0d2240 legacy=0x7fe28c0b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c0d2d00 con 0x7fe28c06e790 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fe27c0019f0 con 0x7fe28c06e790 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 >> v1:172.21.15.149:6789/0 conn(0x7fe28c06e790 legacy=0x7fe28c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe270003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe270004800 0x7fe270004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe2700051c0 0x7fe27000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c0d07c0 con 0x7fe270004800 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe27000c160 con 0x7fe2700039b0 2024-05-30T16:41:29.534 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe27000c360 con 0x7fe2700051c0 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe28be00640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe270003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.531+0000 7fe290c00640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe2700051c0 0x7fe27000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.532+0000 7fe283400640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe270004800 0x7fe270004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.532+0000 7fe28be00640 1 -- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe2700051c0 msgr2=0x7fe27000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.532+0000 7fe28be00640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe2700051c0 0x7fe27000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.532+0000 7fe28be00640 1 -- 172.21.15.149:0/1049078835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe270004800 msgr2=0x7fe270004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.532+0000 7fe28be00640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe270004800 0x7fe270004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.532+0000 7fe28be00640 1 -- 172.21.15.149:0/1049078835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe270003520 con 0x7fe2700039b0 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.532+0000 7fe290c00640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe2700051c0 0x7fe27000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:41:29.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.532+0000 7fe290c00640 1 -- 172.21.15.149:0/1049078835 reap_dead start 2024-05-30T16:41:29.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.533+0000 7fe28be00640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe270003dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00a860 tx=0x7fe270005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2bbc071bdc3c213 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:29.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.533+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00a480 con 0x7fe2700039b0 2024-05-30T16:41:29.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.533+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c02f070 con 0x7fe2700039b0 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.533+0000 7fe28b400640 1 -- 172.21.15.149:0/1049078835 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c02bcd0 con 0x7fe2700039b0 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.534+0000 7fe291600640 1 -- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 msgr2=0x7fe270003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.534+0000 7fe291600640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe270003dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00a860 tx=0x7fe270005830 comp rx=0 tx=0).stop 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.534+0000 7fe291600640 1 -- 172.21.15.149:0/1049078835 shutdown_connections 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.534+0000 7fe291600640 1 --2- 172.21.15.149:0/1049078835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe270003dd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.534+0000 7fe291600640 1 -- 172.21.15.149:0/1049078835 >> 172.21.15.149:0/1049078835 conn(0x7fe28c08bfc0 msgr2=0x7fe28c0d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.534+0000 7fe291600640 1 -- 172.21.15.149:0/1049078835 shutdown_connections 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.534+0000 7fe291600640 1 -- 172.21.15.149:0/1049078835 wait complete. 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.536+0000 7fe291600640 1 Processor -- start 2024-05-30T16:41:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.536+0000 7fe291600640 1 -- start start 2024-05-30T16:41:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe291600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe28c15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe291600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe28c0cc150 0x7fe28c1f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe291600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe28c1562d0 0x7fe28c0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe291600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c0d00b0 con 0x7fe28c0cc150 2024-05-30T16:41:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe291600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c0d32c0 con 0x7fe2700039b0 2024-05-30T16:41:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe291600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe28c0d0230 con 0x7fe28c1562d0 2024-05-30T16:41:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe28be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe28c15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe290c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe28c1562d0 0x7fe28c0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe28be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe28c15ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:53754/0 (socket says 172.21.15.149:53754) 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe28be00640 1 -- 172.21.15.149:0/655617992 learned_addr learned my addr 172.21.15.149:0/655617992 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe283400640 1 --2- 172.21.15.149:0/655617992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe28c0cc150 0x7fe28c1f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe28be00640 1 -- 172.21.15.149:0/655617992 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe28c1562d0 msgr2=0x7fe28c0c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe28be00640 1 --2- 172.21.15.149:0/655617992 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe28c1562d0 0x7fe28c0c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe28be00640 1 -- 172.21.15.149:0/655617992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe28c0cc150 msgr2=0x7fe28c1f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe28be00640 1 --2- 172.21.15.149:0/655617992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe28c0cc150 0x7fe28c1f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe28be00640 1 -- 172.21.15.149:0/655617992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c158240 con 0x7fe2700039b0 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.537+0000 7fe290c00640 1 --2- 172.21.15.149:0/655617992 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe28c1562d0 0x7fe28c0c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.538+0000 7fe28be00640 1 --2- 172.21.15.149:0/655617992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe28c15ba90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00a980 tx=0x7fe28c0d2910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.538+0000 7fe288c00640 1 -- 172.21.15.149:0/655617992 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c044070 con 0x7fe2700039b0 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.538+0000 7fe288c00640 1 -- 172.21.15.149:0/655617992 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c02bdd0 con 0x7fe2700039b0 2024-05-30T16:41:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.538+0000 7fe288c00640 1 -- 172.21.15.149:0/655617992 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00a480 con 0x7fe2700039b0 2024-05-30T16:41:29.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.538+0000 7fe291600640 1 -- 172.21.15.149:0/655617992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c0cc7c0 con 0x7fe2700039b0 2024-05-30T16:41:29.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.538+0000 7fe291600640 1 -- 172.21.15.149:0/655617992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c1f8300 con 0x7fe2700039b0 2024-05-30T16:41:29.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.538+0000 7fe288c00640 1 -- 172.21.15.149:0/655617992 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe27c047070 con 0x7fe2700039b0 2024-05-30T16:41:29.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.538+0000 7fe288c00640 1 -- 172.21.15.149:0/655617992 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fe27c034ab0 con 0x7fe2700039b0 2024-05-30T16:41:29.541 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.539+0000 7fe281600640 1 -- 172.21.15.149:0/655617992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28c0cc530 con 0x7fe2700039b0 2024-05-30T16:41:29.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.543+0000 7fe288c00640 1 -- 172.21.15.149:0/655617992 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe27c04e020 con 0x7fe2700039b0 2024-05-30T16:41:29.561 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:29.560+0000 7fba9b5d5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-30T16:41:29.586 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:29.585+0000 7fe253321040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-30T16:41:29.622 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.621+0000 7fe281600640 1 -- 172.21.15.149:0/655617992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e4dd2d18-ea5a-40c9-a231-9178b930c60f", "id": 2} v 0) -- 0x7fe28c0ccc80 con 0x7fe2700039b0 2024-05-30T16:41:29.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.629+0000 7fe288c00640 1 -- 172.21.15.149:0/655617992 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4dd2d18-ea5a-40c9-a231-9178b930c60f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fe28c158240 con 0x7fe2700039b0 2024-05-30T16:41:29.630 INFO:teuthology.orchestra.run.smithi149.stdout:2 2024-05-30T16:41:29.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.630+0000 7fe281600640 1 -- 172.21.15.149:0/655617992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 msgr2=0x7fe28c15ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.630+0000 7fe281600640 1 --2- 172.21.15.149:0/655617992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe28c15ba90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00a980 tx=0x7fe28c0d2910 comp rx=0 tx=0).stop 2024-05-30T16:41:29.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.630+0000 7fe281600640 1 -- 172.21.15.149:0/655617992 shutdown_connections 2024-05-30T16:41:29.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.630+0000 7fe281600640 1 --2- 172.21.15.149:0/655617992 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe28c1562d0 0x7fe28c0c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.630+0000 7fe281600640 1 --2- 172.21.15.149:0/655617992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe28c0cc150 0x7fe28c1f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.630+0000 7fe281600640 1 --2- 172.21.15.149:0/655617992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2700039b0 0x7fe28c15ba90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.630+0000 7fe281600640 1 -- 172.21.15.149:0/655617992 >> 172.21.15.149:0/655617992 conn(0x7fe28c08bfc0 msgr2=0x7fe28c0b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:29.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.630+0000 7fe281600640 1 -- 172.21.15.149:0/655617992 shutdown_connections 2024-05-30T16:41:29.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.631+0000 7fe281600640 1 -- 172.21.15.149:0/655617992 wait complete. 2024-05-30T16:41:29.648 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 5b9666b7-ac43-4b9f-81f0-c620389ed1f9 3 2024-05-30T16:41:29.674 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:29.673+0000 7fba9b5d5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-30T16:41:29.691 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:29.690+0000 7fe253321040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-30T16:41:29.730 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:29.729+0000 7fba9b5d5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-30T16:41:29.741 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:29.740+0000 7fe253321040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-30T16:41:29.822 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.821+0000 7f107e800640 1 Processor -- start 2024-05-30T16:41:29.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.822+0000 7f107e800640 1 -- start start 2024-05-30T16:41:29.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f107e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f107815e910 0x7f10780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f107e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10780ba540 0x7f10780cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f107e800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f10780d2dc0 0x7f10780d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f107e800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f10780d2930 con 0x7f10780ba540 2024-05-30T16:41:29.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f107e800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f10780b9360 con 0x7f10780d2dc0 2024-05-30T16:41:29.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f107e800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f10780b9640 con 0x7f107815e910 2024-05-30T16:41:29.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f1077400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f107815e910 0x7f10780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f1077400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f107815e910 0x7f10780cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:41544/0 (socket says 172.21.15.149:41544) 2024-05-30T16:41:29.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f1077400640 1 -- 172.21.15.149:0/1462025894 learned_addr learned my addr 172.21.15.149:0/1462025894 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:29.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.823+0000 7f1077e00640 1 --2- 172.21.15.149:0/1462025894 >> v2:172.21.15.149:3300/0 conn(0x7f10780d2dc0 0x7f10780d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.824+0000 7f106fe00640 1 --2- 172.21.15.149:0/1462025894 >> v2:172.21.15.144:3300/0 conn(0x7f10780ba540 0x7f10780cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.824+0000 7f1077400640 1 -- 172.21.15.149:0/1462025894 >> v2:172.21.15.149:3300/0 conn(0x7f10780d2dc0 msgr2=0x7f10780d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:29.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.824+0000 7f1077400640 1 --2- 172.21.15.149:0/1462025894 >> v2:172.21.15.149:3300/0 conn(0x7f10780d2dc0 0x7f10780d3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.824+0000 7f1077400640 1 -- 172.21.15.149:0/1462025894 >> v2:172.21.15.144:3300/0 conn(0x7f10780ba540 msgr2=0x7f10780cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:29.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.824+0000 7f1077400640 1 --2- 172.21.15.149:0/1462025894 >> v2:172.21.15.144:3300/0 conn(0x7f10780ba540 0x7f10780cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.824+0000 7f1077400640 1 -- 172.21.15.149:0/1462025894 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10780b9920 con 0x7f107815e910 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.825+0000 7f1077400640 1 --2- 172.21.15.149:0/1462025894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f107815e910 0x7f10780cf4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f10780cb880 tx=0x7f106802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=841e5a0338d7e0ee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.825+0000 7f1076a00640 1 -- 172.21.15.149:0/1462025894 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068037070 con 0x7f107815e910 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.825+0000 7f1076a00640 1 -- 172.21.15.149:0/1462025894 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1068032440 con 0x7f107815e910 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.825+0000 7f1076a00640 1 -- 172.21.15.149:0/1462025894 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068032810 con 0x7f107815e910 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.826+0000 7f107e800640 1 -- 172.21.15.149:0/1462025894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f107815e910 msgr2=0x7f10780cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.826+0000 7f107e800640 1 --2- 172.21.15.149:0/1462025894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f107815e910 0x7f10780cf4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f10780cb880 tx=0x7f106802a270 comp rx=0 tx=0).stop 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.826+0000 7f107e800640 1 -- 172.21.15.149:0/1462025894 shutdown_connections 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.826+0000 7f107e800640 1 --2- 172.21.15.149:0/1462025894 >> v2:172.21.15.149:3300/0 conn(0x7f10780d2dc0 0x7f10780d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.826+0000 7f107e800640 1 --2- 172.21.15.149:0/1462025894 >> v2:172.21.15.144:3300/0 conn(0x7f10780ba540 0x7f10780cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.826+0000 7f107e800640 1 --2- 172.21.15.149:0/1462025894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f107815e910 0x7f10780cf4f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.826+0000 7f107e800640 1 -- 172.21.15.149:0/1462025894 >> 172.21.15.149:0/1462025894 conn(0x7f10780627b0 msgr2=0x7f1078062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.826+0000 7f107e800640 1 -- 172.21.15.149:0/1462025894 shutdown_connections 2024-05-30T16:41:29.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.826+0000 7f107e800640 1 -- 172.21.15.149:0/1462025894 wait complete. 2024-05-30T16:41:29.829 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.828+0000 7f107e800640 1 Processor -- start 2024-05-30T16:41:29.829 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.828+0000 7f107e800640 1 -- start start 2024-05-30T16:41:29.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f107e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10780ba540 0x7f1078152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f107e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10780d2dc0 0x7f10781f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f107e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f107815e910 0x7f10781f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:29.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f107e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f107815ee70 con 0x7f107815e910 2024-05-30T16:41:29.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f107e800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f107815ecf0 con 0x7f10780ba540 2024-05-30T16:41:29.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f107e800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f10780d3790 con 0x7f10780d2dc0 2024-05-30T16:41:29.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f1077400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10780ba540 0x7f1078152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f106fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10780d2dc0 0x7f10781f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f1077400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10780ba540 0x7f1078152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:53782/0 (socket says 172.21.15.149:53782) 2024-05-30T16:41:29.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f1077400640 1 -- 172.21.15.149:0/294845813 learned_addr learned my addr 172.21.15.149:0/294845813 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:29.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.829+0000 7f1077e00640 1 --2- 172.21.15.149:0/294845813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f107815e910 0x7f10781f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:29.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f106fe00640 1 -- 172.21.15.149:0/294845813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10780ba540 msgr2=0x7f1078152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f106fe00640 1 --2- 172.21.15.149:0/294845813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10780ba540 0x7f1078152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f106fe00640 1 -- 172.21.15.149:0/294845813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f107815e910 msgr2=0x7f10781f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f106fe00640 1 --2- 172.21.15.149:0/294845813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f107815e910 0x7f10781f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f106fe00640 1 -- 172.21.15.149:0/294845813 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107815c6b0 con 0x7f10780d2dc0 2024-05-30T16:41:29.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f106fe00640 1 --2- 172.21.15.149:0/294845813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10780d2dc0 0x7f10781f54a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f106000c610 tx=0x7f106000cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:29.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f106f400640 1 -- 172.21.15.149:0/294845813 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060015070 con 0x7f10780d2dc0 2024-05-30T16:41:29.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f106f400640 1 -- 172.21.15.149:0/294845813 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060004220 con 0x7f10780d2dc0 2024-05-30T16:41:29.835 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f106f400640 1 -- 172.21.15.149:0/294845813 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060003610 con 0x7f10780d2dc0 2024-05-30T16:41:29.835 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f107e800640 1 -- 172.21.15.149:0/294845813 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10780cb990 con 0x7f10780d2dc0 2024-05-30T16:41:29.835 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.830+0000 7f107e800640 1 -- 172.21.15.149:0/294845813 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10780cbc30 con 0x7f10780d2dc0 2024-05-30T16:41:29.836 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.831+0000 7f106f400640 1 -- 172.21.15.149:0/294845813 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f10600037b0 con 0x7f10780d2dc0 2024-05-30T16:41:29.836 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.832+0000 7f107e800640 1 -- 172.21.15.149:0/294845813 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10780d5160 con 0x7f10780d2dc0 2024-05-30T16:41:29.836 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.833+0000 7f106f400640 1 -- 172.21.15.149:0/294845813 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1060011dd0 con 0x7f10780d2dc0 2024-05-30T16:41:29.836 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.835+0000 7f106f400640 1 -- 172.21.15.149:0/294845813 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f10780d5160 con 0x7f10780d2dc0 2024-05-30T16:41:29.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.914+0000 7f107e800640 1 -- 172.21.15.149:0/294845813 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5b9666b7-ac43-4b9f-81f0-c620389ed1f9", "id": 3} v 0) -- 0x7f1078068b90 con 0x7f10780d2dc0 2024-05-30T16:41:29.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.921+0000 7f106f400640 1 -- 172.21.15.149:0/294845813 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b9666b7-ac43-4b9f-81f0-c620389ed1f9", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1060003da0 con 0x7f10780d2dc0 2024-05-30T16:41:29.922 INFO:teuthology.orchestra.run.smithi149.stdout:3 2024-05-30T16:41:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.923+0000 7f107e800640 1 -- 172.21.15.149:0/294845813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10780d2dc0 msgr2=0x7f10781f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.923+0000 7f107e800640 1 --2- 172.21.15.149:0/294845813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10780d2dc0 0x7f10781f54a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f106000c610 tx=0x7f106000cad0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.923+0000 7f107e800640 1 -- 172.21.15.149:0/294845813 shutdown_connections 2024-05-30T16:41:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.923+0000 7f107e800640 1 --2- 172.21.15.149:0/294845813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f107815e910 0x7f10781f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.923+0000 7f107e800640 1 --2- 172.21.15.149:0/294845813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10780d2dc0 0x7f10781f54a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.923+0000 7f107e800640 1 --2- 172.21.15.149:0/294845813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10780ba540 0x7f1078152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.923+0000 7f107e800640 1 -- 172.21.15.149:0/294845813 >> 172.21.15.149:0/294845813 conn(0x7f10780627b0 msgr2=0x7f10780b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.923+0000 7f107e800640 1 -- 172.21.15.149:0/294845813 shutdown_connections 2024-05-30T16:41:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:29.923+0000 7f107e800640 1 -- 172.21.15.149:0/294845813 wait complete. 2024-05-30T16:41:29.938 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:29.937+0000 7fe253321040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-30T16:41:29.939 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:29.938+0000 7fba9b5d5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-30T16:41:29.941 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 561069cb-4cc2-4227-a6f5-d1f2bee387f6 4 2024-05-30T16:41:30.001 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:30.000+0000 7fe253321040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-30T16:41:30.012 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:30.012+0000 7fba9b5d5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-30T16:41:30.063 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:30.062+0000 7fe253321040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-30T16:41:30.078 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:30.078+0000 7fba9b5d5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-30T16:41:30.166 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.165+0000 7f576da00640 1 Processor -- start 2024-05-30T16:41:30.166 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.165+0000 7f576da00640 1 -- start start 2024-05-30T16:41:30.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.166+0000 7f576da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57680d2240 0x7f57680b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.166+0000 7f576da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57680b66c0 0x7f576806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576da00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57680d2740 con 0x7f576806e790 2024-05-30T16:41:30.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576da00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f57680d07c0 con 0x7f57680d2240 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f57680d2a20 con 0x7f57680b66c0 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57680b66c0 0x7f576806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57680b66c0 0x7f576806ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:41566/0 (socket says 172.21.15.149:41566) 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576d000640 1 -- 172.21.15.149:0/187832414 learned_addr learned my addr 172.21.15.149:0/187832414 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f575fe00640 1 --2- 172.21.15.149:0/187832414 >> v2:172.21.15.144:3300/0 conn(0x7f57680d2240 0x7f57680b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576d000640 1 -- 172.21.15.149:0/187832414 >> v2:172.21.15.144:3300/0 conn(0x7f57680d2240 msgr2=0x7f57680b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576d000640 1 --2- 172.21.15.149:0/187832414 >> v2:172.21.15.144:3300/0 conn(0x7f57680d2240 0x7f57680b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576d000640 1 -- 172.21.15.149:0/187832414 >> v1:172.21.15.144:6789/0 conn(0x7f576806e790 legacy=0x7f57680d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.167+0000 7f576d000640 1 -- 172.21.15.149:0/187832414 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57680d2d00 con 0x7f57680b66c0 2024-05-30T16:41:30.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.169+0000 7f576d000640 1 --2- 172.21.15.149:0/187832414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57680b66c0 0x7f576806ca50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5760009e50 tx=0x7f576002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df415be9faf0c522 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:30.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.169+0000 7f5767400640 1 -- 172.21.15.149:0/187832414 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760036070 con 0x7f57680b66c0 2024-05-30T16:41:30.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.169+0000 7f5767400640 1 -- 172.21.15.149:0/187832414 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5760031600 con 0x7f57680b66c0 2024-05-30T16:41:30.170 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.169+0000 7f5767400640 1 -- 172.21.15.149:0/187832414 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57600319d0 con 0x7f57680b66c0 2024-05-30T16:41:30.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.170+0000 7f576da00640 1 -- 172.21.15.149:0/187832414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57680b66c0 msgr2=0x7f576806ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.170+0000 7f576da00640 1 --2- 172.21.15.149:0/187832414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57680b66c0 0x7f576806ca50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5760009e50 tx=0x7f576002a680 comp rx=0 tx=0).stop 2024-05-30T16:41:30.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.170+0000 7f576da00640 1 -- 172.21.15.149:0/187832414 shutdown_connections 2024-05-30T16:41:30.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.170+0000 7f576da00640 1 --2- 172.21.15.149:0/187832414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57680b66c0 0x7f576806ca50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.170+0000 7f576da00640 1 --2- 172.21.15.149:0/187832414 >> v2:172.21.15.144:3300/0 conn(0x7f57680d2240 0x7f57680b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.170+0000 7f576da00640 1 -- 172.21.15.149:0/187832414 >> 172.21.15.149:0/187832414 conn(0x7f576808bfc0 msgr2=0x7f57680d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:30.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.170+0000 7f576da00640 1 -- 172.21.15.149:0/187832414 shutdown_connections 2024-05-30T16:41:30.171 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.170+0000 7f576da00640 1 -- 172.21.15.149:0/187832414 wait complete. 2024-05-30T16:41:30.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.172+0000 7f576da00640 1 Processor -- start 2024-05-30T16:41:30.173 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.172+0000 7f576da00640 1 -- start start 2024-05-30T16:41:30.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f576da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f576806e790 0x7f5768157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f576da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57680b66c0 0x7f5768157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f576da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57680d2240 0x7f576815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.175 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f576da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f576806cf90 con 0x7f57680d2240 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f576da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f57680d32c0 con 0x7f57680b66c0 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f576da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f576806d110 con 0x7f576806e790 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f5767e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f576806e790 0x7f5768157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f575fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57680b66c0 0x7f5768157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f575fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57680b66c0 0x7f5768157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:53796/0 (socket says 172.21.15.149:53796) 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f5767e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f576806e790 0x7f5768157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:41578/0 (socket says 172.21.15.149:41578) 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.173+0000 7f575fe00640 1 -- 172.21.15.149:0/4125561462 learned_addr learned my addr 172.21.15.149:0/4125561462 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f576d000640 1 --2- 172.21.15.149:0/4125561462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57680d2240 0x7f576815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f5767e00640 1 -- 172.21.15.149:0/4125561462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57680b66c0 msgr2=0x7f5768157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f5767e00640 1 --2- 172.21.15.149:0/4125561462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57680b66c0 0x7f5768157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f5767e00640 1 -- 172.21.15.149:0/4125561462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57680d2240 msgr2=0x7f576815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f5767e00640 1 --2- 172.21.15.149:0/4125561462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57680d2240 0x7f576815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f5767e00640 1 -- 172.21.15.149:0/4125561462 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576815ce00 con 0x7f576806e790 2024-05-30T16:41:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f575fe00640 1 --2- 172.21.15.149:0/4125561462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57680b66c0 0x7f5768157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:41:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f5767e00640 1 --2- 172.21.15.149:0/4125561462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f576806e790 0x7f5768157c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f575800c390 tx=0x7f575800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f5764c00640 1 -- 172.21.15.149:0/4125561462 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758017070 con 0x7f576806e790 2024-05-30T16:41:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f5764c00640 1 -- 172.21.15.149:0/4125561462 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57580052d0 con 0x7f576806e790 2024-05-30T16:41:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f5764c00640 1 -- 172.21.15.149:0/4125561462 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758003830 con 0x7f576806e790 2024-05-30T16:41:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f576da00640 1 -- 172.21.15.149:0/4125561462 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576815e4e0 con 0x7f576806e790 2024-05-30T16:41:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.174+0000 7f576da00640 1 -- 172.21.15.149:0/4125561462 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f576815eaa0 con 0x7f576806e790 2024-05-30T16:41:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.175+0000 7f5764c00640 1 -- 172.21.15.149:0/4125561462 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f575801a070 con 0x7f576806e790 2024-05-30T16:41:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.175+0000 7f5764c00640 1 -- 172.21.15.149:0/4125561462 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5758011590 con 0x7f576806e790 2024-05-30T16:41:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.175+0000 7f576da00640 1 -- 172.21.15.149:0/4125561462 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5768075570 con 0x7f576806e790 2024-05-30T16:41:30.178 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.178+0000 7f5764c00640 1 -- 172.21.15.149:0/4125561462 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5758021070 con 0x7f576806e790 2024-05-30T16:41:30.191 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:30.190+0000 7fe253321040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-30T16:41:30.215 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:30.214+0000 7fba9b5d5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-30T16:41:30.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.257+0000 7f576da00640 1 -- 172.21.15.149:0/4125561462 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "561069cb-4cc2-4227-a6f5-d1f2bee387f6", "id": 4} v 0) -- 0x7f57680d1f40 con 0x7f576806e790 2024-05-30T16:41:30.264 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.264+0000 7f5764c00640 1 -- 172.21.15.149:0/4125561462 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "561069cb-4cc2-4227-a6f5-d1f2bee387f6", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f576815ce00 con 0x7f576806e790 2024-05-30T16:41:30.265 INFO:teuthology.orchestra.run.smithi149.stdout:4 2024-05-30T16:41:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.265+0000 7f576da00640 1 -- 172.21.15.149:0/4125561462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f576806e790 msgr2=0x7f5768157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.265+0000 7f576da00640 1 --2- 172.21.15.149:0/4125561462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f576806e790 0x7f5768157c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f575800c390 tx=0x7f575800c850 comp rx=0 tx=0).stop 2024-05-30T16:41:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.265+0000 7f576da00640 1 -- 172.21.15.149:0/4125561462 shutdown_connections 2024-05-30T16:41:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.265+0000 7f576da00640 1 --2- 172.21.15.149:0/4125561462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57680d2240 0x7f576815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.265+0000 7f576da00640 1 --2- 172.21.15.149:0/4125561462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57680b66c0 0x7f5768157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.265+0000 7f576da00640 1 --2- 172.21.15.149:0/4125561462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f576806e790 0x7f5768157c10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.265+0000 7f576da00640 1 -- 172.21.15.149:0/4125561462 >> 172.21.15.149:0/4125561462 conn(0x7f576808bfc0 msgr2=0x7f57680b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:30.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.265+0000 7f576da00640 1 -- 172.21.15.149:0/4125561462 shutdown_connections 2024-05-30T16:41:30.267 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.265+0000 7f576da00640 1 -- 172.21.15.149:0/4125561462 wait complete. 2024-05-30T16:41:30.282 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68 5 2024-05-30T16:41:30.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.510+0000 7f9d13200640 1 Processor -- start 2024-05-30T16:41:30.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.510+0000 7f9d13200640 1 -- start start 2024-05-30T16:41:30.512 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.511+0000 7f9d13200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d0c15e820 0x7f9d0c162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.511+0000 7f9d13200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d0c1631c0 con 0x7f9d0c160070 2024-05-30T16:41:30.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.511+0000 7f9d13200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d0c1605c0 con 0x7f9d0c0d2c10 2024-05-30T16:41:30.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.511+0000 7f9d13200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0c1608a0 con 0x7f9d0c15e820 2024-05-30T16:41:30.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d12800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9d0c0d2c10 0x7f9d0c161660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:52032/0 (socket says 172.21.15.149:52032) 2024-05-30T16:41:30.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d12800640 1 -- 172.21.15.149:0/2962512645 learned_addr learned my addr 172.21.15.149:0/2962512645 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-30T16:41:30.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d11e00640 1 --2- 172.21.15.149:0/2962512645 >> v2:172.21.15.144:3300/0 conn(0x7f9d0c15e820 0x7f9d0c162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 228128539 0 0) 0x7f9d0c1605c0 con 0x7f9d0c0d2c10 2024-05-30T16:41:30.515 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf4003520 con 0x7f9d0c0d2c10 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3240422934 0 0) 0x7f9cf4003520 con 0x7f9d0c0d2c10 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 >> v2:172.21.15.144:3300/0 conn(0x7f9d0c15e820 msgr2=0x7f9d0c162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d10a00640 1 --2- 172.21.15.149:0/2962512645 >> v2:172.21.15.144:3300/0 conn(0x7f9d0c15e820 0x7f9d0c162c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 >> v1:172.21.15.144:6789/0 conn(0x7f9d0c160070 legacy=0x7f9d0c0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c160b80 con 0x7f9d0c0d2c10 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.512+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f9d080019f0 con 0x7f9d0c0d2c10 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 >> v1:172.21.15.149:6789/0 conn(0x7f9d0c0d2c10 legacy=0x7f9d0c161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d10a00640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf40039b0 0x7f9cf4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d10a00640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf4004800 0x7f9cf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d10a00640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40051c0 0x7f9cf400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1608a0 con 0x7f9cf40051c0 2024-05-30T16:41:30.516 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf400c060 con 0x7f9cf4004800 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf400c260 con 0x7f9cf40039b0 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d11e00640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf40039b0 0x7f9cf4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d11400640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf4004800 0x7f9cf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d12800640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40051c0 0x7f9cf400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d11e00640 1 -- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf4004800 msgr2=0x7f9cf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d11e00640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf4004800 0x7f9cf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d11e00640 1 -- 172.21.15.149:0/2962512645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40051c0 msgr2=0x7f9cf400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d11e00640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40051c0 0x7f9cf400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d11e00640 1 -- 172.21.15.149:0/2962512645 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf4003520 con 0x7f9cf40039b0 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.513+0000 7f9d12800640 1 -- 172.21.15.149:0/2962512645 reap_dead start 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.514+0000 7f9d11e00640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf40039b0 0x7f9cf4003dd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009ac0 tx=0x7f9cf4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fa2882090a5011d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00036070 con 0x7f9cf40039b0 2024-05-30T16:41:30.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d00031400 con 0x7f9cf40039b0 2024-05-30T16:41:30.518 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d10a00640 1 -- 172.21.15.149:0/2962512645 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00009690 con 0x7f9cf40039b0 2024-05-30T16:41:30.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d13200640 1 -- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf40039b0 msgr2=0x7f9cf4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.520 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d13200640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf40039b0 0x7f9cf4003dd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009ac0 tx=0x7f9cf4005830 comp rx=0 tx=0).stop 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d13200640 1 -- 172.21.15.149:0/2962512645 shutdown_connections 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d13200640 1 --2- 172.21.15.149:0/2962512645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf40039b0 0x7f9cf4003dd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d13200640 1 -- 172.21.15.149:0/2962512645 >> 172.21.15.149:0/2962512645 conn(0x7f9d0c08bfc0 msgr2=0x7f9d0c0d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d13200640 1 -- 172.21.15.149:0/2962512645 shutdown_connections 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.515+0000 7f9d13200640 1 -- 172.21.15.149:0/2962512645 wait complete. 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.517+0000 7f9d13200640 1 Processor -- start 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.517+0000 7f9d13200640 1 -- start start 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d13200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40039b0 0x7f9d0c159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d13200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d0c1e94e0 0x7f9d0c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d13200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d0c0caca0 0x7f9d0c0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d13200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c162c80 con 0x7f9cf40039b0 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d13200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c161140 con 0x7f9d0c0caca0 2024-05-30T16:41:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d13200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0c162e00 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d11400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d0c1e94e0 0x7f9d0c0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d12800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d0c0caca0 0x7f9d0c0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d11400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d0c1e94e0 0x7f9d0c0ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:41598/0 (socket says 172.21.15.149:41598) 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.518+0000 7f9d11400640 1 -- 172.21.15.149:0/163277206 learned_addr learned my addr 172.21.15.149:0/163277206 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d11e00640 1 --2- 172.21.15.149:0/163277206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40039b0 0x7f9d0c159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d11400640 1 -- 172.21.15.149:0/163277206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d0c0caca0 msgr2=0x7f9d0c0c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d11400640 1 --2- 172.21.15.149:0/163277206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d0c0caca0 0x7f9d0c0c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d11400640 1 -- 172.21.15.149:0/163277206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40039b0 msgr2=0x7f9d0c159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d11400640 1 --2- 172.21.15.149:0/163277206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40039b0 0x7f9d0c159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d11400640 1 -- 172.21.15.149:0/163277206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c1e8440 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d11e00640 1 --2- 172.21.15.149:0/163277206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40039b0 0x7f9d0c159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d11400640 1 --2- 172.21.15.149:0/163277206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d0c1e94e0 0x7f9d0c0ca760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00f770 tx=0x7f9cfc00fc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d06000640 1 -- 172.21.15.149:0/163277206 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0050d0 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.522 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d06000640 1 -- 172.21.15.149:0/163277206 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cfc018070 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d13200640 1 -- 172.21.15.149:0/163277206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c1e8720 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d06000640 1 -- 172.21.15.149:0/163277206 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc005490 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.519+0000 7f9d13200640 1 -- 172.21.15.149:0/163277206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c1e8ce0 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.520+0000 7f9d06000640 1 -- 172.21.15.149:0/163277206 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9cfc00d730 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.520+0000 7f9d06000640 1 -- 172.21.15.149:0/163277206 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f9cfc0035f0 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.523 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.521+0000 7f9d13200640 1 -- 172.21.15.149:0/163277206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0c075570 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.524 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.523+0000 7f9d06000640 1 -- 172.21.15.149:0/163277206 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9cfc003b40 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.603 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.602+0000 7f9d13200640 1 -- 172.21.15.149:0/163277206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68", "id": 5} v 0) -- 0x7f9d0c15c550 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.612+0000 7f9d06000640 1 -- 172.21.15.149:0/163277206 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f9cfc003d20 con 0x7f9d0c1e94e0 2024-05-30T16:41:30.613 INFO:teuthology.orchestra.run.smithi149.stdout:5 2024-05-30T16:41:30.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.614+0000 7f9d13200640 1 -- 172.21.15.149:0/163277206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d0c1e94e0 msgr2=0x7f9d0c0ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.614+0000 7f9d13200640 1 --2- 172.21.15.149:0/163277206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d0c1e94e0 0x7f9d0c0ca760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00f770 tx=0x7f9cfc00fc30 comp rx=0 tx=0).stop 2024-05-30T16:41:30.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.614+0000 7f9d13200640 1 -- 172.21.15.149:0/163277206 shutdown_connections 2024-05-30T16:41:30.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.614+0000 7f9d13200640 1 --2- 172.21.15.149:0/163277206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d0c0caca0 0x7f9d0c0c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.614+0000 7f9d13200640 1 --2- 172.21.15.149:0/163277206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d0c1e94e0 0x7f9d0c0ca760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.614+0000 7f9d13200640 1 --2- 172.21.15.149:0/163277206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cf40039b0 0x7f9d0c159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.614+0000 7f9d13200640 1 -- 172.21.15.149:0/163277206 >> 172.21.15.149:0/163277206 conn(0x7f9d0c08bfc0 msgr2=0x7f9d0c0cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:30.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.614+0000 7f9d13200640 1 -- 172.21.15.149:0/163277206 shutdown_connections 2024-05-30T16:41:30.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.614+0000 7f9d13200640 1 -- 172.21.15.149:0/163277206 wait complete. 2024-05-30T16:41:30.638 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new a0fb6874-8aff-49d4-989b-515bda877687 6 2024-05-30T16:41:30.652 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:30.651+0000 7fe253321040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-30T16:41:30.713 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:30.712+0000 7fba9b5d5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-30T16:41:30.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.826+0000 7f3b89400640 1 Processor -- start 2024-05-30T16:41:30.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.827+0000 7f3b89400640 1 -- start start 2024-05-30T16:41:30.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.828+0000 7f3b89400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b840d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.828+0000 7f3b89400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b840d0b90 0x7f3b8415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.828+0000 7f3b89400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b840b3d20 con 0x7f3b8406cce0 2024-05-30T16:41:30.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.828+0000 7f3b89400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3b840d10c0 con 0x7f3b840d0b90 2024-05-30T16:41:30.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.828+0000 7f3b89400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3b840d13a0 con 0x7f3b840b3940 2024-05-30T16:41:30.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.829+0000 7f3b83e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b840d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.829+0000 7f3b88a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b840d0b90 0x7f3b8415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.829+0000 7f3b83e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b840d0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:41606/0 (socket says 172.21.15.149:41606) 2024-05-30T16:41:30.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.829+0000 7f3b83e00640 1 -- 172.21.15.149:0/3252135406 learned_addr learned my addr 172.21.15.149:0/3252135406 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:30.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.829+0000 7f3b88a00640 1 -- 172.21.15.149:0/3252135406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 msgr2=0x7f3b840d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:30.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.829+0000 7f3b88a00640 1 --2- 172.21.15.149:0/3252135406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b840d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.829+0000 7f3b88a00640 1 -- 172.21.15.149:0/3252135406 >> v1:172.21.15.144:6789/0 conn(0x7f3b8406cce0 legacy=0x7f3b8406d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:30.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.829+0000 7f3b88a00640 1 -- 172.21.15.149:0/3252135406 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b840d1680 con 0x7f3b840d0b90 2024-05-30T16:41:30.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.829+0000 7f3b83e00640 1 --2- 172.21.15.149:0/3252135406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b840d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:41:30.831 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.830+0000 7f3b88a00640 1 --2- 172.21.15.149:0/3252135406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b840d0b90 0x7f3b8415e0a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009d90 tx=0x7f3b7c02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d344becf3f86bfae server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:30.832 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.831+0000 7f3b82a00640 1 -- 172.21.15.149:0/3252135406 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c031600 con 0x7f3b840d0b90 2024-05-30T16:41:30.832 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.831+0000 7f3b82a00640 1 -- 172.21.15.149:0/3252135406 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c0317a0 con 0x7f3b840d0b90 2024-05-30T16:41:30.832 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.831+0000 7f3b82a00640 1 -- 172.21.15.149:0/3252135406 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c031b70 con 0x7f3b840d0b90 2024-05-30T16:41:30.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.831+0000 7f3b89400640 1 -- 172.21.15.149:0/3252135406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b840d0b90 msgr2=0x7f3b8415e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.831+0000 7f3b89400640 1 --2- 172.21.15.149:0/3252135406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b840d0b90 0x7f3b8415e0a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009d90 tx=0x7f3b7c02a610 comp rx=0 tx=0).stop 2024-05-30T16:41:30.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.831+0000 7f3b89400640 1 -- 172.21.15.149:0/3252135406 shutdown_connections 2024-05-30T16:41:30.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.831+0000 7f3b89400640 1 --2- 172.21.15.149:0/3252135406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b840d0b90 0x7f3b8415e0a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.831+0000 7f3b89400640 1 --2- 172.21.15.149:0/3252135406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b840d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.831+0000 7f3b89400640 1 -- 172.21.15.149:0/3252135406 >> 172.21.15.149:0/3252135406 conn(0x7f3b840b3f20 msgr2=0x7f3b840b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:30.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.832+0000 7f3b89400640 1 -- 172.21.15.149:0/3252135406 shutdown_connections 2024-05-30T16:41:30.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.832+0000 7f3b89400640 1 -- 172.21.15.149:0/3252135406 wait complete. 2024-05-30T16:41:30.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.833+0000 7f3b89400640 1 Processor -- start 2024-05-30T16:41:30.834 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.833+0000 7f3b89400640 1 -- start start 2024-05-30T16:41:30.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.834+0000 7f3b89400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8406cce0 0x7f3b840c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.834+0000 7f3b89400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b84152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.834+0000 7f3b89400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b840d0b90 0x7f3b840cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.834+0000 7f3b89400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8406dc90 con 0x7f3b840d0b90 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.834+0000 7f3b89400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8406db10 con 0x7f3b8406cce0 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.834+0000 7f3b89400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8406de10 con 0x7f3b840b3940 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b83e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8406cce0 0x7f3b840c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b83e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8406cce0 0x7f3b840c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:53832/0 (socket says 172.21.15.149:53832) 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b83e00640 1 -- 172.21.15.149:0/4194926299 learned_addr learned my addr 172.21.15.149:0/4194926299 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b83400640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b84152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b88a00640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b840d0b90 0x7f3b840cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:30.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b83e00640 1 -- 172.21.15.149:0/4194926299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 msgr2=0x7f3b84152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b83e00640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b84152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b83e00640 1 -- 172.21.15.149:0/4194926299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b840d0b90 msgr2=0x7f3b840cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b83e00640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b840d0b90 0x7f3b840cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b83e00640 1 -- 172.21.15.149:0/4194926299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b840c70a0 con 0x7f3b8406cce0 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.835+0000 7f3b88a00640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b840d0b90 0x7f3b840cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.836+0000 7f3b83400640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b84152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.836+0000 7f3b83e00640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8406cce0 0x7f3b840c89e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400ea00 tx=0x7f3b7400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.836+0000 7f3b7be00640 1 -- 172.21.15.149:0/4194926299 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74017070 con 0x7f3b8406cce0 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.836+0000 7f3b7be00640 1 -- 172.21.15.149:0/4194926299 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7400ca60 con 0x7f3b8406cce0 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.836+0000 7f3b7be00640 1 -- 172.21.15.149:0/4194926299 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400ce10 con 0x7f3b8406cce0 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.836+0000 7f3b89400640 1 -- 172.21.15.149:0/4194926299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b840c7380 con 0x7f3b8406cce0 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.836+0000 7f3b89400640 1 -- 172.21.15.149:0/4194926299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b840c7940 con 0x7f3b8406cce0 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.837+0000 7f3b7be00640 1 -- 172.21.15.149:0/4194926299 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3b7401a070 con 0x7f3b8406cce0 2024-05-30T16:41:30.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.837+0000 7f3b7be00640 1 -- 172.21.15.149:0/4194926299 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3b74013a60 con 0x7f3b8406cce0 2024-05-30T16:41:30.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.837+0000 7f3b89400640 1 -- 172.21.15.149:0/4194926299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8406d1e0 con 0x7f3b8406cce0 2024-05-30T16:41:30.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.842+0000 7f3b7be00640 1 -- 172.21.15.149:0/4194926299 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3b74013470 con 0x7f3b8406cce0 2024-05-30T16:41:30.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.921+0000 7f3b89400640 1 -- 172.21.15.149:0/4194926299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a0fb6874-8aff-49d4-989b-515bda877687", "id": 6} v 0) -- 0x7f3b84075060 con 0x7f3b8406cce0 2024-05-30T16:41:30.932 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.931+0000 7f3b7be00640 1 -- 172.21.15.149:0/4194926299 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0fb6874-8aff-49d4-989b-515bda877687", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3b74013650 con 0x7f3b8406cce0 2024-05-30T16:41:30.932 INFO:teuthology.orchestra.run.smithi149.stdout:6 2024-05-30T16:41:30.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.932+0000 7f3b89400640 1 -- 172.21.15.149:0/4194926299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8406cce0 msgr2=0x7f3b840c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:30.934 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.932+0000 7f3b89400640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8406cce0 0x7f3b840c89e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400ea00 tx=0x7f3b7400eec0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.934 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.932+0000 7f3b89400640 1 -- 172.21.15.149:0/4194926299 shutdown_connections 2024-05-30T16:41:30.934 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.932+0000 7f3b89400640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b840d0b90 0x7f3b840cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.934 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.932+0000 7f3b89400640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b840b3940 0x7f3b84152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.934 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.932+0000 7f3b89400640 1 --2- 172.21.15.149:0/4194926299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8406cce0 0x7f3b840c89e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:30.934 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.932+0000 7f3b89400640 1 -- 172.21.15.149:0/4194926299 >> 172.21.15.149:0/4194926299 conn(0x7f3b840b3f20 msgr2=0x7f3b840b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:30.934 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.933+0000 7f3b89400640 1 -- 172.21.15.149:0/4194926299 shutdown_connections 2024-05-30T16:41:30.934 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:30.933+0000 7f3b89400640 1 -- 172.21.15.149:0/4194926299 wait complete. 2024-05-30T16:41:30.950 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 573db942-5379-437d-b128-bee376048692 7 2024-05-30T16:41:30.954 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:30.953+0000 7fe253321040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-30T16:41:31.016 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:31.015+0000 7fe253321040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-30T16:41:31.032 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:31.032+0000 7fba9b5d5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-30T16:41:31.097 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:31.096+0000 7fba9b5d5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-30T16:41:31.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.123+0000 7efe8f200640 1 Processor -- start 2024-05-30T16:41:31.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.123+0000 7efe8f200640 1 -- start start 2024-05-30T16:41:31.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.124+0000 7efe8f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe9015e820 0x7efe90162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:31.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.124+0000 7efe8f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe901631c0 con 0x7efe900d2c10 2024-05-30T16:41:31.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.124+0000 7efe8f200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe901605c0 con 0x7efe90160070 2024-05-30T16:41:31.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.124+0000 7efe8f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe901608a0 con 0x7efe9015e820 2024-05-30T16:41:31.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.125+0000 7efe8de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe9015e820 0x7efe90162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:31.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.125+0000 7efe8de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe9015e820 0x7efe90162c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:41630/0 (socket says 172.21.15.149:41630) 2024-05-30T16:41:31.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.125+0000 7efe8de00640 1 -- 172.21.15.149:0/2890808397 learned_addr learned my addr 172.21.15.149:0/2890808397 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:31.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.125+0000 7efe8de00640 1 -- 172.21.15.149:0/2890808397 >> v1:172.21.15.149:6789/0 conn(0x7efe90160070 legacy=0x7efe900cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.125+0000 7efe8de00640 1 -- 172.21.15.149:0/2890808397 >> v1:172.21.15.144:6789/0 conn(0x7efe900d2c10 legacy=0x7efe90161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.125+0000 7efe8de00640 1 -- 172.21.15.149:0/2890808397 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe90160b80 con 0x7efe9015e820 2024-05-30T16:41:31.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.125+0000 7efe8ca00640 1 -- 172.21.15.149:0/2890808397 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360013088 0 0) 0x7efe901605c0 con 0x7efe90160070 2024-05-30T16:41:31.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.126+0000 7efe8de00640 1 --2- 172.21.15.149:0/2890808397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe9015e820 0x7efe90162c80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efe800098a0 tx=0x7efe8002a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62fe2f212f993053 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:31.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.126+0000 7efe8ca00640 1 -- 172.21.15.149:0/2890808397 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80037070 con 0x7efe9015e820 2024-05-30T16:41:31.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.126+0000 7efe8ca00640 1 -- 172.21.15.149:0/2890808397 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe80032640 con 0x7efe9015e820 2024-05-30T16:41:31.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.127+0000 7efe8ca00640 1 -- 172.21.15.149:0/2890808397 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80032a10 con 0x7efe9015e820 2024-05-30T16:41:31.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.127+0000 7efe8f200640 1 -- 172.21.15.149:0/2890808397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe9015e820 msgr2=0x7efe90162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.127+0000 7efe8f200640 1 --2- 172.21.15.149:0/2890808397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe9015e820 0x7efe90162c80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efe800098a0 tx=0x7efe8002a2e0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.127+0000 7efe8f200640 1 -- 172.21.15.149:0/2890808397 shutdown_connections 2024-05-30T16:41:31.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.127+0000 7efe8f200640 1 --2- 172.21.15.149:0/2890808397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe9015e820 0x7efe90162c80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.127+0000 7efe8f200640 1 -- 172.21.15.149:0/2890808397 >> 172.21.15.149:0/2890808397 conn(0x7efe9008bfc0 msgr2=0x7efe900d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:31.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.128+0000 7efe8f200640 1 -- 172.21.15.149:0/2890808397 shutdown_connections 2024-05-30T16:41:31.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.128+0000 7efe8f200640 1 -- 172.21.15.149:0/2890808397 wait complete. 2024-05-30T16:41:31.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.130+0000 7efe8f200640 1 Processor -- start 2024-05-30T16:41:31.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.130+0000 7efe8f200640 1 -- start start 2024-05-30T16:41:31.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe900d2c10 0x7efe900cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:31.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9015e820 0x7efe900ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe90160070 0x7efe900cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe900cfba0 con 0x7efe9015e820 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe90161140 con 0x7efe90160070 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe900cfd20 con 0x7efe900d2c10 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe900d2c10 0x7efe900cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe900d2c10 0x7efe900cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:41632/0 (socket says 172.21.15.149:41632) 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8de00640 1 -- 172.21.15.149:0/1376146216 learned_addr learned my addr 172.21.15.149:0/1376146216 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8e800640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe90160070 0x7efe900cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8d400640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9015e820 0x7efe900ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8de00640 1 -- 172.21.15.149:0/1376146216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe90160070 msgr2=0x7efe900cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8de00640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe90160070 0x7efe900cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8de00640 1 -- 172.21.15.149:0/1376146216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9015e820 msgr2=0x7efe900ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.132+0000 7efe8de00640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9015e820 0x7efe900ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.133+0000 7efe8de00640 1 -- 172.21.15.149:0/1376146216 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe900ccb10 con 0x7efe900d2c10 2024-05-30T16:41:31.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.133+0000 7efe8d400640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9015e820 0x7efe900ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:31.135 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.133+0000 7efe8de00640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe900d2c10 0x7efe900cd400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efe800098a0 tx=0x7efe800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.133+0000 7efe86000640 1 -- 172.21.15.149:0/1376146216 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80037040 con 0x7efe900d2c10 2024-05-30T16:41:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.133+0000 7efe86000640 1 -- 172.21.15.149:0/1376146216 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe80004250 con 0x7efe900d2c10 2024-05-30T16:41:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.133+0000 7efe8f200640 1 -- 172.21.15.149:0/1376146216 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe900cae50 con 0x7efe900d2c10 2024-05-30T16:41:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.133+0000 7efe86000640 1 -- 172.21.15.149:0/1376146216 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800306f0 con 0x7efe900d2c10 2024-05-30T16:41:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.133+0000 7efe8f200640 1 -- 172.21.15.149:0/1376146216 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe900cbaf0 con 0x7efe900d2c10 2024-05-30T16:41:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.134+0000 7efe86000640 1 -- 172.21.15.149:0/1376146216 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe80032500 con 0x7efe900d2c10 2024-05-30T16:41:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.134+0000 7efe86000640 1 -- 172.21.15.149:0/1376146216 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7efe80003d40 con 0x7efe900d2c10 2024-05-30T16:41:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.134+0000 7efe8f200640 1 -- 172.21.15.149:0/1376146216 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe90075570 con 0x7efe900d2c10 2024-05-30T16:41:31.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.137+0000 7efe86000640 1 -- 172.21.15.149:0/1376146216 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7efe80030c20 con 0x7efe900d2c10 2024-05-30T16:41:31.152 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:31.151+0000 7fe253321040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-30T16:41:31.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.215+0000 7efe8f200640 1 -- 172.21.15.149:0/1376146216 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "573db942-5379-437d-b128-bee376048692", "id": 7} v 0) -- 0x7efe900d1e50 con 0x7efe900d2c10 2024-05-30T16:41:31.225 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.225+0000 7efe86000640 1 -- 172.21.15.149:0/1376146216 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "573db942-5379-437d-b128-bee376048692", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7efe80030e00 con 0x7efe900d2c10 2024-05-30T16:41:31.226 INFO:teuthology.orchestra.run.smithi149.stdout:7 2024-05-30T16:41:31.227 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.226+0000 7efe8f200640 1 -- 172.21.15.149:0/1376146216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe900d2c10 msgr2=0x7efe900cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.226+0000 7efe8f200640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe900d2c10 0x7efe900cd400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efe800098a0 tx=0x7efe800046c0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.226+0000 7efe8f200640 1 -- 172.21.15.149:0/1376146216 shutdown_connections 2024-05-30T16:41:31.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.226+0000 7efe8f200640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe90160070 0x7efe900cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.226+0000 7efe8f200640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9015e820 0x7efe900ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.226+0000 7efe8f200640 1 --2- 172.21.15.149:0/1376146216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe900d2c10 0x7efe900cd400 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.226+0000 7efe8f200640 1 -- 172.21.15.149:0/1376146216 >> 172.21.15.149:0/1376146216 conn(0x7efe9008bfc0 msgr2=0x7efe900d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:31.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.227+0000 7efe8f200640 1 -- 172.21.15.149:0/1376146216 shutdown_connections 2024-05-30T16:41:31.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:41:31.227+0000 7efe8f200640 1 -- 172.21.15.149:0/1376146216 wait complete. 2024-05-30T16:41:31.240 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:31.239+0000 7fba9b5d5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-30T16:41:31.243 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-30T16:41:31.244 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-30T16:41:31.251 INFO:tasks.ceph.osd.0:Started 2024-05-30T16:41:31.251 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-30T16:41:31.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-30T16:41:31.259 INFO:tasks.ceph.osd.1:Started 2024-05-30T16:41:31.259 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-30T16:41:31.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-30T16:41:31.266 INFO:tasks.ceph.osd.2:Started 2024-05-30T16:41:31.266 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-30T16:41:31.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-30T16:41:31.273 INFO:tasks.ceph.osd.3:Started 2024-05-30T16:41:31.273 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-30T16:41:31.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-30T16:41:31.277 INFO:tasks.ceph.osd.4:Started 2024-05-30T16:41:31.277 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-30T16:41:31.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-30T16:41:31.284 INFO:tasks.ceph.osd.5:Started 2024-05-30T16:41:31.284 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-30T16:41:31.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-30T16:41:31.288 INFO:tasks.ceph.osd.6:Started 2024-05-30T16:41:31.288 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-30T16:41:31.288 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-30T16:41:31.294 INFO:tasks.ceph.osd.7:Started 2024-05-30T16:41:31.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:41:31.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.498+0000 7ff99b200640 1 Processor -- start 2024-05-30T16:41:31.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.498+0000 7ff99b200640 1 -- start start 2024-05-30T16:41:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.499+0000 7ff99b200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff99c0ba090 0x7ff99c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.499+0000 7ff99b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c15ed40 con 0x7ff99c15e960 2024-05-30T16:41:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.499+0000 7ff99b200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c162ca0 con 0x7ff99c0cfa10 2024-05-30T16:41:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.499+0000 7ff99b200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff99c0cfe80 con 0x7ff99c0ba090 2024-05-30T16:41:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.499+0000 7ff999e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff99c15e960 0x7ff99c162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50014/0 (socket says 172.21.15.144:50014) 2024-05-30T16:41:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.499+0000 7ff999e00640 1 -- 172.21.15.144:0/3072308308 learned_addr learned my addr 172.21.15.144:0/3072308308 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.499+0000 7ff999400640 1 --2- 172.21.15.144:0/3072308308 >> v2:172.21.15.149:3300/0 conn(0x7ff99c0ba090 0x7ff99c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.500+0000 7ff998a00640 1 -- 172.21.15.144:0/3072308308 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4232951310 0 0) 0x7ff99c15ed40 con 0x7ff99c15e960 2024-05-30T16:41:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.500+0000 7ff998a00640 1 -- 172.21.15.144:0/3072308308 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff980003520 con 0x7ff99c15e960 2024-05-30T16:41:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.500+0000 7ff999400640 1 -- 172.21.15.144:0/3072308308 >> v1:172.21.15.149:6789/0 conn(0x7ff99c0cfa10 legacy=0x7ff99c0d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.500+0000 7ff999400640 1 -- 172.21.15.144:0/3072308308 >> v1:172.21.15.144:6789/0 conn(0x7ff99c15e960 legacy=0x7ff99c162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.500+0000 7ff999400640 1 -- 172.21.15.144:0/3072308308 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c162f80 con 0x7ff99c0ba090 2024-05-30T16:41:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.501+0000 7ff999400640 1 --2- 172.21.15.144:0/3072308308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0ba090 0x7ff99c0cf4d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9880097a0 tx=0x7ff98802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2af59bfe1c005 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.501+0000 7ff998a00640 1 -- 172.21.15.144:0/3072308308 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988037070 con 0x7ff99c0ba090 2024-05-30T16:41:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.501+0000 7ff998a00640 1 -- 172.21.15.144:0/3072308308 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff988032440 con 0x7ff99c0ba090 2024-05-30T16:41:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.501+0000 7ff998a00640 1 -- 172.21.15.144:0/3072308308 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9880327f0 con 0x7ff99c0ba090 2024-05-30T16:41:31.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.501+0000 7ff99b200640 1 -- 172.21.15.144:0/3072308308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0ba090 msgr2=0x7ff99c0cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.501+0000 7ff99b200640 1 --2- 172.21.15.144:0/3072308308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0ba090 0x7ff99c0cf4d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9880097a0 tx=0x7ff98802a230 comp rx=0 tx=0).stop 2024-05-30T16:41:31.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.502+0000 7ff99b200640 1 -- 172.21.15.144:0/3072308308 shutdown_connections 2024-05-30T16:41:31.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.502+0000 7ff99b200640 1 --2- 172.21.15.144:0/3072308308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0ba090 0x7ff99c0cf4d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.502+0000 7ff99b200640 1 -- 172.21.15.144:0/3072308308 >> 172.21.15.144:0/3072308308 conn(0x7ff99c0d1360 msgr2=0x7ff99c0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:31.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.502+0000 7ff99b200640 1 -- 172.21.15.144:0/3072308308 shutdown_connections 2024-05-30T16:41:31.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.502+0000 7ff99b200640 1 -- 172.21.15.144:0/3072308308 wait complete. 2024-05-30T16:41:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.503+0000 7ff99b200640 1 Processor -- start 2024-05-30T16:41:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.503+0000 7ff99b200640 1 -- start start 2024-05-30T16:41:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.504+0000 7ff99b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff99c0ba090 0x7ff99c0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.504+0000 7ff99b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0cfa10 0x7ff99c14a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.504+0000 7ff99b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff99c15e960 0x7ff99c0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.504+0000 7ff99b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c0d2d90 con 0x7ff99c15e960 2024-05-30T16:41:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.504+0000 7ff99b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c0d2b40 con 0x7ff99c0cfa10 2024-05-30T16:41:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.504+0000 7ff99b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff99c0b78a0 con 0x7ff99c0ba090 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.504+0000 7ff99a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff99c15e960 0x7ff99c0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff99a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff99c15e960 0x7ff99c0ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36132/0 (socket says 172.21.15.144:36132) 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff99a800640 1 -- 172.21.15.144:0/1320138835 learned_addr learned my addr 172.21.15.144:0/1320138835 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff999400640 1 --2- 172.21.15.144:0/1320138835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0cfa10 0x7ff99c14a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff999e00640 1 --2- 172.21.15.144:0/1320138835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff99c0ba090 0x7ff99c0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff999400640 1 -- 172.21.15.144:0/1320138835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff99c0ba090 msgr2=0x7ff99c0cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff999400640 1 --2- 172.21.15.144:0/1320138835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff99c0ba090 0x7ff99c0cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff999400640 1 -- 172.21.15.144:0/1320138835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff99c15e960 msgr2=0x7ff99c0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff999400640 1 --2- 172.21.15.144:0/1320138835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff99c15e960 0x7ff99c0ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff999400640 1 -- 172.21.15.144:0/1320138835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c15ad60 con 0x7ff99c0cfa10 2024-05-30T16:41:31.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.505+0000 7ff999400640 1 --2- 172.21.15.144:0/1320138835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0cfa10 0x7ff99c14a610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff988031000 tx=0x7ff9880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.506+0000 7ff992000640 1 -- 172.21.15.144:0/1320138835 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988037050 con 0x7ff99c0cfa10 2024-05-30T16:41:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.506+0000 7ff992000640 1 -- 172.21.15.144:0/1320138835 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff988043070 con 0x7ff99c0cfa10 2024-05-30T16:41:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.506+0000 7ff992000640 1 -- 172.21.15.144:0/1320138835 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988006e10 con 0x7ff99c0cfa10 2024-05-30T16:41:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.506+0000 7ff99b200640 1 -- 172.21.15.144:0/1320138835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99c0cdc90 con 0x7ff99c0cfa10 2024-05-30T16:41:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.506+0000 7ff99b200640 1 -- 172.21.15.144:0/1320138835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99c0ce250 con 0x7ff99c0cfa10 2024-05-30T16:41:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.506+0000 7ff992000640 1 -- 172.21.15.144:0/1320138835 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff988032830 con 0x7ff99c0cfa10 2024-05-30T16:41:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.506+0000 7ff992000640 1 -- 172.21.15.144:0/1320138835 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff98803eb20 con 0x7ff99c0cfa10 2024-05-30T16:41:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.507+0000 7ff99b200640 1 -- 172.21.15.144:0/1320138835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99c075570 con 0x7ff99c0cfa10 2024-05-30T16:41:31.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.511+0000 7ff992000640 1 -- 172.21.15.144:0/1320138835 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff98803ee20 con 0x7ff99c0cfa10 2024-05-30T16:41:31.560 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:31.559+0000 7fe253321040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-30T16:41:31.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.585+0000 7ff99b200640 1 -- 172.21.15.144:0/1320138835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff99c15bd10 con 0x7ff99c0cfa10 2024-05-30T16:41:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.587+0000 7ff992000640 1 -- 172.21.15.144:0/1320138835 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff988032b20 con 0x7ff99c0cfa10 2024-05-30T16:41:31.588 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:31.588 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":10,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:31.218500+0000","last_up_change":"0.000000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:41:31.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.588+0000 7ff99b200640 1 -- 172.21.15.144:0/1320138835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0cfa10 msgr2=0x7ff99c14a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:31.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.588+0000 7ff99b200640 1 --2- 172.21.15.144:0/1320138835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0cfa10 0x7ff99c14a610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff988031000 tx=0x7ff9880046c0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.588+0000 7ff99b200640 1 -- 172.21.15.144:0/1320138835 shutdown_connections 2024-05-30T16:41:31.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.588+0000 7ff99b200640 1 --2- 172.21.15.144:0/1320138835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff99c15e960 0x7ff99c0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.588+0000 7ff99b200640 1 --2- 172.21.15.144:0/1320138835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff99c0cfa10 0x7ff99c14a610 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.588+0000 7ff99b200640 1 --2- 172.21.15.144:0/1320138835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff99c0ba090 0x7ff99c0cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:31.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.588+0000 7ff99b200640 1 -- 172.21.15.144:0/1320138835 >> 172.21.15.144:0/1320138835 conn(0x7ff99c0d1360 msgr2=0x7ff99c1615c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:31.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.588+0000 7ff99b200640 1 -- 172.21.15.144:0/1320138835 shutdown_connections 2024-05-30T16:41:31.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:31.588+0000 7ff99b200640 1 -- 172.21.15.144:0/1320138835 wait complete. 2024-05-30T16:41:31.605 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-30T16:41:31.606 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-30T16:41:31.621 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:31.620+0000 7fe253321040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-30T16:41:31.632 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:31.631+0000 7fba9b5d5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-30T16:41:31.690 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:31.689+0000 7fba9b5d5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-30T16:41:31.808 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:31.807+0000 7fe253321040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-30T16:41:31.877 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:31.876+0000 7fba9b5d5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-30T16:41:31.964 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-05-30T16:41:31.963+0000 7f164a61a640 -1 Falling back to public interface 2024-05-30T16:41:31.969 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-05-30T16:41:31.968+0000 7f74c9350640 -1 Falling back to public interface 2024-05-30T16:41:31.974 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-05-30T16:41:31.973+0000 7f25879dc640 -1 Falling back to public interface 2024-05-30T16:41:31.974 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-05-30T16:41:31.974+0000 7fecac614640 -1 Falling back to public interface 2024-05-30T16:41:31.979 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-05-30T16:41:31.978+0000 7feabf3dc640 -1 Falling back to public interface 2024-05-30T16:41:31.980 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:31.979+0000 7fe253321040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-30T16:41:31.993 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-05-30T16:41:31.993+0000 7f9f25b55640 -1 Falling back to public interface 2024-05-30T16:41:31.994 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-05-30T16:41:31.993+0000 7f4189025640 -1 Falling back to public interface 2024-05-30T16:41:31.997 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-05-30T16:41:31.997+0000 7f90eb60c640 -1 Falling back to public interface 2024-05-30T16:41:32.041 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:32.040+0000 7fe253321040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-30T16:41:32.059 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:32.058+0000 7fba9b5d5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-30T16:41:32.117 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:32.117+0000 7fba9b5d5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-30T16:41:32.123 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:32.122+0000 7fe253321040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-30T16:41:32.176 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:32.175+0000 7fe253321040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-30T16:41:32.198 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:32.197+0000 7fba9b5d5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-30T16:41:32.251 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:32.250+0000 7fba9b5d5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-30T16:41:32.411 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-30T16:41:32.571 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.570+0000 7fc882600640 1 Processor -- start 2024-05-30T16:41:32.571 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.570+0000 7fc882600640 1 -- start start 2024-05-30T16:41:32.573 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.572+0000 7fc882600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c0ba650 0x7fc87c0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:32.573 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.572+0000 7fc882600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87c0d0020 con 0x7fc87c15ebe0 2024-05-30T16:41:32.573 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.572+0000 7fc882600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87c0d30f0 con 0x7fc87c0cfb70 2024-05-30T16:41:32.573 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.572+0000 7fc882600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc87c0d33c0 con 0x7fc87c0ba650 2024-05-30T16:41:32.573 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.572+0000 7fc87b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc87c15ebe0 0x7fc87c0d29e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50016/0 (socket says 172.21.15.144:50016) 2024-05-30T16:41:32.573 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.572+0000 7fc87b400640 1 -- 172.21.15.144:0/4267144192 learned_addr learned my addr 172.21.15.144:0/4267144192 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:32.575 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.572+0000 7fc87aa00640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c0ba650 0x7fc87c0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:32.575 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.572+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1993806718 0 0) 0x7fc87c0d0020 con 0x7fc87c15ebe0 2024-05-30T16:41:32.575 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.572+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc860003520 con 0x7fc87c15ebe0 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 171413150 0 0) 0x7fc860003520 con 0x7fc87c15ebe0 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c0ba650 msgr2=0x7fc87c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c0ba650 0x7fc87c0cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 >> v1:172.21.15.149:6789/0 conn(0x7fc87c0cfb70 legacy=0x7fc87c0b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c0d36a0 con 0x7fc87c15ebe0 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fc86c001670 con 0x7fc87c15ebe0 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 >> v1:172.21.15.144:6789/0 conn(0x7fc87c15ebe0 legacy=0x7fc87c0d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8600039e0 0x7fc860003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc860004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c0ba650 0x7fc8600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c0d33c0 con 0x7fc860004800 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc86000baa0 con 0x7fc8600039e0 2024-05-30T16:41:32.576 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc86000bca0 con 0x7fc87c0ba650 2024-05-30T16:41:32.577 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87aa00640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc860004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:32.577 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87b400640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8600039e0 0x7fc860003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:32.577 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.573+0000 7fc87be00640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c0ba650 0x7fc8600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:32.577 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.574+0000 7fc87aa00640 1 -- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c0ba650 msgr2=0x7fc8600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:32.577 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.574+0000 7fc87aa00640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c0ba650 0x7fc8600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:32.577 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.574+0000 7fc87aa00640 1 -- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8600039e0 msgr2=0x7fc860003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:32.577 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.574+0000 7fc87aa00640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8600039e0 0x7fc860003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:32.577 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.574+0000 7fc87aa00640 1 -- 172.21.15.144:0/4267144192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc860003520 con 0x7fc860004800 2024-05-30T16:41:32.578 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.575+0000 7fc87aa00640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc860004c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0baa60 tx=0x7fc860005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10181c53fd777e71 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:32.578 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.575+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868036070 con 0x7fc860004800 2024-05-30T16:41:32.578 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.576+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc868031400 con 0x7fc860004800 2024-05-30T16:41:32.578 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.576+0000 7fc87a000640 1 -- 172.21.15.144:0/4267144192 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868009690 con 0x7fc860004800 2024-05-30T16:41:32.578 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.576+0000 7fc882600640 1 -- 172.21.15.144:0/4267144192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 msgr2=0x7fc860004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:32.578 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.576+0000 7fc882600640 1 --2- 172.21.15.144:0/4267144192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc860004c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0baa60 tx=0x7fc860005830 comp rx=0 tx=0).stop 2024-05-30T16:41:32.579 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.576+0000 7fc87be00640 1 -- 172.21.15.144:0/4267144192 reap_dead start 2024-05-30T16:41:32.579 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.576+0000 7fc882600640 1 -- 172.21.15.144:0/4267144192 shutdown_connections 2024-05-30T16:41:32.579 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.576+0000 7fc882600640 1 -- 172.21.15.144:0/4267144192 >> 172.21.15.144:0/4267144192 conn(0x7fc87c0733d0 msgr2=0x7fc87c0737e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:32.579 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.576+0000 7fc882600640 1 -- 172.21.15.144:0/4267144192 shutdown_connections 2024-05-30T16:41:32.579 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.576+0000 7fc882600640 1 -- 172.21.15.144:0/4267144192 wait complete. 2024-05-30T16:41:32.579 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.578+0000 7fc882600640 1 Processor -- start 2024-05-30T16:41:32.579 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.578+0000 7fc882600640 1 -- start start 2024-05-30T16:41:32.581 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc882600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc87c154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:32.581 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc882600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc87c157190 0x7fc87c1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:32.581 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc882600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c1f79b0 0x7fc87c1f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc882600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c0d3f40 con 0x7fc860004800 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc882600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c0d3c60 con 0x7fc87c157190 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc882600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc87c0d4460 con 0x7fc87c1f79b0 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc87b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc87c154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc87b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc87c154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36152/0 (socket says 172.21.15.144:36152) 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc87b400640 1 -- 172.21.15.144:0/3730535977 learned_addr learned my addr 172.21.15.144:0/3730535977 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.579+0000 7fc87aa00640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc87c157190 0x7fc87c1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc87be00640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c1f79b0 0x7fc87c1f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc87b400640 1 -- 172.21.15.144:0/3730535977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c1f79b0 msgr2=0x7fc87c1f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc87b400640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c1f79b0 0x7fc87c1f7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc87b400640 1 -- 172.21.15.144:0/3730535977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc87c157190 msgr2=0x7fc87c1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:32.582 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc87b400640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc87c157190 0x7fc87c1575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc87b400640 1 -- 172.21.15.144:0/3730535977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c157d50 con 0x7fc860004800 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc87aa00640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc87c157190 0x7fc87c1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc87b400640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc87c154b60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc86c001b80 tx=0x7fc86c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc873400640 1 -- 172.21.15.144:0/3730535977 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f960 con 0x7fc860004800 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc873400640 1 -- 172.21.15.144:0/3730535977 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86c018070 con 0x7fc860004800 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc873400640 1 -- 172.21.15.144:0/3730535977 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00fd20 con 0x7fc860004800 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc882600640 1 -- 172.21.15.144:0/3730535977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87c158030 con 0x7fc860004800 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.580+0000 7fc882600640 1 -- 172.21.15.144:0/3730535977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87c1585f0 con 0x7fc860004800 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.581+0000 7fc873400640 1 -- 172.21.15.144:0/3730535977 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc86c01d460 con 0x7fc860004800 2024-05-30T16:41:32.583 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.581+0000 7fc873400640 1 -- 172.21.15.144:0/3730535977 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc86c013d90 con 0x7fc860004800 2024-05-30T16:41:32.584 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.581+0000 7fc882600640 1 -- 172.21.15.144:0/3730535977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87c04fce0 con 0x7fc860004800 2024-05-30T16:41:32.585 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.584+0000 7fc873400640 1 -- 172.21.15.144:0/3730535977 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc86c0136c0 con 0x7fc860004800 2024-05-30T16:41:32.649 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.648+0000 7fc882600640 1 -- 172.21.15.144:0/3730535977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc87c0b8890 con 0x7fc860004800 2024-05-30T16:41:32.650 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.649+0000 7fc873400640 1 -- 172.21.15.144:0/3730535977 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc86c0138a0 con 0x7fc860004800 2024-05-30T16:41:32.650 INFO:teuthology.misc.health.smithi144.stdout: 2024-05-30T16:41:32.651 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":10,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:31.218500+0000","last_up_change":"0.000000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:41:32.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.650+0000 7fc882600640 1 -- 172.21.15.144:0/3730535977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 msgr2=0x7fc87c154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:32.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.650+0000 7fc882600640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc87c154b60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc86c001b80 tx=0x7fc86c007720 comp rx=0 tx=0).stop 2024-05-30T16:41:32.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.651+0000 7fc882600640 1 -- 172.21.15.144:0/3730535977 shutdown_connections 2024-05-30T16:41:32.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.651+0000 7fc882600640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc87c1f79b0 0x7fc87c1f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:32.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.651+0000 7fc882600640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc87c157190 0x7fc87c1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:32.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.651+0000 7fc882600640 1 --2- 172.21.15.144:0/3730535977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc860004800 0x7fc87c154b60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:32.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.651+0000 7fc882600640 1 -- 172.21.15.144:0/3730535977 >> 172.21.15.144:0/3730535977 conn(0x7fc87c0733d0 msgr2=0x7fc87c0b8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:32.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.651+0000 7fc882600640 1 -- 172.21.15.144:0/3730535977 shutdown_connections 2024-05-30T16:41:32.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:32.651+0000 7fc882600640 1 -- 172.21.15.144:0/3730535977 wait complete. 2024-05-30T16:41:32.664 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-30T16:41:32.736 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:32.735+0000 7fe253321040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-30T16:41:32.795 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:32.794+0000 7fba9b5d5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-30T16:41:32.871 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:32.870+0000 7fe253321040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-30T16:41:32.939 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-30T16:41:32.938+0000 7fba9b5d5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-30T16:41:33.906 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:33.905+0000 7fe1f3a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-30T16:41:33.907 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:41:33.905+0000 7fe1f3a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-30T16:41:34.960 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-05-30T16:41:34.959+0000 7f4189025640 -1 osd.5 0 log_to_monitors true 2024-05-30T16:41:35.371 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-05-30T16:41:35.371+0000 7fecac614640 -1 osd.6 0 log_to_monitors true 2024-05-30T16:41:35.381 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-05-30T16:41:35.380+0000 7f25879dc640 -1 osd.2 0 log_to_monitors true 2024-05-30T16:41:35.544 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-05-30T16:41:35.543+0000 7f164a61a640 -1 osd.1 0 log_to_monitors true 2024-05-30T16:41:35.604 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-05-30T16:41:35.603+0000 7feabf3dc640 -1 osd.0 0 log_to_monitors true 2024-05-30T16:41:35.639 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-05-30T16:41:35.638+0000 7f9f25b55640 -1 osd.3 0 log_to_monitors true 2024-05-30T16:41:35.654 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-05-30T16:41:35.653+0000 7f90eb60c640 -1 osd.7 0 log_to_monitors true 2024-05-30T16:41:35.826 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-05-30T16:41:35.825+0000 7f74c9350640 -1 osd.4 0 log_to_monitors true 2024-05-30T16:41:39.160 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-05-30T16:41:39.159+0000 7f74c4c00640 -1 osd.4 0 waiting for initial osdmap 2024-05-30T16:41:39.171 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-05-30T16:41:39.170+0000 7f74ba200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:41:39.195 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-05-30T16:41:39.194+0000 7f2582800640 -1 osd.2 0 waiting for initial osdmap 2024-05-30T16:41:39.203 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-05-30T16:41:39.202+0000 7f2578800640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:41:39.212 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-05-30T16:41:39.211+0000 7f90e5e00640 -1 osd.7 0 waiting for initial osdmap 2024-05-30T16:41:39.219 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-05-30T16:41:39.219+0000 7f90dbe00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:41:39.235 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-05-30T16:41:39.234+0000 7f9f20a00640 -1 osd.3 0 waiting for initial osdmap 2024-05-30T16:41:39.243 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-05-30T16:41:39.242+0000 7f9f16a00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:41:39.268 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-05-30T16:41:39.268+0000 7f4184800640 -1 osd.5 0 waiting for initial osdmap 2024-05-30T16:41:39.269 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-05-30T16:41:39.268+0000 7feca7800640 -1 osd.6 0 waiting for initial osdmap 2024-05-30T16:41:39.271 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-05-30T16:41:39.270+0000 7feaba200640 -1 osd.0 0 waiting for initial osdmap 2024-05-30T16:41:39.273 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-05-30T16:41:39.273+0000 7f1645000640 -1 osd.1 0 waiting for initial osdmap 2024-05-30T16:41:39.275 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-05-30T16:41:39.274+0000 7fec9ce00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:41:39.280 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-05-30T16:41:39.279+0000 7f4179e00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:41:39.282 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-05-30T16:41:39.281+0000 7f163b000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:41:39.290 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-05-30T16:41:39.290+0000 7feab0200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T16:41:39.470 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-30T16:41:39.648 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.647+0000 7f9aca600640 1 Processor -- start 2024-05-30T16:41:39.648 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.648+0000 7f9aca600640 1 -- start start 2024-05-30T16:41:39.650 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.649+0000 7f9aca600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9ac415ea90 0x7f9ac40d52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:39.650 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.649+0000 7f9aca600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ac40d17b0 0x7f9ac406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:39.650 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.649+0000 7f9aca600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac415ee70 con 0x7f9ac40d2d60 2024-05-30T16:41:39.650 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.649+0000 7f9aca600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac406d230 con 0x7f9ac40d17b0 2024-05-30T16:41:39.650 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.649+0000 7f9aca600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac40d3520 con 0x7f9ac415ea90 2024-05-30T16:41:39.651 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.649+0000 7f9ac9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ac40d17b0 0x7f9ac406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:39.651 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.649+0000 7f9ac9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ac40d17b0 0x7f9ac406d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39768/0 (socket says 172.21.15.144:39768) 2024-05-30T16:41:39.651 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.649+0000 7f9ac9c00640 1 -- 172.21.15.144:0/90765950 learned_addr learned my addr 172.21.15.144:0/90765950 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:39.651 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.650+0000 7f9ac9200640 1 --2- 172.21.15.144:0/90765950 >> v2:172.21.15.149:3300/0 conn(0x7f9ac415ea90 0x7f9ac40d52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:39.651 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.650+0000 7f9ac9c00640 1 -- 172.21.15.144:0/90765950 >> v2:172.21.15.149:3300/0 conn(0x7f9ac415ea90 msgr2=0x7f9ac40d52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:39.651 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.650+0000 7f9ac9c00640 1 --2- 172.21.15.144:0/90765950 >> v2:172.21.15.149:3300/0 conn(0x7f9ac415ea90 0x7f9ac40d52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.651 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.650+0000 7f9ac9c00640 1 -- 172.21.15.144:0/90765950 >> v1:172.21.15.149:6789/0 conn(0x7f9ac40d2d60 legacy=0x7f9ac40d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:39.651 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.650+0000 7f9ac9c00640 1 -- 172.21.15.144:0/90765950 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac406cbe0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.651+0000 7f9ac9c00640 1 --2- 172.21.15.144:0/90765950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 0x7f9ac406d6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ac408ce40 tx=0x7f9abc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1207f3fcc8275248 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:39.652 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9ac3400640 1 -- 172.21.15.144:0/90765950 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc036070 con 0x7f9ac40d17b0 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9ac3400640 1 -- 172.21.15.144:0/90765950 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc031600 con 0x7f9ac40d17b0 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9ac3400640 1 -- 172.21.15.144:0/90765950 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0319d0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9aca600640 1 -- 172.21.15.144:0/90765950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 msgr2=0x7f9ac406d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9aca600640 1 --2- 172.21.15.144:0/90765950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 0x7f9ac406d6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ac408ce40 tx=0x7f9abc02a660 comp rx=0 tx=0).stop 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9aca600640 1 -- 172.21.15.144:0/90765950 shutdown_connections 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9aca600640 1 --2- 172.21.15.144:0/90765950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 0x7f9ac406d6c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9aca600640 1 --2- 172.21.15.144:0/90765950 >> v2:172.21.15.149:3300/0 conn(0x7f9ac415ea90 0x7f9ac40d52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9aca600640 1 -- 172.21.15.144:0/90765950 >> 172.21.15.144:0/90765950 conn(0x7f9ac408bfe0 msgr2=0x7f9ac40d4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.652+0000 7f9aca600640 1 -- 172.21.15.144:0/90765950 shutdown_connections 2024-05-30T16:41:39.653 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.653+0000 7f9aca600640 1 -- 172.21.15.144:0/90765950 wait complete. 2024-05-30T16:41:39.654 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.654+0000 7f9aca600640 1 Processor -- start 2024-05-30T16:41:39.654 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.654+0000 7f9aca600640 1 -- start start 2024-05-30T16:41:39.656 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.655+0000 7f9aca600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 0x7f9ac415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.655+0000 7f9aca600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ac40d2d60 0x7f9ac40cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.655+0000 7f9aca600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ac415ea90 0x7f9ac40cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.655+0000 7f9aca600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40d31c0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.655+0000 7f9aca600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40d3800 con 0x7f9ac415ea90 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.655+0000 7f9aca600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac406dc00 con 0x7f9ac40d2d60 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.655+0000 7f9ac9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 0x7f9ac415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.655+0000 7f9ac9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 0x7f9ac415ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39770/0 (socket says 172.21.15.144:39770) 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.655+0000 7f9ac9200640 1 -- 172.21.15.144:0/725924752 learned_addr learned my addr 172.21.15.144:0/725924752 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac9c00640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ac415ea90 0x7f9ac40cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac9200640 1 -- 172.21.15.144:0/725924752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ac40d2d60 msgr2=0x7f9ac40cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac9200640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ac40d2d60 0x7f9ac40cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.657 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac9200640 1 -- 172.21.15.144:0/725924752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ac415ea90 msgr2=0x7f9ac40cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:39.658 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac9200640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ac415ea90 0x7f9ac40cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.658 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac9200640 1 -- 172.21.15.144:0/725924752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac41f89e0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.658 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac9c00640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ac415ea90 0x7f9ac40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:39.658 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac9200640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 0x7f9ac415ca50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400d5f0 tx=0x7f9ab400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:39.658 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac0c00640 1 -- 172.21.15.144:0/725924752 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40125f0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.658 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac0c00640 1 -- 172.21.15.144:0/725924752 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab4019070 con 0x7f9ac40d17b0 2024-05-30T16:41:39.658 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac40b5f00 con 0x7f9ac40d17b0 2024-05-30T16:41:39.658 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.656+0000 7f9ac0c00640 1 -- 172.21.15.144:0/725924752 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40129b0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.658 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.657+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac40b64c0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.659 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.658+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac404fce0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.659 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.659+0000 7f9ac0c00640 1 -- 172.21.15.144:0/725924752 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f9ab4012b50 con 0x7f9ac40d17b0 2024-05-30T16:41:39.659 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.659+0000 7f9ac0c00640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9aa406c860 0x7f9aa406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:39.659 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.660+0000 7f9ac0c00640 1 -- 172.21.15.144:0/725924752 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f9ab408b1b0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.660 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.660+0000 7f9ac3e00640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9aa406c860 0x7f9aa406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:39.660 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.660+0000 7f9ac3e00640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9aa406c860 0x7f9aa406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40a26c0 tx=0x7f9ab0007a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:39.665 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.665+0000 7f9ac0c00640 1 -- 172.21.15.144:0/725924752 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9ab405a3b0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.854 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.854+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ac40d0e50 con 0x7f9ac40d17b0 2024-05-30T16:41:39.854 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.855+0000 7f9ac0c00640 1 -- 172.21.15.144:0/725924752 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f9ab4059cb0 con 0x7f9ac40d17b0 2024-05-30T16:41:39.855 INFO:teuthology.misc.health.smithi144.stdout: 2024-05-30T16:41:39.855 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":12,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:36.906919+0000","last_up_change":"0.000000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:41:39.857 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9aa406c860 msgr2=0x7f9aa406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:39.857 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9aa406c860 0x7f9aa406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40a26c0 tx=0x7f9ab0007a00 comp rx=0 tx=0).stop 2024-05-30T16:41:39.857 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 msgr2=0x7f9ac415ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:39.857 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 0x7f9ac415ca50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400d5f0 tx=0x7f9ab400dab0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.857 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 shutdown_connections 2024-05-30T16:41:39.858 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9aa406c860 0x7f9aa406ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.858 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ac415ea90 0x7f9ac40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.858 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ac40d2d60 0x7f9ac40cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.858 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 --2- 172.21.15.144:0/725924752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac40d17b0 0x7f9ac415ca50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:39.858 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 >> 172.21.15.144:0/725924752 conn(0x7f9ac408bfe0 msgr2=0x7f9ac40b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:39.858 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.857+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 shutdown_connections 2024-05-30T16:41:39.858 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:39.858+0000 7f9aca600640 1 -- 172.21.15.144:0/725924752 wait complete. 2024-05-30T16:41:39.871 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-30T16:41:44.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:41:44.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:41:46.678 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-30T16:41:46.862 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.861+0000 7f2a17200640 1 Processor -- start 2024-05-30T16:41:46.862 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.862+0000 7f2a17200640 1 -- start start 2024-05-30T16:41:46.864 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.863+0000 7f2a17200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a180d52d0 0x7f2a180d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:46.864 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.863+0000 7f2a17200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2a180d15e0 0x7f2a1806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:46.864 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.863+0000 7f2a17200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1815ee70 con 0x7f2a1815ea90 2024-05-30T16:41:46.864 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.863+0000 7f2a17200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2a180d5730 con 0x7f2a180d52d0 2024-05-30T16:41:46.864 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.863+0000 7f2a17200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2a180d1a50 con 0x7f2a180d15e0 2024-05-30T16:41:46.864 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.863+0000 7f2a15400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a180d52d0 0x7f2a180d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:46.864 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.863+0000 7f2a15400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a180d52d0 0x7f2a180d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45208/0 (socket says 172.21.15.144:45208) 2024-05-30T16:41:46.865 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.863+0000 7f2a15e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2a1815ea90 0x7f2a180d2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41244/0 (socket says 172.21.15.144:41244) 2024-05-30T16:41:46.865 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.863+0000 7f2a15400640 1 -- 172.21.15.144:0/3684269706 learned_addr learned my addr 172.21.15.144:0/3684269706 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:46.865 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.864+0000 7f2a16800640 1 --2- 172.21.15.144:0/3684269706 >> v2:172.21.15.149:3300/0 conn(0x7f2a180d15e0 0x7f2a1806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:46.865 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.864+0000 7f2a15400640 1 -- 172.21.15.144:0/3684269706 >> v2:172.21.15.149:3300/0 conn(0x7f2a180d15e0 msgr2=0x7f2a1806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:46.865 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.864+0000 7f2a15400640 1 --2- 172.21.15.144:0/3684269706 >> v2:172.21.15.149:3300/0 conn(0x7f2a180d15e0 0x7f2a1806d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:46.865 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.864+0000 7f2a15400640 1 -- 172.21.15.144:0/3684269706 >> v1:172.21.15.144:6789/0 conn(0x7f2a1815ea90 legacy=0x7f2a180d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:46.865 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.864+0000 7f2a15400640 1 -- 172.21.15.144:0/3684269706 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a180d3520 con 0x7f2a180d52d0 2024-05-30T16:41:46.865 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.864+0000 7f2a14a00640 1 -- 172.21.15.144:0/3684269706 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543455955 0 0) 0x7f2a1815ee70 con 0x7f2a1815ea90 2024-05-30T16:41:46.866 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.865+0000 7f2a15400640 1 --2- 172.21.15.144:0/3684269706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 0x7f2a180d10a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a1808d050 tx=0x7f2a0402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f6c6630edb4ada server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.866+0000 7f2a14a00640 1 -- 172.21.15.144:0/3684269706 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04004030 con 0x7f2a180d52d0 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.866+0000 7f2a14a00640 1 -- 172.21.15.144:0/3684269706 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a040041d0 con 0x7f2a180d52d0 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.866+0000 7f2a14a00640 1 -- 172.21.15.144:0/3684269706 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04003610 con 0x7f2a180d52d0 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.866+0000 7f2a17200640 1 -- 172.21.15.144:0/3684269706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 msgr2=0x7f2a180d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.866+0000 7f2a17200640 1 --2- 172.21.15.144:0/3684269706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 0x7f2a180d10a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a1808d050 tx=0x7f2a0402a1c0 comp rx=0 tx=0).stop 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.866+0000 7f2a17200640 1 -- 172.21.15.144:0/3684269706 shutdown_connections 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.866+0000 7f2a17200640 1 --2- 172.21.15.144:0/3684269706 >> v2:172.21.15.149:3300/0 conn(0x7f2a180d15e0 0x7f2a1806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.866+0000 7f2a17200640 1 --2- 172.21.15.144:0/3684269706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 0x7f2a180d10a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.866+0000 7f2a17200640 1 -- 172.21.15.144:0/3684269706 >> 172.21.15.144:0/3684269706 conn(0x7f2a1808bfe0 msgr2=0x7f2a180d4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.867+0000 7f2a17200640 1 -- 172.21.15.144:0/3684269706 shutdown_connections 2024-05-30T16:41:46.867 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.867+0000 7f2a17200640 1 -- 172.21.15.144:0/3684269706 wait complete. 2024-05-30T16:41:46.868 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.868+0000 7f2a17200640 1 Processor -- start 2024-05-30T16:41:46.868 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.869+0000 7f2a17200640 1 -- start start 2024-05-30T16:41:46.870 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.869+0000 7f2a17200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a180d15e0 0x7f2a18152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.869+0000 7f2a17200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 0x7f2a180c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.869+0000 7f2a17200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a1815ea90 0x7f2a180b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a17200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1806cec0 con 0x7f2a180d52d0 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a17200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1806d230 con 0x7f2a180d15e0 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a17200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2a180d3800 con 0x7f2a1815ea90 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a15400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 0x7f2a180c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a15400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 0x7f2a180c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45222/0 (socket says 172.21.15.144:45222) 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a15400640 1 -- 172.21.15.144:0/500597894 learned_addr learned my addr 172.21.15.144:0/500597894 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a15e00640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a180d15e0 0x7f2a18152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a16800640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a1815ea90 0x7f2a180b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a15400640 1 -- 172.21.15.144:0/500597894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a1815ea90 msgr2=0x7f2a180b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a15400640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a1815ea90 0x7f2a180b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:46.871 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a15400640 1 -- 172.21.15.144:0/500597894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a180d15e0 msgr2=0x7f2a18152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:46.872 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a15400640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a180d15e0 0x7f2a18152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:46.872 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.870+0000 7f2a15400640 1 -- 172.21.15.144:0/500597894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a18152ac0 con 0x7f2a180d52d0 2024-05-30T16:41:46.872 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.871+0000 7f2a15400640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 0x7f2a180c8670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a0402a200 tx=0x7f2a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:46.872 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.871+0000 7f2a0e000640 1 -- 172.21.15.144:0/500597894 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04041020 con 0x7f2a180d52d0 2024-05-30T16:41:46.872 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.871+0000 7f2a0e000640 1 -- 172.21.15.144:0/500597894 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a04003c50 con 0x7f2a180d52d0 2024-05-30T16:41:46.873 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.871+0000 7f2a0e000640 1 -- 172.21.15.144:0/500597894 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04004030 con 0x7f2a180d52d0 2024-05-30T16:41:46.873 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.871+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a180b6960 con 0x7f2a180d52d0 2024-05-30T16:41:46.873 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.871+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a180b6f20 con 0x7f2a180d52d0 2024-05-30T16:41:46.873 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.872+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a18075f20 con 0x7f2a180d52d0 2024-05-30T16:41:46.873 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.873+0000 7f2a0e000640 1 -- 172.21.15.144:0/500597894 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a04044020 con 0x7f2a180d52d0 2024-05-30T16:41:46.875 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.874+0000 7f2a0e000640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29f806c8f0 0x7f29f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:46.875 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.875+0000 7f2a0e000640 1 -- 172.21.15.144:0/500597894 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2a040ac490 con 0x7f2a180d52d0 2024-05-30T16:41:46.875 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.875+0000 7f2a15e00640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29f806c8f0 0x7f29f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:46.875 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.875+0000 7f2a15e00640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29f806c8f0 0x7f29f806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a08000f60 tx=0x7f2a08007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:46.880 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:46.880+0000 7f2a0e000640 1 -- 172.21.15.144:0/500597894 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a18075f20 con 0x7f2a180d52d0 2024-05-30T16:41:47.075 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.075+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a1804fce0 con 0x7f2a180d52d0 2024-05-30T16:41:47.077 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.077+0000 7f2a0e000640 1 -- 172.21.15.144:0/500597894 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7f2a0404b030 con 0x7f2a180d52d0 2024-05-30T16:41:47.078 INFO:teuthology.misc.health.smithi144.stdout: 2024-05-30T16:41:47.078 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":16,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:43.222425+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:41:47.080 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29f806c8f0 msgr2=0x7f29f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:47.080 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29f806c8f0 0x7f29f806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a08000f60 tx=0x7f2a08007c00 comp rx=0 tx=0).stop 2024-05-30T16:41:47.080 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 msgr2=0x7f2a180c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:47.081 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 0x7f2a180c8670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a0402a200 tx=0x7f2a040046c0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.081 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 shutdown_connections 2024-05-30T16:41:47.081 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29f806c8f0 0x7f29f806edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.081 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a1815ea90 0x7f2a180b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.081 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a180d52d0 0x7f2a180c8670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.081 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 --2- 172.21.15.144:0/500597894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a180d15e0 0x7f2a18152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.081 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 >> 172.21.15.144:0/500597894 conn(0x7f2a1808bfe0 msgr2=0x7f2a180b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:47.081 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 shutdown_connections 2024-05-30T16:41:47.081 INFO:teuthology.misc.health.smithi144.stderr:2024-05-30T16:41:47.080+0000 7f2a17200640 1 -- 172.21.15.144:0/500597894 wait complete. 2024-05-30T16:41:47.094 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-30T16:41:47.095 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-30T16:41:47.095 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:41:47.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:41:47.102 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:41:47.103 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:41:47.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:41:47.109 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:41:47.109 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:41:47.109 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:41:47.117 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:41:47.117 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:41:47.117 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:41:47.124 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:41:47.125 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-30T16:41:47.125 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:41:47.243 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-05-30T16:41:47.244 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-05-30T16:41:47.272 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-05-30T16:41:47.275 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-05-30T16:41:47.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.293+0000 7f612fe00640 1 Processor -- start 2024-05-30T16:41:47.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.293+0000 7f612fe00640 1 -- start start 2024-05-30T16:41:47.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.294+0000 7f612fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f613015e960 0x7f6130162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:47.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.294+0000 7f612fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f61300ba090 0x7f61300cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:47.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.294+0000 7f612fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613015ed40 con 0x7f61300cfa10 2024-05-30T16:41:47.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.294+0000 7f612fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f61300cfe80 con 0x7f613015e960 2024-05-30T16:41:47.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.294+0000 7f612fe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f61300d2b40 con 0x7f61300ba090 2024-05-30T16:41:47.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.294+0000 7f612ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f613015e960 0x7f6130162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:47.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.294+0000 7f612f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f61300cfa10 0x7f613006c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41278/0 (socket says 172.21.15.144:41278) 2024-05-30T16:41:47.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.294+0000 7f612f400640 1 -- 172.21.15.144:0/2365938545 learned_addr learned my addr 172.21.15.144:0/2365938545 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:47.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.294+0000 7f6127e00640 1 --2- 172.21.15.144:0/2365938545 >> v2:172.21.15.149:3300/0 conn(0x7f61300ba090 0x7f61300cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:47.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.295+0000 7f612ea00640 1 -- 172.21.15.144:0/2365938545 >> v2:172.21.15.149:3300/0 conn(0x7f61300ba090 msgr2=0x7f61300cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:47.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.295+0000 7f612ea00640 1 --2- 172.21.15.144:0/2365938545 >> v2:172.21.15.149:3300/0 conn(0x7f61300ba090 0x7f61300cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.295+0000 7f612ea00640 1 -- 172.21.15.144:0/2365938545 >> v1:172.21.15.144:6789/0 conn(0x7f61300cfa10 legacy=0x7f613006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:47.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.295+0000 7f612ea00640 1 -- 172.21.15.144:0/2365938545 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61301629d0 con 0x7f613015e960 2024-05-30T16:41:47.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.295+0000 7f612e000640 1 -- 172.21.15.144:0/2365938545 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3863943209 0 0) 0x7f613015ed40 con 0x7f61300cfa10 2024-05-30T16:41:47.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.295+0000 7f612ea00640 1 --2- 172.21.15.144:0/2365938545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 0x7f6130162490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f61300d5800 tx=0x7f612002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101b19fd06224c4e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:47.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612e000640 1 -- 172.21.15.144:0/2365938545 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120037070 con 0x7f613015e960 2024-05-30T16:41:47.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612e000640 1 -- 172.21.15.144:0/2365938545 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6120032440 con 0x7f613015e960 2024-05-30T16:41:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612e000640 1 -- 172.21.15.144:0/2365938545 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120032810 con 0x7f613015e960 2024-05-30T16:41:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612fe00640 1 -- 172.21.15.144:0/2365938545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 msgr2=0x7f6130162490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612fe00640 1 --2- 172.21.15.144:0/2365938545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 0x7f6130162490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f61300d5800 tx=0x7f612002a1a0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612fe00640 1 -- 172.21.15.144:0/2365938545 shutdown_connections 2024-05-30T16:41:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612fe00640 1 --2- 172.21.15.144:0/2365938545 >> v2:172.21.15.149:3300/0 conn(0x7f61300ba090 0x7f61300cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612fe00640 1 --2- 172.21.15.144:0/2365938545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 0x7f6130162490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612fe00640 1 -- 172.21.15.144:0/2365938545 >> 172.21.15.144:0/2365938545 conn(0x7f61300d1360 msgr2=0x7f61300d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.296+0000 7f612fe00640 1 -- 172.21.15.144:0/2365938545 shutdown_connections 2024-05-30T16:41:47.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.297+0000 7f612fe00640 1 -- 172.21.15.144:0/2365938545 wait complete. 2024-05-30T16:41:47.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.298+0000 7f612fe00640 1 Processor -- start 2024-05-30T16:41:47.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.298+0000 7f612fe00640 1 -- start start 2024-05-30T16:41:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.299+0000 7f612fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61300ba090 0x7f61300cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.299+0000 7f612fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300cfa10 0x7f6130154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.299+0000 7f612fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 0x7f61300b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.299+0000 7f612fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6130163260 con 0x7f613015e960 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.299+0000 7f612fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6130162f80 con 0x7f61300cfa10 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.299+0000 7f612fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61300d2d90 con 0x7f61300ba090 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.299+0000 7f612f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 0x7f61300b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.299+0000 7f612f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 0x7f61300b8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45292/0 (socket says 172.21.15.144:45292) 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.299+0000 7f612f400640 1 -- 172.21.15.144:0/3094701624 learned_addr learned my addr 172.21.15.144:0/3094701624 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f6127e00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300cfa10 0x7f6130154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f612ea00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61300ba090 0x7f61300cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f612f400640 1 -- 172.21.15.144:0/3094701624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61300ba090 msgr2=0x7f61300cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f612f400640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61300ba090 0x7f61300cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f612f400640 1 -- 172.21.15.144:0/3094701624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300cfa10 msgr2=0x7f6130154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f612f400640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300cfa10 0x7f6130154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f612f400640 1 -- 172.21.15.144:0/3094701624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61301555f0 con 0x7f613015e960 2024-05-30T16:41:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f6127e00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300cfa10 0x7f6130154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:41:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f612f400640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 0x7f61300b8a80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f612800c7a0 tx=0x7f612800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f6127400640 1 -- 172.21.15.144:0/3094701624 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128018070 con 0x7f613015e960 2024-05-30T16:41:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f6127400640 1 -- 172.21.15.144:0/3094701624 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f612800a640 con 0x7f613015e960 2024-05-30T16:41:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6130155890 con 0x7f613015e960 2024-05-30T16:41:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f6127400640 1 -- 172.21.15.144:0/3094701624 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612800aa70 con 0x7f613015e960 2024-05-30T16:41:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.300+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6130155e50 con 0x7f613015e960 2024-05-30T16:41:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.301+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6130075570 con 0x7f613015e960 2024-05-30T16:41:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.302+0000 7f6127400640 1 -- 172.21.15.144:0/3094701624 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f612801b070 con 0x7f613015e960 2024-05-30T16:41:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.303+0000 7f6127400640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f610c06c8f0 0x7f610c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.303+0000 7f6127400640 1 -- 172.21.15.144:0/3094701624 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f612808aed0 con 0x7f613015e960 2024-05-30T16:41:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.303+0000 7f612ea00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f610c06c8f0 0x7f610c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:47.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.304+0000 7f612ea00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f610c06c8f0 0x7f610c06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6120034000 tx=0x7f612002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.308+0000 7f6127400640 1 -- 172.21.15.144:0/3094701624 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61280595b0 con 0x7f613015e960 2024-05-30T16:41:47.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.533+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61300d19f0 con 0x7f613015e960 2024-05-30T16:41:47.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.534+0000 7f6127400640 1 -- 172.21.15.144:0/3094701624 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f6128058eb0 con 0x7f613015e960 2024-05-30T16:41:47.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:47.534 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-30T16:41:47.535 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 2 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f610c06c8f0 msgr2=0x7f610c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f610c06c8f0 0x7f610c06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6120034000 tx=0x7f612002e000 comp rx=0 tx=0).stop 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 msgr2=0x7f61300b8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 0x7f61300b8a80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f612800c7a0 tx=0x7f612800cc60 comp rx=0 tx=0).stop 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 shutdown_connections 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f610c06c8f0 0x7f610c06edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f613015e960 0x7f61300b8a80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300cfa10 0x7f6130154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 --2- 172.21.15.144:0/3094701624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61300ba090 0x7f61300cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.536+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 >> 172.21.15.144:0/3094701624 conn(0x7f61300d1360 msgr2=0x7f613015f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:47.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.537+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 shutdown_connections 2024-05-30T16:41:47.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:47.537+0000 7f612fe00640 1 -- 172.21.15.144:0/3094701624 wait complete. 2024-05-30T16:41:49.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:41:49.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.764+0000 7fe648400640 1 Processor -- start 2024-05-30T16:41:49.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.764+0000 7fe648400640 1 -- start start 2024-05-30T16:41:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.766+0000 7fe648400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6400b5fd0 0x7fe640142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.766+0000 7fe648400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe640160730 con 0x7fe6400cec70 2024-05-30T16:41:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.766+0000 7fe648400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe640160a10 con 0x7fe64013f760 2024-05-30T16:41:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.766+0000 7fe648400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe6401612b0 con 0x7fe6400b5fd0 2024-05-30T16:41:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.766+0000 7fe645000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe6400cec70 0x7fe6400b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41280/0 (socket says 172.21.15.144:41280) 2024-05-30T16:41:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.766+0000 7fe645000640 1 -- 172.21.15.144:0/245255772 learned_addr learned my addr 172.21.15.144:0/245255772 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe646400640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6400b5fd0 0x7fe640142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387188629 0 0) 0x7fe640160730 con 0x7fe6400cec70 2024-05-30T16:41:49.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe628003520 con 0x7fe6400cec70 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1029250952 0 0) 0x7fe628003520 con 0x7fe6400cec70 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6400b5fd0 msgr2=0x7fe640142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6400b5fd0 0x7fe640142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 >> v1:172.21.15.149:6789/0 conn(0x7fe64013f760 legacy=0x7fe64006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe640160cf0 con 0x7fe6400cec70 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fe62c001690 con 0x7fe6400cec70 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 >> v1:172.21.15.144:6789/0 conn(0x7fe6400cec70 legacy=0x7fe6400b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6280039e0 0x7fe628003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6400b5fd0 0x7fe628004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe628004d40 0x7fe6280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe6401612b0 con 0x7fe6280039e0 2024-05-30T16:41:49.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe62800bb30 con 0x7fe628004d40 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe62800bd30 con 0x7fe6400b5fd0 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.767+0000 7fe645a00640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6280039e0 0x7fe628003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.768+0000 7fe645000640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6400b5fd0 0x7fe628004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.768+0000 7fe646400640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe628004d40 0x7fe6280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.768+0000 7fe645a00640 1 -- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6400b5fd0 msgr2=0x7fe628004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.768+0000 7fe645a00640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6400b5fd0 0x7fe628004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.768+0000 7fe645a00640 1 -- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe628004d40 msgr2=0x7fe6280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.768+0000 7fe645a00640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe628004d40 0x7fe6280051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.768+0000 7fe645a00640 1 -- 172.21.15.144:0/245255772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe628003520 con 0x7fe6280039e0 2024-05-30T16:41:49.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.768+0000 7fe645000640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6400b5fd0 0x7fe628004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.769+0000 7fe645a00640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6280039e0 0x7fe628003e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe634001720 tx=0x7fe628005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11c7f40875e3121 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.769+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634001370 con 0x7fe6280039e0 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.769+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6340052d0 con 0x7fe6280039e0 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.769+0000 7fe63fe00640 1 -- 172.21.15.144:0/245255772 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63402abc0 con 0x7fe6280039e0 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.770+0000 7fe648400640 1 -- 172.21.15.144:0/245255772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6280039e0 msgr2=0x7fe628003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.770+0000 7fe648400640 1 --2- 172.21.15.144:0/245255772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6280039e0 0x7fe628003e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe634001720 tx=0x7fe628005830 comp rx=0 tx=0).stop 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.770+0000 7fe646400640 1 -- 172.21.15.144:0/245255772 reap_dead start 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.770+0000 7fe648400640 1 -- 172.21.15.144:0/245255772 shutdown_connections 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.770+0000 7fe648400640 1 -- 172.21.15.144:0/245255772 >> 172.21.15.144:0/245255772 conn(0x7fe64006bd00 msgr2=0x7fe64006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.770+0000 7fe648400640 1 -- 172.21.15.144:0/245255772 shutdown_connections 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.770+0000 7fe648400640 1 -- 172.21.15.144:0/245255772 wait complete. 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.772+0000 7fe648400640 1 Processor -- start 2024-05-30T16:41:49.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.772+0000 7fe648400640 1 -- start start 2024-05-30T16:41:49.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe648400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6280039e0 0x7fe640131c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:49.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe648400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe640156a70 0x7fe6401f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:49.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe648400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe640153dd0 0x7fe6400b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe648400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe6400cf0d0 con 0x7fe640156a70 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe648400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe6400cf250 con 0x7fe6280039e0 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe648400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe6400ce6a0 con 0x7fe640153dd0 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe645000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe640156a70 0x7fe6401f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe645000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe640156a70 0x7fe6401f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45312/0 (socket says 172.21.15.144:45312) 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe645000640 1 -- 172.21.15.144:0/94010615 learned_addr learned my addr 172.21.15.144:0/94010615 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe645a00640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6280039e0 0x7fe640131c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe646400640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe640153dd0 0x7fe6400b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe645000640 1 -- 172.21.15.144:0/94010615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe640153dd0 msgr2=0x7fe6400b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe645000640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe640153dd0 0x7fe6400b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe645000640 1 -- 172.21.15.144:0/94010615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6280039e0 msgr2=0x7fe640131c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe645000640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6280039e0 0x7fe640131c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.773+0000 7fe645000640 1 -- 172.21.15.144:0/94010615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe640157000 con 0x7fe640156a70 2024-05-30T16:41:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.774+0000 7fe645000640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe640156a70 0x7fe6401f4490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00d7e0 tx=0x7fe62c00dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.774+0000 7fe63d600640 1 -- 172.21.15.144:0/94010615 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c019070 con 0x7fe640156a70 2024-05-30T16:41:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.774+0000 7fe63d600640 1 -- 172.21.15.144:0/94010615 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62c0074e0 con 0x7fe640156a70 2024-05-30T16:41:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.774+0000 7fe63d600640 1 -- 172.21.15.144:0/94010615 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0049e0 con 0x7fe640156a70 2024-05-30T16:41:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.774+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64013d0a0 con 0x7fe640156a70 2024-05-30T16:41:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.774+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe640154250 con 0x7fe640156a70 2024-05-30T16:41:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.775+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64013ce90 con 0x7fe640156a70 2024-05-30T16:41:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.776+0000 7fe63d600640 1 -- 172.21.15.144:0/94010615 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe62c004b80 con 0x7fe640156a70 2024-05-30T16:41:49.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.777+0000 7fe63d600640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe62006c8f0 0x7fe62006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:49.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.777+0000 7fe63d600640 1 -- 172.21.15.144:0/94010615 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe62c08b2a0 con 0x7fe640156a70 2024-05-30T16:41:49.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.777+0000 7fe645a00640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe62006c8f0 0x7fe62006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:49.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.778+0000 7fe645a00640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe62006c8f0 0x7fe62006edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe634032000 tx=0x7fe63402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:49.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:49.782+0000 7fe63d600640 1 -- 172.21.15.144:0/94010615 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe62c059980 con 0x7fe640156a70 2024-05-30T16:41:50.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.020+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe640068b90 con 0x7fe640156a70 2024-05-30T16:41:50.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.021+0000 7fe63d600640 1 -- 172.21.15.144:0/94010615 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7fe62c059280 con 0x7fe640156a70 2024-05-30T16:41:50.022 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:50.022 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3786718549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3786718549},{"type":"v1","addr":"172.21.15.149:6833","nonce":3786718549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/117174447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":117174447},{"type":"v1","addr":"172.21.15.149:6835","nonce":117174447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1743859445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1743859445},{"type":"v1","addr":"172.21.15.144:6836","nonce":1743859445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-30T16:41:50.022 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 3 2024-05-30T16:41:50.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe62006c8f0 msgr2=0x7fe62006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe62006c8f0 0x7fe62006edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe634032000 tx=0x7fe63402e000 comp rx=0 tx=0).stop 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe640156a70 msgr2=0x7fe6401f4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe640156a70 0x7fe6401f4490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00d7e0 tx=0x7fe62c00dca0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 shutdown_connections 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe62006c8f0 0x7fe62006edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe640153dd0 0x7fe6400b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe640156a70 0x7fe6401f4490 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 --2- 172.21.15.144:0/94010615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6280039e0 0x7fe640131c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 >> 172.21.15.144:0/94010615 conn(0x7fe64006bd00 msgr2=0x7fe64013fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.024+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 shutdown_connections 2024-05-30T16:41:50.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.025+0000 7fe648400640 1 -- 172.21.15.144:0/94010615 wait complete. 2024-05-30T16:41:50.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:41:50.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.239+0000 7f2dd6000640 1 Processor -- start 2024-05-30T16:41:50.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.239+0000 7f2dd6000640 1 -- start start 2024-05-30T16:41:50.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.241+0000 7f2dd6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 0x7f2dd006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.241+0000 7f2dd6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2dd00cec70 0x7f2dd00b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.241+0000 7f2dd6000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd006ee80 con 0x7f2dd00b5e00 2024-05-30T16:41:50.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.241+0000 7f2dd6000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd01612b0 con 0x7f2dd00cec70 2024-05-30T16:41:50.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.241+0000 7f2dd6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd013fb40 con 0x7f2dd013f760 2024-05-30T16:41:50.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.241+0000 7f2dc6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2dd00cec70 0x7f2dd00b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.241+0000 7f2dc6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2dd00cec70 0x7f2dd00b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45318/0 (socket says 172.21.15.144:45318) 2024-05-30T16:41:50.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.241+0000 7f2dc6a00640 1 -- 172.21.15.144:0/425686153 learned_addr learned my addr 172.21.15.144:0/425686153 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:50.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.242+0000 7f2dcf400640 1 --2- 172.21.15.144:0/425686153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 0x7f2dd006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.242+0000 7f2dc6a00640 1 -- 172.21.15.144:0/425686153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 msgr2=0x7f2dd006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:50.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.242+0000 7f2dc6a00640 1 --2- 172.21.15.144:0/425686153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 0x7f2dd006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.242+0000 7f2dc6a00640 1 -- 172.21.15.144:0/425686153 >> v1:172.21.15.149:6789/0 conn(0x7f2dd00b5e00 legacy=0x7f2dd0142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.242+0000 7f2dc6a00640 1 -- 172.21.15.144:0/425686153 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd0160730 con 0x7f2dd00cec70 2024-05-30T16:41:50.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.243+0000 7f2dc6a00640 1 --2- 172.21.15.144:0/425686153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 0x7f2dd00b58c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009870 tx=0x7f2db802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1814a20084dd6fff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:50.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.243+0000 7f2dcea00640 1 -- 172.21.15.144:0/425686153 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8037070 con 0x7f2dd00cec70 2024-05-30T16:41:50.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dcea00640 1 -- 172.21.15.144:0/425686153 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db802ae50 con 0x7f2dd00cec70 2024-05-30T16:41:50.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dcea00640 1 -- 172.21.15.144:0/425686153 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8032860 con 0x7f2dd00cec70 2024-05-30T16:41:50.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dd6000640 1 -- 172.21.15.144:0/425686153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 msgr2=0x7f2dd00b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dd6000640 1 --2- 172.21.15.144:0/425686153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 0x7f2dd00b58c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009870 tx=0x7f2db802a300 comp rx=0 tx=0).stop 2024-05-30T16:41:50.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dd6000640 1 -- 172.21.15.144:0/425686153 shutdown_connections 2024-05-30T16:41:50.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dd6000640 1 --2- 172.21.15.144:0/425686153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 0x7f2dd00b58c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dd6000640 1 --2- 172.21.15.144:0/425686153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 0x7f2dd006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dd6000640 1 -- 172.21.15.144:0/425686153 >> 172.21.15.144:0/425686153 conn(0x7f2dd006bd00 msgr2=0x7f2dd006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:50.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dd6000640 1 -- 172.21.15.144:0/425686153 shutdown_connections 2024-05-30T16:41:50.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.244+0000 7f2dd6000640 1 -- 172.21.15.144:0/425686153 wait complete. 2024-05-30T16:41:50.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.246+0000 7f2dd6000640 1 Processor -- start 2024-05-30T16:41:50.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.246+0000 7f2dd6000640 1 -- start start 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.247+0000 7f2dd6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd00b5e00 0x7f2dd01552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.247+0000 7f2dd6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 0x7f2dd0152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.247+0000 7f2dd6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 0x7f2dd015eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.247+0000 7f2dd6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd0160fd0 con 0x7f2dd00cec70 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.247+0000 7f2dd6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd0160cf0 con 0x7f2dd00b5e00 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.247+0000 7f2dd6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd00cf0d0 con 0x7f2dd013f760 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.247+0000 7f2dc6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 0x7f2dd0152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.247+0000 7f2dc6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 0x7f2dd0152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45324/0 (socket says 172.21.15.144:45324) 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.247+0000 7f2dc6a00640 1 -- 172.21.15.144:0/2605015132 learned_addr learned my addr 172.21.15.144:0/2605015132 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dcfe00640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 0x7f2dd015eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dcf400640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd00b5e00 0x7f2dd01552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dc6a00640 1 -- 172.21.15.144:0/2605015132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 msgr2=0x7f2dd015eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dc6a00640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 0x7f2dd015eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dc6a00640 1 -- 172.21.15.144:0/2605015132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd00b5e00 msgr2=0x7f2dd01552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dc6a00640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd00b5e00 0x7f2dd01552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dc6a00640 1 -- 172.21.15.144:0/2605015132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd01f79b0 con 0x7f2dd00cec70 2024-05-30T16:41:50.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dc6a00640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 0x7f2dd0152c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2db8000c00 tx=0x7f2db80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:50.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dc7e00640 1 -- 172.21.15.144:0/2605015132 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8041070 con 0x7f2dd00cec70 2024-05-30T16:41:50.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dc7e00640 1 -- 172.21.15.144:0/2605015132 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db803c670 con 0x7f2dd00cec70 2024-05-30T16:41:50.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.248+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd01f7c90 con 0x7f2dd00cec70 2024-05-30T16:41:50.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.249+0000 7f2dc7e00640 1 -- 172.21.15.144:0/2605015132 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8037040 con 0x7f2dd00cec70 2024-05-30T16:41:50.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.249+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd01f8530 con 0x7f2dd00cec70 2024-05-30T16:41:50.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.250+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd01f8080 con 0x7f2dd00cec70 2024-05-30T16:41:50.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.251+0000 7f2dc7e00640 1 -- 172.21.15.144:0/2605015132 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2db8044070 con 0x7f2dd00cec70 2024-05-30T16:41:50.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.252+0000 7f2dc7e00640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2dac06c8f0 0x7f2dac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.252+0000 7f2dc7e00640 1 -- 172.21.15.144:0/2605015132 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2db80abe50 con 0x7f2dd00cec70 2024-05-30T16:41:50.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.252+0000 7f2dcf400640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2dac06c8f0 0x7f2dac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.253+0000 7f2dcf400640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2dac06c8f0 0x7f2dac06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0006fd0 tx=0x7f2dc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:50.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.256+0000 7f2dc7e00640 1 -- 172.21.15.144:0/2605015132 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2db807a5d0 con 0x7f2dd00cec70 2024-05-30T16:41:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.463+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2dd0068b90 con 0x7f2dd00cec70 2024-05-30T16:41:50.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.464+0000 7f2dc7e00640 1 -- 172.21.15.144:0/2605015132 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f2db8079ed0 con 0x7f2dd00cec70 2024-05-30T16:41:50.464 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:50.464 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:41:50.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:41:50.464 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-05-30T16:41:50.465 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-05-30T16:41:50.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:41:50.465 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:41:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2dac06c8f0 msgr2=0x7f2dac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2dac06c8f0 0x7f2dac06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0006fd0 tx=0x7f2dc0008040 comp rx=0 tx=0).stop 2024-05-30T16:41:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 msgr2=0x7f2dd0152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 0x7f2dd0152c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2db8000c00 tx=0x7f2db80046c0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 shutdown_connections 2024-05-30T16:41:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2dac06c8f0 0x7f2dac06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd013f760 0x7f2dd015eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dd00cec70 0x7f2dd0152c10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 --2- 172.21.15.144:0/2605015132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd00b5e00 0x7f2dd01552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 >> 172.21.15.144:0/2605015132 conn(0x7f2dd006bd00 msgr2=0x7f2dd0140a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 shutdown_connections 2024-05-30T16:41:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.467+0000 7f2dd6000640 1 -- 172.21.15.144:0/2605015132 wait complete. 2024-05-30T16:41:50.486 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:41:50.486 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:41:50.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.690+0000 7f6a54000640 1 Processor -- start 2024-05-30T16:41:50.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.691+0000 7f6a54000640 1 -- start start 2024-05-30T16:41:50.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.692+0000 7f6a54000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c146210 0x7f6a4c0b6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.692+0000 7f6a54000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6a4c0b6e90 0x7f6a4c15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.692+0000 7f6a54000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a4c15dc40 con 0x7f6a4c15d410 2024-05-30T16:41:50.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.692+0000 7f6a54000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6a4c160cd0 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.692+0000 7f6a54000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4c1603a0 con 0x7f6a4c146210 2024-05-30T16:41:50.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.693+0000 7f6a51600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c146210 0x7f6a4c0b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.693+0000 7f6a50c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6a4c0b6e90 0x7f6a4c15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.693+0000 7f6a52000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6a4c15d410 0x7f6a4c06b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:58806/0 (socket says 172.21.15.144:58806) 2024-05-30T16:41:50.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.693+0000 7f6a51600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c146210 0x7f6a4c0b6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:39250/0 (socket says 172.21.15.144:39250) 2024-05-30T16:41:50.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.693+0000 7f6a52000640 1 -- 172.21.15.144:0/1177049685 learned_addr learned my addr 172.21.15.144:0/1177049685 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:50.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.694+0000 7f6a50c00640 1 -- 172.21.15.144:0/1177049685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c146210 msgr2=0x7f6a4c0b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:50.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.694+0000 7f6a50c00640 1 --2- 172.21.15.144:0/1177049685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c146210 0x7f6a4c0b6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.694+0000 7f6a50c00640 1 -- 172.21.15.144:0/1177049685 >> v1:172.21.15.149:6789/0 conn(0x7f6a4c15d410 legacy=0x7f6a4c06b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.694+0000 7f6a50c00640 1 -- 172.21.15.144:0/1177049685 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c160680 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.695+0000 7f6a50c00640 1 --2- 172.21.15.144:0/1177049685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a4c0b6e90 0x7f6a4c15ced0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009d90 tx=0x7f6a3802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdbadea477f558db server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:50.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.696+0000 7f6a4be00640 1 -- 172.21.15.144:0/1177049685 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38007740 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.696+0000 7f6a4be00640 1 -- 172.21.15.144:0/1177049685 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a380078e0 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.696+0000 7f6a4be00640 1 -- 172.21.15.144:0/1177049685 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38007cb0 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.696+0000 7f6a54000640 1 -- 172.21.15.144:0/1177049685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a4c0b6e90 msgr2=0x7f6a4c15ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.696+0000 7f6a54000640 1 --2- 172.21.15.144:0/1177049685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a4c0b6e90 0x7f6a4c15ced0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009d90 tx=0x7f6a3802a660 comp rx=0 tx=0).stop 2024-05-30T16:41:50.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.697+0000 7f6a54000640 1 -- 172.21.15.144:0/1177049685 shutdown_connections 2024-05-30T16:41:50.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.697+0000 7f6a54000640 1 --2- 172.21.15.144:0/1177049685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a4c0b6e90 0x7f6a4c15ced0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.697+0000 7f6a54000640 1 --2- 172.21.15.144:0/1177049685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c146210 0x7f6a4c0b6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.697+0000 7f6a54000640 1 -- 172.21.15.144:0/1177049685 >> 172.21.15.144:0/1177049685 conn(0x7f6a4c073460 msgr2=0x7f6a4c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:50.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.697+0000 7f6a54000640 1 -- 172.21.15.144:0/1177049685 shutdown_connections 2024-05-30T16:41:50.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.697+0000 7f6a54000640 1 -- 172.21.15.144:0/1177049685 wait complete. 2024-05-30T16:41:50.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.698+0000 7f6a54000640 1 Processor -- start 2024-05-30T16:41:50.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.698+0000 7f6a54000640 1 -- start start 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.699+0000 7f6a54000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a4c0b6e90 0x7f6a4c145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.699+0000 7f6a54000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a4c146210 0x7f6a4c09b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.699+0000 7f6a54000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c15d410 0x7f6a4c09ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.699+0000 7f6a54000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c15d8a0 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.699+0000 7f6a54000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c161160 con 0x7f6a4c146210 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.699+0000 7f6a54000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4c15da20 con 0x7f6a4c15d410 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a51600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a4c0b6e90 0x7f6a4c145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a51600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a4c0b6e90 0x7f6a4c145510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45334/0 (socket says 172.21.15.144:45334) 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a51600640 1 -- 172.21.15.144:0/4070582868 learned_addr learned my addr 172.21.15.144:0/4070582868 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a50c00640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a4c146210 0x7f6a4c09b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a52000640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c15d410 0x7f6a4c09ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a51600640 1 -- 172.21.15.144:0/4070582868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c15d410 msgr2=0x7f6a4c09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a51600640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c15d410 0x7f6a4c09ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a51600640 1 -- 172.21.15.144:0/4070582868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a4c146210 msgr2=0x7f6a4c09b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a51600640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a4c146210 0x7f6a4c09b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a51600640 1 -- 172.21.15.144:0/4070582868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c145a50 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a52000640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c15d410 0x7f6a4c09ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.700+0000 7f6a51600640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a4c0b6e90 0x7f6a4c145510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e9e0 tx=0x7f6a3c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.701+0000 7f6a49600640 1 -- 172.21.15.144:0/4070582868 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c017070 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.701+0000 7f6a49600640 1 -- 172.21.15.144:0/4070582868 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00c9d0 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.701+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4c09eb80 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.701+0000 7f6a49600640 1 -- 172.21.15.144:0/4070582868 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00cdc0 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.701+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4c09f140 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.702+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4c068b90 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.703+0000 7f6a49600640 1 -- 172.21.15.144:0/4070582868 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a3c01a070 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.703+0000 7f6a49600640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:50.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.704+0000 7f6a49600640 1 -- 172.21.15.144:0/4070582868 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6a3c08b850 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.704+0000 7f6a50c00640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:50.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.704+0000 7f6a50c00640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a38034000 tx=0x7f6a3802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:50.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.708+0000 7f6a49600640 1 -- 172.21.15.144:0/4070582868 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a3c05a060 con 0x7f6a4c0b6e90 2024-05-30T16:41:50.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:50.909+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6a4c0d1a20 con 0x7f6a4c0b6e90 2024-05-30T16:41:51.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.291+0000 7f6a49600640 1 -- 172.21.15.144:0/4070582868 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f6a3c059960 con 0x7f6a4c0b6e90 2024-05-30T16:41:51.292 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-05-30T16:41:51.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.294+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a2c06c8f0 msgr2=0x7f6a2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:51.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.294+0000 7f6a54000640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a38034000 tx=0x7f6a3802f000 comp rx=0 tx=0).stop 2024-05-30T16:41:51.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a4c0b6e90 msgr2=0x7f6a4c145510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:51.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a4c0b6e90 0x7f6a4c145510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e9e0 tx=0x7f6a3c00eea0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 shutdown_connections 2024-05-30T16:41:51.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a4c15d410 0x7f6a4c09ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a4c146210 0x7f6a4c09b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 --2- 172.21.15.144:0/4070582868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a4c0b6e90 0x7f6a4c145510 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 >> 172.21.15.144:0/4070582868 conn(0x7f6a4c073460 msgr2=0x7f6a4c06f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:51.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 shutdown_connections 2024-05-30T16:41:51.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.295+0000 7f6a54000640 1 -- 172.21.15.144:0/4070582868 wait complete. 2024-05-30T16:41:51.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:41:51.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.512+0000 7f626aa00640 1 Processor -- start 2024-05-30T16:41:51.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.512+0000 7f626aa00640 1 -- start start 2024-05-30T16:41:51.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f626aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f626415ea90 0x7f62640ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:51.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f626aa00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f62640b6300 0x7f62640b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:51.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f626aa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62640b91c0 con 0x7f62640d2b60 2024-05-30T16:41:51.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f626aa00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f62640b9dd0 con 0x7f62640b6300 2024-05-30T16:41:51.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f626aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62640b94a0 con 0x7f626415ea90 2024-05-30T16:41:51.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f6268a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f62640d2b60 0x7f62640d2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41290/0 (socket says 172.21.15.144:41290) 2024-05-30T16:41:51.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f6268a00640 1 -- 172.21.15.144:0/1786863578 learned_addr learned my addr 172.21.15.144:0/1786863578 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:51.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780416625 0 0) 0x7f62640b91c0 con 0x7f62640d2b60 2024-05-30T16:41:51.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6248003520 con 0x7f62640d2b60 2024-05-30T16:41:51.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f6263e00640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f626415ea90 0x7f62640ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:51.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.514+0000 7f6263400640 1 --2- 172.21.15.144:0/1786863578 >> v2:172.21.15.149:3300/0 conn(0x7f62640b6300 0x7f62640b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:51.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3436845649 0 0) 0x7f6248003520 con 0x7f62640d2b60 2024-05-30T16:41:51.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f626415ea90 msgr2=0x7f62640ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f626415ea90 0x7f62640ba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 >> v2:172.21.15.149:3300/0 conn(0x7f62640b6300 msgr2=0x7f62640b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 --2- 172.21.15.144:0/1786863578 >> v2:172.21.15.149:3300/0 conn(0x7f62640b6300 0x7f62640b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62640b9780 con 0x7f62640d2b60 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f625c001670 con 0x7f62640d2b60 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 >> v1:172.21.15.144:6789/0 conn(0x7f62640d2b60 legacy=0x7f62640d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f626415ea90 0x7f62480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248003fe0 0x7f6248004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6248004d40 0x7f62480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f62640b94a0 con 0x7f6248003fe0 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f624800bb50 con 0x7f6248004d40 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f624800bd50 con 0x7f626415ea90 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6263400640 1 --2- 172.21.15.144:0/1786863578 >> v2:172.21.15.149:3300/0 conn(0x7f62640b6300 0x7f62640b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6263400640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248003fe0 0x7f6248004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6263e00640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f626415ea90 0x7f62480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.515+0000 7f6268a00640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6248004d40 0x7f62480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.516+0000 7f6263400640 1 -- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f626415ea90 msgr2=0x7f62480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.516+0000 7f6263400640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f626415ea90 0x7f62480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.516+0000 7f6263400640 1 -- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6248004d40 msgr2=0x7f62480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.516+0000 7f6263400640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6248004d40 0x7f62480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.516+0000 7f6263400640 1 -- 172.21.15.144:0/1786863578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6248003520 con 0x7f6248003fe0 2024-05-30T16:41:51.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.516+0000 7f6268a00640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6248004d40 0x7f62480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:51.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.517+0000 7f6263400640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248003fe0 0x7f6248004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f624c00aa70 tx=0x7f6248005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be26139873409a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:51.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.517+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c00a640 con 0x7f6248003fe0 2024-05-30T16:41:51.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.517+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c02ac70 con 0x7f6248003fe0 2024-05-30T16:41:51.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.517+0000 7f6262a00640 1 -- 172.21.15.144:0/1786863578 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c02ae60 con 0x7f6248003fe0 2024-05-30T16:41:51.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.517+0000 7f626aa00640 1 -- 172.21.15.144:0/1786863578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248003fe0 msgr2=0x7f6248004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:51.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.517+0000 7f626aa00640 1 --2- 172.21.15.144:0/1786863578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248003fe0 0x7f6248004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f624c00aa70 tx=0x7f6248005830 comp rx=0 tx=0).stop 2024-05-30T16:41:51.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.517+0000 7f6268a00640 1 -- 172.21.15.144:0/1786863578 reap_dead start 2024-05-30T16:41:51.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.517+0000 7f626aa00640 1 -- 172.21.15.144:0/1786863578 shutdown_connections 2024-05-30T16:41:51.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.517+0000 7f626aa00640 1 -- 172.21.15.144:0/1786863578 >> 172.21.15.144:0/1786863578 conn(0x7f62640627b0 msgr2=0x7f6264062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:51.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.518+0000 7f626aa00640 1 -- 172.21.15.144:0/1786863578 shutdown_connections 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.518+0000 7f626aa00640 1 -- 172.21.15.144:0/1786863578 wait complete. 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.519+0000 7f626aa00640 1 Processor -- start 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.519+0000 7f626aa00640 1 -- start start 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.520+0000 7f626aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6248003fe0 0x7f6264161a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.520+0000 7f626aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62640cab30 0x7f626415fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.520+0000 7f626aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62640cde50 0x7f62640ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.520+0000 7f626aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f62640ba330 con 0x7f62640cab30 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.520+0000 7f626aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f626415ee70 con 0x7f6248003fe0 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.520+0000 7f626aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62640ba4b0 con 0x7f62640cde50 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.520+0000 7f6263400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62640cab30 0x7f626415fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.520+0000 7f6263400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62640cab30 0x7f626415fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45352/0 (socket says 172.21.15.144:45352) 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.520+0000 7f6263400640 1 -- 172.21.15.144:0/2626468159 learned_addr learned my addr 172.21.15.144:0/2626468159 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:51.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f6263400640 1 -- 172.21.15.144:0/2626468159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62640cde50 msgr2=0x7f62640ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f6268a00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62640cde50 0x7f62640ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f6263400640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62640cde50 0x7f62640ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f6263400640 1 -- 172.21.15.144:0/2626468159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6248003fe0 msgr2=0x7f6264161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f6263400640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6248003fe0 0x7f6264161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f6263400640 1 -- 172.21.15.144:0/2626468159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62640c9e30 con 0x7f62640cab30 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f6263400640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62640cab30 0x7f626415fa70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f624c034040 tx=0x7f624c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f625be00640 1 -- 172.21.15.144:0/2626468159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c041070 con 0x7f62640cab30 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f625be00640 1 -- 172.21.15.144:0/2626468159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c004020 con 0x7f62640cab30 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f625be00640 1 -- 172.21.15.144:0/2626468159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0043d0 con 0x7f62640cab30 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.521+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62640ca0d0 con 0x7f62640cab30 2024-05-30T16:41:51.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.522+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62640ca690 con 0x7f62640cab30 2024-05-30T16:41:51.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.523+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6264068b90 con 0x7f62640cab30 2024-05-30T16:41:51.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.524+0000 7f625be00640 1 -- 172.21.15.144:0/2626468159 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f624c03d650 con 0x7f62640cab30 2024-05-30T16:41:51.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.525+0000 7f625be00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f624006c8f0 0x7f624006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:51.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.525+0000 7f625be00640 1 -- 172.21.15.144:0/2626468159 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f624c0ac3c0 con 0x7f62640cab30 2024-05-30T16:41:51.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.525+0000 7f6263e00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f624006c8f0 0x7f624006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:51.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.525+0000 7f6263e00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f624006c8f0 0x7f624006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62540042d0 tx=0x7f6254003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:51.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.530+0000 7f625be00640 1 -- 172.21.15.144:0/2626468159 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f624c02ae20 con 0x7f62640cab30 2024-05-30T16:41:51.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:51.725+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f626415d6b0 con 0x7f62640cab30 2024-05-30T16:41:52.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.297+0000 7f625be00640 1 -- 172.21.15.144:0/2626468159 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f624c07a930 con 0x7f62640cab30 2024-05-30T16:41:52.298 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-05-30T16:41:52.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.300+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f624006c8f0 msgr2=0x7f624006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:52.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.300+0000 7f626aa00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f624006c8f0 0x7f624006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62540042d0 tx=0x7f6254003990 comp rx=0 tx=0).stop 2024-05-30T16:41:52.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.301+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62640cab30 msgr2=0x7f626415fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:52.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.301+0000 7f626aa00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62640cab30 0x7f626415fa70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f624c034040 tx=0x7f624c004730 comp rx=0 tx=0).stop 2024-05-30T16:41:52.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.301+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 shutdown_connections 2024-05-30T16:41:52.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.301+0000 7f626aa00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f624006c8f0 0x7f624006edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:52.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.301+0000 7f626aa00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62640cde50 0x7f62640ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:52.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.301+0000 7f626aa00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62640cab30 0x7f626415fa70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:52.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.301+0000 7f626aa00640 1 --2- 172.21.15.144:0/2626468159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6248003fe0 0x7f6264161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:52.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.301+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 >> 172.21.15.144:0/2626468159 conn(0x7f62640627b0 msgr2=0x7f6264074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:52.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.302+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 shutdown_connections 2024-05-30T16:41:52.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.302+0000 7f626aa00640 1 -- 172.21.15.144:0/2626468159 wait complete. 2024-05-30T16:41:52.342 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:41:52.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.517+0000 7fc278a00640 1 Processor -- start 2024-05-30T16:41:52.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.517+0000 7fc278a00640 1 -- start start 2024-05-30T16:41:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.518+0000 7fc278a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc274167680 0x7fc274169a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.518+0000 7fc278a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc27406d770 con 0x7fc274161f40 2024-05-30T16:41:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.518+0000 7fc278a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc27406da50 con 0x7fc27406c9f0 2024-05-30T16:41:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.518+0000 7fc278a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc2740d1af0 con 0x7fc274167680 2024-05-30T16:41:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.518+0000 7fc272800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc274161f40 0x7fc2740b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41306/0 (socket says 172.21.15.144:41306) 2024-05-30T16:41:52.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.518+0000 7fc272800640 1 -- 172.21.15.144:0/1507034137 learned_addr learned my addr 172.21.15.144:0/1507034137 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:52.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.518+0000 7fc273200640 1 --2- 172.21.15.144:0/1507034137 >> v2:172.21.15.144:3300/0 conn(0x7fc274167680 0x7fc274169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:52.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.519+0000 7fc273200640 1 -- 172.21.15.144:0/1507034137 >> v1:172.21.15.149:6789/0 conn(0x7fc27406c9f0 legacy=0x7fc27406ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:52.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.519+0000 7fc273200640 1 -- 172.21.15.144:0/1507034137 >> v1:172.21.15.144:6789/0 conn(0x7fc274161f40 legacy=0x7fc2740b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:52.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.519+0000 7fc273200640 1 -- 172.21.15.144:0/1507034137 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2740d12f0 con 0x7fc274167680 2024-05-30T16:41:52.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.520+0000 7fc273200640 1 --2- 172.21.15.144:0/1507034137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274167680 0x7fc274169a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097a0 tx=0x7fc26c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e401218d7c82d76a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:52.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.520+0000 7fc271400640 1 -- 172.21.15.144:0/1507034137 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c037070 con 0x7fc274167680 2024-05-30T16:41:52.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.520+0000 7fc271400640 1 -- 172.21.15.144:0/1507034137 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc26c032440 con 0x7fc274167680 2024-05-30T16:41:52.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.520+0000 7fc271400640 1 -- 172.21.15.144:0/1507034137 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c032810 con 0x7fc274167680 2024-05-30T16:41:52.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.521+0000 7fc278a00640 1 -- 172.21.15.144:0/1507034137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274167680 msgr2=0x7fc274169a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:52.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.521+0000 7fc278a00640 1 --2- 172.21.15.144:0/1507034137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274167680 0x7fc274169a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097a0 tx=0x7fc26c02a270 comp rx=0 tx=0).stop 2024-05-30T16:41:52.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.521+0000 7fc278a00640 1 -- 172.21.15.144:0/1507034137 shutdown_connections 2024-05-30T16:41:52.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.521+0000 7fc278a00640 1 --2- 172.21.15.144:0/1507034137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274167680 0x7fc274169a70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:52.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.521+0000 7fc278a00640 1 -- 172.21.15.144:0/1507034137 >> 172.21.15.144:0/1507034137 conn(0x7fc2740d24d0 msgr2=0x7fc2740d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:52.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.521+0000 7fc278a00640 1 -- 172.21.15.144:0/1507034137 shutdown_connections 2024-05-30T16:41:52.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.521+0000 7fc278a00640 1 -- 172.21.15.144:0/1507034137 wait complete. 2024-05-30T16:41:52.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.523+0000 7fc278a00640 1 Processor -- start 2024-05-30T16:41:52.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.523+0000 7fc278a00640 1 -- start start 2024-05-30T16:41:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.524+0000 7fc278a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc27406c9f0 0x7fc2741567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.524+0000 7fc278a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc274161f40 0x7fc274154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.524+0000 7fc278a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc274167680 0x7fc274154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.524+0000 7fc278a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740d1660 con 0x7fc27406c9f0 2024-05-30T16:41:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.524+0000 7fc278a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc27406dd30 con 0x7fc274161f40 2024-05-30T16:41:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.524+0000 7fc278a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc27409bc70 con 0x7fc274167680 2024-05-30T16:41:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.524+0000 7fc272800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc27406c9f0 0x7fc2741567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.524+0000 7fc272800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc27406c9f0 0x7fc2741567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45374/0 (socket says 172.21.15.144:45374) 2024-05-30T16:41:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.524+0000 7fc272800640 1 -- 172.21.15.144:0/3562072210 learned_addr learned my addr 172.21.15.144:0/3562072210 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:52.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.525+0000 7fc273200640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc274167680 0x7fc274154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:52.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.525+0000 7fc272800640 1 -- 172.21.15.144:0/3562072210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc274167680 msgr2=0x7fc274154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:52.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.525+0000 7fc272800640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc274167680 0x7fc274154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:52.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.525+0000 7fc271e00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc274161f40 0x7fc274154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:52.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.525+0000 7fc272800640 1 -- 172.21.15.144:0/3562072210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc274161f40 msgr2=0x7fc274154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:52.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.525+0000 7fc272800640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc274161f40 0x7fc274154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:52.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.525+0000 7fc272800640 1 -- 172.21.15.144:0/3562072210 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2740b5380 con 0x7fc27406c9f0 2024-05-30T16:41:52.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.525+0000 7fc272800640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc27406c9f0 0x7fc2741567e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc26400cb10 tx=0x7fc26400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.525+0000 7fc26aa00640 1 -- 172.21.15.144:0/3562072210 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264017070 con 0x7fc27406c9f0 2024-05-30T16:41:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.526+0000 7fc26aa00640 1 -- 172.21.15.144:0/3562072210 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc26400ac70 con 0x7fc27406c9f0 2024-05-30T16:41:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.526+0000 7fc26aa00640 1 -- 172.21.15.144:0/3562072210 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264012620 con 0x7fc27406c9f0 2024-05-30T16:41:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.526+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2740b5660 con 0x7fc27406c9f0 2024-05-30T16:41:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.526+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2740b5c20 con 0x7fc27406c9f0 2024-05-30T16:41:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.527+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2740b5e20 con 0x7fc27406c9f0 2024-05-30T16:41:52.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.528+0000 7fc26aa00640 1 -- 172.21.15.144:0/3562072210 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc26401a070 con 0x7fc27406c9f0 2024-05-30T16:41:52.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.529+0000 7fc26aa00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406c940 0x7fc25406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:52.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.529+0000 7fc26aa00640 1 -- 172.21.15.144:0/3562072210 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fc26408b930 con 0x7fc27406c9f0 2024-05-30T16:41:52.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.529+0000 7fc271e00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406c940 0x7fc25406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:52.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.530+0000 7fc271e00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406c940 0x7fc25406ee00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2740d0ef0 tx=0x7fc260008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:52.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.534+0000 7fc26aa00640 1 -- 172.21.15.144:0/3562072210 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc2740b5e20 con 0x7fc27406c9f0 2024-05-30T16:41:52.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:52.775+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc274075570 con 0x7fc27406c9f0 2024-05-30T16:41:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.338+0000 7fc26aa00640 1 -- 172.21.15.144:0/3562072210 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc264059da0 con 0x7fc27406c9f0 2024-05-30T16:41:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 2 and data pool 3 2024-05-30T16:41:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.345+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406c940 msgr2=0x7fc25406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.345+0000 7fc278a00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406c940 0x7fc25406ee00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2740d0ef0 tx=0x7fc260008040 comp rx=0 tx=0).stop 2024-05-30T16:41:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.345+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc27406c9f0 msgr2=0x7fc2741567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.345+0000 7fc278a00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc27406c9f0 0x7fc2741567e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc26400cb10 tx=0x7fc26400a060 comp rx=0 tx=0).stop 2024-05-30T16:41:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.346+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 shutdown_connections 2024-05-30T16:41:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.346+0000 7fc278a00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406c940 0x7fc25406ee00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.346+0000 7fc278a00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc274167680 0x7fc274154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.346+0000 7fc278a00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc274161f40 0x7fc274154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.346+0000 7fc278a00640 1 --2- 172.21.15.144:0/3562072210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc27406c9f0 0x7fc2741567e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.346+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 >> 172.21.15.144:0/3562072210 conn(0x7fc2740d24d0 msgr2=0x7fc274070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.346+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 shutdown_connections 2024-05-30T16:41:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.347+0000 7fc278a00640 1 -- 172.21.15.144:0/3562072210 wait complete. 2024-05-30T16:41:53.381 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:41:53.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.548+0000 7f7e98c00640 1 Processor -- start 2024-05-30T16:41:53.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.548+0000 7f7e98c00640 1 -- start start 2024-05-30T16:41:53.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.550+0000 7f7e98c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e94141510 0x7f7e941418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.550+0000 7f7e98c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e940b3fd0 con 0x7f7e9415f8f0 2024-05-30T16:41:53.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.550+0000 7f7e98c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e9415fd80 con 0x7f7e94144020 2024-05-30T16:41:53.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.550+0000 7f7e98c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9406dfc0 con 0x7f7e94141510 2024-05-30T16:41:53.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.550+0000 7f7e91400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7e9415f8f0 0x7f7e940b5440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41316/0 (socket says 172.21.15.144:41316) 2024-05-30T16:41:53.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.550+0000 7f7e91400640 1 -- 172.21.15.144:0/1485757909 learned_addr learned my addr 172.21.15.144:0/1485757909 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.550+0000 7f7e91e00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e94141510 0x7f7e941418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.550+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780269193 0 0) 0x7f7e940b3fd0 con 0x7f7e9415f8f0 2024-05-30T16:41:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e78003520 con 0x7f7e9415f8f0 2024-05-30T16:41:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3661103242 0 0) 0x7f7e78003520 con 0x7f7e9415f8f0 2024-05-30T16:41:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e94141510 msgr2=0x7f7e941418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e94141510 0x7f7e941418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 >> v1:172.21.15.149:6789/0 conn(0x7f7e94144020 legacy=0x7f7e9406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e94144790 con 0x7f7e9415f8f0 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f7e80001670 con 0x7f7e9415f8f0 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 >> v1:172.21.15.144:6789/0 conn(0x7f7e9415f8f0 legacy=0x7f7e940b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e780039e0 0x7f7e78003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e94141510 0x7f7e78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e78004d40 0x7f7e780051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9406dfc0 con 0x7f7e780039e0 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7800bbd0 con 0x7f7e78004d40 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7800bdd0 con 0x7f7e94141510 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.551+0000 7f7e91e00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e780039e0 0x7f7e78003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.552+0000 7f7e91e00640 1 -- 172.21.15.144:0/1485757909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e94141510 msgr2=0x7f7e78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.552+0000 7f7e91e00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e94141510 0x7f7e78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.552+0000 7f7e91e00640 1 -- 172.21.15.144:0/1485757909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e78004d40 msgr2=0x7f7e780051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.552+0000 7f7e91e00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e78004d40 0x7f7e780051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.552+0000 7f7e91e00640 1 -- 172.21.15.144:0/1485757909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e78003520 con 0x7f7e780039e0 2024-05-30T16:41:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.553+0000 7f7e91e00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e780039e0 0x7f7e78003e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009ac0 tx=0x7f7e78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de67b322daa825bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.553+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84036070 con 0x7f7e780039e0 2024-05-30T16:41:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.553+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e84031400 con 0x7f7e780039e0 2024-05-30T16:41:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.553+0000 7f7e90a00640 1 -- 172.21.15.144:0/1485757909 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84009690 con 0x7f7e780039e0 2024-05-30T16:41:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.553+0000 7f7e98c00640 1 -- 172.21.15.144:0/1485757909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e780039e0 msgr2=0x7f7e78003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.553+0000 7f7e98c00640 1 --2- 172.21.15.144:0/1485757909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e780039e0 0x7f7e78003e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009ac0 tx=0x7f7e78005830 comp rx=0 tx=0).stop 2024-05-30T16:41:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.554+0000 7f7e92800640 1 -- 172.21.15.144:0/1485757909 reap_dead start 2024-05-30T16:41:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.554+0000 7f7e98c00640 1 -- 172.21.15.144:0/1485757909 shutdown_connections 2024-05-30T16:41:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.554+0000 7f7e98c00640 1 -- 172.21.15.144:0/1485757909 >> 172.21.15.144:0/1485757909 conn(0x7f7e9406bd00 msgr2=0x7f7e9406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.554+0000 7f7e98c00640 1 -- 172.21.15.144:0/1485757909 shutdown_connections 2024-05-30T16:41:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.554+0000 7f7e98c00640 1 -- 172.21.15.144:0/1485757909 wait complete. 2024-05-30T16:41:53.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.555+0000 7f7e98c00640 1 Processor -- start 2024-05-30T16:41:53.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.556+0000 7f7e98c00640 1 -- start start 2024-05-30T16:41:53.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.556+0000 7f7e98c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780039e0 0x7f7e9415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.556+0000 7f7e98c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e941592e0 0x7f7e9415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e98c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e94136c20 0x7f7e94142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e98c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9406e210 con 0x7f7e94136c20 2024-05-30T16:41:53.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e98c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e94144d50 con 0x7f7e780039e0 2024-05-30T16:41:53.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e98c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e94144450 con 0x7f7e941592e0 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e92800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e94136c20 0x7f7e94142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e92800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e94136c20 0x7f7e94142090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45394/0 (socket says 172.21.15.144:45394) 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e92800640 1 -- 172.21.15.144:0/2624451182 learned_addr learned my addr 172.21.15.144:0/2624451182 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e91400640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e941592e0 0x7f7e9415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e91e00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780039e0 0x7f7e9415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e92800640 1 -- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e941592e0 msgr2=0x7f7e9415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e92800640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e941592e0 0x7f7e9415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e92800640 1 -- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780039e0 msgr2=0x7f7e9415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e92800640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780039e0 0x7f7e9415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e92800640 1 -- 172.21.15.144:0/2624451182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9415b060 con 0x7f7e94136c20 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e91e00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780039e0 0x7f7e9415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:53.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.557+0000 7f7e91400640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e941592e0 0x7f7e9415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:53.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.558+0000 7f7e92800640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e94136c20 0x7f7e94142090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e9415fcd0 tx=0x7f7e8c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:53.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.558+0000 7f7e8a000640 1 -- 172.21.15.144:0/2624451182 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c017070 con 0x7f7e94136c20 2024-05-30T16:41:53.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.558+0000 7f7e8a000640 1 -- 172.21.15.144:0/2624451182 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c005d60 con 0x7f7e94136c20 2024-05-30T16:41:53.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.558+0000 7f7e8a000640 1 -- 172.21.15.144:0/2624451182 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00a850 con 0x7f7e94136c20 2024-05-30T16:41:53.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.558+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e94159a80 con 0x7f7e94136c20 2024-05-30T16:41:53.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.558+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9415a040 con 0x7f7e94136c20 2024-05-30T16:41:53.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.559+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e94068b90 con 0x7f7e94136c20 2024-05-30T16:41:53.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.560+0000 7f7e8a000640 1 -- 172.21.15.144:0/2624451182 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e8c00a9f0 con 0x7f7e94136c20 2024-05-30T16:41:53.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.561+0000 7f7e8a000640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e7406c920 0x7f7e7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.561+0000 7f7e8a000640 1 -- 172.21.15.144:0/2624451182 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f7e8c08acd0 con 0x7f7e94136c20 2024-05-30T16:41:53.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.561+0000 7f7e91e00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e7406c920 0x7f7e7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.562+0000 7f7e91e00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e7406c920 0x7f7e7406ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e84033000 tx=0x7f7e84008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.566+0000 7f7e8a000640 1 -- 172.21.15.144:0/2624451182 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e8c059060 con 0x7f7e94136c20 2024-05-30T16:41:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.758+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e940b3890 con 0x7f7e94136c20 2024-05-30T16:41:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.760+0000 7f7e8a000640 1 -- 172.21.15.144:0/2624451182 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7f7e8c058960 con 0x7f7e94136c20 2024-05-30T16:41:53.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:53.762 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":19,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:52.777522+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:41:50.922058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:41:51.739937+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.763+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e7406c920 msgr2=0x7f7e7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.763+0000 7f7e98c00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e7406c920 0x7f7e7406ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e84033000 tx=0x7f7e84008030 comp rx=0 tx=0).stop 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.763+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e94136c20 msgr2=0x7f7e94142090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.763+0000 7f7e98c00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e94136c20 0x7f7e94142090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e9415fcd0 tx=0x7f7e8c00cb90 comp rx=0 tx=0).stop 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.763+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 shutdown_connections 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.763+0000 7f7e98c00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e7406c920 0x7f7e7406ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.763+0000 7f7e98c00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e94136c20 0x7f7e94142090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.763+0000 7f7e98c00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e941592e0 0x7f7e9415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.763+0000 7f7e98c00640 1 --2- 172.21.15.144:0/2624451182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780039e0 0x7f7e9415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.764+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 >> 172.21.15.144:0/2624451182 conn(0x7f7e9406bd00 msgr2=0x7f7e9406e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.764+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 shutdown_connections 2024-05-30T16:41:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.764+0000 7f7e98c00640 1 -- 172.21.15.144:0/2624451182 wait complete. 2024-05-30T16:41:53.783 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:41:53.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.971+0000 7f5a53600640 1 Processor -- start 2024-05-30T16:41:53.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.971+0000 7f5a53600640 1 -- start start 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.972+0000 7f5a53600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c13f760 0x7f5a4c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a53600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a4c0b5fd0 0x7f5a4c142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a53600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4c06ee80 con 0x7f5a4c0cec70 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a53600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5a4c1612b0 con 0x7f5a4c0b5fd0 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a53600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4c13fb40 con 0x7f5a4c13f760 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a4be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5a4c0cec70 0x7f5a4c0b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41332/0 (socket says 172.21.15.144:41332) 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a4be00640 1 -- 172.21.15.144:0/373480093 learned_addr learned my addr 172.21.15.144:0/373480093 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a50c00640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c13f760 0x7f5a4c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a51600640 1 --2- 172.21.15.144:0/373480093 >> v2:172.21.15.149:3300/0 conn(0x7f5a4c0b5fd0 0x7f5a4c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107397788 0 0) 0x7f5a4c06ee80 con 0x7f5a4c0cec70 2024-05-30T16:41:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.973+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a34003520 con 0x7f5a4c0cec70 2024-05-30T16:41:53.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1038647819 0 0) 0x7f5a34003520 con 0x7f5a4c0cec70 2024-05-30T16:41:53.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c13f760 msgr2=0x7f5a4c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c13f760 0x7f5a4c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 >> v2:172.21.15.149:3300/0 conn(0x7f5a4c0b5fd0 msgr2=0x7f5a4c142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 --2- 172.21.15.144:0/373480093 >> v2:172.21.15.149:3300/0 conn(0x7f5a4c0b5fd0 0x7f5a4c142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c160730 con 0x7f5a4c0cec70 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f5a38001670 con 0x7f5a4c0cec70 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 >> v1:172.21.15.144:6789/0 conn(0x7f5a4c0cec70 legacy=0x7f5a4c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a340039b0 0x7f5a34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c13f760 0x7f5a340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c1612b0 con 0x7f5a34004800 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3400b9c0 con 0x7f5a340039b0 2024-05-30T16:41:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3400bb40 con 0x7f5a4c13f760 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.974+0000 7f5a4be00640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.975+0000 7f5a4be00640 1 -- 172.21.15.144:0/373480093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c13f760 msgr2=0x7f5a340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.975+0000 7f5a4be00640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c13f760 0x7f5a340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.975+0000 7f5a4be00640 1 -- 172.21.15.144:0/373480093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a340039b0 msgr2=0x7f5a34003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.975+0000 7f5a4be00640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a340039b0 0x7f5a34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.975+0000 7f5a4be00640 1 -- 172.21.15.144:0/373480093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a34003520 con 0x7f5a34004800 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.976+0000 7f5a4be00640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a34004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5a38007fd0 tx=0x7f5a34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ed347bb6701f42 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.976+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38007d50 con 0x7f5a34004800 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.976+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a38005ad0 con 0x7f5a34004800 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.976+0000 7f5a4b400640 1 -- 172.21.15.144:0/373480093 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38007070 con 0x7f5a34004800 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.976+0000 7f5a53600640 1 -- 172.21.15.144:0/373480093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 msgr2=0x7f5a34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.976+0000 7f5a53600640 1 --2- 172.21.15.144:0/373480093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a34004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5a38007fd0 tx=0x7f5a34005830 comp rx=0 tx=0).stop 2024-05-30T16:41:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.976+0000 7f5a51600640 1 -- 172.21.15.144:0/373480093 reap_dead start 2024-05-30T16:41:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.976+0000 7f5a53600640 1 -- 172.21.15.144:0/373480093 shutdown_connections 2024-05-30T16:41:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.976+0000 7f5a53600640 1 -- 172.21.15.144:0/373480093 >> 172.21.15.144:0/373480093 conn(0x7f5a4c06bd00 msgr2=0x7f5a4c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.977+0000 7f5a53600640 1 -- 172.21.15.144:0/373480093 shutdown_connections 2024-05-30T16:41:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.977+0000 7f5a53600640 1 -- 172.21.15.144:0/373480093 wait complete. 2024-05-30T16:41:53.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.978+0000 7f5a53600640 1 Processor -- start 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.979+0000 7f5a53600640 1 -- start start 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.979+0000 7f5a53600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a4c1515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.979+0000 7f5a53600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c151d00 0x7f5a4c152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.979+0000 7f5a53600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a4c0ad9b0 0x7f5a4c0ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.979+0000 7f5a53600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c160fd0 con 0x7f5a34004800 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.979+0000 7f5a53600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c160cf0 con 0x7f5a4c0ad9b0 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.979+0000 7f5a53600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4c0cf0d0 con 0x7f5a4c151d00 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a50c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a4c1515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a50c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a4c1515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45412/0 (socket says 172.21.15.144:45412) 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a50c00640 1 -- 172.21.15.144:0/963452987 learned_addr learned my addr 172.21.15.144:0/963452987 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:53.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a4be00640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c151d00 0x7f5a4c152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a50c00640 1 -- 172.21.15.144:0/963452987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c151d00 msgr2=0x7f5a4c152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a50c00640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c151d00 0x7f5a4c152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a50c00640 1 -- 172.21.15.144:0/963452987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a4c0ad9b0 msgr2=0x7f5a4c0ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a50c00640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a4c0ad9b0 0x7f5a4c0ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a50c00640 1 -- 172.21.15.144:0/963452987 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c151b00 con 0x7f5a34004800 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.980+0000 7f5a50c00640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a4c1515c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000e7a0 tx=0x7f5a4000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.981+0000 7f5a48c00640 1 -- 172.21.15.144:0/963452987 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40017070 con 0x7f5a34004800 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.981+0000 7f5a48c00640 1 -- 172.21.15.144:0/963452987 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4000c8c0 con 0x7f5a34004800 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.981+0000 7f5a48c00640 1 -- 172.21.15.144:0/963452987 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000cc90 con 0x7f5a34004800 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.981+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c0ae720 con 0x7f5a34004800 2024-05-30T16:41:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.981+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c0aece0 con 0x7f5a34004800 2024-05-30T16:41:53.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.982+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4c068b90 con 0x7f5a34004800 2024-05-30T16:41:53.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.983+0000 7f5a48c00640 1 -- 172.21.15.144:0/963452987 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a4001a070 con 0x7f5a34004800 2024-05-30T16:41:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.984+0000 7f5a48c00640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5a2c06c8f0 0x7f5a2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.984+0000 7f5a48c00640 1 -- 172.21.15.144:0/963452987 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f5a4008b860 con 0x7f5a34004800 2024-05-30T16:41:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.984+0000 7f5a4be00640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5a2c06c8f0 0x7f5a2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.985+0000 7f5a4be00640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5a2c06c8f0 0x7f5a2c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5a38033000 tx=0x7f5a38009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:53.988+0000 7f5a48c00640 1 -- 172.21.15.144:0/963452987 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a4c151b00 con 0x7f5a34004800 2024-05-30T16:41:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.189+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a4c15e8b0 con 0x7f5a34004800 2024-05-30T16:41:54.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.191+0000 7f5a48c00640 1 -- 172.21.15.144:0/963452987 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7f5a4008b020 con 0x7f5a34004800 2024-05-30T16:41:54.192 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:54.192 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":19,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:52.777522+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:41:50.922058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:41:51.739937+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:41:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5a2c06c8f0 msgr2=0x7f5a2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5a2c06c8f0 0x7f5a2c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5a38033000 tx=0x7f5a38009030 comp rx=0 tx=0).stop 2024-05-30T16:41:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 msgr2=0x7f5a4c1515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a4c1515c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000e7a0 tx=0x7f5a4000ec60 comp rx=0 tx=0).stop 2024-05-30T16:41:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 shutdown_connections 2024-05-30T16:41:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5a2c06c8f0 0x7f5a2c06edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a4c0ad9b0 0x7f5a4c0ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a4c151d00 0x7f5a4c152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 --2- 172.21.15.144:0/963452987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34004800 0x7f5a4c1515c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 >> 172.21.15.144:0/963452987 conn(0x7f5a4c06bd00 msgr2=0x7f5a4c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 shutdown_connections 2024-05-30T16:41:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.194+0000 7f5a53600640 1 -- 172.21.15.144:0/963452987 wait complete. 2024-05-30T16:41:54.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:41:54.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.418+0000 7f5e3e000640 1 Processor -- start 2024-05-30T16:41:54.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.418+0000 7f5e3e000640 1 -- start start 2024-05-30T16:41:54.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.420+0000 7f5e3e000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5e38072210 0x7f5e38072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:54.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.420+0000 7f5e3e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e380b4140 0x7f5e380b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:54.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.420+0000 7f5e3e000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e38072b70 con 0x7f5e3814c630 2024-05-30T16:41:54.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.420+0000 7f5e3e000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3806fbf0 con 0x7f5e38072210 2024-05-30T16:41:54.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.420+0000 7f5e3e000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e380cf050 con 0x7f5e380b4140 2024-05-30T16:41:54.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.420+0000 7f5e37400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5e3814c630 0x7f5e380ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41348/0 (socket says 172.21.15.144:41348) 2024-05-30T16:41:54.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.420+0000 7f5e37400640 1 -- 172.21.15.144:0/1547348874 learned_addr learned my addr 172.21.15.144:0/1547348874 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:54.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e37e00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e380b4140 0x7f5e380b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:54.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e2fe00640 1 --2- 172.21.15.144:0/1547348874 >> v2:172.21.15.149:3300/0 conn(0x7f5e38072210 0x7f5e38072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:54.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890932106 0 0) 0x7f5e38072b70 con 0x7f5e3814c630 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e1c003520 con 0x7f5e3814c630 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 28137722 0 0) 0x7f5e1c003520 con 0x7f5e3814c630 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e380b4140 msgr2=0x7f5e380b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e380b4140 0x7f5e380b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 >> v2:172.21.15.149:3300/0 conn(0x7f5e38072210 msgr2=0x7f5e38072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 --2- 172.21.15.144:0/1547348874 >> v2:172.21.15.149:3300/0 conn(0x7f5e38072210 0x7f5e38072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e380cf330 con 0x7f5e3814c630 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f5e28001670 con 0x7f5e3814c630 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 >> v1:172.21.15.144:6789/0 conn(0x7f5e3814c630 legacy=0x7f5e380ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e380b4140 0x7f5e1c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e1c004d40 0x7f5e1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:54.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3806fbf0 con 0x7f5e1c003f30 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380cf050 con 0x7f5e1c004d40 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e1c00baa0 con 0x7f5e380b4140 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.421+0000 7f5e2fe00640 1 --2- 172.21.15.144:0/1547348874 >> v2:172.21.15.149:3300/0 conn(0x7f5e38072210 0x7f5e38072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.422+0000 7f5e2fe00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.422+0000 7f5e37400640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e380b4140 0x7f5e1c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.422+0000 7f5e2fe00640 1 -- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e380b4140 msgr2=0x7f5e1c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.422+0000 7f5e2fe00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e380b4140 0x7f5e1c0039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.422+0000 7f5e37e00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e1c004d40 0x7f5e1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.422+0000 7f5e2fe00640 1 -- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e1c004d40 msgr2=0x7f5e1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.422+0000 7f5e2fe00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e1c004d40 0x7f5e1c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.422+0000 7f5e2fe00640 1 -- 172.21.15.144:0/1547348874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1c003520 con 0x7f5e1c003f30 2024-05-30T16:41:54.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.423+0000 7f5e2fe00640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e1c004800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e200098a0 tx=0x7f5e1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ffc705acc8e31 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.423+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20037070 con 0x7f5e1c003f30 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.423+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2002ad20 con 0x7f5e1c003f30 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.423+0000 7f5e36a00640 1 -- 172.21.15.144:0/1547348874 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000f040 con 0x7f5e1c003f30 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.424+0000 7f5e3e000640 1 -- 172.21.15.144:0/1547348874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 msgr2=0x7f5e1c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.424+0000 7f5e3e000640 1 --2- 172.21.15.144:0/1547348874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e1c004800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e200098a0 tx=0x7f5e1c005830 comp rx=0 tx=0).stop 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.424+0000 7f5e37e00640 1 -- 172.21.15.144:0/1547348874 reap_dead start 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.424+0000 7f5e3e000640 1 -- 172.21.15.144:0/1547348874 shutdown_connections 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.424+0000 7f5e3e000640 1 -- 172.21.15.144:0/1547348874 >> 172.21.15.144:0/1547348874 conn(0x7f5e3806bd00 msgr2=0x7f5e3806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.424+0000 7f5e3e000640 1 -- 172.21.15.144:0/1547348874 shutdown_connections 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.424+0000 7f5e3e000640 1 -- 172.21.15.144:0/1547348874 wait complete. 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.426+0000 7f5e3e000640 1 Processor -- start 2024-05-30T16:41:54.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.426+0000 7f5e3e000640 1 -- start start 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e3e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e381e9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e3e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e381ed050 0x7f5e380ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e3e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e380adce0 0x7f5e380afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e3e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380b3c20 con 0x7f5e1c003f30 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e3e000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380cf8f0 con 0x7f5e380adce0 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e3e000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3814ca10 con 0x7f5e381ed050 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e381e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e381e9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45418/0 (socket says 172.21.15.144:45418) 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e37400640 1 -- 172.21.15.144:0/4146444443 learned_addr learned my addr 172.21.15.144:0/4146444443 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e37400640 1 -- 172.21.15.144:0/4146444443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e381ed050 msgr2=0x7f5e380ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e37400640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e381ed050 0x7f5e380ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e37400640 1 -- 172.21.15.144:0/4146444443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e380adce0 msgr2=0x7f5e380afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e37400640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e380adce0 0x7f5e380afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.427+0000 7f5e37400640 1 -- 172.21.15.144:0/4146444443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e381ec870 con 0x7f5e1c003f30 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.428+0000 7f5e37400640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e381e9350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800d810 tx=0x7f5e2800dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.428+0000 7f5e2f400640 1 -- 172.21.15.144:0/4146444443 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28019070 con 0x7f5e1c003f30 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.428+0000 7f5e2f400640 1 -- 172.21.15.144:0/4146444443 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e280074e0 con 0x7f5e1c003f30 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.428+0000 7f5e2f400640 1 -- 172.21.15.144:0/4146444443 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28004a20 con 0x7f5e1c003f30 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.428+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e380ae210 con 0x7f5e1c003f30 2024-05-30T16:41:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.428+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e381ecb30 con 0x7f5e1c003f30 2024-05-30T16:41:54.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.429+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e381ea570 con 0x7f5e1c003f30 2024-05-30T16:41:54.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.430+0000 7f5e2f400640 1 -- 172.21.15.144:0/4146444443 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e2801c070 con 0x7f5e1c003f30 2024-05-30T16:41:54.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.431+0000 7f5e2f400640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e1406c920 0x7f5e1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:54.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.431+0000 7f5e2f400640 1 -- 172.21.15.144:0/4146444443 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5e2808b530 con 0x7f5e1c003f30 2024-05-30T16:41:54.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.431+0000 7f5e2fe00640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e1406c920 0x7f5e1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:54.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.432+0000 7f5e2fe00640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e1406c920 0x7f5e1406ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e20034000 tx=0x7f5e2002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:54.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.436+0000 7f5e2f400640 1 -- 172.21.15.144:0/4146444443 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e381ea570 con 0x7f5e1c003f30 2024-05-30T16:41:54.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:54.674+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5e38068b90 con 0x7f5e1c003f30 2024-05-30T16:41:55.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.354+0000 7f5e2f400640 1 -- 172.21.15.144:0/4146444443 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f5e28059960 con 0x7f5e1c003f30 2024-05-30T16:41:55.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.357+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e1406c920 msgr2=0x7f5e1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:55.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.357+0000 7f5e3e000640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e1406c920 0x7f5e1406ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e20034000 tx=0x7f5e2002c000 comp rx=0 tx=0).stop 2024-05-30T16:41:55.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.357+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 msgr2=0x7f5e381e9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:55.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.357+0000 7f5e3e000640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e381e9350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800d810 tx=0x7f5e2800dcd0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.358+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 shutdown_connections 2024-05-30T16:41:55.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.358+0000 7f5e3e000640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e1406c920 0x7f5e1406ede0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.358+0000 7f5e3e000640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e380adce0 0x7f5e380afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.358+0000 7f5e3e000640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e381ed050 0x7f5e380ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.358+0000 7f5e3e000640 1 --2- 172.21.15.144:0/4146444443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e1c003f30 0x7f5e381e9350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.358+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 >> 172.21.15.144:0/4146444443 conn(0x7f5e3806bd00 msgr2=0x7f5e3814b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:55.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.358+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 shutdown_connections 2024-05-30T16:41:55.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.358+0000 7f5e3e000640 1 -- 172.21.15.144:0/4146444443 wait complete. 2024-05-30T16:41:55.379 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:41:55.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:41:55.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.576+0000 7fce21000640 1 Processor -- start 2024-05-30T16:41:55.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.576+0000 7fce21000640 1 -- start start 2024-05-30T16:41:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce21000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c0cec70 0x7fce1c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce21000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce1c0b5e00 0x7fce1c142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce21000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce1c160730 con 0x7fce1c13f760 2024-05-30T16:41:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce21000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fce1c1612b0 con 0x7fce1c0b5e00 2024-05-30T16:41:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce21000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce1c13fb40 con 0x7fce1c0cec70 2024-05-30T16:41:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce19e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fce1c13f760 0x7fce1c06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54646/0 (socket says 172.21.15.144:54646) 2024-05-30T16:41:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce19e00640 1 -- 172.21.15.144:0/1769086034 learned_addr learned my addr 172.21.15.144:0/1769086034 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:55.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce1a800640 1 --2- 172.21.15.144:0/1769086034 >> v2:172.21.15.149:3300/0 conn(0x7fce1c0b5e00 0x7fce1c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:55.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce13e00640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c0cec70 0x7fce1c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:55.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.578+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069661121 0 0) 0x7fce1c160730 con 0x7fce1c13f760 2024-05-30T16:41:55.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce00003520 con 0x7fce1c13f760 2024-05-30T16:41:55.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 218481740 0 0) 0x7fce00003520 con 0x7fce1c13f760 2024-05-30T16:41:55.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c0cec70 msgr2=0x7fce1c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c0cec70 0x7fce1c0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 >> v2:172.21.15.149:3300/0 conn(0x7fce1c0b5e00 msgr2=0x7fce1c142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 --2- 172.21.15.144:0/1769086034 >> v2:172.21.15.149:3300/0 conn(0x7fce1c0b5e00 0x7fce1c142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c160a10 con 0x7fce1c13f760 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fce0c001670 con 0x7fce1c13f760 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 >> v1:172.21.15.144:6789/0 conn(0x7fce1c13f760 legacy=0x7fce1c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce000039b0 0x7fce00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce00004800 0x7fce00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce000051c0 0x7fce0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1612b0 con 0x7fce000039b0 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce0000bf00 con 0x7fce00004800 2024-05-30T16:41:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce0000c0b0 con 0x7fce000051c0 2024-05-30T16:41:55.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce13e00640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c0cec70 0x7fce1c0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:41:55.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.579+0000 7fce19e00640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce000039b0 0x7fce00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:55.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.580+0000 7fce1a800640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce000051c0 0x7fce0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:55.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.580+0000 7fce19e00640 1 -- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce000051c0 msgr2=0x7fce0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:55.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.580+0000 7fce19e00640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce000051c0 0x7fce0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.580+0000 7fce19e00640 1 -- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce00004800 msgr2=0x7fce00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:55.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.580+0000 7fce19e00640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce00004800 0x7fce00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.580+0000 7fce19e00640 1 -- 172.21.15.144:0/1769086034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce00003520 con 0x7fce000039b0 2024-05-30T16:41:55.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.580+0000 7fce1a800640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce000051c0 0x7fce0000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:55.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.581+0000 7fce19e00640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce000039b0 0x7fce00003dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00c240 tx=0x7fce00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f34c5b7466fd845 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.581+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c02e070 con 0x7fce000039b0 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.581+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c005af0 con 0x7fce000039b0 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.581+0000 7fce19400640 1 -- 172.21.15.144:0/1769086034 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c007d30 con 0x7fce000039b0 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.581+0000 7fce21000640 1 -- 172.21.15.144:0/1769086034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce000039b0 msgr2=0x7fce00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.581+0000 7fce21000640 1 --2- 172.21.15.144:0/1769086034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce000039b0 0x7fce00003dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00c240 tx=0x7fce00005830 comp rx=0 tx=0).stop 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.581+0000 7fce1a800640 1 -- 172.21.15.144:0/1769086034 reap_dead start 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.582+0000 7fce21000640 1 -- 172.21.15.144:0/1769086034 shutdown_connections 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.582+0000 7fce21000640 1 -- 172.21.15.144:0/1769086034 >> 172.21.15.144:0/1769086034 conn(0x7fce1c06bd00 msgr2=0x7fce1c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.582+0000 7fce21000640 1 -- 172.21.15.144:0/1769086034 shutdown_connections 2024-05-30T16:41:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.582+0000 7fce21000640 1 -- 172.21.15.144:0/1769086034 wait complete. 2024-05-30T16:41:55.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.583+0000 7fce21000640 1 Processor -- start 2024-05-30T16:41:55.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.583+0000 7fce21000640 1 -- start start 2024-05-30T16:41:55.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.584+0000 7fce21000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce000039b0 0x7fce1c132520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:55.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.584+0000 7fce21000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c157ad0 0x7fce1c0af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:55.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.584+0000 7fce21000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce1c0b18f0 0x7fce1c0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.584+0000 7fce21000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c0cf0d0 con 0x7fce1c0b18f0 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.584+0000 7fce21000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c160fd0 con 0x7fce000039b0 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.584+0000 7fce21000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce1c0cf250 con 0x7fce1c157ad0 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce1a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce1c0b18f0 0x7fce1c0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce1a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce1c0b18f0 0x7fce1c0b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58680/0 (socket says 172.21.15.144:58680) 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce1a800640 1 -- 172.21.15.144:0/333397452 learned_addr learned my addr 172.21.15.144:0/333397452 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce19e00640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce000039b0 0x7fce1c132520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce13e00640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c157ad0 0x7fce1c0af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce1a800640 1 -- 172.21.15.144:0/333397452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c157ad0 msgr2=0x7fce1c0af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce1a800640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c157ad0 0x7fce1c0af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce1a800640 1 -- 172.21.15.144:0/333397452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce000039b0 msgr2=0x7fce1c132520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce1a800640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce000039b0 0x7fce1c132520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce1a800640 1 -- 172.21.15.144:0/333397452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c0af950 con 0x7fce1c0b18f0 2024-05-30T16:41:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce19e00640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce000039b0 0x7fce1c132520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.585+0000 7fce1a800640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce1c0b18f0 0x7fce1c0b1d70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce1c06e4b0 tx=0x7fce1400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.586+0000 7fce12000640 1 -- 172.21.15.144:0/333397452 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14016420 con 0x7fce1c0b18f0 2024-05-30T16:41:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.586+0000 7fce12000640 1 -- 172.21.15.144:0/333397452 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1401b070 con 0x7fce1c0b18f0 2024-05-30T16:41:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.586+0000 7fce12000640 1 -- 172.21.15.144:0/333397452 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce140167e0 con 0x7fce1c0b18f0 2024-05-30T16:41:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.586+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1c0aae50 con 0x7fce1c0b18f0 2024-05-30T16:41:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.586+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1c0ab410 con 0x7fce1c0b18f0 2024-05-30T16:41:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.587+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1c0cfc70 con 0x7fce1c0b18f0 2024-05-30T16:41:55.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.588+0000 7fce12000640 1 -- 172.21.15.144:0/333397452 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce14005d10 con 0x7fce1c0b18f0 2024-05-30T16:41:55.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.589+0000 7fce12000640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcdf806c970 0x7fcdf806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:55.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.589+0000 7fce12000640 1 -- 172.21.15.144:0/333397452 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fce1408c3d0 con 0x7fce1c0b18f0 2024-05-30T16:41:55.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.589+0000 7fce19e00640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcdf806c970 0x7fcdf806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:55.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.590+0000 7fce19e00640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcdf806c970 0x7fcdf806ee30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce0c033000 tx=0x7fce0c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:55.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.593+0000 7fce12000640 1 -- 172.21.15.144:0/333397452 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce1c0cfc70 con 0x7fce1c0b18f0 2024-05-30T16:41:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:55.838+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fce1c068b90 con 0x7fce1c0b18f0 2024-05-30T16:41:56.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.364+0000 7fce12000640 1 -- 172.21.15.144:0/333397452 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fce1405a7e0 con 0x7fce1c0b18f0 2024-05-30T16:41:56.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcdf806c970 msgr2=0x7fcdf806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:56.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcdf806c970 0x7fcdf806ee30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce0c033000 tx=0x7fce0c009030 comp rx=0 tx=0).stop 2024-05-30T16:41:56.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce1c0b18f0 msgr2=0x7fce1c0b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:56.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce1c0b18f0 0x7fce1c0b1d70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce1c06e4b0 tx=0x7fce1400f520 comp rx=0 tx=0).stop 2024-05-30T16:41:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 shutdown_connections 2024-05-30T16:41:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcdf806c970 0x7fcdf806ee30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce1c0b18f0 0x7fce1c0b1d70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce1c157ad0 0x7fce1c0af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 --2- 172.21.15.144:0/333397452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce000039b0 0x7fce1c132520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 >> 172.21.15.144:0/333397452 conn(0x7fce1c06bd00 msgr2=0x7fce1c074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 shutdown_connections 2024-05-30T16:41:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.368+0000 7fce21000640 1 -- 172.21.15.144:0/333397452 wait complete. 2024-05-30T16:41:56.389 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:41:56.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:41:56.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.588+0000 7f38c3000640 1 Processor -- start 2024-05-30T16:41:56.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.588+0000 7f38c3000640 1 -- start start 2024-05-30T16:41:56.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.589+0000 7f38c3000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f38bc1418f0 0x7f38bc15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:56.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.589+0000 7f38c3000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f38bc144020 0x7f38bc06e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:56.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.589+0000 7f38c3000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38bc0b3fd0 con 0x7f38bc141510 2024-05-30T16:41:56.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.589+0000 7f38c3000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f38bc06dfc0 con 0x7f38bc144020 2024-05-30T16:41:56.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.589+0000 7f38c3000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f38bc144790 con 0x7f38bc1418f0 2024-05-30T16:41:56.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.590+0000 7f38c1000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f38bc144020 0x7f38bc06e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:56.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.590+0000 7f38c1000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f38bc144020 0x7f38bc06e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58684/0 (socket says 172.21.15.144:58684) 2024-05-30T16:41:56.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.590+0000 7f38c1000640 1 -- 172.21.15.144:0/3375894136 learned_addr learned my addr 172.21.15.144:0/3375894136 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:56.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.590+0000 7f38b3400640 1 --2- 172.21.15.144:0/3375894136 >> v2:172.21.15.149:3300/0 conn(0x7f38bc1418f0 0x7f38bc15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:56.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.590+0000 7f38c1000640 1 -- 172.21.15.144:0/3375894136 >> v2:172.21.15.149:3300/0 conn(0x7f38bc1418f0 msgr2=0x7f38bc15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:56.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.590+0000 7f38c1000640 1 --2- 172.21.15.144:0/3375894136 >> v2:172.21.15.149:3300/0 conn(0x7f38bc1418f0 0x7f38bc15f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.590+0000 7f38c1000640 1 -- 172.21.15.144:0/3375894136 >> v1:172.21.15.149:6789/0 conn(0x7f38bc141510 legacy=0x7f38bc0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:56.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.590+0000 7f38c1000640 1 -- 172.21.15.144:0/3375894136 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38bc144a70 con 0x7f38bc144020 2024-05-30T16:41:56.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.590+0000 7f38b3400640 1 --2- 172.21.15.144:0/3375894136 >> v2:172.21.15.149:3300/0 conn(0x7f38bc1418f0 0x7f38bc15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.591+0000 7f38c1000640 1 --2- 172.21.15.144:0/3375894136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc144020 0x7f38bc06e710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0b4f80 tx=0x7f38b402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f09e53d0931456 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.592+0000 7f38bb400640 1 -- 172.21.15.144:0/3375894136 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4036070 con 0x7f38bc144020 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.592+0000 7f38bb400640 1 -- 172.21.15.144:0/3375894136 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b4031600 con 0x7f38bc144020 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.592+0000 7f38bb400640 1 -- 172.21.15.144:0/3375894136 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40319d0 con 0x7f38bc144020 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.592+0000 7f38c3000640 1 -- 172.21.15.144:0/3375894136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc144020 msgr2=0x7f38bc06e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.592+0000 7f38c3000640 1 --2- 172.21.15.144:0/3375894136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc144020 0x7f38bc06e710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0b4f80 tx=0x7f38b402a5d0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.593+0000 7f38c3000640 1 -- 172.21.15.144:0/3375894136 shutdown_connections 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.593+0000 7f38c3000640 1 --2- 172.21.15.144:0/3375894136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc144020 0x7f38bc06e710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.593+0000 7f38c3000640 1 --2- 172.21.15.144:0/3375894136 >> v2:172.21.15.149:3300/0 conn(0x7f38bc1418f0 0x7f38bc15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.593+0000 7f38c3000640 1 -- 172.21.15.144:0/3375894136 >> 172.21.15.144:0/3375894136 conn(0x7f38bc06bd00 msgr2=0x7f38bc06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.593+0000 7f38c3000640 1 -- 172.21.15.144:0/3375894136 shutdown_connections 2024-05-30T16:41:56.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.593+0000 7f38c3000640 1 -- 172.21.15.144:0/3375894136 wait complete. 2024-05-30T16:41:56.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.594+0000 7f38c3000640 1 Processor -- start 2024-05-30T16:41:56.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.595+0000 7f38c3000640 1 -- start start 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.595+0000 7f38c3000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc141510 0x7f38bc13e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.595+0000 7f38c3000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38bc1418f0 0x7f38bc0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38c3000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38bc144020 0x7f38bc156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38c3000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc144490 con 0x7f38bc141510 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38c3000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc06e210 con 0x7f38bc144020 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38c3000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38bc0b5b50 con 0x7f38bc1418f0 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc141510 0x7f38bc13e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc141510 0x7f38bc13e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58692/0 (socket says 172.21.15.144:58692) 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38bbe00640 1 -- 172.21.15.144:0/3524349944 learned_addr learned my addr 172.21.15.144:0/3524349944 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38c1000640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38bc144020 0x7f38bc156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38b3400640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38bc1418f0 0x7f38bc0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38bbe00640 1 -- 172.21.15.144:0/3524349944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38bc1418f0 msgr2=0x7f38bc0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38bbe00640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38bc1418f0 0x7f38bc0b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38bbe00640 1 -- 172.21.15.144:0/3524349944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38bc144020 msgr2=0x7f38bc156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38bbe00640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38bc144020 0x7f38bc156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38bbe00640 1 -- 172.21.15.144:0/3524349944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38bc13e690 con 0x7f38bc141510 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.596+0000 7f38bbe00640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc141510 0x7f38bc13e150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00c430 tx=0x7f38ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.597+0000 7f38b8c00640 1 -- 172.21.15.144:0/3524349944 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac011790 con 0x7f38bc141510 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.597+0000 7f38b8c00640 1 -- 172.21.15.144:0/3524349944 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac017070 con 0x7f38bc141510 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.597+0000 7f38b8c00640 1 -- 172.21.15.144:0/3524349944 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac011bb0 con 0x7f38bc141510 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.597+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38bc0b17b0 con 0x7f38bc141510 2024-05-30T16:41:56.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.597+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38bc0b2050 con 0x7f38bc141510 2024-05-30T16:41:56.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.598+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38bc0b3b20 con 0x7f38bc141510 2024-05-30T16:41:56.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.599+0000 7f38b8c00640 1 -- 172.21.15.144:0/3524349944 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38ac01c460 con 0x7f38bc141510 2024-05-30T16:41:56.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.600+0000 7f38b8c00640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f389806c8f0 0x7f389806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:56.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.600+0000 7f38b8c00640 1 -- 172.21.15.144:0/3524349944 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f38ac08b980 con 0x7f38bc141510 2024-05-30T16:41:56.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.601+0000 7f38b3400640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f389806c8f0 0x7f389806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:56.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.601+0000 7f38b3400640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f389806c8f0 0x7f389806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38bc162390 tx=0x7f38a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:56.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.605+0000 7f38b8c00640 1 -- 172.21.15.144:0/3524349944 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38bc0b3b20 con 0x7f38bc141510 2024-05-30T16:41:56.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.841+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38bc068b90 con 0x7f38bc141510 2024-05-30T16:41:56.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.842+0000 7f38b8c00640 1 -- 172.21.15.144:0/3524349944 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f38ac059e40 con 0x7f38bc141510 2024-05-30T16:41:56.844 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:56.844 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3786718549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3786718549},{"type":"v1","addr":"172.21.15.149:6833","nonce":3786718549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/117174447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":117174447},{"type":"v1","addr":"172.21.15.149:6835","nonce":117174447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1743859445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1743859445},{"type":"v1","addr":"172.21.15.144:6836","nonce":1743859445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:41:52.777438+0000","modified":"2024-05-30T16:41:55.840372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-30T16:41:56.844 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-05-30T16:41:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f389806c8f0 msgr2=0x7f389806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f389806c8f0 0x7f389806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38bc162390 tx=0x7f38a4008040 comp rx=0 tx=0).stop 2024-05-30T16:41:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc141510 msgr2=0x7f38bc13e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc141510 0x7f38bc13e150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00c430 tx=0x7f38ac00c8f0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 shutdown_connections 2024-05-30T16:41:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f389806c8f0 0x7f389806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38bc144020 0x7f38bc156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38bc1418f0 0x7f38bc0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 --2- 172.21.15.144:0/3524349944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc141510 0x7f38bc13e150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 >> 172.21.15.144:0/3524349944 conn(0x7f38bc06bd00 msgr2=0x7f38bc06e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 shutdown_connections 2024-05-30T16:41:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:56.845+0000 7f38c3000640 1 -- 172.21.15.144:0/3524349944 wait complete. 2024-05-30T16:41:56.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:41:57.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.049+0000 7f8577c00640 1 Processor -- start 2024-05-30T16:41:57.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.049+0000 7f8577c00640 1 -- start start 2024-05-30T16:41:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.050+0000 7f8577c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8570145150 0x7f85700cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.050+0000 7f8577c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f857006f7e0 0x7f85700b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.050+0000 7f8577c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85700d00f0 con 0x7f85700cfa70 2024-05-30T16:41:57.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.050+0000 7f8577c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f85700cfeb0 con 0x7f8570145150 2024-05-30T16:41:57.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.050+0000 7f8577c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f857015f140 con 0x7f857006f7e0 2024-05-30T16:41:57.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.050+0000 7f8575200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8570145150 0x7f85700cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.051+0000 7f8575200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8570145150 0x7f85700cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58698/0 (socket says 172.21.15.144:58698) 2024-05-30T16:41:57.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.051+0000 7f8575200640 1 -- 172.21.15.144:0/2789591608 learned_addr learned my addr 172.21.15.144:0/2789591608 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.051+0000 7f8575c00640 1 --2- 172.21.15.144:0/2789591608 >> v2:172.21.15.149:3300/0 conn(0x7f857006f7e0 0x7f85700b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.051+0000 7f8575200640 1 -- 172.21.15.144:0/2789591608 >> v2:172.21.15.149:3300/0 conn(0x7f857006f7e0 msgr2=0x7f85700b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.051+0000 7f8575200640 1 --2- 172.21.15.144:0/2789591608 >> v2:172.21.15.149:3300/0 conn(0x7f857006f7e0 0x7f85700b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.051+0000 7f8575200640 1 -- 172.21.15.144:0/2789591608 >> v1:172.21.15.149:6789/0 conn(0x7f85700cfa70 legacy=0x7f857006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.051+0000 7f8575200640 1 -- 172.21.15.144:0/2789591608 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857015f390 con 0x7f8570145150 2024-05-30T16:41:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.051+0000 7f8575c00640 1 --2- 172.21.15.144:0/2789591608 >> v2:172.21.15.149:3300/0 conn(0x7f857006f7e0 0x7f85700b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.052+0000 7f8575200640 1 --2- 172.21.15.144:0/2789591608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8570145150 0x7f85700cf530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f857006fd50 tx=0x7f856402c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe62bc4e0f0d518 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:57.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.052+0000 7f856f400640 1 -- 172.21.15.144:0/2789591608 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564039070 con 0x7f8570145150 2024-05-30T16:41:57.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f856f400640 1 -- 172.21.15.144:0/2789591608 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8564034640 con 0x7f8570145150 2024-05-30T16:41:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f856f400640 1 -- 172.21.15.144:0/2789591608 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564034a10 con 0x7f8570145150 2024-05-30T16:41:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f8577c00640 1 -- 172.21.15.144:0/2789591608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8570145150 msgr2=0x7f85700cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f8577c00640 1 --2- 172.21.15.144:0/2789591608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8570145150 0x7f85700cf530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f857006fd50 tx=0x7f856402c3b0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f8577c00640 1 -- 172.21.15.144:0/2789591608 shutdown_connections 2024-05-30T16:41:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f8577c00640 1 --2- 172.21.15.144:0/2789591608 >> v2:172.21.15.149:3300/0 conn(0x7f857006f7e0 0x7f85700b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f8577c00640 1 --2- 172.21.15.144:0/2789591608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8570145150 0x7f85700cf530 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f8577c00640 1 -- 172.21.15.144:0/2789591608 >> 172.21.15.144:0/2789591608 conn(0x7f857006bd00 msgr2=0x7f857006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f8577c00640 1 -- 172.21.15.144:0/2789591608 shutdown_connections 2024-05-30T16:41:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.053+0000 7f8577c00640 1 -- 172.21.15.144:0/2789591608 wait complete. 2024-05-30T16:41:57.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.055+0000 7f8577c00640 1 Processor -- start 2024-05-30T16:41:57.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.055+0000 7f8577c00640 1 -- start start 2024-05-30T16:41:57.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.056+0000 7f8577c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857006f7e0 0x7f857013e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.056+0000 7f8577c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85700cfa70 0x7f85700b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.056+0000 7f8577c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570145150 0x7f857015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.056+0000 7f8577c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f85700b64f0 con 0x7f85700cfa70 2024-05-30T16:41:57.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.056+0000 7f8577c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f857015f950 con 0x7f857006f7e0 2024-05-30T16:41:57.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.056+0000 7f8577c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f857015fe70 con 0x7f8570145150 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.056+0000 7f856fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85700cfa70 0x7f85700b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.056+0000 7f856fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85700cfa70 0x7f85700b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58708/0 (socket says 172.21.15.144:58708) 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.056+0000 7f856fe00640 1 -- 172.21.15.144:0/2663294180 learned_addr learned my addr 172.21.15.144:0/2663294180 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.057+0000 7f8575200640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857006f7e0 0x7f857013e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.057+0000 7f8575c00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570145150 0x7f857015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.057+0000 7f856fe00640 1 -- 172.21.15.144:0/2663294180 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570145150 msgr2=0x7f857015dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.057+0000 7f856fe00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570145150 0x7f857015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.057+0000 7f856fe00640 1 -- 172.21.15.144:0/2663294180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857006f7e0 msgr2=0x7f857013e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.057+0000 7f856fe00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857006f7e0 0x7f857013e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.057+0000 7f856fe00640 1 -- 172.21.15.144:0/2663294180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570154700 con 0x7f85700cfa70 2024-05-30T16:41:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.057+0000 7f856fe00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85700cfa70 0x7f85700b21f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f855c00c430 tx=0x7f855c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.057+0000 7f856cc00640 1 -- 172.21.15.144:0/2663294180 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c011790 con 0x7f85700cfa70 2024-05-30T16:41:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.058+0000 7f856cc00640 1 -- 172.21.15.144:0/2663294180 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855c017070 con 0x7f85700cfa70 2024-05-30T16:41:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.058+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85700b1230 con 0x7f85700cfa70 2024-05-30T16:41:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.058+0000 7f856cc00640 1 -- 172.21.15.144:0/2663294180 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c011bb0 con 0x7f85700cfa70 2024-05-30T16:41:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.058+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85700b17f0 con 0x7f85700cfa70 2024-05-30T16:41:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.059+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8570068b90 con 0x7f85700cfa70 2024-05-30T16:41:57.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.061+0000 7f856cc00640 1 -- 172.21.15.144:0/2663294180 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f855c01c460 con 0x7f85700cfa70 2024-05-30T16:41:57.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.061+0000 7f856cc00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f855006c8f0 0x7f855006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.062+0000 7f856cc00640 1 -- 172.21.15.144:0/2663294180 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f855c08bb20 con 0x7f85700cfa70 2024-05-30T16:41:57.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.062+0000 7f8575200640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f855006c8f0 0x7f855006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.063+0000 7f8575200640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f855006c8f0 0x7f855006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8564036000 tx=0x7f8564030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:57.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.066+0000 7f856cc00640 1 -- 172.21.15.144:0/2663294180 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f855c059e20 con 0x7f85700cfa70 2024-05-30T16:41:57.262 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-05-30T16:41:57.261+0000 7f5558000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:41:57.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.272+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85701448b0 con 0x7f85700cfa70 2024-05-30T16:41:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.275+0000 7f856cc00640 1 -- 172.21.15.144:0/2663294180 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f855c059720 con 0x7f85700cfa70 2024-05-30T16:41:57.276 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:57.276 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:54.340246+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:41:50.922058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:41:51.739937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:41:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f855006c8f0 msgr2=0x7f855006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f855006c8f0 0x7f855006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8564036000 tx=0x7f8564030000 comp rx=0 tx=0).stop 2024-05-30T16:41:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85700cfa70 msgr2=0x7f85700b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85700cfa70 0x7f85700b21f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f855c00c430 tx=0x7f855c00c8f0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 shutdown_connections 2024-05-30T16:41:57.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f855006c8f0 0x7f855006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570145150 0x7f857015dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85700cfa70 0x7f85700b21f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 --2- 172.21.15.144:0/2663294180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f857006f7e0 0x7f857013e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 >> 172.21.15.144:0/2663294180 conn(0x7f857006bd00 msgr2=0x7f8570143830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:57.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 shutdown_connections 2024-05-30T16:41:57.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.278+0000 7f8577c00640 1 -- 172.21.15.144:0/2663294180 wait complete. 2024-05-30T16:41:57.305 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:41:57.305 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:41:57.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.485+0000 7f34e3000640 1 Processor -- start 2024-05-30T16:41:57.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.485+0000 7f34e3000640 1 -- start start 2024-05-30T16:41:57.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.487+0000 7f34e3000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f34dc0ba090 0x7f34dc0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.487+0000 7f34e3000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34dc0cfa10 0x7f34dc0d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.487+0000 7f34e3000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34dc15ed40 con 0x7f34dc15e960 2024-05-30T16:41:57.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.487+0000 7f34e3000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f34dc0d2b40 con 0x7f34dc0ba090 2024-05-30T16:41:57.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.487+0000 7f34e3000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34dc162ca0 con 0x7f34dc0cfa10 2024-05-30T16:41:57.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.487+0000 7f34e1c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f34dc15e960 0x7f34dc162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54650/0 (socket says 172.21.15.144:54650) 2024-05-30T16:41:57.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.487+0000 7f34e1c00640 1 -- 172.21.15.144:0/4018196730 learned_addr learned my addr 172.21.15.144:0/4018196730 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:57.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871836830 0 0) 0x7f34dc15ed40 con 0x7f34dc15e960 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34e2600640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34dc0cfa10 0x7f34dc0d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c4003520 con 0x7f34dc15e960 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34e1200640 1 --2- 172.21.15.144:0/4018196730 >> v2:172.21.15.149:3300/0 conn(0x7f34dc0ba090 0x7f34dc0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3474405847 0 0) 0x7f34c4003520 con 0x7f34dc15e960 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34dc0cfa10 msgr2=0x7f34dc0d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34dc0cfa10 0x7f34dc0d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 >> v2:172.21.15.149:3300/0 conn(0x7f34dc0ba090 msgr2=0x7f34dc0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 --2- 172.21.15.144:0/4018196730 >> v2:172.21.15.149:3300/0 conn(0x7f34dc0ba090 0x7f34dc0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc162f80 con 0x7f34dc15e960 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f34d0001670 con 0x7f34dc15e960 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34e1200640 1 --2- 172.21.15.144:0/4018196730 >> v2:172.21.15.149:3300/0 conn(0x7f34dc0ba090 0x7f34dc0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 >> v1:172.21.15.144:6789/0 conn(0x7f34dc15e960 legacy=0x7f34dc162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34dc0cfa10 0x7f34c40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c4003f30 0x7f34c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c4004d40 0x7f34c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc0d2b40 con 0x7f34c4004d40 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc162ca0 con 0x7f34c4003f30 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34c400ba10 con 0x7f34dc0cfa10 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.488+0000 7f34e2600640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c4004d40 0x7f34c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.489+0000 7f34e1200640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c4003f30 0x7f34c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.489+0000 7f34e2600640 1 -- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34dc0cfa10 msgr2=0x7f34c40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.489+0000 7f34e1c00640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34dc0cfa10 0x7f34c40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.489+0000 7f34e2600640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34dc0cfa10 0x7f34c40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.489+0000 7f34e2600640 1 -- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c4003f30 msgr2=0x7f34c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.489+0000 7f34e2600640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c4003f30 0x7f34c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.489+0000 7f34e2600640 1 -- 172.21.15.144:0/4018196730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c4003520 con 0x7f34c4004d40 2024-05-30T16:41:57.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.489+0000 7f34e1c00640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34dc0cfa10 0x7f34c40039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.490+0000 7f34e2600640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c4004d40 0x7f34c40051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009fc0 tx=0x7f34c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8243816132ba5a33 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.490+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4009c10 con 0x7f34c4004d40 2024-05-30T16:41:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.490+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4036070 con 0x7f34c4004d40 2024-05-30T16:41:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.490+0000 7f34dbe00640 1 -- 172.21.15.144:0/4018196730 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4031880 con 0x7f34c4004d40 2024-05-30T16:41:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.491+0000 7f34e3000640 1 -- 172.21.15.144:0/4018196730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c4004d40 msgr2=0x7f34c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.491+0000 7f34e3000640 1 --2- 172.21.15.144:0/4018196730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c4004d40 0x7f34c40051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009fc0 tx=0x7f34c4005830 comp rx=0 tx=0).stop 2024-05-30T16:41:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.491+0000 7f34e2600640 1 -- 172.21.15.144:0/4018196730 reap_dead start 2024-05-30T16:41:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.491+0000 7f34e3000640 1 -- 172.21.15.144:0/4018196730 shutdown_connections 2024-05-30T16:41:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.491+0000 7f34e3000640 1 -- 172.21.15.144:0/4018196730 >> 172.21.15.144:0/4018196730 conn(0x7f34dc0d1360 msgr2=0x7f34dc0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.491+0000 7f34e3000640 1 -- 172.21.15.144:0/4018196730 shutdown_connections 2024-05-30T16:41:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.491+0000 7f34e3000640 1 -- 172.21.15.144:0/4018196730 wait complete. 2024-05-30T16:41:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.493+0000 7f34e3000640 1 Processor -- start 2024-05-30T16:41:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.493+0000 7f34e3000640 1 -- start start 2024-05-30T16:41:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e3000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c4004d40 0x7f34dc0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e3000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34dc0ce640 0x7f34dc0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e3000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34dc0cd030 0x7f34dc0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e3000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc0b78a0 con 0x7f34dc0cd030 2024-05-30T16:41:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e3000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc0d2d90 con 0x7f34dc0ce640 2024-05-30T16:41:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e3000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34dc0d32b0 con 0x7f34c4004d40 2024-05-30T16:41:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34dc0cd030 0x7f34dc0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34dc0cd030 0x7f34dc0cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58724/0 (socket says 172.21.15.144:58724) 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e2600640 1 -- 172.21.15.144:0/3704395943 learned_addr learned my addr 172.21.15.144:0/3704395943 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e1200640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34dc0ce640 0x7f34dc0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e1c00640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c4004d40 0x7f34dc0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e2600640 1 -- 172.21.15.144:0/3704395943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c4004d40 msgr2=0x7f34dc0ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e2600640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c4004d40 0x7f34dc0ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e2600640 1 -- 172.21.15.144:0/3704395943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34dc0ce640 msgr2=0x7f34dc0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e2600640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34dc0ce640 0x7f34dc0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e2600640 1 -- 172.21.15.144:0/3704395943 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc155e60 con 0x7f34dc0cd030 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.494+0000 7f34e1200640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34dc0ce640 0x7f34dc0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.495+0000 7f34e2600640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34dc0cd030 0x7f34dc0cd480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f34d400e230 tx=0x7f34d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.495+0000 7f34d9600640 1 -- 172.21.15.144:0/3704395943 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4009c10 con 0x7f34dc0cd030 2024-05-30T16:41:57.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.495+0000 7f34d9600640 1 -- 172.21.15.144:0/3704395943 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4031dd0 con 0x7f34dc0cd030 2024-05-30T16:41:57.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.495+0000 7f34d9600640 1 -- 172.21.15.144:0/3704395943 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4003bd0 con 0x7f34dc0cd030 2024-05-30T16:41:57.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.495+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34dc156140 con 0x7f34dc0cd030 2024-05-30T16:41:57.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.495+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34dc156700 con 0x7f34dc0cd030 2024-05-30T16:41:57.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.496+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34dc075570 con 0x7f34dc0cd030 2024-05-30T16:41:57.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.497+0000 7f34d9600640 1 -- 172.21.15.144:0/3704395943 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34d4005d10 con 0x7f34dc0cd030 2024-05-30T16:41:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.499+0000 7f34d9600640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34bc06c8f0 0x7f34bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.499+0000 7f34d9600640 1 -- 172.21.15.144:0/3704395943 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f34d40ac9d0 con 0x7f34dc0cd030 2024-05-30T16:41:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.499+0000 7f34e1c00640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34bc06c8f0 0x7f34bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.500+0000 7f34e1c00640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34bc06c8f0 0x7f34bc06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34d0001840 tx=0x7f34d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:57.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.503+0000 7f34d9600640 1 -- 172.21.15.144:0/3704395943 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34d407adf0 con 0x7f34dc0cd030 2024-05-30T16:41:57.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.699+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34dc0cde70 con 0x7f34bc06c8f0 2024-05-30T16:41:57.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.722+0000 7f34d9600640 1 -- 172.21.15.144:0/3704395943 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f34d000e8c0 con 0x7f34bc06c8f0 2024-05-30T16:41:57.727 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34bc06c8f0 msgr2=0x7f34bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34bc06c8f0 0x7f34bc06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34d0001840 tx=0x7f34d0009040 comp rx=0 tx=0).stop 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34dc0cd030 msgr2=0x7f34dc0cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34dc0cd030 0x7f34dc0cd480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f34d400e230 tx=0x7f34d4009750 comp rx=0 tx=0).stop 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 shutdown_connections 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34bc06c8f0 0x7f34bc06edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34dc0cd030 0x7f34dc0cd480 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34dc0ce640 0x7f34dc0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 --2- 172.21.15.144:0/3704395943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c4004d40 0x7f34dc0ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 >> 172.21.15.144:0/3704395943 conn(0x7f34dc0d1360 msgr2=0x7f34dc0b9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 shutdown_connections 2024-05-30T16:41:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.727+0000 7f34e3000640 1 -- 172.21.15.144:0/3704395943 wait complete. 2024-05-30T16:41:57.747 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-30T16:41:56.893770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2842624,"data_stored":1727828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.595891"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473939+0000","last_change":"2024-05-30T16:41:53.357304+0000","last_active":"2024-05-30T16:41:54.473939+0000","last_peered":"2024-05-30T16:41:54.473939+0000","last_clean":"2024-05-30T16:41:54.473939+0000","last_became_active":"2024-05-30T16:41:53.356937+0000","last_became_peered":"2024-05-30T16:41:53.356937+0000","last_unstale":"2024-05-30T16:41:54.473939+0000","last_undegraded":"2024-05-30T16:41:54.473939+0000","last_fullsized":"2024-05-30T16:41:54.473939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:04.325790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353623+0000","last_change":"2024-05-30T16:41:53.368919+0000","last_active":"2024-05-30T16:41:54.353623+0000","last_peered":"2024-05-30T16:41:54.353623+0000","last_clean":"2024-05-30T16:41:54.353623+0000","last_became_active":"2024-05-30T16:41:53.368598+0000","last_became_peered":"2024-05-30T16:41:53.368598+0000","last_unstale":"2024-05-30T16:41:54.353623+0000","last_undegraded":"2024-05-30T16:41:54.353623+0000","last_fullsized":"2024-05-30T16:41:54.353623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457349+0000","last_change":"2024-05-30T16:41:53.360032+0000","last_active":"2024-05-30T16:41:55.457349+0000","last_peered":"2024-05-30T16:41:55.457349+0000","last_clean":"2024-05-30T16:41:55.457349+0000","last_became_active":"2024-05-30T16:41:53.353909+0000","last_became_peered":"2024-05-30T16:41:53.353909+0000","last_unstale":"2024-05-30T16:41:55.457349+0000","last_undegraded":"2024-05-30T16:41:55.457349+0000","last_fullsized":"2024-05-30T16:41:55.457349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456943+0000","last_change":"2024-05-30T16:41:53.375331+0000","last_active":"2024-05-30T16:41:55.456943+0000","last_peered":"2024-05-30T16:41:55.456943+0000","last_clean":"2024-05-30T16:41:55.456943+0000","last_became_active":"2024-05-30T16:41:53.375049+0000","last_became_peered":"2024-05-30T16:41:53.375049+0000","last_unstale":"2024-05-30T16:41:55.456943+0000","last_undegraded":"2024-05-30T16:41:55.456943+0000","last_fullsized":"2024-05-30T16:41:55.456943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:11.943106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473149+0000","last_change":"2024-05-30T16:41:53.360193+0000","last_active":"2024-05-30T16:41:54.473149+0000","last_peered":"2024-05-30T16:41:54.473149+0000","last_clean":"2024-05-30T16:41:54.473149+0000","last_became_active":"2024-05-30T16:41:53.356390+0000","last_became_peered":"2024-05-30T16:41:53.356390+0000","last_unstale":"2024-05-30T16:41:54.473149+0000","last_undegraded":"2024-05-30T16:41:54.473149+0000","last_fullsized":"2024-05-30T16:41:54.473149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:01:25.890627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456576+0000","last_change":"2024-05-30T16:41:53.363129+0000","last_active":"2024-05-30T16:41:55.456576+0000","last_peered":"2024-05-30T16:41:55.456576+0000","last_clean":"2024-05-30T16:41:55.456576+0000","last_became_active":"2024-05-30T16:41:53.362799+0000","last_became_peered":"2024-05-30T16:41:53.362799+0000","last_unstale":"2024-05-30T16:41:55.456576+0000","last_undegraded":"2024-05-30T16:41:55.456576+0000","last_fullsized":"2024-05-30T16:41:55.456576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472403+0000","last_change":"2024-05-30T16:41:53.354731+0000","last_active":"2024-05-30T16:41:54.472403+0000","last_peered":"2024-05-30T16:41:54.472403+0000","last_clean":"2024-05-30T16:41:54.472403+0000","last_became_active":"2024-05-30T16:41:53.354407+0000","last_became_peered":"2024-05-30T16:41:53.354407+0000","last_unstale":"2024-05-30T16:41:54.472403+0000","last_undegraded":"2024-05-30T16:41:54.472403+0000","last_fullsized":"2024-05-30T16:41:54.472403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:09.648137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457945+0000","last_change":"2024-05-30T16:41:53.364759+0000","last_active":"2024-05-30T16:41:55.457945+0000","last_peered":"2024-05-30T16:41:55.457945+0000","last_clean":"2024-05-30T16:41:55.457945+0000","last_became_active":"2024-05-30T16:41:53.363544+0000","last_became_peered":"2024-05-30T16:41:53.363544+0000","last_unstale":"2024-05-30T16:41:55.457945+0000","last_undegraded":"2024-05-30T16:41:55.457945+0000","last_fullsized":"2024-05-30T16:41:55.457945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473887+0000","last_change":"2024-05-30T16:41:53.361800+0000","last_active":"2024-05-30T16:41:54.473887+0000","last_peered":"2024-05-30T16:41:54.473887+0000","last_clean":"2024-05-30T16:41:54.473887+0000","last_became_active":"2024-05-30T16:41:53.361517+0000","last_became_peered":"2024-05-30T16:41:53.361517+0000","last_unstale":"2024-05-30T16:41:54.473887+0000","last_undegraded":"2024-05-30T16:41:54.473887+0000","last_fullsized":"2024-05-30T16:41:54.473887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:11.893893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359310+0000","last_change":"2024-05-30T16:41:53.357190+0000","last_active":"2024-05-30T16:41:54.359310+0000","last_peered":"2024-05-30T16:41:54.359310+0000","last_clean":"2024-05-30T16:41:54.359310+0000","last_became_active":"2024-05-30T16:41:53.355805+0000","last_became_peered":"2024-05-30T16:41:53.355805+0000","last_unstale":"2024-05-30T16:41:54.359310+0000","last_undegraded":"2024-05-30T16:41:54.359310+0000","last_fullsized":"2024-05-30T16:41:54.359310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358896+0000","last_change":"2024-05-30T16:41:53.362431+0000","last_active":"2024-05-30T16:41:54.358896+0000","last_peered":"2024-05-30T16:41:54.358896+0000","last_clean":"2024-05-30T16:41:54.358896+0000","last_became_active":"2024-05-30T16:41:53.362046+0000","last_became_peered":"2024-05-30T16:41:53.362046+0000","last_unstale":"2024-05-30T16:41:54.358896+0000","last_undegraded":"2024-05-30T16:41:54.358896+0000","last_fullsized":"2024-05-30T16:41:54.358896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358108+0000","last_change":"2024-05-30T16:41:53.365227+0000","last_active":"2024-05-30T16:41:54.358108+0000","last_peered":"2024-05-30T16:41:54.358108+0000","last_clean":"2024-05-30T16:41:54.358108+0000","last_became_active":"2024-05-30T16:41:53.361257+0000","last_became_peered":"2024-05-30T16:41:53.361257+0000","last_unstale":"2024-05-30T16:41:54.358108+0000","last_undegraded":"2024-05-30T16:41:54.358108+0000","last_fullsized":"2024-05-30T16:41:54.358108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:24.316502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459058+0000","last_change":"2024-05-30T16:41:53.363327+0000","last_active":"2024-05-30T16:41:55.459058+0000","last_peered":"2024-05-30T16:41:55.459058+0000","last_clean":"2024-05-30T16:41:55.459058+0000","last_became_active":"2024-05-30T16:41:53.358909+0000","last_became_peered":"2024-05-30T16:41:53.358909+0000","last_unstale":"2024-05-30T16:41:55.459058+0000","last_undegraded":"2024-05-30T16:41:55.459058+0000","last_fullsized":"2024-05-30T16:41:55.459058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456449+0000","last_change":"2024-05-30T16:41:53.349858+0000","last_active":"2024-05-30T16:41:55.456449+0000","last_peered":"2024-05-30T16:41:55.456449+0000","last_clean":"2024-05-30T16:41:55.456449+0000","last_became_active":"2024-05-30T16:41:53.349503+0000","last_became_peered":"2024-05-30T16:41:53.349503+0000","last_unstale":"2024-05-30T16:41:55.456449+0000","last_undegraded":"2024-05-30T16:41:55.456449+0000","last_fullsized":"2024-05-30T16:41:55.456449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:16:19.914867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353871+0000","last_change":"2024-05-30T16:41:53.361644+0000","last_active":"2024-05-30T16:41:54.353871+0000","last_peered":"2024-05-30T16:41:54.353871+0000","last_clean":"2024-05-30T16:41:54.353871+0000","last_became_active":"2024-05-30T16:41:53.361338+0000","last_became_peered":"2024-05-30T16:41:53.361338+0000","last_unstale":"2024-05-30T16:41:54.353871+0000","last_undegraded":"2024-05-30T16:41:54.353871+0000","last_fullsized":"2024-05-30T16:41:54.353871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456639+0000","last_change":"2024-05-30T16:41:53.360331+0000","last_active":"2024-05-30T16:41:55.456639+0000","last_peered":"2024-05-30T16:41:55.456639+0000","last_clean":"2024-05-30T16:41:55.456639+0000","last_became_active":"2024-05-30T16:41:53.359832+0000","last_became_peered":"2024-05-30T16:41:53.359832+0000","last_unstale":"2024-05-30T16:41:55.456639+0000","last_undegraded":"2024-05-30T16:41:55.456639+0000","last_fullsized":"2024-05-30T16:41:55.456639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457756+0000","last_change":"2024-05-30T16:41:53.368792+0000","last_active":"2024-05-30T16:41:55.457756+0000","last_peered":"2024-05-30T16:41:55.457756+0000","last_clean":"2024-05-30T16:41:55.457756+0000","last_became_active":"2024-05-30T16:41:53.368547+0000","last_became_peered":"2024-05-30T16:41:53.368547+0000","last_unstale":"2024-05-30T16:41:55.457756+0000","last_undegraded":"2024-05-30T16:41:55.457756+0000","last_fullsized":"2024-05-30T16:41:55.457756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:37:50.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295237+0000","last_change":"2024-05-30T16:41:53.356728+0000","last_active":"2024-05-30T16:41:55.295237+0000","last_peered":"2024-05-30T16:41:55.295237+0000","last_clean":"2024-05-30T16:41:55.295237+0000","last_became_active":"2024-05-30T16:41:53.356161+0000","last_became_peered":"2024-05-30T16:41:53.356161+0000","last_unstale":"2024-05-30T16:41:55.295237+0000","last_undegraded":"2024-05-30T16:41:55.295237+0000","last_fullsized":"2024-05-30T16:41:55.295237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:24.316502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473885+0000","last_change":"2024-05-30T16:41:53.352155+0000","last_active":"2024-05-30T16:41:54.473885+0000","last_peered":"2024-05-30T16:41:54.473885+0000","last_clean":"2024-05-30T16:41:54.473885+0000","last_became_active":"2024-05-30T16:41:53.348922+0000","last_became_peered":"2024-05-30T16:41:53.348922+0000","last_unstale":"2024-05-30T16:41:54.473885+0000","last_undegraded":"2024-05-30T16:41:54.473885+0000","last_fullsized":"2024-05-30T16:41:54.473885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:05.861936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358757+0000","last_change":"2024-05-30T16:41:53.373040+0000","last_active":"2024-05-30T16:41:54.358757+0000","last_peered":"2024-05-30T16:41:54.358757+0000","last_clean":"2024-05-30T16:41:54.358757+0000","last_became_active":"2024-05-30T16:41:53.372775+0000","last_became_peered":"2024-05-30T16:41:53.372775+0000","last_unstale":"2024-05-30T16:41:54.358757+0000","last_undegraded":"2024-05-30T16:41:54.358757+0000","last_fullsized":"2024-05-30T16:41:54.358757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456552+0000","last_change":"2024-05-30T16:41:53.363158+0000","last_active":"2024-05-30T16:41:55.456552+0000","last_peered":"2024-05-30T16:41:55.456552+0000","last_clean":"2024-05-30T16:41:55.456552+0000","last_became_active":"2024-05-30T16:41:53.362828+0000","last_became_peered":"2024-05-30T16:41:53.362828+0000","last_unstale":"2024-05-30T16:41:55.456552+0000","last_undegraded":"2024-05-30T16:41:55.456552+0000","last_fullsized":"2024-05-30T16:41:55.456552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:52:35.610545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456637+0000","last_change":"2024-05-30T16:41:53.370806+0000","last_active":"2024-05-30T16:41:55.456637+0000","last_peered":"2024-05-30T16:41:55.456637+0000","last_clean":"2024-05-30T16:41:55.456637+0000","last_became_active":"2024-05-30T16:41:53.369787+0000","last_became_peered":"2024-05-30T16:41:53.369787+0000","last_unstale":"2024-05-30T16:41:55.456637+0000","last_undegraded":"2024-05-30T16:41:55.456637+0000","last_fullsized":"2024-05-30T16:41:55.456637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457726+0000","last_change":"2024-05-30T16:41:53.362039+0000","last_active":"2024-05-30T16:41:55.457726+0000","last_peered":"2024-05-30T16:41:55.457726+0000","last_clean":"2024-05-30T16:41:55.457726+0000","last_became_active":"2024-05-30T16:41:53.361725+0000","last_became_peered":"2024-05-30T16:41:53.361725+0000","last_unstale":"2024-05-30T16:41:55.457726+0000","last_undegraded":"2024-05-30T16:41:55.457726+0000","last_fullsized":"2024-05-30T16:41:55.457726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:03.444148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456547+0000","last_change":"2024-05-30T16:41:53.360122+0000","last_active":"2024-05-30T16:41:55.456547+0000","last_peered":"2024-05-30T16:41:55.456547+0000","last_clean":"2024-05-30T16:41:55.456547+0000","last_became_active":"2024-05-30T16:41:53.359414+0000","last_became_peered":"2024-05-30T16:41:53.359414+0000","last_unstale":"2024-05-30T16:41:55.456547+0000","last_undegraded":"2024-05-30T16:41:55.456547+0000","last_fullsized":"2024-05-30T16:41:55.456547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459845+0000","last_change":"2024-05-30T16:41:53.354023+0000","last_active":"2024-05-30T16:41:55.459845+0000","last_peered":"2024-05-30T16:41:55.459845+0000","last_clean":"2024-05-30T16:41:55.459845+0000","last_became_active":"2024-05-30T16:41:53.352390+0000","last_became_peered":"2024-05-30T16:41:53.352390+0000","last_unstale":"2024-05-30T16:41:55.459845+0000","last_undegraded":"2024-05-30T16:41:55.459845+0000","last_fullsized":"2024-05-30T16:41:55.459845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359371+0000","last_change":"2024-05-30T16:41:53.354855+0000","last_active":"2024-05-30T16:41:54.359371+0000","last_peered":"2024-05-30T16:41:54.359371+0000","last_clean":"2024-05-30T16:41:54.359371+0000","last_became_active":"2024-05-30T16:41:53.354564+0000","last_became_peered":"2024-05-30T16:41:53.354564+0000","last_unstale":"2024-05-30T16:41:54.359371+0000","last_undegraded":"2024-05-30T16:41:54.359371+0000","last_fullsized":"2024-05-30T16:41:54.359371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353620+0000","last_change":"2024-05-30T16:41:53.357643+0000","last_active":"2024-05-30T16:41:54.353620+0000","last_peered":"2024-05-30T16:41:54.353620+0000","last_clean":"2024-05-30T16:41:54.353620+0000","last_became_active":"2024-05-30T16:41:53.357364+0000","last_became_peered":"2024-05-30T16:41:53.357364+0000","last_unstale":"2024-05-30T16:41:54.353620+0000","last_undegraded":"2024-05-30T16:41:54.353620+0000","last_fullsized":"2024-05-30T16:41:54.353620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459783+0000","last_change":"2024-05-30T16:41:53.359016+0000","last_active":"2024-05-30T16:41:55.459783+0000","last_peered":"2024-05-30T16:41:55.459783+0000","last_clean":"2024-05-30T16:41:55.459783+0000","last_became_active":"2024-05-30T16:41:53.358647+0000","last_became_peered":"2024-05-30T16:41:53.358647+0000","last_unstale":"2024-05-30T16:41:55.459783+0000","last_undegraded":"2024-05-30T16:41:55.459783+0000","last_fullsized":"2024-05-30T16:41:55.459783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456720+0000","last_change":"2024-05-30T16:41:53.369095+0000","last_active":"2024-05-30T16:41:55.456720+0000","last_peered":"2024-05-30T16:41:55.456720+0000","last_clean":"2024-05-30T16:41:55.456720+0000","last_became_active":"2024-05-30T16:41:53.368747+0000","last_became_peered":"2024-05-30T16:41:53.368747+0000","last_unstale":"2024-05-30T16:41:55.456720+0000","last_undegraded":"2024-05-30T16:41:55.456720+0000","last_fullsized":"2024-05-30T16:41:55.456720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:03.444148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456759+0000","last_change":"2024-05-30T16:41:53.373107+0000","last_active":"2024-05-30T16:41:55.456759+0000","last_peered":"2024-05-30T16:41:55.456759+0000","last_clean":"2024-05-30T16:41:55.456759+0000","last_became_active":"2024-05-30T16:41:53.372856+0000","last_became_peered":"2024-05-30T16:41:53.372856+0000","last_unstale":"2024-05-30T16:41:55.456759+0000","last_undegraded":"2024-05-30T16:41:55.456759+0000","last_fullsized":"2024-05-30T16:41:55.456759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295310+0000","last_change":"2024-05-30T16:41:53.357024+0000","last_active":"2024-05-30T16:41:55.295310+0000","last_peered":"2024-05-30T16:41:55.295310+0000","last_clean":"2024-05-30T16:41:55.295310+0000","last_became_active":"2024-05-30T16:41:53.355547+0000","last_became_peered":"2024-05-30T16:41:53.355547+0000","last_unstale":"2024-05-30T16:41:55.295310+0000","last_undegraded":"2024-05-30T16:41:55.295310+0000","last_fullsized":"2024-05-30T16:41:55.295310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:17.807528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357938+0000","last_change":"2024-05-30T16:41:53.358603+0000","last_active":"2024-05-30T16:41:54.357938+0000","last_peered":"2024-05-30T16:41:54.357938+0000","last_clean":"2024-05-30T16:41:54.357938+0000","last_became_active":"2024-05-30T16:41:53.357790+0000","last_became_peered":"2024-05-30T16:41:53.357790+0000","last_unstale":"2024-05-30T16:41:54.357938+0000","last_undegraded":"2024-05-30T16:41:54.357938+0000","last_fullsized":"2024-05-30T16:41:54.357938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357689+0000","last_change":"2024-05-30T16:41:53.352211+0000","last_active":"2024-05-30T16:41:54.357689+0000","last_peered":"2024-05-30T16:41:54.357689+0000","last_clean":"2024-05-30T16:41:54.357689+0000","last_became_active":"2024-05-30T16:41:53.351432+0000","last_became_peered":"2024-05-30T16:41:53.351432+0000","last_unstale":"2024-05-30T16:41:54.357689+0000","last_undegraded":"2024-05-30T16:41:54.357689+0000","last_fullsized":"2024-05-30T16:41:54.357689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:03.931858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459368+0000","last_change":"2024-05-30T16:41:52.337016+0000","last_active":"2024-05-30T16:41:55.459368+0000","last_peered":"2024-05-30T16:41:55.459368+0000","last_clean":"2024-05-30T16:41:55.459368+0000","last_became_active":"2024-05-30T16:41:52.336681+0000","last_became_peered":"2024-05-30T16:41:52.336681+0000","last_unstale":"2024-05-30T16:41:55.459368+0000","last_undegraded":"2024-05-30T16:41:55.459368+0000","last_fullsized":"2024-05-30T16:41:55.459368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:31.649153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456897+0000","last_change":"2024-05-30T16:41:53.368959+0000","last_active":"2024-05-30T16:41:55.456897+0000","last_peered":"2024-05-30T16:41:55.456897+0000","last_clean":"2024-05-30T16:41:55.456897+0000","last_became_active":"2024-05-30T16:41:53.368153+0000","last_became_peered":"2024-05-30T16:41:53.368153+0000","last_unstale":"2024-05-30T16:41:55.456897+0000","last_undegraded":"2024-05-30T16:41:55.456897+0000","last_fullsized":"2024-05-30T16:41:55.456897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358440+0000","last_change":"2024-05-30T16:41:52.332967+0000","last_active":"2024-05-30T16:41:54.358440+0000","last_peered":"2024-05-30T16:41:54.358440+0000","last_clean":"2024-05-30T16:41:54.358440+0000","last_became_active":"2024-05-30T16:41:52.331825+0000","last_became_peered":"2024-05-30T16:41:52.331825+0000","last_unstale":"2024-05-30T16:41:54.358440+0000","last_undegraded":"2024-05-30T16:41:54.358440+0000","last_fullsized":"2024-05-30T16:41:54.358440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457891+0000","last_change":"2024-05-30T16:41:52.336306+0000","last_active":"2024-05-30T16:41:55.457891+0000","last_peered":"2024-05-30T16:41:55.457891+0000","last_clean":"2024-05-30T16:41:55.457891+0000","last_became_active":"2024-05-30T16:41:52.336007+0000","last_became_peered":"2024-05-30T16:41:52.336007+0000","last_unstale":"2024-05-30T16:41:55.457891+0000","last_undegraded":"2024-05-30T16:41:55.457891+0000","last_fullsized":"2024-05-30T16:41:55.457891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:49.630008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458336+0000","last_change":"2024-05-30T16:41:53.363846+0000","last_active":"2024-05-30T16:41:55.458336+0000","last_peered":"2024-05-30T16:41:55.458336+0000","last_clean":"2024-05-30T16:41:55.458336+0000","last_became_active":"2024-05-30T16:41:53.362819+0000","last_became_peered":"2024-05-30T16:41:53.362819+0000","last_unstale":"2024-05-30T16:41:55.458336+0000","last_undegraded":"2024-05-30T16:41:55.458336+0000","last_fullsized":"2024-05-30T16:41:55.458336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456693+0000","last_change":"2024-05-30T16:41:52.336486+0000","last_active":"2024-05-30T16:41:55.456693+0000","last_peered":"2024-05-30T16:41:55.456693+0000","last_clean":"2024-05-30T16:41:55.456693+0000","last_became_active":"2024-05-30T16:41:52.336188+0000","last_became_peered":"2024-05-30T16:41:52.336188+0000","last_unstale":"2024-05-30T16:41:55.456693+0000","last_undegraded":"2024-05-30T16:41:55.456693+0000","last_fullsized":"2024-05-30T16:41:55.456693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353589+0000","last_change":"2024-05-30T16:41:53.356908+0000","last_active":"2024-05-30T16:41:54.353589+0000","last_peered":"2024-05-30T16:41:54.353589+0000","last_clean":"2024-05-30T16:41:54.353589+0000","last_became_active":"2024-05-30T16:41:53.356604+0000","last_became_peered":"2024-05-30T16:41:53.356604+0000","last_unstale":"2024-05-30T16:41:54.353589+0000","last_undegraded":"2024-05-30T16:41:54.353589+0000","last_fullsized":"2024-05-30T16:41:54.353589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359167+0000","last_change":"2024-05-30T16:41:52.340551+0000","last_active":"2024-05-30T16:41:54.359167+0000","last_peered":"2024-05-30T16:41:54.359167+0000","last_clean":"2024-05-30T16:41:54.359167+0000","last_became_active":"2024-05-30T16:41:52.340249+0000","last_became_peered":"2024-05-30T16:41:52.340249+0000","last_unstale":"2024-05-30T16:41:54.359167+0000","last_undegraded":"2024-05-30T16:41:54.359167+0000","last_fullsized":"2024-05-30T16:41:54.359167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457084+0000","last_change":"2024-05-30T16:41:53.366735+0000","last_active":"2024-05-30T16:41:55.457084+0000","last_peered":"2024-05-30T16:41:55.457084+0000","last_clean":"2024-05-30T16:41:55.457084+0000","last_became_active":"2024-05-30T16:41:53.362673+0000","last_became_peered":"2024-05-30T16:41:53.362673+0000","last_unstale":"2024-05-30T16:41:55.457084+0000","last_undegraded":"2024-05-30T16:41:55.457084+0000","last_fullsized":"2024-05-30T16:41:55.457084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:20:22.765092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457368+0000","last_change":"2024-05-30T16:41:52.343438+0000","last_active":"2024-05-30T16:41:55.457368+0000","last_peered":"2024-05-30T16:41:55.457368+0000","last_clean":"2024-05-30T16:41:55.457368+0000","last_became_active":"2024-05-30T16:41:52.342914+0000","last_became_peered":"2024-05-30T16:41:52.342914+0000","last_unstale":"2024-05-30T16:41:55.457368+0000","last_undegraded":"2024-05-30T16:41:55.457368+0000","last_fullsized":"2024-05-30T16:41:55.457368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457494+0000","last_change":"2024-05-30T16:41:53.362708+0000","last_active":"2024-05-30T16:41:55.457494+0000","last_peered":"2024-05-30T16:41:55.457494+0000","last_clean":"2024-05-30T16:41:55.457494+0000","last_became_active":"2024-05-30T16:41:53.362383+0000","last_became_peered":"2024-05-30T16:41:53.362383+0000","last_unstale":"2024-05-30T16:41:55.457494+0000","last_undegraded":"2024-05-30T16:41:55.457494+0000","last_fullsized":"2024-05-30T16:41:55.457494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353856+0000","last_change":"2024-05-30T16:41:52.340849+0000","last_active":"2024-05-30T16:41:54.353856+0000","last_peered":"2024-05-30T16:41:54.353856+0000","last_clean":"2024-05-30T16:41:54.353856+0000","last_became_active":"2024-05-30T16:41:52.340475+0000","last_became_peered":"2024-05-30T16:41:52.340475+0000","last_unstale":"2024-05-30T16:41:54.353856+0000","last_undegraded":"2024-05-30T16:41:54.353856+0000","last_fullsized":"2024-05-30T16:41:54.353856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358021+0000","last_change":"2024-05-30T16:41:53.363781+0000","last_active":"2024-05-30T16:41:54.358021+0000","last_peered":"2024-05-30T16:41:54.358021+0000","last_clean":"2024-05-30T16:41:54.358021+0000","last_became_active":"2024-05-30T16:41:53.353193+0000","last_became_peered":"2024-05-30T16:41:53.353193+0000","last_unstale":"2024-05-30T16:41:54.358021+0000","last_undegraded":"2024-05-30T16:41:54.358021+0000","last_fullsized":"2024-05-30T16:41:54.358021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:50.511215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359109+0000","last_change":"2024-05-30T16:41:52.334473+0000","last_active":"2024-05-30T16:41:54.359109+0000","last_peered":"2024-05-30T16:41:54.359109+0000","last_clean":"2024-05-30T16:41:54.359109+0000","last_became_active":"2024-05-30T16:41:52.333867+0000","last_became_peered":"2024-05-30T16:41:52.333867+0000","last_unstale":"2024-05-30T16:41:54.359109+0000","last_undegraded":"2024-05-30T16:41:54.359109+0000","last_fullsized":"2024-05-30T16:41:54.359109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473028+0000","last_change":"2024-05-30T16:41:53.359385+0000","last_active":"2024-05-30T16:41:54.473028+0000","last_peered":"2024-05-30T16:41:54.473028+0000","last_clean":"2024-05-30T16:41:54.473028+0000","last_became_active":"2024-05-30T16:41:53.356569+0000","last_became_peered":"2024-05-30T16:41:53.356569+0000","last_unstale":"2024-05-30T16:41:54.473028+0000","last_undegraded":"2024-05-30T16:41:54.473028+0000","last_fullsized":"2024-05-30T16:41:54.473028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:37:50.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457082+0000","last_change":"2024-05-30T16:41:52.334576+0000","last_active":"2024-05-30T16:41:55.457082+0000","last_peered":"2024-05-30T16:41:55.457082+0000","last_clean":"2024-05-30T16:41:55.457082+0000","last_became_active":"2024-05-30T16:41:52.334243+0000","last_became_peered":"2024-05-30T16:41:52.334243+0000","last_unstale":"2024-05-30T16:41:55.457082+0000","last_undegraded":"2024-05-30T16:41:55.457082+0000","last_fullsized":"2024-05-30T16:41:55.457082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:31.649153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456742+0000","last_change":"2024-05-30T16:41:53.363700+0000","last_active":"2024-05-30T16:41:55.456742+0000","last_peered":"2024-05-30T16:41:55.456742+0000","last_clean":"2024-05-30T16:41:55.456742+0000","last_became_active":"2024-05-30T16:41:53.363109+0000","last_became_peered":"2024-05-30T16:41:53.363109+0000","last_unstale":"2024-05-30T16:41:55.456742+0000","last_undegraded":"2024-05-30T16:41:55.456742+0000","last_fullsized":"2024-05-30T16:41:55.456742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456745+0000","last_change":"2024-05-30T16:41:52.337819+0000","last_active":"2024-05-30T16:41:55.456745+0000","last_peered":"2024-05-30T16:41:55.456745+0000","last_clean":"2024-05-30T16:41:55.456745+0000","last_became_active":"2024-05-30T16:41:52.337487+0000","last_became_peered":"2024-05-30T16:41:52.337487+0000","last_unstale":"2024-05-30T16:41:55.456745+0000","last_undegraded":"2024-05-30T16:41:55.456745+0000","last_fullsized":"2024-05-30T16:41:55.456745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473171+0000","last_change":"2024-05-30T16:41:53.353545+0000","last_active":"2024-05-30T16:41:54.473171+0000","last_peered":"2024-05-30T16:41:54.473171+0000","last_clean":"2024-05-30T16:41:54.473171+0000","last_became_active":"2024-05-30T16:41:53.353247+0000","last_became_peered":"2024-05-30T16:41:53.353247+0000","last_unstale":"2024-05-30T16:41:54.473171+0000","last_undegraded":"2024-05-30T16:41:54.473171+0000","last_fullsized":"2024-05-30T16:41:54.473171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:12:07.999320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357907+0000","last_change":"2024-05-30T16:41:52.328980+0000","last_active":"2024-05-30T16:41:54.357907+0000","last_peered":"2024-05-30T16:41:54.357907+0000","last_clean":"2024-05-30T16:41:54.357907+0000","last_became_active":"2024-05-30T16:41:52.328652+0000","last_became_peered":"2024-05-30T16:41:52.328652+0000","last_unstale":"2024-05-30T16:41:54.357907+0000","last_undegraded":"2024-05-30T16:41:54.357907+0000","last_fullsized":"2024-05-30T16:41:54.357907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:23.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357940+0000","last_change":"2024-05-30T16:41:53.358880+0000","last_active":"2024-05-30T16:41:54.357940+0000","last_peered":"2024-05-30T16:41:54.357940+0000","last_clean":"2024-05-30T16:41:54.357940+0000","last_became_active":"2024-05-30T16:41:53.358285+0000","last_became_peered":"2024-05-30T16:41:53.358285+0000","last_unstale":"2024-05-30T16:41:54.357940+0000","last_undegraded":"2024-05-30T16:41:54.357940+0000","last_fullsized":"2024-05-30T16:41:54.357940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.294851+0000","last_change":"2024-05-30T16:41:52.328717+0000","last_active":"2024-05-30T16:41:55.294851+0000","last_peered":"2024-05-30T16:41:55.294851+0000","last_clean":"2024-05-30T16:41:55.294851+0000","last_became_active":"2024-05-30T16:41:52.328423+0000","last_became_peered":"2024-05-30T16:41:52.328423+0000","last_unstale":"2024-05-30T16:41:55.294851+0000","last_undegraded":"2024-05-30T16:41:55.294851+0000","last_fullsized":"2024-05-30T16:41:55.294851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:49.630008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472391+0000","last_change":"2024-05-30T16:41:53.341566+0000","last_active":"2024-05-30T16:41:54.472391+0000","last_peered":"2024-05-30T16:41:54.472391+0000","last_clean":"2024-05-30T16:41:54.472391+0000","last_became_active":"2024-05-30T16:41:53.341079+0000","last_became_peered":"2024-05-30T16:41:53.341079+0000","last_unstale":"2024-05-30T16:41:54.472391+0000","last_undegraded":"2024-05-30T16:41:54.472391+0000","last_fullsized":"2024-05-30T16:41:54.472391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:45.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358659+0000","last_change":"2024-05-30T16:41:52.332813+0000","last_active":"2024-05-30T16:41:54.358659+0000","last_peered":"2024-05-30T16:41:54.358659+0000","last_clean":"2024-05-30T16:41:54.358659+0000","last_became_active":"2024-05-30T16:41:52.332521+0000","last_became_peered":"2024-05-30T16:41:52.332521+0000","last_unstale":"2024-05-30T16:41:54.358659+0000","last_undegraded":"2024-05-30T16:41:54.358659+0000","last_fullsized":"2024-05-30T16:41:54.358659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:22.977875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473787+0000","last_change":"2024-05-30T16:41:53.344857+0000","last_active":"2024-05-30T16:41:54.473787+0000","last_peered":"2024-05-30T16:41:54.473787+0000","last_clean":"2024-05-30T16:41:54.473787+0000","last_became_active":"2024-05-30T16:41:53.344411+0000","last_became_peered":"2024-05-30T16:41:53.344411+0000","last_unstale":"2024-05-30T16:41:54.473787+0000","last_undegraded":"2024-05-30T16:41:54.473787+0000","last_fullsized":"2024-05-30T16:41:54.473787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:52.685260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295183+0000","last_change":"2024-05-30T16:41:52.325985+0000","last_active":"2024-05-30T16:41:55.295183+0000","last_peered":"2024-05-30T16:41:55.295183+0000","last_clean":"2024-05-30T16:41:55.295183+0000","last_became_active":"2024-05-30T16:41:52.324383+0000","last_became_peered":"2024-05-30T16:41:52.324383+0000","last_unstale":"2024-05-30T16:41:55.295183+0000","last_undegraded":"2024-05-30T16:41:55.295183+0000","last_fullsized":"2024-05-30T16:41:55.295183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.474204+0000","last_change":"2024-05-30T16:41:53.353421+0000","last_active":"2024-05-30T16:41:54.474204+0000","last_peered":"2024-05-30T16:41:54.474204+0000","last_clean":"2024-05-30T16:41:54.474204+0000","last_became_active":"2024-05-30T16:41:53.353121+0000","last_became_peered":"2024-05-30T16:41:53.353121+0000","last_unstale":"2024-05-30T16:41:54.474204+0000","last_undegraded":"2024-05-30T16:41:54.474204+0000","last_fullsized":"2024-05-30T16:41:54.474204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:04.081864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.354077+0000","last_change":"2024-05-30T16:41:52.338368+0000","last_active":"2024-05-30T16:41:54.354077+0000","last_peered":"2024-05-30T16:41:54.354077+0000","last_clean":"2024-05-30T16:41:54.354077+0000","last_became_active":"2024-05-30T16:41:52.338036+0000","last_became_peered":"2024-05-30T16:41:52.338036+0000","last_unstale":"2024-05-30T16:41:54.354077+0000","last_undegraded":"2024-05-30T16:41:54.354077+0000","last_fullsized":"2024-05-30T16:41:54.354077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:49.498732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457474+0000","last_change":"2024-05-30T16:41:53.375844+0000","last_active":"2024-05-30T16:41:55.457474+0000","last_peered":"2024-05-30T16:41:55.457474+0000","last_clean":"2024-05-30T16:41:55.457474+0000","last_became_active":"2024-05-30T16:41:53.375574+0000","last_became_peered":"2024-05-30T16:41:53.375574+0000","last_unstale":"2024-05-30T16:41:55.457474+0000","last_undegraded":"2024-05-30T16:41:55.457474+0000","last_fullsized":"2024-05-30T16:41:55.457474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:09.648137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295130+0000","last_change":"2024-05-30T16:41:52.340534+0000","last_active":"2024-05-30T16:41:55.295130+0000","last_peered":"2024-05-30T16:41:55.295130+0000","last_clean":"2024-05-30T16:41:55.295130+0000","last_became_active":"2024-05-30T16:41:52.340157+0000","last_became_peered":"2024-05-30T16:41:52.340157+0000","last_unstale":"2024-05-30T16:41:55.295130+0000","last_undegraded":"2024-05-30T16:41:55.295130+0000","last_fullsized":"2024-05-30T16:41:55.295130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473453+0000","last_change":"2024-05-30T16:41:53.361217+0000","last_active":"2024-05-30T16:41:54.473453+0000","last_peered":"2024-05-30T16:41:54.473453+0000","last_clean":"2024-05-30T16:41:54.473453+0000","last_became_active":"2024-05-30T16:41:53.360593+0000","last_became_peered":"2024-05-30T16:41:53.360593+0000","last_unstale":"2024-05-30T16:41:54.473453+0000","last_undegraded":"2024-05-30T16:41:54.473453+0000","last_fullsized":"2024-05-30T16:41:54.473453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:56:37.884273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472880+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:41:54.472880+0000","last_peered":"2024-05-30T16:41:54.472880+0000","last_clean":"2024-05-30T16:41:54.472880+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:41:54.472880+0000","last_undegraded":"2024-05-30T16:41:54.472880+0000","last_fullsized":"2024-05-30T16:41:54.472880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456903+0000","last_change":"2024-05-30T16:41:52.336314+0000","last_active":"2024-05-30T16:41:55.456903+0000","last_peered":"2024-05-30T16:41:55.456903+0000","last_clean":"2024-05-30T16:41:55.456903+0000","last_became_active":"2024-05-30T16:41:52.335990+0000","last_became_peered":"2024-05-30T16:41:52.335990+0000","last_unstale":"2024-05-30T16:41:55.456903+0000","last_undegraded":"2024-05-30T16:41:55.456903+0000","last_fullsized":"2024-05-30T16:41:55.456903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458465+0000","last_change":"2024-05-30T16:41:53.363616+0000","last_active":"2024-05-30T16:41:55.458465+0000","last_peered":"2024-05-30T16:41:55.458465+0000","last_clean":"2024-05-30T16:41:55.458465+0000","last_became_active":"2024-05-30T16:41:53.363275+0000","last_became_peered":"2024-05-30T16:41:53.363275+0000","last_unstale":"2024-05-30T16:41:55.458465+0000","last_undegraded":"2024-05-30T16:41:55.458465+0000","last_fullsized":"2024-05-30T16:41:55.458465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472306+0000","last_change":"2024-05-30T16:41:52.342846+0000","last_active":"2024-05-30T16:41:54.472306+0000","last_peered":"2024-05-30T16:41:54.472306+0000","last_clean":"2024-05-30T16:41:54.472306+0000","last_became_active":"2024-05-30T16:41:52.342435+0000","last_became_peered":"2024-05-30T16:41:52.342435+0000","last_unstale":"2024-05-30T16:41:54.472306+0000","last_undegraded":"2024-05-30T16:41:54.472306+0000","last_fullsized":"2024-05-30T16:41:54.472306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:12:46.572059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456543+0000","last_change":"2024-05-30T16:41:53.369256+0000","last_active":"2024-05-30T16:41:55.456543+0000","last_peered":"2024-05-30T16:41:55.456543+0000","last_clean":"2024-05-30T16:41:55.456543+0000","last_became_active":"2024-05-30T16:41:53.368938+0000","last_became_peered":"2024-05-30T16:41:53.368938+0000","last_unstale":"2024-05-30T16:41:55.456543+0000","last_undegraded":"2024-05-30T16:41:55.456543+0000","last_fullsized":"2024-05-30T16:41:55.456543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:11:06.050717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295411+0000","last_change":"2024-05-30T16:41:52.326607+0000","last_active":"2024-05-30T16:41:55.295411+0000","last_peered":"2024-05-30T16:41:55.295411+0000","last_clean":"2024-05-30T16:41:55.295411+0000","last_became_active":"2024-05-30T16:41:52.326202+0000","last_became_peered":"2024-05-30T16:41:52.326202+0000","last_unstale":"2024-05-30T16:41:55.295411+0000","last_undegraded":"2024-05-30T16:41:55.295411+0000","last_fullsized":"2024-05-30T16:41:55.295411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353720+0000","last_change":"2024-05-30T16:41:53.354056+0000","last_active":"2024-05-30T16:41:54.353720+0000","last_peered":"2024-05-30T16:41:54.353720+0000","last_clean":"2024-05-30T16:41:54.353720+0000","last_became_active":"2024-05-30T16:41:53.353806+0000","last_became_peered":"2024-05-30T16:41:53.353806+0000","last_unstale":"2024-05-30T16:41:54.353720+0000","last_undegraded":"2024-05-30T16:41:54.353720+0000","last_fullsized":"2024-05-30T16:41:54.353720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456837+0000","last_change":"2024-05-30T16:41:52.341003+0000","last_active":"2024-05-30T16:41:55.456837+0000","last_peered":"2024-05-30T16:41:55.456837+0000","last_clean":"2024-05-30T16:41:55.456837+0000","last_became_active":"2024-05-30T16:41:52.340199+0000","last_became_peered":"2024-05-30T16:41:52.340199+0000","last_unstale":"2024-05-30T16:41:55.456837+0000","last_undegraded":"2024-05-30T16:41:55.456837+0000","last_fullsized":"2024-05-30T16:41:55.456837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357559+0000","last_change":"2024-05-30T16:41:53.363426+0000","last_active":"2024-05-30T16:41:54.357559+0000","last_peered":"2024-05-30T16:41:54.357559+0000","last_clean":"2024-05-30T16:41:54.357559+0000","last_became_active":"2024-05-30T16:41:53.363167+0000","last_became_peered":"2024-05-30T16:41:53.363167+0000","last_unstale":"2024-05-30T16:41:54.357559+0000","last_undegraded":"2024-05-30T16:41:54.357559+0000","last_fullsized":"2024-05-30T16:41:54.357559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:26.300947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353566+0000","last_change":"2024-05-30T16:41:52.335162+0000","last_active":"2024-05-30T16:41:54.353566+0000","last_peered":"2024-05-30T16:41:54.353566+0000","last_clean":"2024-05-30T16:41:54.353566+0000","last_became_active":"2024-05-30T16:41:52.334870+0000","last_became_peered":"2024-05-30T16:41:52.334870+0000","last_unstale":"2024-05-30T16:41:54.353566+0000","last_undegraded":"2024-05-30T16:41:54.353566+0000","last_fullsized":"2024-05-30T16:41:54.353566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457197+0000","last_change":"2024-05-30T16:41:53.374678+0000","last_active":"2024-05-30T16:41:55.457197+0000","last_peered":"2024-05-30T16:41:55.457197+0000","last_clean":"2024-05-30T16:41:55.457197+0000","last_became_active":"2024-05-30T16:41:53.374417+0000","last_became_peered":"2024-05-30T16:41:53.374417+0000","last_unstale":"2024-05-30T16:41:55.457197+0000","last_undegraded":"2024-05-30T16:41:55.457197+0000","last_fullsized":"2024-05-30T16:41:55.457197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:45.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473652+0000","last_change":"2024-05-30T16:41:52.345422+0000","last_active":"2024-05-30T16:41:54.473652+0000","last_peered":"2024-05-30T16:41:54.473652+0000","last_clean":"2024-05-30T16:41:54.473652+0000","last_became_active":"2024-05-30T16:41:52.345025+0000","last_became_peered":"2024-05-30T16:41:52.345025+0000","last_unstale":"2024-05-30T16:41:54.473652+0000","last_undegraded":"2024-05-30T16:41:54.473652+0000","last_fullsized":"2024-05-30T16:41:54.473652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:55.167706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353496+0000","last_change":"2024-05-30T16:41:53.354570+0000","last_active":"2024-05-30T16:41:54.353496+0000","last_peered":"2024-05-30T16:41:54.353496+0000","last_clean":"2024-05-30T16:41:54.353496+0000","last_became_active":"2024-05-30T16:41:53.353658+0000","last_became_peered":"2024-05-30T16:41:53.353658+0000","last_unstale":"2024-05-30T16:41:54.353496+0000","last_undegraded":"2024-05-30T16:41:54.353496+0000","last_fullsized":"2024-05-30T16:41:54.353496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.365566+0000","last_change":"2024-05-30T16:41:52.335427+0000","last_active":"2024-05-30T16:41:54.365566+0000","last_peered":"2024-05-30T16:41:54.365566+0000","last_clean":"2024-05-30T16:41:54.365566+0000","last_became_active":"2024-05-30T16:41:52.334938+0000","last_became_peered":"2024-05-30T16:41:52.334938+0000","last_unstale":"2024-05-30T16:41:54.365566+0000","last_undegraded":"2024-05-30T16:41:54.365566+0000","last_fullsized":"2024-05-30T16:41:54.365566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459967+0000","last_change":"2024-05-30T16:41:53.350035+0000","last_active":"2024-05-30T16:41:55.459967+0000","last_peered":"2024-05-30T16:41:55.459967+0000","last_clean":"2024-05-30T16:41:55.459967+0000","last_became_active":"2024-05-30T16:41:53.349514+0000","last_became_peered":"2024-05-30T16:41:53.349514+0000","last_unstale":"2024-05-30T16:41:55.459967+0000","last_undegraded":"2024-05-30T16:41:55.459967+0000","last_fullsized":"2024-05-30T16:41:55.459967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359122+0000","last_change":"2024-05-30T16:41:52.343555+0000","last_active":"2024-05-30T16:41:54.359122+0000","last_peered":"2024-05-30T16:41:54.359122+0000","last_clean":"2024-05-30T16:41:54.359122+0000","last_became_active":"2024-05-30T16:41:52.342980+0000","last_became_peered":"2024-05-30T16:41:52.342980+0000","last_unstale":"2024-05-30T16:41:54.359122+0000","last_undegraded":"2024-05-30T16:41:54.359122+0000","last_fullsized":"2024-05-30T16:41:54.359122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:49.498732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457706+0000","last_change":"2024-05-30T16:41:53.365631+0000","last_active":"2024-05-30T16:41:55.457706+0000","last_peered":"2024-05-30T16:41:55.457706+0000","last_clean":"2024-05-30T16:41:55.457706+0000","last_became_active":"2024-05-30T16:41:53.357804+0000","last_became_peered":"2024-05-30T16:41:53.357804+0000","last_unstale":"2024-05-30T16:41:55.457706+0000","last_undegraded":"2024-05-30T16:41:55.457706+0000","last_fullsized":"2024-05-30T16:41:55.457706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472293+0000","last_change":"2024-05-30T16:41:52.340095+0000","last_active":"2024-05-30T16:41:54.472293+0000","last_peered":"2024-05-30T16:41:54.472293+0000","last_clean":"2024-05-30T16:41:54.472293+0000","last_became_active":"2024-05-30T16:41:52.339769+0000","last_became_peered":"2024-05-30T16:41:52.339769+0000","last_unstale":"2024-05-30T16:41:54.472293+0000","last_undegraded":"2024-05-30T16:41:54.472293+0000","last_fullsized":"2024-05-30T16:41:54.472293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:16:18.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357172+0000","last_change":"2024-05-30T16:41:53.359564+0000","last_active":"2024-05-30T16:41:54.357172+0000","last_peered":"2024-05-30T16:41:54.357172+0000","last_clean":"2024-05-30T16:41:54.357172+0000","last_became_active":"2024-05-30T16:41:53.358733+0000","last_became_peered":"2024-05-30T16:41:53.358733+0000","last_unstale":"2024-05-30T16:41:54.357172+0000","last_undegraded":"2024-05-30T16:41:54.357172+0000","last_fullsized":"2024-05-30T16:41:54.357172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:50.153923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353727+0000","last_change":"2024-05-30T16:41:52.340268+0000","last_active":"2024-05-30T16:41:54.353727+0000","last_peered":"2024-05-30T16:41:54.353727+0000","last_clean":"2024-05-30T16:41:54.353727+0000","last_became_active":"2024-05-30T16:41:52.339896+0000","last_became_peered":"2024-05-30T16:41:52.339896+0000","last_unstale":"2024-05-30T16:41:54.353727+0000","last_undegraded":"2024-05-30T16:41:54.353727+0000","last_fullsized":"2024-05-30T16:41:54.353727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458359+0000","last_change":"2024-05-30T16:41:53.351989+0000","last_active":"2024-05-30T16:41:55.458359+0000","last_peered":"2024-05-30T16:41:55.458359+0000","last_clean":"2024-05-30T16:41:55.458359+0000","last_became_active":"2024-05-30T16:41:53.351579+0000","last_became_peered":"2024-05-30T16:41:53.351579+0000","last_unstale":"2024-05-30T16:41:55.458359+0000","last_undegraded":"2024-05-30T16:41:55.458359+0000","last_fullsized":"2024-05-30T16:41:55.458359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353390+0000","last_change":"2024-05-30T16:41:52.330661+0000","last_active":"2024-05-30T16:41:54.353390+0000","last_peered":"2024-05-30T16:41:54.353390+0000","last_clean":"2024-05-30T16:41:54.353390+0000","last_became_active":"2024-05-30T16:41:52.330239+0000","last_became_peered":"2024-05-30T16:41:52.330239+0000","last_unstale":"2024-05-30T16:41:54.353390+0000","last_undegraded":"2024-05-30T16:41:54.353390+0000","last_fullsized":"2024-05-30T16:41:54.353390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:23.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459438+0000","last_change":"2024-05-30T16:41:53.365561+0000","last_active":"2024-05-30T16:41:55.459438+0000","last_peered":"2024-05-30T16:41:55.459438+0000","last_clean":"2024-05-30T16:41:55.459438+0000","last_became_active":"2024-05-30T16:41:53.363963+0000","last_became_peered":"2024-05-30T16:41:53.363963+0000","last_unstale":"2024-05-30T16:41:55.459438+0000","last_undegraded":"2024-05-30T16:41:55.459438+0000","last_fullsized":"2024-05-30T16:41:55.459438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473668+0000","last_change":"2024-05-30T16:41:52.344910+0000","last_active":"2024-05-30T16:41:54.473668+0000","last_peered":"2024-05-30T16:41:54.473668+0000","last_clean":"2024-05-30T16:41:54.473668+0000","last_became_active":"2024-05-30T16:41:52.344564+0000","last_became_peered":"2024-05-30T16:41:52.344564+0000","last_unstale":"2024-05-30T16:41:54.473668+0000","last_undegraded":"2024-05-30T16:41:54.473668+0000","last_fullsized":"2024-05-30T16:41:54.473668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:11:05.038234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358176+0000","last_change":"2024-05-30T16:41:53.361266+0000","last_active":"2024-05-30T16:41:54.358176+0000","last_peered":"2024-05-30T16:41:54.358176+0000","last_clean":"2024-05-30T16:41:54.358176+0000","last_became_active":"2024-05-30T16:41:53.360980+0000","last_became_peered":"2024-05-30T16:41:53.360980+0000","last_unstale":"2024-05-30T16:41:54.358176+0000","last_undegraded":"2024-05-30T16:41:54.358176+0000","last_fullsized":"2024-05-30T16:41:54.358176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457189+0000","last_change":"2024-05-30T16:41:53.370166+0000","last_active":"2024-05-30T16:41:55.457189+0000","last_peered":"2024-05-30T16:41:55.457189+0000","last_clean":"2024-05-30T16:41:55.457189+0000","last_became_active":"2024-05-30T16:41:53.369830+0000","last_became_peered":"2024-05-30T16:41:53.369830+0000","last_unstale":"2024-05-30T16:41:55.457189+0000","last_undegraded":"2024-05-30T16:41:55.457189+0000","last_fullsized":"2024-05-30T16:41:55.457189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:08:24.828674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472946+0000","last_change":"2024-05-30T16:41:52.342853+0000","last_active":"2024-05-30T16:41:54.472946+0000","last_peered":"2024-05-30T16:41:54.472946+0000","last_clean":"2024-05-30T16:41:54.472946+0000","last_became_active":"2024-05-30T16:41:52.342459+0000","last_became_peered":"2024-05-30T16:41:52.342459+0000","last_unstale":"2024-05-30T16:41:54.472946+0000","last_undegraded":"2024-05-30T16:41:54.472946+0000","last_fullsized":"2024-05-30T16:41:54.472946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:52:34.598062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457125+0000","last_change":"2024-05-30T16:41:53.367020+0000","last_active":"2024-05-30T16:41:55.457125+0000","last_peered":"2024-05-30T16:41:55.457125+0000","last_clean":"2024-05-30T16:41:55.457125+0000","last_became_active":"2024-05-30T16:41:53.366745+0000","last_became_peered":"2024-05-30T16:41:53.366745+0000","last_unstale":"2024-05-30T16:41:55.457125+0000","last_undegraded":"2024-05-30T16:41:55.457125+0000","last_fullsized":"2024-05-30T16:41:55.457125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:35:37.949106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473358+0000","last_change":"2024-05-30T16:41:52.343170+0000","last_active":"2024-05-30T16:41:54.473358+0000","last_peered":"2024-05-30T16:41:54.473358+0000","last_clean":"2024-05-30T16:41:54.473358+0000","last_became_active":"2024-05-30T16:41:52.342743+0000","last_became_peered":"2024-05-30T16:41:52.342743+0000","last_unstale":"2024-05-30T16:41:54.473358+0000","last_undegraded":"2024-05-30T16:41:54.473358+0000","last_fullsized":"2024-05-30T16:41:54.473358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:02.431665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457471+0000","last_change":"2024-05-30T16:41:53.364283+0000","last_active":"2024-05-30T16:41:55.457471+0000","last_peered":"2024-05-30T16:41:55.457471+0000","last_clean":"2024-05-30T16:41:55.457471+0000","last_became_active":"2024-05-30T16:41:53.362510+0000","last_became_peered":"2024-05-30T16:41:53.362510+0000","last_unstale":"2024-05-30T16:41:55.457471+0000","last_undegraded":"2024-05-30T16:41:55.457471+0000","last_fullsized":"2024-05-30T16:41:55.457471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.460118+0000","last_change":"2024-05-30T16:41:52.333188+0000","last_active":"2024-05-30T16:41:55.460118+0000","last_peered":"2024-05-30T16:41:55.460118+0000","last_clean":"2024-05-30T16:41:55.460118+0000","last_became_active":"2024-05-30T16:41:52.332987+0000","last_became_peered":"2024-05-30T16:41:52.332987+0000","last_unstale":"2024-05-30T16:41:55.460118+0000","last_undegraded":"2024-05-30T16:41:55.460118+0000","last_fullsized":"2024-05-30T16:41:55.460118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.460122+0000","last_change":"2024-05-30T16:41:53.360296+0000","last_active":"2024-05-30T16:41:55.460122+0000","last_peered":"2024-05-30T16:41:55.460122+0000","last_clean":"2024-05-30T16:41:55.460122+0000","last_became_active":"2024-05-30T16:41:53.360008+0000","last_became_peered":"2024-05-30T16:41:53.360008+0000","last_unstale":"2024-05-30T16:41:55.460122+0000","last_undegraded":"2024-05-30T16:41:55.460122+0000","last_fullsized":"2024-05-30T16:41:55.460122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:11.943106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457581+0000","last_change":"2024-05-30T16:41:52.337440+0000","last_active":"2024-05-30T16:41:55.457581+0000","last_peered":"2024-05-30T16:41:55.457581+0000","last_clean":"2024-05-30T16:41:55.457581+0000","last_became_active":"2024-05-30T16:41:52.337136+0000","last_became_peered":"2024-05-30T16:41:52.337136+0000","last_unstale":"2024-05-30T16:41:55.457581+0000","last_undegraded":"2024-05-30T16:41:55.457581+0000","last_fullsized":"2024-05-30T16:41:55.457581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:17.345557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:41:57.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:41:57.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.975+0000 7ff17a400640 1 Processor -- start 2024-05-30T16:41:57.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.975+0000 7ff17a400640 1 -- start start 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff17a400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff17415e960 0x7ff174162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff17a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 0x7ff1740cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff17a400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff1740cfa10 0x7ff17406c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff17a400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff1740d2b40 con 0x7ff17415e960 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff17a400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff17415ed40 con 0x7ff1740cfa10 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff17a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff1741629d0 con 0x7ff1740ba090 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff179000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff17415e960 0x7ff174162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff179000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff17415e960 0x7ff174162490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58736/0 (socket says 172.21.15.144:58736) 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff179000640 1 -- 172.21.15.144:0/2619039572 learned_addr learned my addr 172.21.15.144:0/2619039572 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff179a00640 1 --2- 172.21.15.144:0/2619039572 >> v2:172.21.15.149:3300/0 conn(0x7ff1740cfa10 0x7ff17406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.977+0000 7ff16be00640 1 --2- 172.21.15.144:0/2619039572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 0x7ff1740cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.978+0000 7ff179000640 1 -- 172.21.15.144:0/2619039572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 msgr2=0x7ff1740cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.978+0000 7ff179000640 1 --2- 172.21.15.144:0/2619039572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 0x7ff1740cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.978+0000 7ff179000640 1 -- 172.21.15.144:0/2619039572 >> v2:172.21.15.149:3300/0 conn(0x7ff1740cfa10 msgr2=0x7ff17406c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.978+0000 7ff179000640 1 --2- 172.21.15.144:0/2619039572 >> v2:172.21.15.149:3300/0 conn(0x7ff1740cfa10 0x7ff17406c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.978+0000 7ff179000640 1 -- 172.21.15.144:0/2619039572 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff174162ca0 con 0x7ff17415e960 2024-05-30T16:41:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.978+0000 7ff16be00640 1 --2- 172.21.15.144:0/2619039572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 0x7ff1740cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:41:57.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.979+0000 7ff179000640 1 --2- 172.21.15.144:0/2619039572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 0x7ff174162490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff1740cb5d0 tx=0x7ff16402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649a70a21c492444 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:57.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.979+0000 7ff173e00640 1 -- 172.21.15.144:0/2619039572 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164037070 con 0x7ff17415e960 2024-05-30T16:41:57.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.979+0000 7ff173e00640 1 -- 172.21.15.144:0/2619039572 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff164032440 con 0x7ff17415e960 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.979+0000 7ff173e00640 1 -- 172.21.15.144:0/2619039572 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164032810 con 0x7ff17415e960 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.980+0000 7ff17a400640 1 -- 172.21.15.144:0/2619039572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 msgr2=0x7ff174162490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.980+0000 7ff17a400640 1 --2- 172.21.15.144:0/2619039572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 0x7ff174162490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff1740cb5d0 tx=0x7ff16402a1e0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.980+0000 7ff17a400640 1 -- 172.21.15.144:0/2619039572 shutdown_connections 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.980+0000 7ff17a400640 1 --2- 172.21.15.144:0/2619039572 >> v2:172.21.15.149:3300/0 conn(0x7ff1740cfa10 0x7ff17406c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.980+0000 7ff17a400640 1 --2- 172.21.15.144:0/2619039572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 0x7ff1740cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.980+0000 7ff17a400640 1 --2- 172.21.15.144:0/2619039572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 0x7ff174162490 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.980+0000 7ff17a400640 1 -- 172.21.15.144:0/2619039572 >> 172.21.15.144:0/2619039572 conn(0x7ff1740d1360 msgr2=0x7ff1740d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.980+0000 7ff17a400640 1 -- 172.21.15.144:0/2619039572 shutdown_connections 2024-05-30T16:41:57.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.980+0000 7ff17a400640 1 -- 172.21.15.144:0/2619039572 wait complete. 2024-05-30T16:41:57.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.982+0000 7ff17a400640 1 Processor -- start 2024-05-30T16:41:57.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.982+0000 7ff17a400640 1 -- start start 2024-05-30T16:41:57.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff17a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 0x7ff17415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff17a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1740cfa10 0x7ff1741e84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff17a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 0x7ff1741542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff17a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740d2d90 con 0x7ff17415e960 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff17a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff174163260 con 0x7ff1740cfa10 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff17a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff1740b78a0 con 0x7ff1740ba090 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff179a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 0x7ff1741542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff179a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 0x7ff1741542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58752/0 (socket says 172.21.15.144:58752) 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff179a00640 1 -- 172.21.15.144:0/806994212 learned_addr learned my addr 172.21.15.144:0/806994212 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff179000640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 0x7ff17415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff16be00640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1740cfa10 0x7ff1741e84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff179a00640 1 -- 172.21.15.144:0/806994212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 msgr2=0x7ff17415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff179a00640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 0x7ff17415d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff179a00640 1 -- 172.21.15.144:0/806994212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1740cfa10 msgr2=0x7ff1741e84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:57.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff179a00640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1740cfa10 0x7ff1741e84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:57.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.983+0000 7ff179a00640 1 -- 172.21.15.144:0/806994212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17415d7f0 con 0x7ff17415e960 2024-05-30T16:41:57.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.984+0000 7ff179a00640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 0x7ff1741542b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff16c007e60 tx=0x7ff16c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:57.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.984+0000 7ff171600640 1 -- 172.21.15.144:0/806994212 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c014420 con 0x7ff17415e960 2024-05-30T16:41:57.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.984+0000 7ff171600640 1 -- 172.21.15.144:0/806994212 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff16c019070 con 0x7ff17415e960 2024-05-30T16:41:57.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.984+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17415da70 con 0x7ff17415e960 2024-05-30T16:41:57.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.984+0000 7ff171600640 1 -- 172.21.15.144:0/806994212 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c014820 con 0x7ff17415e960 2024-05-30T16:41:57.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.984+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17415ae50 con 0x7ff17415e960 2024-05-30T16:41:57.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.985+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff174075570 con 0x7ff17415e960 2024-05-30T16:41:57.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.986+0000 7ff171600640 1 -- 172.21.15.144:0/806994212 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff16c0149c0 con 0x7ff17415e960 2024-05-30T16:41:57.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.987+0000 7ff171600640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff15006c8f0 0x7ff15006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:57.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.988+0000 7ff171600640 1 -- 172.21.15.144:0/806994212 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff16c08c460 con 0x7ff17415e960 2024-05-30T16:41:57.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.988+0000 7ff179000640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff15006c8f0 0x7ff15006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:57.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.988+0000 7ff179000640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff15006c8f0 0x7ff15006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff164034000 tx=0x7ff16402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:57.992+0000 7ff171600640 1 -- 172.21.15.144:0/806994212 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff17415d7f0 con 0x7ff17415e960 2024-05-30T16:41:58.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.187+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1740d2410 con 0x7ff15006c8f0 2024-05-30T16:41:58.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.206+0000 7ff171600640 1 -- 172.21.15.144:0/806994212 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7ff1740d2410 con 0x7ff15006c8f0 2024-05-30T16:41:58.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:58.212 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:41:58.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.212+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff15006c8f0 msgr2=0x7ff15006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff15006c8f0 0x7ff15006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff164034000 tx=0x7ff16402e000 comp rx=0 tx=0).stop 2024-05-30T16:41:58.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 msgr2=0x7ff1741542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 0x7ff1741542b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff16c007e60 tx=0x7ff16c00e4b0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 shutdown_connections 2024-05-30T16:41:58.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff15006c8f0 0x7ff15006edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415e960 0x7ff1741542b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1740cfa10 0x7ff1741e84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 --2- 172.21.15.144:0/806994212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1740ba090 0x7ff17415d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 >> 172.21.15.144:0/806994212 conn(0x7ff1740d1360 msgr2=0x7ff1740d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:58.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 shutdown_connections 2024-05-30T16:41:58.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.213+0000 7ff17a400640 1 -- 172.21.15.144:0/806994212 wait complete. 2024-05-30T16:41:58.232 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-30T16:41:56.893770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2842624,"data_stored":1727828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.595891"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473939+0000","last_change":"2024-05-30T16:41:53.357304+0000","last_active":"2024-05-30T16:41:54.473939+0000","last_peered":"2024-05-30T16:41:54.473939+0000","last_clean":"2024-05-30T16:41:54.473939+0000","last_became_active":"2024-05-30T16:41:53.356937+0000","last_became_peered":"2024-05-30T16:41:53.356937+0000","last_unstale":"2024-05-30T16:41:54.473939+0000","last_undegraded":"2024-05-30T16:41:54.473939+0000","last_fullsized":"2024-05-30T16:41:54.473939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:04.325790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353623+0000","last_change":"2024-05-30T16:41:53.368919+0000","last_active":"2024-05-30T16:41:54.353623+0000","last_peered":"2024-05-30T16:41:54.353623+0000","last_clean":"2024-05-30T16:41:54.353623+0000","last_became_active":"2024-05-30T16:41:53.368598+0000","last_became_peered":"2024-05-30T16:41:53.368598+0000","last_unstale":"2024-05-30T16:41:54.353623+0000","last_undegraded":"2024-05-30T16:41:54.353623+0000","last_fullsized":"2024-05-30T16:41:54.353623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457349+0000","last_change":"2024-05-30T16:41:53.360032+0000","last_active":"2024-05-30T16:41:55.457349+0000","last_peered":"2024-05-30T16:41:55.457349+0000","last_clean":"2024-05-30T16:41:55.457349+0000","last_became_active":"2024-05-30T16:41:53.353909+0000","last_became_peered":"2024-05-30T16:41:53.353909+0000","last_unstale":"2024-05-30T16:41:55.457349+0000","last_undegraded":"2024-05-30T16:41:55.457349+0000","last_fullsized":"2024-05-30T16:41:55.457349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456943+0000","last_change":"2024-05-30T16:41:53.375331+0000","last_active":"2024-05-30T16:41:55.456943+0000","last_peered":"2024-05-30T16:41:55.456943+0000","last_clean":"2024-05-30T16:41:55.456943+0000","last_became_active":"2024-05-30T16:41:53.375049+0000","last_became_peered":"2024-05-30T16:41:53.375049+0000","last_unstale":"2024-05-30T16:41:55.456943+0000","last_undegraded":"2024-05-30T16:41:55.456943+0000","last_fullsized":"2024-05-30T16:41:55.456943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:11.943106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473149+0000","last_change":"2024-05-30T16:41:53.360193+0000","last_active":"2024-05-30T16:41:54.473149+0000","last_peered":"2024-05-30T16:41:54.473149+0000","last_clean":"2024-05-30T16:41:54.473149+0000","last_became_active":"2024-05-30T16:41:53.356390+0000","last_became_peered":"2024-05-30T16:41:53.356390+0000","last_unstale":"2024-05-30T16:41:54.473149+0000","last_undegraded":"2024-05-30T16:41:54.473149+0000","last_fullsized":"2024-05-30T16:41:54.473149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:01:25.890627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456576+0000","last_change":"2024-05-30T16:41:53.363129+0000","last_active":"2024-05-30T16:41:55.456576+0000","last_peered":"2024-05-30T16:41:55.456576+0000","last_clean":"2024-05-30T16:41:55.456576+0000","last_became_active":"2024-05-30T16:41:53.362799+0000","last_became_peered":"2024-05-30T16:41:53.362799+0000","last_unstale":"2024-05-30T16:41:55.456576+0000","last_undegraded":"2024-05-30T16:41:55.456576+0000","last_fullsized":"2024-05-30T16:41:55.456576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472403+0000","last_change":"2024-05-30T16:41:53.354731+0000","last_active":"2024-05-30T16:41:54.472403+0000","last_peered":"2024-05-30T16:41:54.472403+0000","last_clean":"2024-05-30T16:41:54.472403+0000","last_became_active":"2024-05-30T16:41:53.354407+0000","last_became_peered":"2024-05-30T16:41:53.354407+0000","last_unstale":"2024-05-30T16:41:54.472403+0000","last_undegraded":"2024-05-30T16:41:54.472403+0000","last_fullsized":"2024-05-30T16:41:54.472403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:09.648137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457945+0000","last_change":"2024-05-30T16:41:53.364759+0000","last_active":"2024-05-30T16:41:55.457945+0000","last_peered":"2024-05-30T16:41:55.457945+0000","last_clean":"2024-05-30T16:41:55.457945+0000","last_became_active":"2024-05-30T16:41:53.363544+0000","last_became_peered":"2024-05-30T16:41:53.363544+0000","last_unstale":"2024-05-30T16:41:55.457945+0000","last_undegraded":"2024-05-30T16:41:55.457945+0000","last_fullsized":"2024-05-30T16:41:55.457945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473887+0000","last_change":"2024-05-30T16:41:53.361800+0000","last_active":"2024-05-30T16:41:54.473887+0000","last_peered":"2024-05-30T16:41:54.473887+0000","last_clean":"2024-05-30T16:41:54.473887+0000","last_became_active":"2024-05-30T16:41:53.361517+0000","last_became_peered":"2024-05-30T16:41:53.361517+0000","last_unstale":"2024-05-30T16:41:54.473887+0000","last_undegraded":"2024-05-30T16:41:54.473887+0000","last_fullsized":"2024-05-30T16:41:54.473887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:11.893893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359310+0000","last_change":"2024-05-30T16:41:53.357190+0000","last_active":"2024-05-30T16:41:54.359310+0000","last_peered":"2024-05-30T16:41:54.359310+0000","last_clean":"2024-05-30T16:41:54.359310+0000","last_became_active":"2024-05-30T16:41:53.355805+0000","last_became_peered":"2024-05-30T16:41:53.355805+0000","last_unstale":"2024-05-30T16:41:54.359310+0000","last_undegraded":"2024-05-30T16:41:54.359310+0000","last_fullsized":"2024-05-30T16:41:54.359310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358896+0000","last_change":"2024-05-30T16:41:53.362431+0000","last_active":"2024-05-30T16:41:54.358896+0000","last_peered":"2024-05-30T16:41:54.358896+0000","last_clean":"2024-05-30T16:41:54.358896+0000","last_became_active":"2024-05-30T16:41:53.362046+0000","last_became_peered":"2024-05-30T16:41:53.362046+0000","last_unstale":"2024-05-30T16:41:54.358896+0000","last_undegraded":"2024-05-30T16:41:54.358896+0000","last_fullsized":"2024-05-30T16:41:54.358896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358108+0000","last_change":"2024-05-30T16:41:53.365227+0000","last_active":"2024-05-30T16:41:54.358108+0000","last_peered":"2024-05-30T16:41:54.358108+0000","last_clean":"2024-05-30T16:41:54.358108+0000","last_became_active":"2024-05-30T16:41:53.361257+0000","last_became_peered":"2024-05-30T16:41:53.361257+0000","last_unstale":"2024-05-30T16:41:54.358108+0000","last_undegraded":"2024-05-30T16:41:54.358108+0000","last_fullsized":"2024-05-30T16:41:54.358108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:24.316502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459058+0000","last_change":"2024-05-30T16:41:53.363327+0000","last_active":"2024-05-30T16:41:55.459058+0000","last_peered":"2024-05-30T16:41:55.459058+0000","last_clean":"2024-05-30T16:41:55.459058+0000","last_became_active":"2024-05-30T16:41:53.358909+0000","last_became_peered":"2024-05-30T16:41:53.358909+0000","last_unstale":"2024-05-30T16:41:55.459058+0000","last_undegraded":"2024-05-30T16:41:55.459058+0000","last_fullsized":"2024-05-30T16:41:55.459058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456449+0000","last_change":"2024-05-30T16:41:53.349858+0000","last_active":"2024-05-30T16:41:55.456449+0000","last_peered":"2024-05-30T16:41:55.456449+0000","last_clean":"2024-05-30T16:41:55.456449+0000","last_became_active":"2024-05-30T16:41:53.349503+0000","last_became_peered":"2024-05-30T16:41:53.349503+0000","last_unstale":"2024-05-30T16:41:55.456449+0000","last_undegraded":"2024-05-30T16:41:55.456449+0000","last_fullsized":"2024-05-30T16:41:55.456449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:16:19.914867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353871+0000","last_change":"2024-05-30T16:41:53.361644+0000","last_active":"2024-05-30T16:41:54.353871+0000","last_peered":"2024-05-30T16:41:54.353871+0000","last_clean":"2024-05-30T16:41:54.353871+0000","last_became_active":"2024-05-30T16:41:53.361338+0000","last_became_peered":"2024-05-30T16:41:53.361338+0000","last_unstale":"2024-05-30T16:41:54.353871+0000","last_undegraded":"2024-05-30T16:41:54.353871+0000","last_fullsized":"2024-05-30T16:41:54.353871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456639+0000","last_change":"2024-05-30T16:41:53.360331+0000","last_active":"2024-05-30T16:41:55.456639+0000","last_peered":"2024-05-30T16:41:55.456639+0000","last_clean":"2024-05-30T16:41:55.456639+0000","last_became_active":"2024-05-30T16:41:53.359832+0000","last_became_peered":"2024-05-30T16:41:53.359832+0000","last_unstale":"2024-05-30T16:41:55.456639+0000","last_undegraded":"2024-05-30T16:41:55.456639+0000","last_fullsized":"2024-05-30T16:41:55.456639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457756+0000","last_change":"2024-05-30T16:41:53.368792+0000","last_active":"2024-05-30T16:41:55.457756+0000","last_peered":"2024-05-30T16:41:55.457756+0000","last_clean":"2024-05-30T16:41:55.457756+0000","last_became_active":"2024-05-30T16:41:53.368547+0000","last_became_peered":"2024-05-30T16:41:53.368547+0000","last_unstale":"2024-05-30T16:41:55.457756+0000","last_undegraded":"2024-05-30T16:41:55.457756+0000","last_fullsized":"2024-05-30T16:41:55.457756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:37:50.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295237+0000","last_change":"2024-05-30T16:41:53.356728+0000","last_active":"2024-05-30T16:41:55.295237+0000","last_peered":"2024-05-30T16:41:55.295237+0000","last_clean":"2024-05-30T16:41:55.295237+0000","last_became_active":"2024-05-30T16:41:53.356161+0000","last_became_peered":"2024-05-30T16:41:53.356161+0000","last_unstale":"2024-05-30T16:41:55.295237+0000","last_undegraded":"2024-05-30T16:41:55.295237+0000","last_fullsized":"2024-05-30T16:41:55.295237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:24.316502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473885+0000","last_change":"2024-05-30T16:41:53.352155+0000","last_active":"2024-05-30T16:41:54.473885+0000","last_peered":"2024-05-30T16:41:54.473885+0000","last_clean":"2024-05-30T16:41:54.473885+0000","last_became_active":"2024-05-30T16:41:53.348922+0000","last_became_peered":"2024-05-30T16:41:53.348922+0000","last_unstale":"2024-05-30T16:41:54.473885+0000","last_undegraded":"2024-05-30T16:41:54.473885+0000","last_fullsized":"2024-05-30T16:41:54.473885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:05.861936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358757+0000","last_change":"2024-05-30T16:41:53.373040+0000","last_active":"2024-05-30T16:41:54.358757+0000","last_peered":"2024-05-30T16:41:54.358757+0000","last_clean":"2024-05-30T16:41:54.358757+0000","last_became_active":"2024-05-30T16:41:53.372775+0000","last_became_peered":"2024-05-30T16:41:53.372775+0000","last_unstale":"2024-05-30T16:41:54.358757+0000","last_undegraded":"2024-05-30T16:41:54.358757+0000","last_fullsized":"2024-05-30T16:41:54.358757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456552+0000","last_change":"2024-05-30T16:41:53.363158+0000","last_active":"2024-05-30T16:41:55.456552+0000","last_peered":"2024-05-30T16:41:55.456552+0000","last_clean":"2024-05-30T16:41:55.456552+0000","last_became_active":"2024-05-30T16:41:53.362828+0000","last_became_peered":"2024-05-30T16:41:53.362828+0000","last_unstale":"2024-05-30T16:41:55.456552+0000","last_undegraded":"2024-05-30T16:41:55.456552+0000","last_fullsized":"2024-05-30T16:41:55.456552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:52:35.610545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456637+0000","last_change":"2024-05-30T16:41:53.370806+0000","last_active":"2024-05-30T16:41:55.456637+0000","last_peered":"2024-05-30T16:41:55.456637+0000","last_clean":"2024-05-30T16:41:55.456637+0000","last_became_active":"2024-05-30T16:41:53.369787+0000","last_became_peered":"2024-05-30T16:41:53.369787+0000","last_unstale":"2024-05-30T16:41:55.456637+0000","last_undegraded":"2024-05-30T16:41:55.456637+0000","last_fullsized":"2024-05-30T16:41:55.456637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457726+0000","last_change":"2024-05-30T16:41:53.362039+0000","last_active":"2024-05-30T16:41:55.457726+0000","last_peered":"2024-05-30T16:41:55.457726+0000","last_clean":"2024-05-30T16:41:55.457726+0000","last_became_active":"2024-05-30T16:41:53.361725+0000","last_became_peered":"2024-05-30T16:41:53.361725+0000","last_unstale":"2024-05-30T16:41:55.457726+0000","last_undegraded":"2024-05-30T16:41:55.457726+0000","last_fullsized":"2024-05-30T16:41:55.457726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:03.444148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456547+0000","last_change":"2024-05-30T16:41:53.360122+0000","last_active":"2024-05-30T16:41:55.456547+0000","last_peered":"2024-05-30T16:41:55.456547+0000","last_clean":"2024-05-30T16:41:55.456547+0000","last_became_active":"2024-05-30T16:41:53.359414+0000","last_became_peered":"2024-05-30T16:41:53.359414+0000","last_unstale":"2024-05-30T16:41:55.456547+0000","last_undegraded":"2024-05-30T16:41:55.456547+0000","last_fullsized":"2024-05-30T16:41:55.456547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459845+0000","last_change":"2024-05-30T16:41:53.354023+0000","last_active":"2024-05-30T16:41:55.459845+0000","last_peered":"2024-05-30T16:41:55.459845+0000","last_clean":"2024-05-30T16:41:55.459845+0000","last_became_active":"2024-05-30T16:41:53.352390+0000","last_became_peered":"2024-05-30T16:41:53.352390+0000","last_unstale":"2024-05-30T16:41:55.459845+0000","last_undegraded":"2024-05-30T16:41:55.459845+0000","last_fullsized":"2024-05-30T16:41:55.459845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359371+0000","last_change":"2024-05-30T16:41:53.354855+0000","last_active":"2024-05-30T16:41:54.359371+0000","last_peered":"2024-05-30T16:41:54.359371+0000","last_clean":"2024-05-30T16:41:54.359371+0000","last_became_active":"2024-05-30T16:41:53.354564+0000","last_became_peered":"2024-05-30T16:41:53.354564+0000","last_unstale":"2024-05-30T16:41:54.359371+0000","last_undegraded":"2024-05-30T16:41:54.359371+0000","last_fullsized":"2024-05-30T16:41:54.359371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353620+0000","last_change":"2024-05-30T16:41:53.357643+0000","last_active":"2024-05-30T16:41:54.353620+0000","last_peered":"2024-05-30T16:41:54.353620+0000","last_clean":"2024-05-30T16:41:54.353620+0000","last_became_active":"2024-05-30T16:41:53.357364+0000","last_became_peered":"2024-05-30T16:41:53.357364+0000","last_unstale":"2024-05-30T16:41:54.353620+0000","last_undegraded":"2024-05-30T16:41:54.353620+0000","last_fullsized":"2024-05-30T16:41:54.353620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459783+0000","last_change":"2024-05-30T16:41:53.359016+0000","last_active":"2024-05-30T16:41:55.459783+0000","last_peered":"2024-05-30T16:41:55.459783+0000","last_clean":"2024-05-30T16:41:55.459783+0000","last_became_active":"2024-05-30T16:41:53.358647+0000","last_became_peered":"2024-05-30T16:41:53.358647+0000","last_unstale":"2024-05-30T16:41:55.459783+0000","last_undegraded":"2024-05-30T16:41:55.459783+0000","last_fullsized":"2024-05-30T16:41:55.459783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456720+0000","last_change":"2024-05-30T16:41:53.369095+0000","last_active":"2024-05-30T16:41:55.456720+0000","last_peered":"2024-05-30T16:41:55.456720+0000","last_clean":"2024-05-30T16:41:55.456720+0000","last_became_active":"2024-05-30T16:41:53.368747+0000","last_became_peered":"2024-05-30T16:41:53.368747+0000","last_unstale":"2024-05-30T16:41:55.456720+0000","last_undegraded":"2024-05-30T16:41:55.456720+0000","last_fullsized":"2024-05-30T16:41:55.456720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:03.444148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456759+0000","last_change":"2024-05-30T16:41:53.373107+0000","last_active":"2024-05-30T16:41:55.456759+0000","last_peered":"2024-05-30T16:41:55.456759+0000","last_clean":"2024-05-30T16:41:55.456759+0000","last_became_active":"2024-05-30T16:41:53.372856+0000","last_became_peered":"2024-05-30T16:41:53.372856+0000","last_unstale":"2024-05-30T16:41:55.456759+0000","last_undegraded":"2024-05-30T16:41:55.456759+0000","last_fullsized":"2024-05-30T16:41:55.456759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295310+0000","last_change":"2024-05-30T16:41:53.357024+0000","last_active":"2024-05-30T16:41:55.295310+0000","last_peered":"2024-05-30T16:41:55.295310+0000","last_clean":"2024-05-30T16:41:55.295310+0000","last_became_active":"2024-05-30T16:41:53.355547+0000","last_became_peered":"2024-05-30T16:41:53.355547+0000","last_unstale":"2024-05-30T16:41:55.295310+0000","last_undegraded":"2024-05-30T16:41:55.295310+0000","last_fullsized":"2024-05-30T16:41:55.295310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:17.807528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357938+0000","last_change":"2024-05-30T16:41:53.358603+0000","last_active":"2024-05-30T16:41:54.357938+0000","last_peered":"2024-05-30T16:41:54.357938+0000","last_clean":"2024-05-30T16:41:54.357938+0000","last_became_active":"2024-05-30T16:41:53.357790+0000","last_became_peered":"2024-05-30T16:41:53.357790+0000","last_unstale":"2024-05-30T16:41:54.357938+0000","last_undegraded":"2024-05-30T16:41:54.357938+0000","last_fullsized":"2024-05-30T16:41:54.357938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357689+0000","last_change":"2024-05-30T16:41:53.352211+0000","last_active":"2024-05-30T16:41:54.357689+0000","last_peered":"2024-05-30T16:41:54.357689+0000","last_clean":"2024-05-30T16:41:54.357689+0000","last_became_active":"2024-05-30T16:41:53.351432+0000","last_became_peered":"2024-05-30T16:41:53.351432+0000","last_unstale":"2024-05-30T16:41:54.357689+0000","last_undegraded":"2024-05-30T16:41:54.357689+0000","last_fullsized":"2024-05-30T16:41:54.357689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:03.931858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459368+0000","last_change":"2024-05-30T16:41:52.337016+0000","last_active":"2024-05-30T16:41:55.459368+0000","last_peered":"2024-05-30T16:41:55.459368+0000","last_clean":"2024-05-30T16:41:55.459368+0000","last_became_active":"2024-05-30T16:41:52.336681+0000","last_became_peered":"2024-05-30T16:41:52.336681+0000","last_unstale":"2024-05-30T16:41:55.459368+0000","last_undegraded":"2024-05-30T16:41:55.459368+0000","last_fullsized":"2024-05-30T16:41:55.459368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:31.649153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456897+0000","last_change":"2024-05-30T16:41:53.368959+0000","last_active":"2024-05-30T16:41:55.456897+0000","last_peered":"2024-05-30T16:41:55.456897+0000","last_clean":"2024-05-30T16:41:55.456897+0000","last_became_active":"2024-05-30T16:41:53.368153+0000","last_became_peered":"2024-05-30T16:41:53.368153+0000","last_unstale":"2024-05-30T16:41:55.456897+0000","last_undegraded":"2024-05-30T16:41:55.456897+0000","last_fullsized":"2024-05-30T16:41:55.456897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358440+0000","last_change":"2024-05-30T16:41:52.332967+0000","last_active":"2024-05-30T16:41:54.358440+0000","last_peered":"2024-05-30T16:41:54.358440+0000","last_clean":"2024-05-30T16:41:54.358440+0000","last_became_active":"2024-05-30T16:41:52.331825+0000","last_became_peered":"2024-05-30T16:41:52.331825+0000","last_unstale":"2024-05-30T16:41:54.358440+0000","last_undegraded":"2024-05-30T16:41:54.358440+0000","last_fullsized":"2024-05-30T16:41:54.358440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457891+0000","last_change":"2024-05-30T16:41:52.336306+0000","last_active":"2024-05-30T16:41:55.457891+0000","last_peered":"2024-05-30T16:41:55.457891+0000","last_clean":"2024-05-30T16:41:55.457891+0000","last_became_active":"2024-05-30T16:41:52.336007+0000","last_became_peered":"2024-05-30T16:41:52.336007+0000","last_unstale":"2024-05-30T16:41:55.457891+0000","last_undegraded":"2024-05-30T16:41:55.457891+0000","last_fullsized":"2024-05-30T16:41:55.457891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:49.630008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458336+0000","last_change":"2024-05-30T16:41:53.363846+0000","last_active":"2024-05-30T16:41:55.458336+0000","last_peered":"2024-05-30T16:41:55.458336+0000","last_clean":"2024-05-30T16:41:55.458336+0000","last_became_active":"2024-05-30T16:41:53.362819+0000","last_became_peered":"2024-05-30T16:41:53.362819+0000","last_unstale":"2024-05-30T16:41:55.458336+0000","last_undegraded":"2024-05-30T16:41:55.458336+0000","last_fullsized":"2024-05-30T16:41:55.458336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456693+0000","last_change":"2024-05-30T16:41:52.336486+0000","last_active":"2024-05-30T16:41:55.456693+0000","last_peered":"2024-05-30T16:41:55.456693+0000","last_clean":"2024-05-30T16:41:55.456693+0000","last_became_active":"2024-05-30T16:41:52.336188+0000","last_became_peered":"2024-05-30T16:41:52.336188+0000","last_unstale":"2024-05-30T16:41:55.456693+0000","last_undegraded":"2024-05-30T16:41:55.456693+0000","last_fullsized":"2024-05-30T16:41:55.456693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353589+0000","last_change":"2024-05-30T16:41:53.356908+0000","last_active":"2024-05-30T16:41:54.353589+0000","last_peered":"2024-05-30T16:41:54.353589+0000","last_clean":"2024-05-30T16:41:54.353589+0000","last_became_active":"2024-05-30T16:41:53.356604+0000","last_became_peered":"2024-05-30T16:41:53.356604+0000","last_unstale":"2024-05-30T16:41:54.353589+0000","last_undegraded":"2024-05-30T16:41:54.353589+0000","last_fullsized":"2024-05-30T16:41:54.353589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359167+0000","last_change":"2024-05-30T16:41:52.340551+0000","last_active":"2024-05-30T16:41:54.359167+0000","last_peered":"2024-05-30T16:41:54.359167+0000","last_clean":"2024-05-30T16:41:54.359167+0000","last_became_active":"2024-05-30T16:41:52.340249+0000","last_became_peered":"2024-05-30T16:41:52.340249+0000","last_unstale":"2024-05-30T16:41:54.359167+0000","last_undegraded":"2024-05-30T16:41:54.359167+0000","last_fullsized":"2024-05-30T16:41:54.359167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457084+0000","last_change":"2024-05-30T16:41:53.366735+0000","last_active":"2024-05-30T16:41:55.457084+0000","last_peered":"2024-05-30T16:41:55.457084+0000","last_clean":"2024-05-30T16:41:55.457084+0000","last_became_active":"2024-05-30T16:41:53.362673+0000","last_became_peered":"2024-05-30T16:41:53.362673+0000","last_unstale":"2024-05-30T16:41:55.457084+0000","last_undegraded":"2024-05-30T16:41:55.457084+0000","last_fullsized":"2024-05-30T16:41:55.457084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:20:22.765092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457368+0000","last_change":"2024-05-30T16:41:52.343438+0000","last_active":"2024-05-30T16:41:55.457368+0000","last_peered":"2024-05-30T16:41:55.457368+0000","last_clean":"2024-05-30T16:41:55.457368+0000","last_became_active":"2024-05-30T16:41:52.342914+0000","last_became_peered":"2024-05-30T16:41:52.342914+0000","last_unstale":"2024-05-30T16:41:55.457368+0000","last_undegraded":"2024-05-30T16:41:55.457368+0000","last_fullsized":"2024-05-30T16:41:55.457368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457494+0000","last_change":"2024-05-30T16:41:53.362708+0000","last_active":"2024-05-30T16:41:55.457494+0000","last_peered":"2024-05-30T16:41:55.457494+0000","last_clean":"2024-05-30T16:41:55.457494+0000","last_became_active":"2024-05-30T16:41:53.362383+0000","last_became_peered":"2024-05-30T16:41:53.362383+0000","last_unstale":"2024-05-30T16:41:55.457494+0000","last_undegraded":"2024-05-30T16:41:55.457494+0000","last_fullsized":"2024-05-30T16:41:55.457494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353856+0000","last_change":"2024-05-30T16:41:52.340849+0000","last_active":"2024-05-30T16:41:54.353856+0000","last_peered":"2024-05-30T16:41:54.353856+0000","last_clean":"2024-05-30T16:41:54.353856+0000","last_became_active":"2024-05-30T16:41:52.340475+0000","last_became_peered":"2024-05-30T16:41:52.340475+0000","last_unstale":"2024-05-30T16:41:54.353856+0000","last_undegraded":"2024-05-30T16:41:54.353856+0000","last_fullsized":"2024-05-30T16:41:54.353856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358021+0000","last_change":"2024-05-30T16:41:53.363781+0000","last_active":"2024-05-30T16:41:54.358021+0000","last_peered":"2024-05-30T16:41:54.358021+0000","last_clean":"2024-05-30T16:41:54.358021+0000","last_became_active":"2024-05-30T16:41:53.353193+0000","last_became_peered":"2024-05-30T16:41:53.353193+0000","last_unstale":"2024-05-30T16:41:54.358021+0000","last_undegraded":"2024-05-30T16:41:54.358021+0000","last_fullsized":"2024-05-30T16:41:54.358021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:50.511215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359109+0000","last_change":"2024-05-30T16:41:52.334473+0000","last_active":"2024-05-30T16:41:54.359109+0000","last_peered":"2024-05-30T16:41:54.359109+0000","last_clean":"2024-05-30T16:41:54.359109+0000","last_became_active":"2024-05-30T16:41:52.333867+0000","last_became_peered":"2024-05-30T16:41:52.333867+0000","last_unstale":"2024-05-30T16:41:54.359109+0000","last_undegraded":"2024-05-30T16:41:54.359109+0000","last_fullsized":"2024-05-30T16:41:54.359109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473028+0000","last_change":"2024-05-30T16:41:53.359385+0000","last_active":"2024-05-30T16:41:54.473028+0000","last_peered":"2024-05-30T16:41:54.473028+0000","last_clean":"2024-05-30T16:41:54.473028+0000","last_became_active":"2024-05-30T16:41:53.356569+0000","last_became_peered":"2024-05-30T16:41:53.356569+0000","last_unstale":"2024-05-30T16:41:54.473028+0000","last_undegraded":"2024-05-30T16:41:54.473028+0000","last_fullsized":"2024-05-30T16:41:54.473028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:37:50.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457082+0000","last_change":"2024-05-30T16:41:52.334576+0000","last_active":"2024-05-30T16:41:55.457082+0000","last_peered":"2024-05-30T16:41:55.457082+0000","last_clean":"2024-05-30T16:41:55.457082+0000","last_became_active":"2024-05-30T16:41:52.334243+0000","last_became_peered":"2024-05-30T16:41:52.334243+0000","last_unstale":"2024-05-30T16:41:55.457082+0000","last_undegraded":"2024-05-30T16:41:55.457082+0000","last_fullsized":"2024-05-30T16:41:55.457082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:31.649153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456742+0000","last_change":"2024-05-30T16:41:53.363700+0000","last_active":"2024-05-30T16:41:55.456742+0000","last_peered":"2024-05-30T16:41:55.456742+0000","last_clean":"2024-05-30T16:41:55.456742+0000","last_became_active":"2024-05-30T16:41:53.363109+0000","last_became_peered":"2024-05-30T16:41:53.363109+0000","last_unstale":"2024-05-30T16:41:55.456742+0000","last_undegraded":"2024-05-30T16:41:55.456742+0000","last_fullsized":"2024-05-30T16:41:55.456742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456745+0000","last_change":"2024-05-30T16:41:52.337819+0000","last_active":"2024-05-30T16:41:55.456745+0000","last_peered":"2024-05-30T16:41:55.456745+0000","last_clean":"2024-05-30T16:41:55.456745+0000","last_became_active":"2024-05-30T16:41:52.337487+0000","last_became_peered":"2024-05-30T16:41:52.337487+0000","last_unstale":"2024-05-30T16:41:55.456745+0000","last_undegraded":"2024-05-30T16:41:55.456745+0000","last_fullsized":"2024-05-30T16:41:55.456745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473171+0000","last_change":"2024-05-30T16:41:53.353545+0000","last_active":"2024-05-30T16:41:54.473171+0000","last_peered":"2024-05-30T16:41:54.473171+0000","last_clean":"2024-05-30T16:41:54.473171+0000","last_became_active":"2024-05-30T16:41:53.353247+0000","last_became_peered":"2024-05-30T16:41:53.353247+0000","last_unstale":"2024-05-30T16:41:54.473171+0000","last_undegraded":"2024-05-30T16:41:54.473171+0000","last_fullsized":"2024-05-30T16:41:54.473171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:12:07.999320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357907+0000","last_change":"2024-05-30T16:41:52.328980+0000","last_active":"2024-05-30T16:41:54.357907+0000","last_peered":"2024-05-30T16:41:54.357907+0000","last_clean":"2024-05-30T16:41:54.357907+0000","last_became_active":"2024-05-30T16:41:52.328652+0000","last_became_peered":"2024-05-30T16:41:52.328652+0000","last_unstale":"2024-05-30T16:41:54.357907+0000","last_undegraded":"2024-05-30T16:41:54.357907+0000","last_fullsized":"2024-05-30T16:41:54.357907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:23.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357940+0000","last_change":"2024-05-30T16:41:53.358880+0000","last_active":"2024-05-30T16:41:54.357940+0000","last_peered":"2024-05-30T16:41:54.357940+0000","last_clean":"2024-05-30T16:41:54.357940+0000","last_became_active":"2024-05-30T16:41:53.358285+0000","last_became_peered":"2024-05-30T16:41:53.358285+0000","last_unstale":"2024-05-30T16:41:54.357940+0000","last_undegraded":"2024-05-30T16:41:54.357940+0000","last_fullsized":"2024-05-30T16:41:54.357940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.294851+0000","last_change":"2024-05-30T16:41:52.328717+0000","last_active":"2024-05-30T16:41:55.294851+0000","last_peered":"2024-05-30T16:41:55.294851+0000","last_clean":"2024-05-30T16:41:55.294851+0000","last_became_active":"2024-05-30T16:41:52.328423+0000","last_became_peered":"2024-05-30T16:41:52.328423+0000","last_unstale":"2024-05-30T16:41:55.294851+0000","last_undegraded":"2024-05-30T16:41:55.294851+0000","last_fullsized":"2024-05-30T16:41:55.294851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:49.630008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472391+0000","last_change":"2024-05-30T16:41:53.341566+0000","last_active":"2024-05-30T16:41:54.472391+0000","last_peered":"2024-05-30T16:41:54.472391+0000","last_clean":"2024-05-30T16:41:54.472391+0000","last_became_active":"2024-05-30T16:41:53.341079+0000","last_became_peered":"2024-05-30T16:41:53.341079+0000","last_unstale":"2024-05-30T16:41:54.472391+0000","last_undegraded":"2024-05-30T16:41:54.472391+0000","last_fullsized":"2024-05-30T16:41:54.472391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:45.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358659+0000","last_change":"2024-05-30T16:41:52.332813+0000","last_active":"2024-05-30T16:41:54.358659+0000","last_peered":"2024-05-30T16:41:54.358659+0000","last_clean":"2024-05-30T16:41:54.358659+0000","last_became_active":"2024-05-30T16:41:52.332521+0000","last_became_peered":"2024-05-30T16:41:52.332521+0000","last_unstale":"2024-05-30T16:41:54.358659+0000","last_undegraded":"2024-05-30T16:41:54.358659+0000","last_fullsized":"2024-05-30T16:41:54.358659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:22.977875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473787+0000","last_change":"2024-05-30T16:41:53.344857+0000","last_active":"2024-05-30T16:41:54.473787+0000","last_peered":"2024-05-30T16:41:54.473787+0000","last_clean":"2024-05-30T16:41:54.473787+0000","last_became_active":"2024-05-30T16:41:53.344411+0000","last_became_peered":"2024-05-30T16:41:53.344411+0000","last_unstale":"2024-05-30T16:41:54.473787+0000","last_undegraded":"2024-05-30T16:41:54.473787+0000","last_fullsized":"2024-05-30T16:41:54.473787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:52.685260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295183+0000","last_change":"2024-05-30T16:41:52.325985+0000","last_active":"2024-05-30T16:41:55.295183+0000","last_peered":"2024-05-30T16:41:55.295183+0000","last_clean":"2024-05-30T16:41:55.295183+0000","last_became_active":"2024-05-30T16:41:52.324383+0000","last_became_peered":"2024-05-30T16:41:52.324383+0000","last_unstale":"2024-05-30T16:41:55.295183+0000","last_undegraded":"2024-05-30T16:41:55.295183+0000","last_fullsized":"2024-05-30T16:41:55.295183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.474204+0000","last_change":"2024-05-30T16:41:53.353421+0000","last_active":"2024-05-30T16:41:54.474204+0000","last_peered":"2024-05-30T16:41:54.474204+0000","last_clean":"2024-05-30T16:41:54.474204+0000","last_became_active":"2024-05-30T16:41:53.353121+0000","last_became_peered":"2024-05-30T16:41:53.353121+0000","last_unstale":"2024-05-30T16:41:54.474204+0000","last_undegraded":"2024-05-30T16:41:54.474204+0000","last_fullsized":"2024-05-30T16:41:54.474204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:04.081864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.354077+0000","last_change":"2024-05-30T16:41:52.338368+0000","last_active":"2024-05-30T16:41:54.354077+0000","last_peered":"2024-05-30T16:41:54.354077+0000","last_clean":"2024-05-30T16:41:54.354077+0000","last_became_active":"2024-05-30T16:41:52.338036+0000","last_became_peered":"2024-05-30T16:41:52.338036+0000","last_unstale":"2024-05-30T16:41:54.354077+0000","last_undegraded":"2024-05-30T16:41:54.354077+0000","last_fullsized":"2024-05-30T16:41:54.354077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:49.498732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457474+0000","last_change":"2024-05-30T16:41:53.375844+0000","last_active":"2024-05-30T16:41:55.457474+0000","last_peered":"2024-05-30T16:41:55.457474+0000","last_clean":"2024-05-30T16:41:55.457474+0000","last_became_active":"2024-05-30T16:41:53.375574+0000","last_became_peered":"2024-05-30T16:41:53.375574+0000","last_unstale":"2024-05-30T16:41:55.457474+0000","last_undegraded":"2024-05-30T16:41:55.457474+0000","last_fullsized":"2024-05-30T16:41:55.457474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:09.648137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295130+0000","last_change":"2024-05-30T16:41:52.340534+0000","last_active":"2024-05-30T16:41:55.295130+0000","last_peered":"2024-05-30T16:41:55.295130+0000","last_clean":"2024-05-30T16:41:55.295130+0000","last_became_active":"2024-05-30T16:41:52.340157+0000","last_became_peered":"2024-05-30T16:41:52.340157+0000","last_unstale":"2024-05-30T16:41:55.295130+0000","last_undegraded":"2024-05-30T16:41:55.295130+0000","last_fullsized":"2024-05-30T16:41:55.295130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473453+0000","last_change":"2024-05-30T16:41:53.361217+0000","last_active":"2024-05-30T16:41:54.473453+0000","last_peered":"2024-05-30T16:41:54.473453+0000","last_clean":"2024-05-30T16:41:54.473453+0000","last_became_active":"2024-05-30T16:41:53.360593+0000","last_became_peered":"2024-05-30T16:41:53.360593+0000","last_unstale":"2024-05-30T16:41:54.473453+0000","last_undegraded":"2024-05-30T16:41:54.473453+0000","last_fullsized":"2024-05-30T16:41:54.473453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:56:37.884273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472880+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:41:54.472880+0000","last_peered":"2024-05-30T16:41:54.472880+0000","last_clean":"2024-05-30T16:41:54.472880+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:41:54.472880+0000","last_undegraded":"2024-05-30T16:41:54.472880+0000","last_fullsized":"2024-05-30T16:41:54.472880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456903+0000","last_change":"2024-05-30T16:41:52.336314+0000","last_active":"2024-05-30T16:41:55.456903+0000","last_peered":"2024-05-30T16:41:55.456903+0000","last_clean":"2024-05-30T16:41:55.456903+0000","last_became_active":"2024-05-30T16:41:52.335990+0000","last_became_peered":"2024-05-30T16:41:52.335990+0000","last_unstale":"2024-05-30T16:41:55.456903+0000","last_undegraded":"2024-05-30T16:41:55.456903+0000","last_fullsized":"2024-05-30T16:41:55.456903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458465+0000","last_change":"2024-05-30T16:41:53.363616+0000","last_active":"2024-05-30T16:41:55.458465+0000","last_peered":"2024-05-30T16:41:55.458465+0000","last_clean":"2024-05-30T16:41:55.458465+0000","last_became_active":"2024-05-30T16:41:53.363275+0000","last_became_peered":"2024-05-30T16:41:53.363275+0000","last_unstale":"2024-05-30T16:41:55.458465+0000","last_undegraded":"2024-05-30T16:41:55.458465+0000","last_fullsized":"2024-05-30T16:41:55.458465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472306+0000","last_change":"2024-05-30T16:41:52.342846+0000","last_active":"2024-05-30T16:41:54.472306+0000","last_peered":"2024-05-30T16:41:54.472306+0000","last_clean":"2024-05-30T16:41:54.472306+0000","last_became_active":"2024-05-30T16:41:52.342435+0000","last_became_peered":"2024-05-30T16:41:52.342435+0000","last_unstale":"2024-05-30T16:41:54.472306+0000","last_undegraded":"2024-05-30T16:41:54.472306+0000","last_fullsized":"2024-05-30T16:41:54.472306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:12:46.572059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456543+0000","last_change":"2024-05-30T16:41:53.369256+0000","last_active":"2024-05-30T16:41:55.456543+0000","last_peered":"2024-05-30T16:41:55.456543+0000","last_clean":"2024-05-30T16:41:55.456543+0000","last_became_active":"2024-05-30T16:41:53.368938+0000","last_became_peered":"2024-05-30T16:41:53.368938+0000","last_unstale":"2024-05-30T16:41:55.456543+0000","last_undegraded":"2024-05-30T16:41:55.456543+0000","last_fullsized":"2024-05-30T16:41:55.456543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:11:06.050717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295411+0000","last_change":"2024-05-30T16:41:52.326607+0000","last_active":"2024-05-30T16:41:55.295411+0000","last_peered":"2024-05-30T16:41:55.295411+0000","last_clean":"2024-05-30T16:41:55.295411+0000","last_became_active":"2024-05-30T16:41:52.326202+0000","last_became_peered":"2024-05-30T16:41:52.326202+0000","last_unstale":"2024-05-30T16:41:55.295411+0000","last_undegraded":"2024-05-30T16:41:55.295411+0000","last_fullsized":"2024-05-30T16:41:55.295411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353720+0000","last_change":"2024-05-30T16:41:53.354056+0000","last_active":"2024-05-30T16:41:54.353720+0000","last_peered":"2024-05-30T16:41:54.353720+0000","last_clean":"2024-05-30T16:41:54.353720+0000","last_became_active":"2024-05-30T16:41:53.353806+0000","last_became_peered":"2024-05-30T16:41:53.353806+0000","last_unstale":"2024-05-30T16:41:54.353720+0000","last_undegraded":"2024-05-30T16:41:54.353720+0000","last_fullsized":"2024-05-30T16:41:54.353720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456837+0000","last_change":"2024-05-30T16:41:52.341003+0000","last_active":"2024-05-30T16:41:55.456837+0000","last_peered":"2024-05-30T16:41:55.456837+0000","last_clean":"2024-05-30T16:41:55.456837+0000","last_became_active":"2024-05-30T16:41:52.340199+0000","last_became_peered":"2024-05-30T16:41:52.340199+0000","last_unstale":"2024-05-30T16:41:55.456837+0000","last_undegraded":"2024-05-30T16:41:55.456837+0000","last_fullsized":"2024-05-30T16:41:55.456837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357559+0000","last_change":"2024-05-30T16:41:53.363426+0000","last_active":"2024-05-30T16:41:54.357559+0000","last_peered":"2024-05-30T16:41:54.357559+0000","last_clean":"2024-05-30T16:41:54.357559+0000","last_became_active":"2024-05-30T16:41:53.363167+0000","last_became_peered":"2024-05-30T16:41:53.363167+0000","last_unstale":"2024-05-30T16:41:54.357559+0000","last_undegraded":"2024-05-30T16:41:54.357559+0000","last_fullsized":"2024-05-30T16:41:54.357559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:26.300947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353566+0000","last_change":"2024-05-30T16:41:52.335162+0000","last_active":"2024-05-30T16:41:54.353566+0000","last_peered":"2024-05-30T16:41:54.353566+0000","last_clean":"2024-05-30T16:41:54.353566+0000","last_became_active":"2024-05-30T16:41:52.334870+0000","last_became_peered":"2024-05-30T16:41:52.334870+0000","last_unstale":"2024-05-30T16:41:54.353566+0000","last_undegraded":"2024-05-30T16:41:54.353566+0000","last_fullsized":"2024-05-30T16:41:54.353566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457197+0000","last_change":"2024-05-30T16:41:53.374678+0000","last_active":"2024-05-30T16:41:55.457197+0000","last_peered":"2024-05-30T16:41:55.457197+0000","last_clean":"2024-05-30T16:41:55.457197+0000","last_became_active":"2024-05-30T16:41:53.374417+0000","last_became_peered":"2024-05-30T16:41:53.374417+0000","last_unstale":"2024-05-30T16:41:55.457197+0000","last_undegraded":"2024-05-30T16:41:55.457197+0000","last_fullsized":"2024-05-30T16:41:55.457197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:45.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473652+0000","last_change":"2024-05-30T16:41:52.345422+0000","last_active":"2024-05-30T16:41:54.473652+0000","last_peered":"2024-05-30T16:41:54.473652+0000","last_clean":"2024-05-30T16:41:54.473652+0000","last_became_active":"2024-05-30T16:41:52.345025+0000","last_became_peered":"2024-05-30T16:41:52.345025+0000","last_unstale":"2024-05-30T16:41:54.473652+0000","last_undegraded":"2024-05-30T16:41:54.473652+0000","last_fullsized":"2024-05-30T16:41:54.473652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:55.167706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353496+0000","last_change":"2024-05-30T16:41:53.354570+0000","last_active":"2024-05-30T16:41:54.353496+0000","last_peered":"2024-05-30T16:41:54.353496+0000","last_clean":"2024-05-30T16:41:54.353496+0000","last_became_active":"2024-05-30T16:41:53.353658+0000","last_became_peered":"2024-05-30T16:41:53.353658+0000","last_unstale":"2024-05-30T16:41:54.353496+0000","last_undegraded":"2024-05-30T16:41:54.353496+0000","last_fullsized":"2024-05-30T16:41:54.353496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.365566+0000","last_change":"2024-05-30T16:41:52.335427+0000","last_active":"2024-05-30T16:41:54.365566+0000","last_peered":"2024-05-30T16:41:54.365566+0000","last_clean":"2024-05-30T16:41:54.365566+0000","last_became_active":"2024-05-30T16:41:52.334938+0000","last_became_peered":"2024-05-30T16:41:52.334938+0000","last_unstale":"2024-05-30T16:41:54.365566+0000","last_undegraded":"2024-05-30T16:41:54.365566+0000","last_fullsized":"2024-05-30T16:41:54.365566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459967+0000","last_change":"2024-05-30T16:41:53.350035+0000","last_active":"2024-05-30T16:41:55.459967+0000","last_peered":"2024-05-30T16:41:55.459967+0000","last_clean":"2024-05-30T16:41:55.459967+0000","last_became_active":"2024-05-30T16:41:53.349514+0000","last_became_peered":"2024-05-30T16:41:53.349514+0000","last_unstale":"2024-05-30T16:41:55.459967+0000","last_undegraded":"2024-05-30T16:41:55.459967+0000","last_fullsized":"2024-05-30T16:41:55.459967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359122+0000","last_change":"2024-05-30T16:41:52.343555+0000","last_active":"2024-05-30T16:41:54.359122+0000","last_peered":"2024-05-30T16:41:54.359122+0000","last_clean":"2024-05-30T16:41:54.359122+0000","last_became_active":"2024-05-30T16:41:52.342980+0000","last_became_peered":"2024-05-30T16:41:52.342980+0000","last_unstale":"2024-05-30T16:41:54.359122+0000","last_undegraded":"2024-05-30T16:41:54.359122+0000","last_fullsized":"2024-05-30T16:41:54.359122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:49.498732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457706+0000","last_change":"2024-05-30T16:41:53.365631+0000","last_active":"2024-05-30T16:41:55.457706+0000","last_peered":"2024-05-30T16:41:55.457706+0000","last_clean":"2024-05-30T16:41:55.457706+0000","last_became_active":"2024-05-30T16:41:53.357804+0000","last_became_peered":"2024-05-30T16:41:53.357804+0000","last_unstale":"2024-05-30T16:41:55.457706+0000","last_undegraded":"2024-05-30T16:41:55.457706+0000","last_fullsized":"2024-05-30T16:41:55.457706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472293+0000","last_change":"2024-05-30T16:41:52.340095+0000","last_active":"2024-05-30T16:41:54.472293+0000","last_peered":"2024-05-30T16:41:54.472293+0000","last_clean":"2024-05-30T16:41:54.472293+0000","last_became_active":"2024-05-30T16:41:52.339769+0000","last_became_peered":"2024-05-30T16:41:52.339769+0000","last_unstale":"2024-05-30T16:41:54.472293+0000","last_undegraded":"2024-05-30T16:41:54.472293+0000","last_fullsized":"2024-05-30T16:41:54.472293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:16:18.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357172+0000","last_change":"2024-05-30T16:41:53.359564+0000","last_active":"2024-05-30T16:41:54.357172+0000","last_peered":"2024-05-30T16:41:54.357172+0000","last_clean":"2024-05-30T16:41:54.357172+0000","last_became_active":"2024-05-30T16:41:53.358733+0000","last_became_peered":"2024-05-30T16:41:53.358733+0000","last_unstale":"2024-05-30T16:41:54.357172+0000","last_undegraded":"2024-05-30T16:41:54.357172+0000","last_fullsized":"2024-05-30T16:41:54.357172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:50.153923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353727+0000","last_change":"2024-05-30T16:41:52.340268+0000","last_active":"2024-05-30T16:41:54.353727+0000","last_peered":"2024-05-30T16:41:54.353727+0000","last_clean":"2024-05-30T16:41:54.353727+0000","last_became_active":"2024-05-30T16:41:52.339896+0000","last_became_peered":"2024-05-30T16:41:52.339896+0000","last_unstale":"2024-05-30T16:41:54.353727+0000","last_undegraded":"2024-05-30T16:41:54.353727+0000","last_fullsized":"2024-05-30T16:41:54.353727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458359+0000","last_change":"2024-05-30T16:41:53.351989+0000","last_active":"2024-05-30T16:41:55.458359+0000","last_peered":"2024-05-30T16:41:55.458359+0000","last_clean":"2024-05-30T16:41:55.458359+0000","last_became_active":"2024-05-30T16:41:53.351579+0000","last_became_peered":"2024-05-30T16:41:53.351579+0000","last_unstale":"2024-05-30T16:41:55.458359+0000","last_undegraded":"2024-05-30T16:41:55.458359+0000","last_fullsized":"2024-05-30T16:41:55.458359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353390+0000","last_change":"2024-05-30T16:41:52.330661+0000","last_active":"2024-05-30T16:41:54.353390+0000","last_peered":"2024-05-30T16:41:54.353390+0000","last_clean":"2024-05-30T16:41:54.353390+0000","last_became_active":"2024-05-30T16:41:52.330239+0000","last_became_peered":"2024-05-30T16:41:52.330239+0000","last_unstale":"2024-05-30T16:41:54.353390+0000","last_undegraded":"2024-05-30T16:41:54.353390+0000","last_fullsized":"2024-05-30T16:41:54.353390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:23.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459438+0000","last_change":"2024-05-30T16:41:53.365561+0000","last_active":"2024-05-30T16:41:55.459438+0000","last_peered":"2024-05-30T16:41:55.459438+0000","last_clean":"2024-05-30T16:41:55.459438+0000","last_became_active":"2024-05-30T16:41:53.363963+0000","last_became_peered":"2024-05-30T16:41:53.363963+0000","last_unstale":"2024-05-30T16:41:55.459438+0000","last_undegraded":"2024-05-30T16:41:55.459438+0000","last_fullsized":"2024-05-30T16:41:55.459438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473668+0000","last_change":"2024-05-30T16:41:52.344910+0000","last_active":"2024-05-30T16:41:54.473668+0000","last_peered":"2024-05-30T16:41:54.473668+0000","last_clean":"2024-05-30T16:41:54.473668+0000","last_became_active":"2024-05-30T16:41:52.344564+0000","last_became_peered":"2024-05-30T16:41:52.344564+0000","last_unstale":"2024-05-30T16:41:54.473668+0000","last_undegraded":"2024-05-30T16:41:54.473668+0000","last_fullsized":"2024-05-30T16:41:54.473668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:11:05.038234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358176+0000","last_change":"2024-05-30T16:41:53.361266+0000","last_active":"2024-05-30T16:41:54.358176+0000","last_peered":"2024-05-30T16:41:54.358176+0000","last_clean":"2024-05-30T16:41:54.358176+0000","last_became_active":"2024-05-30T16:41:53.360980+0000","last_became_peered":"2024-05-30T16:41:53.360980+0000","last_unstale":"2024-05-30T16:41:54.358176+0000","last_undegraded":"2024-05-30T16:41:54.358176+0000","last_fullsized":"2024-05-30T16:41:54.358176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457189+0000","last_change":"2024-05-30T16:41:53.370166+0000","last_active":"2024-05-30T16:41:55.457189+0000","last_peered":"2024-05-30T16:41:55.457189+0000","last_clean":"2024-05-30T16:41:55.457189+0000","last_became_active":"2024-05-30T16:41:53.369830+0000","last_became_peered":"2024-05-30T16:41:53.369830+0000","last_unstale":"2024-05-30T16:41:55.457189+0000","last_undegraded":"2024-05-30T16:41:55.457189+0000","last_fullsized":"2024-05-30T16:41:55.457189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:08:24.828674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472946+0000","last_change":"2024-05-30T16:41:52.342853+0000","last_active":"2024-05-30T16:41:54.472946+0000","last_peered":"2024-05-30T16:41:54.472946+0000","last_clean":"2024-05-30T16:41:54.472946+0000","last_became_active":"2024-05-30T16:41:52.342459+0000","last_became_peered":"2024-05-30T16:41:52.342459+0000","last_unstale":"2024-05-30T16:41:54.472946+0000","last_undegraded":"2024-05-30T16:41:54.472946+0000","last_fullsized":"2024-05-30T16:41:54.472946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:52:34.598062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457125+0000","last_change":"2024-05-30T16:41:53.367020+0000","last_active":"2024-05-30T16:41:55.457125+0000","last_peered":"2024-05-30T16:41:55.457125+0000","last_clean":"2024-05-30T16:41:55.457125+0000","last_became_active":"2024-05-30T16:41:53.366745+0000","last_became_peered":"2024-05-30T16:41:53.366745+0000","last_unstale":"2024-05-30T16:41:55.457125+0000","last_undegraded":"2024-05-30T16:41:55.457125+0000","last_fullsized":"2024-05-30T16:41:55.457125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:35:37.949106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473358+0000","last_change":"2024-05-30T16:41:52.343170+0000","last_active":"2024-05-30T16:41:54.473358+0000","last_peered":"2024-05-30T16:41:54.473358+0000","last_clean":"2024-05-30T16:41:54.473358+0000","last_became_active":"2024-05-30T16:41:52.342743+0000","last_became_peered":"2024-05-30T16:41:52.342743+0000","last_unstale":"2024-05-30T16:41:54.473358+0000","last_undegraded":"2024-05-30T16:41:54.473358+0000","last_fullsized":"2024-05-30T16:41:54.473358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:02.431665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457471+0000","last_change":"2024-05-30T16:41:53.364283+0000","last_active":"2024-05-30T16:41:55.457471+0000","last_peered":"2024-05-30T16:41:55.457471+0000","last_clean":"2024-05-30T16:41:55.457471+0000","last_became_active":"2024-05-30T16:41:53.362510+0000","last_became_peered":"2024-05-30T16:41:53.362510+0000","last_unstale":"2024-05-30T16:41:55.457471+0000","last_undegraded":"2024-05-30T16:41:55.457471+0000","last_fullsized":"2024-05-30T16:41:55.457471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.460118+0000","last_change":"2024-05-30T16:41:52.333188+0000","last_active":"2024-05-30T16:41:55.460118+0000","last_peered":"2024-05-30T16:41:55.460118+0000","last_clean":"2024-05-30T16:41:55.460118+0000","last_became_active":"2024-05-30T16:41:52.332987+0000","last_became_peered":"2024-05-30T16:41:52.332987+0000","last_unstale":"2024-05-30T16:41:55.460118+0000","last_undegraded":"2024-05-30T16:41:55.460118+0000","last_fullsized":"2024-05-30T16:41:55.460118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.460122+0000","last_change":"2024-05-30T16:41:53.360296+0000","last_active":"2024-05-30T16:41:55.460122+0000","last_peered":"2024-05-30T16:41:55.460122+0000","last_clean":"2024-05-30T16:41:55.460122+0000","last_became_active":"2024-05-30T16:41:53.360008+0000","last_became_peered":"2024-05-30T16:41:53.360008+0000","last_unstale":"2024-05-30T16:41:55.460122+0000","last_undegraded":"2024-05-30T16:41:55.460122+0000","last_fullsized":"2024-05-30T16:41:55.460122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:11.943106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457581+0000","last_change":"2024-05-30T16:41:52.337440+0000","last_active":"2024-05-30T16:41:55.457581+0000","last_peered":"2024-05-30T16:41:55.457581+0000","last_clean":"2024-05-30T16:41:55.457581+0000","last_became_active":"2024-05-30T16:41:52.337136+0000","last_became_peered":"2024-05-30T16:41:52.337136+0000","last_unstale":"2024-05-30T16:41:55.457581+0000","last_undegraded":"2024-05-30T16:41:55.457581+0000","last_fullsized":"2024-05-30T16:41:55.457581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:17.345557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:41:58.235 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:41:58.236 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-30T16:41:58.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-30T16:41:58.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-30T16:41:58.236 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-30T16:41:58.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.453+0000 7f0038800640 1 Processor -- start 2024-05-30T16:41:58.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.453+0000 7f0038800640 1 -- start start 2024-05-30T16:41:58.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.454+0000 7f0038800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0030145150 0x7f00300cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.454+0000 7f0038800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f003006f7e0 0x7f00300b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.454+0000 7f0038800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00300d00f0 con 0x7f00300cfa70 2024-05-30T16:41:58.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.454+0000 7f0038800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f00300cfeb0 con 0x7f003006f7e0 2024-05-30T16:41:58.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.454+0000 7f0038800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f003015f140 con 0x7f0030145150 2024-05-30T16:41:58.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.454+0000 7f0036800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f003006f7e0 0x7f00300b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:58.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.455+0000 7f0036800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f003006f7e0 0x7f00300b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58758/0 (socket says 172.21.15.144:58758) 2024-05-30T16:41:58.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.455+0000 7f0036800640 1 -- 172.21.15.144:0/676113570 learned_addr learned my addr 172.21.15.144:0/676113570 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:58.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.455+0000 7f0036800640 1 -- 172.21.15.144:0/676113570 >> v2:172.21.15.149:3300/0 conn(0x7f0030145150 msgr2=0x7f00300cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:58.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.455+0000 7f0036800640 1 --2- 172.21.15.144:0/676113570 >> v2:172.21.15.149:3300/0 conn(0x7f0030145150 0x7f00300cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.455+0000 7f0036800640 1 -- 172.21.15.144:0/676113570 >> v1:172.21.15.149:6789/0 conn(0x7f00300cfa70 legacy=0x7f003006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:58.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.455+0000 7f0036800640 1 -- 172.21.15.144:0/676113570 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003015f390 con 0x7f003006f7e0 2024-05-30T16:41:58.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.456+0000 7f0036800640 1 --2- 172.21.15.144:0/676113570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f003006f7e0 0x7f00300b4930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00300b3db0 tx=0x7f002c02c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceeac2e9f19d7a60 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:58.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.456+0000 7f0034a00640 1 -- 172.21.15.144:0/676113570 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c039070 con 0x7f003006f7e0 2024-05-30T16:41:58.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.456+0000 7f0034a00640 1 -- 172.21.15.144:0/676113570 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c00b2d0 con 0x7f003006f7e0 2024-05-30T16:41:58.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.456+0000 7f0034a00640 1 -- 172.21.15.144:0/676113570 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c00b480 con 0x7f003006f7e0 2024-05-30T16:41:58.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.457+0000 7f0038800640 1 -- 172.21.15.144:0/676113570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f003006f7e0 msgr2=0x7f00300b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.457+0000 7f0038800640 1 --2- 172.21.15.144:0/676113570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f003006f7e0 0x7f00300b4930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00300b3db0 tx=0x7f002c02c870 comp rx=0 tx=0).stop 2024-05-30T16:41:58.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.457+0000 7f0038800640 1 -- 172.21.15.144:0/676113570 shutdown_connections 2024-05-30T16:41:58.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.457+0000 7f0038800640 1 --2- 172.21.15.144:0/676113570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f003006f7e0 0x7f00300b4930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.457+0000 7f0038800640 1 --2- 172.21.15.144:0/676113570 >> v2:172.21.15.149:3300/0 conn(0x7f0030145150 0x7f00300cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.457+0000 7f0038800640 1 -- 172.21.15.144:0/676113570 >> 172.21.15.144:0/676113570 conn(0x7f003006bd00 msgr2=0x7f003006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:58.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.457+0000 7f0038800640 1 -- 172.21.15.144:0/676113570 shutdown_connections 2024-05-30T16:41:58.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.457+0000 7f0038800640 1 -- 172.21.15.144:0/676113570 wait complete. 2024-05-30T16:41:58.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.459+0000 7f0038800640 1 Processor -- start 2024-05-30T16:41:58.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.459+0000 7f0038800640 1 -- start start 2024-05-30T16:41:58.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0038800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003006f7e0 0x7f003015ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0038800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00300cfa70 0x7f00300b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0038800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0030145150 0x7f00300b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0038800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00300b64f0 con 0x7f00300cfa70 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0038800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f003015f950 con 0x7f003006f7e0 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0038800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f003015fe70 con 0x7f0030145150 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0035400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00300cfa70 0x7f00300b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0035400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00300cfa70 0x7f00300b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58768/0 (socket says 172.21.15.144:58768) 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0035400640 1 -- 172.21.15.144:0/2440418966 learned_addr learned my addr 172.21.15.144:0/2440418966 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0035e00640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003006f7e0 0x7f003015ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0036800640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0030145150 0x7f00300b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0035400640 1 -- 172.21.15.144:0/2440418966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0030145150 msgr2=0x7f00300b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0035400640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0030145150 0x7f00300b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0035400640 1 -- 172.21.15.144:0/2440418966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003006f7e0 msgr2=0x7f003015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0035400640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003006f7e0 0x7f003015ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.460+0000 7f0035400640 1 -- 172.21.15.144:0/2440418966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00300b2220 con 0x7f00300cfa70 2024-05-30T16:41:58.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.461+0000 7f0035400640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00300cfa70 0x7f00300b16b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f002000c410 tx=0x7f002000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:58.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.461+0000 7f002a000640 1 -- 172.21.15.144:0/2440418966 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020017070 con 0x7f00300cfa70 2024-05-30T16:41:58.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.461+0000 7f002a000640 1 -- 172.21.15.144:0/2440418966 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00200035f0 con 0x7f00300cfa70 2024-05-30T16:41:58.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.461+0000 7f002a000640 1 -- 172.21.15.144:0/2440418966 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020003a20 con 0x7f00300cfa70 2024-05-30T16:41:58.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.461+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00300b2500 con 0x7f00300cfa70 2024-05-30T16:41:58.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.461+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00300b2ac0 con 0x7f00300cfa70 2024-05-30T16:41:58.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.462+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0030068b90 con 0x7f00300cfa70 2024-05-30T16:41:58.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.463+0000 7f002a000640 1 -- 172.21.15.144:0/2440418966 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f002001a070 con 0x7f00300cfa70 2024-05-30T16:41:58.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.464+0000 7f002a000640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f001406c8f0 0x7f001406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.464+0000 7f002a000640 1 -- 172.21.15.144:0/2440418966 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f002008b0a0 con 0x7f00300cfa70 2024-05-30T16:41:58.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.464+0000 7f0035e00640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f001406c8f0 0x7f001406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:58.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.465+0000 7f0035e00640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f001406c8f0 0x7f001406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f003006f700 tx=0x7f0024008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:58.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.468+0000 7f002a000640 1 -- 172.21.15.144:0/2440418966 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0020059430 con 0x7f00300cfa70 2024-05-30T16:41:58.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.700+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f003006c380 con 0x7f00300cfa70 2024-05-30T16:41:58.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.705+0000 7f002a000640 1 -- 172.21.15.144:0/2440418966 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174144 (secure 0 0 0) 0x7f0020058d30 con 0x7f00300cfa70 2024-05-30T16:41:58.709 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:58.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f001406c8f0 msgr2=0x7f001406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f001406c8f0 0x7f001406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f003006f700 tx=0x7f0024008040 comp rx=0 tx=0).stop 2024-05-30T16:41:58.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00300cfa70 msgr2=0x7f00300b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00300cfa70 0x7f00300b16b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f002000c410 tx=0x7f002000c8d0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 shutdown_connections 2024-05-30T16:41:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f001406c8f0 0x7f001406edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0030145150 0x7f00300b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00300cfa70 0x7f00300b16b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 --2- 172.21.15.144:0/2440418966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003006f7e0 0x7f003015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 >> 172.21.15.144:0/2440418966 conn(0x7f003006bd00 msgr2=0x7f00300b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 shutdown_connections 2024-05-30T16:41:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.709+0000 7f0038800640 1 -- 172.21.15.144:0/2440418966 wait complete. 2024-05-30T16:41:58.728 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2157301613},{"type":"v1","addr":"172.21.15.144:6833","nonce":2157301613}]},"active_addr":"172.21.15.144:6833/2157301613","active_change":"2024-05-30T16:41:32.874877+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":3992285770}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":4202109605}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":1210541022}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":2893574224}]}]} 2024-05-30T16:41:58.731 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-30T16:41:58.731 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-30T16:41:58.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:41:58.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.918+0000 7ff89ca00640 1 Processor -- start 2024-05-30T16:41:58.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.918+0000 7ff89ca00640 1 -- start start 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.919+0000 7ff89ca00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff89806f670 0x7ff8980b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.919+0000 7ff89ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff89806bff0 0x7ff89815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.919+0000 7ff89ca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8980cab30 con 0x7ff8980cf300 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.919+0000 7ff89ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff89815b090 con 0x7ff89806bff0 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.919+0000 7ff89ca00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff8980cf950 con 0x7ff89806f670 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff895e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff8980cf300 0x7ff89806b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54658/0 (socket says 172.21.15.144:54658) 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff895e00640 1 -- 172.21.15.144:0/2882205152 learned_addr learned my addr 172.21.15.144:0/2882205152 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff897200640 1 --2- 172.21.15.144:0/2882205152 >> v2:172.21.15.144:3300/0 conn(0x7ff89806bff0 0x7ff89815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff896800640 1 --2- 172.21.15.144:0/2882205152 >> v2:172.21.15.149:3300/0 conn(0x7ff89806f670 0x7ff8980b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff895400640 1 -- 172.21.15.144:0/2882205152 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400305743 0 0) 0x7ff8980cab30 con 0x7ff8980cf300 2024-05-30T16:41:58.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff895400640 1 -- 172.21.15.144:0/2882205152 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff87c003520 con 0x7ff8980cf300 2024-05-30T16:41:58.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff897200640 1 -- 172.21.15.144:0/2882205152 >> v2:172.21.15.149:3300/0 conn(0x7ff89806f670 msgr2=0x7ff8980b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:58.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff897200640 1 --2- 172.21.15.144:0/2882205152 >> v2:172.21.15.149:3300/0 conn(0x7ff89806f670 0x7ff8980b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff897200640 1 -- 172.21.15.144:0/2882205152 >> v1:172.21.15.144:6789/0 conn(0x7ff8980cf300 legacy=0x7ff89806b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.920+0000 7ff897200640 1 -- 172.21.15.144:0/2882205152 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8980cfc30 con 0x7ff89806bff0 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.921+0000 7ff897200640 1 --2- 172.21.15.144:0/2882205152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 0x7ff89815ec50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff890009d90 tx=0x7ff89002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7824e7be1d42fa67 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff895400640 1 -- 172.21.15.144:0/2882205152 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890007740 con 0x7ff89806bff0 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff895400640 1 -- 172.21.15.144:0/2882205152 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8900078e0 con 0x7ff89806bff0 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff895400640 1 -- 172.21.15.144:0/2882205152 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890007cb0 con 0x7ff89806bff0 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff89ca00640 1 -- 172.21.15.144:0/2882205152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 msgr2=0x7ff89815ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff89ca00640 1 --2- 172.21.15.144:0/2882205152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 0x7ff89815ec50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff890009d90 tx=0x7ff89002a6a0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff89ca00640 1 -- 172.21.15.144:0/2882205152 shutdown_connections 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff89ca00640 1 --2- 172.21.15.144:0/2882205152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 0x7ff89815ec50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff89ca00640 1 --2- 172.21.15.144:0/2882205152 >> v2:172.21.15.149:3300/0 conn(0x7ff89806f670 0x7ff8980b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff89ca00640 1 -- 172.21.15.144:0/2882205152 >> 172.21.15.144:0/2882205152 conn(0x7ff8980b20a0 msgr2=0x7ff8980b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff89ca00640 1 -- 172.21.15.144:0/2882205152 shutdown_connections 2024-05-30T16:41:58.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.922+0000 7ff89ca00640 1 -- 172.21.15.144:0/2882205152 wait complete. 2024-05-30T16:41:58.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.924+0000 7ff89ca00640 1 Processor -- start 2024-05-30T16:41:58.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.924+0000 7ff89ca00640 1 -- start start 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.925+0000 7ff89ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 0x7ff898145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.925+0000 7ff89ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89806f670 0x7ff898148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.925+0000 7ff89ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8980cf300 0x7ff89814bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.925+0000 7ff89ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff8980ca840 con 0x7ff89806bff0 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.925+0000 7ff89ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff89815e730 con 0x7ff8980cf300 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.925+0000 7ff89ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff89806fa50 con 0x7ff89806f670 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.925+0000 7ff896800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 0x7ff898145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.925+0000 7ff896800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 0x7ff898145ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58784/0 (socket says 172.21.15.144:58784) 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.925+0000 7ff896800640 1 -- 172.21.15.144:0/2094897755 learned_addr learned my addr 172.21.15.144:0/2094897755 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff896800640 1 -- 172.21.15.144:0/2094897755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89806f670 msgr2=0x7ff898148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff896800640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89806f670 0x7ff898148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff896800640 1 -- 172.21.15.144:0/2094897755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8980cf300 msgr2=0x7ff89814bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff896800640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8980cf300 0x7ff89814bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff896800640 1 -- 172.21.15.144:0/2094897755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8980738c0 con 0x7ff89806bff0 2024-05-30T16:41:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff896800640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 0x7ff898145ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff88800e9b0 tx=0x7ff88800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff88ea00640 1 -- 172.21.15.144:0/2094897755 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888017070 con 0x7ff89806bff0 2024-05-30T16:41:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff88ea00640 1 -- 172.21.15.144:0/2094897755 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88800c9a0 con 0x7ff89806bff0 2024-05-30T16:41:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff898073600 con 0x7ff89806bff0 2024-05-30T16:41:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff88ea00640 1 -- 172.21.15.144:0/2094897755 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88800cd90 con 0x7ff89806bff0 2024-05-30T16:41:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.926+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89814b4f0 con 0x7ff89806bff0 2024-05-30T16:41:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.927+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff898075570 con 0x7ff89806bff0 2024-05-30T16:41:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.928+0000 7ff88ea00640 1 -- 172.21.15.144:0/2094897755 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff88801a070 con 0x7ff89806bff0 2024-05-30T16:41:58.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.929+0000 7ff88ea00640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87806c8f0 0x7ff87806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:58.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.929+0000 7ff88ea00640 1 -- 172.21.15.144:0/2094897755 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff88808bad0 con 0x7ff89806bff0 2024-05-30T16:41:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.929+0000 7ff895e00640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87806c8f0 0x7ff87806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.930+0000 7ff895e00640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87806c8f0 0x7ff87806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff884000f60 tx=0x7ff8840078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:58.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:58.933+0000 7ff88ea00640 1 -- 172.21.15.144:0/2094897755 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff888059f90 con 0x7ff89806bff0 2024-05-30T16:41:59.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.137+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8980b47d0 con 0x7ff89806bff0 2024-05-30T16:41:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.139+0000 7ff88ea00640 1 -- 172.21.15.144:0/2094897755 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7ff888059890 con 0x7ff89806bff0 2024-05-30T16:41:59.140 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:59.141 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:54.340246+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:41:50.922058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:41:51.739937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:41:59.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87806c8f0 msgr2=0x7ff87806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87806c8f0 0x7ff87806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff884000f60 tx=0x7ff8840078f0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 msgr2=0x7ff898145ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 0x7ff898145ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff88800e9b0 tx=0x7ff88800ee70 comp rx=0 tx=0).stop 2024-05-30T16:41:59.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 shutdown_connections 2024-05-30T16:41:59.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87806c8f0 0x7ff87806edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8980cf300 0x7ff89814bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89806f670 0x7ff898148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 --2- 172.21.15.144:0/2094897755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89806bff0 0x7ff898145ab0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 >> 172.21.15.144:0/2094897755 conn(0x7ff8980b20a0 msgr2=0x7ff898155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 shutdown_connections 2024-05-30T16:41:59.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.142+0000 7ff89ca00640 1 -- 172.21.15.144:0/2094897755 wait complete. 2024-05-30T16:41:59.161 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-30T16:41:59.162 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:41:59.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.351+0000 7f0973c00640 1 Processor -- start 2024-05-30T16:41:59.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.352+0000 7f0973c00640 1 -- start start 2024-05-30T16:41:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.353+0000 7f0973c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f096c145150 0x7f096c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.353+0000 7f0973c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c0cfa70 0x7f096c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.353+0000 7f0973c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c0d00f0 con 0x7f096c06f610 2024-05-30T16:41:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.353+0000 7f0973c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f096c0cfeb0 con 0x7f096c145150 2024-05-30T16:41:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.353+0000 7f0973c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f096c15f140 con 0x7f096c0cfa70 2024-05-30T16:41:59.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.354+0000 7f0963e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c0cfa70 0x7f096c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.354+0000 7f0963e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c0cfa70 0x7f096c06f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:34824/0 (socket says 172.21.15.144:34824) 2024-05-30T16:41:59.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.354+0000 7f0963e00640 1 -- 172.21.15.144:0/817190061 learned_addr learned my addr 172.21.15.144:0/817190061 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.354+0000 7f0971200640 1 --2- 172.21.15.144:0/817190061 >> v2:172.21.15.149:3300/0 conn(0x7f096c145150 0x7f096c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.354+0000 7f0963e00640 1 -- 172.21.15.144:0/817190061 >> v2:172.21.15.149:3300/0 conn(0x7f096c145150 msgr2=0x7f096c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.354+0000 7f0963e00640 1 --2- 172.21.15.144:0/817190061 >> v2:172.21.15.149:3300/0 conn(0x7f096c145150 0x7f096c0cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.354+0000 7f0963e00640 1 -- 172.21.15.144:0/817190061 >> v1:172.21.15.149:6789/0 conn(0x7f096c06f610 legacy=0x7f096c072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.354+0000 7f0963e00640 1 -- 172.21.15.144:0/817190061 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c15f390 con 0x7f096c0cfa70 2024-05-30T16:41:59.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.356+0000 7f0963e00640 1 --2- 172.21.15.144:0/817190061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c0cfa70 0x7f096c06f0d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0954009870 tx=0x7f095402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c5613241cba987 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.356+0000 7f096be00640 1 -- 172.21.15.144:0/817190061 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954037070 con 0x7f096c0cfa70 2024-05-30T16:41:59.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.356+0000 7f096be00640 1 -- 172.21.15.144:0/817190061 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0954032440 con 0x7f096c0cfa70 2024-05-30T16:41:59.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.356+0000 7f096be00640 1 -- 172.21.15.144:0/817190061 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954032810 con 0x7f096c0cfa70 2024-05-30T16:41:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.356+0000 7f0973c00640 1 -- 172.21.15.144:0/817190061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c0cfa70 msgr2=0x7f096c06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.356+0000 7f0973c00640 1 --2- 172.21.15.144:0/817190061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c0cfa70 0x7f096c06f0d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0954009870 tx=0x7f095402a1c0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.357+0000 7f0973c00640 1 -- 172.21.15.144:0/817190061 shutdown_connections 2024-05-30T16:41:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.357+0000 7f0973c00640 1 --2- 172.21.15.144:0/817190061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c0cfa70 0x7f096c06f0d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.357+0000 7f0973c00640 1 --2- 172.21.15.144:0/817190061 >> v2:172.21.15.149:3300/0 conn(0x7f096c145150 0x7f096c0cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.357+0000 7f0973c00640 1 -- 172.21.15.144:0/817190061 >> 172.21.15.144:0/817190061 conn(0x7f096c06bd00 msgr2=0x7f096c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.357+0000 7f0973c00640 1 -- 172.21.15.144:0/817190061 shutdown_connections 2024-05-30T16:41:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.357+0000 7f0973c00640 1 -- 172.21.15.144:0/817190061 wait complete. 2024-05-30T16:41:59.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.358+0000 7f0973c00640 1 Processor -- start 2024-05-30T16:41:59.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.359+0000 7f0973c00640 1 -- start start 2024-05-30T16:41:59.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.359+0000 7f0973c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c06f610 0x7f096c1f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.359+0000 7f0973c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096c0cfa70 0x7f096c1306c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.359+0000 7f0973c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f096c145150 0x7f096c130c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.359+0000 7f0973c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f096c0b64f0 con 0x7f096c0cfa70 2024-05-30T16:41:59.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.359+0000 7f0973c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f096c15f950 con 0x7f096c145150 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0973c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f096c15fe70 con 0x7f096c06f610 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0963e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096c0cfa70 0x7f096c1306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0963e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096c0cfa70 0x7f096c1306c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58796/0 (socket says 172.21.15.144:58796) 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0963e00640 1 -- 172.21.15.144:0/3775296337 learned_addr learned my addr 172.21.15.144:0/3775296337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0971c00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f096c145150 0x7f096c130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0971200640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c06f610 0x7f096c1f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0963e00640 1 -- 172.21.15.144:0/3775296337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c06f610 msgr2=0x7f096c1f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0963e00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c06f610 0x7f096c1f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0963e00640 1 -- 172.21.15.144:0/3775296337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f096c145150 msgr2=0x7f096c130c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0963e00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f096c145150 0x7f096c130c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.360+0000 7f0963e00640 1 -- 172.21.15.144:0/3775296337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c0aa270 con 0x7f096c0cfa70 2024-05-30T16:41:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.361+0000 7f0963e00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096c0cfa70 0x7f096c1306c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0954000c00 tx=0x7f09540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.361+0000 7f0969600640 1 -- 172.21.15.144:0/3775296337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954041070 con 0x7f096c0cfa70 2024-05-30T16:41:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.361+0000 7f0969600640 1 -- 172.21.15.144:0/3775296337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095403c890 con 0x7f096c0cfa70 2024-05-30T16:41:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.361+0000 7f0969600640 1 -- 172.21.15.144:0/3775296337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954037040 con 0x7f096c0cfa70 2024-05-30T16:41:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.361+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c0aa550 con 0x7f096c0cfa70 2024-05-30T16:41:59.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.361+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c0aab10 con 0x7f096c0cfa70 2024-05-30T16:41:59.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.362+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c0aaef0 con 0x7f096c0cfa70 2024-05-30T16:41:59.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.363+0000 7f0969600640 1 -- 172.21.15.144:0/3775296337 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0954044070 con 0x7f096c0cfa70 2024-05-30T16:41:59.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.364+0000 7f0969600640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f094806c8f0 0x7f094806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.364+0000 7f0969600640 1 -- 172.21.15.144:0/3775296337 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f09540ac620 con 0x7f096c0cfa70 2024-05-30T16:41:59.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.364+0000 7f0971200640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f094806c8f0 0x7f094806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.365+0000 7f0971200640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f094806c8f0 0x7f094806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f095c009a30 tx=0x7f095c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.369+0000 7f0969600640 1 -- 172.21.15.144:0/3775296337 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f096c0aaef0 con 0x7f096c0cfa70 2024-05-30T16:41:59.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.567+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f096c068b90 con 0x7f096c0cfa70 2024-05-30T16:41:59.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.570+0000 7f0969600640 1 -- 172.21.15.144:0/3775296337 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f095407ab60 con 0x7f096c0cfa70 2024-05-30T16:41:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:41:59.571 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:54.340246+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:41:50.922058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:41:51.739937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f094806c8f0 msgr2=0x7f094806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f094806c8f0 0x7f094806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f095c009a30 tx=0x7f095c008040 comp rx=0 tx=0).stop 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096c0cfa70 msgr2=0x7f096c1306c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096c0cfa70 0x7f096c1306c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0954000c00 tx=0x7f09540046c0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 shutdown_connections 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f094806c8f0 0x7f094806edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f096c145150 0x7f096c130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096c0cfa70 0x7f096c1306c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 --2- 172.21.15.144:0/3775296337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096c06f610 0x7f096c1f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.572+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 >> 172.21.15.144:0/3775296337 conn(0x7f096c06bd00 msgr2=0x7f096c0cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.573+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 shutdown_connections 2024-05-30T16:41:59.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.573+0000 7f0973c00640 1 -- 172.21.15.144:0/3775296337 wait complete. 2024-05-30T16:41:59.592 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-30T16:41:59.592 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-30T16:41:59.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-30T16:41:59.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-30T16:41:59.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-30T16:41:59.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-30T16:41:59.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-30T16:41:59.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-30T16:41:59.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.871+0000 7feb75800640 1 Processor -- start 2024-05-30T16:41:59.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.871+0000 7feb75800640 1 -- start start 2024-05-30T16:41:59.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.873+0000 7feb75800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb700cdb50 0x7feb700cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.873+0000 7feb75800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb700ce000 con 0x7feb7015c490 2024-05-30T16:41:59.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.873+0000 7feb75800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb700ce2e0 con 0x7feb700cf7a0 2024-05-30T16:41:59.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.873+0000 7feb75800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7feb700cfc00 con 0x7feb700cdb50 2024-05-30T16:41:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.874+0000 7feb6e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb700cdb50 0x7feb700cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.874+0000 7feb6ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7feb7015c490 0x7feb700cd440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54674/0 (socket says 172.21.15.144:54674) 2024-05-30T16:41:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.874+0000 7feb6ea00640 1 -- 172.21.15.144:0/2031378093 learned_addr learned my addr 172.21.15.144:0/2031378093 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.876+0000 7feb6e000640 1 -- 172.21.15.144:0/2031378093 >> v1:172.21.15.149:6789/0 conn(0x7feb700cf7a0 legacy=0x7feb700b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.876+0000 7feb6e000640 1 -- 172.21.15.144:0/2031378093 >> v1:172.21.15.144:6789/0 conn(0x7feb7015c490 legacy=0x7feb700cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.876+0000 7feb6e000640 1 -- 172.21.15.144:0/2031378093 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb700ce5c0 con 0x7feb700cdb50 2024-05-30T16:41:59.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.878+0000 7feb6e000640 1 --2- 172.21.15.144:0/2031378093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb700cdb50 0x7feb700cf260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb58009a00 tx=0x7feb5802a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91c5e18c65d6d6b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.879+0000 7feb6d600640 1 -- 172.21.15.144:0/2031378093 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58036070 con 0x7feb700cdb50 2024-05-30T16:41:59.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.879+0000 7feb6d600640 1 -- 172.21.15.144:0/2031378093 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb58031600 con 0x7feb700cdb50 2024-05-30T16:41:59.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.879+0000 7feb6d600640 1 -- 172.21.15.144:0/2031378093 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580319d0 con 0x7feb700cdb50 2024-05-30T16:41:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.880+0000 7feb75800640 1 -- 172.21.15.144:0/2031378093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb700cdb50 msgr2=0x7feb700cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.880+0000 7feb75800640 1 --2- 172.21.15.144:0/2031378093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb700cdb50 0x7feb700cf260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb58009a00 tx=0x7feb5802a430 comp rx=0 tx=0).stop 2024-05-30T16:41:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.880+0000 7feb75800640 1 -- 172.21.15.144:0/2031378093 shutdown_connections 2024-05-30T16:41:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.880+0000 7feb75800640 1 --2- 172.21.15.144:0/2031378093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb700cdb50 0x7feb700cf260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.880+0000 7feb75800640 1 -- 172.21.15.144:0/2031378093 >> 172.21.15.144:0/2031378093 conn(0x7feb7006dee0 msgr2=0x7feb7006e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.880+0000 7feb75800640 1 -- 172.21.15.144:0/2031378093 shutdown_connections 2024-05-30T16:41:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.881+0000 7feb75800640 1 -- 172.21.15.144:0/2031378093 wait complete. 2024-05-30T16:41:59.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.881+0000 7ff4e1e00640 1 Processor -- start 2024-05-30T16:41:59.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.881+0000 7ff4e1e00640 1 -- start start 2024-05-30T16:41:59.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.883+0000 7feb75800640 1 Processor -- start 2024-05-30T16:41:59.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7feb75800640 1 -- start start 2024-05-30T16:41:59.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.883+0000 7ff4e1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4dc15eb80 0x7ff4dc162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.883+0000 7ff4e1e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff4dc0cfc70 0x7ff4dc0d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.883+0000 7ff4e1e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4dc163550 con 0x7ff4dc0ba2b0 2024-05-30T16:41:59.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7ff4e1e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff4dc15ef60 con 0x7ff4dc15eb80 2024-05-30T16:41:59.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7ff4e1e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff4dc162f90 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7ff4da000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff4dc0ba2b0 0x7ff4dc0cf560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54680/0 (socket says 172.21.15.144:54680) 2024-05-30T16:41:59.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7ff4da000640 1 -- 172.21.15.144:0/3792513334 learned_addr learned my addr 172.21.15.144:0/3792513334 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:59.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7f04d1800640 1 Processor -- start 2024-05-30T16:41:59.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7efd61400640 1 Processor -- start 2024-05-30T16:41:59.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7efd61400640 1 -- start start 2024-05-30T16:41:59.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7ff4db400640 1 --2- 172.21.15.144:0/3792513334 >> v2:172.21.15.149:3300/0 conn(0x7ff4dc0cfc70 0x7ff4dc0d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.885+0000 7ff4daa00640 1 --2- 172.21.15.144:0/3792513334 >> v2:172.21.15.144:3300/0 conn(0x7ff4dc15eb80 0x7ff4dc162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7f7ff6800640 1 Processor -- start 2024-05-30T16:41:59.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.884+0000 7f7ff6800640 1 -- start start 2024-05-30T16:41:59.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.885+0000 7ff4d9600640 1 -- 172.21.15.144:0/3792513334 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 623559593 0 0) 0x7ff4dc163550 con 0x7ff4dc0ba2b0 2024-05-30T16:41:59.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.885+0000 7ff4d9600640 1 -- 172.21.15.144:0/3792513334 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4c0003520 con 0x7ff4dc0ba2b0 2024-05-30T16:41:59.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.885+0000 7feb75800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb700cdb50 0x7feb701f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.885+0000 7f04d1800640 1 -- start start 2024-05-30T16:41:59.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7ff4db400640 1 -- 172.21.15.144:0/3792513334 >> v2:172.21.15.144:3300/0 conn(0x7ff4dc15eb80 msgr2=0x7ff4dc162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7feb75800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb700cf7a0 0x7feb701476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7feb75800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c490 0x7feb70142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7feb75800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feb700b4080 con 0x7feb7015c490 2024-05-30T16:41:59.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7feb75800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feb7015f120 con 0x7feb700cf7a0 2024-05-30T16:41:59.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7feb75800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feb700b4200 con 0x7feb700cdb50 2024-05-30T16:41:59.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7feb6ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb700cdb50 0x7feb701f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7feb6ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb700cdb50 0x7feb701f4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:34856/0 (socket says 172.21.15.144:34856) 2024-05-30T16:41:59.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7feb6ea00640 1 -- 172.21.15.144:0/4043116132 learned_addr learned my addr 172.21.15.144:0/4043116132 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7feb6f400640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c490 0x7feb70142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f7ff6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7fe800c0a0 0x7f7fe8038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f7ff6800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7fe8033ef0 0x7f7fe8006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7efd61400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efd5c070500 0x7efd5c15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7efd61400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 0x7efd5c072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f7ff6800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe80544c0 con 0x7f7fe8053c70 2024-05-30T16:41:59.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f7ff6800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe80541e0 con 0x7f7fe800c0a0 2024-05-30T16:41:59.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f7ff6800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe8005f30 con 0x7f7fe8033ef0 2024-05-30T16:41:59.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f04d1800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f04cc072210 0x7f04cc072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f04d1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04cc0b4140 0x7f04cc0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f04d1800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04cc072b70 con 0x7f04cc14c630 2024-05-30T16:41:59.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f04d1800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f04cc06fbf0 con 0x7f04cc0b4140 2024-05-30T16:41:59.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f04d1800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f04cc0cf050 con 0x7f04cc072210 2024-05-30T16:41:59.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7efd5a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efd5c070500 0x7efd5c15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f96e5c00640 1 Processor -- start 2024-05-30T16:41:59.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f96e5c00640 1 -- start start 2024-05-30T16:41:59.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7efd61400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c0b6310 con 0x7efd5c15ef30 2024-05-30T16:41:59.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7efd61400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efd5c072780 con 0x7efd5c070500 2024-05-30T16:41:59.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7efd61400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd5c15b040 con 0x7efd5c071df0 2024-05-30T16:41:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7f04cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04cc0b4140 0x7f04cc0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7f04cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04cc0b4140 0x7f04cc0b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58818/0 (socket says 172.21.15.144:58818) 2024-05-30T16:41:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7f04cb400640 1 -- 172.21.15.144:0/1276007840 learned_addr learned my addr 172.21.15.144:0/1276007840 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7feb6ea00640 1 -- 172.21.15.144:0/4043116132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb700cf7a0 msgr2=0x7feb701476b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:41:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7feb6ea00640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb700cf7a0 0x7feb701476b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7feb6ea00640 1 -- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c490 msgr2=0x7feb70142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7feb6ea00640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c490 0x7feb70142090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7feb6ea00640 1 -- 172.21.15.144:0/4043116132 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb70147460 con 0x7feb700cdb50 2024-05-30T16:41:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.887+0000 7feb6f400640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c490 0x7feb70142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:41:59.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7f7ff4a00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7fe8053c70 0x7f7fe80df220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:37056/0 (socket says 172.21.15.144:37056) 2024-05-30T16:41:59.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7f7ff4a00640 1 -- 172.21.15.144:0/1952850611 learned_addr learned my addr 172.21.15.144:0/1952850611 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:59.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7efd5a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efd5c070500 0x7efd5c15bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58812/0 (socket says 172.21.15.144:58812) 2024-05-30T16:41:59.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7efd5a800640 1 -- 172.21.15.144:0/1017932069 learned_addr learned my addr 172.21.15.144:0/1017932069 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7feb6ea00640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb700cdb50 0x7feb701f4c20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb6000c390 tx=0x7feb6000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7f04ca000640 1 --2- 172.21.15.144:0/1276007840 >> v2:172.21.15.149:3300/0 conn(0x7f04cc072210 0x7f04cc072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7f04cb400640 1 -- 172.21.15.144:0/1276007840 >> v2:172.21.15.149:3300/0 conn(0x7f04cc072210 msgr2=0x7f04cc072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7f04cb400640 1 --2- 172.21.15.144:0/1276007840 >> v2:172.21.15.149:3300/0 conn(0x7f04cc072210 0x7f04cc072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7f04cb400640 1 -- 172.21.15.144:0/1276007840 >> v1:172.21.15.149:6789/0 conn(0x7f04cc14c630 legacy=0x7f04cc0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7f04cb400640 1 -- 172.21.15.144:0/1276007840 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc0cf330 con 0x7f04cc0b4140 2024-05-30T16:41:59.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7f7ff5400640 1 --2- 172.21.15.144:0/1952850611 >> v2:172.21.15.144:3300/0 conn(0x7f7fe800c0a0 0x7f7fe8038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7ff4db400640 1 --2- 172.21.15.144:0/3792513334 >> v2:172.21.15.144:3300/0 conn(0x7ff4dc15eb80 0x7ff4dc162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7ff4db400640 1 -- 172.21.15.144:0/3792513334 >> v1:172.21.15.144:6789/0 conn(0x7ff4dc0ba2b0 legacy=0x7ff4dc0cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927107181 0 0) 0x7f7fe80544c0 con 0x7f7fe8053c70 2024-05-30T16:41:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fd8003520 con 0x7f7fe8053c70 2024-05-30T16:41:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7f7ff5e00640 1 --2- 172.21.15.144:0/1952850611 >> v2:172.21.15.149:3300/0 conn(0x7f7fe8033ef0 0x7f7fe8006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7ff4db400640 1 -- 172.21.15.144:0/3792513334 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc163270 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.886+0000 7ff4d9600640 1 -- 172.21.15.144:0/3792513334 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3295630343 0 0) 0x7ff4c0003520 con 0x7ff4dc0ba2b0 2024-05-30T16:41:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.888+0000 7efd5b200640 1 --2- 172.21.15.144:0/1017932069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 0x7efd5c072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7efd5a800640 1 -- 172.21.15.144:0/1017932069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 msgr2=0x7efd5c072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7efd5a800640 1 --2- 172.21.15.144:0/1017932069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 0x7efd5c072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7efd5a800640 1 -- 172.21.15.144:0/1017932069 >> v1:172.21.15.149:6789/0 conn(0x7efd5c15ef30 legacy=0x7efd5c140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7feb66a00640 1 -- 172.21.15.144:0/4043116132 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60017070 con 0x7feb700cdb50 2024-05-30T16:41:59.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7efd5a800640 1 -- 172.21.15.144:0/1017932069 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c15b320 con 0x7efd5c070500 2024-05-30T16:41:59.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7f96e5c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96e00ccef0 0x7f96e015b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7f96e5c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f96e00b4000 0x7f96e015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7f96e5c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e015edc0 con 0x7f96e0072360 2024-05-30T16:41:59.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7f96e5c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f96e015f380 con 0x7f96e00ccef0 2024-05-30T16:41:59.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7f96e5c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f96e015f0a0 con 0x7f96e00b4000 2024-05-30T16:41:59.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.889+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb701f5230 con 0x7feb700cdb50 2024-05-30T16:41:59.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb701f57f0 con 0x7feb700cdb50 2024-05-30T16:41:59.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2240986249 0 0) 0x7f7fd8003520 con 0x7f7fe8053c70 2024-05-30T16:41:59.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7feb66a00640 1 -- 172.21.15.144:0/4043116132 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb60005ce0 con 0x7feb700cdb50 2024-05-30T16:41:59.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7feb66a00640 1 -- 172.21.15.144:0/4043116132 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600072d0 con 0x7feb700cdb50 2024-05-30T16:41:59.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 >> v2:172.21.15.149:3300/0 conn(0x7f7fe8033ef0 msgr2=0x7f7fe8006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f7fefe00640 1 --2- 172.21.15.144:0/1952850611 >> v2:172.21.15.149:3300/0 conn(0x7f7fe8033ef0 0x7f7fe8006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 >> v2:172.21.15.144:3300/0 conn(0x7f7fe800c0a0 msgr2=0x7f7fe8038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f7fefe00640 1 --2- 172.21.15.144:0/1952850611 >> v2:172.21.15.144:3300/0 conn(0x7f7fe800c0a0 0x7f7fe8038080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe8006210 con 0x7f7fe8053c70 2024-05-30T16:41:59.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f7fdc001650 con 0x7f7fe8053c70 2024-05-30T16:41:59.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f04cb400640 1 --2- 172.21.15.144:0/1276007840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc0b4140 0x7f04cc0b45b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1668e0 tx=0x7f04bc02a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf761cbcc8f1e50 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 >> v1:172.21.15.149:6789/0 conn(0x7f7fe8053c70 legacy=0x7f7fe80df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb48001030 con 0x7feb700cdb50 2024-05-30T16:41:59.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f7fefe00640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fd80039d0 0x7f7fd8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f7fefe00640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fd8004350 0x7f7fd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f7fefe00640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd8004e50 0x7f7fd800ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe80541e0 con 0x7f7fd80039d0 2024-05-30T16:41:59.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8005f30 con 0x7f7fd8004e50 2024-05-30T16:41:59.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd8010510 con 0x7f7fd8004350 2024-05-30T16:41:59.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f04c9600640 1 -- 172.21.15.144:0/1276007840 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc036070 con 0x7f04cc0b4140 2024-05-30T16:41:59.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f04c9600640 1 -- 172.21.15.144:0/1276007840 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc031600 con 0x7f04cc0b4140 2024-05-30T16:41:59.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f04c9600640 1 -- 172.21.15.144:0/1276007840 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0319d0 con 0x7f04cc0b4140 2024-05-30T16:41:59.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f96df400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f96e0072360 0x7f96e00b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54692/0 (socket says 172.21.15.144:54692) 2024-05-30T16:41:59.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.890+0000 7f96df400640 1 -- 172.21.15.144:0/69860351 learned_addr learned my addr 172.21.15.144:0/69860351 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:41:59.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f96dea00640 1 --2- 172.21.15.144:0/69860351 >> v2:172.21.15.144:3300/0 conn(0x7f96e00ccef0 0x7f96e015b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f96de000640 1 --2- 172.21.15.144:0/69860351 >> v2:172.21.15.149:3300/0 conn(0x7f96e00b4000 0x7f96e015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7ff4db400640 1 --2- 172.21.15.144:0/3792513334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4dc0cfc70 0x7ff4dc0d3570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc162570 tx=0x7ff4d402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839294950a698493 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f7ff5400640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fd80039d0 0x7f7fd8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.891+0000 7f7ff4a00640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fd8004350 0x7f7fd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f7ff5e00640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd8004e50 0x7f7fd800ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7ff4d9600640 1 -- 172.21.15.144:0/3792513334 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4037070 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7ff4d9600640 1 -- 172.21.15.144:0/3792513334 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d402abc0 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7ff4d9600640 1 -- 172.21.15.144:0/3792513334 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8001670 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f04d1800640 1 -- 172.21.15.144:0/1276007840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc0b4140 msgr2=0x7f04cc0b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f04d1800640 1 --2- 172.21.15.144:0/1276007840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc0b4140 0x7f04cc0b45b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1668e0 tx=0x7f04bc02a490 comp rx=0 tx=0).stop 2024-05-30T16:41:59.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7efd5a800640 1 --2- 172.21.15.144:0/1017932069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5c070500 0x7efd5c15bb00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009870 tx=0x7efd4c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566851aedbf588d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f04d1800640 1 -- 172.21.15.144:0/1276007840 shutdown_connections 2024-05-30T16:41:59.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f7ff5400640 1 -- 172.21.15.144:0/1952850611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fd8004350 msgr2=0x7f7fd8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f7ff5400640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fd8004350 0x7f7fd8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f04d1800640 1 --2- 172.21.15.144:0/1276007840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc0b4140 0x7f04cc0b45b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f04d1800640 1 --2- 172.21.15.144:0/1276007840 >> v2:172.21.15.149:3300/0 conn(0x7f04cc072210 0x7f04cc072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f04d1800640 1 -- 172.21.15.144:0/1276007840 >> 172.21.15.144:0/1276007840 conn(0x7f04cc06bd00 msgr2=0x7f04cc06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f96dea00640 1 -- 172.21.15.144:0/69860351 >> v2:172.21.15.149:3300/0 conn(0x7f96e00b4000 msgr2=0x7f96e015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f96dea00640 1 --2- 172.21.15.144:0/69860351 >> v2:172.21.15.149:3300/0 conn(0x7f96e00b4000 0x7f96e015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f96dea00640 1 -- 172.21.15.144:0/69860351 >> v1:172.21.15.144:6789/0 conn(0x7f96e0072360 legacy=0x7f96e00b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f96dea00640 1 -- 172.21.15.144:0/69860351 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e015b090 con 0x7f96e00ccef0 2024-05-30T16:41:59.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f7ff5400640 1 -- 172.21.15.144:0/1952850611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd8004e50 msgr2=0x7f7fd800ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f7ff5400640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd8004e50 0x7f7fd800ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.892+0000 7f7ff5400640 1 -- 172.21.15.144:0/1952850611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe8006210 con 0x7f7fd80039d0 2024-05-30T16:41:59.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.893+0000 7f7ff5e00640 1 -- 172.21.15.144:0/1952850611 reap_dead start 2024-05-30T16:41:59.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.893+0000 7efd59400640 1 -- 172.21.15.144:0/1017932069 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c037070 con 0x7efd5c070500 2024-05-30T16:41:59.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.893+0000 7efd59400640 1 -- 172.21.15.144:0/1017932069 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4c032440 con 0x7efd5c070500 2024-05-30T16:41:59.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.893+0000 7efd59400640 1 -- 172.21.15.144:0/1017932069 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c032810 con 0x7efd5c070500 2024-05-30T16:41:59.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7ff4e1e00640 1 -- 172.21.15.144:0/3792513334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4dc0cfc70 msgr2=0x7ff4dc0d3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7ff4e1e00640 1 --2- 172.21.15.144:0/3792513334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4dc0cfc70 0x7ff4dc0d3570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc162570 tx=0x7ff4d402a130 comp rx=0 tx=0).stop 2024-05-30T16:41:59.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7f96dea00640 1 --2- 172.21.15.144:0/69860351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e00ccef0 0x7f96e015b890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96e015f500 tx=0x7f96d002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20659e895daaa18 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7f04d1800640 1 -- 172.21.15.144:0/1276007840 shutdown_connections 2024-05-30T16:41:59.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7ff4e1e00640 1 -- 172.21.15.144:0/3792513334 shutdown_connections 2024-05-30T16:41:59.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7ff4e1e00640 1 --2- 172.21.15.144:0/3792513334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4dc0cfc70 0x7ff4dc0d3570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7ff4e1e00640 1 --2- 172.21.15.144:0/3792513334 >> v2:172.21.15.144:3300/0 conn(0x7ff4dc15eb80 0x7ff4dc162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7ff4e1e00640 1 -- 172.21.15.144:0/3792513334 >> 172.21.15.144:0/3792513334 conn(0x7ff4dc06cf40 msgr2=0x7ff4dc06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7f96dd600640 1 -- 172.21.15.144:0/69860351 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0031600 con 0x7f96e00ccef0 2024-05-30T16:41:59.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7ff4e1e00640 1 -- 172.21.15.144:0/3792513334 shutdown_connections 2024-05-30T16:41:59.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7f96dd600640 1 -- 172.21.15.144:0/69860351 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d00317a0 con 0x7f96e00ccef0 2024-05-30T16:41:59.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7ff4e1e00640 1 -- 172.21.15.144:0/3792513334 wait complete. 2024-05-30T16:41:59.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7f96dd600640 1 -- 172.21.15.144:0/69860351 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0031b70 con 0x7f96e00ccef0 2024-05-30T16:41:59.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7efd61400640 1 -- 172.21.15.144:0/1017932069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5c070500 msgr2=0x7efd5c15bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.894+0000 7efd61400640 1 --2- 172.21.15.144:0/1017932069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5c070500 0x7efd5c15bb00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009870 tx=0x7efd4c02a250 comp rx=0 tx=0).stop 2024-05-30T16:41:59.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7efd61400640 1 -- 172.21.15.144:0/1017932069 shutdown_connections 2024-05-30T16:41:59.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7efd61400640 1 --2- 172.21.15.144:0/1017932069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 0x7efd5c072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7efd61400640 1 --2- 172.21.15.144:0/1017932069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5c070500 0x7efd5c15bb00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7efd61400640 1 -- 172.21.15.144:0/1017932069 >> 172.21.15.144:0/1017932069 conn(0x7efd5c070050 msgr2=0x7efd5c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7feb66a00640 1 -- 172.21.15.144:0/4043116132 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb6001a070 con 0x7feb700cdb50 2024-05-30T16:41:59.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7f7ff5400640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fd80039d0 0x7f7fd8003e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009ac0 tx=0x7f7fd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5022f7100e89f36c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7efd61400640 1 -- 172.21.15.144:0/1017932069 shutdown_connections 2024-05-30T16:41:59.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7f96e5c00640 1 -- 172.21.15.144:0/69860351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e00ccef0 msgr2=0x7f96e015b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7f96e5c00640 1 --2- 172.21.15.144:0/69860351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e00ccef0 0x7f96e015b890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96e015f500 tx=0x7f96d002a5d0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7efd61400640 1 -- 172.21.15.144:0/1017932069 wait complete. 2024-05-30T16:41:59.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f8112800640 1 Processor -- start 2024-05-30T16:41:59.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.895+0000 7f04d1800640 1 -- 172.21.15.144:0/1276007840 wait complete. 2024-05-30T16:41:59.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4036070 con 0x7f7fd80039d0 2024-05-30T16:41:59.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f96e5c00640 1 -- 172.21.15.144:0/69860351 shutdown_connections 2024-05-30T16:41:59.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f96e5c00640 1 --2- 172.21.15.144:0/69860351 >> v2:172.21.15.149:3300/0 conn(0x7f96e00b4000 0x7f96e015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f96e5c00640 1 --2- 172.21.15.144:0/69860351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e00ccef0 0x7f96e015b890 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f96e5c00640 1 -- 172.21.15.144:0/69860351 >> 172.21.15.144:0/69860351 conn(0x7f96e006bd00 msgr2=0x7f96e006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe4031400 con 0x7f7fd80039d0 2024-05-30T16:41:59.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f7fefe00640 1 -- 172.21.15.144:0/1952850611 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4009690 con 0x7f7fd80039d0 2024-05-30T16:41:59.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f96e5c00640 1 -- 172.21.15.144:0/69860351 shutdown_connections 2024-05-30T16:41:59.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7ff4e1e00640 1 Processor -- start 2024-05-30T16:41:59.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7feb66a00640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feb4c06c940 0x7feb4c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7feb66a00640 1 -- 172.21.15.144:0/4043116132 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feb6008b450 con 0x7feb700cdb50 2024-05-30T16:41:59.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7feb66a00640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7feb4c074b60 0x7feb4c076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7feb66a00640 1 -- 172.21.15.144:0/4043116132 --> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb6000ee50 con 0x7feb4c074b60 2024-05-30T16:41:59.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7feb66a00640 1 -- 172.21.15.144:0/4043116132 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feb6008b930 con 0x7feb700cdb50 2024-05-30T16:41:59.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7feb6e000640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feb4c06c940 0x7feb4c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f96e5c00640 1 -- 172.21.15.144:0/69860351 wait complete. 2024-05-30T16:41:59.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.898+0000 7feb6f400640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7feb4c074b60 0x7feb4c076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7f7ff6800640 1 -- 172.21.15.144:0/1952850611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fd80039d0 msgr2=0x7f7fd8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7f7ff6800640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fd80039d0 0x7f7fd8003e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009ac0 tx=0x7f7fd8005830 comp rx=0 tx=0).stop 2024-05-30T16:41:59.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7f7ff6800640 1 -- 172.21.15.144:0/1952850611 shutdown_connections 2024-05-30T16:41:59.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7f7ff6800640 1 --2- 172.21.15.144:0/1952850611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fd80039d0 0x7f7fd8003e10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.897+0000 7f7ff6800640 1 -- 172.21.15.144:0/1952850611 >> 172.21.15.144:0/1952850611 conn(0x7f7fe8009fb0 msgr2=0x7f7fe800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.896+0000 7f8112800640 1 -- start start 2024-05-30T16:41:59.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.898+0000 7f7ff6800640 1 -- 172.21.15.144:0/1952850611 shutdown_connections 2024-05-30T16:41:59.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.898+0000 7f04d1800640 1 Processor -- start 2024-05-30T16:41:59.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.898+0000 7feb6e000640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feb4c06c940 0x7feb4c06ee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb58033000 tx=0x7feb58008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.898+0000 7ff4e1e00640 1 -- start start 2024-05-30T16:41:59.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.898+0000 7f7ff6800640 1 -- 172.21.15.144:0/1952850611 wait complete. 2024-05-30T16:41:59.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.899+0000 7f96e5c00640 1 Processor -- start 2024-05-30T16:41:59.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.899+0000 7f96e5c00640 1 -- start start 2024-05-30T16:41:59.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.899+0000 7f8112800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f810c160810 0x7f810c0d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.899+0000 7f8112800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c163ec0 0x7f810c0cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.899+0000 7f8112800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f810c0d4bd0 0x7f810c0d5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.899+0000 7f8112800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f810c0d5580 con 0x7f810c160810 2024-05-30T16:41:59.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.899+0000 7f8112800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f810c160bf0 con 0x7f810c0d4bd0 2024-05-30T16:41:59.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.899+0000 7f8112800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f810c0cf610 con 0x7f810c163ec0 2024-05-30T16:41:59.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.899+0000 7feb6f400640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7feb4c074b60 0x7feb4c076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7efd61400640 1 Processor -- start 2024-05-30T16:41:59.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7efd61400640 1 -- start start 2024-05-30T16:41:59.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7ff4e1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4dc0ba2b0 0x7ff4dc15f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7ff4e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4dc0cfc70 0x7ff4dc1f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7ff4e1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4dc15eb80 0x7ff4dc0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7ff4e1e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc162b80 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7ff4e1e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc0d3050 con 0x7ff4dc0ba2b0 2024-05-30T16:41:59.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7ff4e1e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff4dc162d00 con 0x7ff4dc15eb80 2024-05-30T16:41:59.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7feb66a00640 1 -- 172.21.15.144:0/4043116132 <== osd.0 v2:172.21.15.144:6816/2149619239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb6000ee50 con 0x7feb4c074b60 2024-05-30T16:41:59.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7f7ff6800640 1 Processor -- start 2024-05-30T16:41:59.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7ff4da000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4dc0cfc70 0x7ff4dc1f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7ff4da000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4dc0cfc70 0x7ff4dc1f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58850/0 (socket says 172.21.15.144:58850) 2024-05-30T16:41:59.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7ff4da000640 1 -- 172.21.15.144:0/2307739107 learned_addr learned my addr 172.21.15.144:0/2307739107 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7f810aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c163ec0 0x7f810c0cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7f810be00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f810c0d4bd0 0x7f810c0d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7f810aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c163ec0 0x7f810c0cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:34876/0 (socket says 172.21.15.144:34876) 2024-05-30T16:41:59.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7f810aa00640 1 -- 172.21.15.144:0/3653803523 learned_addr learned my addr 172.21.15.144:0/3653803523 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7f810b400640 1 --2- 172.21.15.144:0/3653803523 >> v2:172.21.15.144:3300/0 conn(0x7f810c160810 0x7f810c0d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7f96e5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e0072360 0x7f96e00c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7f96e5c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96e00b4000 0x7f96e00c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7f96e5c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e00ccef0 0x7f96e00b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7f96e5c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f96e00cd450 con 0x7f96e0072360 2024-05-30T16:41:59.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7f96e5c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f96e00cd2d0 con 0x7f96e00ccef0 2024-05-30T16:41:59.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7f96e5c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f96e015ea20 con 0x7f96e00b4000 2024-05-30T16:41:59.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f7ff6800640 1 -- start start 2024-05-30T16:41:59.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.898+0000 7f04d1800640 1 -- start start 2024-05-30T16:41:59.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7f04d1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc072210 0x7f04cc201450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7f04d1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04cc0b4140 0x7f04cc0aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.900+0000 7f04d1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04cc14c630 0x7f04cc0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f04d1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0b3c20 con 0x7f04cc072210 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f04d1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0cf8f0 con 0x7f04cc0b4140 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f04d1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc14ca10 con 0x7f04cc14c630 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f04ca000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04cc0b4140 0x7f04cc0aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f04cb400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04cc14c630 0x7f04cc0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f04cb400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04cc14c630 0x7f04cc0a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:34896/0 (socket says 172.21.15.144:34896) 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f04ca000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04cc0b4140 0x7f04cc0aabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:35870/0 (socket says 172.21.15.144:35870) 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f04cb400640 1 -- 172.21.15.144:0/1048216611 learned_addr learned my addr 172.21.15.144:0/1048216611 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f04caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc072210 0x7f04cc201450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f04caa00640 1 -- 172.21.15.144:0/1048216611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04cc14c630 msgr2=0x7f04cc0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7efd61400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5c070500 0x7efd5c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7efd61400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 0x7efd5c13c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7efd61400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd5c15ef30 0x7efd5c2005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7efd61400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c0b5fb0 con 0x7efd5c070500 2024-05-30T16:41:59.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7efd61400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c15f3a0 con 0x7efd5c15ef30 2024-05-30T16:41:59.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7efd61400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd5c144340 con 0x7efd5c071df0 2024-05-30T16:41:59.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7efd59e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 0x7efd5c13c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7ff4db400640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4dc15eb80 0x7ff4dc0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.901+0000 7ff4daa00640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4dc0ba2b0 0x7ff4dc15f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7ff4da000640 1 -- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4dc15eb80 msgr2=0x7ff4dc0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7ff4da000640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4dc15eb80 0x7ff4dc0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7ff4da000640 1 -- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4dc0ba2b0 msgr2=0x7ff4dc15f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7ff4da000640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4dc0ba2b0 0x7ff4dc15f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7ff4da000640 1 -- 172.21.15.144:0/2307739107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc15f750 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f96df400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e00ccef0 0x7f96e00b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f9ef8e00640 1 Processor -- start 2024-05-30T16:41:59.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f810aa00640 1 -- 172.21.15.144:0/3653803523 >> v2:172.21.15.149:3300/0 conn(0x7f810c0d4bd0 msgr2=0x7f810c0d5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f04caa00640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04cc14c630 0x7f04cc0a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f04caa00640 1 -- 172.21.15.144:0/1048216611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04cc0b4140 msgr2=0x7f04cc0aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f04caa00640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04cc0b4140 0x7f04cc0aabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f04caa00640 1 -- 172.21.15.144:0/1048216611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc0a9b20 con 0x7f04cc072210 2024-05-30T16:41:59.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7efd5b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd5c15ef30 0x7efd5c2005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7efd59e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 0x7efd5c13c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:34912/0 (socket says 172.21.15.144:34912) 2024-05-30T16:41:59.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7efd59e00640 1 -- 172.21.15.144:0/410975083 learned_addr learned my addr 172.21.15.144:0/410975083 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7efd5a800640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5c070500 0x7efd5c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f810aa00640 1 --2- 172.21.15.144:0/3653803523 >> v2:172.21.15.149:3300/0 conn(0x7f810c0d4bd0 0x7f810c0d5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f04caa00640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc072210 0x7f04cc201450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04c400c700 tx=0x7f04c400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f9ef8e00640 1 -- start start 2024-05-30T16:41:59.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f7ff6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd80039d0 0x7f7fe804c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f7ff6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe80d5f00 0x7f7fe80dc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f7ff6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fe80d6380 0x7f7fe80dcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f7ff6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8037a90 con 0x7f7fe80d5f00 2024-05-30T16:41:59.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f7ff6800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8037910 con 0x7f7fd80039d0 2024-05-30T16:41:59.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f7ff6800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe8038080 con 0x7f7fe80d6380 2024-05-30T16:41:59.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f810aa00640 1 -- 172.21.15.144:0/3653803523 >> v2:172.21.15.144:3300/0 conn(0x7f810c160810 msgr2=0x7f810c0d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f810aa00640 1 --2- 172.21.15.144:0/3653803523 >> v2:172.21.15.144:3300/0 conn(0x7f810c160810 0x7f810c0d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.902+0000 7f810aa00640 1 -- 172.21.15.144:0/3653803523 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c0d1000 con 0x7f810c163ec0 2024-05-30T16:41:59.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f04c2a00640 1 -- 172.21.15.144:0/1048216611 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4017070 con 0x7f04cc072210 2024-05-30T16:41:59.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f7ff4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe80d5f00 0x7f7fe80dc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f04c2a00640 1 -- 172.21.15.144:0/1048216611 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c4003da0 con 0x7f04cc072210 2024-05-30T16:41:59.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc0a9e00 con 0x7f04cc072210 2024-05-30T16:41:59.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f96dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e0072360 0x7f96e00c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f96dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e0072360 0x7f96e00c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58870/0 (socket says 172.21.15.144:58870) 2024-05-30T16:41:59.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f96de000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96e00b4000 0x7f96e00c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f96dea00640 1 -- 172.21.15.144:0/1105529894 learned_addr learned my addr 172.21.15.144:0/1105529894 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.903+0000 7f96df400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e00ccef0 0x7f96e00b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:35872/0 (socket says 172.21.15.144:35872) 2024-05-30T16:41:59.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f7ff4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe80d5f00 0x7f7fe80dc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58892/0 (socket says 172.21.15.144:58892) 2024-05-30T16:41:59.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f7ff4a00640 1 -- 172.21.15.144:0/3414049250 learned_addr learned my addr 172.21.15.144:0/3414049250 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f7ff5400640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd80039d0 0x7f7fe804c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7ff4da000640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4dc0cfc70 0x7ff4dc1f8560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800c580 tx=0x7ff4c800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7ff4d3400640 1 -- 172.21.15.144:0/2307739107 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8017070 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7efd5b200640 1 -- 172.21.15.144:0/410975083 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 msgr2=0x7efd5c13c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7efd5b200640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c071df0 0x7efd5c13c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7efd5b200640 1 -- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5c070500 msgr2=0x7efd5c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7efd5b200640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5c070500 0x7efd5c0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7efd5b200640 1 -- 172.21.15.144:0/410975083 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c13d5b0 con 0x7efd5c15ef30 2024-05-30T16:41:59.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f7ff5e00640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fe80d6380 0x7f7fe80dcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f810aa00640 1 --2- 172.21.15.144:0/3653803523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c163ec0 0x7f810c0cece0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f810c0d4640 tx=0x7f80fc02a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=822f31cb482196c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7ff4d3400640 1 -- 172.21.15.144:0/2307739107 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c8005ce0 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7ff4d3400640 1 -- 172.21.15.144:0/2307739107 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80072f0 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f7ff4a00640 1 -- 172.21.15.144:0/3414049250 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fe80d6380 msgr2=0x7f7fe80dcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f7ff4a00640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fe80d6380 0x7f7fe80dcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f7ff4a00640 1 -- 172.21.15.144:0/3414049250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd80039d0 msgr2=0x7f7fe804c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f7ff4a00640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd80039d0 0x7f7fe804c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f7ff4a00640 1 -- 172.21.15.144:0/3414049250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe804ccc0 con 0x7f7fe80d5f00 2024-05-30T16:41:59.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f7ff5400640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd80039d0 0x7f7fe804c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:41:59.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4dc15fa30 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f04c2a00640 1 -- 172.21.15.144:0/1048216611 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c40052b0 con 0x7f04cc072210 2024-05-30T16:41:59.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.904+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc0aa3c0 con 0x7f04cc072210 2024-05-30T16:41:59.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f810a000640 1 -- 172.21.15.144:0/3653803523 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc037070 con 0x7f810c163ec0 2024-05-30T16:41:59.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f810a000640 1 -- 172.21.15.144:0/3653803523 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80fc032440 con 0x7f810c163ec0 2024-05-30T16:41:59.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04cc075f70 con 0x7f04cc072210 2024-05-30T16:41:59.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4dc15fff0 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f810a000640 1 -- 172.21.15.144:0/3653803523 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc032810 con 0x7f810c163ec0 2024-05-30T16:41:59.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.905+0000 7f7ff4a00640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe80d5f00 0x7f7fe80dc5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0073c0 tx=0x7f7fdc0077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7efd5b200640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd5c15ef30 0x7efd5c2005f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd5400eba0 tx=0x7efd5400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7efd52a00640 1 -- 172.21.15.144:0/410975083 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54018020 con 0x7efd5c15ef30 2024-05-30T16:41:59.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f96dea00640 1 -- 172.21.15.144:0/1105529894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96e00b4000 msgr2=0x7f96e00c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f96dea00640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96e00b4000 0x7f96e00c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f96dea00640 1 -- 172.21.15.144:0/1105529894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e00ccef0 msgr2=0x7f96e00b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f96dea00640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e00ccef0 0x7f96e00b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f96dea00640 1 -- 172.21.15.144:0/1105529894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e00c69f0 con 0x7f96e0072360 2024-05-30T16:41:59.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f9ef8e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef415eb80 0x7f9ef4162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f9ef8e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9ef40cfc70 0x7f9ef40d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f9ef8e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ef4163550 con 0x7f9ef40ba2b0 2024-05-30T16:41:59.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f9ef8e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9ef415ef60 con 0x7f9ef40cfc70 2024-05-30T16:41:59.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7f9ef8e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef4162f90 con 0x7f9ef415eb80 2024-05-30T16:41:59.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.906+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c13d890 con 0x7efd5c15ef30 2024-05-30T16:41:59.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c0b23c0 con 0x7efd5c15ef30 2024-05-30T16:41:59.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f7fed600640 1 -- 172.21.15.144:0/3414049250 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc01a070 con 0x7f7fe80d5f00 2024-05-30T16:41:59.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe80c5a20 con 0x7f7fe80d5f00 2024-05-30T16:41:59.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe804bfa0 con 0x7f7fe80d5f00 2024-05-30T16:41:59.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f9ef1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef415eb80 0x7f9ef4162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f9ef1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef415eb80 0x7f9ef4162640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:34924/0 (socket says 172.21.15.144:34924) 2024-05-30T16:41:59.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f9ef1e00640 1 -- 172.21.15.144:0/3984941829 learned_addr learned my addr 172.21.15.144:0/3984941829 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f96dea00640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e0072360 0x7f96e00c7fa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009e50 tx=0x7f96d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7efd52a00640 1 -- 172.21.15.144:0/410975083 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5400cd20 con 0x7efd5c15ef30 2024-05-30T16:41:59.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f96d6a00640 1 -- 172.21.15.144:0/1105529894 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d003f070 con 0x7f96e0072360 2024-05-30T16:41:59.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7f9ef1e00640 1 -- 172.21.15.144:0/3984941829 >> v2:172.21.15.149:3300/0 conn(0x7f9ef40cfc70 msgr2=0x7f9ef40d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:41:59.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7f9ef1e00640 1 --2- 172.21.15.144:0/3984941829 >> v2:172.21.15.149:3300/0 conn(0x7f9ef40cfc70 0x7f9ef40d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7f9ef1e00640 1 -- 172.21.15.144:0/3984941829 >> v1:172.21.15.149:6789/0 conn(0x7f9ef40ba2b0 legacy=0x7f9ef40cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7f9ef1e00640 1 -- 172.21.15.144:0/3984941829 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef4163270 con 0x7f9ef415eb80 2024-05-30T16:41:59.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4dc075f70 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7fe80c5d00 con 0x7f7fe80d5f00 2024-05-30T16:41:59.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7f8112800640 1 -- 172.21.15.144:0/3653803523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c163ec0 msgr2=0x7f810c0cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7f8112800640 1 --2- 172.21.15.144:0/3653803523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c163ec0 0x7f810c0cece0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f810c0d4640 tx=0x7f80fc02a1d0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f96d6a00640 1 -- 172.21.15.144:0/1105529894 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d0030be0 con 0x7f96e0072360 2024-05-30T16:41:59.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f96d6a00640 1 -- 172.21.15.144:0/1105529894 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0009450 con 0x7f96e0072360 2024-05-30T16:41:59.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.907+0000 7f96e5c00640 1 -- 172.21.15.144:0/1105529894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e00c6cd0 con 0x7f96e0072360 2024-05-30T16:41:59.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.908+0000 7f96e5c00640 1 -- 172.21.15.144:0/1105529894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e00c7290 con 0x7f96e0072360 2024-05-30T16:41:59.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.909+0000 7efd52a00640 1 -- 172.21.15.144:0/410975083 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54018020 con 0x7efd5c15ef30 2024-05-30T16:41:59.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.909+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd34001030 con 0x7efd5c15ef30 2024-05-30T16:41:59.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.909+0000 7f8112800640 1 -- 172.21.15.144:0/3653803523 shutdown_connections 2024-05-30T16:41:59.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.909+0000 7f8112800640 1 --2- 172.21.15.144:0/3653803523 >> v2:172.21.15.149:3300/0 conn(0x7f810c0d4bd0 0x7f810c0d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.909+0000 7f8112800640 1 --2- 172.21.15.144:0/3653803523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c163ec0 0x7f810c0cece0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.909+0000 7f8112800640 1 --2- 172.21.15.144:0/3653803523 >> v2:172.21.15.144:3300/0 conn(0x7f810c160810 0x7f810c0d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.909+0000 7f8112800640 1 -- 172.21.15.144:0/3653803523 >> 172.21.15.144:0/3653803523 conn(0x7f810c06cff0 msgr2=0x7f810c06d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.909+0000 7f96cbe00640 1 -- 172.21.15.144:0/1105529894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96b4001030 con 0x7f96e0072360 2024-05-30T16:41:59.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.910+0000 7f9ef1e00640 1 --2- 172.21.15.144:0/3984941829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef415eb80 0x7f9ef4162640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009e50 tx=0x7f9eec02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab2b8ba3430d82e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.910+0000 7f9ef0a00640 1 -- 172.21.15.144:0/3984941829 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec036070 con 0x7f9ef415eb80 2024-05-30T16:41:59.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.910+0000 7f04c2a00640 1 -- 172.21.15.144:0/1048216611 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04c401a070 con 0x7f04cc072210 2024-05-30T16:41:59.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.911+0000 7f8112800640 1 -- 172.21.15.144:0/3653803523 shutdown_connections 2024-05-30T16:41:59.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.911+0000 7f8112800640 1 -- 172.21.15.144:0/3653803523 wait complete. 2024-05-30T16:41:59.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.909+0000 7f7fed600640 1 -- 172.21.15.144:0/3414049250 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fdc00f940 con 0x7f7fe80d5f00 2024-05-30T16:41:59.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.910+0000 7f7fed600640 1 -- 172.21.15.144:0/3414049250 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc024060 con 0x7f7fe80d5f00 2024-05-30T16:41:59.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.911+0000 7f7fed600640 1 -- 172.21.15.144:0/3414049250 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fdc01d070 con 0x7f7fe80d5f00 2024-05-30T16:41:59.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.912+0000 7f04c2a00640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f04ac06c940 0x7f04ac06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.910+0000 7f9ef0a00640 1 -- 172.21.15.144:0/3984941829 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec031600 con 0x7f9ef415eb80 2024-05-30T16:41:59.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.912+0000 7f9ef0a00640 1 -- 172.21.15.144:0/3984941829 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0319d0 con 0x7f9ef415eb80 2024-05-30T16:41:59.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.911+0000 7ff4d3400640 1 -- 172.21.15.144:0/2307739107 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff4c801a070 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.912+0000 7f7fed600640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fd006caf0 0x7f7fd006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7efd52a00640 1 -- 172.21.15.144:0/410975083 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd54005d10 con 0x7efd5c15ef30 2024-05-30T16:41:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3984941829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef415eb80 msgr2=0x7f9ef4162640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7f9ef8e00640 1 --2- 172.21.15.144:0/3984941829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef415eb80 0x7f9ef4162640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009e50 tx=0x7f9eec02a710 comp rx=0 tx=0).stop 2024-05-30T16:41:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7f7ff5400640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fd006caf0 0x7f7fd006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7f7fed600640 1 -- 172.21.15.144:0/3414049250 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7fdc00faf0 con 0x7f7fe80d5f00 2024-05-30T16:41:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3984941829 shutdown_connections 2024-05-30T16:41:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7f9ef8e00640 1 --2- 172.21.15.144:0/3984941829 >> v2:172.21.15.149:3300/0 conn(0x7f9ef40cfc70 0x7f9ef40d3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7f9ef8e00640 1 --2- 172.21.15.144:0/3984941829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef415eb80 0x7f9ef4162640 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3984941829 >> 172.21.15.144:0/3984941829 conn(0x7f9ef406cf40 msgr2=0x7f9ef406d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7f7fed600640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7f7fd00758f0 0x7f7fd0077d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7f7fed600640 1 -- 172.21.15.144:0/3414049250 --> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fd0078460 con 0x7f7fd00758f0 2024-05-30T16:41:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7f7fed600640 1 -- 172.21.15.144:0/3414049250 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7fdc0566f0 con 0x7f7fe80d5f00 2024-05-30T16:41:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7f7ff5400640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fd006caf0 0x7f7fd006efb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4033000 tx=0x7f7fe4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7f04ca000640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f04ac06c940 0x7f04ac06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.913+0000 7f8112800640 1 Processor -- start 2024-05-30T16:41:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7f8112800640 1 -- start start 2024-05-30T16:41:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7ff4d3400640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff4bc06c8f0 0x7ff4bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7ff4d3400640 1 -- 172.21.15.144:0/2307739107 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff4c808aeb0 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7ff4d3400640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7ff4bc074a90 0x7ff4bc076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7ff4d3400640 1 -- 172.21.15.144:0/2307739107 --> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4c801ae50 con 0x7ff4bc074a90 2024-05-30T16:41:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7ff4daa00640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff4bc06c8f0 0x7ff4bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7f96d6a00640 1 -- 172.21.15.144:0/1105529894 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96d0043410 con 0x7f96e0072360 2024-05-30T16:41:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f96d6a00640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f96c006c9c0 0x7f96c006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f96d6a00640 1 -- 172.21.15.144:0/1105529894 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f96d00ad0c0 con 0x7f96e0072360 2024-05-30T16:41:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f96d6a00640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7f96c0074be0 0x7f96c0077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f96d6a00640 1 -- 172.21.15.144:0/1105529894 --> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96d00020b0 con 0x7f96c0074be0 2024-05-30T16:41:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f96d6a00640 1 -- 172.21.15.144:0/1105529894 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f96d00ad4b0 con 0x7f96e0072360 2024-05-30T16:41:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f8112800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810c0d4bd0 0x7f810c1fec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f8112800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c160810 0x7f810c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f8112800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f810c163ec0 0x7f810c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f8112800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0d0c90 con 0x7f810c0d4bd0 2024-05-30T16:41:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f8112800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0d15c0 con 0x7f810c163ec0 2024-05-30T16:41:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7f8112800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f810c0cf220 con 0x7f810c160810 2024-05-30T16:41:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7ff4db400640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7ff4bc074a90 0x7ff4bc076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f96de000640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f96c006c9c0 0x7f96c006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f810b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810c0d4bd0 0x7f810c1fec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7ff4d3400640 1 -- 172.21.15.144:0/2307739107 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff4c8054fc0 con 0x7ff4dc0cfc70 2024-05-30T16:41:59.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f810b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810c0d4bd0 0x7f810c1fec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58900/0 (socket says 172.21.15.144:58900) 2024-05-30T16:41:59.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f810b400640 1 -- 172.21.15.144:0/2076501868 learned_addr learned my addr 172.21.15.144:0/2076501868 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f04ca000640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f04ac06c940 0x7f04ac06ee00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1ee530 tx=0x7f04b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f04c2a00640 1 -- 172.21.15.144:0/1048216611 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f04c408b690 con 0x7f04cc072210 2024-05-30T16:41:59.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f96df400640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7f96c0074be0 0x7f96c0077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f810be00640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f810c163ec0 0x7f810c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3984941829 shutdown_connections 2024-05-30T16:41:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3984941829 wait complete. 2024-05-30T16:41:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f04c2a00640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f04ac074ae0 0x7f04ac076f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f04c2a00640 1 -- 172.21.15.144:0/1048216611 --> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04ac0775b0 con 0x7f04ac074ae0 2024-05-30T16:41:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f04c2a00640 1 -- 172.21.15.144:0/1048216611 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f04c408bb70 con 0x7f04cc072210 2024-05-30T16:41:59.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f9ef8e00640 1 Processor -- start 2024-05-30T16:41:59.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.916+0000 7f810aa00640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c160810 0x7f810c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f9ef8e00640 1 -- start start 2024-05-30T16:41:59.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f04cb400640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f04ac074ae0 0x7f04ac076f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f96de000640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f96c006c9c0 0x7f96c006ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00b240 tx=0x7f96cc00b3a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.914+0000 7efd52a00640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd3c06cab0 0x7efd3c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7efd52a00640 1 -- 172.21.15.144:0/410975083 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efd5408cbf0 con 0x7efd5c15ef30 2024-05-30T16:41:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7efd52a00640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7efd3c074cb0 0x7efd3c0770d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7efd52a00640 1 -- 172.21.15.144:0/410975083 --> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd5400cd20 con 0x7efd3c074cb0 2024-05-30T16:41:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.915+0000 7efd52a00640 1 -- 172.21.15.144:0/410975083 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efd5408d080 con 0x7efd5c15ef30 2024-05-30T16:41:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f7ff5e00640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7f7fd00758f0 0x7f7fd0077d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7ff4daa00640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff4bc06c8f0 0x7ff4bc06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0073f0 tx=0x7ff4cc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7ff4db400640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7ff4bc074a90 0x7ff4bc076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f810be00640 1 -- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c160810 msgr2=0x7f810c153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.918+0000 7f96df400640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7f96c0074be0 0x7f96c0077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f810be00640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f810c160810 0x7f810c153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.918+0000 7efd5a800640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd3c06cab0 0x7efd3c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f810be00640 1 -- 172.21.15.144:0/2076501868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810c0d4bd0 msgr2=0x7f810c1fec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f810be00640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810c0d4bd0 0x7f810c1fec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.918+0000 7f04cb400640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f04ac074ae0 0x7f04ac076f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f810be00640 1 -- 172.21.15.144:0/2076501868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c0ba400 con 0x7f810c163ec0 2024-05-30T16:41:59.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.917+0000 7f810b400640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810c0d4bd0 0x7f810c1fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:41:59.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.918+0000 7efd59e00640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7efd3c074cb0 0x7efd3c0770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.918+0000 7f7ff5e00640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7f7fd00758f0 0x7f7fd0077d90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.919+0000 7f810be00640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f810c163ec0 0x7f810c0b7260 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f810400eed0 tx=0x7f810400b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.919+0000 7f9ef8e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef40ba2b0 0x7f9ef4201180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.919+0000 7efd59e00640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7efd3c074cb0 0x7efd3c0770d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.919+0000 7f04c2a00640 1 -- 172.21.15.144:0/1048216611 <== osd.2 v2:172.21.15.144:6808/4188068943 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04ac0775b0 con 0x7f04ac074ae0 2024-05-30T16:41:59.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.919+0000 7efd5a800640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd3c06cab0 0x7efd3c06ef70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd4c034000 tx=0x7efd4c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.919+0000 7f8103400640 1 -- 172.21.15.144:0/2076501868 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104018020 con 0x7f810c163ec0 2024-05-30T16:41:59.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.919+0000 7f8103400640 1 -- 172.21.15.144:0/2076501868 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8104014400 con 0x7f810c163ec0 2024-05-30T16:41:59.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.919+0000 7f8103400640 1 -- 172.21.15.144:0/2076501868 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104009e60 con 0x7f810c163ec0 2024-05-30T16:41:59.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.919+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810c1ff1a0 con 0x7f810c163ec0 2024-05-30T16:41:59.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7ff4d3400640 1 -- 172.21.15.144:0/2307739107 <== osd.4 v2:172.21.15.149:6800/2150238027 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4c801ae50 con 0x7ff4bc074a90 2024-05-30T16:41:59.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810c0c9600 con 0x7f810c163ec0 2024-05-30T16:41:59.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7efd52a00640 1 -- 172.21.15.144:0/410975083 <== osd.3 v2:172.21.15.144:6824/3462006210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd5400cd20 con 0x7efd3c074cb0 2024-05-30T16:41:59.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f9ef8e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef40cfc70 0x7f9ef415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f9ef8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ef415eb80 0x7f9ef40cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f9ef8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef4162b80 con 0x7f9ef415eb80 2024-05-30T16:41:59.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f9ef8e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef40d3050 con 0x7f9ef40cfc70 2024-05-30T16:41:59.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f9ef8e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef4162d00 con 0x7f9ef40ba2b0 2024-05-30T16:41:59.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f9ef1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef40ba2b0 0x7f9ef4201180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f9ef1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef40ba2b0 0x7f9ef4201180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:34946/0 (socket says 172.21.15.144:34946) 2024-05-30T16:41:59.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f9ef1e00640 1 -- 172.21.15.144:0/3355971776 learned_addr learned my addr 172.21.15.144:0/3355971776 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:41:59.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f9ef2800640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ef415eb80 0x7f9ef40cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.921+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f810c0c9cc0 con 0x7f810c163ec0 2024-05-30T16:41:59.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.921+0000 7f9ef1400640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef40cfc70 0x7f9ef415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.920+0000 7f7fed600640 1 -- 172.21.15.144:0/3414049250 <== osd.1 v2:172.21.15.144:6800/331457482 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7fd0078460 con 0x7f7fd00758f0 2024-05-30T16:41:59.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.922+0000 7f96d6a00640 1 -- 172.21.15.144:0/1105529894 <== osd.5 v2:172.21.15.149:6816/668470952 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96d00020b0 con 0x7f96c0074be0 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.922+0000 7f9ef1400640 1 -- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef40ba2b0 msgr2=0x7f9ef4201180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.922+0000 7f9ef1400640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ef40ba2b0 0x7f9ef4201180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.922+0000 7f9ef1400640 1 -- 172.21.15.144:0/3355971776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ef415eb80 msgr2=0x7f9ef40cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.922+0000 7f9ef1400640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ef415eb80 0x7f9ef40cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.922+0000 7f9ef1400640 1 -- 172.21.15.144:0/3355971776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef415be20 con 0x7f9ef40cfc70 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.923+0000 7f9ef1400640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef40cfc70 0x7f9ef415b460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c310 tx=0x7f9ee000c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.923+0000 7f9eea000640 1 -- 172.21.15.144:0/3355971776 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00052d0 con 0x7f9ef40cfc70 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.924+0000 7f9eea000640 1 -- 172.21.15.144:0/3355971776 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee0005470 con 0x7f9ef40cfc70 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.924+0000 7f9eea000640 1 -- 172.21.15.144:0/3355971776 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0007260 con 0x7f9ef40cfc70 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.924+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef415c100 con 0x7f9ef40cfc70 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.924+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef42016c0 con 0x7f9ef40cfc70 2024-05-30T16:41:59.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.925+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ef4075f70 con 0x7f9ef40cfc70 2024-05-30T16:41:59.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.927+0000 7f8103400640 1 -- 172.21.15.144:0/2076501868 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8104005d10 con 0x7f810c163ec0 2024-05-30T16:41:59.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.928+0000 7f9eea000640 1 -- 172.21.15.144:0/3355971776 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ee0007400 con 0x7f9ef40cfc70 2024-05-30T16:41:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.928+0000 7f8103400640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f80e806c9c0 0x7f80e806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.928+0000 7f8103400640 1 -- 172.21.15.144:0/2076501868 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f810408cd30 con 0x7f810c163ec0 2024-05-30T16:41:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.929+0000 7f8103400640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7f80e8074c40 0x7f80e8077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.929+0000 7f8103400640 1 -- 172.21.15.144:0/2076501868 --> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80e8077710 con 0x7f80e8074c40 2024-05-30T16:41:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.929+0000 7f8103400640 1 -- 172.21.15.144:0/2076501868 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f810408d120 con 0x7f810c163ec0 2024-05-30T16:41:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.929+0000 7f810aa00640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7f80e8074c40 0x7f80e8077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.931+0000 7f9eea000640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9ed406c8f0 0x7f9ed406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.931+0000 7f9eea000640 1 -- 172.21.15.144:0/3355971776 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9ee008b810 con 0x7f9ef40cfc70 2024-05-30T16:41:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.931+0000 7f810b400640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f80e806c9c0 0x7f80e806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.931+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 --> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb48002dd0 con 0x7feb4c074b60 2024-05-30T16:41:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.932+0000 7feb66a00640 1 -- 172.21.15.144:0/4043116132 <== osd.0 v2:172.21.15.144:6816/2149619239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb48002dd0 con 0x7feb4c074b60 2024-05-30T16:41:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.932+0000 7f810aa00640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7f80e8074c40 0x7f80e8077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.931+0000 7f9eea000640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f9ed4074af0 0x7f9ed4076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:41:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.932+0000 7f9ef1e00640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9ed406c8f0 0x7f9ed406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.932+0000 7f9eea000640 1 -- 172.21.15.144:0/3355971776 --> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ee001ae50 con 0x7f9ed4074af0 2024-05-30T16:41:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.932+0000 7f9eea000640 1 -- 172.21.15.144:0/3355971776 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9ee008bc00 con 0x7f9ef40cfc70 2024-05-30T16:41:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.932+0000 7f810b400640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f80e806c9c0 0x7f80e806ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f80f4006fd0 tx=0x7f80f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7feb4c074b60 msgr2=0x7feb4c076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb75800640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7feb4c074b60 0x7feb4c076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feb4c06c940 msgr2=0x7feb4c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb75800640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feb4c06c940 0x7feb4c06ee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb58033000 tx=0x7feb58008030 comp rx=0 tx=0).stop 2024-05-30T16:41:59.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb700cdb50 msgr2=0x7feb701f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb75800640 1 --2- 172.21.15.144:0/4043116132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb700cdb50 0x7feb701f4c20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb6000c390 tx=0x7feb6000c850 comp rx=0 tx=0).stop 2024-05-30T16:41:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb6f400640 1 -- 172.21.15.144:0/4043116132 reap_dead start 2024-05-30T16:41:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 shutdown_connections 2024-05-30T16:41:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 >> 172.21.15.144:0/4043116132 conn(0x7feb7006dee0 msgr2=0x7feb7006e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 shutdown_connections 2024-05-30T16:41:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.933+0000 7f9ef2800640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f9ed4074af0 0x7f9ed4076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:41:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.934+0000 7feb75800640 1 -- 172.21.15.144:0/4043116132 wait complete. 2024-05-30T16:41:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.934+0000 7f9ef1e00640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9ed406c8f0 0x7f9ed406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9eec000f80 tx=0x7f9eec009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.934+0000 7f9ef2800640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f9ed4074af0 0x7f9ed4076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:41:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.934+0000 7f8103400640 1 -- 172.21.15.144:0/2076501868 <== osd.6 v2:172.21.15.149:6808/1906248048 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80e8077710 con 0x7f80e8074c40 2024-05-30T16:41:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.936+0000 7f9eea000640 1 -- 172.21.15.144:0/3355971776 <== osd.7 v2:172.21.15.149:6819/1157548473 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ee001ae50 con 0x7f9ed4074af0 2024-05-30T16:41:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.952+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 --> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff4dc068b90 con 0x7ff4bc074a90 2024-05-30T16:41:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.953+0000 7ff4d3400640 1 -- 172.21.15.144:0/2307739107 <== osd.4 v2:172.21.15.149:6800/2150238027 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff4dc068b90 con 0x7ff4bc074a90 2024-05-30T16:41:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.952+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 --> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd34002dd0 con 0x7efd3c074cb0 2024-05-30T16:41:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.953+0000 7efd52a00640 1 -- 172.21.15.144:0/410975083 <== osd.3 v2:172.21.15.144:6824/3462006210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd34002dd0 con 0x7efd3c074cb0 2024-05-30T16:41:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.954+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7efd3c074cb0 msgr2=0x7efd3c0770d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.954+0000 7efd61400640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7efd3c074cb0 0x7efd3c0770d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.954+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd3c06cab0 msgr2=0x7efd3c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.954+0000 7efd61400640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd3c06cab0 0x7efd3c06ef70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd4c034000 tx=0x7efd4c02e000 comp rx=0 tx=0).stop 2024-05-30T16:41:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.954+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd5c15ef30 msgr2=0x7efd5c2005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.954+0000 7efd61400640 1 --2- 172.21.15.144:0/410975083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd5c15ef30 0x7efd5c2005f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd5400eba0 tx=0x7efd5400c490 comp rx=0 tx=0).stop 2024-05-30T16:41:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.954+0000 7efd5b200640 1 -- 172.21.15.144:0/410975083 reap_dead start 2024-05-30T16:41:59.979 INFO:teuthology.orchestra.run.smithi144.stdout:55834574855 2024-05-30T16:41:59.979 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-30T16:41:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 --> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7fe804c3f0 con 0x7f7fd00758f0 2024-05-30T16:41:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7ff4bc074a90 msgr2=0x7ff4bc076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7ff4e1e00640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7ff4bc074a90 0x7ff4bc076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7f96cbe00640 1 -- 172.21.15.144:0/1105529894 --> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96b4002dd0 con 0x7f96c0074be0 2024-05-30T16:41:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff4bc06c8f0 msgr2=0x7ff4bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 shutdown_connections 2024-05-30T16:41:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 >> 172.21.15.144:0/410975083 conn(0x7efd5c070050 msgr2=0x7efd5c13f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 shutdown_connections 2024-05-30T16:41:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7ff4e1e00640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff4bc06c8f0 0x7ff4bc06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0073f0 tx=0x7ff4cc00b040 comp rx=0 tx=0).stop 2024-05-30T16:41:59.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7f7fed600640 1 -- 172.21.15.144:0/3414049250 <== osd.1 v2:172.21.15.144:6800/331457482 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7fe804c3f0 con 0x7f7fd00758f0 2024-05-30T16:41:59.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4dc0cfc70 msgr2=0x7ff4dc1f8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7ff4e1e00640 1 --2- 172.21.15.144:0/2307739107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4dc0cfc70 0x7ff4dc1f8560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800c580 tx=0x7ff4c800ca40 comp rx=0 tx=0).stop 2024-05-30T16:41:59.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.955+0000 7ff4db400640 1 -- 172.21.15.144:0/2307739107 reap_dead start 2024-05-30T16:41:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 shutdown_connections 2024-05-30T16:41:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 >> 172.21.15.144:0/2307739107 conn(0x7ff4dc06cf40 msgr2=0x7ff4dc15dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 shutdown_connections 2024-05-30T16:41:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7ff4e1e00640 1 -- 172.21.15.144:0/2307739107 wait complete. 2024-05-30T16:41:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7efd61400640 1 -- 172.21.15.144:0/410975083 wait complete. 2024-05-30T16:41:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7f96d6a00640 1 -- 172.21.15.144:0/1105529894 <== osd.5 v2:172.21.15.149:6816/668470952 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f96b4002dd0 con 0x7f96c0074be0 2024-05-30T16:41:59.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7f7fd00758f0 msgr2=0x7f7fd0077d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7f7ff6800640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7f7fd00758f0 0x7f7fd0077d90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fd006caf0 msgr2=0x7f7fd006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7f7ff6800640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fd006caf0 0x7f7fd006efb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4033000 tx=0x7f7fe4008030 comp rx=0 tx=0).stop 2024-05-30T16:41:59.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe80d5f00 msgr2=0x7f7fe80dc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.956+0000 7f7ff6800640 1 --2- 172.21.15.144:0/3414049250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fe80d5f00 0x7f7fe80dc5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0073c0 tx=0x7f7fdc0077c0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f7ff5e00640 1 -- 172.21.15.144:0/3414049250 reap_dead start 2024-05-30T16:41:59.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 -- 172.21.15.144:0/1105529894 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7f96c0074be0 msgr2=0x7f96c0077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7f96c0074be0 0x7f96c0077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 shutdown_connections 2024-05-30T16:41:59.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 >> 172.21.15.144:0/3414049250 conn(0x7f7fe8009fb0 msgr2=0x7f7fe8035ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 --> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04cc068b90 con 0x7f04ac074ae0 2024-05-30T16:41:59.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 -- 172.21.15.144:0/1105529894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f96c006c9c0 msgr2=0x7f96c006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f96c006c9c0 0x7f96c006ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00b240 tx=0x7f96cc00b3a0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 -- 172.21.15.144:0/1105529894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e0072360 msgr2=0x7f96e00c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 --2- 172.21.15.144:0/1105529894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e0072360 0x7f96e00c7fa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009e50 tx=0x7f96d0004a40 comp rx=0 tx=0).stop 2024-05-30T16:41:59.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96df400640 1 -- 172.21.15.144:0/1105529894 reap_dead start 2024-05-30T16:41:59.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 shutdown_connections 2024-05-30T16:41:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f7ff6800640 1 -- 172.21.15.144:0/3414049250 wait complete. 2024-05-30T16:41:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 -- 172.21.15.144:0/1105529894 shutdown_connections 2024-05-30T16:41:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 -- 172.21.15.144:0/1105529894 >> 172.21.15.144:0/1105529894 conn(0x7f96e006bd00 msgr2=0x7f96e00b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 -- 172.21.15.144:0/1105529894 shutdown_connections 2024-05-30T16:41:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f04c2a00640 1 -- 172.21.15.144:0/1048216611 <== osd.2 v2:172.21.15.144:6808/4188068943 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f04cc068b90 con 0x7f04ac074ae0 2024-05-30T16:41:59.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.957+0000 7f96cbe00640 1 -- 172.21.15.144:0/1105529894 wait complete. 2024-05-30T16:41:59.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.958+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f04ac074ae0 msgr2=0x7f04ac076f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.958+0000 7f04d1800640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f04ac074ae0 0x7f04ac076f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.958+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f04ac06c940 msgr2=0x7f04ac06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.958+0000 7f04d1800640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f04ac06c940 0x7f04ac06ee00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1ee530 tx=0x7f04b8008040 comp rx=0 tx=0).stop 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.958+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc072210 msgr2=0x7f04cc201450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.958+0000 7f04d1800640 1 --2- 172.21.15.144:0/1048216611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc072210 0x7f04cc201450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04c400c700 tx=0x7f04c400cbc0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.959+0000 7f04cb400640 1 -- 172.21.15.144:0/1048216611 reap_dead start 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.959+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 shutdown_connections 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.959+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 >> 172.21.15.144:0/1048216611 conn(0x7f04cc06bd00 msgr2=0x7f04cc1ee5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.959+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 shutdown_connections 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.959+0000 7f04d1800640 1 -- 172.21.15.144:0/1048216611 wait complete. 2024-05-30T16:41:59.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.970+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 --> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f810c075570 con 0x7f80e8074c40 2024-05-30T16:41:59.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.971+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 --> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ef4162800 con 0x7f9ed4074af0 2024-05-30T16:41:59.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.971+0000 7f8103400640 1 -- 172.21.15.144:0/2076501868 <== osd.6 v2:172.21.15.149:6808/1906248048 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f810c075570 con 0x7f80e8074c40 2024-05-30T16:41:59.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.972+0000 7f9eea000640 1 -- 172.21.15.144:0/3355971776 <== osd.7 v2:172.21.15.149:6819/1157548473 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9ef4162800 con 0x7f9ed4074af0 2024-05-30T16:41:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.972+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7f80e8074c40 msgr2=0x7f80e8077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.972+0000 7f8112800640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7f80e8074c40 0x7f80e8077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f9ed4074af0 msgr2=0x7f9ed4076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f9ef8e00640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f9ed4074af0 0x7f9ed4076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f80e806c9c0 msgr2=0x7f80e806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f8112800640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f80e806c9c0 0x7f80e806ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f80f4006fd0 tx=0x7f80f4008040 comp rx=0 tx=0).stop 2024-05-30T16:41:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9ed406c8f0 msgr2=0x7f9ed406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f9ef8e00640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9ed406c8f0 0x7f9ed406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9eec000f80 tx=0x7f9eec009000 comp rx=0 tx=0).stop 2024-05-30T16:41:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef40cfc70 msgr2=0x7f9ef415b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f9ef8e00640 1 --2- 172.21.15.144:0/3355971776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef40cfc70 0x7f9ef415b460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c310 tx=0x7f9ee000c7d0 comp rx=0 tx=0).stop 2024-05-30T16:41:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f9ef2800640 1 -- 172.21.15.144:0/3355971776 reap_dead start 2024-05-30T16:41:59.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f810c163ec0 msgr2=0x7f810c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:41:59.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f8112800640 1 --2- 172.21.15.144:0/2076501868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f810c163ec0 0x7f810c0b7260 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f810400eed0 tx=0x7f810400b480 comp rx=0 tx=0).stop 2024-05-30T16:41:59.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f810be00640 1 -- 172.21.15.144:0/2076501868 reap_dead start 2024-05-30T16:41:59.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 shutdown_connections 2024-05-30T16:41:59.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.973+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 >> 172.21.15.144:0/2076501868 conn(0x7f810c06cff0 msgr2=0x7f810c0b6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.974+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 shutdown_connections 2024-05-30T16:41:59.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.974+0000 7f8112800640 1 -- 172.21.15.144:0/2076501868 wait complete. 2024-05-30T16:41:59.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.974+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 shutdown_connections 2024-05-30T16:41:59.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.974+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 >> 172.21.15.144:0/3355971776 conn(0x7f9ef406cf40 msgr2=0x7f9ef4074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:41:59.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.974+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 shutdown_connections 2024-05-30T16:41:59.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:41:59.974+0000 7f9ef8e00640 1 -- 172.21.15.144:0/3355971776 wait complete. 2024-05-30T16:41:59.995 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:41:59.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-30T16:41:59.996 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:41:59.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-30T16:41:59.997 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:41:59.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-30T16:41:59.998 INFO:teuthology.orchestra.run.smithi144.stdout:55834574854 2024-05-30T16:41:59.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-30T16:41:59.999 INFO:teuthology.orchestra.run.smithi144.stdout:55834574855 2024-05-30T16:42:00.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-30T16:42:00.000 INFO:teuthology.orchestra.run.smithi144.stdout:55834574854 2024-05-30T16:42:00.001 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-30T16:42:00.001 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:42:00.002 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-30T16:42:00.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.235+0000 7fc0fe800640 1 Processor -- start 2024-05-30T16:42:00.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.235+0000 7fc0fe800640 1 -- start start 2024-05-30T16:42:00.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.237+0000 7fc0fe800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc0f00e32d0 0x7fc0f0052c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.237+0000 7fc0fe800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f004ff80 0x7fc0f0037bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.237+0000 7fc0fe800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f00536a0 con 0x7fc0f0053190 2024-05-30T16:42:00.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.237+0000 7fc0fe800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc0f00e36b0 con 0x7fc0f00e32d0 2024-05-30T16:42:00.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.237+0000 7fc0fe800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f0053980 con 0x7fc0f004ff80 2024-05-30T16:42:00.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.238+0000 7fc0fd400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc0f00e32d0 0x7fc0f0052c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.239+0000 7fc0fca00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc0f0053190 0x7fc0f004f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:37096/0 (socket says 172.21.15.144:37096) 2024-05-30T16:42:00.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.239+0000 7fc0fca00640 1 -- 172.21.15.144:0/929676088 learned_addr learned my addr 172.21.15.144:0/929676088 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:00.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.239+0000 7fc0fde00640 1 --2- 172.21.15.144:0/929676088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f004ff80 0x7fc0f0037bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.240+0000 7fc0f7e00640 1 -- 172.21.15.144:0/929676088 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791843444 0 0) 0x7fc0f00536a0 con 0x7fc0f0053190 2024-05-30T16:42:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.240+0000 7fc0f7e00640 1 -- 172.21.15.144:0/929676088 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0e0003520 con 0x7fc0f0053190 2024-05-30T16:42:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.241+0000 7fc0fde00640 1 -- 172.21.15.144:0/929676088 >> v2:172.21.15.149:3300/0 conn(0x7fc0f00e32d0 msgr2=0x7fc0f0052c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.241+0000 7fc0fde00640 1 --2- 172.21.15.144:0/929676088 >> v2:172.21.15.149:3300/0 conn(0x7fc0f00e32d0 0x7fc0f0052c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.241+0000 7fc0fde00640 1 -- 172.21.15.144:0/929676088 >> v1:172.21.15.149:6789/0 conn(0x7fc0f0053190 legacy=0x7fc0f004f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.241+0000 7fc0fde00640 1 -- 172.21.15.144:0/929676088 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f0053c60 con 0x7fc0f004ff80 2024-05-30T16:42:00.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.242+0000 7fc0fde00640 1 --2- 172.21.15.144:0/929676088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f004ff80 0x7fc0f0037bb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8000b60 tx=0x7fc0f80a5d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7577ec2452bfb92 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.243+0000 7fc0f7e00640 1 -- 172.21.15.144:0/929676088 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80b3070 con 0x7fc0f004ff80 2024-05-30T16:42:00.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.243+0000 7fc0f7e00640 1 -- 172.21.15.144:0/929676088 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f80a6b40 con 0x7fc0f004ff80 2024-05-30T16:42:00.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.243+0000 7fc0f7e00640 1 -- 172.21.15.144:0/929676088 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80ae440 con 0x7fc0f004ff80 2024-05-30T16:42:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.246+0000 7fc0fe800640 1 -- 172.21.15.144:0/929676088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f004ff80 msgr2=0x7fc0f0037bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.246+0000 7fc0fe800640 1 --2- 172.21.15.144:0/929676088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f004ff80 0x7fc0f0037bb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8000b60 tx=0x7fc0f80a5d70 comp rx=0 tx=0).stop 2024-05-30T16:42:00.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.247+0000 7fc0fe800640 1 -- 172.21.15.144:0/929676088 shutdown_connections 2024-05-30T16:42:00.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.247+0000 7fc0fe800640 1 --2- 172.21.15.144:0/929676088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f004ff80 0x7fc0f0037bb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.247+0000 7fc0fe800640 1 --2- 172.21.15.144:0/929676088 >> v2:172.21.15.149:3300/0 conn(0x7fc0f00e32d0 0x7fc0f0052c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.247+0000 7fc0fe800640 1 -- 172.21.15.144:0/929676088 >> 172.21.15.144:0/929676088 conn(0x7fc0f0009fb0 msgr2=0x7fc0f000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.253+0000 7fc0fe800640 1 -- 172.21.15.144:0/929676088 shutdown_connections 2024-05-30T16:42:00.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.253+0000 7fc0fe800640 1 -- 172.21.15.144:0/929676088 wait complete. 2024-05-30T16:42:00.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.256+0000 7fc0fe800640 1 Processor -- start 2024-05-30T16:42:00.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.257+0000 7fc0fe800640 1 -- start start 2024-05-30T16:42:00.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.259+0000 7fc0fe800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0f004ff80 0x7fc0f004d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.259+0000 7fc0fe800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0f0053190 0x7fc0f004c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.260+0000 7fc0fe800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f00e32d0 0x7fc0f01853e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.260+0000 7fc0fe800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f0054740 con 0x7fc0f0053190 2024-05-30T16:42:00.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.260+0000 7fc0fde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f00e32d0 0x7fc0f01853e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.261+0000 7fc0fde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f00e32d0 0x7fc0f01853e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:34962/0 (socket says 172.21.15.144:34962) 2024-05-30T16:42:00.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.261+0000 7fc0fde00640 1 -- 172.21.15.144:0/932936728 learned_addr learned my addr 172.21.15.144:0/932936728 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:00.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.261+0000 7fc0fe800640 1 -- 172.21.15.144:0/932936728 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f0054220 con 0x7fc0f004ff80 2024-05-30T16:42:00.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.261+0000 7fc0fe800640 1 -- 172.21.15.144:0/932936728 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f003a900 con 0x7fc0f00e32d0 2024-05-30T16:42:00.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.261+0000 7fc0fd400640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0f004ff80 0x7fc0f004d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.262+0000 7fc0fca00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0f0053190 0x7fc0f004c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.262+0000 7fc0fde00640 1 -- 172.21.15.144:0/932936728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0f004ff80 msgr2=0x7fc0f004d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.262+0000 7fc0fde00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0f004ff80 0x7fc0f004d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.262+0000 7fc0fde00640 1 -- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0f0053190 msgr2=0x7fc0f004c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.263+0000 7fc0fde00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0f0053190 0x7fc0f004c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.263+0000 7fc0fde00640 1 -- 172.21.15.144:0/932936728 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f004dec0 con 0x7fc0f00e32d0 2024-05-30T16:42:00.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.263+0000 7fc0fca00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0f0053190 0x7fc0f004c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:00.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.264+0000 7fc0fde00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f00e32d0 0x7fc0f01853e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8051690 tx=0x7fc0f8069790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.265+0000 7fc0f5600640 1 -- 172.21.15.144:0/932936728 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80bb070 con 0x7fc0f00e32d0 2024-05-30T16:42:00.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.265+0000 7fc0f5600640 1 -- 172.21.15.144:0/932936728 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f80b7410 con 0x7fc0f00e32d0 2024-05-30T16:42:00.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.265+0000 7fc0fe800640 1 -- 172.21.15.144:0/932936728 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f004e1a0 con 0x7fc0f00e32d0 2024-05-30T16:42:00.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.265+0000 7fc0fe800640 1 -- 172.21.15.144:0/932936728 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f00e3d00 con 0x7fc0f00e32d0 2024-05-30T16:42:00.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.267+0000 7fc0eaa00640 1 -- 172.21.15.144:0/932936728 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d4005290 con 0x7fc0f00e32d0 2024-05-30T16:42:00.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.267+0000 7fc0f5600640 1 -- 172.21.15.144:0/932936728 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80b3040 con 0x7fc0f00e32d0 2024-05-30T16:42:00.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.271+0000 7fc0f5600640 1 -- 172.21.15.144:0/932936728 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc0f80be070 con 0x7fc0f00e32d0 2024-05-30T16:42:00.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.273+0000 7fc0f5600640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0d806c8f0 0x7fc0d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.274+0000 7fc0fd400640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0d806c8f0 0x7fc0d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.275+0000 7fc0fd400640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0d806c8f0 0x7fc0d806edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009b40 tx=0x7fc0e4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.275+0000 7fc0f5600640 1 -- 172.21.15.144:0/932936728 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc0f80f38c0 con 0x7fc0f00e32d0 2024-05-30T16:42:00.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.286+0000 7fc0f5600640 1 -- 172.21.15.144:0/932936728 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc0f80f5820 con 0x7fc0f00e32d0 2024-05-30T16:42:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.313+0000 7efc47200640 1 Processor -- start 2024-05-30T16:42:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.313+0000 7efc47200640 1 -- start start 2024-05-30T16:42:00.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.314+0000 7f2973400640 1 Processor -- start 2024-05-30T16:42:00.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.314+0000 7f2973400640 1 -- start start 2024-05-30T16:42:00.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.316+0000 7f2973400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f296c0ceda0 0x7f296c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.316+0000 7f2973400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c0ccec0 0x7f296c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.316+0000 7f2973400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296c0b41c0 con 0x7f296c06fa80 2024-05-30T16:42:00.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.316+0000 7f2973400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f296c06f3a0 con 0x7f296c0ceda0 2024-05-30T16:42:00.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.316+0000 7f2973400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f296c0b44a0 con 0x7f296c0ccec0 2024-05-30T16:42:00.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.316+0000 7f296be00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f296c06fa80 0x7f296c16b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:37122/0 (socket says 172.21.15.144:37122) 2024-05-30T16:42:00.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.317+0000 7f296be00640 1 -- 172.21.15.144:0/2308356117 learned_addr learned my addr 172.21.15.144:0/2308356117 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:00.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.317+0000 7f2970a00640 1 --2- 172.21.15.144:0/2308356117 >> v2:172.21.15.149:3300/0 conn(0x7f296c0ceda0 0x7f296c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.317+0000 7f2971400640 1 --2- 172.21.15.144:0/2308356117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c0ccec0 0x7f296c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.315+0000 7efc47200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc4816ef00 0x7efc4816f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.315+0000 7efc47200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc4808b0b0 0x7efc4808b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.315+0000 7efc47200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4816f820 con 0x7efc480b3f30 2024-05-30T16:42:00.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.315+0000 7efc47200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efc480b44d0 con 0x7efc4808b0b0 2024-05-30T16:42:00.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.315+0000 7efc47200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7efc480b47b0 con 0x7efc4816ef00 2024-05-30T16:42:00.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.316+0000 7efc45400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7efc480b3f30 0x7efc480cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:37106/0 (socket says 172.21.15.144:37106) 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.316+0000 7efc45400640 1 -- 172.21.15.144:0/956767776 learned_addr learned my addr 172.21.15.144:0/956767776 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.316+0000 7efc46800640 1 --2- 172.21.15.144:0/956767776 >> v2:172.21.15.144:3300/0 conn(0x7efc4808b0b0 0x7efc4808b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.317+0000 7efc45e00640 1 --2- 172.21.15.144:0/956767776 >> v2:172.21.15.149:3300/0 conn(0x7efc4816ef00 0x7efc4816f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.317+0000 7efc46800640 1 -- 172.21.15.144:0/956767776 >> v2:172.21.15.149:3300/0 conn(0x7efc4816ef00 msgr2=0x7efc4816f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.317+0000 7efc46800640 1 --2- 172.21.15.144:0/956767776 >> v2:172.21.15.149:3300/0 conn(0x7efc4816ef00 0x7efc4816f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.317+0000 7efc46800640 1 -- 172.21.15.144:0/956767776 >> v1:172.21.15.149:6789/0 conn(0x7efc480b3f30 legacy=0x7efc480cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.317+0000 7efc46800640 1 -- 172.21.15.144:0/956767776 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc480b4a90 con 0x7efc4808b0b0 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.318+0000 7f2971400640 1 -- 172.21.15.144:0/2308356117 >> v2:172.21.15.149:3300/0 conn(0x7f296c0ceda0 msgr2=0x7f296c06eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.318+0000 7f2971400640 1 --2- 172.21.15.144:0/2308356117 >> v2:172.21.15.149:3300/0 conn(0x7f296c0ceda0 0x7f296c06eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.318+0000 7f2971400640 1 -- 172.21.15.144:0/2308356117 >> v1:172.21.15.149:6789/0 conn(0x7f296c06fa80 legacy=0x7f296c16b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.318+0000 7f2971400640 1 -- 172.21.15.144:0/2308356117 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c0b4780 con 0x7f296c0ccec0 2024-05-30T16:42:00.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.319+0000 7f5d0b800640 1 Processor -- start 2024-05-30T16:42:00.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.319+0000 7f5d0b800640 1 -- start start 2024-05-30T16:42:00.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.320+0000 7f2971400640 1 --2- 172.21.15.144:0/2308356117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c0ccec0 0x7f296c0cd370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29640097a0 tx=0x7f296402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e9ce657c33de7b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.320+0000 7efc46800640 1 --2- 172.21.15.144:0/956767776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4808b0b0 0x7efc4808b4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc48063090 tx=0x7efc3802aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04300233c72b51b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.320+0000 7fd154e00640 1 Processor -- start 2024-05-30T16:42:00.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.320+0000 7f296b400640 1 -- 172.21.15.144:0/2308356117 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964037070 con 0x7f296c0ccec0 2024-05-30T16:42:00.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7f296b400640 1 -- 172.21.15.144:0/2308356117 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2964032440 con 0x7f296c0ccec0 2024-05-30T16:42:00.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7f296b400640 1 -- 172.21.15.144:0/2308356117 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964037070 con 0x7f296c0ccec0 2024-05-30T16:42:00.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7efc44a00640 1 -- 172.21.15.144:0/956767776 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38038070 con 0x7efc4808b0b0 2024-05-30T16:42:00.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7efc44a00640 1 -- 172.21.15.144:0/956767776 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3802b7e0 con 0x7efc4808b0b0 2024-05-30T16:42:00.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7f5d0b800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d04155a80 0x7f5d040cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7f5d0b800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 0x7f5d040cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7f5d0b800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d04072c60 con 0x7f5d040ccea0 2024-05-30T16:42:00.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7f5d0b800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5d040cd850 con 0x7f5d04155a80 2024-05-30T16:42:00.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7f5d0b800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d040ce390 con 0x7f5d04072600 2024-05-30T16:42:00.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7fd154e00640 1 -- start start 2024-05-30T16:42:00.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.321+0000 7efc44a00640 1 -- 172.21.15.144:0/956767776 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38038070 con 0x7efc4808b0b0 2024-05-30T16:42:00.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7efc47200640 1 -- 172.21.15.144:0/956767776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4808b0b0 msgr2=0x7efc4808b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7efc47200640 1 --2- 172.21.15.144:0/956767776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4808b0b0 0x7efc4808b4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc48063090 tx=0x7efc3802aca0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7f5d03e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5d040ccea0 0x7f5d04071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54704/0 (socket says 172.21.15.144:54704) 2024-05-30T16:42:00.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7f5d03e00640 1 -- 172.21.15.144:0/1930662591 learned_addr learned my addr 172.21.15.144:0/1930662591 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:00.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7efc47200640 1 -- 172.21.15.144:0/956767776 shutdown_connections 2024-05-30T16:42:00.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7efc47200640 1 --2- 172.21.15.144:0/956767776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4808b0b0 0x7efc4808b4e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7efc47200640 1 --2- 172.21.15.144:0/956767776 >> v2:172.21.15.149:3300/0 conn(0x7efc4816ef00 0x7efc4816f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7efc47200640 1 -- 172.21.15.144:0/956767776 >> 172.21.15.144:0/956767776 conn(0x7efc4806dea0 msgr2=0x7efc4806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7f2973400640 1 -- 172.21.15.144:0/2308356117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c0ccec0 msgr2=0x7f296c0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7f2973400640 1 --2- 172.21.15.144:0/2308356117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c0ccec0 0x7f296c0cd370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29640097a0 tx=0x7f296402a250 comp rx=0 tx=0).stop 2024-05-30T16:42:00.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7efc47200640 1 -- 172.21.15.144:0/956767776 shutdown_connections 2024-05-30T16:42:00.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f2973400640 1 -- 172.21.15.144:0/2308356117 shutdown_connections 2024-05-30T16:42:00.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f2973400640 1 --2- 172.21.15.144:0/2308356117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c0ccec0 0x7f296c0cd370 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f2973400640 1 --2- 172.21.15.144:0/2308356117 >> v2:172.21.15.149:3300/0 conn(0x7f296c0ceda0 0x7f296c06eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f2973400640 1 -- 172.21.15.144:0/2308356117 >> 172.21.15.144:0/2308356117 conn(0x7f296c062570 msgr2=0x7f296c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f2973400640 1 -- 172.21.15.144:0/2308356117 shutdown_connections 2024-05-30T16:42:00.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd154e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd1480ead00 0x7fd14804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd154e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd14804ffd0 0x7fd148037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7f2973400640 1 -- 172.21.15.144:0/2308356117 wait complete. 2024-05-30T16:42:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7efc47200640 1 -- 172.21.15.144:0/956767776 wait complete. 2024-05-30T16:42:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd154e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd148038110 0x7fd1480385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd154e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd148054330 con 0x7fd1480ead00 2024-05-30T16:42:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd154e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd148053720 con 0x7fd14804ffd0 2024-05-30T16:42:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd154e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd148053a00 con 0x7fd148038110 2024-05-30T16:42:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd14f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd1480ead00 0x7fd14804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd14f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd1480ead00 0x7fd14804fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58932/0 (socket says 172.21.15.144:58932) 2024-05-30T16:42:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd14f400640 1 -- 172.21.15.144:0/684728554 learned_addr learned my addr 172.21.15.144:0/684728554 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.324+0000 7fd14fe00640 1 --2- 172.21.15.144:0/684728554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd148038110 0x7fd1480385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.322+0000 7f5d08e00640 1 --2- 172.21.15.144:0/1930662591 >> v2:172.21.15.149:3300/0 conn(0x7f5d04155a80 0x7f5d040cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f5d09800640 1 --2- 172.21.15.144:0/1930662591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 0x7f5d040cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f5d08e00640 1 -- 172.21.15.144:0/1930662591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 msgr2=0x7f5d040cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f5d08e00640 1 --2- 172.21.15.144:0/1930662591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 0x7f5d040cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f5d08e00640 1 -- 172.21.15.144:0/1930662591 >> v1:172.21.15.144:6789/0 conn(0x7f5d040ccea0 legacy=0x7f5d04071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.323+0000 7f5d08e00640 1 -- 172.21.15.144:0/1930662591 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d040ce5e0 con 0x7f5d04155a80 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.325+0000 7f5d08e00640 1 --2- 172.21.15.144:0/1930662591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d04155a80 0x7f5d040cf0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40097a0 tx=0x7f5cf4032810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7644b1a5d6c50d8b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.325+0000 7fd14f400640 1 -- 172.21.15.144:0/684728554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd148038110 msgr2=0x7fd1480385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.325+0000 7fd14f400640 1 --2- 172.21.15.144:0/684728554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd148038110 0x7fd1480385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.326+0000 7f5d03400640 1 -- 172.21.15.144:0/1930662591 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf403e070 con 0x7f5d04155a80 2024-05-30T16:42:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.326+0000 7f5d03400640 1 -- 172.21.15.144:0/1930662591 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4037710 con 0x7f5d04155a80 2024-05-30T16:42:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.326+0000 7f5d03400640 1 -- 172.21.15.144:0/1930662591 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf403e070 con 0x7f5d04155a80 2024-05-30T16:42:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f2973400640 1 Processor -- start 2024-05-30T16:42:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.325+0000 7fd14f400640 1 -- 172.21.15.144:0/684728554 >> v2:172.21.15.149:3300/0 conn(0x7fd14804ffd0 msgr2=0x7fd148037bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:42:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.325+0000 7fd14f400640 1 --2- 172.21.15.144:0/684728554 >> v2:172.21.15.149:3300/0 conn(0x7fd14804ffd0 0x7fd148037bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.325+0000 7fd14f400640 1 -- 172.21.15.144:0/684728554 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd148053ce0 con 0x7fd1480ead00 2024-05-30T16:42:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f5d0b800640 1 -- 172.21.15.144:0/1930662591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d04155a80 msgr2=0x7f5d040cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f5d0b800640 1 --2- 172.21.15.144:0/1930662591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d04155a80 0x7f5d040cf0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40097a0 tx=0x7f5cf4032810 comp rx=0 tx=0).stop 2024-05-30T16:42:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f821ce00640 1 Processor -- start 2024-05-30T16:42:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f2973400640 1 -- start start 2024-05-30T16:42:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f5d0b800640 1 -- 172.21.15.144:0/1930662591 shutdown_connections 2024-05-30T16:42:00.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f5d0b800640 1 --2- 172.21.15.144:0/1930662591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 0x7f5d040cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f5d0b800640 1 --2- 172.21.15.144:0/1930662591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d04155a80 0x7f5d040cf0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f5d0b800640 1 -- 172.21.15.144:0/1930662591 >> 172.21.15.144:0/1930662591 conn(0x7f5d04062570 msgr2=0x7f5d0406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7efc47200640 1 Processor -- start 2024-05-30T16:42:00.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.328+0000 7f49d6e00640 1 Processor -- start 2024-05-30T16:42:00.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.327+0000 7f821ce00640 1 -- start start 2024-05-30T16:42:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7f2973400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c06fa80 0x7f296c15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7f2973400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296c0ccec0 0x7f296c20e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.328+0000 7f49d6e00640 1 -- start start 2024-05-30T16:42:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.328+0000 7fd14f400640 1 --2- 172.21.15.144:0/684728554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1480ead00 0x7fd14804fa90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd148036560 tx=0x7fd14402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d3055220bc7e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7f2973400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f296c0ceda0 0x7f296c20e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7f2973400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f296c16c1a0 con 0x7f296c0ccec0 2024-05-30T16:42:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7f2973400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f296c16c020 con 0x7f296c0ceda0 2024-05-30T16:42:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7f2973400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f296c16e400 con 0x7f296c06fa80 2024-05-30T16:42:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7f296be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296c0ccec0 0x7f296c20e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7f2970a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c06fa80 0x7f296c15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f296be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296c0ccec0 0x7f296c20e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58946/0 (socket says 172.21.15.144:58946) 2024-05-30T16:42:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f296be00640 1 -- 172.21.15.144:0/2609197526 learned_addr learned my addr 172.21.15.144:0/2609197526 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f2970a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c06fa80 0x7f296c15d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35000/0 (socket says 172.21.15.144:35000) 2024-05-30T16:42:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.328+0000 7efc47200640 1 -- start start 2024-05-30T16:42:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7efc47200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc4808b0b0 0x7efc481f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7efc47200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc480b3f30 0x7efc481689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7efc47200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc4816ef00 0x7efc4816afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7efc47200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc48165b70 con 0x7efc480b3f30 2024-05-30T16:42:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7efc47200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efc480b5050 con 0x7efc4808b0b0 2024-05-30T16:42:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7efc47200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efc48165cf0 con 0x7efc4816ef00 2024-05-30T16:42:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7f821ce00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f821815c6e0 0x7f82180d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7fd14e000640 1 -- 172.21.15.144:0/684728554 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144037070 con 0x7fd1480ead00 2024-05-30T16:42:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.329+0000 7fd14e000640 1 -- 172.21.15.144:0/684728554 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd144032440 con 0x7fd1480ead00 2024-05-30T16:42:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7fd14e000640 1 -- 172.21.15.144:0/684728554 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144032810 con 0x7fd1480ead00 2024-05-30T16:42:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f821ce00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8218160120 con 0x7f82180d15e0 2024-05-30T16:42:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f2971400640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f296c0ceda0 0x7f296c20e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7efc46800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc4816ef00 0x7efc4816afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7efc45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc480b3f30 0x7efc481689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f821ce00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82180cf3e0 con 0x7f821815fd00 2024-05-30T16:42:00.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f821ce00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f82180d0440 con 0x7f821815c6e0 2024-05-30T16:42:00.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f820d400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f82180d15e0 0x7f821815f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54714/0 (socket says 172.21.15.144:54714) 2024-05-30T16:42:00.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f820d400640 1 -- 172.21.15.144:0/1223394826 learned_addr learned my addr 172.21.15.144:0/1223394826 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:00.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7efc46800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc4816ef00 0x7efc4816afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35016/0 (socket says 172.21.15.144:35016) 2024-05-30T16:42:00.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.331+0000 7f8215e00640 1 --2- 172.21.15.144:0/1223394826 >> v2:172.21.15.149:3300/0 conn(0x7f821815c6e0 0x7f82180d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.331+0000 7efc45e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc4808b0b0 0x7efc481f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.331+0000 7efc45e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc4808b0b0 0x7efc481f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:35992/0 (socket says 172.21.15.144:35992) 2024-05-30T16:42:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.331+0000 7efc45e00640 1 -- 172.21.15.144:0/823537252 learned_addr learned my addr 172.21.15.144:0/823537252 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.331+0000 7f49d6e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f49d00b23b0 0x7f49d016db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f5d0b800640 1 -- 172.21.15.144:0/1930662591 shutdown_connections 2024-05-30T16:42:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.330+0000 7f5d0b800640 1 -- 172.21.15.144:0/1930662591 wait complete. 2024-05-30T16:42:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7f8215400640 1 -- 172.21.15.144:0/1223394826 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932245819 0 0) 0x7f8218160120 con 0x7f82180d15e0 2024-05-30T16:42:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7f8215400640 1 -- 172.21.15.144:0/1223394826 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81fc003520 con 0x7f82180d15e0 2024-05-30T16:42:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7fd154e00640 1 -- 172.21.15.144:0/684728554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1480ead00 msgr2=0x7fd14804fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7fd154e00640 1 --2- 172.21.15.144:0/684728554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1480ead00 0x7fd14804fa90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd148036560 tx=0x7fd14402a1f0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7efc45400640 1 -- 172.21.15.144:0/823537252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc4816ef00 msgr2=0x7efc4816afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.331+0000 7f49d6e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49d0163a50 con 0x7f49d00cfe90 2024-05-30T16:42:00.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.331+0000 7f49d6e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49d0163d30 con 0x7f49d0149070 2024-05-30T16:42:00.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.331+0000 7f49d6e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f49d0164010 con 0x7f49d00b23b0 2024-05-30T16:42:00.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7fd154e00640 1 -- 172.21.15.144:0/684728554 shutdown_connections 2024-05-30T16:42:00.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7fd154e00640 1 --2- 172.21.15.144:0/684728554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd148038110 0x7fd1480385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7fd154e00640 1 --2- 172.21.15.144:0/684728554 >> v2:172.21.15.149:3300/0 conn(0x7fd14804ffd0 0x7fd148037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7fd154e00640 1 --2- 172.21.15.144:0/684728554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1480ead00 0x7fd14804fa90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7fd154e00640 1 -- 172.21.15.144:0/684728554 >> 172.21.15.144:0/684728554 conn(0x7fd148009fb0 msgr2=0x7fd14800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7f296be00640 1 -- 172.21.15.144:0/2609197526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c06fa80 msgr2=0x7f296c15d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7f296be00640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c06fa80 0x7f296c15d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7f296be00640 1 -- 172.21.15.144:0/2609197526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f296c0ceda0 msgr2=0x7f296c20e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7f296be00640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f296c0ceda0 0x7f296c20e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.333+0000 7f296be00640 1 -- 172.21.15.144:0/2609197526 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c17d120 con 0x7f296c0ccec0 2024-05-30T16:42:00.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.333+0000 7f296be00640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296c0ccec0 0x7f296c20e020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f295c00cb10 tx=0x7f295c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7f49d5000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f49d00cfe90 0x7f49d00b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54726/0 (socket says 172.21.15.144:54726) 2024-05-30T16:42:00.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7f49d5000640 1 -- 172.21.15.144:0/1860307702 learned_addr learned my addr 172.21.15.144:0/1860307702 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:00.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7fd154e00640 1 -- 172.21.15.144:0/684728554 shutdown_connections 2024-05-30T16:42:00.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.333+0000 7fd154e00640 1 -- 172.21.15.144:0/684728554 wait complete. 2024-05-30T16:42:00.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.334+0000 7f2968c00640 1 -- 172.21.15.144:0/2609197526 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c017070 con 0x7f296c0ccec0 2024-05-30T16:42:00.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.334+0000 7f2968c00640 1 -- 172.21.15.144:0/2609197526 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f295c00ac70 con 0x7f296c0ccec0 2024-05-30T16:42:00.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.334+0000 7f2968c00640 1 -- 172.21.15.144:0/2609197526 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c012620 con 0x7f296c0ccec0 2024-05-30T16:42:00.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.332+0000 7efc45400640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc4816ef00 0x7efc4816afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.334+0000 7efc45400640 1 -- 172.21.15.144:0/823537252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc4808b0b0 msgr2=0x7efc481f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.334+0000 7efc45400640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc4808b0b0 0x7efc481f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.334+0000 7efc45400640 1 -- 172.21.15.144:0/823537252 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc482052b0 con 0x7efc480b3f30 2024-05-30T16:42:00.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.333+0000 7f8215e00640 1 -- 172.21.15.144:0/1223394826 >> v1:172.21.15.149:6789/0 conn(0x7f821815fd00 legacy=0x7f82180d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.333+0000 7f8215e00640 1 -- 172.21.15.144:0/1223394826 >> v1:172.21.15.144:6789/0 conn(0x7f82180d15e0 legacy=0x7f821815f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.333+0000 7f8215e00640 1 -- 172.21.15.144:0/1223394826 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82180d1a70 con 0x7f821815c6e0 2024-05-30T16:42:00.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.333+0000 7f5d0b800640 1 Processor -- start 2024-05-30T16:42:00.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.334+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f296c17d400 con 0x7f296c0ccec0 2024-05-30T16:42:00.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.335+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296c17d9c0 con 0x7f296c0ccec0 2024-05-30T16:42:00.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.335+0000 7f8215e00640 1 --2- 172.21.15.144:0/1223394826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 0x7f82180d10a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82180d1c40 tx=0x7f820802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33d2d7935f438398 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.334+0000 7f49d6400640 1 --2- 172.21.15.144:0/1860307702 >> v2:172.21.15.149:3300/0 conn(0x7f49d00b23b0 0x7f49d016db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.335+0000 7f49d6400640 1 -- 172.21.15.144:0/1860307702 >> v1:172.21.15.149:6789/0 conn(0x7f49d0149070 legacy=0x7f49d01631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.335+0000 7f49d6400640 1 -- 172.21.15.144:0/1860307702 >> v1:172.21.15.144:6789/0 conn(0x7f49d00cfe90 legacy=0x7f49d00b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.335+0000 7f49d6400640 1 -- 172.21.15.144:0/1860307702 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d01646a0 con 0x7f49d00b23b0 2024-05-30T16:42:00.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.334+0000 7f5d0b800640 1 -- start start 2024-05-30T16:42:00.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.335+0000 7f5d0b800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 0x7f5d04152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.335+0000 7f5d0b800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d040ccea0 0x7f5d04156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f5d0b800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d04155a80 0x7f5d04157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f5d0b800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040cf600 con 0x7f5d04155a80 2024-05-30T16:42:00.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f5d0b800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d04155e60 con 0x7f5d040ccea0 2024-05-30T16:42:00.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f5d0b800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d040cf780 con 0x7f5d04072600 2024-05-30T16:42:00.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.335+0000 7fd154e00640 1 Processor -- start 2024-05-30T16:42:00.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7fd154e00640 1 -- start start 2024-05-30T16:42:00.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f296c1539f0 con 0x7f296c0ccec0 2024-05-30T16:42:00.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f5d08e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 0x7f5d04152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.337+0000 7efc45e00640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc4808b0b0 0x7efc481f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:42:00.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f8215400640 1 -- 172.21.15.144:0/1223394826 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208037070 con 0x7f821815c6e0 2024-05-30T16:42:00.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.337+0000 7f8215400640 1 -- 172.21.15.144:0/1223394826 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8208032440 con 0x7f821815c6e0 2024-05-30T16:42:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.337+0000 7f8215400640 1 -- 172.21.15.144:0/1223394826 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208032850 con 0x7f821815c6e0 2024-05-30T16:42:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f5d08e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 0x7f5d04152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35018/0 (socket says 172.21.15.144:35018) 2024-05-30T16:42:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f5d03e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d040ccea0 0x7f5d04156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f5d03e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d040ccea0 0x7f5d04156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36016/0 (socket says 172.21.15.144:36016) 2024-05-30T16:42:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.336+0000 7f5d03e00640 1 -- 172.21.15.144:0/1837465817 learned_addr learned my addr 172.21.15.144:0/1837465817 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.337+0000 7f5d09800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d04155a80 0x7f5d04157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.337+0000 7efc45400640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc480b3f30 0x7efc481689b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c830 tx=0x7efc3400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f821ce00640 1 -- 172.21.15.144:0/1223394826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 msgr2=0x7f82180d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7fd154e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd148038110 0x7fd1480d58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7fd154e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14804ffd0 0x7fd1480d5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7fd154e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1480ead00 0x7fd148035e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f821ce00640 1 --2- 172.21.15.144:0/1223394826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 0x7f82180d10a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82180d1c40 tx=0x7f820802a250 comp rx=0 tx=0).stop 2024-05-30T16:42:00.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7efc3e000640 1 -- 172.21.15.144:0/823537252 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34017070 con 0x7efc480b3f30 2024-05-30T16:42:00.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc48205590 con 0x7efc480b3f30 2024-05-30T16:42:00.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f821ce00640 1 -- 172.21.15.144:0/1223394826 shutdown_connections 2024-05-30T16:42:00.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f821ce00640 1 --2- 172.21.15.144:0/1223394826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 0x7f82180d10a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f821ce00640 1 -- 172.21.15.144:0/1223394826 >> 172.21.15.144:0/1223394826 conn(0x7f8218062390 msgr2=0x7f82180627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7f821ce00640 1 -- 172.21.15.144:0/1223394826 shutdown_connections 2024-05-30T16:42:00.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7f821ce00640 1 -- 172.21.15.144:0/1223394826 wait complete. 2024-05-30T16:42:00.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f49d6400640 1 --2- 172.21.15.144:0/1860307702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d00b23b0 0x7f49d016db30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009dc0 tx=0x7f49c802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edade0e92e5e0449 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f5d09800640 1 -- 172.21.15.144:0/1837465817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 msgr2=0x7f5d04152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f5d09800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 0x7f5d04152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f5d09800640 1 -- 172.21.15.144:0/1837465817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d040ccea0 msgr2=0x7f5d04156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f5d09800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d040ccea0 0x7f5d04156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7f5d09800640 1 -- 172.21.15.144:0/1837465817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d04158470 con 0x7f5d04155a80 2024-05-30T16:42:00.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.338+0000 7fd154e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd148054940 con 0x7fd14804ffd0 2024-05-30T16:42:00.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7fd14f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd148038110 0x7fd1480d58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7fd154e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd1480547c0 con 0x7fd148038110 2024-05-30T16:42:00.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7fd154e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd14804f550 con 0x7fd1480ead00 2024-05-30T16:42:00.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7fd14f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd148038110 0x7fd1480d58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36032/0 (socket says 172.21.15.144:36032) 2024-05-30T16:42:00.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7fd14f400640 1 -- 172.21.15.144:0/322334211 learned_addr learned my addr 172.21.15.144:0/322334211 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:00.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7fd14fe00640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1480ead00 0x7fd148035e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc48205b50 con 0x7efc480b3f30 2024-05-30T16:42:00.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.339+0000 7f5d09800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d04155a80 0x7f5d04157a20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000d7d0 tx=0x7f5cf000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.340+0000 7f49cfe00640 1 -- 172.21.15.144:0/1860307702 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8007740 con 0x7f49d00b23b0 2024-05-30T16:42:00.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.340+0000 7f49cfe00640 1 -- 172.21.15.144:0/1860307702 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c80078e0 con 0x7f49d00b23b0 2024-05-30T16:42:00.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.340+0000 7f49cfe00640 1 -- 172.21.15.144:0/1860307702 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8007cb0 con 0x7f49d00b23b0 2024-05-30T16:42:00.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.341+0000 7fd14f400640 1 -- 172.21.15.144:0/322334211 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1480ead00 msgr2=0x7fd148035e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.341+0000 7fd14f400640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1480ead00 0x7fd148035e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.341+0000 7fd14f400640 1 -- 172.21.15.144:0/322334211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14804ffd0 msgr2=0x7fd1480d5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.341+0000 7fd14f400640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14804ffd0 0x7fd1480d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.341+0000 7fd14f400640 1 -- 172.21.15.144:0/322334211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd148036a90 con 0x7fd148038110 2024-05-30T16:42:00.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.341+0000 7fd14f400640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd148038110 0x7fd1480d58b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd144000c00 tx=0x7fd1440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.341+0000 7f49d6e00640 1 -- 172.21.15.144:0/1860307702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d00b23b0 msgr2=0x7f49d016db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.341+0000 7f49d6e00640 1 --2- 172.21.15.144:0/1860307702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d00b23b0 0x7f49d016db30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009dc0 tx=0x7f49c802a730 comp rx=0 tx=0).stop 2024-05-30T16:42:00.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.342+0000 7f821ce00640 1 Processor -- start 2024-05-30T16:42:00.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.340+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc480b5740 con 0x7efc480b3f30 2024-05-30T16:42:00.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.342+0000 7f821ce00640 1 -- start start 2024-05-30T16:42:00.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.343+0000 7f49d6e00640 1 -- 172.21.15.144:0/1860307702 shutdown_connections 2024-05-30T16:42:00.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.343+0000 7f49d6e00640 1 --2- 172.21.15.144:0/1860307702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d00b23b0 0x7f49d016db30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.343+0000 7f49d6e00640 1 -- 172.21.15.144:0/1860307702 >> 172.21.15.144:0/1860307702 conn(0x7f49d00627b0 msgr2=0x7f49d006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.343+0000 7fd143400640 1 -- 172.21.15.144:0/322334211 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144037040 con 0x7fd148038110 2024-05-30T16:42:00.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.343+0000 7fd143400640 1 -- 172.21.15.144:0/322334211 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd144042070 con 0x7fd148038110 2024-05-30T16:42:00.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.343+0000 7fd143400640 1 -- 172.21.15.144:0/322334211 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144030940 con 0x7fd148038110 2024-05-30T16:42:00.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.343+0000 7f49d6e00640 1 -- 172.21.15.144:0/1860307702 shutdown_connections 2024-05-30T16:42:00.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.343+0000 7f49d6e00640 1 -- 172.21.15.144:0/1860307702 wait complete. 2024-05-30T16:42:00.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.344+0000 7f2968c00640 1 -- 172.21.15.144:0/2609197526 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f295c01a070 con 0x7f296c0ccec0 2024-05-30T16:42:00.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.344+0000 7f821ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82180d15e0 0x7f8218151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.344+0000 7f821ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 0x7f82180b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.344+0000 7f821ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821815fd00 0x7f82180b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.344+0000 7f821ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f82180cf960 con 0x7f821815fd00 2024-05-30T16:42:00.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.344+0000 7f821ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82180cffb0 con 0x7f821815c6e0 2024-05-30T16:42:00.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.344+0000 7f821ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82180cfc40 con 0x7f82180d15e0 2024-05-30T16:42:00.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.345+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd148036d70 con 0x7fd148038110 2024-05-30T16:42:00.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.345+0000 7f2968c00640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f294c06c9c0 0x7f294c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.345+0000 7f2968c00640 1 -- 172.21.15.144:0/2609197526 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f295c08bd80 con 0x7f296c0ccec0 2024-05-30T16:42:00.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.346+0000 7f820d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 0x7f82180b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.345+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1480d6810 con 0x7fd148038110 2024-05-30T16:42:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.346+0000 7f2970a00640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f294c06c9c0 0x7f294c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.346+0000 7f820d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 0x7f82180b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36034/0 (socket says 172.21.15.144:36034) 2024-05-30T16:42:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.346+0000 7f820d400640 1 -- 172.21.15.144:0/295997726 learned_addr learned my addr 172.21.15.144:0/295997726 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.347+0000 7f8216800640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821815fd00 0x7f82180b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.345+0000 7f49d6e00640 1 Processor -- start 2024-05-30T16:42:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.346+0000 7f5d00c00640 1 -- 172.21.15.144:0/1837465817 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000b6c0 con 0x7f5d04155a80 2024-05-30T16:42:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.346+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d04156230 con 0x7f5d04155a80 2024-05-30T16:42:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.347+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0414d920 con 0x7f5d04155a80 2024-05-30T16:42:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.346+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd148005390 con 0x7fd148038110 2024-05-30T16:42:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.348+0000 7f2970a00640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f294c06c9c0 0x7f294c06ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2958009aa0 tx=0x7f2958009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.348+0000 7f8215e00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82180d15e0 0x7f8218151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.348+0000 7f49d6e00640 1 -- start start 2024-05-30T16:42:00.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.348+0000 7f2968c00640 1 -- 172.21.15.144:0/2609197526 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f295c021020 con 0x7f296c0ccec0 2024-05-30T16:42:00.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.348+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d04068b20 con 0x7f5d04155a80 2024-05-30T16:42:00.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f820d400640 1 -- 172.21.15.144:0/295997726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82180d15e0 msgr2=0x7f8218151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f820d400640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82180d15e0 0x7f8218151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f820d400640 1 -- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821815fd00 msgr2=0x7f82180b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f820d400640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821815fd00 0x7f82180b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f820d400640 1 -- 172.21.15.144:0/295997726 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8218151f60 con 0x7f821815c6e0 2024-05-30T16:42:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f49d6e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49d00b23b0 0x7f49d0162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f49d6e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49d00cfe90 0x7f49d0142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f49d6e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d0149070 0x7f49d0147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f49d6e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0166030 con 0x7f49d00cfe90 2024-05-30T16:42:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f49d6e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0165eb0 con 0x7f49d0149070 2024-05-30T16:42:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f49d6e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49d01661b0 con 0x7f49d00b23b0 2024-05-30T16:42:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.346+0000 7efc3e000640 1 -- 172.21.15.144:0/823537252 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3400ce20 con 0x7efc480b3f30 2024-05-30T16:42:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7efc3e000640 1 -- 172.21.15.144:0/823537252 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34021060 con 0x7efc480b3f30 2024-05-30T16:42:00.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.349+0000 7f820d400640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 0x7f82180b4ae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f820000c500 tx=0x7f820000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.350+0000 7fb4df000640 1 Processor -- start 2024-05-30T16:42:00.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.350+0000 7f5d00c00640 1 -- 172.21.15.144:0/1837465817 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0019070 con 0x7f5d04155a80 2024-05-30T16:42:00.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.350+0000 7f49d6400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d0149070 0x7f49d0147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.350+0000 7f49d5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49d00cfe90 0x7f49d0142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.350+0000 7f49d5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49d00cfe90 0x7f49d0142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58982/0 (socket says 172.21.15.144:58982) 2024-05-30T16:42:00.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.350+0000 7f49d5000640 1 -- 172.21.15.144:0/2759078178 learned_addr learned my addr 172.21.15.144:0/2759078178 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:00.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.351+0000 7f5d00c00640 1 -- 172.21.15.144:0/1837465817 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000ba80 con 0x7f5d04155a80 2024-05-30T16:42:00.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.350+0000 7f49d5a00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49d00b23b0 0x7f49d0162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.351+0000 7fd143400640 1 -- 172.21.15.144:0/322334211 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd144030ae0 con 0x7fd148038110 2024-05-30T16:42:00.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.351+0000 7fb4df000640 1 -- start start 2024-05-30T16:42:00.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.352+0000 7efc3e000640 1 -- 172.21.15.144:0/823537252 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc3401a070 con 0x7efc480b3f30 2024-05-30T16:42:00.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.352+0000 7fd143400640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd13006c8f0 0x7fd13006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.352+0000 7fd143400640 1 -- 172.21.15.144:0/322334211 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd1440ac610 con 0x7fd148038110 2024-05-30T16:42:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.352+0000 7f49d6400640 1 -- 172.21.15.144:0/2759078178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49d00b23b0 msgr2=0x7f49d0162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.352+0000 7f49d6400640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49d00b23b0 0x7f49d0162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.352+0000 7f49d6400640 1 -- 172.21.15.144:0/2759078178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49d00cfe90 msgr2=0x7f49d0142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.352+0000 7f49d6400640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49d00cfe90 0x7f49d0142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.352+0000 7f49d6400640 1 -- 172.21.15.144:0/2759078178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d015dde0 con 0x7f49d0149070 2024-05-30T16:42:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.352+0000 7f49d5a00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49d00b23b0 0x7f49d0162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:42:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.353+0000 7fd14ea00640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd13006c8f0 0x7fd13006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.353+0000 7f49d6400640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d0149070 0x7f49d0147900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49c8031000 tx=0x7f49c8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.354+0000 7efc3e000640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc2806caf0 0x7efc2806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.354+0000 7fd14ea00640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd13006c8f0 0x7fd13006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd14804e5f0 tx=0x7fd13c006c40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.354+0000 7fb4df000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb4d80cd700 0x7fb4d81425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.354+0000 7fb4df000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d80ce510 con 0x7fb4d8141f20 2024-05-30T16:42:00.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.354+0000 7fb4df000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d80ce7d0 con 0x7fb4d80b4e90 2024-05-30T16:42:00.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.354+0000 7fb4df000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb4d8142300 con 0x7fb4d80cd700 2024-05-30T16:42:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.354+0000 7efc3e000640 1 -- 172.21.15.144:0/823537252 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efc34005ab0 con 0x7efc480b3f30 2024-05-30T16:42:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.354+0000 7fb4d7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb4d8141f20 0x7fb4d80ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54734/0 (socket says 172.21.15.144:54734) 2024-05-30T16:42:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.354+0000 7fb4d7e00640 1 -- 172.21.15.144:0/3740315884 learned_addr learned my addr 172.21.15.144:0/3740315884 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.355+0000 7fb4d7400640 1 --2- 172.21.15.144:0/3740315884 >> v2:172.21.15.144:3300/0 conn(0x7fb4d80cd700 0x7fb4d81425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.355+0000 7efc45e00640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc2806caf0 0x7efc2806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.356+0000 7efc45e00640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc2806caf0 0x7efc2806efb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc40003f70 tx=0x7efc400098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.356+0000 7fb4d7400640 1 -- 172.21.15.144:0/3740315884 >> v1:172.21.15.149:6789/0 conn(0x7fb4d80b4e90 legacy=0x7fb4d80b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.356+0000 7fb4d7400640 1 -- 172.21.15.144:0/3740315884 >> v1:172.21.15.144:6789/0 conn(0x7fb4d8141f20 legacy=0x7fb4d80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.356+0000 7fb4d7400640 1 -- 172.21.15.144:0/3740315884 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d80ceab0 con 0x7fb4d80cd700 2024-05-30T16:42:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.357+0000 7fb4d7400640 1 --2- 172.21.15.144:0/3740315884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 0x7fb4d81425b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40097a0 tx=0x7fb4c402c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c0ff392465ae67 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.357+0000 7efc3e000640 1 -- 172.21.15.144:0/823537252 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc34058d50 con 0x7efc480b3f30 2024-05-30T16:42:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.359+0000 7f5d00c00640 1 -- 172.21.15.144:0/1837465817 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5cf000bc20 con 0x7f5d04155a80 2024-05-30T16:42:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.360+0000 7f5d00c00640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5ce406c8f0 0x7f5ce406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.361+0000 7f5d00c00640 1 -- 172.21.15.144:0/1837465817 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf008c920 con 0x7f5d04155a80 2024-05-30T16:42:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.362+0000 7f5d08e00640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5ce406c8f0 0x7f5ce406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.363+0000 7f5d00c00640 1 -- 172.21.15.144:0/1837465817 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5cf005a6e0 con 0x7f5d04155a80 2024-05-30T16:42:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.362+0000 7fb4d6a00640 1 -- 172.21.15.144:0/3740315884 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4039070 con 0x7fb4d80cd700 2024-05-30T16:42:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.362+0000 7fb4d6a00640 1 -- 172.21.15.144:0/3740315884 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c4034640 con 0x7fb4d80cd700 2024-05-30T16:42:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.362+0000 7fb4d6a00640 1 -- 172.21.15.144:0/3740315884 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4034a10 con 0x7fb4d80cd700 2024-05-30T16:42:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.363+0000 7fb4df000640 1 -- 172.21.15.144:0/3740315884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 msgr2=0x7fb4d81425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.363+0000 7fb4df000640 1 --2- 172.21.15.144:0/3740315884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 0x7fb4d81425b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40097a0 tx=0x7fb4c402c3b0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.363+0000 7fb4df000640 1 -- 172.21.15.144:0/3740315884 shutdown_connections 2024-05-30T16:42:00.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.363+0000 7fb4df000640 1 --2- 172.21.15.144:0/3740315884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 0x7fb4d81425b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.363+0000 7fb4df000640 1 -- 172.21.15.144:0/3740315884 >> 172.21.15.144:0/3740315884 conn(0x7fb4d80629c0 msgr2=0x7fb4d806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.363+0000 7f5d08e00640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5ce406c8f0 0x7f5ce406edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5cf403b000 tx=0x7f5cf4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.364+0000 7fb4df000640 1 -- 172.21.15.144:0/3740315884 shutdown_connections 2024-05-30T16:42:00.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.364+0000 7fb4df000640 1 -- 172.21.15.144:0/3740315884 wait complete. 2024-05-30T16:42:00.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.365+0000 7f820ea00640 1 -- 172.21.15.144:0/295997726 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200017070 con 0x7f821815c6e0 2024-05-30T16:42:00.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.365+0000 7f820ea00640 1 -- 172.21.15.144:0/295997726 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8200005ce0 con 0x7f821815c6e0 2024-05-30T16:42:00.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.365+0000 7f820ea00640 1 -- 172.21.15.144:0/295997726 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200007330 con 0x7f821815c6e0 2024-05-30T16:42:00.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.365+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82180b3a40 con 0x7f821815c6e0 2024-05-30T16:42:00.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.366+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82180b4000 con 0x7f821815c6e0 2024-05-30T16:42:00.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.366+0000 7fb4df000640 1 Processor -- start 2024-05-30T16:42:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.366+0000 7fd143400640 1 -- 172.21.15.144:0/322334211 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd14407ab40 con 0x7fd148038110 2024-05-30T16:42:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.366+0000 7f49cd600640 1 -- 172.21.15.144:0/2759078178 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8040070 con 0x7f49d0149070 2024-05-30T16:42:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.366+0000 7fb4df000640 1 -- start start 2024-05-30T16:42:00.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.366+0000 7f49cd600640 1 -- 172.21.15.144:0/2759078178 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c8031c60 con 0x7f49d0149070 2024-05-30T16:42:00.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.366+0000 7f49cd600640 1 -- 172.21.15.144:0/2759078178 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c80456a0 con 0x7f49d0149070 2024-05-30T16:42:00.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.367+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d015e0c0 con 0x7f49d0149070 2024-05-30T16:42:00.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.367+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d015e680 con 0x7f49d0149070 2024-05-30T16:42:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.368+0000 7fb4df000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d80b4e90 0x7fb4d815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.368+0000 7fb4df000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 0x7fb4d815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.369+0000 7fb4df000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d8141f20 0x7fb4d815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.369+0000 7fb4df000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d80cf590 con 0x7fb4d80cd700 2024-05-30T16:42:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.370+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d80b4e90 0x7fb4d815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.370+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d80b4e90 0x7fb4d815adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35046/0 (socket says 172.21.15.144:35046) 2024-05-30T16:42:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.370+0000 7fb4d7e00640 1 -- 172.21.15.144:0/1328431748 learned_addr learned my addr 172.21.15.144:0/1328431748 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.370+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d80cf100 con 0x7fb4d8141f20 2024-05-30T16:42:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.370+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d80cf710 con 0x7fb4d80b4e90 2024-05-30T16:42:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.370+0000 7fb4dd000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d8141f20 0x7fb4d815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.369+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82180d5410 con 0x7f821815c6e0 2024-05-30T16:42:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.371+0000 7f820ea00640 1 -- 172.21.15.144:0/295997726 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f820001a070 con 0x7f821815c6e0 2024-05-30T16:42:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.371+0000 7fb4d7400640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 0x7fb4d815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.370+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d015eb70 con 0x7f49d0149070 2024-05-30T16:42:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.372+0000 7fb4dd000640 1 -- 172.21.15.144:0/1328431748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d80b4e90 msgr2=0x7fb4d815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.372+0000 7fb4dd000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d80b4e90 0x7fb4d815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.372+0000 7fb4dd000640 1 -- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 msgr2=0x7fb4d815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.372+0000 7f820ea00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f81f406c9c0 0x7f81f406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.372+0000 7fb4dd000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 0x7fb4d815bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.372+0000 7fb4dd000640 1 -- 172.21.15.144:0/1328431748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d815c9c0 con 0x7fb4d8141f20 2024-05-30T16:42:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.373+0000 7f820ea00640 1 -- 172.21.15.144:0/295997726 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f820008b010 con 0x7f821815c6e0 2024-05-30T16:42:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.372+0000 7fb4d7400640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 0x7fb4d815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:42:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.373+0000 7f8215e00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f81f406c9c0 0x7f81f406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.373+0000 7fb4dd000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d8141f20 0x7fb4d815c2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c730 tx=0x7fb4d000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.372+0000 7f49cd600640 1 -- 172.21.15.144:0/2759078178 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49c8039040 con 0x7f49d0149070 2024-05-30T16:42:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.373+0000 7f49cd600640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49b006c9c0 0x7f49b006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.374+0000 7f49cd600640 1 -- 172.21.15.144:0/2759078178 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f49c80ad4e0 con 0x7f49d0149070 2024-05-30T16:42:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.374+0000 7f49d5a00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49b006c9c0 0x7f49b006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.376+0000 7f49d5a00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49b006c9c0 0x7f49b006ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49bc007fd0 tx=0x7f49bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.376+0000 7f8215e00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f81f406c9c0 0x7f81f406ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8208034000 tx=0x7f820802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.386+0000 7f820ea00640 1 -- 172.21.15.144:0/295997726 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8218151f60 con 0x7f821815c6e0 2024-05-30T16:42:00.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.399+0000 7f49cd600640 1 -- 172.21.15.144:0/2759078178 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49c807b8f0 con 0x7f49d0149070 2024-05-30T16:42:00.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.405+0000 7fb4cfe00640 1 -- 172.21.15.144:0/1328431748 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0016020 con 0x7fb4d8141f20 2024-05-30T16:42:00.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.405+0000 7fb4cfe00640 1 -- 172.21.15.144:0/1328431748 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d0006d50 con 0x7fb4d8141f20 2024-05-30T16:42:00.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.405+0000 7fb4cfe00640 1 -- 172.21.15.144:0/1328431748 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0003bb0 con 0x7fb4d8141f20 2024-05-30T16:42:00.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.405+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d815cca0 con 0x7fb4d8141f20 2024-05-30T16:42:00.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.405+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d815d260 con 0x7fb4d8141f20 2024-05-30T16:42:00.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.408+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d8068b20 con 0x7fb4d8141f20 2024-05-30T16:42:00.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.411+0000 7fb4cfe00640 1 -- 172.21.15.144:0/1328431748 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4d00050d0 con 0x7fb4d8141f20 2024-05-30T16:42:00.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.412+0000 7fb4cfe00640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4b806c940 0x7fb4b806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:00.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.413+0000 7fb4d7e00640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4b806c940 0x7fb4b806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:00.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.414+0000 7fb4cfe00640 1 -- 172.21.15.144:0/1328431748 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb4d0090060 con 0x7fb4d8141f20 2024-05-30T16:42:00.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.414+0000 7fb4d7e00640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4b806c940 0x7fb4b806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8143580 tx=0x7fb4c8007f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:00.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.426+0000 7fb4cfe00640 1 -- 172.21.15.144:0/1328431748 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4d0058d60 con 0x7fb4d8141f20 2024-05-30T16:42:00.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.670+0000 7fc0eaa00640 1 -- 172.21.15.144:0/932936728 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc0d4005850 con 0x7fc0f00e32d0 2024-05-30T16:42:00.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.671+0000 7fc0f5600640 1 -- 172.21.15.144:0/932936728 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0f80f9b20 con 0x7fc0f00e32d0 2024-05-30T16:42:00.673 INFO:teuthology.orchestra.run.smithi144.stdout:55834574854 2024-05-30T16:42:00.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.675+0000 7fc0eaa00640 1 -- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0d806c8f0 msgr2=0x7fc0d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.675+0000 7fc0eaa00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0d806c8f0 0x7fc0d806edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009b40 tx=0x7fc0e4009190 comp rx=0 tx=0).stop 2024-05-30T16:42:00.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.676+0000 7fc0eaa00640 1 -- 172.21.15.144:0/932936728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f00e32d0 msgr2=0x7fc0f01853e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.676+0000 7fc0eaa00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f00e32d0 0x7fc0f01853e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8051690 tx=0x7fc0f8069790 comp rx=0 tx=0).stop 2024-05-30T16:42:00.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.676+0000 7fc0eaa00640 1 -- 172.21.15.144:0/932936728 shutdown_connections 2024-05-30T16:42:00.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.677+0000 7fc0eaa00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0d806c8f0 0x7fc0d806edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.677+0000 7fc0eaa00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0f00e32d0 0x7fc0f01853e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.677+0000 7fc0eaa00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0f0053190 0x7fc0f004c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.677+0000 7fc0eaa00640 1 --2- 172.21.15.144:0/932936728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0f004ff80 0x7fc0f004d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.677+0000 7fc0eaa00640 1 -- 172.21.15.144:0/932936728 >> 172.21.15.144:0/932936728 conn(0x7fc0f0009fb0 msgr2=0x7fc0f004f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.678+0000 7fc0eaa00640 1 -- 172.21.15.144:0/932936728 shutdown_connections 2024-05-30T16:42:00.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.678+0000 7fc0eaa00640 1 -- 172.21.15.144:0/932936728 wait complete. 2024-05-30T16:42:00.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-05-30T16:42:00.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.743+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efc480ce400 con 0x7efc480b3f30 2024-05-30T16:42:00.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.744+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5d0406ea60 con 0x7f5d04155a80 2024-05-30T16:42:00.745 INFO:teuthology.orchestra.run.smithi144.stdout:55834574852 2024-05-30T16:42:00.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.744+0000 7efc3e000640 1 -- 172.21.15.144:0/823537252 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc3405d050 con 0x7efc480b3f30 2024-05-30T16:42:00.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.745+0000 7f5d00c00640 1 -- 172.21.15.144:0/1837465817 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d0406ea60 con 0x7f5d04155a80 2024-05-30T16:42:00.748 INFO:teuthology.orchestra.run.smithi144.stdout:55834574852 2024-05-30T16:42:00.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.747+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc2806caf0 msgr2=0x7efc2806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.747+0000 7efc47200640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc2806caf0 0x7efc2806efb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc40003f70 tx=0x7efc400098d0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.747+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc480b3f30 msgr2=0x7efc481689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.747+0000 7efc47200640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc480b3f30 0x7efc481689b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c830 tx=0x7efc3400ccf0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5ce406c8f0 msgr2=0x7f5ce406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5ce406c8f0 0x7f5ce406edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5cf403b000 tx=0x7f5cf4008030 comp rx=0 tx=0).stop 2024-05-30T16:42:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d04155a80 msgr2=0x7f5d04157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d04155a80 0x7f5d04157a20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000d7d0 tx=0x7f5cf000dc90 comp rx=0 tx=0).stop 2024-05-30T16:42:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 shutdown_connections 2024-05-30T16:42:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5ce406c8f0 0x7f5ce406edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d04155a80 0x7f5d04157a20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d040ccea0 0x7f5d04156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 --2- 172.21.15.144:0/1837465817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d04072600 0x7f5d04152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.748+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 >> 172.21.15.144:0/1837465817 conn(0x7f5d04062570 msgr2=0x7f5d0415f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 shutdown_connections 2024-05-30T16:42:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 shutdown_connections 2024-05-30T16:42:00.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7efc47200640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc2806caf0 0x7efc2806efb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7efc47200640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc4816ef00 0x7efc4816afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7efc47200640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc480b3f30 0x7efc481689b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7efc47200640 1 --2- 172.21.15.144:0/823537252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc4808b0b0 0x7efc481f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7f5d0b800640 1 -- 172.21.15.144:0/1837465817 wait complete. 2024-05-30T16:42:00.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 >> 172.21.15.144:0/823537252 conn(0x7efc4806dea0 msgr2=0x7efc480cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 shutdown_connections 2024-05-30T16:42:00.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.749+0000 7efc47200640 1 -- 172.21.15.144:0/823537252 wait complete. 2024-05-30T16:42:00.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-05-30T16:42:00.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-05-30T16:42:00.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.781+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f296c0d0110 con 0x7f296c0ccec0 2024-05-30T16:42:00.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.782+0000 7f2968c00640 1 -- 172.21.15.144:0/2609197526 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f295c059b40 con 0x7f296c0ccec0 2024-05-30T16:42:00.783 INFO:teuthology.orchestra.run.smithi144.stdout:55834574852 2024-05-30T16:42:00.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f294c06c9c0 msgr2=0x7f294c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f294c06c9c0 0x7f294c06ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2958009aa0 tx=0x7f2958009190 comp rx=0 tx=0).stop 2024-05-30T16:42:00.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296c0ccec0 msgr2=0x7f296c20e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296c0ccec0 0x7f296c20e020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f295c00cb10 tx=0x7f295c00a060 comp rx=0 tx=0).stop 2024-05-30T16:42:00.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 shutdown_connections 2024-05-30T16:42:00.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f294c06c9c0 0x7f294c06ee80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f296c0ceda0 0x7f296c20e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296c0ccec0 0x7f296c20e020 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 --2- 172.21.15.144:0/2609197526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f296c06fa80 0x7f296c15d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 >> 172.21.15.144:0/2609197526 conn(0x7f296c062570 msgr2=0x7f296c16d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 shutdown_connections 2024-05-30T16:42:00.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.785+0000 7f2973400640 1 -- 172.21.15.144:0/2609197526 wait complete. 2024-05-30T16:42:00.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.796+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd148009000 con 0x7fd148038110 2024-05-30T16:42:00.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.797+0000 7fd143400640 1 -- 172.21.15.144:0/322334211 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd14407a440 con 0x7fd148038110 2024-05-30T16:42:00.798 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:42:00.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd13006c8f0 msgr2=0x7fd13006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd13006c8f0 0x7fd13006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd14804e5f0 tx=0x7fd13c006c40 comp rx=0 tx=0).stop 2024-05-30T16:42:00.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd148038110 msgr2=0x7fd1480d58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd148038110 0x7fd1480d58b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd144000c00 tx=0x7fd1440046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 shutdown_connections 2024-05-30T16:42:00.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd13006c8f0 0x7fd13006edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1480ead00 0x7fd148035e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14804ffd0 0x7fd1480d5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 --2- 172.21.15.144:0/322334211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd148038110 0x7fd1480d58b0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd144000c00 tx=0x7fd1440046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 >> 172.21.15.144:0/322334211 conn(0x7fd148009fb0 msgr2=0x7fd148039430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 shutdown_connections 2024-05-30T16:42:00.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.800+0000 7fd154e00640 1 -- 172.21.15.144:0/322334211 wait complete. 2024-05-30T16:42:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.810+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb4d80b16c0 con 0x7fb4d8141f20 2024-05-30T16:42:00.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-05-30T16:42:00.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.810+0000 7fb4cfe00640 1 -- 172.21.15.144:0/1328431748 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4d005d060 con 0x7fb4d8141f20 2024-05-30T16:42:00.812 INFO:teuthology.orchestra.run.smithi144.stdout:55834574852 2024-05-30T16:42:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4b806c940 msgr2=0x7fb4b806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4b806c940 0x7fb4b806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8143580 tx=0x7fb4c8007f10 comp rx=0 tx=0).stop 2024-05-30T16:42:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d8141f20 msgr2=0x7fb4d815c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d8141f20 0x7fb4d815c2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c730 tx=0x7fb4d000cbf0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 shutdown_connections 2024-05-30T16:42:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4b806c940 0x7fb4b806ee00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d8141f20 0x7fb4d815c2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4d80cd700 0x7fb4d815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 --2- 172.21.15.144:0/1328431748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d80b4e90 0x7fb4d815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 >> 172.21.15.144:0/1328431748 conn(0x7fb4d80629c0 msgr2=0x7fb4d80b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 shutdown_connections 2024-05-30T16:42:00.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.813+0000 7fb4df000640 1 -- 172.21.15.144:0/1328431748 wait complete. 2024-05-30T16:42:00.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.818+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f49d0075570 con 0x7f49d0149070 2024-05-30T16:42:00.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.819+0000 7f49cd600640 1 -- 172.21.15.144:0/2759078178 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f49c807b1f0 con 0x7f49d0149070 2024-05-30T16:42:00.820 INFO:teuthology.orchestra.run.smithi144.stdout:55834574854 2024-05-30T16:42:00.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49b006c9c0 msgr2=0x7f49b006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49b006c9c0 0x7f49b006ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49bc007fd0 tx=0x7f49bc009040 comp rx=0 tx=0).stop 2024-05-30T16:42:00.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d0149070 msgr2=0x7f49d0147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d0149070 0x7f49d0147900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49c8031000 tx=0x7f49c8004a40 comp rx=0 tx=0).stop 2024-05-30T16:42:00.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 shutdown_connections 2024-05-30T16:42:00.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.822+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f82181616a0 con 0x7f821815c6e0 2024-05-30T16:42:00.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49b006c9c0 0x7f49b006ee80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49d0149070 0x7f49d0147900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49d00cfe90 0x7f49d0142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 --2- 172.21.15.144:0/2759078178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49d00b23b0 0x7f49d0162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.821+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 >> 172.21.15.144:0/2759078178 conn(0x7f49d00627b0 msgr2=0x7f49d006de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.822+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 shutdown_connections 2024-05-30T16:42:00.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.822+0000 7f49d6e00640 1 -- 172.21.15.144:0/2759078178 wait complete. 2024-05-30T16:42:00.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.822+0000 7f820ea00640 1 -- 172.21.15.144:0/295997726 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8200059570 con 0x7f821815c6e0 2024-05-30T16:42:00.824 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:42:00.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f81f406c9c0 msgr2=0x7f81f406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f81f406c9c0 0x7f81f406ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8208034000 tx=0x7f820802e000 comp rx=0 tx=0).stop 2024-05-30T16:42:00.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 msgr2=0x7f82180b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:00.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 0x7f82180b4ae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f820000c500 tx=0x7f820000c9c0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 shutdown_connections 2024-05-30T16:42:00.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f81f406c9c0 0x7f81f406ee80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821815fd00 0x7f82180b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821815c6e0 0x7f82180b4ae0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 --2- 172.21.15.144:0/295997726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82180d15e0 0x7f8218151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 >> 172.21.15.144:0/295997726 conn(0x7f8218062390 msgr2=0x7f82180d3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 shutdown_connections 2024-05-30T16:42:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:00.825+0000 7f821ce00640 1 -- 172.21.15.144:0/295997726 wait complete. 2024-05-30T16:42:00.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-05-30T16:42:00.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-05-30T16:42:00.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-05-30T16:42:00.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-05-30T16:42:01.706 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-30T16:42:01.768 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-30T16:42:01.775 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-30T16:42:01.813 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-30T16:42:01.828 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-30T16:42:01.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-30T16:42:01.842 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-30T16:42:01.842 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-30T16:42:01.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.934+0000 7f665d600640 1 Processor -- start 2024-05-30T16:42:01.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.934+0000 7f665d600640 1 -- start start 2024-05-30T16:42:01.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.936+0000 7f665d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580d17b0 0x7f665815f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:01.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.937+0000 7f6656000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580d17b0 0x7f665815f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:01.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.937+0000 7f6656000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580d17b0 0x7f665815f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35054/0 (socket says 172.21.15.144:35054) 2024-05-30T16:42:01.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.937+0000 7f6656a00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f665815c6e0 0x7f66580d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:37170/0 (socket says 172.21.15.144:37170) 2024-05-30T16:42:01.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.937+0000 7f6657400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f665815fb30 0x7f66580d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54742/0 (socket says 172.21.15.144:54742) 2024-05-30T16:42:01.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.937+0000 7f6656000640 1 -- 172.21.15.144:0/2088051437 learned_addr learned my addr 172.21.15.144:0/2088051437 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:01.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.938+0000 7f665d600640 1 -- 172.21.15.144:0/2088051437 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66580cf3e0 con 0x7f665815fb30 2024-05-30T16:42:01.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.938+0000 7f665d600640 1 -- 172.21.15.144:0/2088051437 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66580cf680 con 0x7f665815c6e0 2024-05-30T16:42:01.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.938+0000 7f6655600640 1 -- 172.21.15.144:0/2088051437 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076425761 0 0) 0x7f66580cf3e0 con 0x7f665815fb30 2024-05-30T16:42:01.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.938+0000 7f665d600640 1 -- 172.21.15.144:0/2088051437 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f66580d0440 con 0x7f66580d17b0 2024-05-30T16:42:01.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.938+0000 7f6655600640 1 -- 172.21.15.144:0/2088051437 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f663c003520 con 0x7f665815fb30 2024-05-30T16:42:01.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.939+0000 7f6655600640 1 -- 172.21.15.144:0/2088051437 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210256134 0 0) 0x7f66580cf680 con 0x7f665815c6e0 2024-05-30T16:42:01.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.939+0000 7f6655600640 1 -- 172.21.15.144:0/2088051437 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66580cf3e0 con 0x7f665815c6e0 2024-05-30T16:42:01.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.939+0000 7f6656000640 1 -- 172.21.15.144:0/2088051437 >> v1:172.21.15.149:6789/0 conn(0x7f665815c6e0 legacy=0x7f66580d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:01.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.940+0000 7f6655600640 1 -- 172.21.15.144:0/2088051437 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3458652201 0 0) 0x7f663c003520 con 0x7f665815fb30 2024-05-30T16:42:01.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.940+0000 7f6656000640 1 -- 172.21.15.144:0/2088051437 >> v1:172.21.15.144:6789/0 conn(0x7f665815fb30 legacy=0x7f66580d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:01.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.940+0000 7f6656000640 1 -- 172.21.15.144:0/2088051437 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66580cf960 con 0x7f66580d17b0 2024-05-30T16:42:01.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.942+0000 7f6656000640 1 --2- 172.21.15.144:0/2088051437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580d17b0 0x7f665815f5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f66480098a0 tx=0x7f664802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f984a9ef83527fcf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:01.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.943+0000 7f6655600640 1 -- 172.21.15.144:0/2088051437 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648037070 con 0x7f66580d17b0 2024-05-30T16:42:01.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.943+0000 7f6655600640 1 -- 172.21.15.144:0/2088051437 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664802ad00 con 0x7f66580d17b0 2024-05-30T16:42:01.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.943+0000 7f6655600640 1 -- 172.21.15.144:0/2088051437 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648037070 con 0x7f66580d17b0 2024-05-30T16:42:01.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.945+0000 7f665d600640 1 -- 172.21.15.144:0/2088051437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580d17b0 msgr2=0x7f665815f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:01.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.945+0000 7f665d600640 1 --2- 172.21.15.144:0/2088051437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580d17b0 0x7f665815f5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f66480098a0 tx=0x7f664802a270 comp rx=0 tx=0).stop 2024-05-30T16:42:01.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.945+0000 7f665d600640 1 -- 172.21.15.144:0/2088051437 shutdown_connections 2024-05-30T16:42:01.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.945+0000 7f665d600640 1 --2- 172.21.15.144:0/2088051437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580d17b0 0x7f665815f5f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:01.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.945+0000 7f665d600640 1 -- 172.21.15.144:0/2088051437 >> 172.21.15.144:0/2088051437 conn(0x7f6658062390 msgr2=0x7f66580627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:01.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.946+0000 7f665d600640 1 -- 172.21.15.144:0/2088051437 shutdown_connections 2024-05-30T16:42:01.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.946+0000 7f665d600640 1 -- 172.21.15.144:0/2088051437 wait complete. 2024-05-30T16:42:01.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.950+0000 7f665d600640 1 Processor -- start 2024-05-30T16:42:01.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.951+0000 7f665d600640 1 -- start start 2024-05-30T16:42:01.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.952+0000 7f665d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66580d17b0 0x7f66580b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:01.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.952+0000 7f665d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f665815c6e0 0x7f665814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:01.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.952+0000 7f665d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f665815fb30 0x7f6658150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:01.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.952+0000 7f665d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f665815ffa0 con 0x7f665815c6e0 2024-05-30T16:42:01.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.952+0000 7f665d600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f66580cffb0 con 0x7f66580d17b0 2024-05-30T16:42:01.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.952+0000 7f665d600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6658160120 con 0x7f665815fb30 2024-05-30T16:42:01.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.953+0000 7f6656a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66580d17b0 0x7f66580b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:01.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.953+0000 7f6656a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66580d17b0 0x7f66580b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36072/0 (socket says 172.21.15.144:36072) 2024-05-30T16:42:01.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.953+0000 7f6656a00640 1 -- 172.21.15.144:0/3226655567 learned_addr learned my addr 172.21.15.144:0/3226655567 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:01.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.953+0000 7f6657400640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f665815fb30 0x7f6658150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:01.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.954+0000 7f6656000640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f665815c6e0 0x7f665814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:01.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.955+0000 7f6657400640 1 -- 172.21.15.144:0/3226655567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66580d17b0 msgr2=0x7f66580b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:01.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.955+0000 7f6657400640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66580d17b0 0x7f66580b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:01.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.955+0000 7f6657400640 1 -- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f665815c6e0 msgr2=0x7f665814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:01.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.955+0000 7f6657400640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f665815c6e0 0x7f665814edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:01.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.955+0000 7f6657400640 1 -- 172.21.15.144:0/3226655567 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66580b44e0 con 0x7f665815fb30 2024-05-30T16:42:01.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.956+0000 7f6657400640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f665815fb30 0x7f6658150840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f665000cac0 tx=0x7f665000cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:01.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.957+0000 7f664ea00640 1 -- 172.21.15.144:0/3226655567 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650018070 con 0x7f665815fb30 2024-05-30T16:42:01.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.957+0000 7f664ea00640 1 -- 172.21.15.144:0/3226655567 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665000a930 con 0x7f665815fb30 2024-05-30T16:42:01.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.957+0000 7f664ea00640 1 -- 172.21.15.144:0/3226655567 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650018070 con 0x7f665815fb30 2024-05-30T16:42:01.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.957+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66580b6ac0 con 0x7f665815fb30 2024-05-30T16:42:01.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.958+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6658151cf0 con 0x7f665815fb30 2024-05-30T16:42:01.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.961+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6658068b20 con 0x7f665815fb30 2024-05-30T16:42:01.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.963+0000 7f664ea00640 1 -- 172.21.15.144:0/3226655567 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f665000aae0 con 0x7f665815fb30 2024-05-30T16:42:01.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.965+0000 7f664ea00640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f663406caf0 0x7f663406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.966+0000 7f664ea00640 1 -- 172.21.15.144:0/3226655567 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f665008af60 con 0x7f665815fb30 2024-05-30T16:42:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.966+0000 7f6656a00640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f663406caf0 0x7f663406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.968+0000 7f6656a00640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f663406caf0 0x7f663406efb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6640000f60 tx=0x7f6640007e60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.978+0000 7f664ea00640 1 -- 172.21.15.144:0/3226655567 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6650058ca0 con 0x7f665815fb30 2024-05-30T16:42:01.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.994+0000 7f94e0c00640 1 Processor -- start 2024-05-30T16:42:01.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.994+0000 7f94e0c00640 1 -- start start 2024-05-30T16:42:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.996+0000 7f94e0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc0b6470 0x7f94dc0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:01.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.997+0000 7f94da800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f94dc15ed10 0x7f94dc0d1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54748/0 (socket says 172.21.15.144:54748) 2024-05-30T16:42:01.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.997+0000 7f94d9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc0b6470 0x7f94dc0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.997+0000 7f94da800640 1 -- 172.21.15.144:0/1497534120 learned_addr learned my addr 172.21.15.144:0/1497534120 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.998+0000 7f94e0c00640 1 -- 172.21.15.144:0/1497534120 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94dc162d60 con 0x7f94dc15ed10 2024-05-30T16:42:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.998+0000 7f94e0c00640 1 -- 172.21.15.144:0/1497534120 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94dc163030 con 0x7f94dc15e930 2024-05-30T16:42:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.998+0000 7f94e0c00640 1 -- 172.21.15.144:0/1497534120 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94dc0b80a0 con 0x7f94dc0b6470 2024-05-30T16:42:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.998+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2284064121 0 0) 0x7f94dc162d60 con 0x7f94dc15ed10 2024-05-30T16:42:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.998+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94c0003520 con 0x7f94dc15ed10 2024-05-30T16:42:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2227734568 0 0) 0x7f94c0003520 con 0x7f94dc15ed10 2024-05-30T16:42:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc0b6470 msgr2=0x7f94dc0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc0b6470 0x7f94dc0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 >> v1:172.21.15.149:6789/0 conn(0x7f94dc15e930 legacy=0x7f94dc162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc163310 con 0x7f94dc15ed10 2024-05-30T16:42:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f94d40019f0 con 0x7f94dc15ed10 2024-05-30T16:42:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 >> v1:172.21.15.144:6789/0 conn(0x7f94dc15ed10 legacy=0x7f94dc0d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94c00039e0 0x7f94c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94c0004800 0x7f94c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94c0005230 0x7f94c00141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc0b80a0 con 0x7f94c00039e0 2024-05-30T16:42:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94c0014950 con 0x7f94c0005230 2024-05-30T16:42:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94c0014b50 con 0x7f94c0004800 2024-05-30T16:42:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:01.999+0000 7f94d9400640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc0b6470 0x7f94dc0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.000+0000 7f94d9400640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94c0004800 0x7f94c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.001+0000 7f94d9400640 1 -- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94c0005230 msgr2=0x7f94c00141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.001+0000 7f94d9400640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94c0005230 0x7f94c00141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.001+0000 7f94d9400640 1 -- 172.21.15.144:0/1497534120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94c00039e0 msgr2=0x7f94c0003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:42:02.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.001+0000 7f94d9e00640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94c00039e0 0x7f94c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.002+0000 7f94d9400640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94c00039e0 0x7f94c0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.002+0000 7f94d9400640 1 -- 172.21.15.144:0/1497534120 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc163310 con 0x7f94c0004800 2024-05-30T16:42:02.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.003+0000 7f94d9e00640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94c00039e0 0x7f94c0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:02.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.004+0000 7f94d9400640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94c0004800 0x7f94c0004c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f94dc073e10 tx=0x7f94c0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1110524848d6ccc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.005+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc037070 con 0x7f94c0004800 2024-05-30T16:42:02.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.005+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94cc02aa50 con 0x7f94c0004800 2024-05-30T16:42:02.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.005+0000 7f94d8a00640 1 -- 172.21.15.144:0/1497534120 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00a4d0 con 0x7f94c0004800 2024-05-30T16:42:02.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.006+0000 7f94e0c00640 1 -- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94c0004800 msgr2=0x7f94c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.006+0000 7f94e0c00640 1 --2- 172.21.15.144:0/1497534120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94c0004800 0x7f94c0004c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f94dc073e10 tx=0x7f94c0005830 comp rx=0 tx=0).stop 2024-05-30T16:42:02.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.006+0000 7f94da800640 1 -- 172.21.15.144:0/1497534120 reap_dead start 2024-05-30T16:42:02.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.007+0000 7f94e0c00640 1 -- 172.21.15.144:0/1497534120 shutdown_connections 2024-05-30T16:42:02.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.007+0000 7f94e0c00640 1 -- 172.21.15.144:0/1497534120 >> 172.21.15.144:0/1497534120 conn(0x7f94dc062390 msgr2=0x7f94dc0627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.007+0000 7f94e0c00640 1 -- 172.21.15.144:0/1497534120 shutdown_connections 2024-05-30T16:42:02.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.007+0000 7f94e0c00640 1 -- 172.21.15.144:0/1497534120 wait complete. 2024-05-30T16:42:02.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.011+0000 7f94e0c00640 1 Processor -- start 2024-05-30T16:42:02.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.011+0000 7f94e0c00640 1 -- start start 2024-05-30T16:42:02.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.013+0000 7f94e0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94dc14ac80 0x7f94dc074ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.014+0000 7f94d9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94dc14ac80 0x7f94dc074ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.015+0000 7f94d9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94dc14ac80 0x7f94dc074ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59010/0 (socket says 172.21.15.144:59010) 2024-05-30T16:42:02.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.015+0000 7f94d9e00640 1 -- 172.21.15.144:0/4094340186 learned_addr learned my addr 172.21.15.144:0/4094340186 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.015+0000 7f94e0c00640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc070c60 0x7f94dc075220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.015+0000 7f94e0c00640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc06ec00 0x7f94dc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.016+0000 7f94e0c00640 1 -- 172.21.15.144:0/4094340186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc0d1a10 con 0x7f94dc14ac80 2024-05-30T16:42:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.016+0000 7f94e0c00640 1 -- 172.21.15.144:0/4094340186 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc0d3000 con 0x7f94dc06ec00 2024-05-30T16:42:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.016+0000 7f94e0c00640 1 -- 172.21.15.144:0/4094340186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94dc0d1b90 con 0x7f94dc070c60 2024-05-30T16:42:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.016+0000 7f94d9400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc070c60 0x7f94dc075220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.016+0000 7f94da800640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc06ec00 0x7f94dc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.017+0000 7f94d9400640 1 -- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc06ec00 msgr2=0x7f94dc06f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.017+0000 7f94d9400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc06ec00 0x7f94dc06f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.017+0000 7f94d9400640 1 -- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94dc14ac80 msgr2=0x7f94dc074ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.017+0000 7f94d9400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94dc14ac80 0x7f94dc074ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.017+0000 7f94d9400640 1 -- 172.21.15.144:0/4094340186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc06fac0 con 0x7f94dc070c60 2024-05-30T16:42:02.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.017+0000 7f94d9e00640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94dc14ac80 0x7f94dc074ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:42:02.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.017+0000 7f94d9400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc070c60 0x7f94dc075220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f94cc006fd0 tx=0x7f94cc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.018+0000 7f94d2000640 1 -- 172.21.15.144:0/4094340186 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc037040 con 0x7f94dc070c60 2024-05-30T16:42:02.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.018+0000 7f94d2000640 1 -- 172.21.15.144:0/4094340186 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94cc006db0 con 0x7f94dc070c60 2024-05-30T16:42:02.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.018+0000 7f94d2000640 1 -- 172.21.15.144:0/4094340186 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc03d660 con 0x7f94dc070c60 2024-05-30T16:42:02.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.018+0000 7f94e0c00640 1 -- 172.21.15.144:0/4094340186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94dc15c030 con 0x7f94dc070c60 2024-05-30T16:42:02.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.018+0000 7f94e0c00640 1 -- 172.21.15.144:0/4094340186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94dc06f7e0 con 0x7f94dc070c60 2024-05-30T16:42:02.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.020+0000 7f94c7400640 1 -- 172.21.15.144:0/4094340186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94dc068b20 con 0x7f94dc070c60 2024-05-30T16:42:02.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.024+0000 7f94d2000640 1 -- 172.21.15.144:0/4094340186 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94cc03d800 con 0x7f94dc070c60 2024-05-30T16:42:02.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.026+0000 7f94d2000640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94bc06c920 0x7f94bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.026+0000 7f94d2000640 1 -- 172.21.15.144:0/4094340186 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f94cc0ac9e0 con 0x7f94dc070c60 2024-05-30T16:42:02.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.027+0000 7f94d9e00640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94bc06c920 0x7f94bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.028+0000 7f94d9e00640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94bc06c920 0x7f94bc06ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0d40f0 tx=0x7f94c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.036+0000 7f94d2000640 1 -- 172.21.15.144:0/4094340186 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94cc07afa0 con 0x7f94dc070c60 2024-05-30T16:42:02.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.065+0000 7f2d8e600640 1 Processor -- start 2024-05-30T16:42:02.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.065+0000 7f2d8e600640 1 -- start start 2024-05-30T16:42:02.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.066+0000 7ff855c00640 1 Processor -- start 2024-05-30T16:42:02.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.066+0000 7ff855c00640 1 -- start start 2024-05-30T16:42:02.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.067+0000 7f2d8e600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d800e3160 0x7f2d800e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.067+0000 7f2d8e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d8003c0a0 0x7f2d80058050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.067+0000 7f2d8e600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d80058590 con 0x7f2d80053cb0 2024-05-30T16:42:02.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.067+0000 7f2d8e600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2d80007b70 con 0x7f2d800e3160 2024-05-30T16:42:02.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.067+0000 7f2d8e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2d80058810 con 0x7f2d8003c0a0 2024-05-30T16:42:02.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.068+0000 7f2d8d200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d800e3160 0x7f2d800e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.068+0000 7f2d8dc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2d80053cb0 0x7f2d80054120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54750/0 (socket says 172.21.15.144:54750) 2024-05-30T16:42:02.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.068+0000 7f2d8dc00640 1 -- 172.21.15.144:0/1815932314 learned_addr learned my addr 172.21.15.144:0/1815932314 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:02.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.069+0000 7ff855c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8501416b0 0x7ff85015f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.069+0000 7f2d87e00640 1 --2- 172.21.15.144:0/1815932314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d8003c0a0 0x7f2d80058050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.069+0000 7ff855c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff850163180 0x7ff850141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.070+0000 7ff84fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8501416b0 0x7ff85015f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.070+0000 7ff84fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8501416b0 0x7ff85015f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35110/0 (socket says 172.21.15.144:35110) 2024-05-30T16:42:02.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.070+0000 7ff84fe00640 1 -- 172.21.15.144:0/1885161397 learned_addr learned my addr 172.21.15.144:0/1885161397 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.070+0000 7f2d87400640 1 -- 172.21.15.144:0/1815932314 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013054044 0 0) 0x7f2d88050bd0 con 0x7f2d80053cb0 2024-05-30T16:42:02.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.070+0000 7f2d87400640 1 -- 172.21.15.144:0/1815932314 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d70003520 con 0x7f2d80053cb0 2024-05-30T16:42:02.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.071+0000 7ff855c00640 1 -- 172.21.15.144:0/1885161397 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8500b3730 con 0x7ff850142400 2024-05-30T16:42:02.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.071+0000 7ff855c00640 1 -- 172.21.15.144:0/1885161397 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff8500b3a10 con 0x7ff850163180 2024-05-30T16:42:02.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.071+0000 7ff84f400640 1 --2- 172.21.15.144:0/1885161397 >> v2:172.21.15.149:3300/0 conn(0x7ff850163180 0x7ff850141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.071+0000 7ff855c00640 1 -- 172.21.15.144:0/1885161397 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff8500b3cf0 con 0x7ff8501416b0 2024-05-30T16:42:02.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.070+0000 7f2d87e00640 1 -- 172.21.15.144:0/1815932314 >> v2:172.21.15.149:3300/0 conn(0x7f2d800e3160 msgr2=0x7f2d800e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.070+0000 7f2d87e00640 1 --2- 172.21.15.144:0/1815932314 >> v2:172.21.15.149:3300/0 conn(0x7f2d800e3160 0x7f2d800e7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.070+0000 7f2d87e00640 1 -- 172.21.15.144:0/1815932314 >> v1:172.21.15.144:6789/0 conn(0x7f2d80053cb0 legacy=0x7f2d80054120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.070+0000 7f2d87e00640 1 -- 172.21.15.144:0/1815932314 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d80058af0 con 0x7f2d8003c0a0 2024-05-30T16:42:02.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.072+0000 7ff84ea00640 1 -- 172.21.15.144:0/1885161397 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288038903 0 0) 0x7ff8500b3730 con 0x7ff850142400 2024-05-30T16:42:02.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.072+0000 7ff84ea00640 1 -- 172.21.15.144:0/1885161397 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff834003520 con 0x7ff850142400 2024-05-30T16:42:02.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.072+0000 7ff84f400640 1 -- 172.21.15.144:0/1885161397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8501416b0 msgr2=0x7ff85015f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.072+0000 7ff84f400640 1 --2- 172.21.15.144:0/1885161397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8501416b0 0x7ff85015f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.072+0000 7ff84f400640 1 -- 172.21.15.144:0/1885161397 >> v1:172.21.15.144:6789/0 conn(0x7ff850142400 legacy=0x7ff8500b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.073+0000 7ff84f400640 1 -- 172.21.15.144:0/1885161397 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8500b3fd0 con 0x7ff850163180 2024-05-30T16:42:02.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.073+0000 7ff84fe00640 1 --2- 172.21.15.144:0/1885161397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8501416b0 0x7ff85015f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:42:02.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.073+0000 7f2d87e00640 1 --2- 172.21.15.144:0/1815932314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d8003c0a0 0x7f2d80058050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0097a0 tx=0x7f2d7c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86116dc22c365524 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.073+0000 7f2d87400640 1 -- 172.21.15.144:0/1815932314 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c037070 con 0x7f2d8003c0a0 2024-05-30T16:42:02.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.074+0000 7f2d87400640 1 -- 172.21.15.144:0/1815932314 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c032440 con 0x7f2d8003c0a0 2024-05-30T16:42:02.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.074+0000 7f2d87400640 1 -- 172.21.15.144:0/1815932314 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c032850 con 0x7f2d8003c0a0 2024-05-30T16:42:02.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7ff84f400640 1 --2- 172.21.15.144:0/1885161397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 0x7ff850141ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff8400097a0 tx=0x7ff84002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c15e3d139e81f8f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7f2d8e600640 1 -- 172.21.15.144:0/1815932314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d8003c0a0 msgr2=0x7f2d80058050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7f2d8e600640 1 --2- 172.21.15.144:0/1815932314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d8003c0a0 0x7f2d80058050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0097a0 tx=0x7f2d7c02a1c0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7f2d8e600640 1 -- 172.21.15.144:0/1815932314 shutdown_connections 2024-05-30T16:42:02.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7f2d8e600640 1 --2- 172.21.15.144:0/1815932314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d8003c0a0 0x7f2d80058050 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7f2d8e600640 1 --2- 172.21.15.144:0/1815932314 >> v2:172.21.15.149:3300/0 conn(0x7f2d800e3160 0x7f2d800e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7ff84ea00640 1 -- 172.21.15.144:0/1885161397 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840037070 con 0x7ff850163180 2024-05-30T16:42:02.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7f2d8e600640 1 -- 172.21.15.144:0/1815932314 >> 172.21.15.144:0/1815932314 conn(0x7f2d80058ee0 msgr2=0x7f2d800592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7ff84ea00640 1 -- 172.21.15.144:0/1885161397 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84002ae40 con 0x7ff850163180 2024-05-30T16:42:02.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.075+0000 7f2d8e600640 1 -- 172.21.15.144:0/1815932314 shutdown_connections 2024-05-30T16:42:02.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.076+0000 7f2d8e600640 1 -- 172.21.15.144:0/1815932314 wait complete. 2024-05-30T16:42:02.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.076+0000 7ff855c00640 1 -- 172.21.15.144:0/1885161397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 msgr2=0x7ff850141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.076+0000 7ff855c00640 1 --2- 172.21.15.144:0/1885161397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 0x7ff850141ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff8400097a0 tx=0x7ff84002a130 comp rx=0 tx=0).stop 2024-05-30T16:42:02.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.077+0000 7ff855c00640 1 -- 172.21.15.144:0/1885161397 shutdown_connections 2024-05-30T16:42:02.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.077+0000 7ff855c00640 1 --2- 172.21.15.144:0/1885161397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 0x7ff850141ec0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.077+0000 7ff855c00640 1 --2- 172.21.15.144:0/1885161397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8501416b0 0x7ff85015f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.077+0000 7ff855c00640 1 -- 172.21.15.144:0/1885161397 >> 172.21.15.144:0/1885161397 conn(0x7ff8500627b0 msgr2=0x7ff85006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.077+0000 7ff855c00640 1 -- 172.21.15.144:0/1885161397 shutdown_connections 2024-05-30T16:42:02.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.077+0000 7ff855c00640 1 -- 172.21.15.144:0/1885161397 wait complete. 2024-05-30T16:42:02.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.079+0000 7f2d8e600640 1 Processor -- start 2024-05-30T16:42:02.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.079+0000 7f2d8e600640 1 -- start start 2024-05-30T16:42:02.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.080+0000 7ff855c00640 1 Processor -- start 2024-05-30T16:42:02.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.081+0000 7f2d8e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d8003c0a0 0x7f2d800d7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.081+0000 7f2d8e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d80053cb0 0x7f2d80051000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.081+0000 7f2d8e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d800e3160 0x7f2d80051540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.081+0000 7ff855c00640 1 -- start start 2024-05-30T16:42:02.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.082+0000 7f2d8d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d8003c0a0 0x7f2d800d7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.082+0000 7f2d8e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2d800e3540 con 0x7f2d8003c0a0 2024-05-30T16:42:02.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.082+0000 7f2d8e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2d80006640 con 0x7f2d800e3160 2024-05-30T16:42:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.082+0000 7f2d8e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2d80006b60 con 0x7f2d80053cb0 2024-05-30T16:42:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.082+0000 7f2d87e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d80053cb0 0x7f2d80051000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.082+0000 7f2d8dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d800e3160 0x7f2d80051540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.082+0000 7f2d8dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d800e3160 0x7f2d80051540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36106/0 (socket says 172.21.15.144:36106) 2024-05-30T16:42:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.082+0000 7f2d8dc00640 1 -- 172.21.15.144:0/1344040732 learned_addr learned my addr 172.21.15.144:0/1344040732 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.082+0000 7f2d87e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d80053cb0 0x7f2d80051000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35118/0 (socket says 172.21.15.144:35118) 2024-05-30T16:42:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.083+0000 7f2d8dc00640 1 -- 172.21.15.144:0/1344040732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d80053cb0 msgr2=0x7f2d80051000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.083+0000 7f2d8dc00640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d80053cb0 0x7f2d80051000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.083+0000 7f2d8dc00640 1 -- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d8003c0a0 msgr2=0x7f2d800d7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.083+0000 7f2d8dc00640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d8003c0a0 0x7f2d800d7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.083+0000 7f2d8dc00640 1 -- 172.21.15.144:0/1344040732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8004d1b0 con 0x7f2d800e3160 2024-05-30T16:42:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.083+0000 7f2d87e00640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d80053cb0 0x7f2d80051000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:42:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.083+0000 7f2d8d200640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d8003c0a0 0x7f2d800d7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.083+0000 7f2d8dc00640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d800e3160 0x7f2d80051540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d88076da0 tx=0x7f2d8806dcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.084+0000 7f2d84c00640 1 -- 172.21.15.144:0/1344040732 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8806bae0 con 0x7f2d800e3160 2024-05-30T16:42:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.084+0000 7f2d84c00640 1 -- 172.21.15.144:0/1344040732 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d8806bc80 con 0x7f2d800e3160 2024-05-30T16:42:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.084+0000 7f2d84c00640 1 -- 172.21.15.144:0/1344040732 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d880754b0 con 0x7f2d800e3160 2024-05-30T16:42:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.085+0000 7ff855c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8501416b0 0x7ff8500c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.085+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d80051b70 con 0x7f2d800e3160 2024-05-30T16:42:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.086+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d80052130 con 0x7f2d800e3160 2024-05-30T16:42:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.086+0000 7ff855c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff850142400 0x7ff85015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.086+0000 7ff855c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 0x7ff8500c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.087+0000 7ff855c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff850141a90 con 0x7ff8501416b0 2024-05-30T16:42:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.087+0000 7ff855200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 0x7ff8500c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.087+0000 7ff855200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 0x7ff8500c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36122/0 (socket says 172.21.15.144:36122) 2024-05-30T16:42:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.087+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d8004d380 con 0x7f2d800e3160 2024-05-30T16:42:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.087+0000 7ff855200640 1 -- 172.21.15.144:0/771273413 learned_addr learned my addr 172.21.15.144:0/771273413 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.087+0000 7ff84fe00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8501416b0 0x7ff8500c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.087+0000 7ff84f400640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff850142400 0x7ff85015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.088+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff85015fdc0 con 0x7ff850163180 2024-05-30T16:42:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.088+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff850141c10 con 0x7ff850142400 2024-05-30T16:42:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.089+0000 7ff84fe00640 1 -- 172.21.15.144:0/771273413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff850142400 msgr2=0x7ff85015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.089+0000 7ff84fe00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff850142400 0x7ff85015e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.089+0000 7ff84fe00640 1 -- 172.21.15.144:0/771273413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 msgr2=0x7ff8500c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.089+0000 7ff84fe00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 0x7ff8500c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.089+0000 7ff84fe00640 1 -- 172.21.15.144:0/771273413 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8500c7e30 con 0x7ff8501416b0 2024-05-30T16:42:02.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.090+0000 7ff84fe00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8501416b0 0x7ff8500c8ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00e7f0 tx=0x7ff83c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.091+0000 7ff847e00640 1 -- 172.21.15.144:0/771273413 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c017070 con 0x7ff8501416b0 2024-05-30T16:42:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.091+0000 7ff847e00640 1 -- 172.21.15.144:0/771273413 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c00ee40 con 0x7ff8501416b0 2024-05-30T16:42:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.092+0000 7ff847e00640 1 -- 172.21.15.144:0/771273413 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00cb60 con 0x7ff8501416b0 2024-05-30T16:42:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.090+0000 7f2d84c00640 1 -- 172.21.15.144:0/1344040732 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d88075650 con 0x7f2d800e3160 2024-05-30T16:42:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.091+0000 7f2d84c00640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2d6806c9c0 0x7f2d6806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.092+0000 7f2d84c00640 1 -- 172.21.15.144:0/1344040732 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d88107120 con 0x7f2d800e3160 2024-05-30T16:42:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.092+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8500c8110 con 0x7ff8501416b0 2024-05-30T16:42:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.092+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8500c86d0 con 0x7ff8501416b0 2024-05-30T16:42:02.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.094+0000 7f2d8d200640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2d6806c9c0 0x7f2d6806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.094+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff85006c870 con 0x7ff8501416b0 2024-05-30T16:42:02.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.095+0000 7f2d8d200640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2d6806c9c0 0x7f2d6806ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009b20 tx=0x7f2d74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.096+0000 7ff847e00640 1 -- 172.21.15.144:0/771273413 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff83c01a070 con 0x7ff8501416b0 2024-05-30T16:42:02.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.098+0000 7ff847e00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff83006c8f0 0x7ff83006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.098+0000 7ff84f400640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff83006c8f0 0x7ff83006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.100+0000 7ff847e00640 1 -- 172.21.15.144:0/771273413 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff83c08bbc0 con 0x7ff8501416b0 2024-05-30T16:42:02.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.100+0000 7ff84f400640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff83006c8f0 0x7ff83006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff840034000 tx=0x7ff84002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.102+0000 7f2d84c00640 1 -- 172.21.15.144:0/1344040732 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d80058590 con 0x7f2d800e3160 2024-05-30T16:42:02.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.106+0000 7ff847e00640 1 -- 172.21.15.144:0/771273413 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff83c059900 con 0x7ff8501416b0 2024-05-30T16:42:02.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.144+0000 7f5212200640 1 Processor -- start 2024-05-30T16:42:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.145+0000 7f5212200640 1 -- start start 2024-05-30T16:42:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.147+0000 7f5212200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52040e30b0 0x7f5204057d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.147+0000 7f5212200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f520403e830 0x7f5204053be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.147+0000 7f5212200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52040582c0 con 0x7f5204054120 2024-05-30T16:42:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.147+0000 7f5212200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5204058560 con 0x7f520403e830 2024-05-30T16:42:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.147+0000 7f5212200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5204058840 con 0x7f52040e30b0 2024-05-30T16:42:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.147+0000 7f520be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5204054120 0x7f52040e6c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54776/0 (socket says 172.21.15.144:54776) 2024-05-30T16:42:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.147+0000 7f520be00640 1 -- 172.21.15.144:0/2467822635 learned_addr learned my addr 172.21.15.144:0/2467822635 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.148+0000 7f520b400640 1 --2- 172.21.15.144:0/2467822635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52040e30b0 0x7f5204057d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.148+0000 7f520aa00640 1 --2- 172.21.15.144:0/2467822635 >> v2:172.21.15.149:3300/0 conn(0x7f520403e830 0x7f5204053be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.149+0000 7f520b400640 1 -- 172.21.15.144:0/2467822635 >> v2:172.21.15.149:3300/0 conn(0x7f520403e830 msgr2=0x7f5204053be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.150+0000 7f520a000640 1 -- 172.21.15.144:0/2467822635 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95132732 0 0) 0x7f52040582c0 con 0x7f5204054120 2024-05-30T16:42:02.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.150+0000 7f520b400640 1 --2- 172.21.15.144:0/2467822635 >> v2:172.21.15.149:3300/0 conn(0x7f520403e830 0x7f5204053be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.150+0000 7f520b400640 1 -- 172.21.15.144:0/2467822635 >> v1:172.21.15.144:6789/0 conn(0x7f5204054120 legacy=0x7f52040e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.151+0000 7f520b400640 1 -- 172.21.15.144:0/2467822635 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5204058b20 con 0x7f52040e30b0 2024-05-30T16:42:02.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.151+0000 7f520aa00640 1 --2- 172.21.15.144:0/2467822635 >> v2:172.21.15.149:3300/0 conn(0x7f520403e830 0x7f5204053be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:42:02.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.153+0000 7f1199800640 1 Processor -- start 2024-05-30T16:42:02.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.153+0000 7f1199800640 1 -- start start 2024-05-30T16:42:02.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.153+0000 7f520b400640 1 --2- 172.21.15.144:0/2467822635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52040e30b0 0x7f5204057d80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52000097a0 tx=0x7f520002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=418cd6cf84a39051 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.154+0000 7f520a000640 1 -- 172.21.15.144:0/2467822635 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200037070 con 0x7f52040e30b0 2024-05-30T16:42:02.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.154+0000 7f520a000640 1 -- 172.21.15.144:0/2467822635 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5200032440 con 0x7f52040e30b0 2024-05-30T16:42:02.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.154+0000 7f520a000640 1 -- 172.21.15.144:0/2467822635 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200032810 con 0x7f52040e30b0 2024-05-30T16:42:02.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.155+0000 7f5212200640 1 -- 172.21.15.144:0/2467822635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52040e30b0 msgr2=0x7f5204057d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.155+0000 7f5212200640 1 --2- 172.21.15.144:0/2467822635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52040e30b0 0x7f5204057d80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52000097a0 tx=0x7f520002a210 comp rx=0 tx=0).stop 2024-05-30T16:42:02.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.155+0000 7f5212200640 1 -- 172.21.15.144:0/2467822635 shutdown_connections 2024-05-30T16:42:02.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.155+0000 7f5212200640 1 --2- 172.21.15.144:0/2467822635 >> v2:172.21.15.149:3300/0 conn(0x7f520403e830 0x7f5204053be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.156+0000 7f5212200640 1 --2- 172.21.15.144:0/2467822635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52040e30b0 0x7f5204057d80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.156+0000 7f5212200640 1 -- 172.21.15.144:0/2467822635 >> 172.21.15.144:0/2467822635 conn(0x7f52040559d0 msgr2=0x7f5204055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.156+0000 7f5212200640 1 -- 172.21.15.144:0/2467822635 shutdown_connections 2024-05-30T16:42:02.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.156+0000 7f5212200640 1 -- 172.21.15.144:0/2467822635 wait complete. 2024-05-30T16:42:02.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7fa1e7e00640 1 Processor -- start 2024-05-30T16:42:02.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.158+0000 7fa1e7e00640 1 -- start start 2024-05-30T16:42:02.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7faa05e00640 1 Processor -- start 2024-05-30T16:42:02.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7faa05e00640 1 -- start start 2024-05-30T16:42:02.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.158+0000 7f5212200640 1 Processor -- start 2024-05-30T16:42:02.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.159+0000 7f5212200640 1 -- start start 2024-05-30T16:42:02.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.159+0000 7faa05e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa9f8053c60 0x7fa9f8038070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7f1199800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1194155a80 0x7f11940cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7f1199800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f11940ccea0 0x7f11940cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7f1199800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1194072c60 con 0x7f1194071ef0 2024-05-30T16:42:02.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7f1199800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f11940ce390 con 0x7f1194155a80 2024-05-30T16:42:02.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7f1199800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f11940ce5e0 con 0x7f11940ccea0 2024-05-30T16:42:02.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7f1192a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1194155a80 0x7f11940cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7f1192a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1194155a80 0x7f11940cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59036/0 (socket says 172.21.15.144:59036) 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.157+0000 7f1192a00640 1 -- 172.21.15.144:0/2602086723 learned_addr learned my addr 172.21.15.144:0/2602086723 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.158+0000 7f1192000640 1 --2- 172.21.15.144:0/2602086723 >> v2:172.21.15.149:3300/0 conn(0x7f11940ccea0 0x7f11940cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.158+0000 7f1192a00640 1 -- 172.21.15.144:0/2602086723 >> v2:172.21.15.149:3300/0 conn(0x7f11940ccea0 msgr2=0x7f11940cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.158+0000 7f1192a00640 1 --2- 172.21.15.144:0/2602086723 >> v2:172.21.15.149:3300/0 conn(0x7f11940ccea0 0x7f11940cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.158+0000 7f1192a00640 1 -- 172.21.15.144:0/2602086723 >> v1:172.21.15.144:6789/0 conn(0x7f1194071ef0 legacy=0x7f1194072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.158+0000 7f1192a00640 1 -- 172.21.15.144:0/2602086723 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11940ce8c0 con 0x7f1194155a80 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.159+0000 7faa05e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f80544b0 con 0x7fa9f80df210 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.159+0000 7faa05e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f80541d0 con 0x7fa9f8050190 2024-05-30T16:42:02.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.159+0000 7faa05e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f8005f20 con 0x7fa9f8053c60 2024-05-30T16:42:02.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.159+0000 7f1192a00640 1 --2- 172.21.15.144:0/2602086723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194155a80 0x7f11940cf0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1194062d30 tx=0x7f118002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3d1b572ea9757a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa1e7e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa1e000c0a0 0x7fa1e0038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa1e7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 0x7fa1e00df220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa1e7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa1e0033ef0 0x7fa1e004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa1e7e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e00df760 con 0x7fa1e0033ef0 2024-05-30T16:42:02.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa1e7e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e00544c0 con 0x7fa1e000c0a0 2024-05-30T16:42:02.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa1e7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e00541e0 con 0x7fa1e0053c70 2024-05-30T16:42:02.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa9fea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa9f80df210 0x7fa9f804fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54792/0 (socket says 172.21.15.144:54792) 2024-05-30T16:42:02.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa9fea00640 1 -- 172.21.15.144:0/1279870344 learned_addr learned my addr 172.21.15.144:0/1279870344 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:02.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa9ff400640 1 --2- 172.21.15.144:0/1279870344 >> v2:172.21.15.149:3300/0 conn(0x7fa9f8053c60 0x7fa9f8038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7f1191600640 1 -- 172.21.15.144:0/2602086723 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180037070 con 0x7f1194155a80 2024-05-30T16:42:02.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7f1191600640 1 -- 172.21.15.144:0/2602086723 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180032440 con 0x7f1194155a80 2024-05-30T16:42:02.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7fa1e7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa1e0033ef0 0x7fa1e004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.160+0000 7f1191600640 1 -- 172.21.15.144:0/2602086723 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180032810 con 0x7f1194155a80 2024-05-30T16:42:02.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa1e6a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa1e000c0a0 0x7fa1e0038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa1e7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa1e0033ef0 0x7fa1e004fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59044/0 (socket says 172.21.15.144:59044) 2024-05-30T16:42:02.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa1e7400640 1 -- 172.21.15.144:0/1083596632 learned_addr learned my addr 172.21.15.144:0/1083596632 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa1e6000640 1 --2- 172.21.15.144:0/1083596632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 0x7fa1e00df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa9ff400640 1 -- 172.21.15.144:0/1279870344 >> v1:172.21.15.149:6789/0 conn(0x7fa9f8050190 legacy=0x7fa9f8006a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa9ff400640 1 -- 172.21.15.144:0/1279870344 >> v1:172.21.15.144:6789/0 conn(0x7fa9f80df210 legacy=0x7fa9f804fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa9ff400640 1 -- 172.21.15.144:0/1279870344 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f8006200 con 0x7fa9f8053c60 2024-05-30T16:42:02.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa9fd600640 1 -- 172.21.15.144:0/1279870344 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610022769 0 0) 0x7fa9f80544b0 con 0x7fa9f80df210 2024-05-30T16:42:02.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa1e7400640 1 -- 172.21.15.144:0/1083596632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 msgr2=0x7fa1e00df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa1e7400640 1 --2- 172.21.15.144:0/1083596632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 0x7fa1e00df220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.161+0000 7fa1e7400640 1 -- 172.21.15.144:0/1083596632 >> v2:172.21.15.149:3300/0 conn(0x7fa1e000c0a0 msgr2=0x7fa1e0038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7f1199800640 1 -- 172.21.15.144:0/2602086723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194155a80 msgr2=0x7f11940cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7f1199800640 1 --2- 172.21.15.144:0/2602086723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194155a80 0x7f11940cf0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1194062d30 tx=0x7f118002a1f0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7fa1e7400640 1 --2- 172.21.15.144:0/1083596632 >> v2:172.21.15.149:3300/0 conn(0x7fa1e000c0a0 0x7fa1e0038080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7f1199800640 1 -- 172.21.15.144:0/2602086723 shutdown_connections 2024-05-30T16:42:02.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7f1199800640 1 --2- 172.21.15.144:0/2602086723 >> v2:172.21.15.149:3300/0 conn(0x7f11940ccea0 0x7f11940cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7f1199800640 1 --2- 172.21.15.144:0/2602086723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194155a80 0x7f11940cf0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7f1199800640 1 -- 172.21.15.144:0/2602086723 >> 172.21.15.144:0/2602086723 conn(0x7f1194062570 msgr2=0x7f119406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7fa1e7400640 1 -- 172.21.15.144:0/1083596632 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e0005f30 con 0x7fa1e0033ef0 2024-05-30T16:42:02.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7f1199800640 1 -- 172.21.15.144:0/2602086723 shutdown_connections 2024-05-30T16:42:02.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.162+0000 7f1199800640 1 -- 172.21.15.144:0/2602086723 wait complete. 2024-05-30T16:42:02.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.163+0000 7fa9ff400640 1 --2- 172.21.15.144:0/1279870344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f8053c60 0x7fa9f8038070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0090e0 tx=0x7fa9ec02b3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d66ceadab7ad60be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.163+0000 7fa1e7400640 1 --2- 172.21.15.144:0/1083596632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 0x7fa1e004fa90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8076da0 tx=0x7fa1e80a5c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2631c39081abbc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.163+0000 7f5212200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f520403e830 0x7f52041803f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.164+0000 7fa9fd600640 1 -- 172.21.15.144:0/1279870344 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec037070 con 0x7fa9f8053c60 2024-05-30T16:42:02.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.164+0000 7fa9fd600640 1 -- 172.21.15.144:0/1279870344 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec030710 con 0x7fa9f8053c60 2024-05-30T16:42:02.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.164+0000 7f5212200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5204054120 0x7f52041862d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.164+0000 7fa9fd600640 1 -- 172.21.15.144:0/1279870344 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec030b20 con 0x7fa9f8053c60 2024-05-30T16:42:02.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.164+0000 7f5212200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52040e30b0 0x7f5204051580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.164+0000 7f1199800640 1 Processor -- start 2024-05-30T16:42:02.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.164+0000 7fa1e5600640 1 -- 172.21.15.144:0/1083596632 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80b3070 con 0x7fa1e0033ef0 2024-05-30T16:42:02.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.164+0000 7fa1e5600640 1 -- 172.21.15.144:0/1083596632 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e80a6a50 con 0x7fa1e0033ef0 2024-05-30T16:42:02.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.164+0000 7fa1e5600640 1 -- 172.21.15.144:0/1083596632 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80ae440 con 0x7fa1e0033ef0 2024-05-30T16:42:02.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7f1199800640 1 -- start start 2024-05-30T16:42:02.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7f5212200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52040e3490 con 0x7f52040e30b0 2024-05-30T16:42:02.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7f5212200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f520403bfb0 con 0x7f520403e830 2024-05-30T16:42:02.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7f5212200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f52040078d0 con 0x7f5204054120 2024-05-30T16:42:02.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7faa05e00640 1 -- 172.21.15.144:0/1279870344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f8053c60 msgr2=0x7fa9f8038070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7faa05e00640 1 --2- 172.21.15.144:0/1279870344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f8053c60 0x7fa9f8038070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0090e0 tx=0x7fa9ec02b3d0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7faa05e00640 1 -- 172.21.15.144:0/1279870344 shutdown_connections 2024-05-30T16:42:02.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7faa05e00640 1 --2- 172.21.15.144:0/1279870344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f8053c60 0x7fa9f8038070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7faa05e00640 1 -- 172.21.15.144:0/1279870344 >> 172.21.15.144:0/1279870344 conn(0x7fa9f8009fa0 msgr2=0x7fa9f800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7fa1e7e00640 1 -- 172.21.15.144:0/1083596632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 msgr2=0x7fa1e004fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/1083596632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 0x7fa1e004fa90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8076da0 tx=0x7fa1e80a5c80 comp rx=0 tx=0).stop 2024-05-30T16:42:02.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7fa1e7e00640 1 -- 172.21.15.144:0/1083596632 shutdown_connections 2024-05-30T16:42:02.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.165+0000 7faa05e00640 1 -- 172.21.15.144:0/1279870344 shutdown_connections 2024-05-30T16:42:02.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7faa05e00640 1 -- 172.21.15.144:0/1279870344 wait complete. 2024-05-30T16:42:02.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/1083596632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 0x7fa1e004fa90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/1083596632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 0x7fa1e00df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/1083596632 >> v2:172.21.15.149:3300/0 conn(0x7fa1e000c0a0 0x7fa1e0038080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7fa1e7e00640 1 -- 172.21.15.144:0/1083596632 >> 172.21.15.144:0/1083596632 conn(0x7fa1e0009fb0 msgr2=0x7fa1e000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7fa1e7e00640 1 -- 172.21.15.144:0/1083596632 shutdown_connections 2024-05-30T16:42:02.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7fa1e7e00640 1 -- 172.21.15.144:0/1083596632 wait complete. 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7f1199800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1194071ef0 0x7f11940c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7f1199800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11940ccea0 0x7f11940c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7f1199800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1194155a80 0x7f1194149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f1199800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f11940cf780 con 0x7f11940ccea0 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f1199800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f11940cf600 con 0x7f1194071ef0 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f1199800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f11940b3e30 con 0x7f1194155a80 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f1192a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1194071ef0 0x7f11940c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f1192a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1194071ef0 0x7f11940c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36188/0 (socket says 172.21.15.144:36188) 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f1192a00640 1 -- 172.21.15.144:0/1411877107 learned_addr learned my addr 172.21.15.144:0/1411877107 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f1192000640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11940ccea0 0x7f11940c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f1193400640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1194155a80 0x7f1194149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7f520be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52040e30b0 0x7f5204051580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7f520aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5204054120 0x7f52041862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7f520be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52040e30b0 0x7f5204051580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59058/0 (socket says 172.21.15.144:59058) 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7f520be00640 1 -- 172.21.15.144:0/1992247086 learned_addr learned my addr 172.21.15.144:0/1992247086 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.166+0000 7f520b400640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f520403e830 0x7f52041803f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f520be00640 1 -- 172.21.15.144:0/1992247086 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5204054120 msgr2=0x7f52041862d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f520be00640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5204054120 0x7f52041862d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f520be00640 1 -- 172.21.15.144:0/1992247086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f520403e830 msgr2=0x7f52041803f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f520be00640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f520403e830 0x7f52041803f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.167+0000 7f520be00640 1 -- 172.21.15.144:0/1992247086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5204186d70 con 0x7f52040e30b0 2024-05-30T16:42:02.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f520be00640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52040e30b0 0x7f5204051580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c450 tx=0x7f51f800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f51ff400640 1 -- 172.21.15.144:0/1992247086 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f80075a0 con 0x7f52040e30b0 2024-05-30T16:42:02.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.169+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5204187050 con 0x7f52040e30b0 2024-05-30T16:42:02.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.169+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5204187910 con 0x7f52040e30b0 2024-05-30T16:42:02.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.169+0000 7faa05e00640 1 Processor -- start 2024-05-30T16:42:02.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.169+0000 7fa1e7e00640 1 Processor -- start 2024-05-30T16:42:02.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.169+0000 7faa05e00640 1 -- start start 2024-05-30T16:42:02.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.169+0000 7fa1e7e00640 1 -- start start 2024-05-30T16:42:02.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.171+0000 7faa05e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f8050190 0x7fa9f8047b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.171+0000 7faa05e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f8053c60 0x7fa9f80ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.169+0000 7f51ff400640 1 -- 172.21.15.144:0/1992247086 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f80047e0 con 0x7f52040e30b0 2024-05-30T16:42:02.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.169+0000 7f51ff400640 1 -- 172.21.15.144:0/1992247086 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f80075a0 con 0x7f52040e30b0 2024-05-30T16:42:02.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.171+0000 7faa05e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f80df210 0x7fa9f80ddb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f1192a00640 1 -- 172.21.15.144:0/1411877107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1194155a80 msgr2=0x7f1194149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f1192a00640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1194155a80 0x7f1194149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f1192a00640 1 -- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11940ccea0 msgr2=0x7f11940c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f1192a00640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11940ccea0 0x7f11940c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f1192a00640 1 -- 172.21.15.144:0/1411877107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11940c70d0 con 0x7f1194071ef0 2024-05-30T16:42:02.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.168+0000 7f1192000640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11940ccea0 0x7f11940c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:42:02.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7faa05e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8037a80 con 0x7fa9f8053c60 2024-05-30T16:42:02.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7faa05e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8037900 con 0x7fa9f80df210 2024-05-30T16:42:02.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7fa9fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f8053c60 0x7fa9f80ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7faa05e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f80df5f0 con 0x7fa9f8050190 2024-05-30T16:42:02.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7fa9fea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f8050190 0x7fa9f8047b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7fa9fea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f8050190 0x7fa9f8047b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35156/0 (socket says 172.21.15.144:35156) 2024-05-30T16:42:02.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7fa9fea00640 1 -- 172.21.15.144:0/193133492 learned_addr learned my addr 172.21.15.144:0/193133492 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7f1192a00640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1194071ef0 0x7f11940c7520 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1180000c00 tx=0x7f11800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7fa1e7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e000c0a0 0x7fa1e00d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7f118aa00640 1 -- 172.21.15.144:0/1411877107 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180041020 con 0x7f1194071ef0 2024-05-30T16:42:02.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7f118aa00640 1 -- 172.21.15.144:0/1411877107 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180030780 con 0x7f1194071ef0 2024-05-30T16:42:02.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7f118aa00640 1 -- 172.21.15.144:0/1411877107 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180037040 con 0x7f1194071ef0 2024-05-30T16:42:02.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7fa1e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 0x7fa1e00d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11941f7f00 con 0x7f1194071ef0 2024-05-30T16:42:02.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11941f84c0 con 0x7f1194071ef0 2024-05-30T16:42:02.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.172+0000 7fa9ff400640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f80df210 0x7fa9f80ddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7fa9ff400640 1 -- 172.21.15.144:0/193133492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f8050190 msgr2=0x7fa9f8047b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7fa9ff400640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f8050190 0x7fa9f8047b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7fa9ff400640 1 -- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f8053c60 msgr2=0x7fa9f80ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7fa9ff400640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f8053c60 0x7fa9f80ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7fa9ff400640 1 -- 172.21.15.144:0/193133492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f804a3b0 con 0x7fa9f80df210 2024-05-30T16:42:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7fa9fea00640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f8050190 0x7fa9f8047b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:42:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.174+0000 7fa9ff400640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f80df210 0x7fa9f80ddb00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec032000 tx=0x7fa9ec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.174+0000 7fa9fe000640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f8053c60 0x7fa9f80ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.173+0000 7fa1e6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e000c0a0 0x7fa1e00d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7fa1e7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 0x7fa1e01780b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7fa1e6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e000c0a0 0x7fa1e00d1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36204/0 (socket says 172.21.15.144:36204) 2024-05-30T16:42:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.174+0000 7fa1e6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 0x7fa1e00d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e8005290 con 0x7f52040e30b0 2024-05-30T16:42:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.176+0000 7fa9f7400640 1 -- 172.21.15.144:0/193133492 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec037050 con 0x7fa9f80df210 2024-05-30T16:42:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.176+0000 7fa9f7400640 1 -- 172.21.15.144:0/193133492 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec038040 con 0x7fa9f80df210 2024-05-30T16:42:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.176+0000 7fa9f7400640 1 -- 172.21.15.144:0/193133492 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec032630 con 0x7fa9f80df210 2024-05-30T16:42:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.176+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f804a690 con 0x7fa9f80df210 2024-05-30T16:42:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.176+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f8048050 con 0x7fa9f80df210 2024-05-30T16:42:02.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7f51ff400640 1 -- 172.21.15.144:0/1992247086 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51f8011070 con 0x7f52040e30b0 2024-05-30T16:42:02.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7fa1e6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 0x7fa1e00d58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59082/0 (socket says 172.21.15.144:59082) 2024-05-30T16:42:02.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7fa1e7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e0037910 con 0x7fa1e0033ef0 2024-05-30T16:42:02.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e00064f0 con 0x7fa1e000c0a0 2024-05-30T16:42:02.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7fa1e6a00640 1 -- 172.21.15.144:0/3213081213 learned_addr learned my addr 172.21.15.144:0/3213081213 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e0037a90 con 0x7fa1e0053c70 2024-05-30T16:42:02.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.176+0000 7fa1e7400640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 0x7fa1e01780b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.177+0000 7f51ff400640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f51ec06caf0 0x7f51ec06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.177+0000 7f51ff400640 1 -- 172.21.15.144:0/1992247086 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f51f808b250 con 0x7f52040e30b0 2024-05-30T16:42:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.178+0000 7fa1e6000640 1 -- 172.21.15.144:0/3213081213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 msgr2=0x7fa1e01780b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.178+0000 7fa1e6000640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 0x7fa1e01780b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.178+0000 7fa1e6000640 1 -- 172.21.15.144:0/3213081213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e000c0a0 msgr2=0x7fa1e00d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.178+0000 7fa1e6000640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e000c0a0 0x7fa1e00d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.178+0000 7fa1e6000640 1 -- 172.21.15.144:0/3213081213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e004c7f0 con 0x7fa1e0033ef0 2024-05-30T16:42:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.178+0000 7fa1e7400640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 0x7fa1e01780b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.175+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1194068b20 con 0x7f1194071ef0 2024-05-30T16:42:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.179+0000 7f118aa00640 1 -- 172.21.15.144:0/1411877107 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1180044020 con 0x7f1194071ef0 2024-05-30T16:42:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.179+0000 7fa1e6000640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 0x7fa1e00d58d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400d5f0 tx=0x7fa1d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.179+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f8005380 con 0x7fa9f80df210 2024-05-30T16:42:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.180+0000 7fa9f7400640 1 -- 172.21.15.144:0/193133492 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9ec0327d0 con 0x7fa9f80df210 2024-05-30T16:42:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.180+0000 7f118aa00640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f117406c8f0 0x7f117406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.180+0000 7f118aa00640 1 -- 172.21.15.144:0/1411877107 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f11800ac360 con 0x7f1194071ef0 2024-05-30T16:42:02.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.181+0000 7f520b400640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f51ec06caf0 0x7f51ec06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.181+0000 7f1192000640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f117406c8f0 0x7f117406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.181+0000 7fa9f7400640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e006c9f0 0x7fa9e006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.182+0000 7fa9f7400640 1 -- 172.21.15.144:0/193133492 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa9ec0b46d0 con 0x7fa9f80df210 2024-05-30T16:42:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.182+0000 7fa9fea00640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e006c9f0 0x7fa9e006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.182+0000 7f520b400640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f51ec06caf0 0x7f51ec06efb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5200034000 tx=0x7f520002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.183+0000 7fa1dea00640 1 -- 172.21.15.144:0/3213081213 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40125f0 con 0x7fa1e0033ef0 2024-05-30T16:42:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.183+0000 7f51ff400640 1 -- 172.21.15.144:0/1992247086 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51f8059670 con 0x7f52040e30b0 2024-05-30T16:42:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.183+0000 7fa1dea00640 1 -- 172.21.15.144:0/3213081213 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d4019070 con 0x7fa1e0033ef0 2024-05-30T16:42:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.183+0000 7fa1dea00640 1 -- 172.21.15.144:0/3213081213 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40129d0 con 0x7fa1e0033ef0 2024-05-30T16:42:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.184+0000 7fa9fea00640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e006c9f0 0x7fa9e006eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0007c40 tx=0x7fa9f0007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.185+0000 7f1192000640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f117406c8f0 0x7f117406edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11940cb250 tx=0x7f1184008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.185+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e004cad0 con 0x7fa1e0033ef0 2024-05-30T16:42:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.185+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e00e1e90 con 0x7fa1e0033ef0 2024-05-30T16:42:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.186+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e0005390 con 0x7fa1e0033ef0 2024-05-30T16:42:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.189+0000 7fa1dea00640 1 -- 172.21.15.144:0/3213081213 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1d4012b70 con 0x7fa1e0033ef0 2024-05-30T16:42:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.190+0000 7fa1dea00640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1c806c970 0x7fa1c806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.190+0000 7fa1dea00640 1 -- 172.21.15.144:0/3213081213 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1d408be60 con 0x7fa1e0033ef0 2024-05-30T16:42:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.191+0000 7fa1e6a00640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1c806c970 0x7fa1c806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.192+0000 7f118aa00640 1 -- 172.21.15.144:0/1411877107 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f118004b030 con 0x7f1194071ef0 2024-05-30T16:42:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.192+0000 7fa1e6a00640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1c806c970 0x7fa1c806ee30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8006fd0 tx=0x7fa1d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.199+0000 7fa1dea00640 1 -- 172.21.15.144:0/3213081213 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1d405a300 con 0x7fa1e0033ef0 2024-05-30T16:42:02.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.206+0000 7fa9f7400640 1 -- 172.21.15.144:0/193133492 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa9ec082ae0 con 0x7fa9f80df210 2024-05-30T16:42:02.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.383+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6658161790 con 0x7f665815fb30 2024-05-30T16:42:02.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.384+0000 7f664ea00640 1 -- 172.21.15.144:0/3226655567 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f665005cfa0 con 0x7f665815fb30 2024-05-30T16:42:02.385 INFO:teuthology.orchestra.run.smithi144.stdout:55834574855 2024-05-30T16:42:02.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.387+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f663406caf0 msgr2=0x7f663406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.387+0000 7f665d600640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f663406caf0 0x7f663406efb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6640000f60 tx=0x7f6640007e60 comp rx=0 tx=0).stop 2024-05-30T16:42:02.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.387+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f665815fb30 msgr2=0x7f6658150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.387+0000 7f665d600640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f665815fb30 0x7f6658150840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f665000cac0 tx=0x7f665000cf80 comp rx=0 tx=0).stop 2024-05-30T16:42:02.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.388+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 shutdown_connections 2024-05-30T16:42:02.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.388+0000 7f665d600640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f663406caf0 0x7f663406efb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.388+0000 7f665d600640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f665815fb30 0x7f6658150840 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.388+0000 7f665d600640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f665815c6e0 0x7f665814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.388+0000 7f665d600640 1 --2- 172.21.15.144:0/3226655567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66580d17b0 0x7f66580b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.388+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 >> 172.21.15.144:0/3226655567 conn(0x7f6658062390 msgr2=0x7f665815e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.389+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 shutdown_connections 2024-05-30T16:42:02.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.389+0000 7f665d600640 1 -- 172.21.15.144:0/3226655567 wait complete. 2024-05-30T16:42:02.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-05-30T16:42:02.417 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:02.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.441+0000 7f94c7400640 1 -- 172.21.15.144:0/4094340186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f94dc0cedb0 con 0x7f94dc070c60 2024-05-30T16:42:02.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.442+0000 7f94d2000640 1 -- 172.21.15.144:0/4094340186 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f94cc07a8a0 con 0x7f94dc070c60 2024-05-30T16:42:02.443 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:42:02.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.444+0000 7f94c7400640 1 -- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94bc06c920 msgr2=0x7f94bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.444+0000 7f94c7400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94bc06c920 0x7f94bc06ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0d40f0 tx=0x7f94c8009040 comp rx=0 tx=0).stop 2024-05-30T16:42:02.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.444+0000 7f94c7400640 1 -- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc070c60 msgr2=0x7f94dc075220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.444+0000 7f94c7400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc070c60 0x7f94dc075220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f94cc006fd0 tx=0x7f94cc004730 comp rx=0 tx=0).stop 2024-05-30T16:42:02.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.445+0000 7f94c7400640 1 -- 172.21.15.144:0/4094340186 shutdown_connections 2024-05-30T16:42:02.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.445+0000 7f94c7400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94bc06c920 0x7f94bc06ede0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.445+0000 7f94c7400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc06ec00 0x7f94dc06f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.445+0000 7f94c7400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94dc070c60 0x7f94dc075220 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.445+0000 7f94c7400640 1 --2- 172.21.15.144:0/4094340186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94dc14ac80 0x7f94dc074ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.445+0000 7f94c7400640 1 -- 172.21.15.144:0/4094340186 >> 172.21.15.144:0/4094340186 conn(0x7f94dc062390 msgr2=0x7f94dc0d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.445+0000 7f94c7400640 1 -- 172.21.15.144:0/4094340186 shutdown_connections 2024-05-30T16:42:02.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.445+0000 7f94c7400640 1 -- 172.21.15.144:0/4094340186 wait complete. 2024-05-30T16:42:02.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-05-30T16:42:02.462 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:02.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.487+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2d80005390 con 0x7f2d800e3160 2024-05-30T16:42:02.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.488+0000 7f2d84c00640 1 -- 172.21.15.144:0/1344040732 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2d880d4f70 con 0x7f2d800e3160 2024-05-30T16:42:02.489 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:42:02.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2d6806c9c0 msgr2=0x7f2d6806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2d6806c9c0 0x7f2d6806ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009b20 tx=0x7f2d74008040 comp rx=0 tx=0).stop 2024-05-30T16:42:02.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d800e3160 msgr2=0x7f2d80051540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d800e3160 0x7f2d80051540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d88076da0 tx=0x7f2d8806dcd0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 shutdown_connections 2024-05-30T16:42:02.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2d6806c9c0 0x7f2d6806ee80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d800e3160 0x7f2d80051540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d80053cb0 0x7f2d80051000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 --2- 172.21.15.144:0/1344040732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d8003c0a0 0x7f2d800d7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 >> 172.21.15.144:0/1344040732 conn(0x7f2d80058ee0 msgr2=0x7f2d800e0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 shutdown_connections 2024-05-30T16:42:02.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.491+0000 7f2d8e600640 1 -- 172.21.15.144:0/1344040732 wait complete. 2024-05-30T16:42:02.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-05-30T16:42:02.508 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:02.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.537+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff850075570 con 0x7ff8501416b0 2024-05-30T16:42:02.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.537+0000 7ff847e00640 1 -- 172.21.15.144:0/771273413 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff83c05dc00 con 0x7ff8501416b0 2024-05-30T16:42:02.538 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff83006c8f0 msgr2=0x7ff83006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff83006c8f0 0x7ff83006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff840034000 tx=0x7ff84002e000 comp rx=0 tx=0).stop 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8501416b0 msgr2=0x7ff8500c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8501416b0 0x7ff8500c8ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00e7f0 tx=0x7ff83c00ebf0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 shutdown_connections 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff83006c8f0 0x7ff83006edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850163180 0x7ff8500c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff850142400 0x7ff85015e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 --2- 172.21.15.144:0/771273413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8501416b0 0x7ff8500c8ed0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00e7f0 tx=0x7ff83c00ebf0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.541+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 >> 172.21.15.144:0/771273413 conn(0x7ff8500627b0 msgr2=0x7ff8500b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.542+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 shutdown_connections 2024-05-30T16:42:02.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.542+0000 7ff855c00640 1 -- 172.21.15.144:0/771273413 wait complete. 2024-05-30T16:42:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.545+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f11940af6d0 con 0x7f1194071ef0 2024-05-30T16:42:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.545+0000 7f118aa00640 1 -- 172.21.15.144:0/1411877107 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f118007a780 con 0x7f1194071ef0 2024-05-30T16:42:02.547 INFO:teuthology.orchestra.run.smithi144.stdout:55834574854 2024-05-30T16:42:02.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f117406c8f0 msgr2=0x7f117406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f117406c8f0 0x7f117406edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11940cb250 tx=0x7f1184008040 comp rx=0 tx=0).stop 2024-05-30T16:42:02.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1194071ef0 msgr2=0x7f11940c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1194071ef0 0x7f11940c7520 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1180000c00 tx=0x7f11800046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 shutdown_connections 2024-05-30T16:42:02.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f117406c8f0 0x7f117406edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1194155a80 0x7f1194149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11940ccea0 0x7f11940c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 --2- 172.21.15.144:0/1411877107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1194071ef0 0x7f11940c7520 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 >> 172.21.15.144:0/1411877107 conn(0x7f1194062570 msgr2=0x7f1194160190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 shutdown_connections 2024-05-30T16:42:02.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.548+0000 7f1199800640 1 -- 172.21.15.144:0/1411877107 wait complete. 2024-05-30T16:42:02.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-05-30T16:42:02.569 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:02.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-05-30T16:42:02.570 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:02.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.576+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f51e8005580 con 0x7f52040e30b0 2024-05-30T16:42:02.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.576+0000 7f51ff400640 1 -- 172.21.15.144:0/1992247086 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51f8058f70 con 0x7f52040e30b0 2024-05-30T16:42:02.577 INFO:teuthology.orchestra.run.smithi144.stdout:55834574855 2024-05-30T16:42:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f51ec06caf0 msgr2=0x7f51ec06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f51ec06caf0 0x7f51ec06efb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5200034000 tx=0x7f520002e000 comp rx=0 tx=0).stop 2024-05-30T16:42:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52040e30b0 msgr2=0x7f5204051580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52040e30b0 0x7f5204051580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c450 tx=0x7f51f800c850 comp rx=0 tx=0).stop 2024-05-30T16:42:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 shutdown_connections 2024-05-30T16:42:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f51ec06caf0 0x7f51ec06efb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52040e30b0 0x7f5204051580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5204054120 0x7f52041862d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 --2- 172.21.15.144:0/1992247086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f520403e830 0x7f52041803f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 >> 172.21.15.144:0/1992247086 conn(0x7f52040559d0 msgr2=0x7f5204057b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 shutdown_connections 2024-05-30T16:42:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.579+0000 7f5212200640 1 -- 172.21.15.144:0/1992247086 wait complete. 2024-05-30T16:42:02.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.582+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa1e0050110 con 0x7fa1e0033ef0 2024-05-30T16:42:02.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.582+0000 7fa1dea00640 1 -- 172.21.15.144:0/3213081213 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa1d4059c00 con 0x7fa1e0033ef0 2024-05-30T16:42:02.583 INFO:teuthology.orchestra.run.smithi144.stdout:55834574854 2024-05-30T16:42:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1c806c970 msgr2=0x7fa1c806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1c806c970 0x7fa1c806ee30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8006fd0 tx=0x7fa1d8008040 comp rx=0 tx=0).stop 2024-05-30T16:42:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 msgr2=0x7fa1e00d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 0x7fa1e00d58d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400d5f0 tx=0x7fa1d400dab0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 shutdown_connections 2024-05-30T16:42:02.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1c806c970 0x7fa1c806ee30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e0053c70 0x7fa1e01780b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0033ef0 0x7fa1e00d58d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 --2- 172.21.15.144:0/3213081213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e000c0a0 0x7fa1e00d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 >> 172.21.15.144:0/3213081213 conn(0x7fa1e0009fb0 msgr2=0x7fa1e0036590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 shutdown_connections 2024-05-30T16:42:02.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.585+0000 7fa1e7e00640 1 -- 172.21.15.144:0/3213081213 wait complete. 2024-05-30T16:42:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.598+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa9f80d77a0 con 0x7fa9f80df210 2024-05-30T16:42:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.599+0000 7fa9f7400640 1 -- 172.21.15.144:0/193133492 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9ec0823e0 con 0x7fa9f80df210 2024-05-30T16:42:02.600 INFO:teuthology.orchestra.run.smithi144.stdout:55834574853 2024-05-30T16:42:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e006c9f0 msgr2=0x7fa9e006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e006c9f0 0x7fa9e006eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0007c40 tx=0x7fa9f0007b90 comp rx=0 tx=0).stop 2024-05-30T16:42:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f80df210 msgr2=0x7fa9f80ddb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f80df210 0x7fa9f80ddb00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec032000 tx=0x7fa9ec0046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 shutdown_connections 2024-05-30T16:42:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e006c9f0 0x7fa9e006eeb0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0007c40 tx=0x7fa9f0007b90 comp rx=0 tx=0).stop 2024-05-30T16:42:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f80df210 0x7fa9f80ddb00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f8053c60 0x7fa9f80ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 --2- 172.21.15.144:0/193133492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f8050190 0x7fa9f8047b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.601+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 >> 172.21.15.144:0/193133492 conn(0x7fa9f8009fa0 msgr2=0x7fa9f8033ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-05-30T16:42:02.604 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.603+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 shutdown_connections 2024-05-30T16:42:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.603+0000 7faa05e00640 1 -- 172.21.15.144:0/193133492 wait complete. 2024-05-30T16:42:02.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-05-30T16:42:02.605 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:02.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-05-30T16:42:02.622 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:02.622 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:42:02.622 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:42:02.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.847+0000 7f3af9000640 1 Processor -- start 2024-05-30T16:42:02.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.847+0000 7f3af9000640 1 -- start start 2024-05-30T16:42:02.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.849+0000 7f3af9000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3af415e790 0x7f3af40ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.849+0000 7f3af9000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3af406b8e0 0x7f3af406bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.849+0000 7f3af9000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af415eb70 con 0x7f3af40b4db0 2024-05-30T16:42:02.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.849+0000 7f3af9000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3af40cea50 con 0x7f3af415e790 2024-05-30T16:42:02.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.849+0000 7f3af9000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3af40cded0 con 0x7f3af406b8e0 2024-05-30T16:42:02.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.849+0000 7f3af3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3af415e790 0x7f3af40ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.849+0000 7f3aeaa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3af40b4db0 0x7f3af4162ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54796/0 (socket says 172.21.15.144:54796) 2024-05-30T16:42:02.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.849+0000 7f3aeaa00640 1 -- 172.21.15.144:0/1893187571 learned_addr learned my addr 172.21.15.144:0/1893187571 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:02.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.849+0000 7f3af3e00640 1 --2- 172.21.15.144:0/1893187571 >> v2:172.21.15.149:3300/0 conn(0x7f3af406b8e0 0x7f3af406bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.850+0000 7f3af3400640 1 -- 172.21.15.144:0/1893187571 >> v2:172.21.15.149:3300/0 conn(0x7f3af406b8e0 msgr2=0x7f3af406bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.850+0000 7f3af3400640 1 --2- 172.21.15.144:0/1893187571 >> v2:172.21.15.149:3300/0 conn(0x7f3af406b8e0 0x7f3af406bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.850+0000 7f3af3400640 1 -- 172.21.15.144:0/1893187571 >> v1:172.21.15.144:6789/0 conn(0x7f3af40b4db0 legacy=0x7f3af4162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.850+0000 7f3af3400640 1 -- 172.21.15.144:0/1893187571 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af40ce1b0 con 0x7f3af415e790 2024-05-30T16:42:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.850+0000 7f3af2a00640 1 -- 172.21.15.144:0/1893187571 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425722607 0 0) 0x7f3adc001110 con 0x7f3af40b4db0 2024-05-30T16:42:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af3400640 1 --2- 172.21.15.144:0/1893187571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af415e790 0x7f3af40ca840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3af40c9d60 tx=0x7f3ae402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41248bb5880f8c62 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af2a00640 1 -- 172.21.15.144:0/1893187571 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4037070 con 0x7f3af415e790 2024-05-30T16:42:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af2a00640 1 -- 172.21.15.144:0/1893187571 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae4032440 con 0x7f3af415e790 2024-05-30T16:42:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af2a00640 1 -- 172.21.15.144:0/1893187571 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae402ae60 con 0x7f3af415e790 2024-05-30T16:42:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af9000640 1 -- 172.21.15.144:0/1893187571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af415e790 msgr2=0x7f3af40ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af9000640 1 --2- 172.21.15.144:0/1893187571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af415e790 0x7f3af40ca840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3af40c9d60 tx=0x7f3ae402a110 comp rx=0 tx=0).stop 2024-05-30T16:42:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af9000640 1 -- 172.21.15.144:0/1893187571 shutdown_connections 2024-05-30T16:42:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af9000640 1 --2- 172.21.15.144:0/1893187571 >> v2:172.21.15.149:3300/0 conn(0x7f3af406b8e0 0x7f3af406bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af9000640 1 --2- 172.21.15.144:0/1893187571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af415e790 0x7f3af40ca840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.851+0000 7f3af9000640 1 -- 172.21.15.144:0/1893187571 >> 172.21.15.144:0/1893187571 conn(0x7f3af40b20a0 msgr2=0x7f3af40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.852+0000 7f3af9000640 1 -- 172.21.15.144:0/1893187571 shutdown_connections 2024-05-30T16:42:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.852+0000 7f3af9000640 1 -- 172.21.15.144:0/1893187571 wait complete. 2024-05-30T16:42:02.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.853+0000 7f3af9000640 1 Processor -- start 2024-05-30T16:42:02.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.853+0000 7f3af9000640 1 -- start start 2024-05-30T16:42:02.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.854+0000 7f3af9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af406b8e0 0x7f3af40aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.854+0000 7f3af9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3af40b4db0 0x7f3af41ea790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.854+0000 7f3af9000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3af415e790 0x7f3af415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.854+0000 7f3af9000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3af40b3990 con 0x7f3af406b8e0 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.854+0000 7f3af9000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3af40ce770 con 0x7f3af40b4db0 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.854+0000 7f3af9000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3af40b3b10 con 0x7f3af415e790 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.854+0000 7f3af3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af406b8e0 0x7f3af40aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.854+0000 7f3af3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af406b8e0 0x7f3af40aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59090/0 (socket says 172.21.15.144:59090) 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.854+0000 7f3af3400640 1 -- 172.21.15.144:0/2110145001 learned_addr learned my addr 172.21.15.144:0/2110145001 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3af3400640 1 -- 172.21.15.144:0/2110145001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3af415e790 msgr2=0x7f3af415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3af3400640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3af415e790 0x7f3af415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3af3400640 1 -- 172.21.15.144:0/2110145001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3af40b4db0 msgr2=0x7f3af41ea790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3aeaa00640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3af40b4db0 0x7f3af41ea790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3af3400640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3af40b4db0 0x7f3af41ea790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3af3400640 1 -- 172.21.15.144:0/2110145001 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af40af3a0 con 0x7f3af406b8e0 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3af3400640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af406b8e0 0x7f3af40aee60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4000c00 tx=0x7f3ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3aebe00640 1 -- 172.21.15.144:0/2110145001 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4037040 con 0x7f3af406b8e0 2024-05-30T16:42:02.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3aebe00640 1 -- 172.21.15.144:0/2110145001 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae4042070 con 0x7f3af406b8e0 2024-05-30T16:42:02.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af41e9fd0 con 0x7f3af406b8e0 2024-05-30T16:42:02.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.855+0000 7f3aebe00640 1 -- 172.21.15.144:0/2110145001 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4030bd0 con 0x7f3af406b8e0 2024-05-30T16:42:02.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.856+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af41e85b0 con 0x7f3af406b8e0 2024-05-30T16:42:02.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.856+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af4075570 con 0x7f3af406b8e0 2024-05-30T16:42:02.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.857+0000 7f3aebe00640 1 -- 172.21.15.144:0/2110145001 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ae4047460 con 0x7f3af406b8e0 2024-05-30T16:42:02.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.858+0000 7f3aebe00640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3ad006c8f0 0x7f3ad006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:02.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.858+0000 7f3aebe00640 1 -- 172.21.15.144:0/2110145001 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ae40ac7c0 con 0x7f3af406b8e0 2024-05-30T16:42:02.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.858+0000 7f3aeaa00640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3ad006c8f0 0x7f3ad006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:02.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.859+0000 7f3aeaa00640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3ad006c8f0 0x7f3ad006edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3af40b2790 tx=0x7f3adc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:02.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:02.863+0000 7f3aebe00640 1 -- 172.21.15.144:0/2110145001 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3af40af3a0 con 0x7f3af406b8e0 2024-05-30T16:42:03.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.047+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3af41ea5e0 con 0x7f3ad006c8f0 2024-05-30T16:42:03.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.058+0000 7f3aebe00640 1 -- 172.21.15.144:0/2110145001 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f3af41ea5e0 con 0x7f3ad006c8f0 2024-05-30T16:42:03.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.062+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3ad006c8f0 msgr2=0x7f3ad006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.062+0000 7f3af9000640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3ad006c8f0 0x7f3ad006edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3af40b2790 tx=0x7f3adc009040 comp rx=0 tx=0).stop 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.062+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af406b8e0 msgr2=0x7f3af40aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.062+0000 7f3af9000640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af406b8e0 0x7f3af40aee60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4000c00 tx=0x7f3ae40046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.063+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 shutdown_connections 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.063+0000 7f3af9000640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3ad006c8f0 0x7f3ad006edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.063+0000 7f3af9000640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3af415e790 0x7f3af415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.063+0000 7f3af9000640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3af40b4db0 0x7f3af41ea790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.063+0000 7f3af9000640 1 --2- 172.21.15.144:0/2110145001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af406b8e0 0x7f3af40aee60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.063+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 >> 172.21.15.144:0/2110145001 conn(0x7f3af40b20a0 msgr2=0x7f3af40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.063+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 shutdown_connections 2024-05-30T16:42:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.063+0000 7f3af9000640 1 -- 172.21.15.144:0/2110145001 wait complete. 2024-05-30T16:42:03.081 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-30T16:42:02.895904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.572490"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473939+0000","last_change":"2024-05-30T16:41:53.357304+0000","last_active":"2024-05-30T16:41:54.473939+0000","last_peered":"2024-05-30T16:41:54.473939+0000","last_clean":"2024-05-30T16:41:54.473939+0000","last_became_active":"2024-05-30T16:41:53.356937+0000","last_became_peered":"2024-05-30T16:41:53.356937+0000","last_unstale":"2024-05-30T16:41:54.473939+0000","last_undegraded":"2024-05-30T16:41:54.473939+0000","last_fullsized":"2024-05-30T16:41:54.473939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:04.325790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353623+0000","last_change":"2024-05-30T16:41:53.368919+0000","last_active":"2024-05-30T16:41:54.353623+0000","last_peered":"2024-05-30T16:41:54.353623+0000","last_clean":"2024-05-30T16:41:54.353623+0000","last_became_active":"2024-05-30T16:41:53.368598+0000","last_became_peered":"2024-05-30T16:41:53.368598+0000","last_unstale":"2024-05-30T16:41:54.353623+0000","last_undegraded":"2024-05-30T16:41:54.353623+0000","last_fullsized":"2024-05-30T16:41:54.353623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457349+0000","last_change":"2024-05-30T16:41:53.360032+0000","last_active":"2024-05-30T16:41:55.457349+0000","last_peered":"2024-05-30T16:41:55.457349+0000","last_clean":"2024-05-30T16:41:55.457349+0000","last_became_active":"2024-05-30T16:41:53.353909+0000","last_became_peered":"2024-05-30T16:41:53.353909+0000","last_unstale":"2024-05-30T16:41:55.457349+0000","last_undegraded":"2024-05-30T16:41:55.457349+0000","last_fullsized":"2024-05-30T16:41:55.457349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456943+0000","last_change":"2024-05-30T16:41:53.375331+0000","last_active":"2024-05-30T16:41:55.456943+0000","last_peered":"2024-05-30T16:41:55.456943+0000","last_clean":"2024-05-30T16:41:55.456943+0000","last_became_active":"2024-05-30T16:41:53.375049+0000","last_became_peered":"2024-05-30T16:41:53.375049+0000","last_unstale":"2024-05-30T16:41:55.456943+0000","last_undegraded":"2024-05-30T16:41:55.456943+0000","last_fullsized":"2024-05-30T16:41:55.456943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:11.943106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473149+0000","last_change":"2024-05-30T16:41:53.360193+0000","last_active":"2024-05-30T16:41:54.473149+0000","last_peered":"2024-05-30T16:41:54.473149+0000","last_clean":"2024-05-30T16:41:54.473149+0000","last_became_active":"2024-05-30T16:41:53.356390+0000","last_became_peered":"2024-05-30T16:41:53.356390+0000","last_unstale":"2024-05-30T16:41:54.473149+0000","last_undegraded":"2024-05-30T16:41:54.473149+0000","last_fullsized":"2024-05-30T16:41:54.473149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:01:25.890627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456576+0000","last_change":"2024-05-30T16:41:53.363129+0000","last_active":"2024-05-30T16:41:55.456576+0000","last_peered":"2024-05-30T16:41:55.456576+0000","last_clean":"2024-05-30T16:41:55.456576+0000","last_became_active":"2024-05-30T16:41:53.362799+0000","last_became_peered":"2024-05-30T16:41:53.362799+0000","last_unstale":"2024-05-30T16:41:55.456576+0000","last_undegraded":"2024-05-30T16:41:55.456576+0000","last_fullsized":"2024-05-30T16:41:55.456576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472403+0000","last_change":"2024-05-30T16:41:53.354731+0000","last_active":"2024-05-30T16:41:54.472403+0000","last_peered":"2024-05-30T16:41:54.472403+0000","last_clean":"2024-05-30T16:41:54.472403+0000","last_became_active":"2024-05-30T16:41:53.354407+0000","last_became_peered":"2024-05-30T16:41:53.354407+0000","last_unstale":"2024-05-30T16:41:54.472403+0000","last_undegraded":"2024-05-30T16:41:54.472403+0000","last_fullsized":"2024-05-30T16:41:54.472403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:09.648137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457945+0000","last_change":"2024-05-30T16:41:53.364759+0000","last_active":"2024-05-30T16:41:55.457945+0000","last_peered":"2024-05-30T16:41:55.457945+0000","last_clean":"2024-05-30T16:41:55.457945+0000","last_became_active":"2024-05-30T16:41:53.363544+0000","last_became_peered":"2024-05-30T16:41:53.363544+0000","last_unstale":"2024-05-30T16:41:55.457945+0000","last_undegraded":"2024-05-30T16:41:55.457945+0000","last_fullsized":"2024-05-30T16:41:55.457945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473887+0000","last_change":"2024-05-30T16:41:53.361800+0000","last_active":"2024-05-30T16:41:54.473887+0000","last_peered":"2024-05-30T16:41:54.473887+0000","last_clean":"2024-05-30T16:41:54.473887+0000","last_became_active":"2024-05-30T16:41:53.361517+0000","last_became_peered":"2024-05-30T16:41:53.361517+0000","last_unstale":"2024-05-30T16:41:54.473887+0000","last_undegraded":"2024-05-30T16:41:54.473887+0000","last_fullsized":"2024-05-30T16:41:54.473887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:11.893893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359310+0000","last_change":"2024-05-30T16:41:53.357190+0000","last_active":"2024-05-30T16:41:54.359310+0000","last_peered":"2024-05-30T16:41:54.359310+0000","last_clean":"2024-05-30T16:41:54.359310+0000","last_became_active":"2024-05-30T16:41:53.355805+0000","last_became_peered":"2024-05-30T16:41:53.355805+0000","last_unstale":"2024-05-30T16:41:54.359310+0000","last_undegraded":"2024-05-30T16:41:54.359310+0000","last_fullsized":"2024-05-30T16:41:54.359310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358896+0000","last_change":"2024-05-30T16:41:53.362431+0000","last_active":"2024-05-30T16:41:54.358896+0000","last_peered":"2024-05-30T16:41:54.358896+0000","last_clean":"2024-05-30T16:41:54.358896+0000","last_became_active":"2024-05-30T16:41:53.362046+0000","last_became_peered":"2024-05-30T16:41:53.362046+0000","last_unstale":"2024-05-30T16:41:54.358896+0000","last_undegraded":"2024-05-30T16:41:54.358896+0000","last_fullsized":"2024-05-30T16:41:54.358896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358108+0000","last_change":"2024-05-30T16:41:53.365227+0000","last_active":"2024-05-30T16:41:54.358108+0000","last_peered":"2024-05-30T16:41:54.358108+0000","last_clean":"2024-05-30T16:41:54.358108+0000","last_became_active":"2024-05-30T16:41:53.361257+0000","last_became_peered":"2024-05-30T16:41:53.361257+0000","last_unstale":"2024-05-30T16:41:54.358108+0000","last_undegraded":"2024-05-30T16:41:54.358108+0000","last_fullsized":"2024-05-30T16:41:54.358108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:24.316502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459058+0000","last_change":"2024-05-30T16:41:53.363327+0000","last_active":"2024-05-30T16:41:55.459058+0000","last_peered":"2024-05-30T16:41:55.459058+0000","last_clean":"2024-05-30T16:41:55.459058+0000","last_became_active":"2024-05-30T16:41:53.358909+0000","last_became_peered":"2024-05-30T16:41:53.358909+0000","last_unstale":"2024-05-30T16:41:55.459058+0000","last_undegraded":"2024-05-30T16:41:55.459058+0000","last_fullsized":"2024-05-30T16:41:55.459058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456449+0000","last_change":"2024-05-30T16:41:53.349858+0000","last_active":"2024-05-30T16:41:55.456449+0000","last_peered":"2024-05-30T16:41:55.456449+0000","last_clean":"2024-05-30T16:41:55.456449+0000","last_became_active":"2024-05-30T16:41:53.349503+0000","last_became_peered":"2024-05-30T16:41:53.349503+0000","last_unstale":"2024-05-30T16:41:55.456449+0000","last_undegraded":"2024-05-30T16:41:55.456449+0000","last_fullsized":"2024-05-30T16:41:55.456449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:16:19.914867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353871+0000","last_change":"2024-05-30T16:41:53.361644+0000","last_active":"2024-05-30T16:41:54.353871+0000","last_peered":"2024-05-30T16:41:54.353871+0000","last_clean":"2024-05-30T16:41:54.353871+0000","last_became_active":"2024-05-30T16:41:53.361338+0000","last_became_peered":"2024-05-30T16:41:53.361338+0000","last_unstale":"2024-05-30T16:41:54.353871+0000","last_undegraded":"2024-05-30T16:41:54.353871+0000","last_fullsized":"2024-05-30T16:41:54.353871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456639+0000","last_change":"2024-05-30T16:41:53.360331+0000","last_active":"2024-05-30T16:41:55.456639+0000","last_peered":"2024-05-30T16:41:55.456639+0000","last_clean":"2024-05-30T16:41:55.456639+0000","last_became_active":"2024-05-30T16:41:53.359832+0000","last_became_peered":"2024-05-30T16:41:53.359832+0000","last_unstale":"2024-05-30T16:41:55.456639+0000","last_undegraded":"2024-05-30T16:41:55.456639+0000","last_fullsized":"2024-05-30T16:41:55.456639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457756+0000","last_change":"2024-05-30T16:41:53.368792+0000","last_active":"2024-05-30T16:41:55.457756+0000","last_peered":"2024-05-30T16:41:55.457756+0000","last_clean":"2024-05-30T16:41:55.457756+0000","last_became_active":"2024-05-30T16:41:53.368547+0000","last_became_peered":"2024-05-30T16:41:53.368547+0000","last_unstale":"2024-05-30T16:41:55.457756+0000","last_undegraded":"2024-05-30T16:41:55.457756+0000","last_fullsized":"2024-05-30T16:41:55.457756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:37:50.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295237+0000","last_change":"2024-05-30T16:41:53.356728+0000","last_active":"2024-05-30T16:41:55.295237+0000","last_peered":"2024-05-30T16:41:55.295237+0000","last_clean":"2024-05-30T16:41:55.295237+0000","last_became_active":"2024-05-30T16:41:53.356161+0000","last_became_peered":"2024-05-30T16:41:53.356161+0000","last_unstale":"2024-05-30T16:41:55.295237+0000","last_undegraded":"2024-05-30T16:41:55.295237+0000","last_fullsized":"2024-05-30T16:41:55.295237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:24.316502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473885+0000","last_change":"2024-05-30T16:41:53.352155+0000","last_active":"2024-05-30T16:41:54.473885+0000","last_peered":"2024-05-30T16:41:54.473885+0000","last_clean":"2024-05-30T16:41:54.473885+0000","last_became_active":"2024-05-30T16:41:53.348922+0000","last_became_peered":"2024-05-30T16:41:53.348922+0000","last_unstale":"2024-05-30T16:41:54.473885+0000","last_undegraded":"2024-05-30T16:41:54.473885+0000","last_fullsized":"2024-05-30T16:41:54.473885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:05.861936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358757+0000","last_change":"2024-05-30T16:41:53.373040+0000","last_active":"2024-05-30T16:41:54.358757+0000","last_peered":"2024-05-30T16:41:54.358757+0000","last_clean":"2024-05-30T16:41:54.358757+0000","last_became_active":"2024-05-30T16:41:53.372775+0000","last_became_peered":"2024-05-30T16:41:53.372775+0000","last_unstale":"2024-05-30T16:41:54.358757+0000","last_undegraded":"2024-05-30T16:41:54.358757+0000","last_fullsized":"2024-05-30T16:41:54.358757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456552+0000","last_change":"2024-05-30T16:41:53.363158+0000","last_active":"2024-05-30T16:41:55.456552+0000","last_peered":"2024-05-30T16:41:55.456552+0000","last_clean":"2024-05-30T16:41:55.456552+0000","last_became_active":"2024-05-30T16:41:53.362828+0000","last_became_peered":"2024-05-30T16:41:53.362828+0000","last_unstale":"2024-05-30T16:41:55.456552+0000","last_undegraded":"2024-05-30T16:41:55.456552+0000","last_fullsized":"2024-05-30T16:41:55.456552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:52:35.610545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456637+0000","last_change":"2024-05-30T16:41:53.370806+0000","last_active":"2024-05-30T16:41:55.456637+0000","last_peered":"2024-05-30T16:41:55.456637+0000","last_clean":"2024-05-30T16:41:55.456637+0000","last_became_active":"2024-05-30T16:41:53.369787+0000","last_became_peered":"2024-05-30T16:41:53.369787+0000","last_unstale":"2024-05-30T16:41:55.456637+0000","last_undegraded":"2024-05-30T16:41:55.456637+0000","last_fullsized":"2024-05-30T16:41:55.456637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457726+0000","last_change":"2024-05-30T16:41:53.362039+0000","last_active":"2024-05-30T16:41:55.457726+0000","last_peered":"2024-05-30T16:41:55.457726+0000","last_clean":"2024-05-30T16:41:55.457726+0000","last_became_active":"2024-05-30T16:41:53.361725+0000","last_became_peered":"2024-05-30T16:41:53.361725+0000","last_unstale":"2024-05-30T16:41:55.457726+0000","last_undegraded":"2024-05-30T16:41:55.457726+0000","last_fullsized":"2024-05-30T16:41:55.457726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:03.444148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456547+0000","last_change":"2024-05-30T16:41:53.360122+0000","last_active":"2024-05-30T16:41:55.456547+0000","last_peered":"2024-05-30T16:41:55.456547+0000","last_clean":"2024-05-30T16:41:55.456547+0000","last_became_active":"2024-05-30T16:41:53.359414+0000","last_became_peered":"2024-05-30T16:41:53.359414+0000","last_unstale":"2024-05-30T16:41:55.456547+0000","last_undegraded":"2024-05-30T16:41:55.456547+0000","last_fullsized":"2024-05-30T16:41:55.456547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459845+0000","last_change":"2024-05-30T16:41:53.354023+0000","last_active":"2024-05-30T16:41:55.459845+0000","last_peered":"2024-05-30T16:41:55.459845+0000","last_clean":"2024-05-30T16:41:55.459845+0000","last_became_active":"2024-05-30T16:41:53.352390+0000","last_became_peered":"2024-05-30T16:41:53.352390+0000","last_unstale":"2024-05-30T16:41:55.459845+0000","last_undegraded":"2024-05-30T16:41:55.459845+0000","last_fullsized":"2024-05-30T16:41:55.459845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359371+0000","last_change":"2024-05-30T16:41:53.354855+0000","last_active":"2024-05-30T16:41:54.359371+0000","last_peered":"2024-05-30T16:41:54.359371+0000","last_clean":"2024-05-30T16:41:54.359371+0000","last_became_active":"2024-05-30T16:41:53.354564+0000","last_became_peered":"2024-05-30T16:41:53.354564+0000","last_unstale":"2024-05-30T16:41:54.359371+0000","last_undegraded":"2024-05-30T16:41:54.359371+0000","last_fullsized":"2024-05-30T16:41:54.359371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353620+0000","last_change":"2024-05-30T16:41:53.357643+0000","last_active":"2024-05-30T16:41:54.353620+0000","last_peered":"2024-05-30T16:41:54.353620+0000","last_clean":"2024-05-30T16:41:54.353620+0000","last_became_active":"2024-05-30T16:41:53.357364+0000","last_became_peered":"2024-05-30T16:41:53.357364+0000","last_unstale":"2024-05-30T16:41:54.353620+0000","last_undegraded":"2024-05-30T16:41:54.353620+0000","last_fullsized":"2024-05-30T16:41:54.353620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459783+0000","last_change":"2024-05-30T16:41:53.359016+0000","last_active":"2024-05-30T16:41:55.459783+0000","last_peered":"2024-05-30T16:41:55.459783+0000","last_clean":"2024-05-30T16:41:55.459783+0000","last_became_active":"2024-05-30T16:41:53.358647+0000","last_became_peered":"2024-05-30T16:41:53.358647+0000","last_unstale":"2024-05-30T16:41:55.459783+0000","last_undegraded":"2024-05-30T16:41:55.459783+0000","last_fullsized":"2024-05-30T16:41:55.459783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456720+0000","last_change":"2024-05-30T16:41:53.369095+0000","last_active":"2024-05-30T16:41:55.456720+0000","last_peered":"2024-05-30T16:41:55.456720+0000","last_clean":"2024-05-30T16:41:55.456720+0000","last_became_active":"2024-05-30T16:41:53.368747+0000","last_became_peered":"2024-05-30T16:41:53.368747+0000","last_unstale":"2024-05-30T16:41:55.456720+0000","last_undegraded":"2024-05-30T16:41:55.456720+0000","last_fullsized":"2024-05-30T16:41:55.456720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:03.444148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456759+0000","last_change":"2024-05-30T16:41:53.373107+0000","last_active":"2024-05-30T16:41:55.456759+0000","last_peered":"2024-05-30T16:41:55.456759+0000","last_clean":"2024-05-30T16:41:55.456759+0000","last_became_active":"2024-05-30T16:41:53.372856+0000","last_became_peered":"2024-05-30T16:41:53.372856+0000","last_unstale":"2024-05-30T16:41:55.456759+0000","last_undegraded":"2024-05-30T16:41:55.456759+0000","last_fullsized":"2024-05-30T16:41:55.456759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295310+0000","last_change":"2024-05-30T16:41:53.357024+0000","last_active":"2024-05-30T16:41:55.295310+0000","last_peered":"2024-05-30T16:41:55.295310+0000","last_clean":"2024-05-30T16:41:55.295310+0000","last_became_active":"2024-05-30T16:41:53.355547+0000","last_became_peered":"2024-05-30T16:41:53.355547+0000","last_unstale":"2024-05-30T16:41:55.295310+0000","last_undegraded":"2024-05-30T16:41:55.295310+0000","last_fullsized":"2024-05-30T16:41:55.295310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:17.807528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357938+0000","last_change":"2024-05-30T16:41:53.358603+0000","last_active":"2024-05-30T16:41:54.357938+0000","last_peered":"2024-05-30T16:41:54.357938+0000","last_clean":"2024-05-30T16:41:54.357938+0000","last_became_active":"2024-05-30T16:41:53.357790+0000","last_became_peered":"2024-05-30T16:41:53.357790+0000","last_unstale":"2024-05-30T16:41:54.357938+0000","last_undegraded":"2024-05-30T16:41:54.357938+0000","last_fullsized":"2024-05-30T16:41:54.357938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357689+0000","last_change":"2024-05-30T16:41:53.352211+0000","last_active":"2024-05-30T16:41:54.357689+0000","last_peered":"2024-05-30T16:41:54.357689+0000","last_clean":"2024-05-30T16:41:54.357689+0000","last_became_active":"2024-05-30T16:41:53.351432+0000","last_became_peered":"2024-05-30T16:41:53.351432+0000","last_unstale":"2024-05-30T16:41:54.357689+0000","last_undegraded":"2024-05-30T16:41:54.357689+0000","last_fullsized":"2024-05-30T16:41:54.357689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:03.931858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459368+0000","last_change":"2024-05-30T16:41:52.337016+0000","last_active":"2024-05-30T16:41:55.459368+0000","last_peered":"2024-05-30T16:41:55.459368+0000","last_clean":"2024-05-30T16:41:55.459368+0000","last_became_active":"2024-05-30T16:41:52.336681+0000","last_became_peered":"2024-05-30T16:41:52.336681+0000","last_unstale":"2024-05-30T16:41:55.459368+0000","last_undegraded":"2024-05-30T16:41:55.459368+0000","last_fullsized":"2024-05-30T16:41:55.459368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:31.649153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456897+0000","last_change":"2024-05-30T16:41:53.368959+0000","last_active":"2024-05-30T16:41:55.456897+0000","last_peered":"2024-05-30T16:41:55.456897+0000","last_clean":"2024-05-30T16:41:55.456897+0000","last_became_active":"2024-05-30T16:41:53.368153+0000","last_became_peered":"2024-05-30T16:41:53.368153+0000","last_unstale":"2024-05-30T16:41:55.456897+0000","last_undegraded":"2024-05-30T16:41:55.456897+0000","last_fullsized":"2024-05-30T16:41:55.456897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358440+0000","last_change":"2024-05-30T16:41:52.332967+0000","last_active":"2024-05-30T16:41:54.358440+0000","last_peered":"2024-05-30T16:41:54.358440+0000","last_clean":"2024-05-30T16:41:54.358440+0000","last_became_active":"2024-05-30T16:41:52.331825+0000","last_became_peered":"2024-05-30T16:41:52.331825+0000","last_unstale":"2024-05-30T16:41:54.358440+0000","last_undegraded":"2024-05-30T16:41:54.358440+0000","last_fullsized":"2024-05-30T16:41:54.358440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457891+0000","last_change":"2024-05-30T16:41:52.336306+0000","last_active":"2024-05-30T16:41:55.457891+0000","last_peered":"2024-05-30T16:41:55.457891+0000","last_clean":"2024-05-30T16:41:55.457891+0000","last_became_active":"2024-05-30T16:41:52.336007+0000","last_became_peered":"2024-05-30T16:41:52.336007+0000","last_unstale":"2024-05-30T16:41:55.457891+0000","last_undegraded":"2024-05-30T16:41:55.457891+0000","last_fullsized":"2024-05-30T16:41:55.457891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:49.630008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458336+0000","last_change":"2024-05-30T16:41:53.363846+0000","last_active":"2024-05-30T16:41:55.458336+0000","last_peered":"2024-05-30T16:41:55.458336+0000","last_clean":"2024-05-30T16:41:55.458336+0000","last_became_active":"2024-05-30T16:41:53.362819+0000","last_became_peered":"2024-05-30T16:41:53.362819+0000","last_unstale":"2024-05-30T16:41:55.458336+0000","last_undegraded":"2024-05-30T16:41:55.458336+0000","last_fullsized":"2024-05-30T16:41:55.458336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456693+0000","last_change":"2024-05-30T16:41:52.336486+0000","last_active":"2024-05-30T16:41:55.456693+0000","last_peered":"2024-05-30T16:41:55.456693+0000","last_clean":"2024-05-30T16:41:55.456693+0000","last_became_active":"2024-05-30T16:41:52.336188+0000","last_became_peered":"2024-05-30T16:41:52.336188+0000","last_unstale":"2024-05-30T16:41:55.456693+0000","last_undegraded":"2024-05-30T16:41:55.456693+0000","last_fullsized":"2024-05-30T16:41:55.456693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353589+0000","last_change":"2024-05-30T16:41:53.356908+0000","last_active":"2024-05-30T16:41:54.353589+0000","last_peered":"2024-05-30T16:41:54.353589+0000","last_clean":"2024-05-30T16:41:54.353589+0000","last_became_active":"2024-05-30T16:41:53.356604+0000","last_became_peered":"2024-05-30T16:41:53.356604+0000","last_unstale":"2024-05-30T16:41:54.353589+0000","last_undegraded":"2024-05-30T16:41:54.353589+0000","last_fullsized":"2024-05-30T16:41:54.353589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359167+0000","last_change":"2024-05-30T16:41:52.340551+0000","last_active":"2024-05-30T16:41:54.359167+0000","last_peered":"2024-05-30T16:41:54.359167+0000","last_clean":"2024-05-30T16:41:54.359167+0000","last_became_active":"2024-05-30T16:41:52.340249+0000","last_became_peered":"2024-05-30T16:41:52.340249+0000","last_unstale":"2024-05-30T16:41:54.359167+0000","last_undegraded":"2024-05-30T16:41:54.359167+0000","last_fullsized":"2024-05-30T16:41:54.359167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457084+0000","last_change":"2024-05-30T16:41:53.366735+0000","last_active":"2024-05-30T16:41:55.457084+0000","last_peered":"2024-05-30T16:41:55.457084+0000","last_clean":"2024-05-30T16:41:55.457084+0000","last_became_active":"2024-05-30T16:41:53.362673+0000","last_became_peered":"2024-05-30T16:41:53.362673+0000","last_unstale":"2024-05-30T16:41:55.457084+0000","last_undegraded":"2024-05-30T16:41:55.457084+0000","last_fullsized":"2024-05-30T16:41:55.457084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:20:22.765092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457368+0000","last_change":"2024-05-30T16:41:52.343438+0000","last_active":"2024-05-30T16:41:55.457368+0000","last_peered":"2024-05-30T16:41:55.457368+0000","last_clean":"2024-05-30T16:41:55.457368+0000","last_became_active":"2024-05-30T16:41:52.342914+0000","last_became_peered":"2024-05-30T16:41:52.342914+0000","last_unstale":"2024-05-30T16:41:55.457368+0000","last_undegraded":"2024-05-30T16:41:55.457368+0000","last_fullsized":"2024-05-30T16:41:55.457368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457494+0000","last_change":"2024-05-30T16:41:53.362708+0000","last_active":"2024-05-30T16:41:55.457494+0000","last_peered":"2024-05-30T16:41:55.457494+0000","last_clean":"2024-05-30T16:41:55.457494+0000","last_became_active":"2024-05-30T16:41:53.362383+0000","last_became_peered":"2024-05-30T16:41:53.362383+0000","last_unstale":"2024-05-30T16:41:55.457494+0000","last_undegraded":"2024-05-30T16:41:55.457494+0000","last_fullsized":"2024-05-30T16:41:55.457494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353856+0000","last_change":"2024-05-30T16:41:52.340849+0000","last_active":"2024-05-30T16:41:54.353856+0000","last_peered":"2024-05-30T16:41:54.353856+0000","last_clean":"2024-05-30T16:41:54.353856+0000","last_became_active":"2024-05-30T16:41:52.340475+0000","last_became_peered":"2024-05-30T16:41:52.340475+0000","last_unstale":"2024-05-30T16:41:54.353856+0000","last_undegraded":"2024-05-30T16:41:54.353856+0000","last_fullsized":"2024-05-30T16:41:54.353856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358021+0000","last_change":"2024-05-30T16:41:53.363781+0000","last_active":"2024-05-30T16:41:54.358021+0000","last_peered":"2024-05-30T16:41:54.358021+0000","last_clean":"2024-05-30T16:41:54.358021+0000","last_became_active":"2024-05-30T16:41:53.353193+0000","last_became_peered":"2024-05-30T16:41:53.353193+0000","last_unstale":"2024-05-30T16:41:54.358021+0000","last_undegraded":"2024-05-30T16:41:54.358021+0000","last_fullsized":"2024-05-30T16:41:54.358021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:50.511215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359109+0000","last_change":"2024-05-30T16:41:52.334473+0000","last_active":"2024-05-30T16:41:54.359109+0000","last_peered":"2024-05-30T16:41:54.359109+0000","last_clean":"2024-05-30T16:41:54.359109+0000","last_became_active":"2024-05-30T16:41:52.333867+0000","last_became_peered":"2024-05-30T16:41:52.333867+0000","last_unstale":"2024-05-30T16:41:54.359109+0000","last_undegraded":"2024-05-30T16:41:54.359109+0000","last_fullsized":"2024-05-30T16:41:54.359109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473028+0000","last_change":"2024-05-30T16:41:53.359385+0000","last_active":"2024-05-30T16:41:54.473028+0000","last_peered":"2024-05-30T16:41:54.473028+0000","last_clean":"2024-05-30T16:41:54.473028+0000","last_became_active":"2024-05-30T16:41:53.356569+0000","last_became_peered":"2024-05-30T16:41:53.356569+0000","last_unstale":"2024-05-30T16:41:54.473028+0000","last_undegraded":"2024-05-30T16:41:54.473028+0000","last_fullsized":"2024-05-30T16:41:54.473028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:37:50.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457082+0000","last_change":"2024-05-30T16:41:52.334576+0000","last_active":"2024-05-30T16:41:55.457082+0000","last_peered":"2024-05-30T16:41:55.457082+0000","last_clean":"2024-05-30T16:41:55.457082+0000","last_became_active":"2024-05-30T16:41:52.334243+0000","last_became_peered":"2024-05-30T16:41:52.334243+0000","last_unstale":"2024-05-30T16:41:55.457082+0000","last_undegraded":"2024-05-30T16:41:55.457082+0000","last_fullsized":"2024-05-30T16:41:55.457082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:31.649153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456742+0000","last_change":"2024-05-30T16:41:53.363700+0000","last_active":"2024-05-30T16:41:55.456742+0000","last_peered":"2024-05-30T16:41:55.456742+0000","last_clean":"2024-05-30T16:41:55.456742+0000","last_became_active":"2024-05-30T16:41:53.363109+0000","last_became_peered":"2024-05-30T16:41:53.363109+0000","last_unstale":"2024-05-30T16:41:55.456742+0000","last_undegraded":"2024-05-30T16:41:55.456742+0000","last_fullsized":"2024-05-30T16:41:55.456742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456745+0000","last_change":"2024-05-30T16:41:52.337819+0000","last_active":"2024-05-30T16:41:55.456745+0000","last_peered":"2024-05-30T16:41:55.456745+0000","last_clean":"2024-05-30T16:41:55.456745+0000","last_became_active":"2024-05-30T16:41:52.337487+0000","last_became_peered":"2024-05-30T16:41:52.337487+0000","last_unstale":"2024-05-30T16:41:55.456745+0000","last_undegraded":"2024-05-30T16:41:55.456745+0000","last_fullsized":"2024-05-30T16:41:55.456745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473171+0000","last_change":"2024-05-30T16:41:53.353545+0000","last_active":"2024-05-30T16:41:54.473171+0000","last_peered":"2024-05-30T16:41:54.473171+0000","last_clean":"2024-05-30T16:41:54.473171+0000","last_became_active":"2024-05-30T16:41:53.353247+0000","last_became_peered":"2024-05-30T16:41:53.353247+0000","last_unstale":"2024-05-30T16:41:54.473171+0000","last_undegraded":"2024-05-30T16:41:54.473171+0000","last_fullsized":"2024-05-30T16:41:54.473171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:12:07.999320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357907+0000","last_change":"2024-05-30T16:41:52.328980+0000","last_active":"2024-05-30T16:41:54.357907+0000","last_peered":"2024-05-30T16:41:54.357907+0000","last_clean":"2024-05-30T16:41:54.357907+0000","last_became_active":"2024-05-30T16:41:52.328652+0000","last_became_peered":"2024-05-30T16:41:52.328652+0000","last_unstale":"2024-05-30T16:41:54.357907+0000","last_undegraded":"2024-05-30T16:41:54.357907+0000","last_fullsized":"2024-05-30T16:41:54.357907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:23.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357940+0000","last_change":"2024-05-30T16:41:53.358880+0000","last_active":"2024-05-30T16:41:54.357940+0000","last_peered":"2024-05-30T16:41:54.357940+0000","last_clean":"2024-05-30T16:41:54.357940+0000","last_became_active":"2024-05-30T16:41:53.358285+0000","last_became_peered":"2024-05-30T16:41:53.358285+0000","last_unstale":"2024-05-30T16:41:54.357940+0000","last_undegraded":"2024-05-30T16:41:54.357940+0000","last_fullsized":"2024-05-30T16:41:54.357940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.294851+0000","last_change":"2024-05-30T16:41:52.328717+0000","last_active":"2024-05-30T16:41:55.294851+0000","last_peered":"2024-05-30T16:41:55.294851+0000","last_clean":"2024-05-30T16:41:55.294851+0000","last_became_active":"2024-05-30T16:41:52.328423+0000","last_became_peered":"2024-05-30T16:41:52.328423+0000","last_unstale":"2024-05-30T16:41:55.294851+0000","last_undegraded":"2024-05-30T16:41:55.294851+0000","last_fullsized":"2024-05-30T16:41:55.294851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:49.630008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472391+0000","last_change":"2024-05-30T16:41:53.341566+0000","last_active":"2024-05-30T16:41:54.472391+0000","last_peered":"2024-05-30T16:41:54.472391+0000","last_clean":"2024-05-30T16:41:54.472391+0000","last_became_active":"2024-05-30T16:41:53.341079+0000","last_became_peered":"2024-05-30T16:41:53.341079+0000","last_unstale":"2024-05-30T16:41:54.472391+0000","last_undegraded":"2024-05-30T16:41:54.472391+0000","last_fullsized":"2024-05-30T16:41:54.472391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:45.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358659+0000","last_change":"2024-05-30T16:41:52.332813+0000","last_active":"2024-05-30T16:41:54.358659+0000","last_peered":"2024-05-30T16:41:54.358659+0000","last_clean":"2024-05-30T16:41:54.358659+0000","last_became_active":"2024-05-30T16:41:52.332521+0000","last_became_peered":"2024-05-30T16:41:52.332521+0000","last_unstale":"2024-05-30T16:41:54.358659+0000","last_undegraded":"2024-05-30T16:41:54.358659+0000","last_fullsized":"2024-05-30T16:41:54.358659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:22.977875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473787+0000","last_change":"2024-05-30T16:41:53.344857+0000","last_active":"2024-05-30T16:41:54.473787+0000","last_peered":"2024-05-30T16:41:54.473787+0000","last_clean":"2024-05-30T16:41:54.473787+0000","last_became_active":"2024-05-30T16:41:53.344411+0000","last_became_peered":"2024-05-30T16:41:53.344411+0000","last_unstale":"2024-05-30T16:41:54.473787+0000","last_undegraded":"2024-05-30T16:41:54.473787+0000","last_fullsized":"2024-05-30T16:41:54.473787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:52.685260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295183+0000","last_change":"2024-05-30T16:41:52.325985+0000","last_active":"2024-05-30T16:41:55.295183+0000","last_peered":"2024-05-30T16:41:55.295183+0000","last_clean":"2024-05-30T16:41:55.295183+0000","last_became_active":"2024-05-30T16:41:52.324383+0000","last_became_peered":"2024-05-30T16:41:52.324383+0000","last_unstale":"2024-05-30T16:41:55.295183+0000","last_undegraded":"2024-05-30T16:41:55.295183+0000","last_fullsized":"2024-05-30T16:41:55.295183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.474204+0000","last_change":"2024-05-30T16:41:53.353421+0000","last_active":"2024-05-30T16:41:54.474204+0000","last_peered":"2024-05-30T16:41:54.474204+0000","last_clean":"2024-05-30T16:41:54.474204+0000","last_became_active":"2024-05-30T16:41:53.353121+0000","last_became_peered":"2024-05-30T16:41:53.353121+0000","last_unstale":"2024-05-30T16:41:54.474204+0000","last_undegraded":"2024-05-30T16:41:54.474204+0000","last_fullsized":"2024-05-30T16:41:54.474204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:04.081864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.354077+0000","last_change":"2024-05-30T16:41:52.338368+0000","last_active":"2024-05-30T16:41:54.354077+0000","last_peered":"2024-05-30T16:41:54.354077+0000","last_clean":"2024-05-30T16:41:54.354077+0000","last_became_active":"2024-05-30T16:41:52.338036+0000","last_became_peered":"2024-05-30T16:41:52.338036+0000","last_unstale":"2024-05-30T16:41:54.354077+0000","last_undegraded":"2024-05-30T16:41:54.354077+0000","last_fullsized":"2024-05-30T16:41:54.354077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:49.498732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457474+0000","last_change":"2024-05-30T16:41:53.375844+0000","last_active":"2024-05-30T16:41:55.457474+0000","last_peered":"2024-05-30T16:41:55.457474+0000","last_clean":"2024-05-30T16:41:55.457474+0000","last_became_active":"2024-05-30T16:41:53.375574+0000","last_became_peered":"2024-05-30T16:41:53.375574+0000","last_unstale":"2024-05-30T16:41:55.457474+0000","last_undegraded":"2024-05-30T16:41:55.457474+0000","last_fullsized":"2024-05-30T16:41:55.457474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:09.648137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295130+0000","last_change":"2024-05-30T16:41:52.340534+0000","last_active":"2024-05-30T16:41:55.295130+0000","last_peered":"2024-05-30T16:41:55.295130+0000","last_clean":"2024-05-30T16:41:55.295130+0000","last_became_active":"2024-05-30T16:41:52.340157+0000","last_became_peered":"2024-05-30T16:41:52.340157+0000","last_unstale":"2024-05-30T16:41:55.295130+0000","last_undegraded":"2024-05-30T16:41:55.295130+0000","last_fullsized":"2024-05-30T16:41:55.295130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473453+0000","last_change":"2024-05-30T16:41:53.361217+0000","last_active":"2024-05-30T16:41:54.473453+0000","last_peered":"2024-05-30T16:41:54.473453+0000","last_clean":"2024-05-30T16:41:54.473453+0000","last_became_active":"2024-05-30T16:41:53.360593+0000","last_became_peered":"2024-05-30T16:41:53.360593+0000","last_unstale":"2024-05-30T16:41:54.473453+0000","last_undegraded":"2024-05-30T16:41:54.473453+0000","last_fullsized":"2024-05-30T16:41:54.473453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:56:37.884273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472880+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:41:54.472880+0000","last_peered":"2024-05-30T16:41:54.472880+0000","last_clean":"2024-05-30T16:41:54.472880+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:41:54.472880+0000","last_undegraded":"2024-05-30T16:41:54.472880+0000","last_fullsized":"2024-05-30T16:41:54.472880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456903+0000","last_change":"2024-05-30T16:41:52.336314+0000","last_active":"2024-05-30T16:41:55.456903+0000","last_peered":"2024-05-30T16:41:55.456903+0000","last_clean":"2024-05-30T16:41:55.456903+0000","last_became_active":"2024-05-30T16:41:52.335990+0000","last_became_peered":"2024-05-30T16:41:52.335990+0000","last_unstale":"2024-05-30T16:41:55.456903+0000","last_undegraded":"2024-05-30T16:41:55.456903+0000","last_fullsized":"2024-05-30T16:41:55.456903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458465+0000","last_change":"2024-05-30T16:41:53.363616+0000","last_active":"2024-05-30T16:41:55.458465+0000","last_peered":"2024-05-30T16:41:55.458465+0000","last_clean":"2024-05-30T16:41:55.458465+0000","last_became_active":"2024-05-30T16:41:53.363275+0000","last_became_peered":"2024-05-30T16:41:53.363275+0000","last_unstale":"2024-05-30T16:41:55.458465+0000","last_undegraded":"2024-05-30T16:41:55.458465+0000","last_fullsized":"2024-05-30T16:41:55.458465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472306+0000","last_change":"2024-05-30T16:41:52.342846+0000","last_active":"2024-05-30T16:41:54.472306+0000","last_peered":"2024-05-30T16:41:54.472306+0000","last_clean":"2024-05-30T16:41:54.472306+0000","last_became_active":"2024-05-30T16:41:52.342435+0000","last_became_peered":"2024-05-30T16:41:52.342435+0000","last_unstale":"2024-05-30T16:41:54.472306+0000","last_undegraded":"2024-05-30T16:41:54.472306+0000","last_fullsized":"2024-05-30T16:41:54.472306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:12:46.572059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456543+0000","last_change":"2024-05-30T16:41:53.369256+0000","last_active":"2024-05-30T16:41:55.456543+0000","last_peered":"2024-05-30T16:41:55.456543+0000","last_clean":"2024-05-30T16:41:55.456543+0000","last_became_active":"2024-05-30T16:41:53.368938+0000","last_became_peered":"2024-05-30T16:41:53.368938+0000","last_unstale":"2024-05-30T16:41:55.456543+0000","last_undegraded":"2024-05-30T16:41:55.456543+0000","last_fullsized":"2024-05-30T16:41:55.456543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:11:06.050717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295411+0000","last_change":"2024-05-30T16:41:52.326607+0000","last_active":"2024-05-30T16:41:55.295411+0000","last_peered":"2024-05-30T16:41:55.295411+0000","last_clean":"2024-05-30T16:41:55.295411+0000","last_became_active":"2024-05-30T16:41:52.326202+0000","last_became_peered":"2024-05-30T16:41:52.326202+0000","last_unstale":"2024-05-30T16:41:55.295411+0000","last_undegraded":"2024-05-30T16:41:55.295411+0000","last_fullsized":"2024-05-30T16:41:55.295411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353720+0000","last_change":"2024-05-30T16:41:53.354056+0000","last_active":"2024-05-30T16:41:54.353720+0000","last_peered":"2024-05-30T16:41:54.353720+0000","last_clean":"2024-05-30T16:41:54.353720+0000","last_became_active":"2024-05-30T16:41:53.353806+0000","last_became_peered":"2024-05-30T16:41:53.353806+0000","last_unstale":"2024-05-30T16:41:54.353720+0000","last_undegraded":"2024-05-30T16:41:54.353720+0000","last_fullsized":"2024-05-30T16:41:54.353720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456837+0000","last_change":"2024-05-30T16:41:52.341003+0000","last_active":"2024-05-30T16:41:55.456837+0000","last_peered":"2024-05-30T16:41:55.456837+0000","last_clean":"2024-05-30T16:41:55.456837+0000","last_became_active":"2024-05-30T16:41:52.340199+0000","last_became_peered":"2024-05-30T16:41:52.340199+0000","last_unstale":"2024-05-30T16:41:55.456837+0000","last_undegraded":"2024-05-30T16:41:55.456837+0000","last_fullsized":"2024-05-30T16:41:55.456837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357559+0000","last_change":"2024-05-30T16:41:53.363426+0000","last_active":"2024-05-30T16:41:54.357559+0000","last_peered":"2024-05-30T16:41:54.357559+0000","last_clean":"2024-05-30T16:41:54.357559+0000","last_became_active":"2024-05-30T16:41:53.363167+0000","last_became_peered":"2024-05-30T16:41:53.363167+0000","last_unstale":"2024-05-30T16:41:54.357559+0000","last_undegraded":"2024-05-30T16:41:54.357559+0000","last_fullsized":"2024-05-30T16:41:54.357559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:26.300947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353566+0000","last_change":"2024-05-30T16:41:52.335162+0000","last_active":"2024-05-30T16:41:54.353566+0000","last_peered":"2024-05-30T16:41:54.353566+0000","last_clean":"2024-05-30T16:41:54.353566+0000","last_became_active":"2024-05-30T16:41:52.334870+0000","last_became_peered":"2024-05-30T16:41:52.334870+0000","last_unstale":"2024-05-30T16:41:54.353566+0000","last_undegraded":"2024-05-30T16:41:54.353566+0000","last_fullsized":"2024-05-30T16:41:54.353566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457197+0000","last_change":"2024-05-30T16:41:53.374678+0000","last_active":"2024-05-30T16:41:55.457197+0000","last_peered":"2024-05-30T16:41:55.457197+0000","last_clean":"2024-05-30T16:41:55.457197+0000","last_became_active":"2024-05-30T16:41:53.374417+0000","last_became_peered":"2024-05-30T16:41:53.374417+0000","last_unstale":"2024-05-30T16:41:55.457197+0000","last_undegraded":"2024-05-30T16:41:55.457197+0000","last_fullsized":"2024-05-30T16:41:55.457197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:45.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473652+0000","last_change":"2024-05-30T16:41:52.345422+0000","last_active":"2024-05-30T16:41:54.473652+0000","last_peered":"2024-05-30T16:41:54.473652+0000","last_clean":"2024-05-30T16:41:54.473652+0000","last_became_active":"2024-05-30T16:41:52.345025+0000","last_became_peered":"2024-05-30T16:41:52.345025+0000","last_unstale":"2024-05-30T16:41:54.473652+0000","last_undegraded":"2024-05-30T16:41:54.473652+0000","last_fullsized":"2024-05-30T16:41:54.473652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:55.167706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353496+0000","last_change":"2024-05-30T16:41:53.354570+0000","last_active":"2024-05-30T16:41:54.353496+0000","last_peered":"2024-05-30T16:41:54.353496+0000","last_clean":"2024-05-30T16:41:54.353496+0000","last_became_active":"2024-05-30T16:41:53.353658+0000","last_became_peered":"2024-05-30T16:41:53.353658+0000","last_unstale":"2024-05-30T16:41:54.353496+0000","last_undegraded":"2024-05-30T16:41:54.353496+0000","last_fullsized":"2024-05-30T16:41:54.353496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.365566+0000","last_change":"2024-05-30T16:41:52.335427+0000","last_active":"2024-05-30T16:41:54.365566+0000","last_peered":"2024-05-30T16:41:54.365566+0000","last_clean":"2024-05-30T16:41:54.365566+0000","last_became_active":"2024-05-30T16:41:52.334938+0000","last_became_peered":"2024-05-30T16:41:52.334938+0000","last_unstale":"2024-05-30T16:41:54.365566+0000","last_undegraded":"2024-05-30T16:41:54.365566+0000","last_fullsized":"2024-05-30T16:41:54.365566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459967+0000","last_change":"2024-05-30T16:41:53.350035+0000","last_active":"2024-05-30T16:41:55.459967+0000","last_peered":"2024-05-30T16:41:55.459967+0000","last_clean":"2024-05-30T16:41:55.459967+0000","last_became_active":"2024-05-30T16:41:53.349514+0000","last_became_peered":"2024-05-30T16:41:53.349514+0000","last_unstale":"2024-05-30T16:41:55.459967+0000","last_undegraded":"2024-05-30T16:41:55.459967+0000","last_fullsized":"2024-05-30T16:41:55.459967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359122+0000","last_change":"2024-05-30T16:41:52.343555+0000","last_active":"2024-05-30T16:41:54.359122+0000","last_peered":"2024-05-30T16:41:54.359122+0000","last_clean":"2024-05-30T16:41:54.359122+0000","last_became_active":"2024-05-30T16:41:52.342980+0000","last_became_peered":"2024-05-30T16:41:52.342980+0000","last_unstale":"2024-05-30T16:41:54.359122+0000","last_undegraded":"2024-05-30T16:41:54.359122+0000","last_fullsized":"2024-05-30T16:41:54.359122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:49.498732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457706+0000","last_change":"2024-05-30T16:41:53.365631+0000","last_active":"2024-05-30T16:41:55.457706+0000","last_peered":"2024-05-30T16:41:55.457706+0000","last_clean":"2024-05-30T16:41:55.457706+0000","last_became_active":"2024-05-30T16:41:53.357804+0000","last_became_peered":"2024-05-30T16:41:53.357804+0000","last_unstale":"2024-05-30T16:41:55.457706+0000","last_undegraded":"2024-05-30T16:41:55.457706+0000","last_fullsized":"2024-05-30T16:41:55.457706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472293+0000","last_change":"2024-05-30T16:41:52.340095+0000","last_active":"2024-05-30T16:41:54.472293+0000","last_peered":"2024-05-30T16:41:54.472293+0000","last_clean":"2024-05-30T16:41:54.472293+0000","last_became_active":"2024-05-30T16:41:52.339769+0000","last_became_peered":"2024-05-30T16:41:52.339769+0000","last_unstale":"2024-05-30T16:41:54.472293+0000","last_undegraded":"2024-05-30T16:41:54.472293+0000","last_fullsized":"2024-05-30T16:41:54.472293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:16:18.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357172+0000","last_change":"2024-05-30T16:41:53.359564+0000","last_active":"2024-05-30T16:41:54.357172+0000","last_peered":"2024-05-30T16:41:54.357172+0000","last_clean":"2024-05-30T16:41:54.357172+0000","last_became_active":"2024-05-30T16:41:53.358733+0000","last_became_peered":"2024-05-30T16:41:53.358733+0000","last_unstale":"2024-05-30T16:41:54.357172+0000","last_undegraded":"2024-05-30T16:41:54.357172+0000","last_fullsized":"2024-05-30T16:41:54.357172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:50.153923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353727+0000","last_change":"2024-05-30T16:41:52.340268+0000","last_active":"2024-05-30T16:41:54.353727+0000","last_peered":"2024-05-30T16:41:54.353727+0000","last_clean":"2024-05-30T16:41:54.353727+0000","last_became_active":"2024-05-30T16:41:52.339896+0000","last_became_peered":"2024-05-30T16:41:52.339896+0000","last_unstale":"2024-05-30T16:41:54.353727+0000","last_undegraded":"2024-05-30T16:41:54.353727+0000","last_fullsized":"2024-05-30T16:41:54.353727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458359+0000","last_change":"2024-05-30T16:41:53.351989+0000","last_active":"2024-05-30T16:41:55.458359+0000","last_peered":"2024-05-30T16:41:55.458359+0000","last_clean":"2024-05-30T16:41:55.458359+0000","last_became_active":"2024-05-30T16:41:53.351579+0000","last_became_peered":"2024-05-30T16:41:53.351579+0000","last_unstale":"2024-05-30T16:41:55.458359+0000","last_undegraded":"2024-05-30T16:41:55.458359+0000","last_fullsized":"2024-05-30T16:41:55.458359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353390+0000","last_change":"2024-05-30T16:41:52.330661+0000","last_active":"2024-05-30T16:41:54.353390+0000","last_peered":"2024-05-30T16:41:54.353390+0000","last_clean":"2024-05-30T16:41:54.353390+0000","last_became_active":"2024-05-30T16:41:52.330239+0000","last_became_peered":"2024-05-30T16:41:52.330239+0000","last_unstale":"2024-05-30T16:41:54.353390+0000","last_undegraded":"2024-05-30T16:41:54.353390+0000","last_fullsized":"2024-05-30T16:41:54.353390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:23.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459438+0000","last_change":"2024-05-30T16:41:53.365561+0000","last_active":"2024-05-30T16:41:55.459438+0000","last_peered":"2024-05-30T16:41:55.459438+0000","last_clean":"2024-05-30T16:41:55.459438+0000","last_became_active":"2024-05-30T16:41:53.363963+0000","last_became_peered":"2024-05-30T16:41:53.363963+0000","last_unstale":"2024-05-30T16:41:55.459438+0000","last_undegraded":"2024-05-30T16:41:55.459438+0000","last_fullsized":"2024-05-30T16:41:55.459438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473668+0000","last_change":"2024-05-30T16:41:52.344910+0000","last_active":"2024-05-30T16:41:54.473668+0000","last_peered":"2024-05-30T16:41:54.473668+0000","last_clean":"2024-05-30T16:41:54.473668+0000","last_became_active":"2024-05-30T16:41:52.344564+0000","last_became_peered":"2024-05-30T16:41:52.344564+0000","last_unstale":"2024-05-30T16:41:54.473668+0000","last_undegraded":"2024-05-30T16:41:54.473668+0000","last_fullsized":"2024-05-30T16:41:54.473668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:11:05.038234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358176+0000","last_change":"2024-05-30T16:41:53.361266+0000","last_active":"2024-05-30T16:41:54.358176+0000","last_peered":"2024-05-30T16:41:54.358176+0000","last_clean":"2024-05-30T16:41:54.358176+0000","last_became_active":"2024-05-30T16:41:53.360980+0000","last_became_peered":"2024-05-30T16:41:53.360980+0000","last_unstale":"2024-05-30T16:41:54.358176+0000","last_undegraded":"2024-05-30T16:41:54.358176+0000","last_fullsized":"2024-05-30T16:41:54.358176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457189+0000","last_change":"2024-05-30T16:41:53.370166+0000","last_active":"2024-05-30T16:41:55.457189+0000","last_peered":"2024-05-30T16:41:55.457189+0000","last_clean":"2024-05-30T16:41:55.457189+0000","last_became_active":"2024-05-30T16:41:53.369830+0000","last_became_peered":"2024-05-30T16:41:53.369830+0000","last_unstale":"2024-05-30T16:41:55.457189+0000","last_undegraded":"2024-05-30T16:41:55.457189+0000","last_fullsized":"2024-05-30T16:41:55.457189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:08:24.828674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472946+0000","last_change":"2024-05-30T16:41:52.342853+0000","last_active":"2024-05-30T16:41:54.472946+0000","last_peered":"2024-05-30T16:41:54.472946+0000","last_clean":"2024-05-30T16:41:54.472946+0000","last_became_active":"2024-05-30T16:41:52.342459+0000","last_became_peered":"2024-05-30T16:41:52.342459+0000","last_unstale":"2024-05-30T16:41:54.472946+0000","last_undegraded":"2024-05-30T16:41:54.472946+0000","last_fullsized":"2024-05-30T16:41:54.472946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:52:34.598062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457125+0000","last_change":"2024-05-30T16:41:53.367020+0000","last_active":"2024-05-30T16:41:55.457125+0000","last_peered":"2024-05-30T16:41:55.457125+0000","last_clean":"2024-05-30T16:41:55.457125+0000","last_became_active":"2024-05-30T16:41:53.366745+0000","last_became_peered":"2024-05-30T16:41:53.366745+0000","last_unstale":"2024-05-30T16:41:55.457125+0000","last_undegraded":"2024-05-30T16:41:55.457125+0000","last_fullsized":"2024-05-30T16:41:55.457125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:35:37.949106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473358+0000","last_change":"2024-05-30T16:41:52.343170+0000","last_active":"2024-05-30T16:41:54.473358+0000","last_peered":"2024-05-30T16:41:54.473358+0000","last_clean":"2024-05-30T16:41:54.473358+0000","last_became_active":"2024-05-30T16:41:52.342743+0000","last_became_peered":"2024-05-30T16:41:52.342743+0000","last_unstale":"2024-05-30T16:41:54.473358+0000","last_undegraded":"2024-05-30T16:41:54.473358+0000","last_fullsized":"2024-05-30T16:41:54.473358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:02.431665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457471+0000","last_change":"2024-05-30T16:41:53.364283+0000","last_active":"2024-05-30T16:41:55.457471+0000","last_peered":"2024-05-30T16:41:55.457471+0000","last_clean":"2024-05-30T16:41:55.457471+0000","last_became_active":"2024-05-30T16:41:53.362510+0000","last_became_peered":"2024-05-30T16:41:53.362510+0000","last_unstale":"2024-05-30T16:41:55.457471+0000","last_undegraded":"2024-05-30T16:41:55.457471+0000","last_fullsized":"2024-05-30T16:41:55.457471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.460118+0000","last_change":"2024-05-30T16:41:52.333188+0000","last_active":"2024-05-30T16:41:55.460118+0000","last_peered":"2024-05-30T16:41:55.460118+0000","last_clean":"2024-05-30T16:41:55.460118+0000","last_became_active":"2024-05-30T16:41:52.332987+0000","last_became_peered":"2024-05-30T16:41:52.332987+0000","last_unstale":"2024-05-30T16:41:55.460118+0000","last_undegraded":"2024-05-30T16:41:55.460118+0000","last_fullsized":"2024-05-30T16:41:55.460118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.460122+0000","last_change":"2024-05-30T16:41:53.360296+0000","last_active":"2024-05-30T16:41:55.460122+0000","last_peered":"2024-05-30T16:41:55.460122+0000","last_clean":"2024-05-30T16:41:55.460122+0000","last_became_active":"2024-05-30T16:41:53.360008+0000","last_became_peered":"2024-05-30T16:41:53.360008+0000","last_unstale":"2024-05-30T16:41:55.460122+0000","last_undegraded":"2024-05-30T16:41:55.460122+0000","last_fullsized":"2024-05-30T16:41:55.460122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:11.943106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457581+0000","last_change":"2024-05-30T16:41:52.337440+0000","last_active":"2024-05-30T16:41:55.457581+0000","last_peered":"2024-05-30T16:41:55.457581+0000","last_clean":"2024-05-30T16:41:55.457581+0000","last_became_active":"2024-05-30T16:41:52.337136+0000","last_became_peered":"2024-05-30T16:41:52.337136+0000","last_unstale":"2024-05-30T16:41:55.457581+0000","last_undegraded":"2024-05-30T16:41:55.457581+0000","last_fullsized":"2024-05-30T16:41:55.457581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:17.345557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:42:03.085 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:42:03.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.317+0000 7fc6fd400640 1 Processor -- start 2024-05-30T16:42:03.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.317+0000 7fc6fd400640 1 -- start start 2024-05-30T16:42:03.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.318+0000 7fc6fd400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc6f80caf10 0x7fc6f815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.318+0000 7fc6fd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f80cb2f0 0x7fc6f815c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6fd400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f815f500 con 0x7fc6f815c780 2024-05-30T16:42:03.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6fd400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc6f815f780 con 0x7fc6f80caf10 2024-05-30T16:42:03.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6fd400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f815fa60 con 0x7fc6f80cb2f0 2024-05-30T16:42:03.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6f7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc6f80caf10 0x7fc6f815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:03.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6f7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc6f80caf10 0x7fc6f815efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59100/0 (socket says 172.21.15.144:59100) 2024-05-30T16:42:03.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6f7e00640 1 -- 172.21.15.144:0/807274672 learned_addr learned my addr 172.21.15.144:0/807274672 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:03.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6f7e00640 1 -- 172.21.15.144:0/807274672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f80cb2f0 msgr2=0x7fc6f815c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:03.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6f7e00640 1 --2- 172.21.15.144:0/807274672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f80cb2f0 0x7fc6f815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6f7e00640 1 -- 172.21.15.144:0/807274672 >> v1:172.21.15.149:6789/0 conn(0x7fc6f815c780 legacy=0x7fc6f80b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:03.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.319+0000 7fc6f7e00640 1 -- 172.21.15.144:0/807274672 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f815fd40 con 0x7fc6f80caf10 2024-05-30T16:42:03.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.320+0000 7fc6f7e00640 1 --2- 172.21.15.144:0/807274672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 0x7fc6f815efc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800bb10 tx=0x7fc6e802c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892070e83d29b343 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:03.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.320+0000 7fc6f6a00640 1 -- 172.21.15.144:0/807274672 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8032780 con 0x7fc6f80caf10 2024-05-30T16:42:03.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.320+0000 7fc6f6a00640 1 -- 172.21.15.144:0/807274672 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e8038070 con 0x7fc6f80caf10 2024-05-30T16:42:03.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.320+0000 7fc6f6a00640 1 -- 172.21.15.144:0/807274672 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8032b40 con 0x7fc6f80caf10 2024-05-30T16:42:03.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.321+0000 7fc6fd400640 1 -- 172.21.15.144:0/807274672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 msgr2=0x7fc6f815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.321+0000 7fc6fd400640 1 --2- 172.21.15.144:0/807274672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 0x7fc6f815efc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800bb10 tx=0x7fc6e802c8c0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.321+0000 7fc6fd400640 1 -- 172.21.15.144:0/807274672 shutdown_connections 2024-05-30T16:42:03.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.321+0000 7fc6fd400640 1 --2- 172.21.15.144:0/807274672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f80cb2f0 0x7fc6f815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.321+0000 7fc6fd400640 1 --2- 172.21.15.144:0/807274672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 0x7fc6f815efc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.321+0000 7fc6fd400640 1 -- 172.21.15.144:0/807274672 >> 172.21.15.144:0/807274672 conn(0x7fc6f80b20a0 msgr2=0x7fc6f80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:03.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.321+0000 7fc6fd400640 1 -- 172.21.15.144:0/807274672 shutdown_connections 2024-05-30T16:42:03.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.321+0000 7fc6fd400640 1 -- 172.21.15.144:0/807274672 wait complete. 2024-05-30T16:42:03.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.323+0000 7fc6fd400640 1 Processor -- start 2024-05-30T16:42:03.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.323+0000 7fc6fd400640 1 -- start start 2024-05-30T16:42:03.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6fd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 0x7fc6f80c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6fd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6f80cb2f0 0x7fc6f80adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6fd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f815c780 0x7fc6f81552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6fd400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80b3a50 con 0x7fc6f80caf10 2024-05-30T16:42:03.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6fd400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80b38d0 con 0x7fc6f80cb2f0 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6fd400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f81f4380 con 0x7fc6f815c780 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6f7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 0x7fc6f80c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6f7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 0x7fc6f80c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59108/0 (socket says 172.21.15.144:59108) 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6f7e00640 1 -- 172.21.15.144:0/3942783993 learned_addr learned my addr 172.21.15.144:0/3942783993 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6f7e00640 1 -- 172.21.15.144:0/3942783993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f815c780 msgr2=0x7fc6f81552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6f7e00640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f815c780 0x7fc6f81552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6f7e00640 1 -- 172.21.15.144:0/3942783993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6f80cb2f0 msgr2=0x7fc6f80adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6f7e00640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6f80cb2f0 0x7fc6f80adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.324+0000 7fc6f7e00640 1 -- 172.21.15.144:0/3942783993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f80ae950 con 0x7fc6f80caf10 2024-05-30T16:42:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.325+0000 7fc6f7e00640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 0x7fc6f80c97b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800b2c0 tx=0x7fc6e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.325+0000 7fc6efe00640 1 -- 172.21.15.144:0/3942783993 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8043070 con 0x7fc6f80caf10 2024-05-30T16:42:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.325+0000 7fc6efe00640 1 -- 172.21.15.144:0/3942783993 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e8033c70 con 0x7fc6f80caf10 2024-05-30T16:42:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.325+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f81f45d0 con 0x7fc6f80caf10 2024-05-30T16:42:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.325+0000 7fc6efe00640 1 -- 172.21.15.144:0/3942783993 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e803c660 con 0x7fc6f80caf10 2024-05-30T16:42:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.325+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f80c9cf0 con 0x7fc6f80caf10 2024-05-30T16:42:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.326+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f8075570 con 0x7fc6f80caf10 2024-05-30T16:42:03.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.327+0000 7fc6efe00640 1 -- 172.21.15.144:0/3942783993 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6e8046070 con 0x7fc6f80caf10 2024-05-30T16:42:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.328+0000 7fc6efe00640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc6d806c8f0 0x7fc6d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.328+0000 7fc6efe00640 1 -- 172.21.15.144:0/3942783993 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc6e80ac7c0 con 0x7fc6f80caf10 2024-05-30T16:42:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.328+0000 7fc6f7400640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc6d806c8f0 0x7fc6d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.329+0000 7fc6f7400640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc6d806c8f0 0x7fc6d806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc6f806dfb0 tx=0x7fc6e4006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:03.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.332+0000 7fc6efe00640 1 -- 172.21.15.144:0/3942783993 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6e8030050 con 0x7fc6f80caf10 2024-05-30T16:42:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.518+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6f80b5000 con 0x7fc6d806c8f0 2024-05-30T16:42:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.526+0000 7fc6efe00640 1 -- 172.21.15.144:0/3942783993 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fc6f80b5000 con 0x7fc6d806c8f0 2024-05-30T16:42:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:42:03.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc6d806c8f0 msgr2=0x7fc6d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc6d806c8f0 0x7fc6d806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc6f806dfb0 tx=0x7fc6e4006c90 comp rx=0 tx=0).stop 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 msgr2=0x7fc6f80c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 0x7fc6f80c97b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800b2c0 tx=0x7fc6e8004730 comp rx=0 tx=0).stop 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 shutdown_connections 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc6d806c8f0 0x7fc6d806edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f815c780 0x7fc6f81552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6f80cb2f0 0x7fc6f80adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 --2- 172.21.15.144:0/3942783993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6f80caf10 0x7fc6f80c97b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 >> 172.21.15.144:0/3942783993 conn(0x7fc6f80b20a0 msgr2=0x7fc6f815d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 shutdown_connections 2024-05-30T16:42:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.533+0000 7fc6fd400640 1 -- 172.21.15.144:0/3942783993 wait complete. 2024-05-30T16:42:03.552 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-30T16:42:02.895904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.572490"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473939+0000","last_change":"2024-05-30T16:41:53.357304+0000","last_active":"2024-05-30T16:41:54.473939+0000","last_peered":"2024-05-30T16:41:54.473939+0000","last_clean":"2024-05-30T16:41:54.473939+0000","last_became_active":"2024-05-30T16:41:53.356937+0000","last_became_peered":"2024-05-30T16:41:53.356937+0000","last_unstale":"2024-05-30T16:41:54.473939+0000","last_undegraded":"2024-05-30T16:41:54.473939+0000","last_fullsized":"2024-05-30T16:41:54.473939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:04.325790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353623+0000","last_change":"2024-05-30T16:41:53.368919+0000","last_active":"2024-05-30T16:41:54.353623+0000","last_peered":"2024-05-30T16:41:54.353623+0000","last_clean":"2024-05-30T16:41:54.353623+0000","last_became_active":"2024-05-30T16:41:53.368598+0000","last_became_peered":"2024-05-30T16:41:53.368598+0000","last_unstale":"2024-05-30T16:41:54.353623+0000","last_undegraded":"2024-05-30T16:41:54.353623+0000","last_fullsized":"2024-05-30T16:41:54.353623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457349+0000","last_change":"2024-05-30T16:41:53.360032+0000","last_active":"2024-05-30T16:41:55.457349+0000","last_peered":"2024-05-30T16:41:55.457349+0000","last_clean":"2024-05-30T16:41:55.457349+0000","last_became_active":"2024-05-30T16:41:53.353909+0000","last_became_peered":"2024-05-30T16:41:53.353909+0000","last_unstale":"2024-05-30T16:41:55.457349+0000","last_undegraded":"2024-05-30T16:41:55.457349+0000","last_fullsized":"2024-05-30T16:41:55.457349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456943+0000","last_change":"2024-05-30T16:41:53.375331+0000","last_active":"2024-05-30T16:41:55.456943+0000","last_peered":"2024-05-30T16:41:55.456943+0000","last_clean":"2024-05-30T16:41:55.456943+0000","last_became_active":"2024-05-30T16:41:53.375049+0000","last_became_peered":"2024-05-30T16:41:53.375049+0000","last_unstale":"2024-05-30T16:41:55.456943+0000","last_undegraded":"2024-05-30T16:41:55.456943+0000","last_fullsized":"2024-05-30T16:41:55.456943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:11.943106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473149+0000","last_change":"2024-05-30T16:41:53.360193+0000","last_active":"2024-05-30T16:41:54.473149+0000","last_peered":"2024-05-30T16:41:54.473149+0000","last_clean":"2024-05-30T16:41:54.473149+0000","last_became_active":"2024-05-30T16:41:53.356390+0000","last_became_peered":"2024-05-30T16:41:53.356390+0000","last_unstale":"2024-05-30T16:41:54.473149+0000","last_undegraded":"2024-05-30T16:41:54.473149+0000","last_fullsized":"2024-05-30T16:41:54.473149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:01:25.890627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456576+0000","last_change":"2024-05-30T16:41:53.363129+0000","last_active":"2024-05-30T16:41:55.456576+0000","last_peered":"2024-05-30T16:41:55.456576+0000","last_clean":"2024-05-30T16:41:55.456576+0000","last_became_active":"2024-05-30T16:41:53.362799+0000","last_became_peered":"2024-05-30T16:41:53.362799+0000","last_unstale":"2024-05-30T16:41:55.456576+0000","last_undegraded":"2024-05-30T16:41:55.456576+0000","last_fullsized":"2024-05-30T16:41:55.456576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472403+0000","last_change":"2024-05-30T16:41:53.354731+0000","last_active":"2024-05-30T16:41:54.472403+0000","last_peered":"2024-05-30T16:41:54.472403+0000","last_clean":"2024-05-30T16:41:54.472403+0000","last_became_active":"2024-05-30T16:41:53.354407+0000","last_became_peered":"2024-05-30T16:41:53.354407+0000","last_unstale":"2024-05-30T16:41:54.472403+0000","last_undegraded":"2024-05-30T16:41:54.472403+0000","last_fullsized":"2024-05-30T16:41:54.472403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:09.648137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457945+0000","last_change":"2024-05-30T16:41:53.364759+0000","last_active":"2024-05-30T16:41:55.457945+0000","last_peered":"2024-05-30T16:41:55.457945+0000","last_clean":"2024-05-30T16:41:55.457945+0000","last_became_active":"2024-05-30T16:41:53.363544+0000","last_became_peered":"2024-05-30T16:41:53.363544+0000","last_unstale":"2024-05-30T16:41:55.457945+0000","last_undegraded":"2024-05-30T16:41:55.457945+0000","last_fullsized":"2024-05-30T16:41:55.457945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473887+0000","last_change":"2024-05-30T16:41:53.361800+0000","last_active":"2024-05-30T16:41:54.473887+0000","last_peered":"2024-05-30T16:41:54.473887+0000","last_clean":"2024-05-30T16:41:54.473887+0000","last_became_active":"2024-05-30T16:41:53.361517+0000","last_became_peered":"2024-05-30T16:41:53.361517+0000","last_unstale":"2024-05-30T16:41:54.473887+0000","last_undegraded":"2024-05-30T16:41:54.473887+0000","last_fullsized":"2024-05-30T16:41:54.473887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:11.893893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359310+0000","last_change":"2024-05-30T16:41:53.357190+0000","last_active":"2024-05-30T16:41:54.359310+0000","last_peered":"2024-05-30T16:41:54.359310+0000","last_clean":"2024-05-30T16:41:54.359310+0000","last_became_active":"2024-05-30T16:41:53.355805+0000","last_became_peered":"2024-05-30T16:41:53.355805+0000","last_unstale":"2024-05-30T16:41:54.359310+0000","last_undegraded":"2024-05-30T16:41:54.359310+0000","last_fullsized":"2024-05-30T16:41:54.359310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358896+0000","last_change":"2024-05-30T16:41:53.362431+0000","last_active":"2024-05-30T16:41:54.358896+0000","last_peered":"2024-05-30T16:41:54.358896+0000","last_clean":"2024-05-30T16:41:54.358896+0000","last_became_active":"2024-05-30T16:41:53.362046+0000","last_became_peered":"2024-05-30T16:41:53.362046+0000","last_unstale":"2024-05-30T16:41:54.358896+0000","last_undegraded":"2024-05-30T16:41:54.358896+0000","last_fullsized":"2024-05-30T16:41:54.358896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358108+0000","last_change":"2024-05-30T16:41:53.365227+0000","last_active":"2024-05-30T16:41:54.358108+0000","last_peered":"2024-05-30T16:41:54.358108+0000","last_clean":"2024-05-30T16:41:54.358108+0000","last_became_active":"2024-05-30T16:41:53.361257+0000","last_became_peered":"2024-05-30T16:41:53.361257+0000","last_unstale":"2024-05-30T16:41:54.358108+0000","last_undegraded":"2024-05-30T16:41:54.358108+0000","last_fullsized":"2024-05-30T16:41:54.358108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:24.316502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459058+0000","last_change":"2024-05-30T16:41:53.363327+0000","last_active":"2024-05-30T16:41:55.459058+0000","last_peered":"2024-05-30T16:41:55.459058+0000","last_clean":"2024-05-30T16:41:55.459058+0000","last_became_active":"2024-05-30T16:41:53.358909+0000","last_became_peered":"2024-05-30T16:41:53.358909+0000","last_unstale":"2024-05-30T16:41:55.459058+0000","last_undegraded":"2024-05-30T16:41:55.459058+0000","last_fullsized":"2024-05-30T16:41:55.459058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456449+0000","last_change":"2024-05-30T16:41:53.349858+0000","last_active":"2024-05-30T16:41:55.456449+0000","last_peered":"2024-05-30T16:41:55.456449+0000","last_clean":"2024-05-30T16:41:55.456449+0000","last_became_active":"2024-05-30T16:41:53.349503+0000","last_became_peered":"2024-05-30T16:41:53.349503+0000","last_unstale":"2024-05-30T16:41:55.456449+0000","last_undegraded":"2024-05-30T16:41:55.456449+0000","last_fullsized":"2024-05-30T16:41:55.456449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:16:19.914867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353871+0000","last_change":"2024-05-30T16:41:53.361644+0000","last_active":"2024-05-30T16:41:54.353871+0000","last_peered":"2024-05-30T16:41:54.353871+0000","last_clean":"2024-05-30T16:41:54.353871+0000","last_became_active":"2024-05-30T16:41:53.361338+0000","last_became_peered":"2024-05-30T16:41:53.361338+0000","last_unstale":"2024-05-30T16:41:54.353871+0000","last_undegraded":"2024-05-30T16:41:54.353871+0000","last_fullsized":"2024-05-30T16:41:54.353871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456639+0000","last_change":"2024-05-30T16:41:53.360331+0000","last_active":"2024-05-30T16:41:55.456639+0000","last_peered":"2024-05-30T16:41:55.456639+0000","last_clean":"2024-05-30T16:41:55.456639+0000","last_became_active":"2024-05-30T16:41:53.359832+0000","last_became_peered":"2024-05-30T16:41:53.359832+0000","last_unstale":"2024-05-30T16:41:55.456639+0000","last_undegraded":"2024-05-30T16:41:55.456639+0000","last_fullsized":"2024-05-30T16:41:55.456639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457756+0000","last_change":"2024-05-30T16:41:53.368792+0000","last_active":"2024-05-30T16:41:55.457756+0000","last_peered":"2024-05-30T16:41:55.457756+0000","last_clean":"2024-05-30T16:41:55.457756+0000","last_became_active":"2024-05-30T16:41:53.368547+0000","last_became_peered":"2024-05-30T16:41:53.368547+0000","last_unstale":"2024-05-30T16:41:55.457756+0000","last_undegraded":"2024-05-30T16:41:55.457756+0000","last_fullsized":"2024-05-30T16:41:55.457756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:37:50.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295237+0000","last_change":"2024-05-30T16:41:53.356728+0000","last_active":"2024-05-30T16:41:55.295237+0000","last_peered":"2024-05-30T16:41:55.295237+0000","last_clean":"2024-05-30T16:41:55.295237+0000","last_became_active":"2024-05-30T16:41:53.356161+0000","last_became_peered":"2024-05-30T16:41:53.356161+0000","last_unstale":"2024-05-30T16:41:55.295237+0000","last_undegraded":"2024-05-30T16:41:55.295237+0000","last_fullsized":"2024-05-30T16:41:55.295237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:24.316502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473885+0000","last_change":"2024-05-30T16:41:53.352155+0000","last_active":"2024-05-30T16:41:54.473885+0000","last_peered":"2024-05-30T16:41:54.473885+0000","last_clean":"2024-05-30T16:41:54.473885+0000","last_became_active":"2024-05-30T16:41:53.348922+0000","last_became_peered":"2024-05-30T16:41:53.348922+0000","last_unstale":"2024-05-30T16:41:54.473885+0000","last_undegraded":"2024-05-30T16:41:54.473885+0000","last_fullsized":"2024-05-30T16:41:54.473885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:05.861936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358757+0000","last_change":"2024-05-30T16:41:53.373040+0000","last_active":"2024-05-30T16:41:54.358757+0000","last_peered":"2024-05-30T16:41:54.358757+0000","last_clean":"2024-05-30T16:41:54.358757+0000","last_became_active":"2024-05-30T16:41:53.372775+0000","last_became_peered":"2024-05-30T16:41:53.372775+0000","last_unstale":"2024-05-30T16:41:54.358757+0000","last_undegraded":"2024-05-30T16:41:54.358757+0000","last_fullsized":"2024-05-30T16:41:54.358757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456552+0000","last_change":"2024-05-30T16:41:53.363158+0000","last_active":"2024-05-30T16:41:55.456552+0000","last_peered":"2024-05-30T16:41:55.456552+0000","last_clean":"2024-05-30T16:41:55.456552+0000","last_became_active":"2024-05-30T16:41:53.362828+0000","last_became_peered":"2024-05-30T16:41:53.362828+0000","last_unstale":"2024-05-30T16:41:55.456552+0000","last_undegraded":"2024-05-30T16:41:55.456552+0000","last_fullsized":"2024-05-30T16:41:55.456552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:52:35.610545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456637+0000","last_change":"2024-05-30T16:41:53.370806+0000","last_active":"2024-05-30T16:41:55.456637+0000","last_peered":"2024-05-30T16:41:55.456637+0000","last_clean":"2024-05-30T16:41:55.456637+0000","last_became_active":"2024-05-30T16:41:53.369787+0000","last_became_peered":"2024-05-30T16:41:53.369787+0000","last_unstale":"2024-05-30T16:41:55.456637+0000","last_undegraded":"2024-05-30T16:41:55.456637+0000","last_fullsized":"2024-05-30T16:41:55.456637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457726+0000","last_change":"2024-05-30T16:41:53.362039+0000","last_active":"2024-05-30T16:41:55.457726+0000","last_peered":"2024-05-30T16:41:55.457726+0000","last_clean":"2024-05-30T16:41:55.457726+0000","last_became_active":"2024-05-30T16:41:53.361725+0000","last_became_peered":"2024-05-30T16:41:53.361725+0000","last_unstale":"2024-05-30T16:41:55.457726+0000","last_undegraded":"2024-05-30T16:41:55.457726+0000","last_fullsized":"2024-05-30T16:41:55.457726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:03.444148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456547+0000","last_change":"2024-05-30T16:41:53.360122+0000","last_active":"2024-05-30T16:41:55.456547+0000","last_peered":"2024-05-30T16:41:55.456547+0000","last_clean":"2024-05-30T16:41:55.456547+0000","last_became_active":"2024-05-30T16:41:53.359414+0000","last_became_peered":"2024-05-30T16:41:53.359414+0000","last_unstale":"2024-05-30T16:41:55.456547+0000","last_undegraded":"2024-05-30T16:41:55.456547+0000","last_fullsized":"2024-05-30T16:41:55.456547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459845+0000","last_change":"2024-05-30T16:41:53.354023+0000","last_active":"2024-05-30T16:41:55.459845+0000","last_peered":"2024-05-30T16:41:55.459845+0000","last_clean":"2024-05-30T16:41:55.459845+0000","last_became_active":"2024-05-30T16:41:53.352390+0000","last_became_peered":"2024-05-30T16:41:53.352390+0000","last_unstale":"2024-05-30T16:41:55.459845+0000","last_undegraded":"2024-05-30T16:41:55.459845+0000","last_fullsized":"2024-05-30T16:41:55.459845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:03.539958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359371+0000","last_change":"2024-05-30T16:41:53.354855+0000","last_active":"2024-05-30T16:41:54.359371+0000","last_peered":"2024-05-30T16:41:54.359371+0000","last_clean":"2024-05-30T16:41:54.359371+0000","last_became_active":"2024-05-30T16:41:53.354564+0000","last_became_peered":"2024-05-30T16:41:53.354564+0000","last_unstale":"2024-05-30T16:41:54.359371+0000","last_undegraded":"2024-05-30T16:41:54.359371+0000","last_fullsized":"2024-05-30T16:41:54.359371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353620+0000","last_change":"2024-05-30T16:41:53.357643+0000","last_active":"2024-05-30T16:41:54.353620+0000","last_peered":"2024-05-30T16:41:54.353620+0000","last_clean":"2024-05-30T16:41:54.353620+0000","last_became_active":"2024-05-30T16:41:53.357364+0000","last_became_peered":"2024-05-30T16:41:53.357364+0000","last_unstale":"2024-05-30T16:41:54.353620+0000","last_undegraded":"2024-05-30T16:41:54.353620+0000","last_fullsized":"2024-05-30T16:41:54.353620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459783+0000","last_change":"2024-05-30T16:41:53.359016+0000","last_active":"2024-05-30T16:41:55.459783+0000","last_peered":"2024-05-30T16:41:55.459783+0000","last_clean":"2024-05-30T16:41:55.459783+0000","last_became_active":"2024-05-30T16:41:53.358647+0000","last_became_peered":"2024-05-30T16:41:53.358647+0000","last_unstale":"2024-05-30T16:41:55.459783+0000","last_undegraded":"2024-05-30T16:41:55.459783+0000","last_fullsized":"2024-05-30T16:41:55.459783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:01.904685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456720+0000","last_change":"2024-05-30T16:41:53.369095+0000","last_active":"2024-05-30T16:41:55.456720+0000","last_peered":"2024-05-30T16:41:55.456720+0000","last_clean":"2024-05-30T16:41:55.456720+0000","last_became_active":"2024-05-30T16:41:53.368747+0000","last_became_peered":"2024-05-30T16:41:53.368747+0000","last_unstale":"2024-05-30T16:41:55.456720+0000","last_undegraded":"2024-05-30T16:41:55.456720+0000","last_fullsized":"2024-05-30T16:41:55.456720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:03.444148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456759+0000","last_change":"2024-05-30T16:41:53.373107+0000","last_active":"2024-05-30T16:41:55.456759+0000","last_peered":"2024-05-30T16:41:55.456759+0000","last_clean":"2024-05-30T16:41:55.456759+0000","last_became_active":"2024-05-30T16:41:53.372856+0000","last_became_peered":"2024-05-30T16:41:53.372856+0000","last_unstale":"2024-05-30T16:41:55.456759+0000","last_undegraded":"2024-05-30T16:41:55.456759+0000","last_fullsized":"2024-05-30T16:41:55.456759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295310+0000","last_change":"2024-05-30T16:41:53.357024+0000","last_active":"2024-05-30T16:41:55.295310+0000","last_peered":"2024-05-30T16:41:55.295310+0000","last_clean":"2024-05-30T16:41:55.295310+0000","last_became_active":"2024-05-30T16:41:53.355547+0000","last_became_peered":"2024-05-30T16:41:53.355547+0000","last_unstale":"2024-05-30T16:41:55.295310+0000","last_undegraded":"2024-05-30T16:41:55.295310+0000","last_fullsized":"2024-05-30T16:41:55.295310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:17.807528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357938+0000","last_change":"2024-05-30T16:41:53.358603+0000","last_active":"2024-05-30T16:41:54.357938+0000","last_peered":"2024-05-30T16:41:54.357938+0000","last_clean":"2024-05-30T16:41:54.357938+0000","last_became_active":"2024-05-30T16:41:53.357790+0000","last_became_peered":"2024-05-30T16:41:53.357790+0000","last_unstale":"2024-05-30T16:41:54.357938+0000","last_undegraded":"2024-05-30T16:41:54.357938+0000","last_fullsized":"2024-05-30T16:41:54.357938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357689+0000","last_change":"2024-05-30T16:41:53.352211+0000","last_active":"2024-05-30T16:41:54.357689+0000","last_peered":"2024-05-30T16:41:54.357689+0000","last_clean":"2024-05-30T16:41:54.357689+0000","last_became_active":"2024-05-30T16:41:53.351432+0000","last_became_peered":"2024-05-30T16:41:53.351432+0000","last_unstale":"2024-05-30T16:41:54.357689+0000","last_undegraded":"2024-05-30T16:41:54.357689+0000","last_fullsized":"2024-05-30T16:41:54.357689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:03.931858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459368+0000","last_change":"2024-05-30T16:41:52.337016+0000","last_active":"2024-05-30T16:41:55.459368+0000","last_peered":"2024-05-30T16:41:55.459368+0000","last_clean":"2024-05-30T16:41:55.459368+0000","last_became_active":"2024-05-30T16:41:52.336681+0000","last_became_peered":"2024-05-30T16:41:52.336681+0000","last_unstale":"2024-05-30T16:41:55.459368+0000","last_undegraded":"2024-05-30T16:41:55.459368+0000","last_fullsized":"2024-05-30T16:41:55.459368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:31.649153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456897+0000","last_change":"2024-05-30T16:41:53.368959+0000","last_active":"2024-05-30T16:41:55.456897+0000","last_peered":"2024-05-30T16:41:55.456897+0000","last_clean":"2024-05-30T16:41:55.456897+0000","last_became_active":"2024-05-30T16:41:53.368153+0000","last_became_peered":"2024-05-30T16:41:53.368153+0000","last_unstale":"2024-05-30T16:41:55.456897+0000","last_undegraded":"2024-05-30T16:41:55.456897+0000","last_fullsized":"2024-05-30T16:41:55.456897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358440+0000","last_change":"2024-05-30T16:41:52.332967+0000","last_active":"2024-05-30T16:41:54.358440+0000","last_peered":"2024-05-30T16:41:54.358440+0000","last_clean":"2024-05-30T16:41:54.358440+0000","last_became_active":"2024-05-30T16:41:52.331825+0000","last_became_peered":"2024-05-30T16:41:52.331825+0000","last_unstale":"2024-05-30T16:41:54.358440+0000","last_undegraded":"2024-05-30T16:41:54.358440+0000","last_fullsized":"2024-05-30T16:41:54.358440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457891+0000","last_change":"2024-05-30T16:41:52.336306+0000","last_active":"2024-05-30T16:41:55.457891+0000","last_peered":"2024-05-30T16:41:55.457891+0000","last_clean":"2024-05-30T16:41:55.457891+0000","last_became_active":"2024-05-30T16:41:52.336007+0000","last_became_peered":"2024-05-30T16:41:52.336007+0000","last_unstale":"2024-05-30T16:41:55.457891+0000","last_undegraded":"2024-05-30T16:41:55.457891+0000","last_fullsized":"2024-05-30T16:41:55.457891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:49.630008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458336+0000","last_change":"2024-05-30T16:41:53.363846+0000","last_active":"2024-05-30T16:41:55.458336+0000","last_peered":"2024-05-30T16:41:55.458336+0000","last_clean":"2024-05-30T16:41:55.458336+0000","last_became_active":"2024-05-30T16:41:53.362819+0000","last_became_peered":"2024-05-30T16:41:53.362819+0000","last_unstale":"2024-05-30T16:41:55.458336+0000","last_undegraded":"2024-05-30T16:41:55.458336+0000","last_fullsized":"2024-05-30T16:41:55.458336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456693+0000","last_change":"2024-05-30T16:41:52.336486+0000","last_active":"2024-05-30T16:41:55.456693+0000","last_peered":"2024-05-30T16:41:55.456693+0000","last_clean":"2024-05-30T16:41:55.456693+0000","last_became_active":"2024-05-30T16:41:52.336188+0000","last_became_peered":"2024-05-30T16:41:52.336188+0000","last_unstale":"2024-05-30T16:41:55.456693+0000","last_undegraded":"2024-05-30T16:41:55.456693+0000","last_fullsized":"2024-05-30T16:41:55.456693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353589+0000","last_change":"2024-05-30T16:41:53.356908+0000","last_active":"2024-05-30T16:41:54.353589+0000","last_peered":"2024-05-30T16:41:54.353589+0000","last_clean":"2024-05-30T16:41:54.353589+0000","last_became_active":"2024-05-30T16:41:53.356604+0000","last_became_peered":"2024-05-30T16:41:53.356604+0000","last_unstale":"2024-05-30T16:41:54.353589+0000","last_undegraded":"2024-05-30T16:41:54.353589+0000","last_fullsized":"2024-05-30T16:41:54.353589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:55:56.660417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359167+0000","last_change":"2024-05-30T16:41:52.340551+0000","last_active":"2024-05-30T16:41:54.359167+0000","last_peered":"2024-05-30T16:41:54.359167+0000","last_clean":"2024-05-30T16:41:54.359167+0000","last_became_active":"2024-05-30T16:41:52.340249+0000","last_became_peered":"2024-05-30T16:41:52.340249+0000","last_unstale":"2024-05-30T16:41:54.359167+0000","last_undegraded":"2024-05-30T16:41:54.359167+0000","last_fullsized":"2024-05-30T16:41:54.359167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457084+0000","last_change":"2024-05-30T16:41:53.366735+0000","last_active":"2024-05-30T16:41:55.457084+0000","last_peered":"2024-05-30T16:41:55.457084+0000","last_clean":"2024-05-30T16:41:55.457084+0000","last_became_active":"2024-05-30T16:41:53.362673+0000","last_became_peered":"2024-05-30T16:41:53.362673+0000","last_unstale":"2024-05-30T16:41:55.457084+0000","last_undegraded":"2024-05-30T16:41:55.457084+0000","last_fullsized":"2024-05-30T16:41:55.457084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:20:22.765092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457368+0000","last_change":"2024-05-30T16:41:52.343438+0000","last_active":"2024-05-30T16:41:55.457368+0000","last_peered":"2024-05-30T16:41:55.457368+0000","last_clean":"2024-05-30T16:41:55.457368+0000","last_became_active":"2024-05-30T16:41:52.342914+0000","last_became_peered":"2024-05-30T16:41:52.342914+0000","last_unstale":"2024-05-30T16:41:55.457368+0000","last_undegraded":"2024-05-30T16:41:55.457368+0000","last_fullsized":"2024-05-30T16:41:55.457368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457494+0000","last_change":"2024-05-30T16:41:53.362708+0000","last_active":"2024-05-30T16:41:55.457494+0000","last_peered":"2024-05-30T16:41:55.457494+0000","last_clean":"2024-05-30T16:41:55.457494+0000","last_became_active":"2024-05-30T16:41:53.362383+0000","last_became_peered":"2024-05-30T16:41:53.362383+0000","last_unstale":"2024-05-30T16:41:55.457494+0000","last_undegraded":"2024-05-30T16:41:55.457494+0000","last_fullsized":"2024-05-30T16:41:55.457494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353856+0000","last_change":"2024-05-30T16:41:52.340849+0000","last_active":"2024-05-30T16:41:54.353856+0000","last_peered":"2024-05-30T16:41:54.353856+0000","last_clean":"2024-05-30T16:41:54.353856+0000","last_became_active":"2024-05-30T16:41:52.340475+0000","last_became_peered":"2024-05-30T16:41:52.340475+0000","last_unstale":"2024-05-30T16:41:54.353856+0000","last_undegraded":"2024-05-30T16:41:54.353856+0000","last_fullsized":"2024-05-30T16:41:54.353856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358021+0000","last_change":"2024-05-30T16:41:53.363781+0000","last_active":"2024-05-30T16:41:54.358021+0000","last_peered":"2024-05-30T16:41:54.358021+0000","last_clean":"2024-05-30T16:41:54.358021+0000","last_became_active":"2024-05-30T16:41:53.353193+0000","last_became_peered":"2024-05-30T16:41:53.353193+0000","last_unstale":"2024-05-30T16:41:54.358021+0000","last_undegraded":"2024-05-30T16:41:54.358021+0000","last_fullsized":"2024-05-30T16:41:54.358021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:50.511215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359109+0000","last_change":"2024-05-30T16:41:52.334473+0000","last_active":"2024-05-30T16:41:54.359109+0000","last_peered":"2024-05-30T16:41:54.359109+0000","last_clean":"2024-05-30T16:41:54.359109+0000","last_became_active":"2024-05-30T16:41:52.333867+0000","last_became_peered":"2024-05-30T16:41:52.333867+0000","last_unstale":"2024-05-30T16:41:54.359109+0000","last_undegraded":"2024-05-30T16:41:54.359109+0000","last_fullsized":"2024-05-30T16:41:54.359109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473028+0000","last_change":"2024-05-30T16:41:53.359385+0000","last_active":"2024-05-30T16:41:54.473028+0000","last_peered":"2024-05-30T16:41:54.473028+0000","last_clean":"2024-05-30T16:41:54.473028+0000","last_became_active":"2024-05-30T16:41:53.356569+0000","last_became_peered":"2024-05-30T16:41:53.356569+0000","last_unstale":"2024-05-30T16:41:54.473028+0000","last_undegraded":"2024-05-30T16:41:54.473028+0000","last_fullsized":"2024-05-30T16:41:54.473028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:37:50.895426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457082+0000","last_change":"2024-05-30T16:41:52.334576+0000","last_active":"2024-05-30T16:41:55.457082+0000","last_peered":"2024-05-30T16:41:55.457082+0000","last_clean":"2024-05-30T16:41:55.457082+0000","last_became_active":"2024-05-30T16:41:52.334243+0000","last_became_peered":"2024-05-30T16:41:52.334243+0000","last_unstale":"2024-05-30T16:41:55.457082+0000","last_undegraded":"2024-05-30T16:41:55.457082+0000","last_fullsized":"2024-05-30T16:41:55.457082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:31.649153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456742+0000","last_change":"2024-05-30T16:41:53.363700+0000","last_active":"2024-05-30T16:41:55.456742+0000","last_peered":"2024-05-30T16:41:55.456742+0000","last_clean":"2024-05-30T16:41:55.456742+0000","last_became_active":"2024-05-30T16:41:53.363109+0000","last_became_peered":"2024-05-30T16:41:53.363109+0000","last_unstale":"2024-05-30T16:41:55.456742+0000","last_undegraded":"2024-05-30T16:41:55.456742+0000","last_fullsized":"2024-05-30T16:41:55.456742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456745+0000","last_change":"2024-05-30T16:41:52.337819+0000","last_active":"2024-05-30T16:41:55.456745+0000","last_peered":"2024-05-30T16:41:55.456745+0000","last_clean":"2024-05-30T16:41:55.456745+0000","last_became_active":"2024-05-30T16:41:52.337487+0000","last_became_peered":"2024-05-30T16:41:52.337487+0000","last_unstale":"2024-05-30T16:41:55.456745+0000","last_undegraded":"2024-05-30T16:41:55.456745+0000","last_fullsized":"2024-05-30T16:41:55.456745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473171+0000","last_change":"2024-05-30T16:41:53.353545+0000","last_active":"2024-05-30T16:41:54.473171+0000","last_peered":"2024-05-30T16:41:54.473171+0000","last_clean":"2024-05-30T16:41:54.473171+0000","last_became_active":"2024-05-30T16:41:53.353247+0000","last_became_peered":"2024-05-30T16:41:53.353247+0000","last_unstale":"2024-05-30T16:41:54.473171+0000","last_undegraded":"2024-05-30T16:41:54.473171+0000","last_fullsized":"2024-05-30T16:41:54.473171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:12:07.999320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357907+0000","last_change":"2024-05-30T16:41:52.328980+0000","last_active":"2024-05-30T16:41:54.357907+0000","last_peered":"2024-05-30T16:41:54.357907+0000","last_clean":"2024-05-30T16:41:54.357907+0000","last_became_active":"2024-05-30T16:41:52.328652+0000","last_became_peered":"2024-05-30T16:41:52.328652+0000","last_unstale":"2024-05-30T16:41:54.357907+0000","last_undegraded":"2024-05-30T16:41:54.357907+0000","last_fullsized":"2024-05-30T16:41:54.357907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:23.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357940+0000","last_change":"2024-05-30T16:41:53.358880+0000","last_active":"2024-05-30T16:41:54.357940+0000","last_peered":"2024-05-30T16:41:54.357940+0000","last_clean":"2024-05-30T16:41:54.357940+0000","last_became_active":"2024-05-30T16:41:53.358285+0000","last_became_peered":"2024-05-30T16:41:53.358285+0000","last_unstale":"2024-05-30T16:41:54.357940+0000","last_undegraded":"2024-05-30T16:41:54.357940+0000","last_fullsized":"2024-05-30T16:41:54.357940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.294851+0000","last_change":"2024-05-30T16:41:52.328717+0000","last_active":"2024-05-30T16:41:55.294851+0000","last_peered":"2024-05-30T16:41:55.294851+0000","last_clean":"2024-05-30T16:41:55.294851+0000","last_became_active":"2024-05-30T16:41:52.328423+0000","last_became_peered":"2024-05-30T16:41:52.328423+0000","last_unstale":"2024-05-30T16:41:55.294851+0000","last_undegraded":"2024-05-30T16:41:55.294851+0000","last_fullsized":"2024-05-30T16:41:55.294851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:49.630008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472391+0000","last_change":"2024-05-30T16:41:53.341566+0000","last_active":"2024-05-30T16:41:54.472391+0000","last_peered":"2024-05-30T16:41:54.472391+0000","last_clean":"2024-05-30T16:41:54.472391+0000","last_became_active":"2024-05-30T16:41:53.341079+0000","last_became_peered":"2024-05-30T16:41:53.341079+0000","last_unstale":"2024-05-30T16:41:54.472391+0000","last_undegraded":"2024-05-30T16:41:54.472391+0000","last_fullsized":"2024-05-30T16:41:54.472391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:45.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358659+0000","last_change":"2024-05-30T16:41:52.332813+0000","last_active":"2024-05-30T16:41:54.358659+0000","last_peered":"2024-05-30T16:41:54.358659+0000","last_clean":"2024-05-30T16:41:54.358659+0000","last_became_active":"2024-05-30T16:41:52.332521+0000","last_became_peered":"2024-05-30T16:41:52.332521+0000","last_unstale":"2024-05-30T16:41:54.358659+0000","last_undegraded":"2024-05-30T16:41:54.358659+0000","last_fullsized":"2024-05-30T16:41:54.358659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:22.977875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473787+0000","last_change":"2024-05-30T16:41:53.344857+0000","last_active":"2024-05-30T16:41:54.473787+0000","last_peered":"2024-05-30T16:41:54.473787+0000","last_clean":"2024-05-30T16:41:54.473787+0000","last_became_active":"2024-05-30T16:41:53.344411+0000","last_became_peered":"2024-05-30T16:41:53.344411+0000","last_unstale":"2024-05-30T16:41:54.473787+0000","last_undegraded":"2024-05-30T16:41:54.473787+0000","last_fullsized":"2024-05-30T16:41:54.473787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:53:52.685260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295183+0000","last_change":"2024-05-30T16:41:52.325985+0000","last_active":"2024-05-30T16:41:55.295183+0000","last_peered":"2024-05-30T16:41:55.295183+0000","last_clean":"2024-05-30T16:41:55.295183+0000","last_became_active":"2024-05-30T16:41:52.324383+0000","last_became_peered":"2024-05-30T16:41:52.324383+0000","last_unstale":"2024-05-30T16:41:55.295183+0000","last_undegraded":"2024-05-30T16:41:55.295183+0000","last_fullsized":"2024-05-30T16:41:55.295183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.474204+0000","last_change":"2024-05-30T16:41:53.353421+0000","last_active":"2024-05-30T16:41:54.474204+0000","last_peered":"2024-05-30T16:41:54.474204+0000","last_clean":"2024-05-30T16:41:54.474204+0000","last_became_active":"2024-05-30T16:41:53.353121+0000","last_became_peered":"2024-05-30T16:41:53.353121+0000","last_unstale":"2024-05-30T16:41:54.474204+0000","last_undegraded":"2024-05-30T16:41:54.474204+0000","last_fullsized":"2024-05-30T16:41:54.474204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:04.081864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.354077+0000","last_change":"2024-05-30T16:41:52.338368+0000","last_active":"2024-05-30T16:41:54.354077+0000","last_peered":"2024-05-30T16:41:54.354077+0000","last_clean":"2024-05-30T16:41:54.354077+0000","last_became_active":"2024-05-30T16:41:52.338036+0000","last_became_peered":"2024-05-30T16:41:52.338036+0000","last_unstale":"2024-05-30T16:41:54.354077+0000","last_undegraded":"2024-05-30T16:41:54.354077+0000","last_fullsized":"2024-05-30T16:41:54.354077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:49.498732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457474+0000","last_change":"2024-05-30T16:41:53.375844+0000","last_active":"2024-05-30T16:41:55.457474+0000","last_peered":"2024-05-30T16:41:55.457474+0000","last_clean":"2024-05-30T16:41:55.457474+0000","last_became_active":"2024-05-30T16:41:53.375574+0000","last_became_peered":"2024-05-30T16:41:53.375574+0000","last_unstale":"2024-05-30T16:41:55.457474+0000","last_undegraded":"2024-05-30T16:41:55.457474+0000","last_fullsized":"2024-05-30T16:41:55.457474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:09.648137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295130+0000","last_change":"2024-05-30T16:41:52.340534+0000","last_active":"2024-05-30T16:41:55.295130+0000","last_peered":"2024-05-30T16:41:55.295130+0000","last_clean":"2024-05-30T16:41:55.295130+0000","last_became_active":"2024-05-30T16:41:52.340157+0000","last_became_peered":"2024-05-30T16:41:52.340157+0000","last_unstale":"2024-05-30T16:41:55.295130+0000","last_undegraded":"2024-05-30T16:41:55.295130+0000","last_fullsized":"2024-05-30T16:41:55.295130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473453+0000","last_change":"2024-05-30T16:41:53.361217+0000","last_active":"2024-05-30T16:41:54.473453+0000","last_peered":"2024-05-30T16:41:54.473453+0000","last_clean":"2024-05-30T16:41:54.473453+0000","last_became_active":"2024-05-30T16:41:53.360593+0000","last_became_peered":"2024-05-30T16:41:53.360593+0000","last_unstale":"2024-05-30T16:41:54.473453+0000","last_undegraded":"2024-05-30T16:41:54.473453+0000","last_fullsized":"2024-05-30T16:41:54.473453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:56:37.884273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472880+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:41:54.472880+0000","last_peered":"2024-05-30T16:41:54.472880+0000","last_clean":"2024-05-30T16:41:54.472880+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:41:54.472880+0000","last_undegraded":"2024-05-30T16:41:54.472880+0000","last_fullsized":"2024-05-30T16:41:54.472880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456903+0000","last_change":"2024-05-30T16:41:52.336314+0000","last_active":"2024-05-30T16:41:55.456903+0000","last_peered":"2024-05-30T16:41:55.456903+0000","last_clean":"2024-05-30T16:41:55.456903+0000","last_became_active":"2024-05-30T16:41:52.335990+0000","last_became_peered":"2024-05-30T16:41:52.335990+0000","last_unstale":"2024-05-30T16:41:55.456903+0000","last_undegraded":"2024-05-30T16:41:55.456903+0000","last_fullsized":"2024-05-30T16:41:55.456903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458465+0000","last_change":"2024-05-30T16:41:53.363616+0000","last_active":"2024-05-30T16:41:55.458465+0000","last_peered":"2024-05-30T16:41:55.458465+0000","last_clean":"2024-05-30T16:41:55.458465+0000","last_became_active":"2024-05-30T16:41:53.363275+0000","last_became_peered":"2024-05-30T16:41:53.363275+0000","last_unstale":"2024-05-30T16:41:55.458465+0000","last_undegraded":"2024-05-30T16:41:55.458465+0000","last_fullsized":"2024-05-30T16:41:55.458465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472306+0000","last_change":"2024-05-30T16:41:52.342846+0000","last_active":"2024-05-30T16:41:54.472306+0000","last_peered":"2024-05-30T16:41:54.472306+0000","last_clean":"2024-05-30T16:41:54.472306+0000","last_became_active":"2024-05-30T16:41:52.342435+0000","last_became_peered":"2024-05-30T16:41:52.342435+0000","last_unstale":"2024-05-30T16:41:54.472306+0000","last_undegraded":"2024-05-30T16:41:54.472306+0000","last_fullsized":"2024-05-30T16:41:54.472306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:12:46.572059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456543+0000","last_change":"2024-05-30T16:41:53.369256+0000","last_active":"2024-05-30T16:41:55.456543+0000","last_peered":"2024-05-30T16:41:55.456543+0000","last_clean":"2024-05-30T16:41:55.456543+0000","last_became_active":"2024-05-30T16:41:53.368938+0000","last_became_peered":"2024-05-30T16:41:53.368938+0000","last_unstale":"2024-05-30T16:41:55.456543+0000","last_undegraded":"2024-05-30T16:41:55.456543+0000","last_fullsized":"2024-05-30T16:41:55.456543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:11:06.050717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.295411+0000","last_change":"2024-05-30T16:41:52.326607+0000","last_active":"2024-05-30T16:41:55.295411+0000","last_peered":"2024-05-30T16:41:55.295411+0000","last_clean":"2024-05-30T16:41:55.295411+0000","last_became_active":"2024-05-30T16:41:52.326202+0000","last_became_peered":"2024-05-30T16:41:52.326202+0000","last_unstale":"2024-05-30T16:41:55.295411+0000","last_undegraded":"2024-05-30T16:41:55.295411+0000","last_fullsized":"2024-05-30T16:41:55.295411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353720+0000","last_change":"2024-05-30T16:41:53.354056+0000","last_active":"2024-05-30T16:41:54.353720+0000","last_peered":"2024-05-30T16:41:54.353720+0000","last_clean":"2024-05-30T16:41:54.353720+0000","last_became_active":"2024-05-30T16:41:53.353806+0000","last_became_peered":"2024-05-30T16:41:53.353806+0000","last_unstale":"2024-05-30T16:41:54.353720+0000","last_undegraded":"2024-05-30T16:41:54.353720+0000","last_fullsized":"2024-05-30T16:41:54.353720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.456837+0000","last_change":"2024-05-30T16:41:52.341003+0000","last_active":"2024-05-30T16:41:55.456837+0000","last_peered":"2024-05-30T16:41:55.456837+0000","last_clean":"2024-05-30T16:41:55.456837+0000","last_became_active":"2024-05-30T16:41:52.340199+0000","last_became_peered":"2024-05-30T16:41:52.340199+0000","last_unstale":"2024-05-30T16:41:55.456837+0000","last_undegraded":"2024-05-30T16:41:55.456837+0000","last_fullsized":"2024-05-30T16:41:55.456837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:02.919374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357559+0000","last_change":"2024-05-30T16:41:53.363426+0000","last_active":"2024-05-30T16:41:54.357559+0000","last_peered":"2024-05-30T16:41:54.357559+0000","last_clean":"2024-05-30T16:41:54.357559+0000","last_became_active":"2024-05-30T16:41:53.363167+0000","last_became_peered":"2024-05-30T16:41:53.363167+0000","last_unstale":"2024-05-30T16:41:54.357559+0000","last_undegraded":"2024-05-30T16:41:54.357559+0000","last_fullsized":"2024-05-30T16:41:54.357559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:26.300947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353566+0000","last_change":"2024-05-30T16:41:52.335162+0000","last_active":"2024-05-30T16:41:54.353566+0000","last_peered":"2024-05-30T16:41:54.353566+0000","last_clean":"2024-05-30T16:41:54.353566+0000","last_became_active":"2024-05-30T16:41:52.334870+0000","last_became_peered":"2024-05-30T16:41:52.334870+0000","last_unstale":"2024-05-30T16:41:54.353566+0000","last_undegraded":"2024-05-30T16:41:54.353566+0000","last_fullsized":"2024-05-30T16:41:54.353566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:34:18.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457197+0000","last_change":"2024-05-30T16:41:53.374678+0000","last_active":"2024-05-30T16:41:55.457197+0000","last_peered":"2024-05-30T16:41:55.457197+0000","last_clean":"2024-05-30T16:41:55.457197+0000","last_became_active":"2024-05-30T16:41:53.374417+0000","last_became_peered":"2024-05-30T16:41:53.374417+0000","last_unstale":"2024-05-30T16:41:55.457197+0000","last_undegraded":"2024-05-30T16:41:55.457197+0000","last_fullsized":"2024-05-30T16:41:55.457197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:45.520278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473652+0000","last_change":"2024-05-30T16:41:52.345422+0000","last_active":"2024-05-30T16:41:54.473652+0000","last_peered":"2024-05-30T16:41:54.473652+0000","last_clean":"2024-05-30T16:41:54.473652+0000","last_became_active":"2024-05-30T16:41:52.345025+0000","last_became_peered":"2024-05-30T16:41:52.345025+0000","last_unstale":"2024-05-30T16:41:54.473652+0000","last_undegraded":"2024-05-30T16:41:54.473652+0000","last_fullsized":"2024-05-30T16:41:54.473652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:55.167706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353496+0000","last_change":"2024-05-30T16:41:53.354570+0000","last_active":"2024-05-30T16:41:54.353496+0000","last_peered":"2024-05-30T16:41:54.353496+0000","last_clean":"2024-05-30T16:41:54.353496+0000","last_became_active":"2024-05-30T16:41:53.353658+0000","last_became_peered":"2024-05-30T16:41:53.353658+0000","last_unstale":"2024-05-30T16:41:54.353496+0000","last_undegraded":"2024-05-30T16:41:54.353496+0000","last_fullsized":"2024-05-30T16:41:54.353496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:56.180189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.365566+0000","last_change":"2024-05-30T16:41:52.335427+0000","last_active":"2024-05-30T16:41:54.365566+0000","last_peered":"2024-05-30T16:41:54.365566+0000","last_clean":"2024-05-30T16:41:54.365566+0000","last_became_active":"2024-05-30T16:41:52.334938+0000","last_became_peered":"2024-05-30T16:41:52.334938+0000","last_unstale":"2024-05-30T16:41:54.365566+0000","last_undegraded":"2024-05-30T16:41:54.365566+0000","last_fullsized":"2024-05-30T16:41:54.365566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:40:25.288464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459967+0000","last_change":"2024-05-30T16:41:53.350035+0000","last_active":"2024-05-30T16:41:55.459967+0000","last_peered":"2024-05-30T16:41:55.459967+0000","last_clean":"2024-05-30T16:41:55.459967+0000","last_became_active":"2024-05-30T16:41:53.349514+0000","last_became_peered":"2024-05-30T16:41:53.349514+0000","last_unstale":"2024-05-30T16:41:55.459967+0000","last_undegraded":"2024-05-30T16:41:55.459967+0000","last_fullsized":"2024-05-30T16:41:55.459967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:07.160618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.359122+0000","last_change":"2024-05-30T16:41:52.343555+0000","last_active":"2024-05-30T16:41:54.359122+0000","last_peered":"2024-05-30T16:41:54.359122+0000","last_clean":"2024-05-30T16:41:54.359122+0000","last_became_active":"2024-05-30T16:41:52.342980+0000","last_became_peered":"2024-05-30T16:41:52.342980+0000","last_unstale":"2024-05-30T16:41:54.359122+0000","last_undegraded":"2024-05-30T16:41:54.359122+0000","last_fullsized":"2024-05-30T16:41:54.359122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:49.498732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457706+0000","last_change":"2024-05-30T16:41:53.365631+0000","last_active":"2024-05-30T16:41:55.457706+0000","last_peered":"2024-05-30T16:41:55.457706+0000","last_clean":"2024-05-30T16:41:55.457706+0000","last_became_active":"2024-05-30T16:41:53.357804+0000","last_became_peered":"2024-05-30T16:41:53.357804+0000","last_unstale":"2024-05-30T16:41:55.457706+0000","last_undegraded":"2024-05-30T16:41:55.457706+0000","last_fullsized":"2024-05-30T16:41:55.457706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472293+0000","last_change":"2024-05-30T16:41:52.340095+0000","last_active":"2024-05-30T16:41:54.472293+0000","last_peered":"2024-05-30T16:41:54.472293+0000","last_clean":"2024-05-30T16:41:54.472293+0000","last_became_active":"2024-05-30T16:41:52.339769+0000","last_became_peered":"2024-05-30T16:41:52.339769+0000","last_unstale":"2024-05-30T16:41:54.472293+0000","last_undegraded":"2024-05-30T16:41:54.472293+0000","last_fullsized":"2024-05-30T16:41:54.472293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:16:18.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.357172+0000","last_change":"2024-05-30T16:41:53.359564+0000","last_active":"2024-05-30T16:41:54.357172+0000","last_peered":"2024-05-30T16:41:54.357172+0000","last_clean":"2024-05-30T16:41:54.357172+0000","last_became_active":"2024-05-30T16:41:53.358733+0000","last_became_peered":"2024-05-30T16:41:53.358733+0000","last_unstale":"2024-05-30T16:41:54.357172+0000","last_undegraded":"2024-05-30T16:41:54.357172+0000","last_fullsized":"2024-05-30T16:41:54.357172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:50.153923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353727+0000","last_change":"2024-05-30T16:41:52.340268+0000","last_active":"2024-05-30T16:41:54.353727+0000","last_peered":"2024-05-30T16:41:54.353727+0000","last_clean":"2024-05-30T16:41:54.353727+0000","last_became_active":"2024-05-30T16:41:52.339896+0000","last_became_peered":"2024-05-30T16:41:52.339896+0000","last_unstale":"2024-05-30T16:41:54.353727+0000","last_undegraded":"2024-05-30T16:41:54.353727+0000","last_fullsized":"2024-05-30T16:41:54.353727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:09:49.141440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.458359+0000","last_change":"2024-05-30T16:41:53.351989+0000","last_active":"2024-05-30T16:41:55.458359+0000","last_peered":"2024-05-30T16:41:55.458359+0000","last_clean":"2024-05-30T16:41:55.458359+0000","last_became_active":"2024-05-30T16:41:53.351579+0000","last_became_peered":"2024-05-30T16:41:53.351579+0000","last_unstale":"2024-05-30T16:41:55.458359+0000","last_undegraded":"2024-05-30T16:41:55.458359+0000","last_fullsized":"2024-05-30T16:41:55.458359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:00.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.353390+0000","last_change":"2024-05-30T16:41:52.330661+0000","last_active":"2024-05-30T16:41:54.353390+0000","last_peered":"2024-05-30T16:41:54.353390+0000","last_clean":"2024-05-30T16:41:54.353390+0000","last_became_active":"2024-05-30T16:41:52.330239+0000","last_became_peered":"2024-05-30T16:41:52.330239+0000","last_unstale":"2024-05-30T16:41:54.353390+0000","last_undegraded":"2024-05-30T16:41:54.353390+0000","last_fullsized":"2024-05-30T16:41:54.353390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:23.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.459438+0000","last_change":"2024-05-30T16:41:53.365561+0000","last_active":"2024-05-30T16:41:55.459438+0000","last_peered":"2024-05-30T16:41:55.459438+0000","last_clean":"2024-05-30T16:41:55.459438+0000","last_became_active":"2024-05-30T16:41:53.363963+0000","last_became_peered":"2024-05-30T16:41:53.363963+0000","last_unstale":"2024-05-30T16:41:55.459438+0000","last_undegraded":"2024-05-30T16:41:55.459438+0000","last_fullsized":"2024-05-30T16:41:55.459438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:59:55.693138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473668+0000","last_change":"2024-05-30T16:41:52.344910+0000","last_active":"2024-05-30T16:41:54.473668+0000","last_peered":"2024-05-30T16:41:54.473668+0000","last_clean":"2024-05-30T16:41:54.473668+0000","last_became_active":"2024-05-30T16:41:52.344564+0000","last_became_peered":"2024-05-30T16:41:52.344564+0000","last_unstale":"2024-05-30T16:41:54.473668+0000","last_undegraded":"2024-05-30T16:41:54.473668+0000","last_fullsized":"2024-05-30T16:41:54.473668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:11:05.038234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.358176+0000","last_change":"2024-05-30T16:41:53.361266+0000","last_active":"2024-05-30T16:41:54.358176+0000","last_peered":"2024-05-30T16:41:54.358176+0000","last_clean":"2024-05-30T16:41:54.358176+0000","last_became_active":"2024-05-30T16:41:53.360980+0000","last_became_peered":"2024-05-30T16:41:53.360980+0000","last_unstale":"2024-05-30T16:41:54.358176+0000","last_undegraded":"2024-05-30T16:41:54.358176+0000","last_fullsized":"2024-05-30T16:41:54.358176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:05:16.619008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457189+0000","last_change":"2024-05-30T16:41:53.370166+0000","last_active":"2024-05-30T16:41:55.457189+0000","last_peered":"2024-05-30T16:41:55.457189+0000","last_clean":"2024-05-30T16:41:55.457189+0000","last_became_active":"2024-05-30T16:41:53.369830+0000","last_became_peered":"2024-05-30T16:41:53.369830+0000","last_unstale":"2024-05-30T16:41:55.457189+0000","last_undegraded":"2024-05-30T16:41:55.457189+0000","last_fullsized":"2024-05-30T16:41:55.457189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:08:24.828674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.472946+0000","last_change":"2024-05-30T16:41:52.342853+0000","last_active":"2024-05-30T16:41:54.472946+0000","last_peered":"2024-05-30T16:41:54.472946+0000","last_clean":"2024-05-30T16:41:54.472946+0000","last_became_active":"2024-05-30T16:41:52.342459+0000","last_became_peered":"2024-05-30T16:41:52.342459+0000","last_unstale":"2024-05-30T16:41:54.472946+0000","last_undegraded":"2024-05-30T16:41:54.472946+0000","last_fullsized":"2024-05-30T16:41:54.472946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:52:34.598062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457125+0000","last_change":"2024-05-30T16:41:53.367020+0000","last_active":"2024-05-30T16:41:55.457125+0000","last_peered":"2024-05-30T16:41:55.457125+0000","last_clean":"2024-05-30T16:41:55.457125+0000","last_became_active":"2024-05-30T16:41:53.366745+0000","last_became_peered":"2024-05-30T16:41:53.366745+0000","last_unstale":"2024-05-30T16:41:55.457125+0000","last_undegraded":"2024-05-30T16:41:55.457125+0000","last_fullsized":"2024-05-30T16:41:55.457125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:35:37.949106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:54.473358+0000","last_change":"2024-05-30T16:41:52.343170+0000","last_active":"2024-05-30T16:41:54.473358+0000","last_peered":"2024-05-30T16:41:54.473358+0000","last_clean":"2024-05-30T16:41:54.473358+0000","last_became_active":"2024-05-30T16:41:52.342743+0000","last_became_peered":"2024-05-30T16:41:52.342743+0000","last_unstale":"2024-05-30T16:41:54.473358+0000","last_undegraded":"2024-05-30T16:41:54.473358+0000","last_fullsized":"2024-05-30T16:41:54.473358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:05:02.431665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457471+0000","last_change":"2024-05-30T16:41:53.364283+0000","last_active":"2024-05-30T16:41:55.457471+0000","last_peered":"2024-05-30T16:41:55.457471+0000","last_clean":"2024-05-30T16:41:55.457471+0000","last_became_active":"2024-05-30T16:41:53.362510+0000","last_became_peered":"2024-05-30T16:41:53.362510+0000","last_unstale":"2024-05-30T16:41:55.457471+0000","last_undegraded":"2024-05-30T16:41:55.457471+0000","last_fullsized":"2024-05-30T16:41:55.457471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:54.816118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.460118+0000","last_change":"2024-05-30T16:41:52.333188+0000","last_active":"2024-05-30T16:41:55.460118+0000","last_peered":"2024-05-30T16:41:55.460118+0000","last_clean":"2024-05-30T16:41:55.460118+0000","last_became_active":"2024-05-30T16:41:52.332987+0000","last_became_peered":"2024-05-30T16:41:52.332987+0000","last_unstale":"2024-05-30T16:41:55.460118+0000","last_undegraded":"2024-05-30T16:41:55.460118+0000","last_fullsized":"2024-05-30T16:41:55.460118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:38.267671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.460122+0000","last_change":"2024-05-30T16:41:53.360296+0000","last_active":"2024-05-30T16:41:55.460122+0000","last_peered":"2024-05-30T16:41:55.460122+0000","last_clean":"2024-05-30T16:41:55.460122+0000","last_became_active":"2024-05-30T16:41:53.360008+0000","last_became_peered":"2024-05-30T16:41:53.360008+0000","last_unstale":"2024-05-30T16:41:55.460122+0000","last_undegraded":"2024-05-30T16:41:55.460122+0000","last_fullsized":"2024-05-30T16:41:55.460122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:52.291308+0000","last_clean_scrub_stamp":"2024-05-30T16:41:52.291308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:11.943106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T16:41:55.457581+0000","last_change":"2024-05-30T16:41:52.337440+0000","last_active":"2024-05-30T16:41:55.457581+0000","last_peered":"2024-05-30T16:41:55.457581+0000","last_clean":"2024-05-30T16:41:55.457581+0000","last_became_active":"2024-05-30T16:41:52.337136+0000","last_became_peered":"2024-05-30T16:41:52.337136+0000","last_unstale":"2024-05-30T16:41:55.457581+0000","last_undegraded":"2024-05-30T16:41:55.457581+0000","last_fullsized":"2024-05-30T16:41:55.457581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:51.278824+0000","last_clean_scrub_stamp":"2024-05-30T16:41:51.278824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:17.345557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:42:03.556 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:42:03.556 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-30T16:42:03.556 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-30T16:42:03.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-30T16:42:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.780+0000 7f0679800640 1 Processor -- start 2024-05-30T16:42:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.780+0000 7f0679800640 1 -- start start 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.782+0000 7f0679800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f067415d510 0x7f067409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.782+0000 7f0679800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06740b5cf0 0x7f067409af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.782+0000 7f0679800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06740b6350 con 0x7f067415d8f0 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.782+0000 7f0679800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f06740b6120 con 0x7f06740b5cf0 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.782+0000 7f0679800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f06740b6bf0 con 0x7f067415d510 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.782+0000 7f0678e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06740b5cf0 0x7f067409af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.782+0000 7f0678e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06740b5cf0 0x7f067409af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59124/0 (socket says 172.21.15.144:59124) 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.782+0000 7f0678e00640 1 -- 172.21.15.144:0/2036824510 learned_addr learned my addr 172.21.15.144:0/2036824510 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.783+0000 7f0673e00640 1 --2- 172.21.15.144:0/2036824510 >> v2:172.21.15.149:3300/0 conn(0x7f067415d510 0x7f067409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.783+0000 7f0678e00640 1 -- 172.21.15.144:0/2036824510 >> v2:172.21.15.149:3300/0 conn(0x7f067415d510 msgr2=0x7f067409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.783+0000 7f0678e00640 1 --2- 172.21.15.144:0/2036824510 >> v2:172.21.15.149:3300/0 conn(0x7f067415d510 0x7f067409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.783+0000 7f0678e00640 1 -- 172.21.15.144:0/2036824510 >> v1:172.21.15.149:6789/0 conn(0x7f067415d8f0 legacy=0x7f06740b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.783+0000 7f0678e00640 1 -- 172.21.15.144:0/2036824510 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06740b6630 con 0x7f06740b5cf0 2024-05-30T16:42:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.783+0000 7f0673e00640 1 --2- 172.21.15.144:0/2036824510 >> v2:172.21.15.149:3300/0 conn(0x7f067415d510 0x7f067409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.784+0000 7f0678e00640 1 --2- 172.21.15.144:0/2036824510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06740b5cf0 0x7f067409af70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0674073310 tx=0x7f066c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c37c229108dab5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.784+0000 7f0673400640 1 -- 172.21.15.144:0/2036824510 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c036070 con 0x7f06740b5cf0 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.784+0000 7f0673400640 1 -- 172.21.15.144:0/2036824510 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066c031600 con 0x7f06740b5cf0 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.784+0000 7f0673400640 1 -- 172.21.15.144:0/2036824510 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c02ae60 con 0x7f06740b5cf0 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.784+0000 7f0679800640 1 -- 172.21.15.144:0/2036824510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06740b5cf0 msgr2=0x7f067409af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.784+0000 7f0679800640 1 --2- 172.21.15.144:0/2036824510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06740b5cf0 0x7f067409af70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0674073310 tx=0x7f066c02a680 comp rx=0 tx=0).stop 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.785+0000 7f0679800640 1 -- 172.21.15.144:0/2036824510 shutdown_connections 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.785+0000 7f0679800640 1 --2- 172.21.15.144:0/2036824510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06740b5cf0 0x7f067409af70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.785+0000 7f0679800640 1 --2- 172.21.15.144:0/2036824510 >> v2:172.21.15.149:3300/0 conn(0x7f067415d510 0x7f067409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.785+0000 7f0679800640 1 -- 172.21.15.144:0/2036824510 >> 172.21.15.144:0/2036824510 conn(0x7f06740b40b0 msgr2=0x7f06740b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:03.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.785+0000 7f0679800640 1 -- 172.21.15.144:0/2036824510 shutdown_connections 2024-05-30T16:42:03.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.785+0000 7f0679800640 1 -- 172.21.15.144:0/2036824510 wait complete. 2024-05-30T16:42:03.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.786+0000 7f0679800640 1 Processor -- start 2024-05-30T16:42:03.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.786+0000 7f0679800640 1 -- start start 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.787+0000 7f0679800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06740b5cf0 0x7f06741f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.787+0000 7f0679800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415d510 0x7f0674158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.787+0000 7f0679800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067415d8f0 0x7f0674155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.787+0000 7f0679800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f067415e310 con 0x7f067415d510 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.787+0000 7f0679800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f067415ddf0 con 0x7f067415d8f0 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.787+0000 7f0679800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f067415e490 con 0x7f06740b5cf0 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f066b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415d510 0x7f0674158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f066b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415d510 0x7f0674158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59126/0 (socket says 172.21.15.144:59126) 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f066b400640 1 -- 172.21.15.144:0/3911925221 learned_addr learned my addr 172.21.15.144:0/3911925221 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f0678e00640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067415d8f0 0x7f0674155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f0673e00640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06740b5cf0 0x7f06741f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:03.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f066b400640 1 -- 172.21.15.144:0/3911925221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06740b5cf0 msgr2=0x7f06741f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f066b400640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06740b5cf0 0x7f06741f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f066b400640 1 -- 172.21.15.144:0/3911925221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067415d8f0 msgr2=0x7f0674155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:03.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f066b400640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067415d8f0 0x7f0674155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:03.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f066b400640 1 -- 172.21.15.144:0/3911925221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067409f6c0 con 0x7f067415d510 2024-05-30T16:42:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f066b400640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415d510 0x7f0674158c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f065c00b3c0 tx=0x7f065c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.788+0000 7f0670c00640 1 -- 172.21.15.144:0/3911925221 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c011830 con 0x7f067415d510 2024-05-30T16:42:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.789+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067409f9a0 con 0x7f067415d510 2024-05-30T16:42:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.789+0000 7f0670c00640 1 -- 172.21.15.144:0/3911925221 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065c016070 con 0x7f067415d510 2024-05-30T16:42:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.789+0000 7f0670c00640 1 -- 172.21.15.144:0/3911925221 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c011c10 con 0x7f067415d510 2024-05-30T16:42:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.789+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06740a0240 con 0x7f067415d510 2024-05-30T16:42:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.790+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f067409fb70 con 0x7f067415d510 2024-05-30T16:42:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.791+0000 7f0670c00640 1 -- 172.21.15.144:0/3911925221 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f065c01b460 con 0x7f067415d510 2024-05-30T16:42:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.791+0000 7f0670c00640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f065006c8f0 0x7f065006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.792+0000 7f0670c00640 1 -- 172.21.15.144:0/3911925221 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f065c08b960 con 0x7f067415d510 2024-05-30T16:42:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.792+0000 7f0673e00640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f065006c8f0 0x7f065006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.792+0000 7f0673e00640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f065006c8f0 0x7f065006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f066400a990 tx=0x7f0664008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:03.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:03.796+0000 7f0670c00640 1 -- 172.21.15.144:0/3911925221 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f065c059c70 con 0x7f067415d510 2024-05-30T16:42:04.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.019+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0674075570 con 0x7f067415d510 2024-05-30T16:42:04.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.020+0000 7f0670c00640 1 -- 172.21.15.144:0/3911925221 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f065c059570 con 0x7f067415d510 2024-05-30T16:42:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:04.021 INFO:teuthology.orchestra.run.smithi144.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-30T16:42:04.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f065006c8f0 msgr2=0x7f065006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f065006c8f0 0x7f065006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f066400a990 tx=0x7f0664008040 comp rx=0 tx=0).stop 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415d510 msgr2=0x7f0674158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415d510 0x7f0674158c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f065c00b3c0 tx=0x7f065c00b880 comp rx=0 tx=0).stop 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 shutdown_connections 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f065006c8f0 0x7f065006edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067415d8f0 0x7f0674155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415d510 0x7f0674158c80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 --2- 172.21.15.144:0/3911925221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06740b5cf0 0x7f06741f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.022+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 >> 172.21.15.144:0/3911925221 conn(0x7f06740b40b0 msgr2=0x7f067415ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.023+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 shutdown_connections 2024-05-30T16:42:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.023+0000 7f0679800640 1 -- 172.21.15.144:0/3911925221 wait complete. 2024-05-30T16:42:04.041 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-30T16:42:04.041 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:42:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.239+0000 7f54a5600640 1 Processor -- start 2024-05-30T16:42:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.239+0000 7f54a5600640 1 -- start start 2024-05-30T16:42:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.241+0000 7f54a5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a013f760 0x7f54a006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.241+0000 7f54a5600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f54a00cec70 0x7f54a00b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.241+0000 7f54a5600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a006ee80 con 0x7f54a00b5e00 2024-05-30T16:42:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.241+0000 7f54a5600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f54a01612b0 con 0x7f54a00cec70 2024-05-30T16:42:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.241+0000 7f54a5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f54a013fb40 con 0x7f54a013f760 2024-05-30T16:42:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.241+0000 7f549e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f54a00cec70 0x7f54a00b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.241+0000 7f549e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f54a00cec70 0x7f54a00b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59136/0 (socket says 172.21.15.144:59136) 2024-05-30T16:42:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.241+0000 7f549e000640 1 -- 172.21.15.144:0/755085960 learned_addr learned my addr 172.21.15.144:0/755085960 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.241+0000 7f549f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f54a00b5e00 0x7f54a0142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54812/0 (socket says 172.21.15.144:54812) 2024-05-30T16:42:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.242+0000 7f549ea00640 1 --2- 172.21.15.144:0/755085960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a013f760 0x7f54a006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.242+0000 7f549e000640 1 -- 172.21.15.144:0/755085960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a013f760 msgr2=0x7f54a006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.242+0000 7f549e000640 1 --2- 172.21.15.144:0/755085960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a013f760 0x7f54a006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.242+0000 7f549e000640 1 -- 172.21.15.144:0/755085960 >> v1:172.21.15.144:6789/0 conn(0x7f54a00b5e00 legacy=0x7f54a0142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.242+0000 7f549e000640 1 -- 172.21.15.144:0/755085960 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a0160730 con 0x7f54a00cec70 2024-05-30T16:42:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.242+0000 7f549ea00640 1 --2- 172.21.15.144:0/755085960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a013f760 0x7f54a006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.242+0000 7f549d600640 1 -- 172.21.15.144:0/755085960 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652043640 0 0) 0x7f54a006ee80 con 0x7f54a00b5e00 2024-05-30T16:42:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.243+0000 7f549e000640 1 --2- 172.21.15.144:0/755085960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 0x7f54a00b58c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f548c009870 tx=0x7f548c02a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716cdf51ffc1404b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:04.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.243+0000 7f549d600640 1 -- 172.21.15.144:0/755085960 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c037070 con 0x7f54a00cec70 2024-05-30T16:42:04.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.243+0000 7f549d600640 1 -- 172.21.15.144:0/755085960 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548c032640 con 0x7f54a00cec70 2024-05-30T16:42:04.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.243+0000 7f549d600640 1 -- 172.21.15.144:0/755085960 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c032a10 con 0x7f54a00cec70 2024-05-30T16:42:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.244+0000 7f54a5600640 1 -- 172.21.15.144:0/755085960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 msgr2=0x7f54a00b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.244+0000 7f54a5600640 1 --2- 172.21.15.144:0/755085960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 0x7f54a00b58c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f548c009870 tx=0x7f548c02a2f0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.244+0000 7f54a5600640 1 -- 172.21.15.144:0/755085960 shutdown_connections 2024-05-30T16:42:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.244+0000 7f54a5600640 1 --2- 172.21.15.144:0/755085960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 0x7f54a00b58c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.244+0000 7f54a5600640 1 --2- 172.21.15.144:0/755085960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a013f760 0x7f54a006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.244+0000 7f54a5600640 1 -- 172.21.15.144:0/755085960 >> 172.21.15.144:0/755085960 conn(0x7f54a006bd00 msgr2=0x7f54a006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.244+0000 7f54a5600640 1 -- 172.21.15.144:0/755085960 shutdown_connections 2024-05-30T16:42:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.244+0000 7f54a5600640 1 -- 172.21.15.144:0/755085960 wait complete. 2024-05-30T16:42:04.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.246+0000 7f54a5600640 1 Processor -- start 2024-05-30T16:42:04.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.246+0000 7f54a5600640 1 -- start start 2024-05-30T16:42:04.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f54a5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a00b5e00 0x7f54a0152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f54a5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 0x7f54a0153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f54a5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a013f760 0x7f54a015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f54a5600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f54a0160fd0 con 0x7f54a00cec70 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f54a5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f54a0160cf0 con 0x7f54a013f760 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f54a5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f54a00cf0d0 con 0x7f54a00b5e00 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f549e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 0x7f54a0153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f549e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 0x7f54a0153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59152/0 (socket says 172.21.15.144:59152) 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f549e000640 1 -- 172.21.15.144:0/719709070 learned_addr learned my addr 172.21.15.144:0/719709070 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f549ea00640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a00b5e00 0x7f54a0152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f549e000640 1 -- 172.21.15.144:0/719709070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a00b5e00 msgr2=0x7f54a0152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f549e000640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a00b5e00 0x7f54a0152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.247+0000 7f549e000640 1 -- 172.21.15.144:0/719709070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a013f760 msgr2=0x7f54a015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f549f400640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a013f760 0x7f54a015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f549e000640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a013f760 0x7f54a015b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f549e000640 1 -- 172.21.15.144:0/719709070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a00b13f0 con 0x7f54a00cec70 2024-05-30T16:42:04.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f549ea00640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a00b5e00 0x7f54a0152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:04.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f549e000640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 0x7f54a0153e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f548c035040 tx=0x7f548c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:04.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f5496a00640 1 -- 172.21.15.144:0/719709070 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c037040 con 0x7f54a00cec70 2024-05-30T16:42:04.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f5496a00640 1 -- 172.21.15.144:0/719709070 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548c004230 con 0x7f54a00cec70 2024-05-30T16:42:04.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a00b16d0 con 0x7f54a00cec70 2024-05-30T16:42:04.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f5496a00640 1 -- 172.21.15.144:0/719709070 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c030770 con 0x7f54a00cec70 2024-05-30T16:42:04.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.248+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a00b1c90 con 0x7f54a00cec70 2024-05-30T16:42:04.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.249+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a0068b90 con 0x7f54a00cec70 2024-05-30T16:42:04.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.251+0000 7f5496a00640 1 -- 172.21.15.144:0/719709070 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f548c032500 con 0x7f54a00cec70 2024-05-30T16:42:04.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.251+0000 7f5496a00640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f548006c8f0 0x7f548006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.252+0000 7f5496a00640 1 -- 172.21.15.144:0/719709070 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f548c0acac0 con 0x7f54a00cec70 2024-05-30T16:42:04.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.252+0000 7f549ea00640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f548006c8f0 0x7f548006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.252+0000 7f549ea00640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f548006c8f0 0x7f548006edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5490006fd0 tx=0x7f5490008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:04.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.256+0000 7f5496a00640 1 -- 172.21.15.144:0/719709070 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f548c07aee0 con 0x7f54a00cec70 2024-05-30T16:42:04.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.498+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54a0160450 con 0x7f54a00cec70 2024-05-30T16:42:04.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.499+0000 7f5496a00640 1 -- 172.21.15.144:0/719709070 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f548c07a7e0 con 0x7f54a00cec70 2024-05-30T16:42:04.500 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:04.500 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3786718549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3786718549},{"type":"v1","addr":"172.21.15.149:6833","nonce":3786718549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/117174447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":117174447},{"type":"v1","addr":"172.21.15.149:6835","nonce":117174447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1743859445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1743859445},{"type":"v1","addr":"172.21.15.144:6836","nonce":1743859445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:41:52.777438+0000","modified":"2024-05-30T16:41:55.840372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-30T16:42:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-05-30T16:42:04.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f548006c8f0 msgr2=0x7f548006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f548006c8f0 0x7f548006edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5490006fd0 tx=0x7f5490008040 comp rx=0 tx=0).stop 2024-05-30T16:42:04.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 msgr2=0x7f54a0153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 0x7f54a0153e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f548c035040 tx=0x7f548c0046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 shutdown_connections 2024-05-30T16:42:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f548006c8f0 0x7f548006edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a013f760 0x7f54a015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a00cec70 0x7f54a0153e10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 --2- 172.21.15.144:0/719709070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54a00b5e00 0x7f54a0152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 >> 172.21.15.144:0/719709070 conn(0x7f54a006bd00 msgr2=0x7f54a006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 shutdown_connections 2024-05-30T16:42:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.501+0000 7f54a5600640 1 -- 172.21.15.144:0/719709070 wait complete. 2024-05-30T16:42:04.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:42:04.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.717+0000 7fe138a00640 1 Processor -- start 2024-05-30T16:42:04.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.717+0000 7fe138a00640 1 -- start start 2024-05-30T16:42:04.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.719+0000 7fe138a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340caf10 0x7fe13415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.719+0000 7fe138a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe1340cf8b0 0x7fe1340b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.719+0000 7fe138a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13415f500 con 0x7fe1340cb2f0 2024-05-30T16:42:04.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.719+0000 7fe138a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe13415f780 con 0x7fe1340cf8b0 2024-05-30T16:42:04.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.719+0000 7fe138a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe13415fa60 con 0x7fe1340caf10 2024-05-30T16:42:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.719+0000 7fe132800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340caf10 0x7fe13415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.719+0000 7fe131e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe1340cb2f0 0x7fe13415c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:37210/0 (socket says 172.21.15.144:37210) 2024-05-30T16:42:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.719+0000 7fe131e00640 1 -- 172.21.15.144:0/2153363269 learned_addr learned my addr 172.21.15.144:0/2153363269 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.720+0000 7fe133200640 1 --2- 172.21.15.144:0/2153363269 >> v2:172.21.15.149:3300/0 conn(0x7fe1340cf8b0 0x7fe1340b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.720+0000 7fe132800640 1 -- 172.21.15.144:0/2153363269 >> v2:172.21.15.149:3300/0 conn(0x7fe1340cf8b0 msgr2=0x7fe1340b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.720+0000 7fe132800640 1 --2- 172.21.15.144:0/2153363269 >> v2:172.21.15.149:3300/0 conn(0x7fe1340cf8b0 0x7fe1340b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.720+0000 7fe132800640 1 -- 172.21.15.144:0/2153363269 >> v1:172.21.15.149:6789/0 conn(0x7fe1340cb2f0 legacy=0x7fe13415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.720+0000 7fe132800640 1 -- 172.21.15.144:0/2153363269 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13415fd40 con 0x7fe1340caf10 2024-05-30T16:42:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.722+0000 7fe132800640 1 --2- 172.21.15.144:0/2153363269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340caf10 0x7fe13415efc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1240097a0 tx=0x7fe12402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d7db08cf7db458 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:04.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.722+0000 7fe131400640 1 -- 172.21.15.144:0/2153363269 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124037070 con 0x7fe1340caf10 2024-05-30T16:42:04.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.722+0000 7fe131400640 1 -- 172.21.15.144:0/2153363269 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe124032440 con 0x7fe1340caf10 2024-05-30T16:42:04.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.722+0000 7fe131400640 1 -- 172.21.15.144:0/2153363269 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124032810 con 0x7fe1340caf10 2024-05-30T16:42:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.722+0000 7fe138a00640 1 -- 172.21.15.144:0/2153363269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340caf10 msgr2=0x7fe13415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.722+0000 7fe138a00640 1 --2- 172.21.15.144:0/2153363269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340caf10 0x7fe13415efc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1240097a0 tx=0x7fe12402a180 comp rx=0 tx=0).stop 2024-05-30T16:42:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.723+0000 7fe138a00640 1 -- 172.21.15.144:0/2153363269 shutdown_connections 2024-05-30T16:42:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.723+0000 7fe138a00640 1 --2- 172.21.15.144:0/2153363269 >> v2:172.21.15.149:3300/0 conn(0x7fe1340cf8b0 0x7fe1340b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.723+0000 7fe138a00640 1 --2- 172.21.15.144:0/2153363269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340caf10 0x7fe13415efc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.723+0000 7fe138a00640 1 -- 172.21.15.144:0/2153363269 >> 172.21.15.144:0/2153363269 conn(0x7fe1340b20a0 msgr2=0x7fe1340b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.723+0000 7fe138a00640 1 -- 172.21.15.144:0/2153363269 shutdown_connections 2024-05-30T16:42:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.723+0000 7fe138a00640 1 -- 172.21.15.144:0/2153363269 wait complete. 2024-05-30T16:42:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.724+0000 7fe138a00640 1 Processor -- start 2024-05-30T16:42:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.725+0000 7fe138a00640 1 -- start start 2024-05-30T16:42:04.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.725+0000 7fe138a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1340caf10 0x7fe13415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.725+0000 7fe138a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340cb2f0 0x7fe134072bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.725+0000 7fe138a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1340cf8b0 0x7fe134073110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.725+0000 7fe138a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe13415bad0 con 0x7fe1340cf8b0 2024-05-30T16:42:04.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.725+0000 7fe138a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe13415b950 con 0x7fe1340caf10 2024-05-30T16:42:04.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.725+0000 7fe138a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe1340b3700 con 0x7fe1340cb2f0 2024-05-30T16:42:04.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe133200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1340cf8b0 0x7fe134073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe133200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1340cf8b0 0x7fe134073110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59154/0 (socket says 172.21.15.144:59154) 2024-05-30T16:42:04.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe133200640 1 -- 172.21.15.144:0/733613007 learned_addr learned my addr 172.21.15.144:0/733613007 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:04.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe132800640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1340caf10 0x7fe13415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe131e00640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340cb2f0 0x7fe134072bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe133200640 1 -- 172.21.15.144:0/733613007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340cb2f0 msgr2=0x7fe134072bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe133200640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340cb2f0 0x7fe134072bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe133200640 1 -- 172.21.15.144:0/733613007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1340caf10 msgr2=0x7fe13415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe133200640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1340caf10 0x7fe13415a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.726+0000 7fe133200640 1 -- 172.21.15.144:0/733613007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1340af360 con 0x7fe1340cf8b0 2024-05-30T16:42:04.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.727+0000 7fe133200640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1340cf8b0 0x7fe134073110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009d30 tx=0x7fe12c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:04.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.727+0000 7fe12aa00640 1 -- 172.21.15.144:0/733613007 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c018020 con 0x7fe1340cf8b0 2024-05-30T16:42:04.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.727+0000 7fe12aa00640 1 -- 172.21.15.144:0/733613007 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12c014480 con 0x7fe1340cf8b0 2024-05-30T16:42:04.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.727+0000 7fe12aa00640 1 -- 172.21.15.144:0/733613007 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c014870 con 0x7fe1340cf8b0 2024-05-30T16:42:04.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.727+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1340af640 con 0x7fe1340cf8b0 2024-05-30T16:42:04.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.727+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13415ac60 con 0x7fe1340cf8b0 2024-05-30T16:42:04.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.728+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe134075570 con 0x7fe1340cf8b0 2024-05-30T16:42:04.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.729+0000 7fe12aa00640 1 -- 172.21.15.144:0/733613007 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe12c005d10 con 0x7fe1340cf8b0 2024-05-30T16:42:04.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.730+0000 7fe12aa00640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11406c8f0 0x7fe11406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:04.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.730+0000 7fe12aa00640 1 -- 172.21.15.144:0/733613007 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe12c08c4f0 con 0x7fe1340cf8b0 2024-05-30T16:42:04.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.730+0000 7fe132800640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11406c8f0 0x7fe11406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:04.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.731+0000 7fe132800640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11406c8f0 0x7fe11406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe124034000 tx=0x7fe12402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:04.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.734+0000 7fe12aa00640 1 -- 172.21.15.144:0/733613007 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe12c022070 con 0x7fe1340cf8b0 2024-05-30T16:42:04.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.975+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1340af810 con 0x7fe1340cf8b0 2024-05-30T16:42:04.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.976+0000 7fe12aa00640 1 -- 172.21.15.144:0/733613007 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7fe12c010040 con 0x7fe1340cf8b0 2024-05-30T16:42:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:04.977 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3786718549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3786718549},{"type":"v1","addr":"172.21.15.149:6833","nonce":3786718549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/117174447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":117174447},{"type":"v1","addr":"172.21.15.149:6835","nonce":117174447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1743859445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1743859445},{"type":"v1","addr":"172.21.15.144:6836","nonce":1743859445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:41:52.777438+0000","modified":"2024-05-30T16:41:55.840372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-30T16:42:04.977 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-05-30T16:42:04.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.978+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11406c8f0 msgr2=0x7fe11406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.978+0000 7fe138a00640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11406c8f0 0x7fe11406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe124034000 tx=0x7fe12402e000 comp rx=0 tx=0).stop 2024-05-30T16:42:04.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.978+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1340cf8b0 msgr2=0x7fe134073110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:04.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.978+0000 7fe138a00640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1340cf8b0 0x7fe134073110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009d30 tx=0x7fe12c00c490 comp rx=0 tx=0).stop 2024-05-30T16:42:04.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.978+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 shutdown_connections 2024-05-30T16:42:04.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.979+0000 7fe138a00640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11406c8f0 0x7fe11406edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.979+0000 7fe138a00640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1340cf8b0 0x7fe134073110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.979+0000 7fe138a00640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1340cb2f0 0x7fe134072bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.979+0000 7fe138a00640 1 --2- 172.21.15.144:0/733613007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1340caf10 0x7fe13415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:04.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.979+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 >> 172.21.15.144:0/733613007 conn(0x7fe1340b20a0 msgr2=0x7fe13415ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:04.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.979+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 shutdown_connections 2024-05-30T16:42:04.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:04.979+0000 7fe138a00640 1 -- 172.21.15.144:0/733613007 wait complete. 2024-05-30T16:42:04.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:42:05.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.185+0000 7fbddac00640 1 Processor -- start 2024-05-30T16:42:05.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.185+0000 7fbddac00640 1 -- start start 2024-05-30T16:42:05.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.187+0000 7fbddac00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbdd40ba2b0 0x7fbdd40cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.187+0000 7fbddac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40cfaa0 0x7fbdd40d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.187+0000 7fbddac00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd4163550 con 0x7fbdd415eb80 2024-05-30T16:42:05.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.187+0000 7fbddac00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd415ef60 con 0x7fbdd40ba2b0 2024-05-30T16:42:05.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.187+0000 7fbddac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd4162d50 con 0x7fbdd40cfaa0 2024-05-30T16:42:05.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.187+0000 7fbdd3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbdd40ba2b0 0x7fbdd40cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.187+0000 7fbdd3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbdd40ba2b0 0x7fbdd40cf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41976/0 (socket says 172.21.15.144:41976) 2024-05-30T16:42:05.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.187+0000 7fbdd3400640 1 -- 172.21.15.144:0/4156734333 learned_addr learned my addr 172.21.15.144:0/4156734333 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:05.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.188+0000 7fbdd8c00640 1 --2- 172.21.15.144:0/4156734333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40cfaa0 0x7fbdd40d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.188+0000 7fbdd3400640 1 -- 172.21.15.144:0/4156734333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40cfaa0 msgr2=0x7fbdd40d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:05.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.188+0000 7fbdd3400640 1 --2- 172.21.15.144:0/4156734333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40cfaa0 0x7fbdd40d3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.188+0000 7fbdd3400640 1 -- 172.21.15.144:0/4156734333 >> v1:172.21.15.144:6789/0 conn(0x7fbdd415eb80 legacy=0x7fbdd4162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.188+0000 7fbdd3400640 1 -- 172.21.15.144:0/4156734333 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd4162f90 con 0x7fbdd40ba2b0 2024-05-30T16:42:05.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.189+0000 7fbdd3400640 1 --2- 172.21.15.144:0/4156734333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40ba2b0 0x7fbdd40cf560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009870 tx=0x7fbdc002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a365fdd46c71f9a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:05.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.189+0000 7fbdd2a00640 1 -- 172.21.15.144:0/4156734333 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0037070 con 0x7fbdd40ba2b0 2024-05-30T16:42:05.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.189+0000 7fbdd2a00640 1 -- 172.21.15.144:0/4156734333 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc0032440 con 0x7fbdd40ba2b0 2024-05-30T16:42:05.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.189+0000 7fbdd2a00640 1 -- 172.21.15.144:0/4156734333 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0032810 con 0x7fbdd40ba2b0 2024-05-30T16:42:05.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.190+0000 7fbddac00640 1 -- 172.21.15.144:0/4156734333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40ba2b0 msgr2=0x7fbdd40cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.190+0000 7fbddac00640 1 --2- 172.21.15.144:0/4156734333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40ba2b0 0x7fbdd40cf560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009870 tx=0x7fbdc002a250 comp rx=0 tx=0).stop 2024-05-30T16:42:05.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.190+0000 7fbddac00640 1 -- 172.21.15.144:0/4156734333 shutdown_connections 2024-05-30T16:42:05.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.190+0000 7fbddac00640 1 --2- 172.21.15.144:0/4156734333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40cfaa0 0x7fbdd40d3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.190+0000 7fbddac00640 1 --2- 172.21.15.144:0/4156734333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40ba2b0 0x7fbdd40cf560 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.190+0000 7fbddac00640 1 -- 172.21.15.144:0/4156734333 >> 172.21.15.144:0/4156734333 conn(0x7fbdd406cf40 msgr2=0x7fbdd406d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:05.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.190+0000 7fbddac00640 1 -- 172.21.15.144:0/4156734333 shutdown_connections 2024-05-30T16:42:05.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.190+0000 7fbddac00640 1 -- 172.21.15.144:0/4156734333 wait complete. 2024-05-30T16:42:05.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.192+0000 7fbddac00640 1 Processor -- start 2024-05-30T16:42:05.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.192+0000 7fbddac00640 1 -- start start 2024-05-30T16:42:05.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbddac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40ba2b0 0x7fbdd41f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbddac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40cfaa0 0x7fbdd4158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbddac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd415eb80 0x7fbdd4150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbddac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd40d3050 con 0x7fbdd415eb80 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbddac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd40d2d70 con 0x7fbdd40cfaa0 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbddac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd40b7a30 con 0x7fbdd40ba2b0 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbdd8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd415eb80 0x7fbdd4150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbdd8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd415eb80 0x7fbdd4150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41992/0 (socket says 172.21.15.144:41992) 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbdd8c00640 1 -- 172.21.15.144:0/3551858485 learned_addr learned my addr 172.21.15.144:0/3551858485 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbdd3400640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40cfaa0 0x7fbdd4158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbdd8c00640 1 -- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40ba2b0 msgr2=0x7fbdd41f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.193+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40ba2b0 0x7fbdd41f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdd8c00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40ba2b0 0x7fbdd41f86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdd8c00640 1 -- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40cfaa0 msgr2=0x7fbdd4158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdd8c00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40cfaa0 0x7fbdd4158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdd8c00640 1 -- 172.21.15.144:0/3551858485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd41f5a40 con 0x7fbdd415eb80 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdd3400640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40cfaa0 0x7fbdd4158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40ba2b0 0x7fbdd41f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdd8c00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd415eb80 0x7fbdd4150c60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc007e90 tx=0x7fbdcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdcbe00640 1 -- 172.21.15.144:0/3551858485 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc014420 con 0x7fbdd415eb80 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdcbe00640 1 -- 172.21.15.144:0/3551858485 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc019070 con 0x7fbdd415eb80 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd41f5d20 con 0x7fbdd415eb80 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbdcbe00640 1 -- 172.21.15.144:0/3551858485 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc014800 con 0x7fbdd415eb80 2024-05-30T16:42:05.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.194+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd41f62e0 con 0x7fbdd415eb80 2024-05-30T16:42:05.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.196+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd4068b90 con 0x7fbdd415eb80 2024-05-30T16:42:05.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.196+0000 7fbdcbe00640 1 -- 172.21.15.144:0/3551858485 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbdcc0149a0 con 0x7fbdd415eb80 2024-05-30T16:42:05.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.197+0000 7fbdcbe00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdb406c8f0 0x7fbdb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.198+0000 7fbdcbe00640 1 -- 172.21.15.144:0/3551858485 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbdcc08c440 con 0x7fbdd415eb80 2024-05-30T16:42:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.198+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdb406c8f0 0x7fbdb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.198+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdb406c8f0 0x7fbdb406edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40d06a0 tx=0x7fbdc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:05.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.202+0000 7fbdcbe00640 1 -- 172.21.15.144:0/3551858485 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbdcc05a7d0 con 0x7fbdd415eb80 2024-05-30T16:42:05.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.397+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdd40d25a0 con 0x7fbdd415eb80 2024-05-30T16:42:05.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.399+0000 7fbdcbe00640 1 -- 172.21.15.144:0/3551858485 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fbdcc05a0d0 con 0x7fbdd415eb80 2024-05-30T16:42:05.400 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:05.400 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:54.340246+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:41:50.922058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:41:51.739937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:42:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.401+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdb406c8f0 msgr2=0x7fbdb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.401+0000 7fbddac00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdb406c8f0 0x7fbdb406edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40d06a0 tx=0x7fbdc4009040 comp rx=0 tx=0).stop 2024-05-30T16:42:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.401+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd415eb80 msgr2=0x7fbdd4150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.401+0000 7fbddac00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd415eb80 0x7fbdd4150c60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc007e90 tx=0x7fbdcc00e4b0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.402+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 shutdown_connections 2024-05-30T16:42:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.402+0000 7fbddac00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdb406c8f0 0x7fbdb406edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.402+0000 7fbddac00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd415eb80 0x7fbdd4150c60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.402+0000 7fbddac00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40cfaa0 0x7fbdd4158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.402+0000 7fbddac00640 1 --2- 172.21.15.144:0/3551858485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40ba2b0 0x7fbdd41f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.402+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 >> 172.21.15.144:0/3551858485 conn(0x7fbdd406cf40 msgr2=0x7fbdd40d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:05.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.402+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 shutdown_connections 2024-05-30T16:42:05.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.402+0000 7fbddac00640 1 -- 172.21.15.144:0/3551858485 wait complete. 2024-05-30T16:42:05.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:42:05.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.613+0000 7f515be00640 1 Processor -- start 2024-05-30T16:42:05.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.613+0000 7f515be00640 1 -- start start 2024-05-30T16:42:05.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f515be00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5154145150 0x7f51540cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f515be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51540cfa70 0x7f515406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f515be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f515406f610 0x7f5154072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f515be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f51540cfeb0 con 0x7f51540cfa70 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f515be00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f515415f140 con 0x7f5154145150 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f515be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f51540d00f0 con 0x7f515406f610 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f5158a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51540cfa70 0x7f515406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f5158a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51540cfa70 0x7f515406f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42008/0 (socket says 172.21.15.144:42008) 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f5158a00640 1 -- 172.21.15.144:0/2157007420 learned_addr learned my addr 172.21.15.144:0/2157007420 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f5159400640 1 --2- 172.21.15.144:0/2157007420 >> v2:172.21.15.149:3300/0 conn(0x7f5154145150 0x7f51540cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.615+0000 7f5159e00640 1 --2- 172.21.15.144:0/2157007420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f515406f610 0x7f5154072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.616+0000 7f5158a00640 1 -- 172.21.15.144:0/2157007420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f515406f610 msgr2=0x7f5154072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.616+0000 7f5158a00640 1 --2- 172.21.15.144:0/2157007420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f515406f610 0x7f5154072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.616+0000 7f5158a00640 1 -- 172.21.15.144:0/2157007420 >> v2:172.21.15.149:3300/0 conn(0x7f5154145150 msgr2=0x7f51540cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:05.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.616+0000 7f5158a00640 1 --2- 172.21.15.144:0/2157007420 >> v2:172.21.15.149:3300/0 conn(0x7f5154145150 0x7f51540cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.616+0000 7f5158a00640 1 -- 172.21.15.144:0/2157007420 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515415f390 con 0x7f51540cfa70 2024-05-30T16:42:05.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.616+0000 7f5159400640 1 --2- 172.21.15.144:0/2157007420 >> v2:172.21.15.149:3300/0 conn(0x7f5154145150 0x7f51540cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:42:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.617+0000 7f5158a00640 1 --2- 172.21.15.144:0/2157007420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51540cfa70 0x7f515406f0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f51540b3db0 tx=0x7f514002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21594db5d694fc78 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.617+0000 7f5153e00640 1 -- 172.21.15.144:0/2157007420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140037070 con 0x7f51540cfa70 2024-05-30T16:42:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.617+0000 7f5153e00640 1 -- 172.21.15.144:0/2157007420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5140032440 con 0x7f51540cfa70 2024-05-30T16:42:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.617+0000 7f5153e00640 1 -- 172.21.15.144:0/2157007420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140032810 con 0x7f51540cfa70 2024-05-30T16:42:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.618+0000 7f515be00640 1 -- 172.21.15.144:0/2157007420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51540cfa70 msgr2=0x7f515406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.618+0000 7f515be00640 1 --2- 172.21.15.144:0/2157007420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51540cfa70 0x7f515406f0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f51540b3db0 tx=0x7f514002a140 comp rx=0 tx=0).stop 2024-05-30T16:42:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.618+0000 7f515be00640 1 -- 172.21.15.144:0/2157007420 shutdown_connections 2024-05-30T16:42:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.618+0000 7f515be00640 1 --2- 172.21.15.144:0/2157007420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f515406f610 0x7f5154072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.618+0000 7f515be00640 1 --2- 172.21.15.144:0/2157007420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51540cfa70 0x7f515406f0d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.618+0000 7f515be00640 1 --2- 172.21.15.144:0/2157007420 >> v2:172.21.15.149:3300/0 conn(0x7f5154145150 0x7f51540cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.618+0000 7f515be00640 1 -- 172.21.15.144:0/2157007420 >> 172.21.15.144:0/2157007420 conn(0x7f515406bd00 msgr2=0x7f515406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:05.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.618+0000 7f515be00640 1 -- 172.21.15.144:0/2157007420 shutdown_connections 2024-05-30T16:42:05.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.618+0000 7f515be00640 1 -- 172.21.15.144:0/2157007420 wait complete. 2024-05-30T16:42:05.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.620+0000 7f515be00640 1 Processor -- start 2024-05-30T16:42:05.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.620+0000 7f515be00640 1 -- start start 2024-05-30T16:42:05.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f515be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515406f610 0x7f51541f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f515be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51540cfa70 0x7f51541f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f515be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5154145150 0x7f51540ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f515be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51540b64f0 con 0x7f515406f610 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f515be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f515415f950 con 0x7f5154145150 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f515be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f515415fe70 con 0x7f51540cfa70 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f5159400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515406f610 0x7f51541f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f5159400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515406f610 0x7f51541f4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42012/0 (socket says 172.21.15.144:42012) 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f5159400640 1 -- 172.21.15.144:0/69890774 learned_addr learned my addr 172.21.15.144:0/69890774 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.621+0000 7f5159e00640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5154145150 0x7f51540ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f5159400640 1 -- 172.21.15.144:0/69890774 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51540cfa70 msgr2=0x7f51541f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f5159400640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51540cfa70 0x7f51541f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f5159400640 1 -- 172.21.15.144:0/69890774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5154145150 msgr2=0x7f51540ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f5159400640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5154145150 0x7f51540ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f5159400640 1 -- 172.21.15.144:0/69890774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51541f8b80 con 0x7f515406f610 2024-05-30T16:42:05.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f5159400640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515406f610 0x7f51541f4020 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f514800e7e0 tx=0x7f514800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:05.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f5151600640 1 -- 172.21.15.144:0/69890774 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514800f040 con 0x7f515406f610 2024-05-30T16:42:05.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f5151600640 1 -- 172.21.15.144:0/69890774 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5148004030 con 0x7f515406f610 2024-05-30T16:42:05.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f5151600640 1 -- 172.21.15.144:0/69890774 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148004400 con 0x7f515406f610 2024-05-30T16:42:05.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515415db90 con 0x7f515406f610 2024-05-30T16:42:05.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.622+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51541e54b0 con 0x7f515406f610 2024-05-30T16:42:05.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.623+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5154068b90 con 0x7f515406f610 2024-05-30T16:42:05.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.624+0000 7f5151600640 1 -- 172.21.15.144:0/69890774 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f514800c6d0 con 0x7f515406f610 2024-05-30T16:42:05.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.625+0000 7f5151600640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f513406c8f0 0x7f513406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:05.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.625+0000 7f5151600640 1 -- 172.21.15.144:0/69890774 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f514808b890 con 0x7f515406f610 2024-05-30T16:42:05.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.626+0000 7f5158a00640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f513406c8f0 0x7f513406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:05.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.626+0000 7f5158a00640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f513406c8f0 0x7f513406edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5140034000 tx=0x7f514002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.629+0000 7f5151600640 1 -- 172.21.15.144:0/69890774 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51541f8b80 con 0x7f515406f610 2024-05-30T16:42:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.869+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f515415df60 con 0x7f515406f610 2024-05-30T16:42:05.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.870+0000 7f5151600640 1 -- 172.21.15.144:0/69890774 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f5148017020 con 0x7f515406f610 2024-05-30T16:42:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:05.871 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3786718549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3786718549},{"type":"v1","addr":"172.21.15.149:6833","nonce":3786718549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/117174447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":117174447},{"type":"v1","addr":"172.21.15.149:6835","nonce":117174447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1743859445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1743859445},{"type":"v1","addr":"172.21.15.144:6836","nonce":1743859445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:41:52.777438+0000","modified":"2024-05-30T16:41:55.840372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-30T16:42:05.871 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-05-30T16:42:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.872+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f513406c8f0 msgr2=0x7f513406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f513406c8f0 0x7f513406edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5140034000 tx=0x7f514002c000 comp rx=0 tx=0).stop 2024-05-30T16:42:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515406f610 msgr2=0x7f51541f4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515406f610 0x7f51541f4020 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f514800e7e0 tx=0x7f514800eca0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 shutdown_connections 2024-05-30T16:42:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f513406c8f0 0x7f513406edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5154145150 0x7f51540ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51540cfa70 0x7f51541f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 --2- 172.21.15.144:0/69890774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515406f610 0x7f51541f4020 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 >> 172.21.15.144:0/69890774 conn(0x7f515406bd00 msgr2=0x7f51540b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 shutdown_connections 2024-05-30T16:42:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:05.873+0000 7f515be00640 1 -- 172.21.15.144:0/69890774 wait complete. 2024-05-30T16:42:06.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:41:52.777438+0000', 'modified': '2024-05-30T16:41:55.840372+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/1315513290', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 1315513290}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 1315513290}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-05-30T16:42:06.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:42:06.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-30T16:42:06.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.499+0000 7f5ce1600640 1 Processor -- start 2024-05-30T16:42:06.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.499+0000 7f5ce1600640 1 -- start start 2024-05-30T16:42:06.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.500+0000 7f5ce1600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5cdc15cb20 0x7f5cdc0cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.500+0000 7f5ce1600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc15d020 con 0x7f5cdc0b2b70 2024-05-30T16:42:06.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.500+0000 7f5ce1600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc15d300 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.500+0000 7f5ce1600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5cdc0cfb20 con 0x7f5cdc15cb20 2024-05-30T16:42:06.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.501+0000 7f5cdbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5cdc0b2b70 0x7f5cdc142710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46446/0 (socket says 172.21.15.144:46446) 2024-05-30T16:42:06.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.501+0000 7f5cdbe00640 1 -- 172.21.15.144:0/3723117501 learned_addr learned my addr 172.21.15.144:0/3723117501 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:06.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.501+0000 7f5cdb400640 1 --2- 172.21.15.144:0/3723117501 >> v2:172.21.15.144:3300/0 conn(0x7f5cdc15cb20 0x7f5cdc0cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.501+0000 7f5cdaa00640 1 -- 172.21.15.144:0/3723117501 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145284423 0 0) 0x7f5cdc15d020 con 0x7f5cdc0b2b70 2024-05-30T16:42:06.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.501+0000 7f5cdaa00640 1 -- 172.21.15.144:0/3723117501 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc0003520 con 0x7f5cdc0b2b70 2024-05-30T16:42:06.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.501+0000 7f5cdb400640 1 -- 172.21.15.144:0/3723117501 >> v1:172.21.15.149:6789/0 conn(0x7f5cdc0cf6c0 legacy=0x7f5cdc140000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:06.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.501+0000 7f5cdb400640 1 -- 172.21.15.144:0/3723117501 >> v1:172.21.15.144:6789/0 conn(0x7f5cdc0b2b70 legacy=0x7f5cdc142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.501+0000 7f5cdb400640 1 -- 172.21.15.144:0/3723117501 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc15d5e0 con 0x7f5cdc15cb20 2024-05-30T16:42:06.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.502+0000 7f5cdb400640 1 --2- 172.21.15.144:0/3723117501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc15cb20 0x7f5cdc0cf180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80097a0 tx=0x7f5cc802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb7dee5e4378630 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:06.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5cdaa00640 1 -- 172.21.15.144:0/3723117501 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8037070 con 0x7f5cdc15cb20 2024-05-30T16:42:06.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5cdaa00640 1 -- 172.21.15.144:0/3723117501 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc8032440 con 0x7f5cdc15cb20 2024-05-30T16:42:06.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5cdaa00640 1 -- 172.21.15.144:0/3723117501 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8032810 con 0x7f5cdc15cb20 2024-05-30T16:42:06.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5ce1600640 1 -- 172.21.15.144:0/3723117501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc15cb20 msgr2=0x7f5cdc0cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5ce1600640 1 --2- 172.21.15.144:0/3723117501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc15cb20 0x7f5cdc0cf180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80097a0 tx=0x7f5cc802a230 comp rx=0 tx=0).stop 2024-05-30T16:42:06.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5ce1600640 1 -- 172.21.15.144:0/3723117501 shutdown_connections 2024-05-30T16:42:06.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5ce1600640 1 --2- 172.21.15.144:0/3723117501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc15cb20 0x7f5cdc0cf180 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5ce1600640 1 -- 172.21.15.144:0/3723117501 >> 172.21.15.144:0/3723117501 conn(0x7f5cdc0627b0 msgr2=0x7f5cdc06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:06.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5ce1600640 1 -- 172.21.15.144:0/3723117501 shutdown_connections 2024-05-30T16:42:06.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.503+0000 7f5ce1600640 1 -- 172.21.15.144:0/3723117501 wait complete. 2024-05-30T16:42:06.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.505+0000 7f5ce1600640 1 Processor -- start 2024-05-30T16:42:06.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.505+0000 7f5ce1600640 1 -- start start 2024-05-30T16:42:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.506+0000 7f5ce1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc0b2b70 0x7f5cdc0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.506+0000 7f5ce1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0cf6c0 0x7f5cdc13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.506+0000 7f5ce1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cdc15cb20 0x7f5cdc15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.506+0000 7f5ce1600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc0b2f50 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.506+0000 7f5ce1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc0c6760 con 0x7f5cdc0b2b70 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.506+0000 7f5ce1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5cdc0b30d0 con 0x7f5cdc15cb20 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.506+0000 7f5cdb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0cf6c0 0x7f5cdc13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.506+0000 7f5cdb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0cf6c0 0x7f5cdc13dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42038/0 (socket says 172.21.15.144:42038) 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.506+0000 7f5cdb400640 1 -- 172.21.15.144:0/1816359029 learned_addr learned my addr 172.21.15.144:0/1816359029 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc0b2b70 0x7f5cdc0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5ce0c00640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cdc15cb20 0x7f5cdc15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cdb400640 1 -- 172.21.15.144:0/1816359029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cdc15cb20 msgr2=0x7f5cdc15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cdb400640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cdc15cb20 0x7f5cdc15b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cdb400640 1 -- 172.21.15.144:0/1816359029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc0b2b70 msgr2=0x7f5cdc0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cdb400640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc0b2b70 0x7f5cdc0a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cdb400640 1 -- 172.21.15.144:0/1816359029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc15ecb0 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc0b2b70 0x7f5cdc0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cdb400640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0cf6c0 0x7f5cdc13dc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8035040 tx=0x7f5cc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cd3e00640 1 -- 172.21.15.144:0/1816359029 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8037040 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cd3e00640 1 -- 172.21.15.144:0/1816359029 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc8030500 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5ce1600640 1 -- 172.21.15.144:0/1816359029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cdc15ef50 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.507+0000 7f5cd3e00640 1 -- 172.21.15.144:0/1816359029 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc80308d0 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.508+0000 7f5ce1600640 1 -- 172.21.15.144:0/1816359029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cdc15f510 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.510+0000 7f5cd3e00640 1 -- 172.21.15.144:0/1816359029 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5cc8044020 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.511+0000 7f5cd3e00640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5cbc06c8f0 0x7f5cbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.511+0000 7f5cd3e00640 1 -- 172.21.15.144:0/1816359029 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5cc80abe80 con 0x7f5cdc0cf6c0 2024-05-30T16:42:06.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.511+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5cbc06c8f0 0x7f5cbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.512+0000 7f5ce5a19740 1 Processor -- start 2024-05-30T16:42:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.512+0000 7f5ce5a19740 1 -- start start 2024-05-30T16:42:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.512+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5cbc06c8f0 0x7f5cbc06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0011e0 tx=0x7f5ccc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:06.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f1490 0x55889e6f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e6f5150 0x55889e711090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e7115d0 0x55889e711a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55889e62eb10 con 0x55889e6f1490 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55889e5d52b0 con 0x55889e6f5150 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55889e62aad0 con 0x55889e7115d0 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5cdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f1490 0x55889e6f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5cdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f1490 0x55889e6f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42050/0 (socket says 172.21.15.144:42050) 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5cdbe00640 1 -- 172.21.15.144:0/3998407542 learned_addr learned my addr 172.21.15.144:0/3998407542 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5cdbe00640 1 -- 172.21.15.144:0/3998407542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e7115d0 msgr2=0x55889e711a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/3998407542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e7115d0 0x55889e711a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5cdbe00640 1 -- 172.21.15.144:0/3998407542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e6f5150 msgr2=0x55889e711090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/3998407542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e6f5150 0x55889e711090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.513+0000 7f5cdbe00640 1 -- 172.21.15.144:0/3998407542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55889e3412d0 con 0x55889e6f1490 2024-05-30T16:42:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/3998407542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f1490 0x55889e6f4c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc005bc0 tx=0x7f5ccc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6060b8d3da8b52bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5cc7e00640 1 -- 172.21.15.144:0/3998407542 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00d9a0 con 0x55889e6f1490 2024-05-30T16:42:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5cc7e00640 1 -- 172.21.15.144:0/3998407542 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00db40 con 0x55889e6f1490 2024-05-30T16:42:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5cc7e00640 1 -- 172.21.15.144:0/3998407542 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc020450 con 0x55889e6f1490 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5ce5a19740 1 -- 172.21.15.144:0/3998407542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f1490 msgr2=0x55889e6f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/3998407542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f1490 0x55889e6f4c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc005bc0 tx=0x7f5ccc010000 comp rx=0 tx=0).stop 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5ce5a19740 1 -- 172.21.15.144:0/3998407542 shutdown_connections 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/3998407542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e7115d0 0x55889e711a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/3998407542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e6f5150 0x55889e711090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/3998407542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f1490 0x55889e6f4c10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.514+0000 7f5ce5a19740 1 -- 172.21.15.144:0/3998407542 >> 172.21.15.144:0/3998407542 conn(0x55889e6c7470 msgr2=0x55889e6c8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.515+0000 7f5ce5a19740 1 -- 172.21.15.144:0/3998407542 shutdown_connections 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.515+0000 7f5ce5a19740 1 -- 172.21.15.144:0/3998407542 wait complete. 2024-05-30T16:42:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.515+0000 7f5ce5a19740 1 -- start start 2024-05-30T16:42:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.515+0000 7f5ce5a19740 1 Processor -- start 2024-05-30T16:42:06.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.516+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.516+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e6c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.516+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e6c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.516+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55889e6c52a0 con 0x55889e6f5150 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.516+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55889e5e8570 con 0x55889e7115d0 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.516+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55889e6c5580 con 0x55889e6f6e20 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5ce5a19740 10 client.0 _ll_register_callbacks cb 0x55889e5b6fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6f08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42066/0 (socket says 172.21.15.144:42066) 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdbe00640 1 -- 172.21.15.144:0/1515867956 learned_addr learned my addr 172.21.15.144:0/1515867956 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdb400640 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e6c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdbe00640 1 -- 172.21.15.144:0/1515867956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 msgr2=0x55889e6c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e6c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdbe00640 1 -- 172.21.15.144:0/1515867956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 msgr2=0x55889e6c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e6c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdbe00640 1 -- 172.21.15.144:0/1515867956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55889e40b6b0 con 0x55889e6f5150 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6f08d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc013000 tx=0x7f5ccc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b14f4e14d5eed96 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cc4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cc4c00640 1 -- 172.21.15.144:0/1515867956 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc020960 con 0x55889e6f5150 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5cc4c00640 1 -- 172.21.15.144:0/1515867956 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5ccc020b00 con 0x55889e6f5150 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.517+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1515867956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ccc00db40 con 0x55889e6f5150 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5cc4c00640 1 -- 172.21.15.144:0/1515867956 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f5ccc036050 con 0x55889e6f5150 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5ce5a19740 10 client.4572 fetch_fsmap learned FSMap version 8 2024-05-30T16:42:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1515867956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55889e7232c0 con 0x55889e6f5150 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5cc4c00640 1 -- 172.21.15.144:0/1515867956 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00db40 con 0x55889e6f5150 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5cc4c00640 1 -- 172.21.15.144:0/1515867956 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f5ccc039020 con 0x55889e6f5150 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5ce5a19740 10 client.4572 fetch_fsmap finished waiting for FSMap version 8 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5ce5a19740 10 client.4572 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5ce5a19740 20 client.4572 populate_metadata read hostname 'smithi144' 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] conn(0x55889e6f7d40 0x55889e6f8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5ce5a19740 4 client.4572 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1515867956 --> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55889e63c530 con 0x55889e6f7d40 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.518+0000 7f5cdb400640 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] conn(0x55889e6f7d40 0x55889e6f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.519+0000 7f5cc4c00640 10 client.4572 ms_handle_connect on v2:172.21.15.144:6835/1315513290 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.519+0000 7f5cdb400640 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] conn(0x55889e6f7d40 0x55889e6f8120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3134e519ca873d4a server_cookie=bf2f7f1f11caaee8 in_seq=0 out_seq=0 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5cc4c00640 1 -- 172.21.15.144:0/1515867956 <== mds.0 v2:172.21.15.144:6835/1315513290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55889e63c530 con 0x55889e6f7d40 2024-05-30T16:42:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5cc4c00640 10 client.4572 handle_command_reply: tid=0 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5ce5a19740 1 client.4572 shutdown 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1515867956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 msgr2=0x55889e6f08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6f08d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc013000 tx=0x7f5ccc012000 comp rx=0 tx=0).stop 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1515867956 shutdown_connections 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e6c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] conn(0x55889e6f7d40 0x55889e6f8120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e6c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1515867956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6f08d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5cc4c00640 0 client.4572 ms_handle_reset on v2:172.21.15.144:6835/1315513290 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.520+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1515867956 >> 172.21.15.144:0/1515867956 conn(0x55889e6f1490 msgr2=0x55889e70fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.521+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1515867956 shutdown_connections 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.521+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1515867956 wait complete. 2024-05-30T16:42:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.521+0000 7f5ce5a19740 20 client.4572 trim_cache size 0 max 16384 2024-05-30T16:42:06.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.540+0000 7f5ce5a19740 1 Processor -- start 2024-05-30T16:42:06.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.540+0000 7f5ce5a19740 1 -- start start 2024-05-30T16:42:06.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.541+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.541+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e733420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.541+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e733960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.541+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc200b30 con 0x55889e6f5150 2024-05-30T16:42:06.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.541+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc1ffbb0 con 0x55889e7115d0 2024-05-30T16:42:06.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.541+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5cdc1fef10 con 0x55889e6f6e20 2024-05-30T16:42:06.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.541+0000 7f5cdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.541+0000 7f5cdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42080/0 (socket says 172.21.15.144:42080) 2024-05-30T16:42:06.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.541+0000 7f5cdbe00640 1 -- 172.21.15.144:0/1591307641 learned_addr learned my addr 172.21.15.144:0/1591307641 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cdbe00640 1 -- 172.21.15.144:0/1591307641 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 msgr2=0x55889e733420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cdb400640 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e733420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5ce0c00640 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e733960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e733420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cdbe00640 1 -- 172.21.15.144:0/1591307641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 msgr2=0x55889e733960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e733960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cdbe00640 1 -- 172.21.15.144:0/1591307641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55889e6c0aa0 con 0x55889e6f5150 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5ce0c00640 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e733960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6cb070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc007e80 tx=0x7f5ccc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9126f17862d4d6c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cc7400640 1 -- 172.21.15.144:0/1591307641 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc020960 con 0x55889e6f5150 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cc7400640 1 -- 172.21.15.144:0/1591307641 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc020b00 con 0x55889e6f5150 2024-05-30T16:42:06.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.542+0000 7f5cc7400640 1 -- 172.21.15.144:0/1591307641 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc02c700 con 0x55889e6f5150 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.543+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1591307641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 msgr2=0x55889e6cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.543+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6cb070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc007e80 tx=0x7f5ccc01c000 comp rx=0 tx=0).stop 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.543+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1591307641 shutdown_connections 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.543+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e733960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.543+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e733420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.543+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/1591307641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e6cb070 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.543+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1591307641 >> 172.21.15.144:0/1591307641 conn(0x55889e6f1490 msgr2=0x55889e71f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.543+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1591307641 shutdown_connections 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.543+0000 7f5ce5a19740 1 -- 172.21.15.144:0/1591307641 wait complete. 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.544+0000 7f5ce5a19740 1 -- start start 2024-05-30T16:42:06.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.544+0000 7f5ce5a19740 1 Processor -- start 2024-05-30T16:42:06.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e785da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e70fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5ce5a19740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e710120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55889e6c52a0 con 0x55889e6f5150 2024-05-30T16:42:06.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc1ff560 con 0x55889e7115d0 2024-05-30T16:42:06.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5ce5a19740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55889e723880 con 0x55889e6f6e20 2024-05-30T16:42:06.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5ce5a19740 10 client.0 _ll_register_callbacks cb 0x7f5ccc005980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:42:06.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5cdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e785da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5cdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e785da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42092/0 (socket says 172.21.15.144:42092) 2024-05-30T16:42:06.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5cdbe00640 1 -- 172.21.15.144:0/2696361872 learned_addr learned my addr 172.21.15.144:0/2696361872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:06.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5cdbe00640 1 -- 172.21.15.144:0/2696361872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 msgr2=0x55889e70fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:06.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e70fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5cdbe00640 1 -- 172.21.15.144:0/2696361872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 msgr2=0x55889e710120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:06.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e710120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.545+0000 7f5cdbe00640 1 -- 172.21.15.144:0/2696361872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55889e7862e0 con 0x55889e6f5150 2024-05-30T16:42:06.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5cdbe00640 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e785da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc005a30 tx=0x7f5ccc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c08b9ecf1b246a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:06.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5cc4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:42:06.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5cc4c00640 1 -- 172.21.15.144:0/2696361872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc02c910 con 0x55889e6f5150 2024-05-30T16:42:06.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5cc4c00640 1 -- 172.21.15.144:0/2696361872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5ccc02cab0 con 0x55889e6f5150 2024-05-30T16:42:06.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5ce5a19740 1 -- 172.21.15.144:0/2696361872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ccc020b00 con 0x55889e6f5150 2024-05-30T16:42:06.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5cc4c00640 1 -- 172.21.15.144:0/2696361872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f5ccc00db20 con 0x55889e6f5150 2024-05-30T16:42:06.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5ce5a19740 10 client.4578 fetch_fsmap learned FSMap version 8 2024-05-30T16:42:06.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5ce5a19740 1 -- 172.21.15.144:0/2696361872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55889e6c52a0 con 0x55889e6f5150 2024-05-30T16:42:06.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5cc4c00640 1 -- 172.21.15.144:0/2696361872 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc020b00 con 0x55889e6f5150 2024-05-30T16:42:06.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5cc4c00640 1 -- 172.21.15.144:0/2696361872 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f5ccc039030 con 0x55889e6f5150 2024-05-30T16:42:06.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.546+0000 7f5ce5a19740 10 client.4578 fetch_fsmap finished waiting for FSMap version 8 2024-05-30T16:42:06.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5ce5a19740 10 client.4578 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T16:42:06.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5ce5a19740 20 client.4578 populate_metadata read hostname 'smithi144' 2024-05-30T16:42:06.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] conn(0x55889e6ca050 0x55889e6ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:06.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5ce5a19740 4 client.4578 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:42:06.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5ce5a19740 1 -- 172.21.15.144:0/2696361872 --> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] -- command(tid 0: {"prefix": "status"}) -- 0x55889e6f6c70 con 0x55889e6ca050 2024-05-30T16:42:06.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5cdb400640 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] conn(0x55889e6ca050 0x55889e6ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:06.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5cdb400640 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] conn(0x55889e6ca050 0x55889e6ca430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3f9fc94f28584a server_cookie=7b8516834eff9375 in_seq=0 out_seq=0 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5cc4c00640 10 client.4578 ms_handle_connect on v2:172.21.15.144:6835/1315513290 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5cc4c00640 1 -- 172.21.15.144:0/2696361872 <== mds.0 v2:172.21.15.144:6835/1315513290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55889e6f6c70 con 0x55889e6ca050 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5cc4c00640 10 client.4578 handle_command_reply: tid=0 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.547+0000 7f5ce5a19740 1 client.4578 shutdown 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 -- 172.21.15.144:0/2696361872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 msgr2=0x55889e785da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e785da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc005a30 tx=0x7f5ccc000ed0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 -- 172.21.15.144:0/2696361872 shutdown_connections 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.144:6835/1315513290,v1:172.21.15.144:6837/1315513290] conn(0x55889e6ca050 0x55889e6ca430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55889e7115d0 0x55889e710120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55889e6f6e20 0x55889e70fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 --2- 172.21.15.144:0/2696361872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55889e6f5150 0x55889e785da0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5cc4c00640 0 client.4578 ms_handle_reset on v2:172.21.15.144:6835/1315513290 2024-05-30T16:42:06.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 -- 172.21.15.144:0/2696361872 >> 172.21.15.144:0/2696361872 conn(0x55889e6f1490 msgr2=0x55889e71f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 -- 172.21.15.144:0/2696361872 shutdown_connections 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 1 -- 172.21.15.144:0/2696361872 wait complete. 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.548+0000 7f5ce5a19740 20 client.4578 trim_cache size 0 max 16384 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4279, 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-05-30T16:42:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-05-30T16:42:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 13.201871066000001, 2024-05-30T16:42:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 8, 2024-05-30T16:42:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 20, 2024-05-30T16:42:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 20, 2024-05-30T16:42:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 19.301050972999999 2024-05-30T16:42:06.559 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 -- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5cbc06c8f0 msgr2=0x7f5cbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5cbc06c8f0 0x7f5cbc06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0011e0 tx=0x7f5ccc009040 comp rx=0 tx=0).stop 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 -- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0cf6c0 msgr2=0x7f5cdc13dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0cf6c0 0x7f5cdc13dc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8035040 tx=0x7f5cc80046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 -- 172.21.15.144:0/1816359029 shutdown_connections 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5cbc06c8f0 0x7f5cbc06edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cdc15cb20 0x7f5cdc15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0cf6c0 0x7f5cdc13dc00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 --2- 172.21.15.144:0/1816359029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cdc0b2b70 0x7f5cdc0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 -- 172.21.15.144:0/1816359029 >> 172.21.15.144:0/1816359029 conn(0x7f5cdc0627b0 msgr2=0x7f5cdc15df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 -- 172.21.15.144:0/1816359029 shutdown_connections 2024-05-30T16:42:06.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:06.549+0000 7f5ce1600640 1 -- 172.21.15.144:0/1816359029 wait complete. 2024-05-30T16:42:06.566 INFO:teuthology.run_tasks:Running task sequential... 2024-05-30T16:42:06.617 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-30T16:42:06.617 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-30T16:42:06.617 INFO:teuthology.task.print:Enabling mgr modules 2024-05-30T16:42:06.617 INFO:teuthology.run_tasks:Running task kclient... 2024-05-30T16:42:06.670 INFO:tasks.kclient:Mounting kernel clients... 2024-05-30T16:42:06.671 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-30T16:42:06.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:06.671 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:42:06.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:06.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-05-30T16:42:06.811 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-05-30T16:42:06.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:42:06.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:06.815 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:42:06.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:06.866 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-05-30T16:42:06.943 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-05-30T16:42:06.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:42:06.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:06.947 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-30T16:42:07.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:07.006 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-05-30T16:42:07.100 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-05-30T16:42:07.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:42:07.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:07.104 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-30T16:42:07.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:07.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-05-30T16:42:07.239 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-05-30T16:42:07.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:42:07.243 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-30T16:42:07.243 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T16:42:07.243 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:42:07.243 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:42:07.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.451+0000 7f198a400640 1 Processor -- start 2024-05-30T16:42:07.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.451+0000 7f198a400640 1 -- start start 2024-05-30T16:42:07.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.452+0000 7f198a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 0x7f198415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:07.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.452+0000 7f198a400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19840cf8b0 0x7f19840b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:07.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.452+0000 7f198a400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f198415f500 con 0x7f19840cb2f0 2024-05-30T16:42:07.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.452+0000 7f198a400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f198415f780 con 0x7f19840cf8b0 2024-05-30T16:42:07.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.452+0000 7f198a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f198415fa60 con 0x7f19840caf10 2024-05-30T16:42:07.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.453+0000 7f1989a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19840cf8b0 0x7f19840b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:07.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.453+0000 7f1989a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19840cf8b0 0x7f19840b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42104/0 (socket says 172.21.15.144:42104) 2024-05-30T16:42:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.453+0000 7f1989a00640 1 -- 172.21.15.144:0/4125142341 learned_addr learned my addr 172.21.15.144:0/4125142341 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.453+0000 7f1989000640 1 --2- 172.21.15.144:0/4125142341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 0x7f198415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.453+0000 7f1989a00640 1 -- 172.21.15.144:0/4125142341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 msgr2=0x7f198415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.453+0000 7f1989a00640 1 --2- 172.21.15.144:0/4125142341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 0x7f198415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.453+0000 7f1989a00640 1 -- 172.21.15.144:0/4125142341 >> v1:172.21.15.149:6789/0 conn(0x7f19840cb2f0 legacy=0x7f198415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.453+0000 7f1989a00640 1 -- 172.21.15.144:0/4125142341 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198415fd40 con 0x7f19840cf8b0 2024-05-30T16:42:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.454+0000 7f1989a00640 1 --2- 172.21.15.144:0/4125142341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 0x7f19840b31c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f197c009870 tx=0x7f197c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d871e1dbd7824c1a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.454+0000 7f1983400640 1 -- 172.21.15.144:0/4125142341 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c037070 con 0x7f19840cf8b0 2024-05-30T16:42:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f1983400640 1 -- 172.21.15.144:0/4125142341 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197c032440 con 0x7f19840cf8b0 2024-05-30T16:42:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f1983400640 1 -- 172.21.15.144:0/4125142341 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c032810 con 0x7f19840cf8b0 2024-05-30T16:42:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f198a400640 1 -- 172.21.15.144:0/4125142341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 msgr2=0x7f19840b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f198a400640 1 --2- 172.21.15.144:0/4125142341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 0x7f19840b31c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f197c009870 tx=0x7f197c02a210 comp rx=0 tx=0).stop 2024-05-30T16:42:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f198a400640 1 -- 172.21.15.144:0/4125142341 shutdown_connections 2024-05-30T16:42:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f198a400640 1 --2- 172.21.15.144:0/4125142341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 0x7f19840b31c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f198a400640 1 --2- 172.21.15.144:0/4125142341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 0x7f198415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f198a400640 1 -- 172.21.15.144:0/4125142341 >> 172.21.15.144:0/4125142341 conn(0x7f19840b20a0 msgr2=0x7f19840b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f198a400640 1 -- 172.21.15.144:0/4125142341 shutdown_connections 2024-05-30T16:42:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.455+0000 7f198a400640 1 -- 172.21.15.144:0/4125142341 wait complete. 2024-05-30T16:42:07.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.458+0000 7f198a400640 1 Processor -- start 2024-05-30T16:42:07.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.458+0000 7f198a400640 1 -- start start 2024-05-30T16:42:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.459+0000 7f198a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 0x7f1984147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.459+0000 7f198a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19840cb2f0 0x7f198409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.459+0000 7f198a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 0x7f198409a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.459+0000 7f198a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f198415bad0 con 0x7f19840cf8b0 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.459+0000 7f198a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f198415b950 con 0x7f19840cb2f0 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.459+0000 7f198a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f19840b3700 con 0x7f19840caf10 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.459+0000 7f1989a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 0x7f198409a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.459+0000 7f1989a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 0x7f198409a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42112/0 (socket says 172.21.15.144:42112) 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.459+0000 7f1989a00640 1 -- 172.21.15.144:0/2920620886 learned_addr learned my addr 172.21.15.144:0/2920620886 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1989000640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 0x7f1984147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1983e00640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19840cb2f0 0x7f198409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1989a00640 1 -- 172.21.15.144:0/2920620886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 msgr2=0x7f1984147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1989a00640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 0x7f1984147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1989a00640 1 -- 172.21.15.144:0/2920620886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19840cb2f0 msgr2=0x7f198409a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:07.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1989a00640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19840cb2f0 0x7f198409a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1989a00640 1 -- 172.21.15.144:0/2920620886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19840731a0 con 0x7f19840cf8b0 2024-05-30T16:42:07.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1983e00640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19840cb2f0 0x7f198409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1989a00640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 0x7f198409a7f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f197c02a250 tx=0x7f197c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1980c00640 1 -- 172.21.15.144:0/2920620886 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c041020 con 0x7f19840cf8b0 2024-05-30T16:42:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1980c00640 1 -- 172.21.15.144:0/2920620886 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197c0306e0 con 0x7f19840cf8b0 2024-05-30T16:42:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1984073480 con 0x7f19840cf8b0 2024-05-30T16:42:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.460+0000 7f1980c00640 1 -- 172.21.15.144:0/2920620886 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c037040 con 0x7f19840cf8b0 2024-05-30T16:42:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.461+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19841487c0 con 0x7f19840cf8b0 2024-05-30T16:42:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.462+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19840691f0 con 0x7f19840cf8b0 2024-05-30T16:42:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.463+0000 7f1980c00640 1 -- 172.21.15.144:0/2920620886 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f197c044020 con 0x7f19840cf8b0 2024-05-30T16:42:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.464+0000 7f1980c00640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f196406c8f0 0x7f196406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.464+0000 7f1980c00640 1 -- 172.21.15.144:0/2920620886 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f197c0ac390 con 0x7f19840cf8b0 2024-05-30T16:42:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.464+0000 7f1989000640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f196406c8f0 0x7f196406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.465+0000 7f1989000640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f196406c8f0 0x7f196406edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1978009a60 tx=0x7f1978003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:07.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.469+0000 7f1980c00640 1 -- 172.21.15.144:0/2920620886 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19840691f0 con 0x7f19840cf8b0 2024-05-30T16:42:07.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.713+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f19841482d0 con 0x7f19840cf8b0 2024-05-30T16:42:07.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.714+0000 7f1980c00640 1 -- 172.21.15.144:0/2920620886 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f197c04b030 con 0x7f19840cf8b0 2024-05-30T16:42:07.715 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:42:07.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.716+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f196406c8f0 msgr2=0x7f196406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:07.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.716+0000 7f198a400640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f196406c8f0 0x7f196406edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1978009a60 tx=0x7f1978003990 comp rx=0 tx=0).stop 2024-05-30T16:42:07.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.716+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 msgr2=0x7f198409a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:07.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.716+0000 7f198a400640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 0x7f198409a7f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f197c02a250 tx=0x7f197c0046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.717+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 shutdown_connections 2024-05-30T16:42:07.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.717+0000 7f198a400640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f196406c8f0 0x7f196406edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.717+0000 7f198a400640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840cf8b0 0x7f198409a7f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.717+0000 7f198a400640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19840cb2f0 0x7f198409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.717+0000 7f198a400640 1 --2- 172.21.15.144:0/2920620886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19840caf10 0x7f1984147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:07.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.717+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 >> 172.21.15.144:0/2920620886 conn(0x7f19840b20a0 msgr2=0x7f19840cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:07.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.717+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 shutdown_connections 2024-05-30T16:42:07.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07.717+0000 7f198a400640 1 -- 172.21.15.144:0/2920620886 wait complete. 2024-05-30T16:42:07.738 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:42:07.738 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:42:07.738 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-05-30T16:42:07.739 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:42:07.739 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:42:07.739 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:42:07.739 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:42:07.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:42:07.739 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:42:07.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:07.739 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-05-30T16:42:07.788 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:42:07.788 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:42:07.788 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:42:07.788 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:07.788 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:42:07.789 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42559sec preferred_lft 42559sec 2024-05-30T16:42:07.790 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-05-30T16:42:07.790 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:07.790 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-30T16:42:07.791 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:07.791 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:07.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2024-05-30T16:42:07.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2024-05-30T16:42:07.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2024-05-30T16:42:07.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-30T16:42:07.791 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:08.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:08.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:08.280 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:42:08.346 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-05-30T16:42:08.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:08.349 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-05-30T16:42:08.400 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-05-30T16:42:08.400 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:42:08.400 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:42:08.400 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:42:08.400 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:42:08.401 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:08.401 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:08.401 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:42:08.401 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:42:08.401 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:42:08.401 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:08.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:09.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:09.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:09.169 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:42:09.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:09.220 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2024-05-30T16:42:09.269 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:09.269 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:09.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:42:09.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-30T16:42:09.269 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:09.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:09.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:09.458 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-30T16:42:09.458 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:09.458 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:09.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-30T16:42:09.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-30T16:42:09.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-30T16:42:09.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-30T16:42:09.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-30T16:42:09.459 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:09.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:09.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:09.757 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:09.757 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:09.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-05-30T16:42:09.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2024-05-30T16:42:09.758 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:09.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:09.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:09.956 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:42:09.998 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:42:09.999 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:09.999 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:42:10.090 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T16:42:10.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:10.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:10.219 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:10.220 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:10.953 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:10.953 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:10.953 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-05-30T16:42:10.953 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@865cdc9a-e28b-4870-8751-0312b261bc38.cephfs=/ 2024-05-30T16:42:10.953 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-05-30T16:42:10.957 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-30T16:42:10.957 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-05-30T16:42:10.957 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-30T16:42:10.957 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-05-30T16:42:10.957 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-30T16:42:10.961 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T16:42:10.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:10.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:42:11.041 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:11.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:11.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:11.179 INFO:teuthology.orchestra.run.smithi144.stdout:client4587 2024-05-30T16:42:11.179 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:11.179 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:11.233 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:11.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:11.363 INFO:teuthology.orchestra.run.smithi144.stdout:client4587 2024-05-30T16:42:11.363 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:11.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:11.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:11.495 INFO:teuthology.orchestra.run.smithi144.stdout:client4587 2024-05-30T16:42:11.496 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/865cdc9a-e28b-4870-8751-0312b261bc38.client4587/status') 2024-05-30T16:42:11.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:11.635 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4587 (3)192.168.0.1:0/1347567124 2024-05-30T16:42:11.635 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2024-05-30T16:42:11.635 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2024-05-30T16:42:11.635 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2024-05-30T16:42:11.636 INFO:teuthology.orchestra.run.smithi144.stderr:69 bytes copied, 7.839e-05 s, 880 kB/s 2024-05-30T16:42:11.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:11.648 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-05-30T16:42:11.649 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T16:42:11.649 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-30T16:42:11.649 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:42:11.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.841+0000 7fd81ca00640 1 Processor -- start 2024-05-30T16:42:11.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.841+0000 7fd81ca00640 1 -- start start 2024-05-30T16:42:11.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.842+0000 7fd81ca00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd8180cc0b0 0x7fd81815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:11.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.843+0000 7fd81ca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd81815da70 con 0x7fd81806b8e0 2024-05-30T16:42:11.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.843+0000 7fd81ca00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd818160ec0 con 0x7fd81806fcf0 2024-05-30T16:42:11.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.843+0000 7fd81ca00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd8180ccd20 con 0x7fd8180cc0b0 2024-05-30T16:42:11.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.843+0000 7fd80ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd81806b8e0 0x7fd8181600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46448/0 (socket says 172.21.15.144:46448) 2024-05-30T16:42:11.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.843+0000 7fd80ea00640 1 -- 172.21.15.144:0/1215896827 learned_addr learned my addr 172.21.15.144:0/1215896827 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:11.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.843+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1019180564 0 0) 0x7fd800001110 con 0x7fd81806b8e0 2024-05-30T16:42:11.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.843+0000 7fd817400640 1 --2- 172.21.15.144:0/1215896827 >> v2:172.21.15.149:3300/0 conn(0x7fd8180cc0b0 0x7fd81815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:11.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.843+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7fc003520 con 0x7fd81806b8e0 2024-05-30T16:42:11.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1089748875 0 0) 0x7fd7fc003520 con 0x7fd81806b8e0 2024-05-30T16:42:11.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 >> v2:172.21.15.149:3300/0 conn(0x7fd8180cc0b0 msgr2=0x7fd81815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:11.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 --2- 172.21.15.144:0/1215896827 >> v2:172.21.15.149:3300/0 conn(0x7fd8180cc0b0 0x7fd81815d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:11.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 >> v1:172.21.15.149:6789/0 conn(0x7fd81806fcf0 legacy=0x7fd8181607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:11.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8180cd000 con 0x7fd81806b8e0 2024-05-30T16:42:11.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fd800001840 con 0x7fd81806b8e0 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 >> v1:172.21.15.144:6789/0 conn(0x7fd81806b8e0 legacy=0x7fd8181600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7fc004800 0x7fd7fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7fc0052e0 0x7fd7fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180ccd20 con 0x7fd7fc004800 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc00c1b0 con 0x7fd7fc0039b0 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd7fc00c3b0 con 0x7fd7fc0052e0 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd80ea00640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7fc004800 0x7fd7fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.844+0000 7fd817400640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.845+0000 7fd80ea00640 1 -- 172.21.15.144:0/1215896827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7fc0052e0 msgr2=0x7fd7fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.845+0000 7fd80ea00640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7fc0052e0 0x7fd7fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:11.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.845+0000 7fd80ea00640 1 -- 172.21.15.144:0/1215896827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc0039b0 msgr2=0x7fd7fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:11.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.845+0000 7fd80ea00640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:11.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.845+0000 7fd80ea00640 1 -- 172.21.15.144:0/1215896827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7fc003520 con 0x7fd7fc004800 2024-05-30T16:42:11.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.845+0000 7fd817400640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:11.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.845+0000 7fd817e00640 1 -- 172.21.15.144:0/1215896827 reap_dead start 2024-05-30T16:42:11.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.846+0000 7fd80ea00640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7fc004800 0x7fd7fc004c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c490 tx=0x7fd7fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922f089953016a5d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:11.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.846+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80000c0e0 con 0x7fd7fc004800 2024-05-30T16:42:11.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.846+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd800034070 con 0x7fd7fc004800 2024-05-30T16:42:11.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.846+0000 7fd816a00640 1 -- 172.21.15.144:0/1215896827 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800005d70 con 0x7fd7fc004800 2024-05-30T16:42:11.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.846+0000 7fd81ca00640 1 -- 172.21.15.144:0/1215896827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7fc004800 msgr2=0x7fd7fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:11.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.846+0000 7fd81ca00640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7fc004800 0x7fd7fc004c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c490 tx=0x7fd7fc005830 comp rx=0 tx=0).stop 2024-05-30T16:42:11.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.846+0000 7fd81ca00640 1 -- 172.21.15.144:0/1215896827 shutdown_connections 2024-05-30T16:42:11.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.846+0000 7fd81ca00640 1 --2- 172.21.15.144:0/1215896827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7fc004800 0x7fd7fc004c80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:11.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.847+0000 7fd81ca00640 1 -- 172.21.15.144:0/1215896827 >> 172.21.15.144:0/1215896827 conn(0x7fd8180b20a0 msgr2=0x7fd8180b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:11.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.847+0000 7fd81ca00640 1 -- 172.21.15.144:0/1215896827 shutdown_connections 2024-05-30T16:42:11.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.847+0000 7fd81ca00640 1 -- 172.21.15.144:0/1215896827 wait complete. 2024-05-30T16:42:11.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.848+0000 7fd81ca00640 1 Processor -- start 2024-05-30T16:42:11.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.848+0000 7fd81ca00640 1 -- start start 2024-05-30T16:42:11.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.849+0000 7fd81ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7fc004800 0x7fd8180b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.849+0000 7fd81ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd81814b760 0x7fd818072780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.849+0000 7fd81ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8180c9540 0x7fd8180c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.849+0000 7fd81ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180cc9e0 con 0x7fd8180c9540 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.849+0000 7fd81ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180cd5c0 con 0x7fd81814b760 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.849+0000 7fd81ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd8180cc490 con 0x7fd7fc004800 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd817e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8180c9540 0x7fd8180c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd817e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8180c9540 0x7fd8180c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42134/0 (socket says 172.21.15.144:42134) 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd817e00640 1 -- 172.21.15.144:0/2502248720 learned_addr learned my addr 172.21.15.144:0/2502248720 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd817400640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7fc004800 0x7fd8180b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd80ea00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd81814b760 0x7fd818072780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:11.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd817e00640 1 -- 172.21.15.144:0/2502248720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7fc004800 msgr2=0x7fd8180b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:11.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd817e00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7fc004800 0x7fd8180b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:11.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd817e00640 1 -- 172.21.15.144:0/2502248720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd81814b760 msgr2=0x7fd818072780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:11.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd817e00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd81814b760 0x7fd818072780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:11.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd817e00640 1 -- 172.21.15.144:0/2502248720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8180b12c0 con 0x7fd8180c9540 2024-05-30T16:42:11.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.850+0000 7fd80ea00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd81814b760 0x7fd818072780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:11.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.851+0000 7fd817e00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8180c9540 0x7fd8180c99c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd81806e640 tx=0x7fd81000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:11.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.851+0000 7fd80fe00640 1 -- 172.21.15.144:0/2502248720 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810017070 con 0x7fd8180c9540 2024-05-30T16:42:11.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.851+0000 7fd80fe00640 1 -- 172.21.15.144:0/2502248720 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd810005d60 con 0x7fd8180c9540 2024-05-30T16:42:11.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.851+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8180b15a0 con 0x7fd8180c9540 2024-05-30T16:42:11.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.851+0000 7fd80fe00640 1 -- 172.21.15.144:0/2502248720 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81000a850 con 0x7fd8180c9540 2024-05-30T16:42:11.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.852+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd818072cc0 con 0x7fd8180c9540 2024-05-30T16:42:11.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.853+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8180ce040 con 0x7fd8180c9540 2024-05-30T16:42:11.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.854+0000 7fd80fe00640 1 -- 172.21.15.144:0/2502248720 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd81001a070 con 0x7fd8180c9540 2024-05-30T16:42:11.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.855+0000 7fd80fe00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd7f406c8f0 0x7fd7f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:11.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.855+0000 7fd80fe00640 1 -- 172.21.15.144:0/2502248720 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd81008af10 con 0x7fd8180c9540 2024-05-30T16:42:11.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.855+0000 7fd817400640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd7f406c8f0 0x7fd7f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:11.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.856+0000 7fd817400640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd7f406c8f0 0x7fd7f406edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd8180690c0 tx=0x7fd808008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:11.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:11.860+0000 7fd80fe00640 1 -- 172.21.15.144:0/2502248720 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd8100592a0 con 0x7fd8180c9540 2024-05-30T16:42:12.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.106+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd818075570 con 0x7fd8180c9540 2024-05-30T16:42:12.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.106+0000 7fd80fe00640 1 -- 172.21.15.144:0/2502248720 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd810058ba0 con 0x7fd8180c9540 2024-05-30T16:42:12.107 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd7f406c8f0 msgr2=0x7fd7f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd7f406c8f0 0x7fd7f406edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd8180690c0 tx=0x7fd808008040 comp rx=0 tx=0).stop 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8180c9540 msgr2=0x7fd8180c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8180c9540 0x7fd8180c99c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd81806e640 tx=0x7fd81000cb90 comp rx=0 tx=0).stop 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 shutdown_connections 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd7f406c8f0 0x7fd7f406edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8180c9540 0x7fd8180c99c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd81814b760 0x7fd818072780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 --2- 172.21.15.144:0/2502248720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7fc004800 0x7fd8180b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 >> 172.21.15.144:0/2502248720 conn(0x7fd8180b20a0 msgr2=0x7fd8180d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 shutdown_connections 2024-05-30T16:42:12.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12.109+0000 7fd81ca00640 1 -- 172.21.15.144:0/2502248720 wait complete. 2024-05-30T16:42:12.129 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:42:12.129 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:42:12.129 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-05-30T16:42:12.129 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-30T16:42:12.129 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-30T16:42:12.130 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:42:12.130 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:42:12.130 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:42:12.130 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-30T16:42:12.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:12.130 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-05-30T16:42:12.179 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:42:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:42:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:42:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42554sec preferred_lft 42554sec 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9019:bbff:fe7f:ed10/64 scope link 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9c4d:5aff:fe40:b9d1/64 scope link 2024-05-30T16:42:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:12.182 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:42:12.257 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-05-30T16:42:12.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:12.261 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-05-30T16:42:12.314 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-05-30T16:42:12.314 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:42:12.314 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:42:12.314 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:42:12.314 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:42:12.314 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:12.314 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:12.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:42:12.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:42:12.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:42:12.315 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:12.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:12.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:12.524 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:42:12.571 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:42:12.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:12.572 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2024-05-30T16:42:12.620 INFO:teuthology.orchestra.run.smithi144.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-30T16:42:12.621 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:12.621 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:12.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:42:12.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-30T16:42:12.621 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:12.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:12.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:12.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:12.806 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-30T16:42:12.880 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 06:38:72:9b:bf:fe brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::438:72ff:fe9b:bffe/64 scope link 2024-05-30T16:42:12.881 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:12.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-30T16:42:12.968 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:42:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:42:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:42:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-05-30T16:42:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.968 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:42:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 06:38:72:9b:bf:fe brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T16:42:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T16:42:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::438:72ff:fe9b:bffe/64 scope link 2024-05-30T16:42:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:12.972 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-30T16:42:12.973 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:12.973 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:12.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-30T16:42:12.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-30T16:42:12.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-30T16:42:12.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-30T16:42:12.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-30T16:42:12.973 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:13.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:13.255 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:13.256 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:13.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.1 up 2024-05-30T16:42:13.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.1 master ceph-brx 2024-05-30T16:42:13.256 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:13.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:13.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:13.463 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-30T16:42:13.512 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-30T16:42:13.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:13.513 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-30T16:42:13.564 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-05-30T16:42:13.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:13.564 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:13.691 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:13.691 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:13.725 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:13.725 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:13.725 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-05-30T16:42:13.725 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 2@865cdc9a-e28b-4870-8751-0312b261bc38.cephfs=/ 2024-05-30T16:42:13.725 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.144:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-05-30T16:42:13.728 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-30T16:42:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-05-30T16:42:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-30T16:42:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-05-30T16:42:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-30T16:42:13.732 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T16:42:13.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:13.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-30T16:42:13.801 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:13.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:13.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:13.915 INFO:teuthology.orchestra.run.smithi144.stdout:client4528 2024-05-30T16:42:13.916 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:13.916 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:13.964 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:14.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:14.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:14.125 INFO:teuthology.orchestra.run.smithi144.stdout:client4528 2024-05-30T16:42:14.126 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:14.242 INFO:teuthology.orchestra.run.smithi144.stdout:client4528 2024-05-30T16:42:14.242 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/865cdc9a-e28b-4870-8751-0312b261bc38.client4528/status') 2024-05-30T16:42:14.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:14.375 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4528 (3)172.21.15.144:0/2769030615 2024-05-30T16:42:14.375 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2024-05-30T16:42:14.375 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2024-05-30T16:42:14.376 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2024-05-30T16:42:14.376 INFO:teuthology.orchestra.run.smithi144.stderr:71 bytes copied, 0.000114802 s, 618 kB/s 2024-05-30T16:42:14.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:14.387 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-05-30T16:42:14.387 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T16:42:14.388 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-30T16:42:14.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:42:14.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.584+0000 7f53c7800640 1 Processor -- start 2024-05-30T16:42:14.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.584+0000 7f53c7800640 1 -- start start 2024-05-30T16:42:14.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.586+0000 7f53c7800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53c013f760 0x7f53c006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:14.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.586+0000 7f53c7800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c006ee80 con 0x7f53c00b5fd0 2024-05-30T16:42:14.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.586+0000 7f53c7800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c0160730 con 0x7f53c00cec70 2024-05-30T16:42:14.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.586+0000 7f53c7800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f53c01612b0 con 0x7f53c013f760 2024-05-30T16:42:14.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.586+0000 7f53c5800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f53c00b5fd0 0x7f53c0142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46464/0 (socket says 172.21.15.144:46464) 2024-05-30T16:42:14.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.586+0000 7f53c5800640 1 -- 172.21.15.144:0/661984981 learned_addr learned my addr 172.21.15.144:0/661984981 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:14.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557872543 0 0) 0x7f53c006ee80 con 0x7f53c00b5fd0 2024-05-30T16:42:14.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53a8003520 con 0x7f53c00b5fd0 2024-05-30T16:42:14.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3014671461 0 0) 0x7f53a8003520 con 0x7f53c00b5fd0 2024-05-30T16:42:14.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 >> v2:172.21.15.149:3300/0 conn(0x7f53c013f760 msgr2=0x7f53c006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:14.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 --2- 172.21.15.144:0/661984981 >> v2:172.21.15.149:3300/0 conn(0x7f53c013f760 0x7f53c006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 >> v1:172.21.15.149:6789/0 conn(0x7f53c00cec70 legacy=0x7f53c00b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c0160a10 con 0x7f53c00b5fd0 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f53b8001a10 con 0x7f53c00b5fd0 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 >> v1:172.21.15.144:6789/0 conn(0x7f53c00b5fd0 legacy=0x7f53c0142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53a8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53a8004800 0x7f53a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53a80052e0 0x7f53a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f53c01612b0 con 0x7f53a80039b0 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f53a800c1e0 con 0x7f53a8004800 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f53a800c3e0 con 0x7f53a80052e0 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.587+0000 7f53c4e00640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53a8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.588+0000 7f53bfe00640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53a8004800 0x7f53a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:14.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.588+0000 7f53c5800640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53a80052e0 0x7f53a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:14.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.588+0000 7f53c4e00640 1 -- 172.21.15.144:0/661984981 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53a80052e0 msgr2=0x7f53a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:14.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.588+0000 7f53c4e00640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53a80052e0 0x7f53a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.588+0000 7f53c4e00640 1 -- 172.21.15.144:0/661984981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53a8004800 msgr2=0x7f53a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:14.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.588+0000 7f53c4e00640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53a8004800 0x7f53a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.588+0000 7f53c4e00640 1 -- 172.21.15.144:0/661984981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a8003520 con 0x7f53a80039b0 2024-05-30T16:42:14.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.588+0000 7f53c5800640 1 -- 172.21.15.144:0/661984981 reap_dead start 2024-05-30T16:42:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.589+0000 7f53c4e00640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53a8003db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53b4006fd0 tx=0x7f53a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55496b6cb9333297 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.589+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4037070 con 0x7f53a80039b0 2024-05-30T16:42:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.589+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b402aa30 con 0x7f53a80039b0 2024-05-30T16:42:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.589+0000 7f53bf400640 1 -- 172.21.15.144:0/661984981 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4009460 con 0x7f53a80039b0 2024-05-30T16:42:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.590+0000 7f53c7800640 1 -- 172.21.15.144:0/661984981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 msgr2=0x7f53a8003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.590+0000 7f53c7800640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53a8003db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53b4006fd0 tx=0x7f53a8005830 comp rx=0 tx=0).stop 2024-05-30T16:42:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.590+0000 7f53c7800640 1 -- 172.21.15.144:0/661984981 shutdown_connections 2024-05-30T16:42:14.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.590+0000 7f53c7800640 1 --2- 172.21.15.144:0/661984981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53a8003db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.590+0000 7f53c7800640 1 -- 172.21.15.144:0/661984981 >> 172.21.15.144:0/661984981 conn(0x7f53c006bd00 msgr2=0x7f53c006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:14.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.590+0000 7f53c7800640 1 -- 172.21.15.144:0/661984981 shutdown_connections 2024-05-30T16:42:14.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.590+0000 7f53c7800640 1 -- 172.21.15.144:0/661984981 wait complete. 2024-05-30T16:42:14.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.592+0000 7f53c7800640 1 Processor -- start 2024-05-30T16:42:14.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.592+0000 7f53c7800640 1 -- start start 2024-05-30T16:42:14.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.593+0000 7f53c7800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53c00b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:14.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.593+0000 7f53c7800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c00b1cf0 0x7f53c013ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:14.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.593+0000 7f53c7800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53c00a9c90 0x7f53c00aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:14.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.593+0000 7f53c7800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f53c0160fd0 con 0x7f53a80039b0 2024-05-30T16:42:14.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.593+0000 7f53c7800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00cf0d0 con 0x7f53c00b1cf0 2024-05-30T16:42:14.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.593+0000 7f53c7800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f53c00cf250 con 0x7f53c00a9c90 2024-05-30T16:42:14.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.593+0000 7f53c4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53c00b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:14.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.593+0000 7f53c4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53c00b4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42154/0 (socket says 172.21.15.144:42154) 2024-05-30T16:42:14.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.593+0000 7f53c4e00640 1 -- 172.21.15.144:0/169117225 learned_addr learned my addr 172.21.15.144:0/169117225 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.594+0000 7f53c5800640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53c00a9c90 0x7f53c00aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.594+0000 7f53c4e00640 1 -- 172.21.15.144:0/169117225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53c00a9c90 msgr2=0x7f53c00aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.594+0000 7f53c4e00640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53c00a9c90 0x7f53c00aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.594+0000 7f53bfe00640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c00b1cf0 0x7f53c013ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.594+0000 7f53c4e00640 1 -- 172.21.15.144:0/169117225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c00b1cf0 msgr2=0x7f53c013ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.594+0000 7f53c4e00640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c00b1cf0 0x7f53c013ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.594+0000 7f53c4e00640 1 -- 172.21.15.144:0/169117225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c00b2170 con 0x7f53a80039b0 2024-05-30T16:42:14.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.594+0000 7f53c4e00640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53c00b4c00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53b4000c00 tx=0x7f53b40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:14.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.594+0000 7f53bcc00640 1 -- 172.21.15.144:0/169117225 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4041070 con 0x7f53a80039b0 2024-05-30T16:42:14.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.595+0000 7f53bcc00640 1 -- 172.21.15.144:0/169117225 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b4032a50 con 0x7f53a80039b0 2024-05-30T16:42:14.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.595+0000 7f53bcc00640 1 -- 172.21.15.144:0/169117225 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4037040 con 0x7f53a80039b0 2024-05-30T16:42:14.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.595+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c00b2440 con 0x7f53a80039b0 2024-05-30T16:42:14.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.595+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c00b2a00 con 0x7f53a80039b0 2024-05-30T16:42:14.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.596+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c0068b90 con 0x7f53a80039b0 2024-05-30T16:42:14.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.597+0000 7f53bcc00640 1 -- 172.21.15.144:0/169117225 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53b4044070 con 0x7f53a80039b0 2024-05-30T16:42:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.598+0000 7f53bcc00640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f53a406c8f0 0x7f53a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.598+0000 7f53bcc00640 1 -- 172.21.15.144:0/169117225 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f53b40abe20 con 0x7f53a80039b0 2024-05-30T16:42:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.598+0000 7f53bfe00640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f53a406c8f0 0x7f53a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:14.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.599+0000 7f53bfe00640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f53a406c8f0 0x7f53a406edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53c01f3870 tx=0x7f53b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.603+0000 7f53bcc00640 1 -- 172.21.15.144:0/169117225 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53b4032e20 con 0x7f53a80039b0 2024-05-30T16:42:14.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.847+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f53c015dfe0 con 0x7f53a80039b0 2024-05-30T16:42:14.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.848+0000 7f53bcc00640 1 -- 172.21.15.144:0/169117225 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f53b4079bf0 con 0x7f53a80039b0 2024-05-30T16:42:14.849 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:42:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.851+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f53a406c8f0 msgr2=0x7f53a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.851+0000 7f53c7800640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f53a406c8f0 0x7f53a406edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53c01f3870 tx=0x7f53b0009040 comp rx=0 tx=0).stop 2024-05-30T16:42:14.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.851+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 msgr2=0x7f53c00b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:14.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.851+0000 7f53c7800640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53c00b4c00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53b4000c00 tx=0x7f53b40047d0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.852+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 shutdown_connections 2024-05-30T16:42:14.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.852+0000 7f53c7800640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f53a406c8f0 0x7f53a406edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.852+0000 7f53c7800640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53c00a9c90 0x7f53c00aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.852+0000 7f53c7800640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c00b1cf0 0x7f53c013ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.852+0000 7f53c7800640 1 --2- 172.21.15.144:0/169117225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a80039b0 0x7f53c00b4c00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:14.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.852+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 >> 172.21.15.144:0/169117225 conn(0x7f53c006bd00 msgr2=0x7f53c0074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:14.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.852+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 shutdown_connections 2024-05-30T16:42:14.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:14.852+0000 7f53c7800640 1 -- 172.21.15.144:0/169117225 wait complete. 2024-05-30T16:42:14.873 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:42:14.873 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:42:14.873 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-05-30T16:42:14.873 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-30T16:42:14.873 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-30T16:42:14.873 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:42:14.873 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:42:14.873 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:42:14.873 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-30T16:42:14.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:14.874 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-05-30T16:42:14.930 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:42:14.930 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:42:14.930 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:42:14.930 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:14.930 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-05-30T16:42:14.930 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:14.930 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42558sec preferred_lft 42558sec 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-05-30T16:42:14.931 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:14.932 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-30T16:42:14.932 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:14.932 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-30T16:42:14.932 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2024-05-30T16:42:14.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2024-05-30T16:42:14.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2024-05-30T16:42:14.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-30T16:42:14.933 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-30T16:42:15.036 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:15.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:42:15.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:42:15.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:15.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:15.419 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:42:15.490 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-05-30T16:42:15.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:15.494 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-05-30T16:42:15.554 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-05-30T16:42:15.555 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:42:15.555 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:42:15.555 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:42:15.555 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:42:15.556 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:15.556 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-30T16:42:15.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:42:15.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:42:15.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:42:15.556 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-30T16:42:15.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:16.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:16.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:16.313 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-30T16:42:16.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:16.366 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-05-30T16:42:16.417 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:16.417 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-30T16:42:16.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:42:16.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-30T16:42:16.418 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-30T16:42:16.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:16.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:16.606 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-30T16:42:16.606 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:16.606 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-30T16:42:16.606 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-30T16:42:16.607 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-30T16:42:16.607 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-30T16:42:16.607 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-30T16:42:16.607 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-30T16:42:16.607 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-30T16:42:16.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:16.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:16.908 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:16.909 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-30T16:42:16.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-05-30T16:42:16.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2024-05-30T16:42:16.909 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-30T16:42:17.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:17.102 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:17.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:17.112 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-30T16:42:17.158 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-30T16:42:17.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:17.159 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-30T16:42:17.251 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-30T16:42:17.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:17.251 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:17.387 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:17.387 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:18.081 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:18.082 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:18.082 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-05-30T16:42:18.082 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@865cdc9a-e28b-4870-8751-0312b261bc38.cephfs=/ 2024-05-30T16:42:18.082 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-05-30T16:42:18.086 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-30T16:42:18.086 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-05-30T16:42:18.086 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-30T16:42:18.087 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-05-30T16:42:18.087 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-30T16:42:18.091 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T16:42:18.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:18.091 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-30T16:42:18.175 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:18.284 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:18.291 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:18.300 INFO:teuthology.orchestra.run.smithi149.stdout:client4397 2024-05-30T16:42:18.300 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:42:18.300 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:18.353 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:18.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:18.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:18.474 INFO:teuthology.orchestra.run.smithi149.stdout:client4397 2024-05-30T16:42:18.474 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:18.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:18.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:18.585 INFO:teuthology.orchestra.run.smithi149.stdout:client4397 2024-05-30T16:42:18.585 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/865cdc9a-e28b-4870-8751-0312b261bc38.client4397/status') 2024-05-30T16:42:18.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:18.716 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4397 (3)192.168.0.1:0/3712305413 2024-05-30T16:42:18.716 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2024-05-30T16:42:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2024-05-30T16:42:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2024-05-30T16:42:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:69 bytes copied, 9.8363e-05 s, 701 kB/s 2024-05-30T16:42:18.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:18.729 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-05-30T16:42:18.729 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T16:42:18.729 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-30T16:42:18.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:42:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.941+0000 7f3fb0400640 1 Processor -- start 2024-05-30T16:42:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.941+0000 7f3fb0400640 1 -- start start 2024-05-30T16:42:18.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.943+0000 7f3fb0400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3fa8141510 0x7f3fa81418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:18.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.943+0000 7f3fb0400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa8144020 0x7f3fa806e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:18.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.943+0000 7f3fb0400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa80b3fd0 con 0x7f3fa815f8f0 2024-05-30T16:42:18.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.943+0000 7f3fb0400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa806dfc0 con 0x7f3fa8141510 2024-05-30T16:42:18.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.943+0000 7f3fb0400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa815fd80 con 0x7f3fa8144020 2024-05-30T16:42:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.943+0000 7f3fad000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3fa815f8f0 0x7f3fa80b5440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60938/0 (socket says 172.21.15.144:60938) 2024-05-30T16:42:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.943+0000 7f3fad000640 1 -- 172.21.15.144:0/1813945954 learned_addr learned my addr 172.21.15.144:0/1813945954 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:18.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fae400640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa8144020 0x7f3fa806e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:18.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fada00640 1 --2- 172.21.15.144:0/1813945954 >> v2:172.21.15.149:3300/0 conn(0x7f3fa8141510 0x7f3fa81418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:18.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178538111 0 0) 0x7f3fa80b3fd0 con 0x7f3fa815f8f0 2024-05-30T16:42:18.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f90003520 con 0x7f3fa815f8f0 2024-05-30T16:42:18.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1879298646 0 0) 0x7f3f90003520 con 0x7f3fa815f8f0 2024-05-30T16:42:18.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa8144020 msgr2=0x7f3fa806e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa8144020 0x7f3fa806e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 >> v2:172.21.15.149:3300/0 conn(0x7f3fa8141510 msgr2=0x7f3fa81418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 --2- 172.21.15.144:0/1813945954 >> v2:172.21.15.149:3300/0 conn(0x7f3fa8141510 0x7f3fa81418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa8144790 con 0x7f3fa815f8f0 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f3f980019f0 con 0x7f3fa815f8f0 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 >> v1:172.21.15.144:6789/0 conn(0x7f3fa815f8f0 legacy=0x7f3fa80b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa8144020 0x7f3f900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3f90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f90004d40 0x7f3f900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa806dfc0 con 0x7f3f90003fe0 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa815fd80 con 0x7f3f90004d40 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.944+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9000bc30 con 0x7f3fa8144020 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fad000640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3f90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:18.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fada00640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa8144020 0x7f3f900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fae400640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f90004d40 0x7f3f900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fad000640 1 -- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa8144020 msgr2=0x7f3f900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fad000640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa8144020 0x7f3f900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fad000640 1 -- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f90004d40 msgr2=0x7f3f900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fad000640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f90004d40 0x7f3f900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fad000640 1 -- 172.21.15.144:0/1813945954 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f90003520 con 0x7f3f90003fe0 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fae400640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f90004d40 0x7f3f900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.945+0000 7f3fada00640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa8144020 0x7f3f900039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.946+0000 7f3fad000640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3f90004800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800a920 tx=0x7f3f90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61038597d862d00c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.946+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800a4c0 con 0x7f3f90003fe0 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.946+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9802f070 con 0x7f3f90003fe0 2024-05-30T16:42:18.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.946+0000 7f3fa7e00640 1 -- 172.21.15.144:0/1813945954 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9802bd40 con 0x7f3f90003fe0 2024-05-30T16:42:18.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.947+0000 7f3fb0400640 1 -- 172.21.15.144:0/1813945954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 msgr2=0x7f3f90004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:18.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.947+0000 7f3fb0400640 1 --2- 172.21.15.144:0/1813945954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3f90004800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800a920 tx=0x7f3f90005830 comp rx=0 tx=0).stop 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.947+0000 7f3fae400640 1 -- 172.21.15.144:0/1813945954 reap_dead start 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.947+0000 7f3fb0400640 1 -- 172.21.15.144:0/1813945954 shutdown_connections 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.947+0000 7f3fb0400640 1 -- 172.21.15.144:0/1813945954 >> 172.21.15.144:0/1813945954 conn(0x7f3fa806bd00 msgr2=0x7f3fa806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.947+0000 7f3fb0400640 1 -- 172.21.15.144:0/1813945954 shutdown_connections 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.947+0000 7f3fb0400640 1 -- 172.21.15.144:0/1813945954 wait complete. 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.949+0000 7f3fb0400640 1 Processor -- start 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.949+0000 7f3fb0400640 1 -- start start 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fb0400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3fa813c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fb0400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa80b2610 0x7f3fa80ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fb0400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fa80aecc0 0x7f3fa80b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fb0400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa806e210 con 0x7f3f90003fe0 2024-05-30T16:42:18.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fb0400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa8144d50 con 0x7f3fa80aecc0 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fb0400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa8144490 con 0x7f3fa80b2610 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fada00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3fa813c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fada00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3fa813c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54740/0 (socket says 172.21.15.144:54740) 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fada00640 1 -- 172.21.15.144:0/3136386352 learned_addr learned my addr 172.21.15.144:0/3136386352 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fad000640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa80b2610 0x7f3fa80ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fada00640 1 -- 172.21.15.144:0/3136386352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa80b2610 msgr2=0x7f3fa80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fada00640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa80b2610 0x7f3fa80ae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.950+0000 7f3fada00640 1 -- 172.21.15.144:0/3136386352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fa80aecc0 msgr2=0x7f3fa80b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.951+0000 7f3fada00640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fa80aecc0 0x7f3fa80b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.951+0000 7f3fada00640 1 -- 172.21.15.144:0/3136386352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa80b6280 con 0x7f3f90003fe0 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.951+0000 7f3fada00640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3fa813c280 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00e7e0 tx=0x7f3f9c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:18.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.951+0000 7f3fa5600640 1 -- 172.21.15.144:0/3136386352 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c017070 con 0x7f3f90003fe0 2024-05-30T16:42:18.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.951+0000 7f3fa5600640 1 -- 172.21.15.144:0/3136386352 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00ee90 con 0x7f3f90003fe0 2024-05-30T16:42:18.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.951+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa80ae1c0 con 0x7f3f90003fe0 2024-05-30T16:42:18.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.951+0000 7f3fa5600640 1 -- 172.21.15.144:0/3136386352 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00f040 con 0x7f3f90003fe0 2024-05-30T16:42:18.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.951+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa81f5a10 con 0x7f3f90003fe0 2024-05-30T16:42:18.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.952+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa80af0e0 con 0x7f3f90003fe0 2024-05-30T16:42:18.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.954+0000 7f3fa5600640 1 -- 172.21.15.144:0/3136386352 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f9c01a070 con 0x7f3f90003fe0 2024-05-30T16:42:18.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.955+0000 7f3fa5600640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:18.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.955+0000 7f3fa5600640 1 -- 172.21.15.144:0/3136386352 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3f9c08b780 con 0x7f3f90003fe0 2024-05-30T16:42:18.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.955+0000 7f3fad000640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:18.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.956+0000 7f3fad000640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f98033000 tx=0x7f3f98007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:18.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:18.960+0000 7f3fa5600640 1 -- 172.21.15.144:0/3136386352 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3fa80b6280 con 0x7f3f90003fe0 2024-05-30T16:42:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.200+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3fa80b3b20 con 0x7f3f90003fe0 2024-05-30T16:42:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.200+0000 7f3fa5600640 1 -- 172.21.15.144:0/3136386352 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3fa80b3b20 con 0x7f3f90003fe0 2024-05-30T16:42:19.202 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:42:19.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f8c06c8f0 msgr2=0x7f3f8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:19.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f98033000 tx=0x7f3f98007000 comp rx=0 tx=0).stop 2024-05-30T16:42:19.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 msgr2=0x7f3fa813c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:19.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3fa813c280 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00e7e0 tx=0x7f3f9c00eca0 comp rx=0 tx=0).stop 2024-05-30T16:42:19.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 shutdown_connections 2024-05-30T16:42:19.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:19.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fa80aecc0 0x7f3fa80b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:19.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fa80b2610 0x7f3fa80ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:19.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 --2- 172.21.15.144:0/3136386352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f90003fe0 0x7f3fa813c280 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:19.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 >> 172.21.15.144:0/3136386352 conn(0x7f3fa806bd00 msgr2=0x7f3fa8074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:19.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 shutdown_connections 2024-05-30T16:42:19.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:19.203+0000 7f3fb0400640 1 -- 172.21.15.144:0/3136386352 wait complete. 2024-05-30T16:42:19.225 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T16:42:19.225 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:42:19.225 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-05-30T16:42:19.225 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-30T16:42:19.225 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-30T16:42:19.225 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T16:42:19.225 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T16:42:19.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:42:19.225 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-30T16:42:19.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:19.226 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-05-30T16:42:19.284 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-05-30T16:42:19.285 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42554sec preferred_lft 42554sec 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether ba:99:52:f3:02:7c brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::587f:85ff:fe79:1198/64 scope link 2024-05-30T16:42:19.287 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:19.287 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:42:19.287 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether ba:99:52:f3:02:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:42:19.287 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b899:52ff:fef3:27c/64 scope link 2024-05-30T16:42:19.287 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:19.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:19.287 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:42:19.368 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-05-30T16:42:19.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:19.373 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-05-30T16:42:19.422 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-05-30T16:42:19.422 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:42:19.422 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:42:19.422 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:42:19.422 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:42:19.423 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:19.423 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-30T16:42:19.423 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:42:19.423 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:42:19.423 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:42:19.423 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-30T16:42:19.527 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:19.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:19.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:19.634 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-30T16:42:19.681 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-30T16:42:19.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:19.682 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-05-30T16:42:19.776 INFO:teuthology.orchestra.run.smithi149.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-30T16:42:19.777 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:19.777 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-30T16:42:19.777 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T16:42:19.777 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-30T16:42:19.778 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-30T16:42:19.881 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:19.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:19.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:19.960 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 3e:d5:14:83:6f:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T16:42:20.036 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:20.037 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::3cd5:14ff:fe83:6fc0/64 scope link 2024-05-30T16:42:20.037 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:20.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:20.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-30T16:42:20.122 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:42:20.122 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:42:20.122 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:42:20.122 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:20.122 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-05-30T16:42:20.122 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:20.122 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:42:20.123 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 3e:d5:14:83:6f:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T16:42:20.123 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T16:42:20.123 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:20.123 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::3cd5:14ff:fe83:6fc0/64 scope link 2024-05-30T16:42:20.123 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:20.126 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-30T16:42:20.126 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:20.126 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-30T16:42:20.126 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-30T16:42:20.126 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-30T16:42:20.126 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-30T16:42:20.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-30T16:42:20.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-30T16:42:20.127 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-30T16:42:20.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:20.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:20.399 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:20.399 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-30T16:42:20.399 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.1 up 2024-05-30T16:42:20.399 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.1 master ceph-brx 2024-05-30T16:42:20.399 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-30T16:42:20.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:20.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:20.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:20.603 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-30T16:42:20.650 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-30T16:42:20.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:20.650 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-30T16:42:20.743 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-05-30T16:42:20.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:20.744 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:20.868 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:20.868 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:20.903 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:20.903 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:20.903 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-05-30T16:42:20.903 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 3@865cdc9a-e28b-4870-8751-0312b261bc38.cephfs=/ 2024-05-30T16:42:20.903 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.144:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-05-30T16:42:20.905 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-30T16:42:20.905 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-05-30T16:42:20.905 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-30T16:42:20.905 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-05-30T16:42:20.905 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-30T16:42:20.909 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T16:42:20.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:20.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-30T16:42:20.981 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:21.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:21.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:21.098 INFO:teuthology.orchestra.run.smithi149.stdout:client4403 2024-05-30T16:42:21.098 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:42:21.098 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:21.150 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:21.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:21.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:21.268 INFO:teuthology.orchestra.run.smithi149.stdout:client4403 2024-05-30T16:42:21.269 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:21.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:21.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:21.381 INFO:teuthology.orchestra.run.smithi149.stdout:client4403 2024-05-30T16:42:21.381 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/865cdc9a-e28b-4870-8751-0312b261bc38.client4403/status') 2024-05-30T16:42:21.485 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:21.516 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4403 (3)192.168.0.2:0/79234491 2024-05-30T16:42:21.517 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2024-05-30T16:42:21.517 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2024-05-30T16:42:21.517 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2024-05-30T16:42:21.517 INFO:teuthology.orchestra.run.smithi149.stderr:67 bytes copied, 7.735e-05 s, 866 kB/s 2024-05-30T16:42:21.519 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-30T16:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:21.529 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-30T16:42:21.735 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that when one clone is in progress, one progress bar is printed 2024-05-30T16:42:21.735 INFO:tasks.cephfs_test_runner:test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:42:21.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:42:21.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.941+0000 7fb4eb200640 1 Processor -- start 2024-05-30T16:42:21.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.941+0000 7fb4eb200640 1 -- start start 2024-05-30T16:42:21.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.942+0000 7fb4eb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0caf10 0x7fb4ec15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:21.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.942+0000 7fb4eb200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb4ec0cf8b0 0x7fb4ec0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:21.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.942+0000 7fb4eb200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4ec15f500 con 0x7fb4ec0cb2f0 2024-05-30T16:42:21.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.942+0000 7fb4eb200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb4ec15f780 con 0x7fb4ec0cf8b0 2024-05-30T16:42:21.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.942+0000 7fb4eb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4ec15fa60 con 0x7fb4ec0caf10 2024-05-30T16:42:21.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.943+0000 7fb4ea800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb4ec0cf8b0 0x7fb4ec0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:21.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.943+0000 7fb4e9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0caf10 0x7fb4ec15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:21.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.943+0000 7fb4ea800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb4ec0cf8b0 0x7fb4ec0b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:57278/0 (socket says 172.21.15.144:57278) 2024-05-30T16:42:21.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.943+0000 7fb4ea800640 1 -- 172.21.15.144:0/3117195811 learned_addr learned my addr 172.21.15.144:0/3117195811 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:21.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.944+0000 7fb4ea800640 1 -- 172.21.15.144:0/3117195811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0caf10 msgr2=0x7fb4ec15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:21.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.944+0000 7fb4ea800640 1 --2- 172.21.15.144:0/3117195811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0caf10 0x7fb4ec15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:21.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.944+0000 7fb4ea800640 1 -- 172.21.15.144:0/3117195811 >> v1:172.21.15.149:6789/0 conn(0x7fb4ec0cb2f0 legacy=0x7fb4ec15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:21.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.944+0000 7fb4ea800640 1 -- 172.21.15.144:0/3117195811 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec15fd40 con 0x7fb4ec0cf8b0 2024-05-30T16:42:21.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.945+0000 7fb4ea800640 1 --2- 172.21.15.144:0/3117195811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4ec0cf8b0 0x7fb4ec0b31c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009e50 tx=0x7fb4e402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd6cc097e802925 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:21.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.946+0000 7fb4e9400640 1 -- 172.21.15.144:0/3117195811 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4036070 con 0x7fb4ec0cf8b0 2024-05-30T16:42:21.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.946+0000 7fb4e9400640 1 -- 172.21.15.144:0/3117195811 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e4031600 con 0x7fb4ec0cf8b0 2024-05-30T16:42:21.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.946+0000 7fb4e9400640 1 -- 172.21.15.144:0/3117195811 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40319d0 con 0x7fb4ec0cf8b0 2024-05-30T16:42:21.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.946+0000 7fb4eb200640 1 -- 172.21.15.144:0/3117195811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4ec0cf8b0 msgr2=0x7fb4ec0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:21.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.946+0000 7fb4eb200640 1 --2- 172.21.15.144:0/3117195811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4ec0cf8b0 0x7fb4ec0b31c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009e50 tx=0x7fb4e402a710 comp rx=0 tx=0).stop 2024-05-30T16:42:21.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.946+0000 7fb4eb200640 1 -- 172.21.15.144:0/3117195811 shutdown_connections 2024-05-30T16:42:21.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.946+0000 7fb4eb200640 1 --2- 172.21.15.144:0/3117195811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4ec0cf8b0 0x7fb4ec0b31c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:21.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.946+0000 7fb4eb200640 1 --2- 172.21.15.144:0/3117195811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0caf10 0x7fb4ec15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:21.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.946+0000 7fb4eb200640 1 -- 172.21.15.144:0/3117195811 >> 172.21.15.144:0/3117195811 conn(0x7fb4ec0b20a0 msgr2=0x7fb4ec0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:21.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.947+0000 7fb4eb200640 1 -- 172.21.15.144:0/3117195811 shutdown_connections 2024-05-30T16:42:21.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.947+0000 7fb4eb200640 1 -- 172.21.15.144:0/3117195811 wait complete. 2024-05-30T16:42:21.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.948+0000 7fb4eb200640 1 Processor -- start 2024-05-30T16:42:21.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.948+0000 7fb4eb200640 1 -- start start 2024-05-30T16:42:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.949+0000 7fb4eb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec0caf10 0x7fb4ec14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.949+0000 7fb4eb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4ec0cb2f0 0x7fb4ec0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.949+0000 7fb4eb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0cf8b0 0x7fb4ec1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.949+0000 7fb4eb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec15bad0 con 0x7fb4ec0caf10 2024-05-30T16:42:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.949+0000 7fb4eb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec15b950 con 0x7fb4ec0cb2f0 2024-05-30T16:42:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.949+0000 7fb4eb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4ec0b3700 con 0x7fb4ec0cf8b0 2024-05-30T16:42:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec0caf10 0x7fb4ec14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec0caf10 0x7fb4ec14e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54756/0 (socket says 172.21.15.144:54756) 2024-05-30T16:42:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e9e00640 1 -- 172.21.15.144:0/3445534993 learned_addr learned my addr 172.21.15.144:0/3445534993 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e3e00640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4ec0cb2f0 0x7fb4ec0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4ea800640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0cf8b0 0x7fb4ec1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e9e00640 1 -- 172.21.15.144:0/3445534993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0cf8b0 msgr2=0x7fb4ec1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e9e00640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0cf8b0 0x7fb4ec1531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e9e00640 1 -- 172.21.15.144:0/3445534993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4ec0cb2f0 msgr2=0x7fb4ec0ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e9e00640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4ec0cb2f0 0x7fb4ec0ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e9e00640 1 -- 172.21.15.144:0/3445534993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec152450 con 0x7fb4ec0caf10 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.950+0000 7fb4e9e00640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec0caf10 0x7fb4ec14e080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e9b0 tx=0x7fb4dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.951+0000 7fb4e2000640 1 -- 172.21.15.144:0/3445534993 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc017070 con 0x7fb4ec0caf10 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.951+0000 7fb4e2000640 1 -- 172.21.15.144:0/3445534993 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00c9a0 con 0x7fb4ec0caf10 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.951+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ec0adb10 con 0x7fb4ec0caf10 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.951+0000 7fb4e2000640 1 -- 172.21.15.144:0/3445534993 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00cd90 con 0x7fb4ec0caf10 2024-05-30T16:42:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.951+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ec1529d0 con 0x7fb4ec0caf10 2024-05-30T16:42:21.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.952+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ec075570 con 0x7fb4ec0caf10 2024-05-30T16:42:21.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.953+0000 7fb4e2000640 1 -- 172.21.15.144:0/3445534993 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4dc01a070 con 0x7fb4ec0caf10 2024-05-30T16:42:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.954+0000 7fb4e2000640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4c806c8f0 0x7fb4c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.954+0000 7fb4e2000640 1 -- 172.21.15.144:0/3445534993 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb4dc08bc00 con 0x7fb4ec0caf10 2024-05-30T16:42:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.954+0000 7fb4e3e00640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4c806c8f0 0x7fb4c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:21.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.955+0000 7fb4e3e00640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4c806c8f0 0x7fb4c806edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4001640 tx=0x7fb4d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:21.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:21.958+0000 7fb4e2000640 1 -- 172.21.15.144:0/3445534993 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4dc059f90 con 0x7fb4ec0caf10 2024-05-30T16:42:22.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.158+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4ec0b5000 con 0x7fb4ec0caf10 2024-05-30T16:42:22.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.161+0000 7fb4e2000640 1 -- 172.21.15.144:0/3445534993 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fb4dc059890 con 0x7fb4ec0caf10 2024-05-30T16:42:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:22.163 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:54.340246+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:41:50.922058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:41:51.739937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:42:22.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4c806c8f0 msgr2=0x7fb4c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4c806c8f0 0x7fb4c806edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4001640 tx=0x7fb4d4009040 comp rx=0 tx=0).stop 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec0caf10 msgr2=0x7fb4ec14e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec0caf10 0x7fb4ec14e080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e9b0 tx=0x7fb4dc00ee70 comp rx=0 tx=0).stop 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 shutdown_connections 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb4c806c8f0 0x7fb4c806edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4ec0cf8b0 0x7fb4ec1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4ec0cb2f0 0x7fb4ec0ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 --2- 172.21.15.144:0/3445534993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec0caf10 0x7fb4ec14e080 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.164+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 >> 172.21.15.144:0/3445534993 conn(0x7fb4ec0b20a0 msgr2=0x7fb4ec15c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.165+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 shutdown_connections 2024-05-30T16:42:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.165+0000 7fb4eb200640 1 -- 172.21.15.144:0/3445534993 wait complete. 2024-05-30T16:42:22.184 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:41:40.927129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T16:41:50.922058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T16:41:51.739937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T16:42:22.185 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T16:42:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.378+0000 7fd483e00640 1 Processor -- start 2024-05-30T16:42:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.379+0000 7fd483e00640 1 -- start start 2024-05-30T16:42:22.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.380+0000 7fd483e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd4840d2240 0x7fd4840b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.380+0000 7fd483e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4840b66c0 0x7fd48406ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.380+0000 7fd483e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4840d2740 con 0x7fd48406e790 2024-05-30T16:42:22.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.380+0000 7fd483e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd4840d07c0 con 0x7fd4840d2240 2024-05-30T16:42:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.380+0000 7fd483e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd4840d2a20 con 0x7fd4840b66c0 2024-05-30T16:42:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.380+0000 7fd482000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd4840d2240 0x7fd4840b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.380+0000 7fd482a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd48406e790 0x7fd4840d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60950/0 (socket says 172.21.15.144:60950) 2024-05-30T16:42:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.380+0000 7fd482a00640 1 -- 172.21.15.144:0/1387868754 learned_addr learned my addr 172.21.15.144:0/1387868754 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.381+0000 7fd483400640 1 --2- 172.21.15.144:0/1387868754 >> v2:172.21.15.149:3300/0 conn(0x7fd4840b66c0 0x7fd48406ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.381+0000 7fd482000640 1 -- 172.21.15.144:0/1387868754 >> v2:172.21.15.149:3300/0 conn(0x7fd4840b66c0 msgr2=0x7fd48406ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.381+0000 7fd482000640 1 --2- 172.21.15.144:0/1387868754 >> v2:172.21.15.149:3300/0 conn(0x7fd4840b66c0 0x7fd48406ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.381+0000 7fd482000640 1 -- 172.21.15.144:0/1387868754 >> v1:172.21.15.144:6789/0 conn(0x7fd48406e790 legacy=0x7fd4840d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.381+0000 7fd482000640 1 -- 172.21.15.144:0/1387868754 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840d2d00 con 0x7fd4840d2240 2024-05-30T16:42:22.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.381+0000 7fd483400640 1 --2- 172.21.15.144:0/1387868754 >> v2:172.21.15.149:3300/0 conn(0x7fd4840b66c0 0x7fd48406ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:22.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.382+0000 7fd482000640 1 --2- 172.21.15.144:0/1387868754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840d2240 0x7fd4840b6180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd48408dad0 tx=0x7fd46c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baaa14d97dd82008 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:22.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.382+0000 7fd481600640 1 -- 172.21.15.144:0/1387868754 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c007740 con 0x7fd4840d2240 2024-05-30T16:42:22.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.382+0000 7fd481600640 1 -- 172.21.15.144:0/1387868754 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46c0078e0 con 0x7fd4840d2240 2024-05-30T16:42:22.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.382+0000 7fd481600640 1 -- 172.21.15.144:0/1387868754 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c007cb0 con 0x7fd4840d2240 2024-05-30T16:42:22.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.383+0000 7fd483e00640 1 -- 172.21.15.144:0/1387868754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840d2240 msgr2=0x7fd4840b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.383+0000 7fd483e00640 1 --2- 172.21.15.144:0/1387868754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840d2240 0x7fd4840b6180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd48408dad0 tx=0x7fd46c02a5f0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.383+0000 7fd483e00640 1 -- 172.21.15.144:0/1387868754 shutdown_connections 2024-05-30T16:42:22.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.383+0000 7fd483e00640 1 --2- 172.21.15.144:0/1387868754 >> v2:172.21.15.149:3300/0 conn(0x7fd4840b66c0 0x7fd48406ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.383+0000 7fd483e00640 1 --2- 172.21.15.144:0/1387868754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840d2240 0x7fd4840b6180 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.383+0000 7fd483e00640 1 -- 172.21.15.144:0/1387868754 >> 172.21.15.144:0/1387868754 conn(0x7fd48408bfc0 msgr2=0x7fd4840d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:22.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.383+0000 7fd483e00640 1 -- 172.21.15.144:0/1387868754 shutdown_connections 2024-05-30T16:42:22.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.383+0000 7fd483e00640 1 -- 172.21.15.144:0/1387868754 wait complete. 2024-05-30T16:42:22.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.384+0000 7fd483e00640 1 Processor -- start 2024-05-30T16:42:22.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.385+0000 7fd483e00640 1 -- start start 2024-05-30T16:42:22.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd483e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd48406e790 0x7fd4840cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd483e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840b66c0 0x7fd4840c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd483e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4840d2240 0x7fd4841f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd483e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd48406cf90 con 0x7fd4840b66c0 2024-05-30T16:42:22.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd483e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd4840d32c0 con 0x7fd48406e790 2024-05-30T16:42:22.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd483e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd48406d110 con 0x7fd4840d2240 2024-05-30T16:42:22.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd482000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840b66c0 0x7fd4840c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd482000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840b66c0 0x7fd4840c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54780/0 (socket says 172.21.15.144:54780) 2024-05-30T16:42:22.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd482000640 1 -- 172.21.15.144:0/970909140 learned_addr learned my addr 172.21.15.144:0/970909140 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:22.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd482000640 1 -- 172.21.15.144:0/970909140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4840d2240 msgr2=0x7fd4841f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd482000640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4840d2240 0x7fd4841f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd482000640 1 -- 172.21.15.144:0/970909140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd48406e790 msgr2=0x7fd4840cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd482a00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd48406e790 0x7fd4840cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd482000640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd48406e790 0x7fd4840cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.386+0000 7fd482000640 1 -- 172.21.15.144:0/970909140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840c9210 con 0x7fd4840b66c0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.387+0000 7fd482000640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840b66c0 0x7fd4840c89c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009e80 tx=0x7fd46c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.387+0000 7fd47aa00640 1 -- 172.21.15.144:0/970909140 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c03f070 con 0x7fd4840b66c0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.387+0000 7fd47aa00640 1 -- 172.21.15.144:0/970909140 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46c031c40 con 0x7fd4840b66c0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.387+0000 7fd47aa00640 1 -- 172.21.15.144:0/970909140 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c043410 con 0x7fd4840b66c0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.387+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4840c94f0 con 0x7fd4840b66c0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.387+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4840c9ab0 con 0x7fd4840b66c0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.388+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484075570 con 0x7fd4840b66c0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.389+0000 7fd47aa00640 1 -- 172.21.15.144:0/970909140 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd46c0435b0 con 0x7fd4840b66c0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.390+0000 7fd47aa00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd46006c8f0 0x7fd46006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.390+0000 7fd47aa00640 1 -- 172.21.15.144:0/970909140 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd46c0ad300 con 0x7fd4840b66c0 2024-05-30T16:42:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.390+0000 7fd482a00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd46006c8f0 0x7fd46006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.391+0000 7fd482a00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd46006c8f0 0x7fd46006edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd47c000f60 tx=0x7fd47c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:22.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.395+0000 7fd47aa00640 1 -- 172.21.15.144:0/970909140 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd46c07b600 con 0x7fd4840b66c0 2024-05-30T16:42:22.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.596+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd4840b6f60 con 0x7fd4840b66c0 2024-05-30T16:42:22.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.597+0000 7fd47aa00640 1 -- 172.21.15.144:0/970909140 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fd46c07af00 con 0x7fd4840b66c0 2024-05-30T16:42:22.599 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-05-30T16:42:22.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd46006c8f0 msgr2=0x7fd46006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd46006c8f0 0x7fd46006edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd47c000f60 tx=0x7fd47c009040 comp rx=0 tx=0).stop 2024-05-30T16:42:22.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840b66c0 msgr2=0x7fd4840c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840b66c0 0x7fd4840c89c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009e80 tx=0x7fd46c004a40 comp rx=0 tx=0).stop 2024-05-30T16:42:22.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 shutdown_connections 2024-05-30T16:42:22.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd46006c8f0 0x7fd46006edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4840d2240 0x7fd4841f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4840b66c0 0x7fd4840c89c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 --2- 172.21.15.144:0/970909140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd48406e790 0x7fd4840cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 >> 172.21.15.144:0/970909140 conn(0x7fd48408bfc0 msgr2=0x7fd4840d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:22.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 shutdown_connections 2024-05-30T16:42:22.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.600+0000 7fd483e00640 1 -- 172.21.15.144:0/970909140 wait complete. 2024-05-30T16:42:22.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T16:42:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.816+0000 7f1a15000640 1 Processor -- start 2024-05-30T16:42:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.817+0000 7f1a15000640 1 -- start start 2024-05-30T16:42:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.818+0000 7f1a15000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1a100d2240 0x7f1a100b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.818+0000 7f1a15000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 0x7f1a1006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.818+0000 7f1a15000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a100d2740 con 0x7f1a1006e790 2024-05-30T16:42:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.818+0000 7f1a15000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f1a100d07c0 con 0x7f1a100d2240 2024-05-30T16:42:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.818+0000 7f1a15000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1a100d2a20 con 0x7f1a100b66c0 2024-05-30T16:42:22.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.819+0000 7f1a0ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1a100d2240 0x7f1a100b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.819+0000 7f1a0fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 0x7f1a1006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.819+0000 7f1a0ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1a100d2240 0x7f1a100b6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:57322/0 (socket says 172.21.15.144:57322) 2024-05-30T16:42:22.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.819+0000 7f1a0ea00640 1 -- 172.21.15.144:0/1909608033 learned_addr learned my addr 172.21.15.144:0/1909608033 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:22.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.820+0000 7f1a0fe00640 1 -- 172.21.15.144:0/1909608033 >> v2:172.21.15.149:3300/0 conn(0x7f1a100d2240 msgr2=0x7f1a100b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:22.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.820+0000 7f1a0fe00640 1 --2- 172.21.15.144:0/1909608033 >> v2:172.21.15.149:3300/0 conn(0x7f1a100d2240 0x7f1a100b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.820+0000 7f1a0fe00640 1 -- 172.21.15.144:0/1909608033 >> v1:172.21.15.149:6789/0 conn(0x7f1a1006e790 legacy=0x7f1a100d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.820+0000 7f1a0fe00640 1 -- 172.21.15.144:0/1909608033 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a100d2d00 con 0x7f1a100b66c0 2024-05-30T16:42:22.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.820+0000 7f1a0ea00640 1 --2- 172.21.15.144:0/1909608033 >> v2:172.21.15.149:3300/0 conn(0x7f1a100d2240 0x7f1a100b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:42:22.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.821+0000 7f1a0fe00640 1 --2- 172.21.15.144:0/1909608033 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 0x7f1a1006ca50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1a080097a0 tx=0x7f1a0802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edff63e0fbf2c84d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:22.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a0e000640 1 -- 172.21.15.144:0/1909608033 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08037070 con 0x7f1a100b66c0 2024-05-30T16:42:22.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a0e000640 1 -- 172.21.15.144:0/1909608033 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0802ae50 con 0x7f1a100b66c0 2024-05-30T16:42:22.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a0e000640 1 -- 172.21.15.144:0/1909608033 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08032660 con 0x7f1a100b66c0 2024-05-30T16:42:22.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a15000640 1 -- 172.21.15.144:0/1909608033 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 msgr2=0x7f1a1006ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a15000640 1 --2- 172.21.15.144:0/1909608033 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 0x7f1a1006ca50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1a080097a0 tx=0x7f1a0802a100 comp rx=0 tx=0).stop 2024-05-30T16:42:22.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a15000640 1 -- 172.21.15.144:0/1909608033 shutdown_connections 2024-05-30T16:42:22.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a15000640 1 --2- 172.21.15.144:0/1909608033 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 0x7f1a1006ca50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a15000640 1 --2- 172.21.15.144:0/1909608033 >> v2:172.21.15.149:3300/0 conn(0x7f1a100d2240 0x7f1a100b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a15000640 1 -- 172.21.15.144:0/1909608033 >> 172.21.15.144:0/1909608033 conn(0x7f1a1008bfc0 msgr2=0x7f1a100d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:22.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a15000640 1 -- 172.21.15.144:0/1909608033 shutdown_connections 2024-05-30T16:42:22.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.822+0000 7f1a15000640 1 -- 172.21.15.144:0/1909608033 wait complete. 2024-05-30T16:42:22.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.824+0000 7f1a15000640 1 Processor -- start 2024-05-30T16:42:22.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.824+0000 7f1a15000640 1 -- start start 2024-05-30T16:42:22.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.825+0000 7f1a15000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1006e790 0x7f1a10152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.825+0000 7f1a15000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 0x7f1a101f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.825+0000 7f1a15000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a100d2240 0x7f1a101f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.825+0000 7f1a15000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1006cf90 con 0x7f1a1006e790 2024-05-30T16:42:22.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.825+0000 7f1a15000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a100d32c0 con 0x7f1a100d2240 2024-05-30T16:42:22.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.825+0000 7f1a15000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1006d110 con 0x7f1a100b66c0 2024-05-30T16:42:22.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1006e790 0x7f1a10152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1006e790 0x7f1a10152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54796/0 (socket says 172.21.15.144:54796) 2024-05-30T16:42:22.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0f400640 1 -- 172.21.15.144:0/702045726 learned_addr learned my addr 172.21.15.144:0/702045726 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0fe00640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a100d2240 0x7f1a101f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0ea00640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 0x7f1a101f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0f400640 1 -- 172.21.15.144:0/702045726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 msgr2=0x7f1a101f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0f400640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 0x7f1a101f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0f400640 1 -- 172.21.15.144:0/702045726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a100d2240 msgr2=0x7f1a101f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0f400640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a100d2240 0x7f1a101f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0f400640 1 -- 172.21.15.144:0/702045726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a100ce110 con 0x7f1a1006e790 2024-05-30T16:42:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.826+0000 7f1a0f400640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1006e790 0x7f1a10152af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000c400 tx=0x7f1a0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.827+0000 7f1a07400640 1 -- 172.21.15.144:0/702045726 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a000052d0 con 0x7f1a1006e790 2024-05-30T16:42:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.827+0000 7f1a07400640 1 -- 172.21.15.144:0/702045726 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a00005490 con 0x7f1a1006e790 2024-05-30T16:42:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.827+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a100c8d40 con 0x7f1a1006e790 2024-05-30T16:42:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.827+0000 7f1a07400640 1 -- 172.21.15.144:0/702045726 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00007260 con 0x7f1a1006e790 2024-05-30T16:42:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.827+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a100c9300 con 0x7f1a1006e790 2024-05-30T16:42:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.828+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a100b3a80 con 0x7f1a1006e790 2024-05-30T16:42:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.829+0000 7f1a07400640 1 -- 172.21.15.144:0/702045726 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a00007400 con 0x7f1a1006e790 2024-05-30T16:42:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.830+0000 7f1a07400640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f19ec06c8f0 0x7f19ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.830+0000 7f1a07400640 1 -- 172.21.15.144:0/702045726 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1a0008b120 con 0x7f1a1006e790 2024-05-30T16:42:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.830+0000 7f1a0ea00640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f19ec06c8f0 0x7f19ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:22.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.831+0000 7f1a0ea00640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f19ec06c8f0 0x7f19ec06edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a100ba560 tx=0x7f19f800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:22.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:22.835+0000 7f1a07400640 1 -- 172.21.15.144:0/702045726 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a100b3a80 con 0x7f1a1006e790 2024-05-30T16:42:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.020+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1a10075570 con 0x7f1a1006e790 2024-05-30T16:42:23.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.021+0000 7f1a07400640 1 -- 172.21.15.144:0/702045726 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f1a000594b0 con 0x7f1a1006e790 2024-05-30T16:42:23.022 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.023+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f19ec06c8f0 msgr2=0x7f19ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.023+0000 7f1a15000640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f19ec06c8f0 0x7f19ec06edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a100ba560 tx=0x7f19f800b040 comp rx=0 tx=0).stop 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.023+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1006e790 msgr2=0x7f1a10152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.023+0000 7f1a15000640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1006e790 0x7f1a10152af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000c400 tx=0x7f1a0000c8c0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.024+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 shutdown_connections 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.024+0000 7f1a15000640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f19ec06c8f0 0x7f19ec06edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.024+0000 7f1a15000640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a100d2240 0x7f1a101f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.024+0000 7f1a15000640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a100b66c0 0x7f1a101f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.024+0000 7f1a15000640 1 --2- 172.21.15.144:0/702045726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1006e790 0x7f1a10152af0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.024+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 >> 172.21.15.144:0/702045726 conn(0x7f1a1008bfc0 msgr2=0x7f1a100d39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:23.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.024+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 shutdown_connections 2024-05-30T16:42:23.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.024+0000 7f1a15000640 1 -- 172.21.15.144:0/702045726 wait complete. 2024-05-30T16:42:23.042 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T16:42:23.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.232+0000 7f45fbe00640 1 Processor -- start 2024-05-30T16:42:23.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.232+0000 7f45fbe00640 1 -- start start 2024-05-30T16:42:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.234+0000 7f45fbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc160070 0x7f45fc0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.234+0000 7f45fbe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45fc1605c0 con 0x7f45fc15e820 2024-05-30T16:42:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.234+0000 7f45fbe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45fc1608a0 con 0x7f45fc0cf9d0 2024-05-30T16:42:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.234+0000 7f45fbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc160b80 con 0x7f45fc160070 2024-05-30T16:42:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.234+0000 7f45faa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f45fc15e820 0x7f45fc162c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60966/0 (socket says 172.21.15.144:60966) 2024-05-30T16:42:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.234+0000 7f45faa00640 1 -- 172.21.15.144:0/2155803360 learned_addr learned my addr 172.21.15.144:0/2155803360 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.234+0000 7f45f3e00640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc160070 0x7f45fc0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.234+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954511034 0 0) 0x7f45fc1605c0 con 0x7f45fc15e820 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.234+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45e0003520 con 0x7f45fc15e820 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1936343500 0 0) 0x7f45e0003520 con 0x7f45fc15e820 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc160070 msgr2=0x7f45fc0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc160070 0x7f45fc0cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 >> v1:172.21.15.149:6789/0 conn(0x7f45fc0cf9d0 legacy=0x7f45fc0d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc160e60 con 0x7f45fc15e820 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f45ec001670 con 0x7f45fc15e820 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 >> v1:172.21.15.144:6789/0 conn(0x7f45fc15e820 legacy=0x7f45fc162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45e0004800 0x7f45e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc160070 0x7f45e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc160b80 con 0x7f45e00039e0 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f45e000ba70 con 0x7f45e0004800 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45e000bc70 con 0x7f45fc160070 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45faa00640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45f3e00640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45e0004800 0x7f45e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45faa00640 1 -- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc160070 msgr2=0x7f45e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45faa00640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc160070 0x7f45e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45faa00640 1 -- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45e0004800 msgr2=0x7f45e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.235+0000 7f45faa00640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45e0004800 0x7f45e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.236+0000 7f45faa00640 1 -- 172.21.15.144:0/2155803360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e0003520 con 0x7f45e00039e0 2024-05-30T16:42:23.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.236+0000 7f45faa00640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45e0003e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f45ec001eb0 tx=0x7f45e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d69da764b7b4e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:23.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec007d30 con 0x7f45e00039e0 2024-05-30T16:42:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec005af0 con 0x7f45e00039e0 2024-05-30T16:42:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fa000640 1 -- 172.21.15.144:0/2155803360 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec007070 con 0x7f45e00039e0 2024-05-30T16:42:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fbe00640 1 -- 172.21.15.144:0/2155803360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 msgr2=0x7f45e0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fbe00640 1 --2- 172.21.15.144:0/2155803360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45e0003e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f45ec001eb0 tx=0x7f45e0005830 comp rx=0 tx=0).stop 2024-05-30T16:42:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fb400640 1 -- 172.21.15.144:0/2155803360 reap_dead start 2024-05-30T16:42:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fbe00640 1 -- 172.21.15.144:0/2155803360 shutdown_connections 2024-05-30T16:42:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fbe00640 1 -- 172.21.15.144:0/2155803360 >> 172.21.15.144:0/2155803360 conn(0x7f45fc08bfc0 msgr2=0x7f45fc0d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fbe00640 1 -- 172.21.15.144:0/2155803360 shutdown_connections 2024-05-30T16:42:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.237+0000 7f45fbe00640 1 -- 172.21.15.144:0/2155803360 wait complete. 2024-05-30T16:42:23.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.239+0000 7f45fbe00640 1 Processor -- start 2024-05-30T16:42:23.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.239+0000 7f45fbe00640 1 -- start start 2024-05-30T16:42:23.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.240+0000 7f45fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45fc0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.240+0000 7f45fbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc14ca30 0x7f45fc0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.240+0000 7f45fbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc0c9520 0x7f45fc0c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.240+0000 7f45fbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0d34a0 con 0x7f45e00039e0 2024-05-30T16:42:23.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.240+0000 7f45fbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0d3320 con 0x7f45fc0c9520 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.240+0000 7f45fbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc0cf490 con 0x7f45fc14ca30 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.240+0000 7f45faa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45fc0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.240+0000 7f45faa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45fc0b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54808/0 (socket says 172.21.15.144:54808) 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.240+0000 7f45faa00640 1 -- 172.21.15.144:0/2432450333 learned_addr learned my addr 172.21.15.144:0/2432450333 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45faa00640 1 -- 172.21.15.144:0/2432450333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc14ca30 msgr2=0x7f45fc0c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45faa00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc14ca30 0x7f45fc0c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45faa00640 1 -- 172.21.15.144:0/2432450333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc0c9520 msgr2=0x7f45fc0c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45faa00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc0c9520 0x7f45fc0c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45faa00640 1 -- 172.21.15.144:0/2432450333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc1e8440 con 0x7f45e00039e0 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45faa00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45fc0b73c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c300 tx=0x7f45ec001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45f3400640 1 -- 172.21.15.144:0/2432450333 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec001640 con 0x7f45e00039e0 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45f3400640 1 -- 172.21.15.144:0/2432450333 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec042070 con 0x7f45e00039e0 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45f3400640 1 -- 172.21.15.144:0/2432450333 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec007290 con 0x7f45e00039e0 2024-05-30T16:42:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc0ba0b0 con 0x7f45e00039e0 2024-05-30T16:42:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.241+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc1e89c0 con 0x7f45e00039e0 2024-05-30T16:42:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.242+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc0ca990 con 0x7f45e00039e0 2024-05-30T16:42:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.243+0000 7f45f3400640 1 -- 172.21.15.144:0/2432450333 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45ec007430 con 0x7f45e00039e0 2024-05-30T16:42:23.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.244+0000 7f45f3400640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45d806c920 0x7f45d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.244+0000 7f45f3400640 1 -- 172.21.15.144:0/2432450333 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f45ec0abf60 con 0x7f45e00039e0 2024-05-30T16:42:23.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.244+0000 7f45f3e00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45d806c920 0x7f45d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.245+0000 7f45f3e00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45d806c920 0x7f45d806ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f45fc1f82e0 tx=0x7f45e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:23.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.249+0000 7f45f3400640 1 -- 172.21.15.144:0/2432450333 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45ec007dd0 con 0x7f45e00039e0 2024-05-30T16:42:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.449+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f45fc075570 con 0x7f45e00039e0 2024-05-30T16:42:23.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.450+0000 7f45f3400640 1 -- 172.21.15.144:0/2432450333 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f45ec07a410 con 0x7f45e00039e0 2024-05-30T16:42:23.451 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2024-05-30T16:42:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.452+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45d806c920 msgr2=0x7f45d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.452+0000 7f45fbe00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45d806c920 0x7f45d806ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f45fc1f82e0 tx=0x7f45e4008040 comp rx=0 tx=0).stop 2024-05-30T16:42:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 msgr2=0x7f45fc0b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45fc0b73c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c300 tx=0x7f45ec001a40 comp rx=0 tx=0).stop 2024-05-30T16:42:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 shutdown_connections 2024-05-30T16:42:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45d806c920 0x7f45d806ede0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc0c9520 0x7f45fc0c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45fc14ca30 0x7f45fc0c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 --2- 172.21.15.144:0/2432450333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e00039e0 0x7f45fc0b73c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 >> 172.21.15.144:0/2432450333 conn(0x7f45fc08bfc0 msgr2=0x7f45fc0d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:23.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 shutdown_connections 2024-05-30T16:42:23.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.453+0000 7f45fbe00640 1 -- 172.21.15.144:0/2432450333 wait complete. 2024-05-30T16:42:23.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-30T16:42:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.663+0000 7f6ffd000640 1 Processor -- start 2024-05-30T16:42:23.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.664+0000 7f6ffd000640 1 -- start start 2024-05-30T16:42:23.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.665+0000 7f6ffd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80ba090 0x7f6ff80cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.665+0000 7f6ffd000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ff80cfa10 0x7f6ff80d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.665+0000 7f6ffd000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff815ed40 con 0x7f6ff815e960 2024-05-30T16:42:23.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.665+0000 7f6ffd000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff80d2b40 con 0x7f6ff80cfa10 2024-05-30T16:42:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.665+0000 7f6ffd000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff8162ca0 con 0x7f6ff80ba090 2024-05-30T16:42:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.665+0000 7f6ff7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6ff815e960 0x7f6ff8162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60972/0 (socket says 172.21.15.144:60972) 2024-05-30T16:42:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.665+0000 7f6ff7400640 1 -- 172.21.15.144:0/952177660 learned_addr learned my addr 172.21.15.144:0/952177660 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.665+0000 7f6ff7e00640 1 --2- 172.21.15.144:0/952177660 >> v2:172.21.15.144:3300/0 conn(0x7f6ff80cfa10 0x7f6ff80d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.666+0000 7f6ff6a00640 1 --2- 172.21.15.144:0/952177660 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80ba090 0x7f6ff80cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.666+0000 7f6ff6000640 1 -- 172.21.15.144:0/952177660 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2594884369 0 0) 0x7f6ff815ed40 con 0x7f6ff815e960 2024-05-30T16:42:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.666+0000 7f6ff6000640 1 -- 172.21.15.144:0/952177660 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fdc003520 con 0x7f6ff815e960 2024-05-30T16:42:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.666+0000 7f6ff7e00640 1 -- 172.21.15.144:0/952177660 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80ba090 msgr2=0x7f6ff80cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.666+0000 7f6ff7e00640 1 --2- 172.21.15.144:0/952177660 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80ba090 0x7f6ff80cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.666+0000 7f6ff7e00640 1 -- 172.21.15.144:0/952177660 >> v1:172.21.15.144:6789/0 conn(0x7f6ff815e960 legacy=0x7f6ff8162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.666+0000 7f6ff7e00640 1 -- 172.21.15.144:0/952177660 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff8162f80 con 0x7f6ff80cfa10 2024-05-30T16:42:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.667+0000 7f6ff7e00640 1 --2- 172.21.15.144:0/952177660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80cfa10 0x7f6ff80d32b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009d90 tx=0x7f6ff002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5692fbb240f5cf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:23.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.667+0000 7f6ff6000640 1 -- 172.21.15.144:0/952177660 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0007740 con 0x7f6ff80cfa10 2024-05-30T16:42:23.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.667+0000 7f6ff6000640 1 -- 172.21.15.144:0/952177660 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff00078e0 con 0x7f6ff80cfa10 2024-05-30T16:42:23.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.667+0000 7f6ff6000640 1 -- 172.21.15.144:0/952177660 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0007c90 con 0x7f6ff80cfa10 2024-05-30T16:42:23.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.668+0000 7f6ffd000640 1 -- 172.21.15.144:0/952177660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80cfa10 msgr2=0x7f6ff80d32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.668+0000 7f6ffd000640 1 --2- 172.21.15.144:0/952177660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80cfa10 0x7f6ff80d32b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009d90 tx=0x7f6ff002a660 comp rx=0 tx=0).stop 2024-05-30T16:42:23.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.668+0000 7f6ffd000640 1 -- 172.21.15.144:0/952177660 shutdown_connections 2024-05-30T16:42:23.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.668+0000 7f6ffd000640 1 --2- 172.21.15.144:0/952177660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80cfa10 0x7f6ff80d32b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.668+0000 7f6ffd000640 1 --2- 172.21.15.144:0/952177660 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80ba090 0x7f6ff80cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.668+0000 7f6ffd000640 1 -- 172.21.15.144:0/952177660 >> 172.21.15.144:0/952177660 conn(0x7f6ff80d1360 msgr2=0x7f6ff80d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:23.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.668+0000 7f6ffd000640 1 -- 172.21.15.144:0/952177660 shutdown_connections 2024-05-30T16:42:23.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.668+0000 7f6ffd000640 1 -- 172.21.15.144:0/952177660 wait complete. 2024-05-30T16:42:23.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.670+0000 7f6ffd000640 1 Processor -- start 2024-05-30T16:42:23.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.670+0000 7f6ffd000640 1 -- start start 2024-05-30T16:42:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ffd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80ba090 0x7f6ff81f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ffd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80cfa10 0x7f6ff81f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ffd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff815e960 0x7f6ff8160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ffd000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80b78a0 con 0x7f6ff80ba090 2024-05-30T16:42:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ffd000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80d2d90 con 0x7f6ff815e960 2024-05-30T16:42:23.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ffd000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff80d37f0 con 0x7f6ff80cfa10 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ff7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80ba090 0x7f6ff81f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ff7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80ba090 0x7f6ff81f3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54834/0 (socket says 172.21.15.144:54834) 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ff7400640 1 -- 172.21.15.144:0/80704310 learned_addr learned my addr 172.21.15.144:0/80704310 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ff7e00640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff815e960 0x7f6ff8160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.671+0000 7f6ff7400640 1 -- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80cfa10 msgr2=0x7f6ff81f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ff6a00640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80cfa10 0x7f6ff81f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ff7400640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80cfa10 0x7f6ff81f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ff7400640 1 -- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff815e960 msgr2=0x7f6ff8160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ff7400640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff815e960 0x7f6ff8160560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ff7400640 1 -- 172.21.15.144:0/80704310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff81f52c0 con 0x7f6ff80ba090 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ff6a00640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80cfa10 0x7f6ff81f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ff7e00640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff815e960 0x7f6ff8160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ff7400640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80ba090 0x7f6ff81f3e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c390 tx=0x7f6fe800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6fef400640 1 -- 172.21.15.144:0/80704310 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8017070 con 0x7f6ff80ba090 2024-05-30T16:42:23.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6fef400640 1 -- 172.21.15.144:0/80704310 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe8005ce0 con 0x7f6ff80ba090 2024-05-30T16:42:23.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff8155a10 con 0x7f6ff80ba090 2024-05-30T16:42:23.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6fef400640 1 -- 172.21.15.144:0/80704310 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80072f0 con 0x7f6ff80ba090 2024-05-30T16:42:23.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.672+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff81f5920 con 0x7f6ff80ba090 2024-05-30T16:42:23.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.673+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff8075570 con 0x7f6ff80ba090 2024-05-30T16:42:23.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.674+0000 7f6fef400640 1 -- 172.21.15.144:0/80704310 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fe801a070 con 0x7f6ff80ba090 2024-05-30T16:42:23.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.675+0000 7f6fef400640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6fd806c8f0 0x7f6fd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:23.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.675+0000 7f6fef400640 1 -- 172.21.15.144:0/80704310 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6fe808af00 con 0x7f6ff80ba090 2024-05-30T16:42:23.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.676+0000 7f6ff6a00640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6fd806c8f0 0x7f6fd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:23.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.676+0000 7f6ff6a00640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6fd806c8f0 0x7f6fd806edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4006fd0 tx=0x7f6fe4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:23.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.680+0000 7f6fef400640 1 -- 172.21.15.144:0/80704310 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6ff81f52c0 con 0x7f6ff80ba090 2024-05-30T16:42:23.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:23.956+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7f6ff80d2410 con 0x7f6ff80ba090 2024-05-30T16:42:24.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.509+0000 7f6fef400640 1 -- 172.21.15.144:0/80704310 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v52) ==== 163+0+0 (secure 0 0 0) 0x7f6fe8059330 con 0x7f6ff80ba090 2024-05-30T16:42:24.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6fd806c8f0 msgr2=0x7f6fd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:24.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6fd806c8f0 0x7f6fd806edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4006fd0 tx=0x7f6fe4008040 comp rx=0 tx=0).stop 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80ba090 msgr2=0x7f6ff81f3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80ba090 0x7f6ff81f3e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c390 tx=0x7f6fe800c850 comp rx=0 tx=0).stop 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 shutdown_connections 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6fd806c8f0 0x7f6fd806edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff815e960 0x7f6ff8160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff80cfa10 0x7f6ff81f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 --2- 172.21.15.144:0/80704310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff80ba090 0x7f6ff81f3e10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 >> 172.21.15.144:0/80704310 conn(0x7f6ff80d1360 msgr2=0x7f6ff80b85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 shutdown_connections 2024-05-30T16:42:24.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.513+0000 7f6ffd000640 1 -- 172.21.15.144:0/80704310 wait complete. 2024-05-30T16:42:24.536 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:42:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.737+0000 7f4277800640 1 Processor -- start 2024-05-30T16:42:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.737+0000 7f4277800640 1 -- start start 2024-05-30T16:42:24.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.739+0000 7f4277800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700cec70 0x7f42700b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:24.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.739+0000 7f4277800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4270160730 con 0x7f427013f760 2024-05-30T16:42:24.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.739+0000 7f4277800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4270160a10 con 0x7f42700b5e00 2024-05-30T16:42:24.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.739+0000 7f4277800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f42701612b0 con 0x7f42700cec70 2024-05-30T16:42:24.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.739+0000 7f4274e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f427013f760 0x7f427006e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60988/0 (socket says 172.21.15.144:60988) 2024-05-30T16:42:24.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.739+0000 7f4274e00640 1 -- 172.21.15.144:0/3267446755 learned_addr learned my addr 172.21.15.144:0/3267446755 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.739+0000 7f426fe00640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700cec70 0x7f42700b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.739+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268517586 0 0) 0x7f4270160730 con 0x7f427013f760 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4258003520 con 0x7f427013f760 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1714867242 0 0) 0x7f4258003520 con 0x7f427013f760 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700cec70 msgr2=0x7f42700b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700cec70 0x7f42700b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 >> v1:172.21.15.149:6789/0 conn(0x7f42700b5e00 legacy=0x7f4270142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4270160cf0 con 0x7f427013f760 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f4264001670 con 0x7f427013f760 2024-05-30T16:42:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 >> v1:172.21.15.144:6789/0 conn(0x7f427013f760 legacy=0x7f427006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f4258003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700cec70 0x7f4258004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4258004d40 0x7f42580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42701612b0 con 0x7f42580039e0 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f425800bb30 con 0x7f4258004d40 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f425800bd30 con 0x7f42700cec70 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.740+0000 7f4274e00640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f4258003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.741+0000 7f4275800640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4258004d40 0x7f42580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.741+0000 7f426fe00640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700cec70 0x7f4258004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.741+0000 7f4274e00640 1 -- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700cec70 msgr2=0x7f4258004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.741+0000 7f4274e00640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700cec70 0x7f4258004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.741+0000 7f4274e00640 1 -- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4258004d40 msgr2=0x7f42580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.741+0000 7f4274e00640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4258004d40 0x7f42580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.741+0000 7f4274e00640 1 -- 172.21.15.144:0/3267446755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4258003520 con 0x7f42580039e0 2024-05-30T16:42:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.741+0000 7f426fe00640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700cec70 0x7f4258004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.741+0000 7f4275800640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4258004d40 0x7f42580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.742+0000 7f4274e00640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f4258003e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4264007fd0 tx=0x7f4258005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd547230310cc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.742+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264007c20 con 0x7f42580039e0 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.742+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4264005af0 con 0x7f42580039e0 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.742+0000 7f426f400640 1 -- 172.21.15.144:0/3267446755 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264007070 con 0x7f42580039e0 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.743+0000 7f4277800640 1 -- 172.21.15.144:0/3267446755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 msgr2=0x7f4258003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.743+0000 7f4277800640 1 --2- 172.21.15.144:0/3267446755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f4258003e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4264007fd0 tx=0x7f4258005830 comp rx=0 tx=0).stop 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.743+0000 7f4275800640 1 -- 172.21.15.144:0/3267446755 reap_dead start 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.743+0000 7f4277800640 1 -- 172.21.15.144:0/3267446755 shutdown_connections 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.743+0000 7f4277800640 1 -- 172.21.15.144:0/3267446755 >> 172.21.15.144:0/3267446755 conn(0x7f427006bd00 msgr2=0x7f427006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.743+0000 7f4277800640 1 -- 172.21.15.144:0/3267446755 shutdown_connections 2024-05-30T16:42:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.743+0000 7f4277800640 1 -- 172.21.15.144:0/3267446755 wait complete. 2024-05-30T16:42:24.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.745+0000 7f4277800640 1 Processor -- start 2024-05-30T16:42:24.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.745+0000 7f4277800640 1 -- start start 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4277800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f42701f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4277800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700b04f0 0x7f42700b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4277800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c7db0 0x7f42700c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4277800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42700cf0d0 con 0x7f42580039e0 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4277800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f42700cf250 con 0x7f42700c7db0 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4277800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f42700ce6a0 con 0x7f42700b04f0 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4274e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f42701f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4274e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f42701f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54846/0 (socket says 172.21.15.144:54846) 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4274e00640 1 -- 172.21.15.144:0/3292648336 learned_addr learned my addr 172.21.15.144:0/3292648336 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4275800640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c7db0 0x7f42700c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f426fe00640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700b04f0 0x7f42700b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4274e00640 1 -- 172.21.15.144:0/3292648336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700b04f0 msgr2=0x7f42700b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4274e00640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700b04f0 0x7f42700b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4274e00640 1 -- 172.21.15.144:0/3292648336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c7db0 msgr2=0x7f42700c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4274e00640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c7db0 0x7f42700c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.746+0000 7f4274e00640 1 -- 172.21.15.144:0/3292648336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42701f48c0 con 0x7f42580039e0 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.747+0000 7f4274e00640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f42701f4f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f426400c1d0 tx=0x7f4270160be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.747+0000 7f426cc00640 1 -- 172.21.15.144:0/3292648336 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264041020 con 0x7f42580039e0 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.747+0000 7f426cc00640 1 -- 172.21.15.144:0/3292648336 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4264038040 con 0x7f42580039e0 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.747+0000 7f426cc00640 1 -- 172.21.15.144:0/3292648336 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264007270 con 0x7f42580039e0 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.747+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42700b10b0 con 0x7f42580039e0 2024-05-30T16:42:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.747+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42700b1670 con 0x7f42580039e0 2024-05-30T16:42:24.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.748+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4270068b90 con 0x7f42580039e0 2024-05-30T16:42:24.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.749+0000 7f426cc00640 1 -- 172.21.15.144:0/3292648336 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4264044020 con 0x7f42580039e0 2024-05-30T16:42:24.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.750+0000 7f426cc00640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f425006c940 0x7f425006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:24.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.750+0000 7f426cc00640 1 -- 172.21.15.144:0/3292648336 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f42640abde0 con 0x7f42580039e0 2024-05-30T16:42:24.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.750+0000 7f426fe00640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f425006c940 0x7f425006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:24.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.751+0000 7f426fe00640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f425006c940 0x7f425006ee00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f42700cd870 tx=0x7f425c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:24.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.754+0000 7f426cc00640 1 -- 172.21.15.144:0/3292648336 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f426407a410 con 0x7f42580039e0 2024-05-30T16:42:24.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.939+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f42701f54b0 con 0x7f42580039e0 2024-05-30T16:42:24.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.946+0000 7f426cc00640 1 -- 172.21.15.144:0/3292648336 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f4264079d10 con 0x7f42580039e0 2024-05-30T16:42:24.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f425006c940 msgr2=0x7f425006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:24.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f425006c940 0x7f425006ee00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f42700cd870 tx=0x7f425c008040 comp rx=0 tx=0).stop 2024-05-30T16:42:24.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 msgr2=0x7f42701f4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:24.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f42701f4f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f426400c1d0 tx=0x7f4270160be0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 shutdown_connections 2024-05-30T16:42:24.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f425006c940 0x7f425006ee00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c7db0 0x7f42700c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700b04f0 0x7f42700b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 --2- 172.21.15.144:0/3292648336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42580039e0 0x7f42701f4f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:24.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 >> 172.21.15.144:0/3292648336 conn(0x7f427006bd00 msgr2=0x7f427015e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:24.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 shutdown_connections 2024-05-30T16:42:24.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:24.949+0000 7f4277800640 1 -- 172.21.15.144:0/3292648336 wait complete. 2024-05-30T16:42:24.968 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:42:24.968 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:42:25.073 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:42:25.193 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:42:25.193 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:25.193 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:25.250 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:25.250 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:25.305 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:25.306 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:25.360 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:42:25.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.557+0000 7f027aa00640 1 Processor -- start 2024-05-30T16:42:25.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.557+0000 7f027aa00640 1 -- start start 2024-05-30T16:42:25.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.559+0000 7f027aa00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f02740b5520 0x7f02740cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:25.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.559+0000 7f027aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f027406ec20 0x7f02740cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:25.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.559+0000 7f027aa00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027406f1d0 con 0x7f0274164290 2024-05-30T16:42:25.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.559+0000 7f027aa00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f02740b4d50 con 0x7f02740b5520 2024-05-30T16:42:25.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.559+0000 7f027aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f02741637b0 con 0x7f027406ec20 2024-05-30T16:42:25.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.560+0000 7f0273e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f02740b5520 0x7f02740cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:25.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.560+0000 7f0278a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f027406ec20 0x7f02740cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:25.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.560+0000 7f0278a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f027406ec20 0x7f02740cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:55722/0 (socket says 172.21.15.144:55722) 2024-05-30T16:42:25.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.560+0000 7f0278a00640 1 -- 172.21.15.144:0/3179987460 learned_addr learned my addr 172.21.15.144:0/3179987460 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:25.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.560+0000 7f026b400640 1 --1- 172.21.15.144:0/3179987460 >> v1:172.21.15.149:6789/0 conn(0x7f0274164290 0x7f027406e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:55568/0 (socket says 172.21.15.144:55568) 2024-05-30T16:42:25.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.561+0000 7f0278a00640 1 -- 172.21.15.144:0/3179987460 >> v2:172.21.15.149:3300/0 conn(0x7f02740b5520 msgr2=0x7f02740cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:25.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.561+0000 7f0278a00640 1 --2- 172.21.15.144:0/3179987460 >> v2:172.21.15.149:3300/0 conn(0x7f02740b5520 0x7f02740cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.561+0000 7f0278a00640 1 -- 172.21.15.144:0/3179987460 >> v1:172.21.15.149:6789/0 conn(0x7f0274164290 legacy=0x7f027406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:25.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.561+0000 7f0278a00640 1 -- 172.21.15.144:0/3179987460 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0274163a90 con 0x7f027406ec20 2024-05-30T16:42:25.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.561+0000 7f0273e00640 1 --2- 172.21.15.144:0/3179987460 >> v2:172.21.15.149:3300/0 conn(0x7f02740b5520 0x7f02740cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:42:25.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.562+0000 7f0278a00640 1 --2- 172.21.15.144:0/3179987460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f027406ec20 0x7f02740cf130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f026c009e50 tx=0x7f026c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4387faca9aa569e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:25.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.563+0000 7f0273400640 1 -- 172.21.15.144:0/3179987460 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c036070 con 0x7f027406ec20 2024-05-30T16:42:25.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.563+0000 7f0273400640 1 -- 172.21.15.144:0/3179987460 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c031600 con 0x7f027406ec20 2024-05-30T16:42:25.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.563+0000 7f0273400640 1 -- 172.21.15.144:0/3179987460 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c0319d0 con 0x7f027406ec20 2024-05-30T16:42:25.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.564+0000 7f027aa00640 1 -- 172.21.15.144:0/3179987460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f027406ec20 msgr2=0x7f02740cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:25.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.564+0000 7f027aa00640 1 --2- 172.21.15.144:0/3179987460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f027406ec20 0x7f02740cf130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f026c009e50 tx=0x7f026c02a710 comp rx=0 tx=0).stop 2024-05-30T16:42:25.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.564+0000 7f027aa00640 1 -- 172.21.15.144:0/3179987460 shutdown_connections 2024-05-30T16:42:25.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.564+0000 7f027aa00640 1 --2- 172.21.15.144:0/3179987460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f027406ec20 0x7f02740cf130 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.564+0000 7f027aa00640 1 --2- 172.21.15.144:0/3179987460 >> v2:172.21.15.149:3300/0 conn(0x7f02740b5520 0x7f02740cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.564+0000 7f027aa00640 1 -- 172.21.15.144:0/3179987460 >> 172.21.15.144:0/3179987460 conn(0x7f02740629c0 msgr2=0x7f027406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:25.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.564+0000 7f027aa00640 1 -- 172.21.15.144:0/3179987460 shutdown_connections 2024-05-30T16:42:25.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.564+0000 7f027aa00640 1 -- 172.21.15.144:0/3179987460 wait complete. 2024-05-30T16:42:25.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.566+0000 7f027aa00640 1 Processor -- start 2024-05-30T16:42:25.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.566+0000 7f027aa00640 1 -- start start 2024-05-30T16:42:25.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.567+0000 7f027aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f027406ec20 0x7f02740af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:25.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.567+0000 7f027aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02740b5520 0x7f0274149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:25.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.567+0000 7f027aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0274164290 0x7f027414ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:25.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.567+0000 7f027aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02740b5900 con 0x7f02740b5520 2024-05-30T16:42:25.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.567+0000 7f027aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02741634c0 con 0x7f027406ec20 2024-05-30T16:42:25.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.567+0000 7f027aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f02740b5a80 con 0x7f0274164290 2024-05-30T16:42:25.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.567+0000 7f026b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02740b5520 0x7f0274149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:25.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.567+0000 7f026b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02740b5520 0x7f0274149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44142/0 (socket says 172.21.15.144:44142) 2024-05-30T16:42:25.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.567+0000 7f026b400640 1 -- 172.21.15.144:0/2315056985 learned_addr learned my addr 172.21.15.144:0/2315056985 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:25.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f0278a00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0274164290 0x7f027414ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:25.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f0273e00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f027406ec20 0x7f02740af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:25.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f026b400640 1 -- 172.21.15.144:0/2315056985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0274164290 msgr2=0x7f027414ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:25.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f026b400640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0274164290 0x7f027414ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f026b400640 1 -- 172.21.15.144:0/2315056985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f027406ec20 msgr2=0x7f02740af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:25.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f026b400640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f027406ec20 0x7f02740af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f026b400640 1 -- 172.21.15.144:0/2315056985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0274149a90 con 0x7f02740b5520 2024-05-30T16:42:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f0273e00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f027406ec20 0x7f02740af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f026b400640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02740b5520 0x7f0274149380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c3c0 tx=0x7f025c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f0270c00640 1 -- 172.21.15.144:0/2315056985 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c0074e0 con 0x7f02740b5520 2024-05-30T16:42:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f0270c00640 1 -- 172.21.15.144:0/2315056985 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025c007680 con 0x7f02740b5520 2024-05-30T16:42:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f0270c00640 1 -- 172.21.15.144:0/2315056985 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c004a00 con 0x7f02740b5520 2024-05-30T16:42:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.568+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0274149d70 con 0x7f02740b5520 2024-05-30T16:42:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.569+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027414a330 con 0x7f02740b5520 2024-05-30T16:42:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.570+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027406c870 con 0x7f02740b5520 2024-05-30T16:42:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.571+0000 7f0270c00640 1 -- 172.21.15.144:0/2315056985 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f025c01a020 con 0x7f02740b5520 2024-05-30T16:42:25.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.571+0000 7f0270c00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f025006c8f0 0x7f025006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:25.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.572+0000 7f0270c00640 1 -- 172.21.15.144:0/2315056985 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f025c08b370 con 0x7f02740b5520 2024-05-30T16:42:25.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.572+0000 7f0273e00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f025006c8f0 0x7f025006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:25.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.573+0000 7f0273e00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f025006c8f0 0x7f025006edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0264009ac0 tx=0x7f0264008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:25.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.576+0000 7f0270c00640 1 -- 172.21.15.144:0/2315056985 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f025c059790 con 0x7f02740b5520 2024-05-30T16:42:25.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.788+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f027406e7f0 con 0x7f02740b5520 2024-05-30T16:42:25.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.789+0000 7f0270c00640 1 -- 172.21.15.144:0/2315056985 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f025c059090 con 0x7f02740b5520 2024-05-30T16:42:25.790 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-05-30T16:42:25.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f025006c8f0 msgr2=0x7f025006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:25.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f025006c8f0 0x7f025006edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0264009ac0 tx=0x7f0264008040 comp rx=0 tx=0).stop 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02740b5520 msgr2=0x7f0274149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02740b5520 0x7f0274149380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c3c0 tx=0x7f025c00c7c0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 shutdown_connections 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f025006c8f0 0x7f025006edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0274164290 0x7f027414ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02740b5520 0x7f0274149380 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 --2- 172.21.15.144:0/2315056985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f027406ec20 0x7f02740af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 >> 172.21.15.144:0/2315056985 conn(0x7f02740629c0 msgr2=0x7f02740ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 shutdown_connections 2024-05-30T16:42:25.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:25.792+0000 7f027aa00640 1 -- 172.21.15.144:0/2315056985 wait complete. 2024-05-30T16:42:25.812 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T16:42:25.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:25.813 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-30T16:42:25.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:42:25.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:25.899 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:42:25.969 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:42:25.969 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:26.027 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:42:26.027 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:26.082 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:42:26.082 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:26.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:42:26.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.329+0000 7efd45400640 1 Processor -- start 2024-05-30T16:42:26.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.329+0000 7efd45400640 1 -- start start 2024-05-30T16:42:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.330+0000 7efd45400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd4015e980 0x7efd400b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.330+0000 7efd45400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d4470 0x7efd400b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.330+0000 7efd45400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd400b7920 con 0x7efd400d28b0 2024-05-30T16:42:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.330+0000 7efd45400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7efd4015ed60 con 0x7efd4015e980 2024-05-30T16:42:26.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.330+0000 7efd45400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd400b65b0 con 0x7efd400d4470 2024-05-30T16:42:26.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.331+0000 7efd3e800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd4015e980 0x7efd400b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:26.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.331+0000 7efd3e800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd4015e980 0x7efd400b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:55948/0 (socket says 172.21.15.144:55948) 2024-05-30T16:42:26.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.331+0000 7efd3e800640 1 -- 172.21.15.144:0/1201140418 learned_addr learned my addr 172.21.15.144:0/1201140418 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:26.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.331+0000 7efd3f200640 1 --2- 172.21.15.144:0/1201140418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d4470 0x7efd400b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:26.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.332+0000 7efd3e800640 1 -- 172.21.15.144:0/1201140418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d4470 msgr2=0x7efd400b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:26.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.332+0000 7efd3e800640 1 --2- 172.21.15.144:0/1201140418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d4470 0x7efd400b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.332+0000 7efd3e800640 1 -- 172.21.15.144:0/1201140418 >> v1:172.21.15.149:6789/0 conn(0x7efd400d28b0 legacy=0x7efd400d3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:26.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.332+0000 7efd3e800640 1 -- 172.21.15.144:0/1201140418 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd400d2e70 con 0x7efd4015e980 2024-05-30T16:42:26.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.333+0000 7efd3e800640 1 --2- 172.21.15.144:0/1201140418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 0x7efd400b6900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efd30009870 tx=0x7efd3002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0b7bf2dbbf4e1d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:26.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.334+0000 7efd3de00640 1 -- 172.21.15.144:0/1201140418 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30037070 con 0x7efd4015e980 2024-05-30T16:42:26.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.334+0000 7efd3de00640 1 -- 172.21.15.144:0/1201140418 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd30032440 con 0x7efd4015e980 2024-05-30T16:42:26.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.334+0000 7efd3de00640 1 -- 172.21.15.144:0/1201140418 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30032810 con 0x7efd4015e980 2024-05-30T16:42:26.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.334+0000 7efd45400640 1 -- 172.21.15.144:0/1201140418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 msgr2=0x7efd400b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:26.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.334+0000 7efd45400640 1 --2- 172.21.15.144:0/1201140418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 0x7efd400b6900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efd30009870 tx=0x7efd3002a270 comp rx=0 tx=0).stop 2024-05-30T16:42:26.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.334+0000 7efd45400640 1 -- 172.21.15.144:0/1201140418 shutdown_connections 2024-05-30T16:42:26.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.334+0000 7efd45400640 1 --2- 172.21.15.144:0/1201140418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d4470 0x7efd400b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.334+0000 7efd45400640 1 --2- 172.21.15.144:0/1201140418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 0x7efd400b6900 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.334+0000 7efd45400640 1 -- 172.21.15.144:0/1201140418 >> 172.21.15.144:0/1201140418 conn(0x7efd400629c0 msgr2=0x7efd400d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:26.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.335+0000 7efd45400640 1 -- 172.21.15.144:0/1201140418 shutdown_connections 2024-05-30T16:42:26.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.335+0000 7efd45400640 1 -- 172.21.15.144:0/1201140418 wait complete. 2024-05-30T16:42:26.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.336+0000 7efd45400640 1 Processor -- start 2024-05-30T16:42:26.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.336+0000 7efd45400640 1 -- start start 2024-05-30T16:42:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.337+0000 7efd45400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d28b0 0x7efd40149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.337+0000 7efd45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd400d4470 0x7efd40157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.337+0000 7efd45400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 0x7efd4015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.337+0000 7efd45400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd400d3710 con 0x7efd400d4470 2024-05-30T16:42:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.337+0000 7efd45400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd400d3430 con 0x7efd4015e980 2024-05-30T16:42:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.337+0000 7efd45400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd400b8320 con 0x7efd400d28b0 2024-05-30T16:42:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd35e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd400d4470 0x7efd40157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd35e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd400d4470 0x7efd40157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44144/0 (socket says 172.21.15.144:44144) 2024-05-30T16:42:26.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd35e00640 1 -- 172.21.15.144:0/2647221013 learned_addr learned my addr 172.21.15.144:0/2647221013 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:26.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd3e800640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d28b0 0x7efd40149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:26.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd3f200640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 0x7efd4015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:26.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd35e00640 1 -- 172.21.15.144:0/2647221013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d28b0 msgr2=0x7efd40149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:26.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd35e00640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d28b0 0x7efd40149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd35e00640 1 -- 172.21.15.144:0/2647221013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 msgr2=0x7efd4015c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:26.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd35e00640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 0x7efd4015c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd35e00640 1 -- 172.21.15.144:0/2647221013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4015f3a0 con 0x7efd400d4470 2024-05-30T16:42:26.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd3f200640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 0x7efd4015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:26.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.338+0000 7efd35e00640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd400d4470 0x7efd40157560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efd2800c400 tx=0x7efd2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:26.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.339+0000 7efd37400640 1 -- 172.21.15.144:0/2647221013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd280052d0 con 0x7efd400d4470 2024-05-30T16:42:26.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.339+0000 7efd37400640 1 -- 172.21.15.144:0/2647221013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd28005490 con 0x7efd400d4470 2024-05-30T16:42:26.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.339+0000 7efd37400640 1 -- 172.21.15.144:0/2647221013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28007260 con 0x7efd400d4470 2024-05-30T16:42:26.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.339+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4015f680 con 0x7efd400d4470 2024-05-30T16:42:26.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.339+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd4015fc40 con 0x7efd400d4470 2024-05-30T16:42:26.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.340+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd40068b20 con 0x7efd400d4470 2024-05-30T16:42:26.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.341+0000 7efd37400640 1 -- 172.21.15.144:0/2647221013 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd28007400 con 0x7efd400d4470 2024-05-30T16:42:26.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.342+0000 7efd37400640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd1c06c940 0x7efd1c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:26.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.342+0000 7efd37400640 1 -- 172.21.15.144:0/2647221013 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efd2808aff0 con 0x7efd400d4470 2024-05-30T16:42:26.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.342+0000 7efd3e800640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd1c06c940 0x7efd1c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:26.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.343+0000 7efd3e800640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd1c06c940 0x7efd1c06ee00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd30034000 tx=0x7efd3002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:26.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.346+0000 7efd37400640 1 -- 172.21.15.144:0/2647221013 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd400b7920 con 0x7efd400d4470 2024-05-30T16:42:26.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.562+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efd400b9b50 con 0x7efd400d4470 2024-05-30T16:42:26.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.563+0000 7efd37400640 1 -- 172.21.15.144:0/2647221013 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7efd280594d0 con 0x7efd400d4470 2024-05-30T16:42:26.564 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-05-30T16:42:26.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd1c06c940 msgr2=0x7efd1c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:26.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd1c06c940 0x7efd1c06ee00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd30034000 tx=0x7efd3002e000 comp rx=0 tx=0).stop 2024-05-30T16:42:26.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd400d4470 msgr2=0x7efd40157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:26.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd400d4470 0x7efd40157560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efd2800c400 tx=0x7efd2800c8c0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 shutdown_connections 2024-05-30T16:42:26.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efd1c06c940 0x7efd1c06ee00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd4015e980 0x7efd4015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd400d4470 0x7efd40157560 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 --2- 172.21.15.144:0/2647221013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd400d28b0 0x7efd40149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:26.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 >> 172.21.15.144:0/2647221013 conn(0x7efd400629c0 msgr2=0x7efd4015d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:26.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 shutdown_connections 2024-05-30T16:42:26.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:26.566+0000 7efd45400640 1 -- 172.21.15.144:0/2647221013 wait complete. 2024-05-30T16:42:26.586 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-30T16:42:26.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:26.586 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-30T16:42:26.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:42:26.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:26.691 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-30T16:42:26.753 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:26.754 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:26.802 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:26.802 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:26.886 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:26.887 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:26.977 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:42:27.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.208+0000 7fb1ea200640 1 Processor -- start 2024-05-30T16:42:27.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.208+0000 7fb1ea200640 1 -- start start 2024-05-30T16:42:27.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.209+0000 7fb1ea200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e40ce390 0x7fb1e415e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.209+0000 7fb1ea200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb1e41604c0 0x7fb1e406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.209+0000 7fb1ea200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e4160c40 con 0x7fb1e415da50 2024-05-30T16:42:27.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.209+0000 7fb1ea200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e415deb0 con 0x7fb1e41604c0 2024-05-30T16:42:27.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.209+0000 7fb1ea200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e4160f20 con 0x7fb1e40ce390 2024-05-30T16:42:27.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.210+0000 7fb1e2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb1e415da50 0x7fb1e40ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43108/0 (socket says 172.21.15.144:43108) 2024-05-30T16:42:27.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.210+0000 7fb1e2a00640 1 -- 172.21.15.144:0/3612302215 learned_addr learned my addr 172.21.15.144:0/3612302215 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.210+0000 7fb1e3400640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e40ce390 0x7fb1e415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.210+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/3612302215 >> v2:172.21.15.149:3300/0 conn(0x7fb1e41604c0 0x7fb1e406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.210+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052481219 0 0) 0x7fb1e4160c40 con 0x7fb1e415da50 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.210+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1c8003520 con 0x7fb1e415da50 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2887293967 0 0) 0x7fb1c8003520 con 0x7fb1e415da50 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e40ce390 msgr2=0x7fb1e415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e40ce390 0x7fb1e415e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 >> v2:172.21.15.149:3300/0 conn(0x7fb1e41604c0 msgr2=0x7fb1e406ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 --2- 172.21.15.144:0/3612302215 >> v2:172.21.15.149:3300/0 conn(0x7fb1e41604c0 0x7fb1e406ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e4161200 con 0x7fb1e415da50 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fb1d0001670 con 0x7fb1e415da50 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 >> v1:172.21.15.144:6789/0 conn(0x7fb1e415da50 legacy=0x7fb1e40ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:27.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e40ce390 0x7fb1c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1c8003f80 0x7fb1c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8004d40 0x7fb1c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e415deb0 con 0x7fb1c8004d40 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e4160f20 con 0x7fb1c8003f80 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c800b9c0 con 0x7fb1e40ce390 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.211+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8004d40 0x7fb1c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.212+0000 7fb1e2a00640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1c8003f80 0x7fb1c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.212+0000 7fb1e3400640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e40ce390 0x7fb1c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.212+0000 7fb1e3e00640 1 -- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e40ce390 msgr2=0x7fb1c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.212+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e40ce390 0x7fb1c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.212+0000 7fb1e3e00640 1 -- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1c8003f80 msgr2=0x7fb1c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.212+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1c8003f80 0x7fb1c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.212+0000 7fb1e3e00640 1 -- 172.21.15.144:0/3612302215 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c8003520 con 0x7fb1c8004d40 2024-05-30T16:42:27.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.213+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8004d40 0x7fb1c80051c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00e170 tx=0x7fb1c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0dabecb0f118a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:27.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc034020 con 0x7fb1c8004d40 2024-05-30T16:42:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc030430 con 0x7fb1c8004d40 2024-05-30T16:42:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1e2000640 1 -- 172.21.15.144:0/3612302215 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc009c10 con 0x7fb1c8004d40 2024-05-30T16:42:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1ea200640 1 -- 172.21.15.144:0/3612302215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8004d40 msgr2=0x7fb1c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1ea200640 1 --2- 172.21.15.144:0/3612302215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8004d40 0x7fb1c80051c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00e170 tx=0x7fb1c8005830 comp rx=0 tx=0).stop 2024-05-30T16:42:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1e3e00640 1 -- 172.21.15.144:0/3612302215 reap_dead start 2024-05-30T16:42:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1ea200640 1 -- 172.21.15.144:0/3612302215 shutdown_connections 2024-05-30T16:42:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1ea200640 1 -- 172.21.15.144:0/3612302215 >> 172.21.15.144:0/3612302215 conn(0x7fb1e40629c0 msgr2=0x7fb1e406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1ea200640 1 -- 172.21.15.144:0/3612302215 shutdown_connections 2024-05-30T16:42:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.214+0000 7fb1ea200640 1 -- 172.21.15.144:0/3612302215 wait complete. 2024-05-30T16:42:27.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.216+0000 7fb1ea200640 1 Processor -- start 2024-05-30T16:42:27.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.216+0000 7fb1ea200640 1 -- start start 2024-05-30T16:42:27.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.217+0000 7fb1ea200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e4157e40 0x7fb1e40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.217+0000 7fb1ea200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e40af3d0 0x7fb1e41f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.217+0000 7fb1ea200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e41f2ed0 0x7fb1e41f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.217+0000 7fb1ea200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e4143130 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.217+0000 7fb1ea200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e41608f0 con 0x7fb1e40af3d0 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.217+0000 7fb1ea200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e41432b0 con 0x7fb1e4157e40 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e41f2ed0 0x7fb1e41f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e41f2ed0 0x7fb1e41f5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44170/0 (socket says 172.21.15.144:44170) 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e3e00640 1 -- 172.21.15.144:0/2069408283 learned_addr learned my addr 172.21.15.144:0/2069408283 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e3400640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e4157e40 0x7fb1e40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e2a00640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e40af3d0 0x7fb1e41f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e3e00640 1 -- 172.21.15.144:0/2069408283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e4157e40 msgr2=0x7fb1e40c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e4157e40 0x7fb1e40c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e3e00640 1 -- 172.21.15.144:0/2069408283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e40af3d0 msgr2=0x7fb1e41f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e40af3d0 0x7fb1e41f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.218+0000 7fb1e3e00640 1 -- 172.21.15.144:0/2069408283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e41f3350 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.219+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e41f2ed0 0x7fb1e41f5f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc02af70 tx=0x7fb1dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:27.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.219+0000 7fb1db400640 1 -- 172.21.15.144:0/2069408283 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc034070 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.219+0000 7fb1db400640 1 -- 172.21.15.144:0/2069408283 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc003b90 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.219+0000 7fb1db400640 1 -- 172.21.15.144:0/2069408283 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc009c10 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.219+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e4142210 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.219+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e40ac1b0 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.221+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e406c870 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.221+0000 7fb1db400640 1 -- 172.21.15.144:0/2069408283 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1dc037020 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.222+0000 7fb1db400640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1c406c920 0x7fb1c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.222+0000 7fb1db400640 1 -- 172.21.15.144:0/2069408283 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb1dc0ac650 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.223+0000 7fb1e3400640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1c406c920 0x7fb1c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.223+0000 7fb1e3400640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1c406c920 0x7fb1c406ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1e415a0d0 tx=0x7fb1d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.231+0000 7fb1db400640 1 -- 172.21.15.144:0/2069408283 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1dc047060 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.444+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1e40cddd0 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.445+0000 7fb1db400640 1 -- 172.21.15.144:0/2069408283 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fb1e41f3350 con 0x7fb1e41f2ed0 2024-05-30T16:42:27.446 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1c406c920 msgr2=0x7fb1c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1c406c920 0x7fb1c406ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1e415a0d0 tx=0x7fb1d4008040 comp rx=0 tx=0).stop 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e41f2ed0 msgr2=0x7fb1e41f5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e41f2ed0 0x7fb1e41f5f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc02af70 tx=0x7fb1dc009750 comp rx=0 tx=0).stop 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 shutdown_connections 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1c406c920 0x7fb1c406ede0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e41f2ed0 0x7fb1e41f5f40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e40af3d0 0x7fb1e41f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 --2- 172.21.15.144:0/2069408283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e4157e40 0x7fb1e40c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 >> 172.21.15.144:0/2069408283 conn(0x7fb1e40629c0 msgr2=0x7fb1e4071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:27.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 shutdown_connections 2024-05-30T16:42:27.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.448+0000 7fb1ea200640 1 -- 172.21.15.144:0/2069408283 wait complete. 2024-05-30T16:42:27.466 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-30T16:42:27.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:27.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-30T16:42:27.545 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:42:27.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:27.546 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-30T16:42:27.592 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:42:27.592 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:27.650 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:42:27.650 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:27.702 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:42:27.702 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:27.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:42:27.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.934+0000 7f0be3200640 1 Processor -- start 2024-05-30T16:42:27.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.934+0000 7f0be3200640 1 -- start start 2024-05-30T16:42:27.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.935+0000 7f0be3200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0bdc159320 0x7f0bdc06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.935+0000 7f0be3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0bdc06f770 0x7f0bdc15f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.935+0000 7f0be3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bdc15fe40 0x7f0bdc0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.935+0000 7f0be3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0bdc15f120 con 0x7f0bdc06f770 2024-05-30T16:42:27.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.935+0000 7f0be3200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f0bdc0cee40 con 0x7f0bdc159320 2024-05-30T16:42:27.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.935+0000 7f0be3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc0cf120 con 0x7f0bdc15fe40 2024-05-30T16:42:27.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0bdc06f770 0x7f0bdc15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0bdc06f770 0x7f0bdc15f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44180/0 (socket says 172.21.15.144:44180) 2024-05-30T16:42:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdb400640 1 -- 172.21.15.144:0/2783286287 learned_addr learned my addr 172.21.15.144:0/2783286287 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/2783286287 >> v2:172.21.15.149:3300/0 conn(0x7f0bdc159320 0x7f0bdc06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdb400640 1 -- 172.21.15.144:0/2783286287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bdc15fe40 msgr2=0x7f0bdc0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdb400640 1 --2- 172.21.15.144:0/2783286287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bdc15fe40 0x7f0bdc0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdb400640 1 -- 172.21.15.144:0/2783286287 >> v2:172.21.15.149:3300/0 conn(0x7f0bdc159320 msgr2=0x7f0bdc06efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdb400640 1 --2- 172.21.15.144:0/2783286287 >> v2:172.21.15.149:3300/0 conn(0x7f0bdc159320 0x7f0bdc06efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdb400640 1 -- 172.21.15.144:0/2783286287 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc0cf400 con 0x7f0bdc06f770 2024-05-30T16:42:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.936+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/2783286287 >> v2:172.21.15.149:3300/0 conn(0x7f0bdc159320 0x7f0bdc06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.937+0000 7f0bdb400640 1 --2- 172.21.15.144:0/2783286287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc06f770 0x7f0bdc15f900 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc074320 tx=0x7f0bc402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5c9c5e60cd025e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0bdaa00640 1 -- 172.21.15.144:0/2783286287 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4037070 con 0x7f0bdc06f770 2024-05-30T16:42:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0bdaa00640 1 -- 172.21.15.144:0/2783286287 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc4032440 con 0x7f0bdc06f770 2024-05-30T16:42:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0bdaa00640 1 -- 172.21.15.144:0/2783286287 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4032810 con 0x7f0bdc06f770 2024-05-30T16:42:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0be3200640 1 -- 172.21.15.144:0/2783286287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc06f770 msgr2=0x7f0bdc15f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0be3200640 1 --2- 172.21.15.144:0/2783286287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc06f770 0x7f0bdc15f900 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc074320 tx=0x7f0bc402a140 comp rx=0 tx=0).stop 2024-05-30T16:42:27.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0be3200640 1 -- 172.21.15.144:0/2783286287 shutdown_connections 2024-05-30T16:42:27.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0be3200640 1 --2- 172.21.15.144:0/2783286287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bdc15fe40 0x7f0bdc0ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0be3200640 1 --2- 172.21.15.144:0/2783286287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc06f770 0x7f0bdc15f900 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0be3200640 1 --2- 172.21.15.144:0/2783286287 >> v2:172.21.15.149:3300/0 conn(0x7f0bdc159320 0x7f0bdc06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0be3200640 1 -- 172.21.15.144:0/2783286287 >> 172.21.15.144:0/2783286287 conn(0x7f0bdc0629c0 msgr2=0x7f0bdc06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:27.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0be3200640 1 -- 172.21.15.144:0/2783286287 shutdown_connections 2024-05-30T16:42:27.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.938+0000 7f0be3200640 1 -- 172.21.15.144:0/2783286287 wait complete. 2024-05-30T16:42:27.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.940+0000 7f0be3200640 1 Processor -- start 2024-05-30T16:42:27.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.941+0000 7f0be3200640 1 -- start start 2024-05-30T16:42:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bdc06f770 0x7f0bdc14d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc159320 0x7f0bdc161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc14dc40 0x7f0bdc1617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc0cd0e0 con 0x7f0bdc14dc40 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc06fc00 con 0x7f0bdc159320 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc0cd260 con 0x7f0bdc06f770 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc14dc40 0x7f0bdc1617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc14dc40 0x7f0bdc1617c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44188/0 (socket says 172.21.15.144:44188) 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be1200640 1 -- 172.21.15.144:0/2444785756 learned_addr learned my addr 172.21.15.144:0/2444785756 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bdc06f770 0x7f0bdc14d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be1200640 1 -- 172.21.15.144:0/2444785756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bdc06f770 msgr2=0x7f0bdc14d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be1200640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bdc06f770 0x7f0bdc14d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be1200640 1 -- 172.21.15.144:0/2444785756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc159320 msgr2=0x7f0bdc161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.942+0000 7f0be1200640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc159320 0x7f0bdc161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.943+0000 7f0be1200640 1 -- 172.21.15.144:0/2444785756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc15e580 con 0x7f0bdc14dc40 2024-05-30T16:42:27.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.943+0000 7f0be1200640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc14dc40 0x7f0bdc1617c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400b410 tx=0x7f0bd400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:27.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.943+0000 7f0bd3e00640 1 -- 172.21.15.144:0/2444785756 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4015020 con 0x7f0bdc14dc40 2024-05-30T16:42:27.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.943+0000 7f0bd3e00640 1 -- 172.21.15.144:0/2444785756 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd4011830 con 0x7f0bdc14dc40 2024-05-30T16:42:27.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.943+0000 7f0bd3e00640 1 -- 172.21.15.144:0/2444785756 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4011c20 con 0x7f0bdc14dc40 2024-05-30T16:42:27.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.943+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bdc15e860 con 0x7f0bdc14dc40 2024-05-30T16:42:27.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.943+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bdc14eeb0 con 0x7f0bdc14dc40 2024-05-30T16:42:27.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.944+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bdc06c870 con 0x7f0bdc14dc40 2024-05-30T16:42:27.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.945+0000 7f0bd3e00640 1 -- 172.21.15.144:0/2444785756 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0bd4018020 con 0x7f0bdc14dc40 2024-05-30T16:42:27.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.946+0000 7f0bd3e00640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bb806c8f0 0x7f0bb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:27.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.946+0000 7f0bd3e00640 1 -- 172.21.15.144:0/2444785756 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0bd408ba50 con 0x7f0bdc14dc40 2024-05-30T16:42:27.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.946+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bb806c8f0 0x7f0bb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:27.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.947+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bb806c8f0 0x7f0bb806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0075b0 tx=0x7f0bcc007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:27.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:27.951+0000 7f0bd3e00640 1 -- 172.21.15.144:0/2444785756 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0bd401f020 con 0x7f0bdc14dc40 2024-05-30T16:42:28.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.161+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0bdc15ea30 con 0x7f0bdc14dc40 2024-05-30T16:42:28.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.162+0000 7f0bd3e00640 1 -- 172.21.15.144:0/2444785756 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f0bd40172c0 con 0x7f0bdc14dc40 2024-05-30T16:42:28.163 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-05-30T16:42:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bb806c8f0 msgr2=0x7f0bb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bb806c8f0 0x7f0bb806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0075b0 tx=0x7f0bcc007540 comp rx=0 tx=0).stop 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc14dc40 msgr2=0x7f0bdc1617c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc14dc40 0x7f0bdc1617c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400b410 tx=0x7f0bd400b810 comp rx=0 tx=0).stop 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 shutdown_connections 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bb806c8f0 0x7f0bb806edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bdc14dc40 0x7f0bdc1617c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc159320 0x7f0bdc161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 --2- 172.21.15.144:0/2444785756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bdc06f770 0x7f0bdc14d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.165+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 >> 172.21.15.144:0/2444785756 conn(0x7f0bdc0629c0 msgr2=0x7f0bdc0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.166+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 shutdown_connections 2024-05-30T16:42:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.166+0000 7f0be3200640 1 -- 172.21.15.144:0/2444785756 wait complete. 2024-05-30T16:42:28.186 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-30T16:42:28.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:28.186 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-30T16:42:28.281 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:42:28.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:28.282 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-30T16:42:28.328 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T16:42:28.328 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:42:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.535+0000 7f20d3200640 1 Processor -- start 2024-05-30T16:42:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.535+0000 7f20d3200640 1 -- start start 2024-05-30T16:42:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.537+0000 7f20d3200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f20cc15e960 0x7f20cc162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.537+0000 7f20d3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20cc15ed40 con 0x7f20cc0cfbe0 2024-05-30T16:42:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.537+0000 7f20d3200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20cc1629d0 con 0x7f20cc0ba090 2024-05-30T16:42:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.537+0000 7f20d3200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f20cc0d2b40 con 0x7f20cc15e960 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.537+0000 7f20d2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f20cc0cfbe0 0x7f20cc0d32b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43120/0 (socket says 172.21.15.144:43120) 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d2800640 1 -- 172.21.15.144:0/639518719 learned_addr learned my addr 172.21.15.144:0/639518719 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d1e00640 1 --2- 172.21.15.144:0/639518719 >> v2:172.21.15.149:3300/0 conn(0x7f20cc15e960 0x7f20cc162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 981654666 0 0) 0x7f20cc15ed40 con 0x7f20cc0cfbe0 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20b4003520 con 0x7f20cc0cfbe0 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 731883920 0 0) 0x7f20b4003520 con 0x7f20cc0cfbe0 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 >> v2:172.21.15.149:3300/0 conn(0x7f20cc15e960 msgr2=0x7f20cc162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d0a00640 1 --2- 172.21.15.144:0/639518719 >> v2:172.21.15.149:3300/0 conn(0x7f20cc15e960 0x7f20cc162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 >> v1:172.21.15.149:6789/0 conn(0x7f20cc0ba090 legacy=0x7f20cc0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc162ca0 con 0x7f20cc0cfbe0 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.538+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f20c80019f0 con 0x7f20cc0cfbe0 2024-05-30T16:42:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 >> v1:172.21.15.144:6789/0 conn(0x7f20cc0cfbe0 legacy=0x7f20cc0d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d0a00640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b40039b0 0x7f20b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d0a00640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20b4004800 0x7f20b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d0a00640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40051c0 0x7f20b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc0d2b40 con 0x7f20b40039b0 2024-05-30T16:42:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f20b400c060 con 0x7f20b40051c0 2024-05-30T16:42:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f20b400c260 con 0x7f20b4004800 2024-05-30T16:42:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d1e00640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b40039b0 0x7f20b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d1400640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20b4004800 0x7f20b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d1e00640 1 -- 172.21.15.144:0/639518719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20b4004800 msgr2=0x7f20b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d1e00640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20b4004800 0x7f20b4004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d1e00640 1 -- 172.21.15.144:0/639518719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40051c0 msgr2=0x7f20b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d1e00640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40051c0 0x7f20b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d2800640 1 -- 172.21.15.144:0/639518719 reap_dead start 2024-05-30T16:42:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.539+0000 7f20d1e00640 1 -- 172.21.15.144:0/639518719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b4003520 con 0x7f20b40039b0 2024-05-30T16:42:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.541+0000 7f20d1e00640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b40039b0 0x7f20b4003dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009ac0 tx=0x7f20b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385090a3014df52e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.541+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0036070 con 0x7f20b40039b0 2024-05-30T16:42:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.541+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c0031400 con 0x7f20b40039b0 2024-05-30T16:42:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.541+0000 7f20d0a00640 1 -- 172.21.15.144:0/639518719 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0009690 con 0x7f20b40039b0 2024-05-30T16:42:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.542+0000 7f20d3200640 1 -- 172.21.15.144:0/639518719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b40039b0 msgr2=0x7f20b4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.542+0000 7f20d3200640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b40039b0 0x7f20b4003dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009ac0 tx=0x7f20b4005830 comp rx=0 tx=0).stop 2024-05-30T16:42:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.542+0000 7f20d3200640 1 -- 172.21.15.144:0/639518719 shutdown_connections 2024-05-30T16:42:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.542+0000 7f20d3200640 1 --2- 172.21.15.144:0/639518719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b40039b0 0x7f20b4003dd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.542+0000 7f20d3200640 1 -- 172.21.15.144:0/639518719 >> 172.21.15.144:0/639518719 conn(0x7f20cc0d1360 msgr2=0x7f20cc0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.542+0000 7f20d3200640 1 -- 172.21.15.144:0/639518719 shutdown_connections 2024-05-30T16:42:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.542+0000 7f20d3200640 1 -- 172.21.15.144:0/639518719 wait complete. 2024-05-30T16:42:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.544+0000 7f20d3200640 1 Processor -- start 2024-05-30T16:42:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.544+0000 7f20d3200640 1 -- start start 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.544+0000 7f20d3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40039b0 0x7f20cc159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20cc1f5980 0x7f20cc0ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc0acee0 0x7f20cc1f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc0d2d90 con 0x7f20cc0acee0 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc163260 con 0x7f20b40039b0 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f20cc0b78a0 con 0x7f20cc1f5980 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc0acee0 0x7f20cc1f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc0acee0 0x7f20cc1f47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44202/0 (socket says 172.21.15.144:44202) 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d2800640 1 -- 172.21.15.144:0/3442943643 learned_addr learned my addr 172.21.15.144:0/3442943643 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d1400640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20cc1f5980 0x7f20cc0ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:28.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d1e00640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40039b0 0x7f20cc159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d2800640 1 -- 172.21.15.144:0/3442943643 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20cc1f5980 msgr2=0x7f20cc0ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d2800640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20cc1f5980 0x7f20cc0ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d2800640 1 -- 172.21.15.144:0/3442943643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40039b0 msgr2=0x7f20cc159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d2800640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40039b0 0x7f20cc159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.545+0000 7f20d2800640 1 -- 172.21.15.144:0/3442943643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc15d830 con 0x7f20cc0acee0 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.546+0000 7f20d2800640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc0acee0 0x7f20cc1f47e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c840 tx=0x7f20c800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.546+0000 7f20c6000640 1 -- 172.21.15.144:0/3442943643 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c800a640 con 0x7f20cc0acee0 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.546+0000 7f20c6000640 1 -- 172.21.15.144:0/3442943643 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c800a7e0 con 0x7f20cc0acee0 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.546+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20cc1f53c0 con 0x7f20cc0acee0 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.546+0000 7f20c6000640 1 -- 172.21.15.144:0/3442943643 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c800abd0 con 0x7f20cc0acee0 2024-05-30T16:42:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.546+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20cc15ab20 con 0x7f20cc0acee0 2024-05-30T16:42:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.547+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20cc075570 con 0x7f20cc0acee0 2024-05-30T16:42:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.548+0000 7f20c6000640 1 -- 172.21.15.144:0/3442943643 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f20c8007110 con 0x7f20cc0acee0 2024-05-30T16:42:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.549+0000 7f20c6000640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f20b006c920 0x7f20b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.549+0000 7f20c6000640 1 -- 172.21.15.144:0/3442943643 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f20c808b8f0 con 0x7f20cc0acee0 2024-05-30T16:42:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.549+0000 7f20d1e00640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f20b006c920 0x7f20b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.550+0000 7f20d1e00640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f20b006c920 0x7f20b006ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20c0033000 tx=0x7f20c0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:28.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.553+0000 7f20c6000640 1 -- 172.21.15.144:0/3442943643 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f20c8059d10 con 0x7f20cc0acee0 2024-05-30T16:42:28.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.792+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20cc0d2410 con 0x7f20cc0acee0 2024-05-30T16:42:28.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.793+0000 7f20c6000640 1 -- 172.21.15.144:0/3442943643 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f20c8059610 con 0x7f20cc0acee0 2024-05-30T16:42:28.794 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:28.794 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3786718549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3786718549},{"type":"v1","addr":"172.21.15.149:6833","nonce":3786718549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/117174447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":117174447},{"type":"v1","addr":"172.21.15.149:6835","nonce":117174447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1743859445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1743859445},{"type":"v1","addr":"172.21.15.144:6836","nonce":1743859445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:41:52.777438+0000","modified":"2024-05-30T16:41:55.840372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-30T16:42:28.794 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-05-30T16:42:28.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.795+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f20b006c920 msgr2=0x7f20b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:28.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.795+0000 7f20d3200640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f20b006c920 0x7f20b006ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20c0033000 tx=0x7f20c0008030 comp rx=0 tx=0).stop 2024-05-30T16:42:28.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.795+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc0acee0 msgr2=0x7f20cc1f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:28.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.795+0000 7f20d3200640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc0acee0 0x7f20cc1f47e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c840 tx=0x7f20c800cd00 comp rx=0 tx=0).stop 2024-05-30T16:42:28.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.796+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 shutdown_connections 2024-05-30T16:42:28.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.796+0000 7f20d3200640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f20b006c920 0x7f20b006ede0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.796+0000 7f20d3200640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc0acee0 0x7f20cc1f47e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.796+0000 7f20d3200640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20cc1f5980 0x7f20cc0ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.796+0000 7f20d3200640 1 --2- 172.21.15.144:0/3442943643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40039b0 0x7f20cc159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:28.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.796+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 >> 172.21.15.144:0/3442943643 conn(0x7f20cc0d1360 msgr2=0x7f20cc06c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:28.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.796+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 shutdown_connections 2024-05-30T16:42:28.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:28.796+0000 7f20d3200640 1 -- 172.21.15.144:0/3442943643 wait complete. 2024-05-30T16:42:28.815 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:42:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.001+0000 7fbfac600640 1 Processor -- start 2024-05-30T16:42:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.001+0000 7fbfac600640 1 -- start start 2024-05-30T16:42:29.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.002+0000 7fbfac600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbfa413f760 0x7fbfa406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.002+0000 7fbfac600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbfa40cec70 0x7fbfa40b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.002+0000 7fbfac600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa406ee80 con 0x7fbfa40b5e00 2024-05-30T16:42:29.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.002+0000 7fbfac600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa41612b0 con 0x7fbfa40cec70 2024-05-30T16:42:29.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.002+0000 7fbfac600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa40b6270 con 0x7fbfa413f760 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfaa600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbfa40b5e00 0x7fbfa4142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43122/0 (socket says 172.21.15.144:43122) 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfaa600640 1 -- 172.21.15.144:0/2020862049 learned_addr learned my addr 172.21.15.144:0/2020862049 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfa9200640 1 --2- 172.21.15.144:0/2020862049 >> v2:172.21.15.144:3300/0 conn(0x7fbfa40cec70 0x7fbfa40b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfa9c00640 1 --2- 172.21.15.144:0/2020862049 >> v2:172.21.15.149:3300/0 conn(0x7fbfa413f760 0x7fbfa406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfa3e00640 1 -- 172.21.15.144:0/2020862049 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549271984 0 0) 0x7fbfa406ee80 con 0x7fbfa40b5e00 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfa3e00640 1 -- 172.21.15.144:0/2020862049 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf8c003520 con 0x7fbfa40b5e00 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfa9200640 1 -- 172.21.15.144:0/2020862049 >> v2:172.21.15.149:3300/0 conn(0x7fbfa413f760 msgr2=0x7fbfa406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfa9200640 1 --2- 172.21.15.144:0/2020862049 >> v2:172.21.15.149:3300/0 conn(0x7fbfa413f760 0x7fbfa406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfa9200640 1 -- 172.21.15.144:0/2020862049 >> v1:172.21.15.144:6789/0 conn(0x7fbfa40b5e00 legacy=0x7fbfa4142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.003+0000 7fbfa9200640 1 -- 172.21.15.144:0/2020862049 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa4160730 con 0x7fbfa40cec70 2024-05-30T16:42:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfa9200640 1 --2- 172.21.15.144:0/2020862049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa40cec70 0x7fbfa40b58c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbfa415cdc0 tx=0x7fbf9002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40efb8f5f0f260ab server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfa3e00640 1 -- 172.21.15.144:0/2020862049 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90037070 con 0x7fbfa40cec70 2024-05-30T16:42:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfa3e00640 1 -- 172.21.15.144:0/2020862049 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf90032440 con 0x7fbfa40cec70 2024-05-30T16:42:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfa3e00640 1 -- 172.21.15.144:0/2020862049 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf900327f0 con 0x7fbfa40cec70 2024-05-30T16:42:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfac600640 1 -- 172.21.15.144:0/2020862049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa40cec70 msgr2=0x7fbfa40b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfac600640 1 --2- 172.21.15.144:0/2020862049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa40cec70 0x7fbfa40b58c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbfa415cdc0 tx=0x7fbf9002a230 comp rx=0 tx=0).stop 2024-05-30T16:42:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfac600640 1 -- 172.21.15.144:0/2020862049 shutdown_connections 2024-05-30T16:42:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfac600640 1 --2- 172.21.15.144:0/2020862049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa40cec70 0x7fbfa40b58c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfac600640 1 --2- 172.21.15.144:0/2020862049 >> v2:172.21.15.149:3300/0 conn(0x7fbfa413f760 0x7fbfa406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.005+0000 7fbfac600640 1 -- 172.21.15.144:0/2020862049 >> 172.21.15.144:0/2020862049 conn(0x7fbfa406bd00 msgr2=0x7fbfa406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.006+0000 7fbfac600640 1 -- 172.21.15.144:0/2020862049 shutdown_connections 2024-05-30T16:42:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.006+0000 7fbfac600640 1 -- 172.21.15.144:0/2020862049 wait complete. 2024-05-30T16:42:29.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.007+0000 7fbfac600640 1 Processor -- start 2024-05-30T16:42:29.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.007+0000 7fbfac600640 1 -- start start 2024-05-30T16:42:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.008+0000 7fbfac600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfa40b5e00 0x7fbfa413ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.008+0000 7fbfac600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfa40cec70 0x7fbfa415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.008+0000 7fbfac600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa413f760 0x7fbfa415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.008+0000 7fbfac600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa4160cf0 con 0x7fbfa413f760 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.008+0000 7fbfac600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa4160fd0 con 0x7fbfa40cec70 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.008+0000 7fbfac600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa40cf0d0 con 0x7fbfa40b5e00 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfaa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa413f760 0x7fbfa415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfaa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa413f760 0x7fbfa415aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44220/0 (socket says 172.21.15.144:44220) 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfaa600640 1 -- 172.21.15.144:0/2667004212 learned_addr learned my addr 172.21.15.144:0/2667004212 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfa9200640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfa40cec70 0x7fbfa415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfa9c00640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfa40b5e00 0x7fbfa413ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfaa600640 1 -- 172.21.15.144:0/2667004212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfa40b5e00 msgr2=0x7fbfa413ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfaa600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfa40b5e00 0x7fbfa413ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfaa600640 1 -- 172.21.15.144:0/2667004212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfa40cec70 msgr2=0x7fbfa415a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfaa600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfa40cec70 0x7fbfa415a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfaa600640 1 -- 172.21.15.144:0/2667004212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa41f3460 con 0x7fbfa413f760 2024-05-30T16:42:29.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.009+0000 7fbfaa600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa413f760 0x7fbfa415aa50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00cb70 tx=0x7fbf9c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:29.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.010+0000 7fbfa1600640 1 -- 172.21.15.144:0/2667004212 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c017070 con 0x7fbfa413f760 2024-05-30T16:42:29.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.010+0000 7fbfa1600640 1 -- 172.21.15.144:0/2667004212 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00ad40 con 0x7fbfa413f760 2024-05-30T16:42:29.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.010+0000 7fbfa1600640 1 -- 172.21.15.144:0/2667004212 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c012620 con 0x7fbfa413f760 2024-05-30T16:42:29.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.010+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa415b640 con 0x7fbfa413f760 2024-05-30T16:42:29.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.010+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa415b080 con 0x7fbfa413f760 2024-05-30T16:42:29.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.011+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa4068b90 con 0x7fbfa413f760 2024-05-30T16:42:29.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.012+0000 7fbfa1600640 1 -- 172.21.15.144:0/2667004212 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf9c01a070 con 0x7fbfa413f760 2024-05-30T16:42:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.013+0000 7fbfa1600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf8406c8f0 0x7fbf8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.013+0000 7fbfa1600640 1 -- 172.21.15.144:0/2667004212 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbf9c08ba60 con 0x7fbfa413f760 2024-05-30T16:42:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.013+0000 7fbfa9c00640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf8406c8f0 0x7fbf8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.014+0000 7fbfa9c00640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf8406c8f0 0x7fbf8406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf98006fd0 tx=0x7fbf98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:29.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.017+0000 7fbfa1600640 1 -- 172.21.15.144:0/2667004212 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf9c059df0 con 0x7fbfa413f760 2024-05-30T16:42:29.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.240+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfa415ea40 con 0x7fbfa413f760 2024-05-30T16:42:29.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.240+0000 7fbfa1600640 1 -- 172.21.15.144:0/2667004212 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7fbf9c0596f0 con 0x7fbfa413f760 2024-05-30T16:42:29.242 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:29.242 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3786718549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3786718549},{"type":"v1","addr":"172.21.15.149:6833","nonce":3786718549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/117174447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":117174447},{"type":"v1","addr":"172.21.15.149:6835","nonce":117174447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1743859445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1743859445},{"type":"v1","addr":"172.21.15.144:6836","nonce":1743859445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:41:52.777438+0000","modified":"2024-05-30T16:41:55.840372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-30T16:42:29.242 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-05-30T16:42:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf8406c8f0 msgr2=0x7fbf8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf8406c8f0 0x7fbf8406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf98006fd0 tx=0x7fbf98008040 comp rx=0 tx=0).stop 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa413f760 msgr2=0x7fbfa415aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa413f760 0x7fbfa415aa50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00cb70 tx=0x7fbf9c00a430 comp rx=0 tx=0).stop 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 shutdown_connections 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf8406c8f0 0x7fbf8406edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa413f760 0x7fbfa415aa50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfa40cec70 0x7fbfa415a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 --2- 172.21.15.144:0/2667004212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfa40b5e00 0x7fbfa413ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.243+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 >> 172.21.15.144:0/2667004212 conn(0x7fbfa406bd00 msgr2=0x7fbfa415f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.244+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 shutdown_connections 2024-05-30T16:42:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.244+0000 7fbfac600640 1 -- 172.21.15.144:0/2667004212 wait complete. 2024-05-30T16:42:29.262 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:42:29.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.457+0000 7fba38e00640 1 Processor -- start 2024-05-30T16:42:29.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.457+0000 7fba38e00640 1 -- start start 2024-05-30T16:42:29.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba38e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba340caf10 0x7fba3415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba38e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba340cb2f0 0x7fba3415c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba38e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3415f500 con 0x7fba3415c780 2024-05-30T16:42:29.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba38e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fba3415f780 con 0x7fba340caf10 2024-05-30T16:42:29.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba38e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fba3415fa60 con 0x7fba340cb2f0 2024-05-30T16:42:29.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba33400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba340caf10 0x7fba3415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba33400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba340caf10 0x7fba3415efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44234/0 (socket says 172.21.15.144:44234) 2024-05-30T16:42:29.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba33400640 1 -- 172.21.15.144:0/2972211652 learned_addr learned my addr 172.21.15.144:0/2972211652 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:29.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba32a00640 1 --2- 172.21.15.144:0/2972211652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba340cb2f0 0x7fba3415c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba33400640 1 -- 172.21.15.144:0/2972211652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba340cb2f0 msgr2=0x7fba3415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:29.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba33400640 1 --2- 172.21.15.144:0/2972211652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba340cb2f0 0x7fba3415c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba33400640 1 -- 172.21.15.144:0/2972211652 >> v1:172.21.15.149:6789/0 conn(0x7fba3415c780 legacy=0x7fba340b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:29.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.459+0000 7fba33400640 1 -- 172.21.15.144:0/2972211652 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3415fd40 con 0x7fba340caf10 2024-05-30T16:42:29.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.460+0000 7fba33400640 1 --2- 172.21.15.144:0/2972211652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340caf10 0x7fba3415efc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba24009870 tx=0x7fba2402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379c242d79a679fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:29.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.461+0000 7fba32000640 1 -- 172.21.15.144:0/2972211652 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba24037070 con 0x7fba340caf10 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.461+0000 7fba32000640 1 -- 172.21.15.144:0/2972211652 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba24032440 con 0x7fba340caf10 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.461+0000 7fba32000640 1 -- 172.21.15.144:0/2972211652 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba24032810 con 0x7fba340caf10 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.461+0000 7fba38e00640 1 -- 172.21.15.144:0/2972211652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340caf10 msgr2=0x7fba3415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.461+0000 7fba38e00640 1 --2- 172.21.15.144:0/2972211652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340caf10 0x7fba3415efc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba24009870 tx=0x7fba2402a210 comp rx=0 tx=0).stop 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.461+0000 7fba38e00640 1 -- 172.21.15.144:0/2972211652 shutdown_connections 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.461+0000 7fba38e00640 1 --2- 172.21.15.144:0/2972211652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba340cb2f0 0x7fba3415c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.461+0000 7fba38e00640 1 --2- 172.21.15.144:0/2972211652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340caf10 0x7fba3415efc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.461+0000 7fba38e00640 1 -- 172.21.15.144:0/2972211652 >> 172.21.15.144:0/2972211652 conn(0x7fba340b20a0 msgr2=0x7fba340b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.462+0000 7fba38e00640 1 -- 172.21.15.144:0/2972211652 shutdown_connections 2024-05-30T16:42:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.462+0000 7fba38e00640 1 -- 172.21.15.144:0/2972211652 wait complete. 2024-05-30T16:42:29.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.463+0000 7fba38e00640 1 Processor -- start 2024-05-30T16:42:29.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.463+0000 7fba38e00640 1 -- start start 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.464+0000 7fba38e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba340caf10 0x7fba3414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.464+0000 7fba38e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340cb2f0 0x7fba3414ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.464+0000 7fba38e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba3415c780 0x7fba341513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.464+0000 7fba38e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fba340b3a50 con 0x7fba340cb2f0 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.464+0000 7fba38e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fba340b38d0 con 0x7fba340caf10 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.464+0000 7fba38e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fba340ae320 con 0x7fba3415c780 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.464+0000 7fba32a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340cb2f0 0x7fba3414ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.464+0000 7fba32a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340cb2f0 0x7fba3414ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44246/0 (socket says 172.21.15.144:44246) 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba32a00640 1 -- 172.21.15.144:0/3547760497 learned_addr learned my addr 172.21.15.144:0/3547760497 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba33400640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba340caf10 0x7fba3414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba33e00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba3415c780 0x7fba341513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba32a00640 1 -- 172.21.15.144:0/3547760497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba3415c780 msgr2=0x7fba341513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba32a00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba3415c780 0x7fba341513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba32a00640 1 -- 172.21.15.144:0/3547760497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba340caf10 msgr2=0x7fba3414d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba32a00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba340caf10 0x7fba3414d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba32a00640 1 -- 172.21.15.144:0/3547760497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3414db40 con 0x7fba340cb2f0 2024-05-30T16:42:29.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba33400640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba340caf10 0x7fba3414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:29.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba32a00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340cb2f0 0x7fba3414ce20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c820 tx=0x7fba1c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:29.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.465+0000 7fba2b400640 1 -- 172.21.15.144:0/3547760497 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c015070 con 0x7fba340cb2f0 2024-05-30T16:42:29.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.466+0000 7fba2b400640 1 -- 172.21.15.144:0/3547760497 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1c004240 con 0x7fba340cb2f0 2024-05-30T16:42:29.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.466+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba340ad710 con 0x7fba340cb2f0 2024-05-30T16:42:29.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.466+0000 7fba2b400640 1 -- 172.21.15.144:0/3547760497 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00ce10 con 0x7fba340cb2f0 2024-05-30T16:42:29.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.466+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba340adcd0 con 0x7fba340cb2f0 2024-05-30T16:42:29.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.467+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba340ae4d0 con 0x7fba340cb2f0 2024-05-30T16:42:29.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.468+0000 7fba2b400640 1 -- 172.21.15.144:0/3547760497 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba1c007830 con 0x7fba340cb2f0 2024-05-30T16:42:29.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.469+0000 7fba2b400640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fba1006c920 0x7fba1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.469+0000 7fba2b400640 1 -- 172.21.15.144:0/3547760497 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fba1c08baa0 con 0x7fba340cb2f0 2024-05-30T16:42:29.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.469+0000 7fba33400640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fba1006c920 0x7fba1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.470+0000 7fba33400640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fba1006c920 0x7fba1006ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fba24034000 tx=0x7fba2402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:29.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.473+0000 7fba2b400640 1 -- 172.21.15.144:0/3547760497 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba1c059e40 con 0x7fba340cb2f0 2024-05-30T16:42:29.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.675+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba34075570 con 0x7fba340cb2f0 2024-05-30T16:42:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.676+0000 7fba2b400640 1 -- 172.21.15.144:0/3547760497 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fba1c059740 con 0x7fba340cb2f0 2024-05-30T16:42:29.678 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:29.678 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:54.340246+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:41:50.922058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:41:51.739937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:42:29.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.678+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fba1006c920 msgr2=0x7fba1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.678+0000 7fba38e00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fba1006c920 0x7fba1006ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fba24034000 tx=0x7fba2402e000 comp rx=0 tx=0).stop 2024-05-30T16:42:29.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340cb2f0 msgr2=0x7fba3414ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340cb2f0 0x7fba3414ce20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c820 tx=0x7fba1c00cce0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 shutdown_connections 2024-05-30T16:42:29.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fba1006c920 0x7fba1006ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba3415c780 0x7fba341513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba340cb2f0 0x7fba3414ce20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 --2- 172.21.15.144:0/3547760497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba340caf10 0x7fba3414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 >> 172.21.15.144:0/3547760497 conn(0x7fba340b20a0 msgr2=0x7fba340ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:29.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 shutdown_connections 2024-05-30T16:42:29.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.679+0000 7fba38e00640 1 -- 172.21.15.144:0/3547760497 wait complete. 2024-05-30T16:42:29.699 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:42:29.699 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:42:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.900+0000 7f0c4b200640 1 Processor -- start 2024-05-30T16:42:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.900+0000 7f0c4b200640 1 -- start start 2024-05-30T16:42:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.902+0000 7f0c4b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c4c0cb2f0 0x7f0c4c15c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.902+0000 7f0c4b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4c15f780 con 0x7f0c4c0caf10 2024-05-30T16:42:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.902+0000 7f0c4b200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4c15fa60 con 0x7f0c4c15c780 2024-05-30T16:42:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.902+0000 7f0c4b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4c15fd40 con 0x7f0c4c0cb2f0 2024-05-30T16:42:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.902+0000 7f0c49e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0c4c0caf10 0x7f0c4c15efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43136/0 (socket says 172.21.15.144:43136) 2024-05-30T16:42:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.902+0000 7f0c49e00640 1 -- 172.21.15.144:0/2673085701 learned_addr learned my addr 172.21.15.144:0/2673085701 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.902+0000 7f0c49400640 1 --2- 172.21.15.144:0/2673085701 >> v2:172.21.15.144:3300/0 conn(0x7f0c4c0cb2f0 0x7f0c4c15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.903+0000 7f0c49400640 1 -- 172.21.15.144:0/2673085701 >> v1:172.21.15.149:6789/0 conn(0x7f0c4c15c780 legacy=0x7f0c4c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.903+0000 7f0c49400640 1 -- 172.21.15.144:0/2673085701 >> v1:172.21.15.144:6789/0 conn(0x7f0c4c0caf10 legacy=0x7f0c4c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.903+0000 7f0c49400640 1 -- 172.21.15.144:0/2673085701 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c15b950 con 0x7f0c4c0cb2f0 2024-05-30T16:42:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.903+0000 7f0c48a00640 1 -- 172.21.15.144:0/2673085701 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533048623 0 0) 0x7f0c4c15f780 con 0x7f0c4c0caf10 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.904+0000 7f0c49400640 1 --2- 172.21.15.144:0/2673085701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c0cb2f0 0x7f0c4c15c240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c380097a0 tx=0x7f0c3802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d75371d7f1666e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.904+0000 7f0c48a00640 1 -- 172.21.15.144:0/2673085701 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38037070 con 0x7f0c4c0cb2f0 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.904+0000 7f0c48a00640 1 -- 172.21.15.144:0/2673085701 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c38032440 con 0x7f0c4c0cb2f0 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.904+0000 7f0c48a00640 1 -- 172.21.15.144:0/2673085701 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38032810 con 0x7f0c4c0cb2f0 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.905+0000 7f0c4b200640 1 -- 172.21.15.144:0/2673085701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c0cb2f0 msgr2=0x7f0c4c15c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.905+0000 7f0c4b200640 1 --2- 172.21.15.144:0/2673085701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c0cb2f0 0x7f0c4c15c240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c380097a0 tx=0x7f0c3802a230 comp rx=0 tx=0).stop 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.905+0000 7f0c4b200640 1 -- 172.21.15.144:0/2673085701 shutdown_connections 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.905+0000 7f0c4b200640 1 --2- 172.21.15.144:0/2673085701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c0cb2f0 0x7f0c4c15c240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.905+0000 7f0c4b200640 1 -- 172.21.15.144:0/2673085701 >> 172.21.15.144:0/2673085701 conn(0x7f0c4c0b20a0 msgr2=0x7f0c4c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.905+0000 7f0c4b200640 1 -- 172.21.15.144:0/2673085701 shutdown_connections 2024-05-30T16:42:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.905+0000 7f0c4b200640 1 -- 172.21.15.144:0/2673085701 wait complete. 2024-05-30T16:42:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.907+0000 7f0c4b200640 1 Processor -- start 2024-05-30T16:42:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.907+0000 7f0c4b200640 1 -- start start 2024-05-30T16:42:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.908+0000 7f0c4b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c4c0caf10 0x7f0c4c073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.908+0000 7f0c4b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4c0cb2f0 0x7f0c4c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.908+0000 7f0c4b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c15c780 0x7f0c4c150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.908+0000 7f0c4b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c0cf8b0 con 0x7f0c4c15c780 2024-05-30T16:42:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.908+0000 7f0c4b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c0b3b60 con 0x7f0c4c0caf10 2024-05-30T16:42:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.908+0000 7f0c4b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0c4c0cfa30 con 0x7f0c4c0cb2f0 2024-05-30T16:42:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c4a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c15c780 0x7f0c4c150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c4a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c15c780 0x7f0c4c150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44268/0 (socket says 172.21.15.144:44268) 2024-05-30T16:42:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c4a800640 1 -- 172.21.15.144:0/2249237246 learned_addr learned my addr 172.21.15.144:0/2249237246 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c49e00640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c4c0caf10 0x7f0c4c073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c49400640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4c0cb2f0 0x7f0c4c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c4a800640 1 -- 172.21.15.144:0/2249237246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4c0cb2f0 msgr2=0x7f0c4c153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c4a800640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4c0cb2f0 0x7f0c4c153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c4a800640 1 -- 172.21.15.144:0/2249237246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c4c0caf10 msgr2=0x7f0c4c073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c4a800640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c4c0caf10 0x7f0c4c073840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.909+0000 7f0c4a800640 1 -- 172.21.15.144:0/2249237246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c153c50 con 0x7f0c4c15c780 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.910+0000 7f0c4a800640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c15c780 0x7f0c4c150080 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c730 tx=0x7f0c4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.910+0000 7f0c42000640 1 -- 172.21.15.144:0/2249237246 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44003b70 con 0x7f0c4c15c780 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.910+0000 7f0c42000640 1 -- 172.21.15.144:0/2249237246 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c44003d10 con 0x7f0c4c15c780 2024-05-30T16:42:29.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.910+0000 7f0c42000640 1 -- 172.21.15.144:0/2249237246 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44005310 con 0x7f0c4c15c780 2024-05-30T16:42:29.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.910+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4c071d20 con 0x7f0c4c15c780 2024-05-30T16:42:29.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.910+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4c0722e0 con 0x7f0c4c15c780 2024-05-30T16:42:29.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.911+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c4c075570 con 0x7f0c4c15c780 2024-05-30T16:42:29.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.912+0000 7f0c42000640 1 -- 172.21.15.144:0/2249237246 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c440056c0 con 0x7f0c4c15c780 2024-05-30T16:42:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.913+0000 7f0c42000640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0c2c06c8f0 0x7f0c2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.913+0000 7f0c42000640 1 -- 172.21.15.144:0/2249237246 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0c4408bcc0 con 0x7f0c4c15c780 2024-05-30T16:42:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.913+0000 7f0c49e00640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0c2c06c8f0 0x7f0c2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:29.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.914+0000 7f0c49e00640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0c2c06c8f0 0x7f0c2c06edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c000f60 tx=0x7f0c3c007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:29.917+0000 7f0c42000640 1 -- 172.21.15.144:0/2249237246 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c44092080 con 0x7f0c4c15c780 2024-05-30T16:42:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.161+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c4c1531e0 con 0x7f0c4c15c780 2024-05-30T16:42:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.162+0000 7f0c42000640 1 -- 172.21.15.144:0/2249237246 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f0c44059fc0 con 0x7f0c4c15c780 2024-05-30T16:42:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:30.163 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3786718549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3786718549},{"type":"v1","addr":"172.21.15.149:6833","nonce":3786718549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/117174447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":117174447},{"type":"v1","addr":"172.21.15.149:6835","nonce":117174447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1743859445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1743859445},{"type":"v1","addr":"172.21.15.144:6836","nonce":1743859445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:41:52.777438+0000","modified":"2024-05-30T16:41:55.840372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-30T16:42:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-05-30T16:42:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0c2c06c8f0 msgr2=0x7f0c2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0c2c06c8f0 0x7f0c2c06edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c000f60 tx=0x7f0c3c007b90 comp rx=0 tx=0).stop 2024-05-30T16:42:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c15c780 msgr2=0x7f0c4c150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c15c780 0x7f0c4c150080 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c730 tx=0x7f0c4400cbf0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 shutdown_connections 2024-05-30T16:42:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0c2c06c8f0 0x7f0c2c06edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c4c15c780 0x7f0c4c150080 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4c0cb2f0 0x7f0c4c153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 --2- 172.21.15.144:0/2249237246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c4c0caf10 0x7f0c4c073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 >> 172.21.15.144:0/2249237246 conn(0x7f0c4c0b20a0 msgr2=0x7f0c4c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 shutdown_connections 2024-05-30T16:42:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.165+0000 7f0c4b200640 1 -- 172.21.15.144:0/2249237246 wait complete. 2024-05-30T16:42:30.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:42:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.385+0000 7f49e9200640 1 Processor -- start 2024-05-30T16:42:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.385+0000 7f49e9200640 1 -- start start 2024-05-30T16:42:30.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.386+0000 7f49e9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e406f670 0x7f49e40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.386+0000 7f49e9200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f49e40cf300 0x7f49e406b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.387+0000 7f49e9200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e40cab30 con 0x7f49e40b4f00 2024-05-30T16:42:30.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.387+0000 7f49e9200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f49e415b090 con 0x7f49e40cf300 2024-05-30T16:42:30.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.387+0000 7f49e9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49e40cf950 con 0x7f49e406f670 2024-05-30T16:42:30.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.387+0000 7f49e3e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f49e40b4f00 0x7f49e415ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:55608/0 (socket says 172.21.15.144:55608) 2024-05-30T16:42:30.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.387+0000 7f49e3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e406f670 0x7f49e40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.387+0000 7f49e3e00640 1 -- 172.21.15.144:0/1133444180 learned_addr learned my addr 172.21.15.144:0/1133444180 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:30.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.387+0000 7f49e2a00640 1 --2- 172.21.15.144:0/1133444180 >> v2:172.21.15.149:3300/0 conn(0x7f49e40cf300 0x7f49e406b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.388+0000 7f49e2000640 1 -- 172.21.15.144:0/1133444180 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128489471 0 0) 0x7f49e40cab30 con 0x7f49e40b4f00 2024-05-30T16:42:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.388+0000 7f49e2000640 1 -- 172.21.15.144:0/1133444180 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49c8003520 con 0x7f49e40b4f00 2024-05-30T16:42:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.388+0000 7f49e2a00640 1 -- 172.21.15.144:0/1133444180 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e406f670 msgr2=0x7f49e40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.388+0000 7f49e2a00640 1 --2- 172.21.15.144:0/1133444180 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e406f670 0x7f49e40b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.388+0000 7f49e2a00640 1 -- 172.21.15.144:0/1133444180 >> v1:172.21.15.149:6789/0 conn(0x7f49e40b4f00 legacy=0x7f49e415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.388+0000 7f49e2a00640 1 -- 172.21.15.144:0/1133444180 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e40cfc30 con 0x7f49e40cf300 2024-05-30T16:42:30.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.388+0000 7f49e3400640 1 --2- 172.21.15.144:0/1133444180 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e406f670 0x7f49e40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:42:30.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.390+0000 7f49e2a00640 1 --2- 172.21.15.144:0/1133444180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e40cf300 0x7f49e406b8e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0097a0 tx=0x7f49cc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a61a1acf5f69c7f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.390+0000 7f49e2000640 1 -- 172.21.15.144:0/1133444180 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc037070 con 0x7f49e40cf300 2024-05-30T16:42:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.390+0000 7f49e2000640 1 -- 172.21.15.144:0/1133444180 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc032440 con 0x7f49e40cf300 2024-05-30T16:42:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.390+0000 7f49e2000640 1 -- 172.21.15.144:0/1133444180 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc032810 con 0x7f49e40cf300 2024-05-30T16:42:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.391+0000 7f49e9200640 1 -- 172.21.15.144:0/1133444180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e40cf300 msgr2=0x7f49e406b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.391+0000 7f49e9200640 1 --2- 172.21.15.144:0/1133444180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e40cf300 0x7f49e406b8e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0097a0 tx=0x7f49cc02a180 comp rx=0 tx=0).stop 2024-05-30T16:42:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.391+0000 7f49e9200640 1 -- 172.21.15.144:0/1133444180 shutdown_connections 2024-05-30T16:42:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.391+0000 7f49e9200640 1 --2- 172.21.15.144:0/1133444180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e40cf300 0x7f49e406b8e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.391+0000 7f49e9200640 1 --2- 172.21.15.144:0/1133444180 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e406f670 0x7f49e40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.391+0000 7f49e9200640 1 -- 172.21.15.144:0/1133444180 >> 172.21.15.144:0/1133444180 conn(0x7f49e40b20a0 msgr2=0x7f49e40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:30.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.391+0000 7f49e9200640 1 -- 172.21.15.144:0/1133444180 shutdown_connections 2024-05-30T16:42:30.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.391+0000 7f49e9200640 1 -- 172.21.15.144:0/1133444180 wait complete. 2024-05-30T16:42:30.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.393+0000 7f49e9200640 1 Processor -- start 2024-05-30T16:42:30.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.393+0000 7f49e9200640 1 -- start start 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.394+0000 7f49e9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e406f670 0x7f49e41e4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.394+0000 7f49e9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49e40b4f00 0x7f49e4157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.394+0000 7f49e9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e40cf300 0x7f49e41f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.394+0000 7f49e9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49e40ca840 con 0x7f49e40b4f00 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.394+0000 7f49e9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f49e415e730 con 0x7f49e406f670 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.394+0000 7f49e9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49e406fa50 con 0x7f49e40cf300 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.394+0000 7f49e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49e40b4f00 0x7f49e4157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.394+0000 7f49e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49e40b4f00 0x7f49e4157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44272/0 (socket says 172.21.15.144:44272) 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.394+0000 7f49e2a00640 1 -- 172.21.15.144:0/1185774491 learned_addr learned my addr 172.21.15.144:0/1185774491 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49e3400640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e406f670 0x7f49e41e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49e3e00640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e40cf300 0x7f49e41f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49e2a00640 1 -- 172.21.15.144:0/1185774491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e40cf300 msgr2=0x7f49e41f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49e2a00640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e40cf300 0x7f49e41f3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49e2a00640 1 -- 172.21.15.144:0/1185774491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e406f670 msgr2=0x7f49e41e4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49e2a00640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e406f670 0x7f49e41e4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49e2a00640 1 -- 172.21.15.144:0/1185774491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e41586a0 con 0x7f49e40b4f00 2024-05-30T16:42:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49e2a00640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49e40b4f00 0x7f49e4157e50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009890 tx=0x7f49cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49db400640 1 -- 172.21.15.144:0/1185774491 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc037050 con 0x7f49e40b4f00 2024-05-30T16:42:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49db400640 1 -- 172.21.15.144:0/1185774491 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc043070 con 0x7f49e40b4f00 2024-05-30T16:42:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.395+0000 7f49db400640 1 -- 172.21.15.144:0/1185774491 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc03cb30 con 0x7f49e40b4f00 2024-05-30T16:42:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.396+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e4158980 con 0x7f49e40b4f00 2024-05-30T16:42:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.396+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e4158f40 con 0x7f49e40b4f00 2024-05-30T16:42:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.397+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e4075570 con 0x7f49e40b4f00 2024-05-30T16:42:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.398+0000 7f49db400640 1 -- 172.21.15.144:0/1185774491 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49cc03ccd0 con 0x7f49e40b4f00 2024-05-30T16:42:30.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.398+0000 7f49db400640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49c006c8f0 0x7f49c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.399+0000 7f49db400640 1 -- 172.21.15.144:0/1185774491 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f49cc0ac820 con 0x7f49e40b4f00 2024-05-30T16:42:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.399+0000 7f49e3400640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49c006c8f0 0x7f49c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.399+0000 7f49e3400640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49c006c8f0 0x7f49c006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009950 tx=0x7f49d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:30.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.403+0000 7f49db400640 1 -- 172.21.15.144:0/1185774491 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49cc046360 con 0x7f49e40b4f00 2024-05-30T16:42:30.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.643+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49e40b47d0 con 0x7f49e40b4f00 2024-05-30T16:42:30.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.645+0000 7f49db400640 1 -- 172.21.15.144:0/1185774491 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f49cc07ac40 con 0x7f49e40b4f00 2024-05-30T16:42:30.646 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:30.646 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3786718549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3786718549},{"type":"v1","addr":"172.21.15.149:6833","nonce":3786718549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/117174447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":117174447},{"type":"v1","addr":"172.21.15.149:6835","nonce":117174447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1743859445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1743859445},{"type":"v1","addr":"172.21.15.144:6836","nonce":1743859445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:41:52.777438+0000","modified":"2024-05-30T16:41:55.840372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1315513290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1315513290},{"type":"v1","addr":"172.21.15.144:6837","nonce":1315513290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-05-30T16:42:30.646 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-05-30T16:42:30.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49c006c8f0 msgr2=0x7f49c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49c006c8f0 0x7f49c006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009950 tx=0x7f49d4008040 comp rx=0 tx=0).stop 2024-05-30T16:42:30.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49e40b4f00 msgr2=0x7f49e4157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49e40b4f00 0x7f49e4157e50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009890 tx=0x7f49cc0046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 shutdown_connections 2024-05-30T16:42:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49c006c8f0 0x7f49c006edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49e40cf300 0x7f49e41f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49e40b4f00 0x7f49e4157e50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 --2- 172.21.15.144:0/1185774491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49e406f670 0x7f49e41e4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 >> 172.21.15.144:0/1185774491 conn(0x7f49e40b20a0 msgr2=0x7f49e40b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 shutdown_connections 2024-05-30T16:42:30.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.647+0000 7f49e9200640 1 -- 172.21.15.144:0/1185774491 wait complete. 2024-05-30T16:42:30.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:42:30.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.865+0000 7f9f80e00640 1 Processor -- start 2024-05-30T16:42:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.865+0000 7f9f80e00640 1 -- start start 2024-05-30T16:42:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.867+0000 7f9f80e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9f7c0cfc40 0x7f9f7c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.867+0000 7f9f80e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c06f610 0x7f9f7c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.867+0000 7f9f80e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7c0d00f0 con 0x7f9f7c145150 2024-05-30T16:42:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.867+0000 7f9f80e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7c15f140 con 0x7f9f7c0cfc40 2024-05-30T16:42:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.867+0000 7f9f80e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c15f390 con 0x7f9f7c06f610 2024-05-30T16:42:30.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.867+0000 7f9f71400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9f7c0cfc40 0x7f9f7c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.867+0000 7f9f71400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9f7c0cfc40 0x7f9f7c06f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44288/0 (socket says 172.21.15.144:44288) 2024-05-30T16:42:30.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.867+0000 7f9f71400640 1 -- 172.21.15.144:0/2525877662 learned_addr learned my addr 172.21.15.144:0/2525877662 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:30.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.868+0000 7f9f7a800640 1 --2- 172.21.15.144:0/2525877662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c06f610 0x7f9f7c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.868+0000 7f9f71400640 1 -- 172.21.15.144:0/2525877662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c06f610 msgr2=0x7f9f7c0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:30.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.868+0000 7f9f71400640 1 --2- 172.21.15.144:0/2525877662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c06f610 0x7f9f7c0b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.868+0000 7f9f71400640 1 -- 172.21.15.144:0/2525877662 >> v1:172.21.15.149:6789/0 conn(0x7f9f7c145150 legacy=0x7f9f7c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.868+0000 7f9f71400640 1 -- 172.21.15.144:0/2525877662 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c15f670 con 0x7f9f7c0cfc40 2024-05-30T16:42:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.869+0000 7f9f71400640 1 --2- 172.21.15.144:0/2525877662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c0cfc40 0x7f9f7c06f0d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400bb10 tx=0x7f9f6402c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cd14c54aea7e8f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.869+0000 7f9f79400640 1 -- 172.21.15.144:0/2525877662 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6403a070 con 0x7f9f7c0cfc40 2024-05-30T16:42:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.869+0000 7f9f79400640 1 -- 172.21.15.144:0/2525877662 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f640326f0 con 0x7f9f7c0cfc40 2024-05-30T16:42:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.869+0000 7f9f79400640 1 -- 172.21.15.144:0/2525877662 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64032ac0 con 0x7f9f7c0cfc40 2024-05-30T16:42:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.870+0000 7f9f80e00640 1 -- 172.21.15.144:0/2525877662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c0cfc40 msgr2=0x7f9f7c06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.870+0000 7f9f80e00640 1 --2- 172.21.15.144:0/2525877662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c0cfc40 0x7f9f7c06f0d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400bb10 tx=0x7f9f6402c830 comp rx=0 tx=0).stop 2024-05-30T16:42:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.870+0000 7f9f80e00640 1 -- 172.21.15.144:0/2525877662 shutdown_connections 2024-05-30T16:42:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.870+0000 7f9f80e00640 1 --2- 172.21.15.144:0/2525877662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c06f610 0x7f9f7c0b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.870+0000 7f9f80e00640 1 --2- 172.21.15.144:0/2525877662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c0cfc40 0x7f9f7c06f0d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.870+0000 7f9f80e00640 1 -- 172.21.15.144:0/2525877662 >> 172.21.15.144:0/2525877662 conn(0x7f9f7c06bd00 msgr2=0x7f9f7c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.870+0000 7f9f80e00640 1 -- 172.21.15.144:0/2525877662 shutdown_connections 2024-05-30T16:42:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.870+0000 7f9f80e00640 1 -- 172.21.15.144:0/2525877662 wait complete. 2024-05-30T16:42:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.872+0000 7f9f80e00640 1 Processor -- start 2024-05-30T16:42:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.872+0000 7f9f80e00640 1 -- start start 2024-05-30T16:42:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f80e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c06f610 0x7f9f7c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f80e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7c0cfc40 0x7f9f7c15e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f80e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c145150 0x7f9f7c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f80e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c15fe70 con 0x7f9f7c06f610 2024-05-30T16:42:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f80e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c0b64f0 con 0x7f9f7c0cfc40 2024-05-30T16:42:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f80e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c15fff0 con 0x7f9f7c145150 2024-05-30T16:42:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f79e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c06f610 0x7f9f7c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f79e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c06f610 0x7f9f7c15c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44296/0 (socket says 172.21.15.144:44296) 2024-05-30T16:42:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f79e00640 1 -- 172.21.15.144:0/663762917 learned_addr learned my addr 172.21.15.144:0/663762917 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.873+0000 7f9f7a800640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c145150 0x7f9f7c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f71400640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7c0cfc40 0x7f9f7c15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f79e00640 1 -- 172.21.15.144:0/663762917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c145150 msgr2=0x7f9f7c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f79e00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c145150 0x7f9f7c15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f79e00640 1 -- 172.21.15.144:0/663762917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7c0cfc40 msgr2=0x7f9f7c15e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f79e00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7c0cfc40 0x7f9f7c15e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f79e00640 1 -- 172.21.15.144:0/663762917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c15cb30 con 0x7f9f7c06f610 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f79e00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c06f610 0x7f9f7c15c550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00b3f0 tx=0x7f9f6c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f72a00640 1 -- 172.21.15.144:0/663762917 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c015020 con 0x7f9f7c06f610 2024-05-30T16:42:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f72a00640 1 -- 172.21.15.144:0/663762917 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6c011830 con 0x7f9f7c06f610 2024-05-30T16:42:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7c15ce10 con 0x7f9f7c06f610 2024-05-30T16:42:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f72a00640 1 -- 172.21.15.144:0/663762917 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c011c20 con 0x7f9f7c06f610 2024-05-30T16:42:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.874+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7c15d3d0 con 0x7f9f7c06f610 2024-05-30T16:42:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.875+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7c068b90 con 0x7f9f7c06f610 2024-05-30T16:42:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.876+0000 7f9f72a00640 1 -- 172.21.15.144:0/663762917 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f6c018020 con 0x7f9f7c06f610 2024-05-30T16:42:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.877+0000 7f9f72a00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9f5806c8f0 0x7f9f5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.877+0000 7f9f72a00640 1 -- 172.21.15.144:0/663762917 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9f6c08b890 con 0x7f9f7c06f610 2024-05-30T16:42:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.878+0000 7f9f71400640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9f5806c8f0 0x7f9f5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.878+0000 7f9f71400640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9f5806c8f0 0x7f9f5806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f64037000 tx=0x7f9f64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:30.882+0000 7f9f72a00640 1 -- 172.21.15.144:0/663762917 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9f6c01f030 con 0x7f9f7c06f610 2024-05-30T16:42:31.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.087+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f7c1e4f00 con 0x7f9f7c06f610 2024-05-30T16:42:31.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.090+0000 7f9f72a00640 1 -- 172.21.15.144:0/663762917 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f9f6c0172c0 con 0x7f9f7c06f610 2024-05-30T16:42:31.091 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:31.091 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:41:54.340246+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:41:50.922058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T16:41:51.739937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:42:31.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9f5806c8f0 msgr2=0x7f9f5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9f5806c8f0 0x7f9f5806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f64037000 tx=0x7f9f64008040 comp rx=0 tx=0).stop 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c06f610 msgr2=0x7f9f7c15c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c06f610 0x7f9f7c15c550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00b3f0 tx=0x7f9f6c00b8b0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 shutdown_connections 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9f5806c8f0 0x7f9f5806edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f7c145150 0x7f9f7c15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7c0cfc40 0x7f9f7c15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 --2- 172.21.15.144:0/663762917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f7c06f610 0x7f9f7c15c550 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.092+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 >> 172.21.15.144:0/663762917 conn(0x7f9f7c06bd00 msgr2=0x7f9f7c0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.093+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 shutdown_connections 2024-05-30T16:42:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.093+0000 7f9f80e00640 1 -- 172.21.15.144:0/663762917 wait complete. 2024-05-30T16:42:31.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T16:42:31.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.306+0000 7ffaf3200640 1 Processor -- start 2024-05-30T16:42:31.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.306+0000 7ffaf3200640 1 -- start start 2024-05-30T16:42:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffaf3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffaf40b2de0 0x7ffaf40b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffaf3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffaf40b4c70 0x7ffaf40c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffaf3200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf4140bf0 con 0x7ffaf40c5b40 2024-05-30T16:42:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffaf3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffaf40b50d0 con 0x7ffaf40b4c70 2024-05-30T16:42:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffaf3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf413e810 con 0x7ffaf40b2de0 2024-05-30T16:42:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffae9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffaf40b4c70 0x7ffaf40c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffae9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffaf40b4c70 0x7ffaf40c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44304/0 (socket says 172.21.15.144:44304) 2024-05-30T16:42:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffae9400640 1 -- 172.21.15.144:0/3672933661 learned_addr learned my addr 172.21.15.144:0/3672933661 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:31.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffae9400640 1 -- 172.21.15.144:0/3672933661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffaf40b2de0 msgr2=0x7ffaf40b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:31.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffae9400640 1 --2- 172.21.15.144:0/3672933661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffaf40b2de0 0x7ffaf40b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffae9400640 1 -- 172.21.15.144:0/3672933661 >> v1:172.21.15.149:6789/0 conn(0x7ffaf40c5b40 legacy=0x7ffaf415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:31.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.308+0000 7ffae9400640 1 -- 172.21.15.144:0/3672933661 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf4140ed0 con 0x7ffaf40b4c70 2024-05-30T16:42:31.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.309+0000 7ffae9400640 1 --2- 172.21.15.144:0/3672933661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 0x7ffaf40c5600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009870 tx=0x7ffadc02c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909b02091edd5d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:31.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.310+0000 7ffaf1400640 1 -- 172.21.15.144:0/3672933661 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc038070 con 0x7ffaf40b4c70 2024-05-30T16:42:31.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.310+0000 7ffaf1400640 1 -- 172.21.15.144:0/3672933661 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffadc031710 con 0x7ffaf40b4c70 2024-05-30T16:42:31.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.310+0000 7ffaf1400640 1 -- 172.21.15.144:0/3672933661 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc031ae0 con 0x7ffaf40b4c70 2024-05-30T16:42:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.310+0000 7ffaf3200640 1 -- 172.21.15.144:0/3672933661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 msgr2=0x7ffaf40c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.310+0000 7ffaf3200640 1 --2- 172.21.15.144:0/3672933661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 0x7ffaf40c5600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009870 tx=0x7ffadc02c420 comp rx=0 tx=0).stop 2024-05-30T16:42:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.311+0000 7ffaf3200640 1 -- 172.21.15.144:0/3672933661 shutdown_connections 2024-05-30T16:42:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.311+0000 7ffaf3200640 1 --2- 172.21.15.144:0/3672933661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 0x7ffaf40c5600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.311+0000 7ffaf3200640 1 --2- 172.21.15.144:0/3672933661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffaf40b2de0 0x7ffaf40b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.311+0000 7ffaf3200640 1 -- 172.21.15.144:0/3672933661 >> 172.21.15.144:0/3672933661 conn(0x7ffaf40627b0 msgr2=0x7ffaf406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.311+0000 7ffaf3200640 1 -- 172.21.15.144:0/3672933661 shutdown_connections 2024-05-30T16:42:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.311+0000 7ffaf3200640 1 -- 172.21.15.144:0/3672933661 wait complete. 2024-05-30T16:42:31.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.312+0000 7ffaf3200640 1 Processor -- start 2024-05-30T16:42:31.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.312+0000 7ffaf3200640 1 -- start start 2024-05-30T16:42:31.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.313+0000 7ffaf3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffaf40b2de0 0x7ffaf4072da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.313+0000 7ffaf3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 0x7ffaf413d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.313+0000 7ffaf3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaf40c5b40 0x7ffaf413d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.313+0000 7ffaf3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf4141770 con 0x7ffaf40b4c70 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.313+0000 7ffaf3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf4141490 con 0x7ffaf40c5b40 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.313+0000 7ffaf3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf40c5fd0 con 0x7ffaf40b2de0 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffae9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 0x7ffaf413d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffae9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 0x7ffaf413d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44316/0 (socket says 172.21.15.144:44316) 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffae9400640 1 -- 172.21.15.144:0/2643987877 learned_addr learned my addr 172.21.15.144:0/2643987877 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffaf1e00640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffaf40b2de0 0x7ffaf4072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffaf2800640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaf40c5b40 0x7ffaf413d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffae9400640 1 -- 172.21.15.144:0/2643987877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffaf40b2de0 msgr2=0x7ffaf4072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffae9400640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffaf40b2de0 0x7ffaf4072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffae9400640 1 -- 172.21.15.144:0/2643987877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaf40c5b40 msgr2=0x7ffaf413d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffae9400640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaf40c5b40 0x7ffaf413d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.314+0000 7ffae9400640 1 -- 172.21.15.144:0/2643987877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf413e290 con 0x7ffaf40b4c70 2024-05-30T16:42:31.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.315+0000 7ffae9400640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 0x7ffaf413d150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009870 tx=0x7ffadc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:31.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.315+0000 7ffaeaa00640 1 -- 172.21.15.144:0/2643987877 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc042020 con 0x7ffaf40b4c70 2024-05-30T16:42:31.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.315+0000 7ffaeaa00640 1 -- 172.21.15.144:0/2643987877 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffadc033830 con 0x7ffaf40b4c70 2024-05-30T16:42:31.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.315+0000 7ffaeaa00640 1 -- 172.21.15.144:0/2643987877 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc038040 con 0x7ffaf40b4c70 2024-05-30T16:42:31.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.315+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf413dcd0 con 0x7ffaf40b4c70 2024-05-30T16:42:31.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.315+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf4156120 con 0x7ffaf40b4c70 2024-05-30T16:42:31.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.316+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf4075570 con 0x7ffaf40b4c70 2024-05-30T16:42:31.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.317+0000 7ffaeaa00640 1 -- 172.21.15.144:0/2643987877 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffadc045020 con 0x7ffaf40b4c70 2024-05-30T16:42:31.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.318+0000 7ffaeaa00640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffad006c8f0 0x7ffad006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.318+0000 7ffaeaa00640 1 -- 172.21.15.144:0/2643987877 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffadc0ac840 con 0x7ffaf40b4c70 2024-05-30T16:42:31.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.318+0000 7ffaf1e00640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffad006c8f0 0x7ffad006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.319+0000 7ffaf1e00640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffad006c8f0 0x7ffad006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffae400b810 tx=0x7ffae4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.323+0000 7ffaeaa00640 1 -- 172.21.15.144:0/2643987877 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffadc04c030 con 0x7ffaf40b4c70 2024-05-30T16:42:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.565+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ffaf40b5890 con 0x7ffaf40b4c70 2024-05-30T16:42:31.568 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-05-30T16:42:31.566+0000 7fd91d600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T16:42:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.570+0000 7ffaeaa00640 1 -- 172.21.15.144:0/2643987877 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7ffadc07abd0 con 0x7ffaf40b4c70 2024-05-30T16:42:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T16:42:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffad006c8f0 msgr2=0x7ffad006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffad006c8f0 0x7ffad006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffae400b810 tx=0x7ffae4008040 comp rx=0 tx=0).stop 2024-05-30T16:42:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 msgr2=0x7ffaf413d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 0x7ffaf413d150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009870 tx=0x7ffadc0046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 shutdown_connections 2024-05-30T16:42:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffad006c8f0 0x7ffad006edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaf40c5b40 0x7ffaf413d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaf40b4c70 0x7ffaf413d150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 --2- 172.21.15.144:0/2643987877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffaf40b2de0 0x7ffaf4072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 >> 172.21.15.144:0/2643987877 conn(0x7ffaf40627b0 msgr2=0x7ffaf40b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 shutdown_connections 2024-05-30T16:42:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.573+0000 7ffaf3200640 1 -- 172.21.15.144:0/2643987877 wait complete. 2024-05-30T16:42:31.594 INFO:tasks.ceph.mds.a.smithi144.stderr: -7165> 2024-05-30T16:41:57.261+0000 7f5558000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:42:31.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T16:42:31.663 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-05-30T16:42:31.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.778+0000 7f8135c00640 1 Processor -- start 2024-05-30T16:42:31.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.779+0000 7f8135c00640 1 -- start start 2024-05-30T16:42:31.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.780+0000 7f8135c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8130145f10 0x7f81300cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.780+0000 7f8135c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 0x7f8130160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.780+0000 7f8135c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81301607c0 0x7f813015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.780+0000 7f8135c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8130160c50 con 0x7f81301607c0 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.780+0000 7f8135c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f8130161100 con 0x7f8130145f10 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.780+0000 7f8135c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f813006c810 con 0x7f813006c3d0 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f8135200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81301607c0 0x7f813015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f8135200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81301607c0 0x7f813015cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44340/0 (socket says 172.21.15.144:44340) 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f8135200640 1 -- 172.21.15.144:0/1211120756 learned_addr learned my addr 172.21.15.144:0/1211120756 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f812fe00640 1 --2- 172.21.15.144:0/1211120756 >> v2:172.21.15.149:3300/0 conn(0x7f8130145f10 0x7f81300cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f812f400640 1 --2- 172.21.15.144:0/1211120756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 0x7f8130160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f8135200640 1 -- 172.21.15.144:0/1211120756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 msgr2=0x7f8130160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f8135200640 1 --2- 172.21.15.144:0/1211120756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 0x7f8130160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f8135200640 1 -- 172.21.15.144:0/1211120756 >> v2:172.21.15.149:3300/0 conn(0x7f8130145f10 msgr2=0x7f81300cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f8135200640 1 --2- 172.21.15.144:0/1211120756 >> v2:172.21.15.149:3300/0 conn(0x7f8130145f10 0x7f81300cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.781+0000 7f8135200640 1 -- 172.21.15.144:0/1211120756 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81300cd3e0 con 0x7f81301607c0 2024-05-30T16:42:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.782+0000 7f8135200640 1 --2- 172.21.15.144:0/1211120756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 0x7f813015cd30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8130063510 tx=0x7f812802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd252fc5345606 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f812ea00640 1 -- 172.21.15.144:0/1211120756 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128036070 con 0x7f81301607c0 2024-05-30T16:42:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f812ea00640 1 -- 172.21.15.144:0/1211120756 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128031600 con 0x7f81301607c0 2024-05-30T16:42:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f812ea00640 1 -- 172.21.15.144:0/1211120756 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280319d0 con 0x7f81301607c0 2024-05-30T16:42:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f8135c00640 1 -- 172.21.15.144:0/1211120756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 msgr2=0x7f813015cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f8135c00640 1 --2- 172.21.15.144:0/1211120756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 0x7f813015cd30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8130063510 tx=0x7f812802a6c0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f8135c00640 1 -- 172.21.15.144:0/1211120756 shutdown_connections 2024-05-30T16:42:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f8135c00640 1 --2- 172.21.15.144:0/1211120756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 0x7f813015cd30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f8135c00640 1 --2- 172.21.15.144:0/1211120756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 0x7f8130160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f8135c00640 1 --2- 172.21.15.144:0/1211120756 >> v2:172.21.15.149:3300/0 conn(0x7f8130145f10 0x7f81300cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f8135c00640 1 -- 172.21.15.144:0/1211120756 >> 172.21.15.144:0/1211120756 conn(0x7f813006b8e0 msgr2=0x7f813006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f8135c00640 1 -- 172.21.15.144:0/1211120756 shutdown_connections 2024-05-30T16:42:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.783+0000 7f8135c00640 1 -- 172.21.15.144:0/1211120756 wait complete. 2024-05-30T16:42:31.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.785+0000 7f8135c00640 1 Processor -- start 2024-05-30T16:42:31.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.785+0000 7f8135c00640 1 -- start start 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.786+0000 7f8135c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 0x7f813013ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.786+0000 7f8135c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8130145f10 0x7f8130159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.786+0000 7f8135c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 0x7f8130157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.786+0000 7f8135c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81300cdc80 con 0x7f81301607c0 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.786+0000 7f8135c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f81300cd9a0 con 0x7f8130145f10 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.786+0000 7f8135c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f81300cdf60 con 0x7f813006c3d0 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f8135200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 0x7f8130157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f8135200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 0x7f8130157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44354/0 (socket says 172.21.15.144:44354) 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f8135200640 1 -- 172.21.15.144:0/3217830313 learned_addr learned my addr 172.21.15.144:0/3217830313 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f812fe00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 0x7f813013ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f812f400640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8130145f10 0x7f8130159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f8135200640 1 -- 172.21.15.144:0/3217830313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 msgr2=0x7f813013ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f8135200640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 0x7f813013ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f8135200640 1 -- 172.21.15.144:0/3217830313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8130145f10 msgr2=0x7f8130159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f8135200640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8130145f10 0x7f8130159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f8135200640 1 -- 172.21.15.144:0/3217830313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813015a070 con 0x7f81301607c0 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.787+0000 7f8135200640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 0x7f8130157c60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8128034040 tx=0x7f8128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.788+0000 7f8127e00640 1 -- 172.21.15.144:0/3217830313 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128036050 con 0x7f81301607c0 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.788+0000 7f8127e00640 1 -- 172.21.15.144:0/3217830313 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128042070 con 0x7f81301607c0 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.788+0000 7f8127e00640 1 -- 172.21.15.144:0/3217830313 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128009510 con 0x7f81301607c0 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.788+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813015a350 con 0x7f81301607c0 2024-05-30T16:42:31.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.788+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813015a910 con 0x7f81301607c0 2024-05-30T16:42:31.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.789+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81300632f0 con 0x7f81301607c0 2024-05-30T16:42:31.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.790+0000 7f8127e00640 1 -- 172.21.15.144:0/3217830313 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8128007bd0 con 0x7f81301607c0 2024-05-30T16:42:31.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.791+0000 7f8127e00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811006c8f0 0x7f811006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:31.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.791+0000 7f8127e00640 1 -- 172.21.15.144:0/3217830313 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f81280acb20 con 0x7f81301607c0 2024-05-30T16:42:31.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.791+0000 7f812fe00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811006c8f0 0x7f811006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:31.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.792+0000 7f812fe00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811006c8f0 0x7f811006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8120006fd0 tx=0x7f8120008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:31.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:31.795+0000 7f8127e00640 1 -- 172.21.15.144:0/3217830313 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8128045360 con 0x7f81301607c0 2024-05-30T16:42:32.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.027+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8130075570 con 0x7f81301607c0 2024-05-30T16:42:32.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.573+0000 7f8127e00640 1 -- 172.21.15.144:0/3217830313 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f812807ae50 con 0x7f81301607c0 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.576+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811006c8f0 msgr2=0x7f811006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.576+0000 7f8135c00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811006c8f0 0x7f811006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8120006fd0 tx=0x7f8120008040 comp rx=0 tx=0).stop 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.576+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 msgr2=0x7f8130157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.576+0000 7f8135c00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 0x7f8130157c60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8128034040 tx=0x7f8128004a40 comp rx=0 tx=0).stop 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.576+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 shutdown_connections 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.576+0000 7f8135c00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811006c8f0 0x7f811006edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.576+0000 7f8135c00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81301607c0 0x7f8130157c60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.576+0000 7f8135c00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8130145f10 0x7f8130159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.576+0000 7f8135c00640 1 --2- 172.21.15.144:0/3217830313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813006c3d0 0x7f813013ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.577+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 >> 172.21.15.144:0/3217830313 conn(0x7f813006b8e0 msgr2=0x7f813006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.577+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 shutdown_connections 2024-05-30T16:42:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.577+0000 7f8135c00640 1 -- 172.21.15.144:0/3217830313 wait complete. 2024-05-30T16:42:32.598 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T16:42:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.796+0000 7f1369a00640 1 Processor -- start 2024-05-30T16:42:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.796+0000 7f1369a00640 1 -- start start 2024-05-30T16:42:32.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.797+0000 7f1369a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1364145150 0x7f13640cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:32.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.797+0000 7f1369a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 0x7f13640b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.797+0000 7f1369a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13640d00f0 con 0x7f13640cfa70 2024-05-30T16:42:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.797+0000 7f1369a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f13640cfeb0 con 0x7f1364145150 2024-05-30T16:42:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.797+0000 7f1369a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f136415f140 con 0x7f136406f7e0 2024-05-30T16:42:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.798+0000 7f1362a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1364145150 0x7f13640cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.798+0000 7f1362a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1364145150 0x7f13640cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:56158/0 (socket says 172.21.15.144:56158) 2024-05-30T16:42:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.798+0000 7f1362a00640 1 -- 172.21.15.144:0/2185896672 learned_addr learned my addr 172.21.15.144:0/2185896672 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:32.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.798+0000 7f1363400640 1 --2- 172.21.15.144:0/2185896672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 0x7f13640b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:32.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.799+0000 7f1363400640 1 -- 172.21.15.144:0/2185896672 >> v2:172.21.15.149:3300/0 conn(0x7f1364145150 msgr2=0x7f13640cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:32.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.799+0000 7f1363400640 1 --2- 172.21.15.144:0/2185896672 >> v2:172.21.15.149:3300/0 conn(0x7f1364145150 0x7f13640cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:32.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.799+0000 7f1363400640 1 -- 172.21.15.144:0/2185896672 >> v1:172.21.15.149:6789/0 conn(0x7f13640cfa70 legacy=0x7f136406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:32.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.799+0000 7f1363400640 1 -- 172.21.15.144:0/2185896672 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136415f390 con 0x7f136406f7e0 2024-05-30T16:42:32.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.799+0000 7f1362a00640 1 --2- 172.21.15.144:0/2185896672 >> v2:172.21.15.149:3300/0 conn(0x7f1364145150 0x7f13640cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:42:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.800+0000 7f1363400640 1 --2- 172.21.15.144:0/2185896672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 0x7f13640b4930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f135c0097a0 tx=0x7f135c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16438b30ffc0a7a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:32.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1361600640 1 -- 172.21.15.144:0/2185896672 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c037070 con 0x7f136406f7e0 2024-05-30T16:42:32.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1361600640 1 -- 172.21.15.144:0/2185896672 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135c02ae50 con 0x7f136406f7e0 2024-05-30T16:42:32.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1361600640 1 -- 172.21.15.144:0/2185896672 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c032660 con 0x7f136406f7e0 2024-05-30T16:42:32.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1369a00640 1 -- 172.21.15.144:0/2185896672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 msgr2=0x7f13640b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1369a00640 1 --2- 172.21.15.144:0/2185896672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 0x7f13640b4930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f135c0097a0 tx=0x7f135c02a100 comp rx=0 tx=0).stop 2024-05-30T16:42:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1369a00640 1 -- 172.21.15.144:0/2185896672 shutdown_connections 2024-05-30T16:42:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1369a00640 1 --2- 172.21.15.144:0/2185896672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 0x7f13640b4930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1369a00640 1 --2- 172.21.15.144:0/2185896672 >> v2:172.21.15.149:3300/0 conn(0x7f1364145150 0x7f13640cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1369a00640 1 -- 172.21.15.144:0/2185896672 >> 172.21.15.144:0/2185896672 conn(0x7f136406bd00 msgr2=0x7f136406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1369a00640 1 -- 172.21.15.144:0/2185896672 shutdown_connections 2024-05-30T16:42:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.801+0000 7f1369a00640 1 -- 172.21.15.144:0/2185896672 wait complete. 2024-05-30T16:42:32.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.803+0000 7f1369a00640 1 Processor -- start 2024-05-30T16:42:32.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.803+0000 7f1369a00640 1 -- start start 2024-05-30T16:42:32.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.804+0000 7f1369a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 0x7f1364136ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:32.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.804+0000 7f1369a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13640cfa70 0x7f1364159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:32.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.804+0000 7f1369a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1364145150 0x7f1364157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:32.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.804+0000 7f1369a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13640b64f0 con 0x7f1364145150 2024-05-30T16:42:32.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.804+0000 7f1369a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f136415f950 con 0x7f13640cfa70 2024-05-30T16:42:32.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.804+0000 7f1369a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f136415fe70 con 0x7f136406f7e0 2024-05-30T16:42:32.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.804+0000 7f1363400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1364145150 0x7f1364157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:32.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.804+0000 7f1363400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1364145150 0x7f1364157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44356/0 (socket says 172.21.15.144:44356) 2024-05-30T16:42:32.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.804+0000 7f1363400640 1 -- 172.21.15.144:0/1760834214 learned_addr learned my addr 172.21.15.144:0/1760834214 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:32.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f1362a00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 0x7f1364136ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:32.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f1362000640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13640cfa70 0x7f1364159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:32.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f1363400640 1 -- 172.21.15.144:0/1760834214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 msgr2=0x7f1364136ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:32.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f1363400640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 0x7f1364136ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:32.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f1363400640 1 -- 172.21.15.144:0/1760834214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13640cfa70 msgr2=0x7f1364159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:32.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f1363400640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13640cfa70 0x7f1364159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:32.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f1363400640 1 -- 172.21.15.144:0/1760834214 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1364137420 con 0x7f1364145150 2024-05-30T16:42:32.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f1363400640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1364145150 0x7f1364157820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f135c035040 tx=0x7f135c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:32.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f135aa00640 1 -- 172.21.15.144:0/1760834214 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c041070 con 0x7f1364145150 2024-05-30T16:42:32.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f135aa00640 1 -- 172.21.15.144:0/1760834214 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135c03c460 con 0x7f1364145150 2024-05-30T16:42:32.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f135aa00640 1 -- 172.21.15.144:0/1760834214 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c037040 con 0x7f1364145150 2024-05-30T16:42:32.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.805+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f136415a480 con 0x7f1364145150 2024-05-30T16:42:32.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.806+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f136415aa40 con 0x7f1364145150 2024-05-30T16:42:32.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.807+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1364068b90 con 0x7f1364145150 2024-05-30T16:42:32.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.808+0000 7f135aa00640 1 -- 172.21.15.144:0/1760834214 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f135c044070 con 0x7f1364145150 2024-05-30T16:42:32.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.809+0000 7f135aa00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f134006c8f0 0x7f134006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:32.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.809+0000 7f135aa00640 1 -- 172.21.15.144:0/1760834214 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f135c0ac1b0 con 0x7f1364145150 2024-05-30T16:42:32.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.809+0000 7f1362a00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f134006c8f0 0x7f134006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:32.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.810+0000 7f1362a00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f134006c8f0 0x7f134006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1354009ac0 tx=0x7f1354008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:32.814+0000 7f135aa00640 1 -- 172.21.15.144:0/1760834214 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1364137420 con 0x7f1364145150 2024-05-30T16:42:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.012+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f13640b54b0 con 0x7f1364145150 2024-05-30T16:42:33.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.577+0000 7f135aa00640 1 -- 172.21.15.144:0/1760834214 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f135c07a690 con 0x7f1364145150 2024-05-30T16:42:33.578 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-05-30T16:42:33.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.580+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f134006c8f0 msgr2=0x7f134006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:33.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.580+0000 7f1369a00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f134006c8f0 0x7f134006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1354009ac0 tx=0x7f1354008040 comp rx=0 tx=0).stop 2024-05-30T16:42:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.580+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1364145150 msgr2=0x7f1364157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.580+0000 7f1369a00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1364145150 0x7f1364157820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f135c035040 tx=0x7f135c0046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.580+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 shutdown_connections 2024-05-30T16:42:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.580+0000 7f1369a00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f134006c8f0 0x7f134006edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.580+0000 7f1369a00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1364145150 0x7f1364157820 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.581+0000 7f1369a00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13640cfa70 0x7f1364159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.581+0000 7f1369a00640 1 --2- 172.21.15.144:0/1760834214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f136406f7e0 0x7f1364136ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.581+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 >> 172.21.15.144:0/1760834214 conn(0x7f136406bd00 msgr2=0x7f136406ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:33.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.581+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 shutdown_connections 2024-05-30T16:42:33.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.581+0000 7f1369a00640 1 -- 172.21.15.144:0/1760834214 wait complete. 2024-05-30T16:42:33.612 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T16:42:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.796+0000 7fbe52e00640 1 Processor -- start 2024-05-30T16:42:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.796+0000 7fbe52e00640 1 -- start start 2024-05-30T16:42:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.797+0000 7fbe52e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c072210 0x7fbe4c072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.797+0000 7fbe52e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe4c0b4140 0x7fbe4c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.797+0000 7fbe52e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4c06fbf0 con 0x7fbe4c14c630 2024-05-30T16:42:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.797+0000 7fbe52e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbe4c072ba0 con 0x7fbe4c0b4140 2024-05-30T16:42:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.797+0000 7fbe52e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4c0cf050 con 0x7fbe4c072210 2024-05-30T16:42:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.798+0000 7fbe50e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe4c0b4140 0x7fbe4c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.798+0000 7fbe50e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe4c0b4140 0x7fbe4c0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44358/0 (socket says 172.21.15.144:44358) 2024-05-30T16:42:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.798+0000 7fbe50e00640 1 -- 172.21.15.144:0/2895883867 learned_addr learned my addr 172.21.15.144:0/2895883867 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.798+0000 7fbe4b400640 1 --2- 172.21.15.144:0/2895883867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c072210 0x7fbe4c072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.798+0000 7fbe50e00640 1 -- 172.21.15.144:0/2895883867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c072210 msgr2=0x7fbe4c072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.798+0000 7fbe50e00640 1 --2- 172.21.15.144:0/2895883867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c072210 0x7fbe4c072660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.798+0000 7fbe50e00640 1 -- 172.21.15.144:0/2895883867 >> v1:172.21.15.149:6789/0 conn(0x7fbe4c14c630 legacy=0x7fbe4c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.798+0000 7fbe50e00640 1 -- 172.21.15.144:0/2895883867 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c0cf330 con 0x7fbe4c0b4140 2024-05-30T16:42:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.800+0000 7fbe50e00640 1 --2- 172.21.15.144:0/2895883867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c0b4140 0x7fbe4c0b45d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0cda80 tx=0x7fbe4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329578671bd239f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.800+0000 7fbe4aa00640 1 -- 172.21.15.144:0/2895883867 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe44037070 con 0x7fbe4c0b4140 2024-05-30T16:42:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.800+0000 7fbe4aa00640 1 -- 172.21.15.144:0/2895883867 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe44032440 con 0x7fbe4c0b4140 2024-05-30T16:42:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.800+0000 7fbe4aa00640 1 -- 172.21.15.144:0/2895883867 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe44032810 con 0x7fbe4c0b4140 2024-05-30T16:42:33.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.801+0000 7fbe52e00640 1 -- 172.21.15.144:0/2895883867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c0b4140 msgr2=0x7fbe4c0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:33.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.801+0000 7fbe52e00640 1 --2- 172.21.15.144:0/2895883867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c0b4140 0x7fbe4c0b45d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0cda80 tx=0x7fbe4402a270 comp rx=0 tx=0).stop 2024-05-30T16:42:33.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.801+0000 7fbe52e00640 1 -- 172.21.15.144:0/2895883867 shutdown_connections 2024-05-30T16:42:33.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.801+0000 7fbe52e00640 1 --2- 172.21.15.144:0/2895883867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c0b4140 0x7fbe4c0b45d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.801+0000 7fbe52e00640 1 --2- 172.21.15.144:0/2895883867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c072210 0x7fbe4c072660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.801+0000 7fbe52e00640 1 -- 172.21.15.144:0/2895883867 >> 172.21.15.144:0/2895883867 conn(0x7fbe4c06bd00 msgr2=0x7fbe4c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:33.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.801+0000 7fbe52e00640 1 -- 172.21.15.144:0/2895883867 shutdown_connections 2024-05-30T16:42:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.801+0000 7fbe52e00640 1 -- 172.21.15.144:0/2895883867 wait complete. 2024-05-30T16:42:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.803+0000 7fbe52e00640 1 Processor -- start 2024-05-30T16:42:33.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.803+0000 7fbe52e00640 1 -- start start 2024-05-30T16:42:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe52e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c072210 0x7fbe4c0ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe52e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b4140 0x7fbe4c1f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe52e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe4c14c630 0x7fbe4c0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe52e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b3c20 con 0x7fbe4c072210 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe52e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c0cf8f0 con 0x7fbe4c14c630 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe52e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4c14ca10 con 0x7fbe4c0b4140 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe4be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c072210 0x7fbe4c0ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe4be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c072210 0x7fbe4c0ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44370/0 (socket says 172.21.15.144:44370) 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe4be00640 1 -- 172.21.15.144:0/2211594460 learned_addr learned my addr 172.21.15.144:0/2211594460 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe4be00640 1 -- 172.21.15.144:0/2211594460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b4140 msgr2=0x7fbe4c1f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.804+0000 7fbe4be00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b4140 0x7fbe4c1f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.805+0000 7fbe4be00640 1 -- 172.21.15.144:0/2211594460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe4c14c630 msgr2=0x7fbe4c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.805+0000 7fbe4be00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe4c14c630 0x7fbe4c0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.805+0000 7fbe4be00640 1 -- 172.21.15.144:0/2211594460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c0ac970 con 0x7fbe4c072210 2024-05-30T16:42:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.805+0000 7fbe4be00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c072210 0x7fbe4c0ac070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00ba50 tx=0x7fbe3c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.805+0000 7fbe43e00640 1 -- 172.21.15.144:0/2211594460 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c019070 con 0x7fbe4c072210 2024-05-30T16:42:33.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.805+0000 7fbe43e00640 1 -- 172.21.15.144:0/2211594460 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00cc20 con 0x7fbe4c072210 2024-05-30T16:42:33.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.805+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4c0acc50 con 0x7fbe4c072210 2024-05-30T16:42:33.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.805+0000 7fbe43e00640 1 -- 172.21.15.144:0/2211594460 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c014680 con 0x7fbe4c072210 2024-05-30T16:42:33.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.805+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4c0ac5b0 con 0x7fbe4c072210 2024-05-30T16:42:33.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.806+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe4c068b90 con 0x7fbe4c072210 2024-05-30T16:42:33.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.807+0000 7fbe43e00640 1 -- 172.21.15.144:0/2211594460 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe3c01c070 con 0x7fbe4c072210 2024-05-30T16:42:33.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.808+0000 7fbe43e00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe2806c920 0x7fbe2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:33.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.808+0000 7fbe43e00640 1 -- 172.21.15.144:0/2211594460 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5473+0+0 (secure 0 0 0) 0x7fbe3c08b7e0 con 0x7fbe4c072210 2024-05-30T16:42:33.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.809+0000 7fbe4b400640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe2806c920 0x7fbe2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:33.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.809+0000 7fbe4b400640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe2806c920 0x7fbe2806ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0ad4c0 tx=0x7fbe34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:33.813+0000 7fbe43e00640 1 -- 172.21.15.144:0/2211594460 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe3c059600 con 0x7fbe4c072210 2024-05-30T16:42:34.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.015+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbe4c06cf20 con 0x7fbe4c072210 2024-05-30T16:42:34.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.593+0000 7fbe43e00640 1 -- 172.21.15.144:0/2211594460 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7fbe3c05d900 con 0x7fbe4c072210 2024-05-30T16:42:34.595 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-05-30T16:42:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe2806c920 msgr2=0x7fbe2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe2806c920 0x7fbe2806ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0ad4c0 tx=0x7fbe34008040 comp rx=0 tx=0).stop 2024-05-30T16:42:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c072210 msgr2=0x7fbe4c0ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c072210 0x7fbe4c0ac070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00ba50 tx=0x7fbe3c00bf10 comp rx=0 tx=0).stop 2024-05-30T16:42:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 shutdown_connections 2024-05-30T16:42:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe2806c920 0x7fbe2806ede0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe4c14c630 0x7fbe4c0c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b4140 0x7fbe4c1f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 --2- 172.21.15.144:0/2211594460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4c072210 0x7fbe4c0ac070 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00ba50 tx=0x7fbe3c00bf10 comp rx=0 tx=0).stop 2024-05-30T16:42:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.601+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 >> 172.21.15.144:0/2211594460 conn(0x7fbe4c06bd00 msgr2=0x7fbe4c0b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.603+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 shutdown_connections 2024-05-30T16:42:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.604+0000 7fbe52e00640 1 -- 172.21.15.144:0/2211594460 wait complete. 2024-05-30T16:42:34.633 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:42:34.633 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T16:42:34.634 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:42:34.634 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:42:34.634 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:42:34.634 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T16:42:34.634 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:42:34.634 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:42:34.634 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:42:34.635 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T16:42:34.635 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:42:34.635 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:42:34.635 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:42:34.635 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T16:42:34.635 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:42:34.635 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:42:34.652 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:42:34.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:42:34.653 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:42:34.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:42:34.662 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:42:34.662 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:42:34.663 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:42:34.663 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:42:34.697 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:42:34.697 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:34.700 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:42:34.700 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:34.710 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:42:34.711 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:34.716 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:42:34.716 DEBUG:teuthology.parallel:result is None 2024-05-30T16:42:34.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T16:42:34.841 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-05-30T16:42:34.842 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-05-30T16:42:34.863 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-05-30T16:42:34.864 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-05-30T16:42:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.893+0000 7f9350a00640 1 Processor -- start 2024-05-30T16:42:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.893+0000 7f9350a00640 1 -- start start 2024-05-30T16:42:34.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.894+0000 7f9350a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f934c15c6e0 0x7f934c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:34.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.894+0000 7f9350a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f934c0d15e0 0x7f934c15f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:34.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.894+0000 7f9350a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934c0cf3e0 con 0x7f934c15fb30 2024-05-30T16:42:34.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.894+0000 7f9350a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f934c0d0440 con 0x7f934c0d15e0 2024-05-30T16:42:34.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.894+0000 7f9350a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f934c0cffb0 con 0x7f934c15c6e0 2024-05-30T16:42:34.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.894+0000 7f9349400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f934c0d15e0 0x7f934c15f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:34.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.895+0000 7f934a800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f934c15fb30 0x7f934c0b6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33252/0 (socket says 172.21.15.144:33252) 2024-05-30T16:42:34.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.895+0000 7f934a800640 1 -- 172.21.15.144:0/2519853461 learned_addr learned my addr 172.21.15.144:0/2519853461 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.895+0000 7f9349e00640 1 --2- 172.21.15.144:0/2519853461 >> v2:172.21.15.149:3300/0 conn(0x7f934c15c6e0 0x7f934c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.895+0000 7f9348a00640 1 -- 172.21.15.144:0/2519853461 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017613229 0 0) 0x7f934c0cf3e0 con 0x7f934c15fb30 2024-05-30T16:42:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.895+0000 7f9348a00640 1 -- 172.21.15.144:0/2519853461 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9330003520 con 0x7f934c15fb30 2024-05-30T16:42:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.895+0000 7f9349400640 1 -- 172.21.15.144:0/2519853461 >> v2:172.21.15.149:3300/0 conn(0x7f934c15c6e0 msgr2=0x7f934c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.895+0000 7f9349400640 1 --2- 172.21.15.144:0/2519853461 >> v2:172.21.15.149:3300/0 conn(0x7f934c15c6e0 0x7f934c0d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.895+0000 7f9349400640 1 -- 172.21.15.144:0/2519853461 >> v1:172.21.15.144:6789/0 conn(0x7f934c15fb30 legacy=0x7f934c0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.895+0000 7f9349400640 1 -- 172.21.15.144:0/2519853461 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c0d1a70 con 0x7f934c0d15e0 2024-05-30T16:42:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.896+0000 7f9349400640 1 --2- 172.21.15.144:0/2519853461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c0d15e0 0x7f934c15f5f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f934c0d59d0 tx=0x7f933802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d393edf3dcdb05 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.896+0000 7f9348a00640 1 -- 172.21.15.144:0/2519853461 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338037070 con 0x7f934c0d15e0 2024-05-30T16:42:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.896+0000 7f9348a00640 1 -- 172.21.15.144:0/2519853461 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9338032440 con 0x7f934c0d15e0 2024-05-30T16:42:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.897+0000 7f9348a00640 1 -- 172.21.15.144:0/2519853461 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338032810 con 0x7f934c0d15e0 2024-05-30T16:42:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.897+0000 7f9350a00640 1 -- 172.21.15.144:0/2519853461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c0d15e0 msgr2=0x7f934c15f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.897+0000 7f9350a00640 1 --2- 172.21.15.144:0/2519853461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c0d15e0 0x7f934c15f5f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f934c0d59d0 tx=0x7f933802a1a0 comp rx=0 tx=0).stop 2024-05-30T16:42:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.897+0000 7f9350a00640 1 -- 172.21.15.144:0/2519853461 shutdown_connections 2024-05-30T16:42:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.897+0000 7f9350a00640 1 --2- 172.21.15.144:0/2519853461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c0d15e0 0x7f934c15f5f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.897+0000 7f9350a00640 1 --2- 172.21.15.144:0/2519853461 >> v2:172.21.15.149:3300/0 conn(0x7f934c15c6e0 0x7f934c0d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.897+0000 7f9350a00640 1 -- 172.21.15.144:0/2519853461 >> 172.21.15.144:0/2519853461 conn(0x7f934c062390 msgr2=0x7f934c0627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.897+0000 7f9350a00640 1 -- 172.21.15.144:0/2519853461 shutdown_connections 2024-05-30T16:42:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.897+0000 7f9350a00640 1 -- 172.21.15.144:0/2519853461 wait complete. 2024-05-30T16:42:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.899+0000 7f9350a00640 1 Processor -- start 2024-05-30T16:42:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.899+0000 7f9350a00640 1 -- start start 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9350a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f934c0d15e0 0x7f934c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9350a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c15c6e0 0x7f934c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9350a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f934c15fb30 0x7f934c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9350a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f934c0cfc40 con 0x7f934c15c6e0 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9350a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f934c0cf960 con 0x7f934c15fb30 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9350a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f934c15cac0 con 0x7f934c0d15e0 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9349400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c15c6e0 0x7f934c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9349400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c15c6e0 0x7f934c0cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39000/0 (socket says 172.21.15.144:39000) 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9349400640 1 -- 172.21.15.144:0/3807039525 learned_addr learned my addr 172.21.15.144:0/3807039525 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.900+0000 7f9349e00640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f934c0d15e0 0x7f934c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.901+0000 7f934a800640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f934c15fb30 0x7f934c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.901+0000 7f9349400640 1 -- 172.21.15.144:0/3807039525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f934c0d15e0 msgr2=0x7f934c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.901+0000 7f9349400640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f934c0d15e0 0x7f934c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.901+0000 7f9349400640 1 -- 172.21.15.144:0/3807039525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f934c15fb30 msgr2=0x7f934c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.901+0000 7f9349400640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f934c15fb30 0x7f934c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.901+0000 7f9349400640 1 -- 172.21.15.144:0/3807039525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c0cc3a0 con 0x7f934c15c6e0 2024-05-30T16:42:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.901+0000 7f934a800640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f934c15fb30 0x7f934c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.901+0000 7f9349400640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c15c6e0 0x7f934c0cb9e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9338000c00 tx=0x7f93380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.902+0000 7f9342000640 1 -- 172.21.15.144:0/3807039525 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338041020 con 0x7f934c15c6e0 2024-05-30T16:42:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.902+0000 7f9342000640 1 -- 172.21.15.144:0/3807039525 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933803d700 con 0x7f934c15c6e0 2024-05-30T16:42:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.902+0000 7f9342000640 1 -- 172.21.15.144:0/3807039525 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338037040 con 0x7f934c15c6e0 2024-05-30T16:42:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.902+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c0cc680 con 0x7f934c15c6e0 2024-05-30T16:42:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.902+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c0ccc40 con 0x7f934c15c6e0 2024-05-30T16:42:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.903+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c068b20 con 0x7f934c15c6e0 2024-05-30T16:42:34.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.904+0000 7f9342000640 1 -- 172.21.15.144:0/3807039525 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9338044020 con 0x7f934c15c6e0 2024-05-30T16:42:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.905+0000 7f9342000640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f932c06c8f0 0x7f932c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.905+0000 7f9342000640 1 -- 172.21.15.144:0/3807039525 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7f93380abff0 con 0x7f934c15c6e0 2024-05-30T16:42:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.905+0000 7f9349e00640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f932c06c8f0 0x7f932c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.906+0000 7f9349e00640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f932c06c8f0 0x7f932c06edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f933c009ad0 tx=0x7f933c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:34.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:34.910+0000 7f9342000640 1 -- 172.21.15.144:0/3807039525 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f933804b030 con 0x7f934c15c6e0 2024-05-30T16:42:35.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.120+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f934c155f70 con 0x7f934c15c6e0 2024-05-30T16:42:35.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.616+0000 7f9342000640 1 -- 172.21.15.144:0/3807039525 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7f933807a6f0 con 0x7f934c15c6e0 2024-05-30T16:42:35.618 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-05-30T16:42:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f932c06c8f0 msgr2=0x7f932c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f932c06c8f0 0x7f932c06edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f933c009ad0 tx=0x7f933c008040 comp rx=0 tx=0).stop 2024-05-30T16:42:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c15c6e0 msgr2=0x7f934c0cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c15c6e0 0x7f934c0cb9e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9338000c00 tx=0x7f93380046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 shutdown_connections 2024-05-30T16:42:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f932c06c8f0 0x7f932c06edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f934c15fb30 0x7f934c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f934c15c6e0 0x7f934c0cb9e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 --2- 172.21.15.144:0/3807039525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f934c0d15e0 0x7f934c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 >> 172.21.15.144:0/3807039525 conn(0x7f934c062390 msgr2=0x7f934c15e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:35.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 shutdown_connections 2024-05-30T16:42:35.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.621+0000 7f9350a00640 1 -- 172.21.15.144:0/3807039525 wait complete. 2024-05-30T16:42:35.644 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T16:42:35.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.831+0000 7f9c42200640 1 Processor -- start 2024-05-30T16:42:35.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.831+0000 7f9c42200640 1 -- start start 2024-05-30T16:42:35.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c42200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9c3c14c630 0x7f9c3c0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:35.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c42200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c072920 0x7f9c3c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:35.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c42200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c3c06fbf0 con 0x7f9c3c0cea10 2024-05-30T16:42:35.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c42200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3c0cee30 con 0x7f9c3c14c630 2024-05-30T16:42:35.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c42200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3c0cf050 con 0x7f9c3c072920 2024-05-30T16:42:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c3b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9c3c14c630 0x7f9c3c0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c3aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9c3c0cea10 0x7f9c3c072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33262/0 (socket says 172.21.15.144:33262) 2024-05-30T16:42:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c3aa00640 1 -- 172.21.15.144:0/2074624162 learned_addr learned my addr 172.21.15.144:0/2074624162 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c3be00640 1 --2- 172.21.15.144:0/2074624162 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c072920 0x7f9c3c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c3b400640 1 -- 172.21.15.144:0/2074624162 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c072920 msgr2=0x7f9c3c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.834+0000 7f9c3b400640 1 --2- 172.21.15.144:0/2074624162 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c072920 0x7f9c3c0b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.833+0000 7f9c3a000640 1 -- 172.21.15.144:0/2074624162 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208658209 0 0) 0x7f9c3c06fbf0 con 0x7f9c3c0cea10 2024-05-30T16:42:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.834+0000 7f9c3b400640 1 -- 172.21.15.144:0/2074624162 >> v1:172.21.15.144:6789/0 conn(0x7f9c3c0cea10 legacy=0x7f9c3c072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.834+0000 7f9c3b400640 1 -- 172.21.15.144:0/2074624162 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3c0cf330 con 0x7f9c3c14c630 2024-05-30T16:42:35.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.835+0000 7f9c3b400640 1 --2- 172.21.15.144:0/2074624162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c14c630 0x7f9c3c0ce4d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0097a0 tx=0x7f9c2c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c453788076cdf084 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:35.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.835+0000 7f9c3a000640 1 -- 172.21.15.144:0/2074624162 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c037070 con 0x7f9c3c14c630 2024-05-30T16:42:35.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.835+0000 7f9c3a000640 1 -- 172.21.15.144:0/2074624162 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2c032440 con 0x7f9c3c14c630 2024-05-30T16:42:35.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.835+0000 7f9c3a000640 1 -- 172.21.15.144:0/2074624162 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c032810 con 0x7f9c3c14c630 2024-05-30T16:42:35.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.835+0000 7f9c42200640 1 -- 172.21.15.144:0/2074624162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c14c630 msgr2=0x7f9c3c0ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:35.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.835+0000 7f9c42200640 1 --2- 172.21.15.144:0/2074624162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c14c630 0x7f9c3c0ce4d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0097a0 tx=0x7f9c2c02a210 comp rx=0 tx=0).stop 2024-05-30T16:42:35.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.836+0000 7f9c42200640 1 -- 172.21.15.144:0/2074624162 shutdown_connections 2024-05-30T16:42:35.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.836+0000 7f9c42200640 1 --2- 172.21.15.144:0/2074624162 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c072920 0x7f9c3c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.836+0000 7f9c42200640 1 --2- 172.21.15.144:0/2074624162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c14c630 0x7f9c3c0ce4d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.836+0000 7f9c42200640 1 -- 172.21.15.144:0/2074624162 >> 172.21.15.144:0/2074624162 conn(0x7f9c3c06bd00 msgr2=0x7f9c3c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:35.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.836+0000 7f9c42200640 1 -- 172.21.15.144:0/2074624162 shutdown_connections 2024-05-30T16:42:35.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.836+0000 7f9c42200640 1 -- 172.21.15.144:0/2074624162 wait complete. 2024-05-30T16:42:35.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.837+0000 7f9c42200640 1 Processor -- start 2024-05-30T16:42:35.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.838+0000 7f9c42200640 1 -- start start 2024-05-30T16:42:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.838+0000 7f9c42200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c3c072920 0x7f9c3c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.838+0000 7f9c42200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cea10 0x7f9c3c0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.838+0000 7f9c42200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c14c630 0x7f9c3c144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.838+0000 7f9c42200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c0b3c20 con 0x7f9c3c0cea10 2024-05-30T16:42:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.838+0000 7f9c42200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c0cf8f0 con 0x7f9c3c072920 2024-05-30T16:42:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.838+0000 7f9c42200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3c14ca10 con 0x7f9c3c14c630 2024-05-30T16:42:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cea10 0x7f9c3c0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cea10 0x7f9c3c0adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39018/0 (socket says 172.21.15.144:39018) 2024-05-30T16:42:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3aa00640 1 -- 172.21.15.144:0/1729921748 learned_addr learned my addr 172.21.15.144:0/1729921748 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3b400640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c3c072920 0x7f9c3c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3be00640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c14c630 0x7f9c3c144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3aa00640 1 -- 172.21.15.144:0/1729921748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c14c630 msgr2=0x7f9c3c144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3aa00640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c14c630 0x7f9c3c144370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3aa00640 1 -- 172.21.15.144:0/1729921748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c3c072920 msgr2=0x7f9c3c0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3aa00640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c3c072920 0x7f9c3c0ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3aa00640 1 -- 172.21.15.144:0/1729921748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3c0ac240 con 0x7f9c3c0cea10 2024-05-30T16:42:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.839+0000 7f9c3aa00640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cea10 0x7f9c3c0adc40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400c4d0 tx=0x7f9c2400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.840+0000 7f9c33400640 1 -- 172.21.15.144:0/1729921748 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24018070 con 0x7f9c3c0cea10 2024-05-30T16:42:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.840+0000 7f9c33400640 1 -- 172.21.15.144:0/1729921748 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c24007500 con 0x7f9c3c0cea10 2024-05-30T16:42:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.840+0000 7f9c33400640 1 -- 172.21.15.144:0/1729921748 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24004a20 con 0x7f9c3c0cea10 2024-05-30T16:42:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.840+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3c0ae260 con 0x7f9c3c0cea10 2024-05-30T16:42:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.840+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3c0aeb00 con 0x7f9c3c0cea10 2024-05-30T16:42:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.841+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c3c068b90 con 0x7f9c3c0cea10 2024-05-30T16:42:35.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.842+0000 7f9c33400640 1 -- 172.21.15.144:0/1729921748 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c24004bc0 con 0x7f9c3c0cea10 2024-05-30T16:42:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.843+0000 7f9c33400640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.843+0000 7f9c33400640 1 -- 172.21.15.144:0/1729921748 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f9c2408aab0 con 0x7f9c3c0cea10 2024-05-30T16:42:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.843+0000 7f9c3b400640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.844+0000 7f9c3b400640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9c1806c8f0 0x7f9c1806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c034000 tx=0x7f9c2c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:35.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:35.847+0000 7f9c33400640 1 -- 172.21.15.144:0/1729921748 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c24059220 con 0x7f9c3c0cea10 2024-05-30T16:42:36.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.120+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9c3c14bbb0 con 0x7f9c3c0cea10 2024-05-30T16:42:36.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.122+0000 7f9c33400640 1 -- 172.21.15.144:0/1729921748 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f9c24058b20 con 0x7f9c3c0cea10 2024-05-30T16:42:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:36.123 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:42:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-05-30T16:42:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-05-30T16:42:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmF+/kKhAA0L6yP95TzJQ6K4jpCd5+tg==", 2024-05-30T16:42:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmn8xEDRAAjwGDHViLwz305wNijyo18g==", 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmuIxAORAA/N4DIL7c+EuojamnyYrt8Q==", 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-05-30T16:42:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmohxgGxAA4vjzBoeVO37nSNV38b13jQ==", 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAVrFhmdJ6TFxAAFhv8K0nLudGT9rT6oHmhvQ==", 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:42:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAYrFhmC1VXIhAAyyeKMhil2CcMD+5mm3xcvg==", 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAbrFhmid0VLRAA/StAYue0HlyInB/n42h3wg==", 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAerFhmJwCyNhAAkvkgyy7RRMOwwfYhyd19XA==", 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:42:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAlrFhm/8G1CxAAAlDJwijmpj2gS8x2BhgIpA==", 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-05-30T16:42:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAorFhmO1zgJhAAxdZsdLD/lBuyuhEdX2AF6g==", 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAsrFhmPtDmAxAA1+YfFHQ7XLtQQIOp4BLnwQ==", 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:42:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAvrFhmbqIVDxAAr6NR0hbs+v/4CP4/WRT1SA==", 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA==", 2024-05-30T16:42:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmVgMROxAA2SCdaM/Q+v9jhyfF7SZoWg==", 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:42:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmvzKvMBAAIPPum2n8LgNjGXjueMBuqQ==", 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-05-30T16:42:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQASrFhmdx2UCRAAFENiZ9XGo/B0vBmixV0k0A==", 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAPrFhmtLjtJBAAhR92wuSYl1aS8+gl0+zhcg==", 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:42:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-mds", 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQA3rFhmzv+5LxAAgP6rDu5OaHfh9U20USL6aA==", 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-mds" 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-mgr", 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQA3rFhmXBy6LxAAVUr/FQq+Gn/YoJ8nrx5wXA==", 2024-05-30T16:42:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-osd", 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQA3rFhmlzW6LxAAeYeuM18+GSyTPBMUceYBeQ==", 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-osd" 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rbd", 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQA3rFhmpE26LxAAKLPNcVrTX9pfyGlIRBWL4w==", 2024-05-30T16:42:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQA3rFhmrma6LxAA+uKeaj2kQyFLzAtaf0GlTg==", 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rgw", 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQA3rFhmoYC6LxAAI6hHJ7NutXYeTu09iB7YrA==", 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmn/cwIBAAc0kCDj+gFH2f0tY5cbGrjg==", 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-05-30T16:42:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhm8GMmFRAAtPZbiQkY1GfShaqCf3b4Zw==", 2024-05-30T16:42:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:42:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:42:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-05-30T16:42:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:42:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-05-30T16:42:36.139 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9c1806c8f0 msgr2=0x7f9c1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9c1806c8f0 0x7f9c1806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c034000 tx=0x7f9c2c02e000 comp rx=0 tx=0).stop 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cea10 msgr2=0x7f9c3c0adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cea10 0x7f9c3c0adc40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400c4d0 tx=0x7f9c2400c990 comp rx=0 tx=0).stop 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 shutdown_connections 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c3c14c630 0x7f9c3c144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cea10 0x7f9c3c0adc40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 --2- 172.21.15.144:0/1729921748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c3c072920 0x7f9c3c0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.124+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 >> 172.21.15.144:0/1729921748 conn(0x7f9c3c06bd00 msgr2=0x7f9c3c0b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:36.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.125+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 shutdown_connections 2024-05-30T16:42:36.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.125+0000 7f9c42200640 1 -- 172.21.15.144:0/1729921748 wait complete. 2024-05-30T16:42:36.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-30T16:42:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.355+0000 7fc0f2800640 1 Processor -- start 2024-05-30T16:42:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.355+0000 7fc0f2800640 1 -- start start 2024-05-30T16:42:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.355+0000 7fc0f2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc0ec0ce390 0x7fc0ec15e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.356+0000 7fc0f2800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc0ec1604c0 0x7fc0ec06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.356+0000 7fc0f2800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec160c40 con 0x7fc0ec15da50 2024-05-30T16:42:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.356+0000 7fc0f2800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc0ec15dee0 con 0x7fc0ec0ce390 2024-05-30T16:42:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.356+0000 7fc0f2800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc0ec160f20 con 0x7fc0ec1604c0 2024-05-30T16:42:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.356+0000 7fc0eb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc0ec0ce390 0x7fc0ec15e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.356+0000 7fc0eb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc0ec0ce390 0x7fc0ec15e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39022/0 (socket says 172.21.15.144:39022) 2024-05-30T16:42:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.356+0000 7fc0eb400640 1 -- 172.21.15.144:0/2844531102 learned_addr learned my addr 172.21.15.144:0/2844531102 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.356+0000 7fc0ebe00640 1 --2- 172.21.15.144:0/2844531102 >> v2:172.21.15.149:3300/0 conn(0x7fc0ec1604c0 0x7fc0ec06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.357+0000 7fc0eb400640 1 -- 172.21.15.144:0/2844531102 >> v2:172.21.15.149:3300/0 conn(0x7fc0ec1604c0 msgr2=0x7fc0ec06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:36.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.357+0000 7fc0eb400640 1 --2- 172.21.15.144:0/2844531102 >> v2:172.21.15.149:3300/0 conn(0x7fc0ec1604c0 0x7fc0ec06ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.357+0000 7fc0eb400640 1 -- 172.21.15.144:0/2844531102 >> v1:172.21.15.149:6789/0 conn(0x7fc0ec15da50 legacy=0x7fc0ec0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:36.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.357+0000 7fc0eb400640 1 -- 172.21.15.144:0/2844531102 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec161200 con 0x7fc0ec0ce390 2024-05-30T16:42:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.357+0000 7fc0ebe00640 1 --2- 172.21.15.144:0/2844531102 >> v2:172.21.15.149:3300/0 conn(0x7fc0ec1604c0 0x7fc0ec06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:42:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.358+0000 7fc0eb400640 1 --2- 172.21.15.144:0/2844531102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 0x7fc0ec15e090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0a9540 tx=0x7fc0dc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9f93c07abff9f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.359+0000 7fc0ea000640 1 -- 172.21.15.144:0/2844531102 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc037070 con 0x7fc0ec0ce390 2024-05-30T16:42:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.359+0000 7fc0ea000640 1 -- 172.21.15.144:0/2844531102 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0dc032440 con 0x7fc0ec0ce390 2024-05-30T16:42:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.359+0000 7fc0ea000640 1 -- 172.21.15.144:0/2844531102 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc032810 con 0x7fc0ec0ce390 2024-05-30T16:42:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.359+0000 7fc0f2800640 1 -- 172.21.15.144:0/2844531102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 msgr2=0x7fc0ec15e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.359+0000 7fc0f2800640 1 --2- 172.21.15.144:0/2844531102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 0x7fc0ec15e090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0a9540 tx=0x7fc0dc02a230 comp rx=0 tx=0).stop 2024-05-30T16:42:36.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.359+0000 7fc0f2800640 1 -- 172.21.15.144:0/2844531102 shutdown_connections 2024-05-30T16:42:36.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.359+0000 7fc0f2800640 1 --2- 172.21.15.144:0/2844531102 >> v2:172.21.15.149:3300/0 conn(0x7fc0ec1604c0 0x7fc0ec06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.359+0000 7fc0f2800640 1 --2- 172.21.15.144:0/2844531102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 0x7fc0ec15e090 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.359+0000 7fc0f2800640 1 -- 172.21.15.144:0/2844531102 >> 172.21.15.144:0/2844531102 conn(0x7fc0ec0629c0 msgr2=0x7fc0ec06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:36.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.360+0000 7fc0f2800640 1 -- 172.21.15.144:0/2844531102 shutdown_connections 2024-05-30T16:42:36.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.360+0000 7fc0f2800640 1 -- 172.21.15.144:0/2844531102 wait complete. 2024-05-30T16:42:36.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.361+0000 7fc0f2800640 1 Processor -- start 2024-05-30T16:42:36.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.361+0000 7fc0f2800640 1 -- start start 2024-05-30T16:42:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.362+0000 7fc0f2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 0x7fc0ec154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.362+0000 7fc0f2800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0ec15da50 0x7fc0ec158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.362+0000 7fc0f2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1604c0 0x7fc0ec159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.362+0000 7fc0f2800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec143130 con 0x7fc0ec0ce390 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.362+0000 7fc0f2800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec1608d0 con 0x7fc0ec1604c0 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.362+0000 7fc0f2800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0ec1432b0 con 0x7fc0ec15da50 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 0x7fc0ec154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 0x7fc0ec154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39036/0 (socket says 172.21.15.144:39036) 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0eb400640 1 -- 172.21.15.144:0/1186112116 learned_addr learned my addr 172.21.15.144:0/1186112116 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0ebe00640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1604c0 0x7fc0ec159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0eaa00640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0ec15da50 0x7fc0ec158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0eb400640 1 -- 172.21.15.144:0/1186112116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0ec15da50 msgr2=0x7fc0ec158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0eb400640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0ec15da50 0x7fc0ec158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0eb400640 1 -- 172.21.15.144:0/1186112116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1604c0 msgr2=0x7fc0ec159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0eb400640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1604c0 0x7fc0ec159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.363+0000 7fc0eb400640 1 -- 172.21.15.144:0/1186112116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec0b4630 con 0x7fc0ec0ce390 2024-05-30T16:42:36.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.364+0000 7fc0eb400640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 0x7fc0ec154e80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc02a270 tx=0x7fc0dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:36.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.364+0000 7fc0e3400640 1 -- 172.21.15.144:0/1186112116 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc041020 con 0x7fc0ec0ce390 2024-05-30T16:42:36.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.364+0000 7fc0e3400640 1 -- 172.21.15.144:0/1186112116 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0dc0306c0 con 0x7fc0ec0ce390 2024-05-30T16:42:36.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.364+0000 7fc0e3400640 1 -- 172.21.15.144:0/1186112116 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc037040 con 0x7fc0ec0ce390 2024-05-30T16:42:36.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.364+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ec0b3870 con 0x7fc0ec0ce390 2024-05-30T16:42:36.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.364+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ec0b3e30 con 0x7fc0ec0ce390 2024-05-30T16:42:36.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.365+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0ec06c870 con 0x7fc0ec0ce390 2024-05-30T16:42:36.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.366+0000 7fc0e3400640 1 -- 172.21.15.144:0/1186112116 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc0dc044020 con 0x7fc0ec0ce390 2024-05-30T16:42:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.367+0000 7fc0e3400640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0cc06c8f0 0x7fc0cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.367+0000 7fc0e3400640 1 -- 172.21.15.144:0/1186112116 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fc0dc0ac030 con 0x7fc0ec0ce390 2024-05-30T16:42:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.367+0000 7fc0eaa00640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0cc06c8f0 0x7fc0cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.368+0000 7fc0eaa00640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0cc06c8f0 0x7fc0cc06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec1f7fc0 tx=0x7fc0d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.372+0000 7fc0e3400640 1 -- 172.21.15.144:0/1186112116 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc0dc04b030 con 0x7fc0ec0ce390 2024-05-30T16:42:36.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.650+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fc0ec0cddd0 con 0x7fc0ec0ce390 2024-05-30T16:42:36.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.654+0000 7fc0e3400640 1 -- 172.21.15.144:0/1186112116 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fc0dc07a7b0 con 0x7fc0ec0ce390 2024-05-30T16:42:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.656+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0cc06c8f0 msgr2=0x7fc0cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.656+0000 7fc0f2800640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0cc06c8f0 0x7fc0cc06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec1f7fc0 tx=0x7fc0d8009040 comp rx=0 tx=0).stop 2024-05-30T16:42:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.656+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 msgr2=0x7fc0ec154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.656+0000 7fc0f2800640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 0x7fc0ec154e80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc02a270 tx=0x7fc0dc0046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.656+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 shutdown_connections 2024-05-30T16:42:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.656+0000 7fc0f2800640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0cc06c8f0 0x7fc0cc06edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.656+0000 7fc0f2800640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1604c0 0x7fc0ec159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.656+0000 7fc0f2800640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0ec15da50 0x7fc0ec158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.656+0000 7fc0f2800640 1 --2- 172.21.15.144:0/1186112116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0ec0ce390 0x7fc0ec154e80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.657+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 >> 172.21.15.144:0/1186112116 conn(0x7fc0ec0629c0 msgr2=0x7fc0ec0adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.657+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 shutdown_connections 2024-05-30T16:42:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.657+0000 7fc0f2800640 1 -- 172.21.15.144:0/1186112116 wait complete. 2024-05-30T16:42:36.676 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-30T16:42:36.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.863+0000 7fd905a00640 1 Processor -- start 2024-05-30T16:42:36.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.863+0000 7fd905a00640 1 -- start start 2024-05-30T16:42:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd905a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd9000ce390 0x7fd90015e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd905a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd9001604c0 0x7fd90006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd905a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd900160c40 con 0x7fd90015da50 2024-05-30T16:42:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd905a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd90015dee0 con 0x7fd9000ce390 2024-05-30T16:42:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd905a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd900160f20 con 0x7fd9001604c0 2024-05-30T16:42:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd8fea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd9000ce390 0x7fd90015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd8fea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd9000ce390 0x7fd90015e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39042/0 (socket says 172.21.15.144:39042) 2024-05-30T16:42:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd8fea00640 1 -- 172.21.15.144:0/3175615251 learned_addr learned my addr 172.21.15.144:0/3175615251 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd8fe000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd90015da50 0x7fd9000ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33268/0 (socket says 172.21.15.144:33268) 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd8ff400640 1 --2- 172.21.15.144:0/3175615251 >> v2:172.21.15.149:3300/0 conn(0x7fd9001604c0 0x7fd90006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd8fea00640 1 -- 172.21.15.144:0/3175615251 >> v2:172.21.15.149:3300/0 conn(0x7fd9001604c0 msgr2=0x7fd90006ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd8fea00640 1 --2- 172.21.15.144:0/3175615251 >> v2:172.21.15.149:3300/0 conn(0x7fd9001604c0 0x7fd90006ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.864+0000 7fd8fea00640 1 -- 172.21.15.144:0/3175615251 >> v1:172.21.15.144:6789/0 conn(0x7fd90015da50 legacy=0x7fd9000ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.865+0000 7fd8fd600640 1 -- 172.21.15.144:0/3175615251 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075905038 0 0) 0x7fd900160c40 con 0x7fd90015da50 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.865+0000 7fd8fea00640 1 -- 172.21.15.144:0/3175615251 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd900161200 con 0x7fd9000ce390 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.865+0000 7fd8ff400640 1 --2- 172.21.15.144:0/3175615251 >> v2:172.21.15.149:3300/0 conn(0x7fd9001604c0 0x7fd90006ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.866+0000 7fd8fea00640 1 --2- 172.21.15.144:0/3175615251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9000ce390 0x7fd90015e090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd9000a9540 tx=0x7fd8f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c259b73e16baa0e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.866+0000 7fd8fd600640 1 -- 172.21.15.144:0/3175615251 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0037070 con 0x7fd9000ce390 2024-05-30T16:42:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.866+0000 7fd8fd600640 1 -- 172.21.15.144:0/3175615251 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f0032440 con 0x7fd9000ce390 2024-05-30T16:42:36.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.866+0000 7fd8fd600640 1 -- 172.21.15.144:0/3175615251 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0032810 con 0x7fd9000ce390 2024-05-30T16:42:36.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.866+0000 7fd905a00640 1 -- 172.21.15.144:0/3175615251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9000ce390 msgr2=0x7fd90015e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.866+0000 7fd905a00640 1 --2- 172.21.15.144:0/3175615251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9000ce390 0x7fd90015e090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd9000a9540 tx=0x7fd8f002a270 comp rx=0 tx=0).stop 2024-05-30T16:42:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.867+0000 7fd905a00640 1 -- 172.21.15.144:0/3175615251 shutdown_connections 2024-05-30T16:42:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.867+0000 7fd905a00640 1 --2- 172.21.15.144:0/3175615251 >> v2:172.21.15.149:3300/0 conn(0x7fd9001604c0 0x7fd90006ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.867+0000 7fd905a00640 1 --2- 172.21.15.144:0/3175615251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9000ce390 0x7fd90015e090 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.867+0000 7fd905a00640 1 -- 172.21.15.144:0/3175615251 >> 172.21.15.144:0/3175615251 conn(0x7fd9000629c0 msgr2=0x7fd90006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.867+0000 7fd905a00640 1 -- 172.21.15.144:0/3175615251 shutdown_connections 2024-05-30T16:42:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.867+0000 7fd905a00640 1 -- 172.21.15.144:0/3175615251 wait complete. 2024-05-30T16:42:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.868+0000 7fd905a00640 1 Processor -- start 2024-05-30T16:42:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.868+0000 7fd905a00640 1 -- start start 2024-05-30T16:42:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.869+0000 7fd905a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9000ce390 0x7fd900141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.869+0000 7fd905a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015da50 0x7fd9000aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.869+0000 7fd905a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9001604c0 0x7fd9001f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.869+0000 7fd905a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd900143130 con 0x7fd90015da50 2024-05-30T16:42:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.869+0000 7fd905a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001608d0 con 0x7fd9001604c0 2024-05-30T16:42:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.869+0000 7fd905a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd9001432b0 con 0x7fd9000ce390 2024-05-30T16:42:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015da50 0x7fd9000aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015da50 0x7fd9000aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39046/0 (socket says 172.21.15.144:39046) 2024-05-30T16:42:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8fe000640 1 -- 172.21.15.144:0/3409469102 learned_addr learned my addr 172.21.15.144:0/3409469102 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8ff400640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9001604c0 0x7fd9001f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8fe000640 1 -- 172.21.15.144:0/3409469102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9000ce390 msgr2=0x7fd900141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8fe000640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9000ce390 0x7fd900141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8fe000640 1 -- 172.21.15.144:0/3409469102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9001604c0 msgr2=0x7fd9001f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8fe000640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9001604c0 0x7fd9001f3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8fe000640 1 -- 172.21.15.144:0/3409469102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9001424d0 con 0x7fd90015da50 2024-05-30T16:42:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.870+0000 7fd8fe000640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015da50 0x7fd9000aa780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c500 tx=0x7fd8ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:36.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.871+0000 7fd8f6a00640 1 -- 172.21.15.144:0/3409469102 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec018070 con 0x7fd90015da50 2024-05-30T16:42:36.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.871+0000 7fd8f6a00640 1 -- 172.21.15.144:0/3409469102 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ec007580 con 0x7fd90015da50 2024-05-30T16:42:36.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.871+0000 7fd8f6a00640 1 -- 172.21.15.144:0/3409469102 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec004a20 con 0x7fd90015da50 2024-05-30T16:42:36.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.871+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9000ab160 con 0x7fd90015da50 2024-05-30T16:42:36.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.871+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9000ab720 con 0x7fd90015da50 2024-05-30T16:42:36.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.872+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9000cddd0 con 0x7fd90015da50 2024-05-30T16:42:36.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.873+0000 7fd8f6a00640 1 -- 172.21.15.144:0/3409469102 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8ec004bc0 con 0x7fd90015da50 2024-05-30T16:42:36.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.874+0000 7fd8f6a00640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8e006c8f0 0x7fd8e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:36.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.874+0000 7fd8f6a00640 1 -- 172.21.15.144:0/3409469102 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fd8ec08a9d0 con 0x7fd90015da50 2024-05-30T16:42:36.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.874+0000 7fd8fea00640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8e006c8f0 0x7fd8e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:36.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.875+0000 7fd8fea00640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8e006c8f0 0x7fd8e006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0034000 tx=0x7fd8f002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:36.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:36.879+0000 7fd8f6a00640 1 -- 172.21.15.144:0/3409469102 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd9001424d0 con 0x7fd90015da50 2024-05-30T16:42:37.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.166+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fd9001592e0 con 0x7fd90015da50 2024-05-30T16:42:37.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.170+0000 7fd8f6a00640 1 -- 172.21.15.144:0/3409469102 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fd8ec0591e0 con 0x7fd90015da50 2024-05-30T16:42:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.174+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8e006c8f0 msgr2=0x7fd8e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.174+0000 7fd905a00640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8e006c8f0 0x7fd8e006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0034000 tx=0x7fd8f002c000 comp rx=0 tx=0).stop 2024-05-30T16:42:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.174+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015da50 msgr2=0x7fd9000aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.175+0000 7fd905a00640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015da50 0x7fd9000aa780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c500 tx=0x7fd8ec00c9c0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.175+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 shutdown_connections 2024-05-30T16:42:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.175+0000 7fd905a00640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8e006c8f0 0x7fd8e006edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.175+0000 7fd905a00640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9001604c0 0x7fd9001f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.175+0000 7fd905a00640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015da50 0x7fd9000aa780 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.175+0000 7fd905a00640 1 --2- 172.21.15.144:0/3409469102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9000ce390 0x7fd900141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.175+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 >> 172.21.15.144:0/3409469102 conn(0x7fd9000629c0 msgr2=0x7fd90015f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:37.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.175+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 shutdown_connections 2024-05-30T16:42:37.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.175+0000 7fd905a00640 1 -- 172.21.15.144:0/3409469102 wait complete. 2024-05-30T16:42:37.202 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-30T16:42:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.400+0000 7f3077e00640 1 Processor -- start 2024-05-30T16:42:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.400+0000 7f3077e00640 1 -- start start 2024-05-30T16:42:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.401+0000 7f3077e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f307006efb0 0x7f307015f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.401+0000 7f3077e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307015f120 con 0x7f307015fe40 2024-05-30T16:42:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.401+0000 7f3077e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30700cee40 con 0x7f3070159320 2024-05-30T16:42:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.401+0000 7f3077e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f30700cf120 con 0x7f307006efb0 2024-05-30T16:42:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.401+0000 7f3075e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f307015fe40 0x7f30700ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33276/0 (socket says 172.21.15.144:33276) 2024-05-30T16:42:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.401+0000 7f3075e00640 1 -- 172.21.15.144:0/47822389 learned_addr learned my addr 172.21.15.144:0/47822389 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.401+0000 7f3074a00640 1 --2- 172.21.15.144:0/47822389 >> v2:172.21.15.149:3300/0 conn(0x7f307006efb0 0x7f307015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.401+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182312742 0 0) 0x7f307015f120 con 0x7f307015fe40 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3058003520 con 0x7f307015fe40 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3695304950 0 0) 0x7f3058003520 con 0x7f307015fe40 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 >> v2:172.21.15.149:3300/0 conn(0x7f307006efb0 msgr2=0x7f307015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 --2- 172.21.15.144:0/47822389 >> v2:172.21.15.149:3300/0 conn(0x7f307006efb0 0x7f307015f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 >> v1:172.21.15.149:6789/0 conn(0x7f3070159320 legacy=0x7f307006f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30700cf400 con 0x7f307015fe40 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f30680019f0 con 0x7f307015fe40 2024-05-30T16:42:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 >> v1:172.21.15.144:6789/0 conn(0x7f307015fe40 legacy=0x7f30700ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 --2- 172.21.15.144:0/47822389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3058003a00 0x7f3058003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 --2- 172.21.15.144:0/47822389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 --2- 172.21.15.144:0/47822389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3058005210 0x7f305800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f30700cf120 con 0x7f3058003a00 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f305800c160 con 0x7f3058005210 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f305800c360 con 0x7f3058004800 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.402+0000 7f3075400640 1 --2- 172.21.15.144:0/47822389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3058003a00 0x7f3058003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.404+0000 7f3075400640 1 -- 172.21.15.144:0/47822389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3058004800 msgr2=0x7f3058004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.404+0000 7f3075400640 1 --2- 172.21.15.144:0/47822389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.404+0000 7f3075400640 1 -- 172.21.15.144:0/47822389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3058005210 msgr2=0x7f305800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.404+0000 7f3075400640 1 --2- 172.21.15.144:0/47822389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3058005210 0x7f305800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.404+0000 7f3075400640 1 -- 172.21.15.144:0/47822389 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3058003520 con 0x7f3058003a00 2024-05-30T16:42:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.404+0000 7f3075e00640 1 -- 172.21.15.144:0/47822389 reap_dead start 2024-05-30T16:42:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f3075400640 1 --2- 172.21.15.144:0/47822389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3058003a00 0x7f3058003e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3064001720 tx=0x7f3058005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac169c155074597 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064001370 con 0x7f3058003a00 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30640052d0 con 0x7f3058003a00 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f306fe00640 1 -- 172.21.15.144:0/47822389 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306402aba0 con 0x7f3058003a00 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f3077e00640 1 -- 172.21.15.144:0/47822389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3058003a00 msgr2=0x7f3058003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f3077e00640 1 --2- 172.21.15.144:0/47822389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3058003a00 0x7f3058003e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3064001720 tx=0x7f3058005830 comp rx=0 tx=0).stop 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f3077e00640 1 -- 172.21.15.144:0/47822389 shutdown_connections 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f3077e00640 1 --2- 172.21.15.144:0/47822389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3058003a00 0x7f3058003e20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f3077e00640 1 -- 172.21.15.144:0/47822389 >> 172.21.15.144:0/47822389 conn(0x7f30700629c0 msgr2=0x7f307006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f3077e00640 1 -- 172.21.15.144:0/47822389 shutdown_connections 2024-05-30T16:42:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.405+0000 7f3077e00640 1 -- 172.21.15.144:0/47822389 wait complete. 2024-05-30T16:42:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.406+0000 7f3077e00640 1 Processor -- start 2024-05-30T16:42:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.406+0000 7f3077e00640 1 -- start start 2024-05-30T16:42:37.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.407+0000 7f3077e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3058003a00 0x7f307015b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.407+0000 7f3077e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3070146e50 0x7f3070159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.407+0000 7f3077e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307015a050 0x7f30700af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.407+0000 7f3077e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f307015fa80 con 0x7f3070146e50 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.407+0000 7f3077e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f307015f900 con 0x7f3058003a00 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.407+0000 7f3077e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f307015fc00 con 0x7f307015a050 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3074a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3070146e50 0x7f3070159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3074a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3070146e50 0x7f3070159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39064/0 (socket says 172.21.15.144:39064) 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3074a00640 1 -- 172.21.15.144:0/198487600 learned_addr learned my addr 172.21.15.144:0/198487600 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3075400640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3058003a00 0x7f307015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3074a00640 1 -- 172.21.15.144:0/198487600 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307015a050 msgr2=0x7f30700af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3074a00640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307015a050 0x7f30700af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3074a00640 1 -- 172.21.15.144:0/198487600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3058003a00 msgr2=0x7f307015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3074a00640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3058003a00 0x7f307015b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3074a00640 1 -- 172.21.15.144:0/198487600 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307015a840 con 0x7f3070146e50 2024-05-30T16:42:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.408+0000 7f3074a00640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3070146e50 0x7f3070159b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f305c00e770 tx=0x7f305c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.409+0000 7f306d600640 1 -- 172.21.15.144:0/198487600 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c017070 con 0x7f3070146e50 2024-05-30T16:42:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.409+0000 7f306d600640 1 -- 172.21.15.144:0/198487600 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c00c730 con 0x7f3070146e50 2024-05-30T16:42:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.409+0000 7f306d600640 1 -- 172.21.15.144:0/198487600 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c00cb20 con 0x7f3070146e50 2024-05-30T16:42:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.409+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307015ab20 con 0x7f3070146e50 2024-05-30T16:42:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.409+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307015b0e0 con 0x7f3070146e50 2024-05-30T16:42:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.411+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3070068b20 con 0x7f3070146e50 2024-05-30T16:42:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.411+0000 7f306d600640 1 -- 172.21.15.144:0/198487600 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f305c01a070 con 0x7f3070146e50 2024-05-30T16:42:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.412+0000 7f306d600640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f305006c8f0 0x7f305006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.412+0000 7f306d600640 1 -- 172.21.15.144:0/198487600 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f305c08baf0 con 0x7f3070146e50 2024-05-30T16:42:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.412+0000 7f3075400640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f305006c8f0 0x7f305006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.413+0000 7f3075400640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f305006c8f0 0x7f305006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3064032000 tx=0x7f306402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.417+0000 7f306d600640 1 -- 172.21.15.144:0/198487600 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f305c05a260 con 0x7f3070146e50 2024-05-30T16:42:37.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.673+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f3070161d40 con 0x7f3070146e50 2024-05-30T16:42:37.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.677+0000 7f306d600640 1 -- 172.21.15.144:0/198487600 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f305c059b60 con 0x7f3070146e50 2024-05-30T16:42:37.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.679+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f305006c8f0 msgr2=0x7f305006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.679+0000 7f3077e00640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f305006c8f0 0x7f305006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3064032000 tx=0x7f306402e000 comp rx=0 tx=0).stop 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.679+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3070146e50 msgr2=0x7f3070159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.679+0000 7f3077e00640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3070146e50 0x7f3070159b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f305c00e770 tx=0x7f305c00ec30 comp rx=0 tx=0).stop 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.679+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 shutdown_connections 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.680+0000 7f3077e00640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f305006c8f0 0x7f305006edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.680+0000 7f3077e00640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307015a050 0x7f30700af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.680+0000 7f3077e00640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3070146e50 0x7f3070159b10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.680+0000 7f3077e00640 1 --2- 172.21.15.144:0/198487600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3058003a00 0x7f307015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.680+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 >> 172.21.15.144:0/198487600 conn(0x7f30700629c0 msgr2=0x7f3070160e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.680+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 shutdown_connections 2024-05-30T16:42:37.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.680+0000 7f3077e00640 1 -- 172.21.15.144:0/198487600 wait complete. 2024-05-30T16:42:37.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-30T16:42:37.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.891+0000 7fc5d4a00640 1 Processor -- start 2024-05-30T16:42:37.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.891+0000 7fc5d4a00640 1 -- start start 2024-05-30T16:42:37.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.893+0000 7fc5d4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d01414d0 0x7fc5d0141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.893+0000 7fc5d4a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc5d01418b0 0x7fc5d00b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.893+0000 7fc5d4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5d00b2c70 0x7fc5d01625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.893+0000 7fc5d4a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc5d01422f0 con 0x7fc5d00b2c70 2024-05-30T16:42:37.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.893+0000 7fc5d4a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc5d00b3730 con 0x7fc5d01418b0 2024-05-30T16:42:37.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.893+0000 7fc5d4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d00b3a10 con 0x7fc5d01414d0 2024-05-30T16:42:37.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.893+0000 7fc5cfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5d00b2c70 0x7fc5d01625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.893+0000 7fc5cfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5d00b2c70 0x7fc5d01625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39066/0 (socket says 172.21.15.144:39066) 2024-05-30T16:42:37.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.893+0000 7fc5cfe00640 1 -- 172.21.15.144:0/3301010637 learned_addr learned my addr 172.21.15.144:0/3301010637 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:37.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.894+0000 7fc5cea00640 1 --2- 172.21.15.144:0/3301010637 >> v2:172.21.15.149:3300/0 conn(0x7fc5d01418b0 0x7fc5d00b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.894+0000 7fc5cfe00640 1 -- 172.21.15.144:0/3301010637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d01414d0 msgr2=0x7fc5d0141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:37.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.894+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/3301010637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d01414d0 0x7fc5d0141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.894+0000 7fc5cfe00640 1 -- 172.21.15.144:0/3301010637 >> v2:172.21.15.149:3300/0 conn(0x7fc5d01418b0 msgr2=0x7fc5d00b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:37.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.894+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/3301010637 >> v2:172.21.15.149:3300/0 conn(0x7fc5d01418b0 0x7fc5d00b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.894+0000 7fc5cfe00640 1 -- 172.21.15.144:0/3301010637 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d00b3cf0 con 0x7fc5d00b2c70 2024-05-30T16:42:37.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.895+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/3301010637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00b2c70 0x7fc5d01625e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc5d006fe70 tx=0x7fc5c802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4c28bef0dff11a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:37.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.895+0000 7fc5ce000640 1 -- 172.21.15.144:0/3301010637 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8036070 con 0x7fc5d00b2c70 2024-05-30T16:42:37.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.895+0000 7fc5ce000640 1 -- 172.21.15.144:0/3301010637 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c8031600 con 0x7fc5d00b2c70 2024-05-30T16:42:37.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.895+0000 7fc5ce000640 1 -- 172.21.15.144:0/3301010637 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80319d0 con 0x7fc5d00b2c70 2024-05-30T16:42:37.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.896+0000 7fc5d4a00640 1 -- 172.21.15.144:0/3301010637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00b2c70 msgr2=0x7fc5d01625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.896+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/3301010637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00b2c70 0x7fc5d01625e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc5d006fe70 tx=0x7fc5c802a6a0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.896+0000 7fc5d4a00640 1 -- 172.21.15.144:0/3301010637 shutdown_connections 2024-05-30T16:42:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.896+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/3301010637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00b2c70 0x7fc5d01625e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.896+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/3301010637 >> v2:172.21.15.149:3300/0 conn(0x7fc5d01418b0 0x7fc5d00b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.896+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/3301010637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d01414d0 0x7fc5d0141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.896+0000 7fc5d4a00640 1 -- 172.21.15.144:0/3301010637 >> 172.21.15.144:0/3301010637 conn(0x7fc5d00627b0 msgr2=0x7fc5d006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.896+0000 7fc5d4a00640 1 -- 172.21.15.144:0/3301010637 shutdown_connections 2024-05-30T16:42:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.896+0000 7fc5d4a00640 1 -- 172.21.15.144:0/3301010637 wait complete. 2024-05-30T16:42:37.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.898+0000 7fc5d4a00640 1 Processor -- start 2024-05-30T16:42:37.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.898+0000 7fc5d4a00640 1 -- start start 2024-05-30T16:42:37.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.899+0000 7fc5d4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00b2c70 0x7fc5d0130b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.899+0000 7fc5d4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d01414d0 0x7fc5d0153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.899+0000 7fc5d4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d01418b0 0x7fc5d013ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.899+0000 7fc5d4a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0162ca0 con 0x7fc5d01418b0 2024-05-30T16:42:37.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.899+0000 7fc5d4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0162b20 con 0x7fc5d00b2c70 2024-05-30T16:42:37.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.899+0000 7fc5d4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d0162e20 con 0x7fc5d01414d0 2024-05-30T16:42:37.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.899+0000 7fc5cfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d01418b0 0x7fc5d013ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.899+0000 7fc5cfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d01418b0 0x7fc5d013ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39070/0 (socket says 172.21.15.144:39070) 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.899+0000 7fc5cfe00640 1 -- 172.21.15.144:0/4117146170 learned_addr learned my addr 172.21.15.144:0/4117146170 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.900+0000 7fc5cea00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d01414d0 0x7fc5d0153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.900+0000 7fc5cf400640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00b2c70 0x7fc5d0130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.900+0000 7fc5cfe00640 1 -- 172.21.15.144:0/4117146170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d01414d0 msgr2=0x7fc5d0153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.900+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d01414d0 0x7fc5d0153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.900+0000 7fc5cfe00640 1 -- 172.21.15.144:0/4117146170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00b2c70 msgr2=0x7fc5d0130b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.900+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00b2c70 0x7fc5d0130b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.900+0000 7fc5cfe00640 1 -- 172.21.15.144:0/4117146170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d0153e90 con 0x7fc5d01418b0 2024-05-30T16:42:37.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.900+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d01418b0 0x7fc5d013ef00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009f40 tx=0x7fc5c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:37.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.900+0000 7fc5c7400640 1 -- 172.21.15.144:0/4117146170 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8036050 con 0x7fc5d01418b0 2024-05-30T16:42:37.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.901+0000 7fc5c7400640 1 -- 172.21.15.144:0/4117146170 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c8042070 con 0x7fc5d01418b0 2024-05-30T16:42:37.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.901+0000 7fc5c7400640 1 -- 172.21.15.144:0/4117146170 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8009510 con 0x7fc5d01418b0 2024-05-30T16:42:37.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.901+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d0154170 con 0x7fc5d01418b0 2024-05-30T16:42:37.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.901+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d01310a0 con 0x7fc5d01418b0 2024-05-30T16:42:37.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.902+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d0075570 con 0x7fc5d01418b0 2024-05-30T16:42:37.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.903+0000 7fc5c7400640 1 -- 172.21.15.144:0/4117146170 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5c8007bd0 con 0x7fc5d01418b0 2024-05-30T16:42:37.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.904+0000 7fc5c7400640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5b006c8f0 0x7fc5b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:37.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.904+0000 7fc5c7400640 1 -- 172.21.15.144:0/4117146170 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fc5c80ac880 con 0x7fc5d01418b0 2024-05-30T16:42:37.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.904+0000 7fc5cf400640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5b006c8f0 0x7fc5b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:37.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.905+0000 7fc5cf400640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5b006c8f0 0x7fc5b006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000a810 tx=0x7fc5c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:37.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:37.909+0000 7fc5c7400640 1 -- 172.21.15.144:0/4117146170 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5c807af60 con 0x7fc5d01418b0 2024-05-30T16:42:38.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.181+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fc5d015e500 con 0x7fc5d01418b0 2024-05-30T16:42:38.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.185+0000 7fc5c7400640 1 -- 172.21.15.144:0/4117146170 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fc5c807a860 con 0x7fc5d01418b0 2024-05-30T16:42:38.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.187+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5b006c8f0 msgr2=0x7fc5b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.187+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5b006c8f0 0x7fc5b006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000a810 tx=0x7fc5c0008040 comp rx=0 tx=0).stop 2024-05-30T16:42:38.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.187+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d01418b0 msgr2=0x7fc5d013ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.188+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d01418b0 0x7fc5d013ef00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009f40 tx=0x7fc5c8004a40 comp rx=0 tx=0).stop 2024-05-30T16:42:38.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.188+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 shutdown_connections 2024-05-30T16:42:38.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.188+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5b006c8f0 0x7fc5b006edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.188+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d01418b0 0x7fc5d013ef00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.188+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d01414d0 0x7fc5d0153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.188+0000 7fc5d4a00640 1 --2- 172.21.15.144:0/4117146170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00b2c70 0x7fc5d0130b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.188+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 >> 172.21.15.144:0/4117146170 conn(0x7fc5d00627b0 msgr2=0x7fc5d013d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:38.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.188+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 shutdown_connections 2024-05-30T16:42:38.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.188+0000 7fc5d4a00640 1 -- 172.21.15.144:0/4117146170 wait complete. 2024-05-30T16:42:38.207 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-30T16:42:38.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.402+0000 7f6545400640 1 Processor -- start 2024-05-30T16:42:38.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.402+0000 7f6545400640 1 -- start start 2024-05-30T16:42:38.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.404+0000 7f6545400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f65400cf890 0x7f6540167150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.404+0000 7f6545400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f654015d020 con 0x7f65400b2b70 2024-05-30T16:42:38.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.404+0000 7f6545400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f654015d300 con 0x7f654015cb20 2024-05-30T16:42:38.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.404+0000 7f6545400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f654015d5e0 con 0x7f65400cf890 2024-05-30T16:42:38.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.404+0000 7f653fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f65400b2b70 0x7f6540142710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33292/0 (socket says 172.21.15.144:33292) 2024-05-30T16:42:38.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.404+0000 7f653fe00640 1 -- 172.21.15.144:0/3526976989 learned_addr learned my addr 172.21.15.144:0/3526976989 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:38.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f6544a00640 1 --2- 172.21.15.144:0/3526976989 >> v2:172.21.15.149:3300/0 conn(0x7f65400cf890 0x7f6540167150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649108299 0 0) 0x7f654015d020 con 0x7f65400b2b70 2024-05-30T16:42:38.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6524003520 con 0x7f65400b2b70 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2372896614 0 0) 0x7f6524003520 con 0x7f65400b2b70 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 >> v2:172.21.15.149:3300/0 conn(0x7f65400cf890 msgr2=0x7f6540167150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 --2- 172.21.15.144:0/3526976989 >> v2:172.21.15.149:3300/0 conn(0x7f65400cf890 0x7f6540167150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 >> v1:172.21.15.149:6789/0 conn(0x7f654015cb20 legacy=0x7f65400cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654015d8c0 con 0x7f65400b2b70 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f6530001670 con 0x7f65400b2b70 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 >> v1:172.21.15.144:6789/0 conn(0x7f65400b2b70 legacy=0x7f6540142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65240039b0 0x7f6524003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6524004800 0x7f6524004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65240051c0 0x7f652400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f654015d5e0 con 0x7f65240039b0 2024-05-30T16:42:38.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f652400c060 con 0x7f65240051c0 2024-05-30T16:42:38.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f652400c260 con 0x7f6524004800 2024-05-30T16:42:38.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.405+0000 7f653fe00640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65240039b0 0x7f6524003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.406+0000 7f653fe00640 1 -- 172.21.15.144:0/3526976989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6524004800 msgr2=0x7f6524004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:38.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.406+0000 7f653f400640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6524004800 0x7f6524004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.406+0000 7f653fe00640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6524004800 0x7f6524004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.406+0000 7f653fe00640 1 -- 172.21.15.144:0/3526976989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65240051c0 msgr2=0x7f652400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:38.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.406+0000 7f653fe00640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65240051c0 0x7f652400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.406+0000 7f653fe00640 1 -- 172.21.15.144:0/3526976989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6524003520 con 0x7f65240039b0 2024-05-30T16:42:38.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.406+0000 7f6544a00640 1 -- 172.21.15.144:0/3526976989 reap_dead start 2024-05-30T16:42:38.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.407+0000 7f653fe00640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65240039b0 0x7f6524003dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f653000c240 tx=0x7f6524005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f09113c7c899eb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:38.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.407+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530007cf0 con 0x7f65240039b0 2024-05-30T16:42:38.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.407+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65300058d0 con 0x7f65240039b0 2024-05-30T16:42:38.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.407+0000 7f653ea00640 1 -- 172.21.15.144:0/3526976989 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530005d20 con 0x7f65240039b0 2024-05-30T16:42:38.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.408+0000 7f6545400640 1 -- 172.21.15.144:0/3526976989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65240039b0 msgr2=0x7f6524003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.408+0000 7f6545400640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65240039b0 0x7f6524003dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f653000c240 tx=0x7f6524005830 comp rx=0 tx=0).stop 2024-05-30T16:42:38.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.408+0000 7f6545400640 1 -- 172.21.15.144:0/3526976989 shutdown_connections 2024-05-30T16:42:38.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.408+0000 7f6545400640 1 --2- 172.21.15.144:0/3526976989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65240039b0 0x7f6524003dd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.408+0000 7f6545400640 1 -- 172.21.15.144:0/3526976989 >> 172.21.15.144:0/3526976989 conn(0x7f65400627b0 msgr2=0x7f654006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:38.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.408+0000 7f6545400640 1 -- 172.21.15.144:0/3526976989 shutdown_connections 2024-05-30T16:42:38.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.408+0000 7f6545400640 1 -- 172.21.15.144:0/3526976989 wait complete. 2024-05-30T16:42:38.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.410+0000 7f6545400640 1 Processor -- start 2024-05-30T16:42:38.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.410+0000 7f6545400640 1 -- start start 2024-05-30T16:42:38.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f6545400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65240039b0 0x7f654013e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f6545400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65400b4070 0x7f65400cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f6545400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65400cd8f0 0x7f65400cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f6545400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65400b30d0 con 0x7f65400b4070 2024-05-30T16:42:38.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f6545400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f65400b2f50 con 0x7f65400cd8f0 2024-05-30T16:42:38.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f6545400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f65400cf180 con 0x7f65240039b0 2024-05-30T16:42:38.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f653f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65400b4070 0x7f65400cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f653f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65400b4070 0x7f65400cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39080/0 (socket says 172.21.15.144:39080) 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f653f400640 1 -- 172.21.15.144:0/250074665 learned_addr learned my addr 172.21.15.144:0/250074665 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f653fe00640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65240039b0 0x7f654013e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f6544a00640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65400cd8f0 0x7f65400cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f653f400640 1 -- 172.21.15.144:0/250074665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65240039b0 msgr2=0x7f654013e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f653f400640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65240039b0 0x7f654013e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f653f400640 1 -- 172.21.15.144:0/250074665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65400cd8f0 msgr2=0x7f65400cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f653f400640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65400cd8f0 0x7f65400cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f653f400640 1 -- 172.21.15.144:0/250074665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654013ec80 con 0x7f65400b4070 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.411+0000 7f6544a00640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65400cd8f0 0x7f65400cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.412+0000 7f653f400640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65400b4070 0x7f65400cd3b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f652c00d3b0 tx=0x7f652c00d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.412+0000 7f6537e00640 1 -- 172.21.15.144:0/250074665 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c018070 con 0x7f65400b4070 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.412+0000 7f6537e00640 1 -- 172.21.15.144:0/250074665 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652c003610 con 0x7f65400b4070 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.412+0000 7f6537e00640 1 -- 172.21.15.144:0/250074665 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c003a00 con 0x7f65400b4070 2024-05-30T16:42:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.412+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65400b5240 con 0x7f65400b4070 2024-05-30T16:42:38.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.412+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6540157350 con 0x7f65400b4070 2024-05-30T16:42:38.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.413+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6540075570 con 0x7f65400b4070 2024-05-30T16:42:38.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.414+0000 7f6537e00640 1 -- 172.21.15.144:0/250074665 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f652c01b070 con 0x7f65400b4070 2024-05-30T16:42:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.415+0000 7f6537e00640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f652006c920 0x7f652006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.415+0000 7f6537e00640 1 -- 172.21.15.144:0/250074665 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f652c08af90 con 0x7f65400b4070 2024-05-30T16:42:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.415+0000 7f653fe00640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f652006c920 0x7f652006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.416+0000 7f653fe00640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f652006c920 0x7f652006ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6530033000 tx=0x7f6530009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:38.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.420+0000 7f6537e00640 1 -- 172.21.15.144:0/250074665 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f654013ec80 con 0x7f65400b4070 2024-05-30T16:42:38.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.671+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f65401562d0 con 0x7f65400b4070 2024-05-30T16:42:38.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.676+0000 7f6537e00640 1 -- 172.21.15.144:0/250074665 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f652c059020 con 0x7f65400b4070 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f652006c920 msgr2=0x7f652006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f652006c920 0x7f652006ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6530033000 tx=0x7f6530009030 comp rx=0 tx=0).stop 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65400b4070 msgr2=0x7f65400cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65400b4070 0x7f65400cd3b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f652c00d3b0 tx=0x7f652c00d870 comp rx=0 tx=0).stop 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 shutdown_connections 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f652006c920 0x7f652006ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65400cd8f0 0x7f65400cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65400b4070 0x7f65400cd3b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 --2- 172.21.15.144:0/250074665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65240039b0 0x7f654013e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 >> 172.21.15.144:0/250074665 conn(0x7f65400627b0 msgr2=0x7f654015e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:38.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.678+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 shutdown_connections 2024-05-30T16:42:38.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.679+0000 7f6545400640 1 -- 172.21.15.144:0/250074665 wait complete. 2024-05-30T16:42:38.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-30T16:42:38.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.890+0000 7f3dd1200640 1 Processor -- start 2024-05-30T16:42:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.890+0000 7f3dd1200640 1 -- start start 2024-05-30T16:42:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.892+0000 7f3dd1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0cd700 0x7f3dcc1425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.892+0000 7f3dd1200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dcc0ce510 con 0x7f3dcc0b4e90 2024-05-30T16:42:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.892+0000 7f3dd1200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dcc0ce7d0 con 0x7f3dcc141f20 2024-05-30T16:42:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.892+0000 7f3dd1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3dcc142300 con 0x7f3dcc0cd700 2024-05-30T16:42:38.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.892+0000 7f3dca800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3dcc0b4e90 0x7f3dcc0b5320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33294/0 (socket says 172.21.15.144:33294) 2024-05-30T16:42:38.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.892+0000 7f3dca800640 1 -- 172.21.15.144:0/2793362288 learned_addr learned my addr 172.21.15.144:0/2793362288 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:38.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.893+0000 7f3dc1400640 1 --2- 172.21.15.144:0/2793362288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0cd700 0x7f3dcc1425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.893+0000 7f3dc9400640 1 -- 172.21.15.144:0/2793362288 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806610401 0 0) 0x7f3dcc0ce510 con 0x7f3dcc0b4e90 2024-05-30T16:42:38.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.893+0000 7f3dc9400640 1 -- 172.21.15.144:0/2793362288 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3db0003520 con 0x7f3dcc0b4e90 2024-05-30T16:42:38.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.893+0000 7f3dc1400640 1 -- 172.21.15.144:0/2793362288 >> v1:172.21.15.149:6789/0 conn(0x7f3dcc141f20 legacy=0x7f3dcc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.893+0000 7f3dc1400640 1 -- 172.21.15.144:0/2793362288 >> v1:172.21.15.144:6789/0 conn(0x7f3dcc0b4e90 legacy=0x7f3dcc0b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.893+0000 7f3dc1400640 1 -- 172.21.15.144:0/2793362288 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc0ceab0 con 0x7f3dcc0cd700 2024-05-30T16:42:38.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.895+0000 7f3dc1400640 1 --2- 172.21.15.144:0/2793362288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0cd700 0x7f3dcc1425b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3db40097d0 tx=0x7f3db402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d41cc574095ed998 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:38.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.895+0000 7f3dc9400640 1 -- 172.21.15.144:0/2793362288 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4037070 con 0x7f3dcc0cd700 2024-05-30T16:42:38.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.895+0000 7f3dc9400640 1 -- 172.21.15.144:0/2793362288 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db4032440 con 0x7f3dcc0cd700 2024-05-30T16:42:38.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.895+0000 7f3dc9400640 1 -- 172.21.15.144:0/2793362288 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4032810 con 0x7f3dcc0cd700 2024-05-30T16:42:38.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.896+0000 7f3dd1200640 1 -- 172.21.15.144:0/2793362288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0cd700 msgr2=0x7f3dcc1425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.896+0000 7f3dd1200640 1 --2- 172.21.15.144:0/2793362288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0cd700 0x7f3dcc1425b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3db40097d0 tx=0x7f3db402a180 comp rx=0 tx=0).stop 2024-05-30T16:42:38.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.896+0000 7f3dd1200640 1 -- 172.21.15.144:0/2793362288 shutdown_connections 2024-05-30T16:42:38.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.896+0000 7f3dd1200640 1 --2- 172.21.15.144:0/2793362288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0cd700 0x7f3dcc1425b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.896+0000 7f3dd1200640 1 -- 172.21.15.144:0/2793362288 >> 172.21.15.144:0/2793362288 conn(0x7f3dcc0629c0 msgr2=0x7f3dcc06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:38.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.896+0000 7f3dd1200640 1 -- 172.21.15.144:0/2793362288 shutdown_connections 2024-05-30T16:42:38.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.896+0000 7f3dd1200640 1 -- 172.21.15.144:0/2793362288 wait complete. 2024-05-30T16:42:38.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.898+0000 7f3dd1200640 1 Processor -- start 2024-05-30T16:42:38.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.898+0000 7f3dd1200640 1 -- start start 2024-05-30T16:42:38.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.899+0000 7f3dd1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0b4e90 0x7f3dcc1e79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.899+0000 7f3dd1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dcc0cd700 0x7f3dcc1e8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.899+0000 7f3dd1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc141f20 0x7f3dcc1e8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.899+0000 7f3dd1200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc0cf590 con 0x7f3dcc141f20 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.899+0000 7f3dd1200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc0cf100 con 0x7f3dcc0cd700 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.899+0000 7f3dd1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3dcc0cf710 con 0x7f3dcc0b4e90 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.899+0000 7f3dca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc141f20 0x7f3dcc1e8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.899+0000 7f3dca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc141f20 0x7f3dcc1e8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39082/0 (socket says 172.21.15.144:39082) 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.899+0000 7f3dca800640 1 -- 172.21.15.144:0/437145515 learned_addr learned my addr 172.21.15.144:0/437145515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dc1400640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dcc0cd700 0x7f3dcc1e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dca800640 1 -- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0b4e90 msgr2=0x7f3dcc1e79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dc9e00640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0b4e90 0x7f3dcc1e79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dca800640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0b4e90 0x7f3dcc1e79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dca800640 1 -- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dcc0cd700 msgr2=0x7f3dcc1e8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dca800640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dcc0cd700 0x7f3dcc1e8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dca800640 1 -- 172.21.15.144:0/437145515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc1e56c0 con 0x7f3dcc141f20 2024-05-30T16:42:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dc1400640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dcc0cd700 0x7f3dcc1e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:38.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dc9e00640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0b4e90 0x7f3dcc1e79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:38.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dca800640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc141f20 0x7f3dcc1e8ac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400cb40 tx=0x7f3dc400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:38.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dc2a00640 1 -- 172.21.15.144:0/437145515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4017070 con 0x7f3dcc141f20 2024-05-30T16:42:38.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dc2a00640 1 -- 172.21.15.144:0/437145515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc400aca0 con 0x7f3dcc141f20 2024-05-30T16:42:38.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dcc1e9790 con 0x7f3dcc141f20 2024-05-30T16:42:38.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.900+0000 7f3dc2a00640 1 -- 172.21.15.144:0/437145515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4012620 con 0x7f3dcc141f20 2024-05-30T16:42:38.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.901+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dcc1e9d50 con 0x7f3dcc141f20 2024-05-30T16:42:38.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.902+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dcc1e5890 con 0x7f3dcc141f20 2024-05-30T16:42:38.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.903+0000 7f3dc2a00640 1 -- 172.21.15.144:0/437145515 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3dc401a070 con 0x7f3dcc141f20 2024-05-30T16:42:38.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.904+0000 7f3dc2a00640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3da806c8f0 0x7f3da806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:38.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.904+0000 7f3dc2a00640 1 -- 172.21.15.144:0/437145515 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f3dc408b620 con 0x7f3dcc141f20 2024-05-30T16:42:38.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.904+0000 7f3dc9e00640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3da806c8f0 0x7f3da806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:38.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.905+0000 7f3dc9e00640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3da806c8f0 0x7f3da806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0015e0 tx=0x7f3dbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:38.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:38.909+0000 7f3dc2a00640 1 -- 172.21.15.144:0/437145515 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3dc4059e30 con 0x7f3dcc141f20 2024-05-30T16:42:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.183+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f3dcc068b20 con 0x7f3dcc141f20 2024-05-30T16:42:39.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.187+0000 7f3dc2a00640 1 -- 172.21.15.144:0/437145515 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f3dc4059730 con 0x7f3dcc141f20 2024-05-30T16:42:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.190+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3da806c8f0 msgr2=0x7f3da806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.190+0000 7f3dd1200640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3da806c8f0 0x7f3da806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0015e0 tx=0x7f3dbc009040 comp rx=0 tx=0).stop 2024-05-30T16:42:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.190+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc141f20 msgr2=0x7f3dcc1e8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.190+0000 7f3dd1200640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc141f20 0x7f3dcc1e8ac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400cb40 tx=0x7f3dc400a060 comp rx=0 tx=0).stop 2024-05-30T16:42:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.191+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 shutdown_connections 2024-05-30T16:42:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.191+0000 7f3dd1200640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3da806c8f0 0x7f3da806edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.191+0000 7f3dd1200640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc141f20 0x7f3dcc1e8ac0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.191+0000 7f3dd1200640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dcc0cd700 0x7f3dcc1e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.191+0000 7f3dd1200640 1 --2- 172.21.15.144:0/437145515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dcc0b4e90 0x7f3dcc1e79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.191+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 >> 172.21.15.144:0/437145515 conn(0x7f3dcc0629c0 msgr2=0x7f3dcc0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:39.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.191+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 shutdown_connections 2024-05-30T16:42:39.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.191+0000 7f3dd1200640 1 -- 172.21.15.144:0/437145515 wait complete. 2024-05-30T16:42:39.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:42:39.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.399+0000 7fd67b200640 1 Processor -- start 2024-05-30T16:42:39.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.399+0000 7fd67b200640 1 -- start start 2024-05-30T16:42:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.401+0000 7fd67b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd67c162d70 0x7fd67c06b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.401+0000 7fd67b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd67c166930 con 0x7fd67c06be20 2024-05-30T16:42:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.401+0000 7fd67b200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd67c166c10 con 0x7fd67c162990 2024-05-30T16:42:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.401+0000 7fd67b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd67c1666e0 con 0x7fd67c162d70 2024-05-30T16:42:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.401+0000 7fd67a800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd67c06be20 0x7fd67c0b3df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33310/0 (socket says 172.21.15.144:33310) 2024-05-30T16:42:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.401+0000 7fd67a800640 1 -- 172.21.15.144:0/3764897113 learned_addr learned my addr 172.21.15.144:0/3764897113 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.401+0000 7fd679400640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd67c162d70 0x7fd67c06b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.401+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279987237 0 0) 0x7fd67c166930 con 0x7fd67c06be20 2024-05-30T16:42:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd660003520 con 0x7fd67c06be20 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 476213237 0 0) 0x7fd660003520 con 0x7fd67c06be20 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd67c162d70 msgr2=0x7fd67c06b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd67c162d70 0x7fd67c06b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 >> v1:172.21.15.149:6789/0 conn(0x7fd67c162990 legacy=0x7fd67c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c166ef0 con 0x7fd67c06be20 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fd6740019f0 con 0x7fd67c06be20 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 >> v1:172.21.15.144:6789/0 conn(0x7fd67c06be20 legacy=0x7fd67c0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6600039e0 0x7fd660003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6600043b0 0x7fd660004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd660005080 0x7fd66000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c1666e0 con 0x7fd660005080 2024-05-30T16:42:39.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd66000bf00 con 0x7fd6600043b0 2024-05-30T16:42:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.402+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd66000c100 con 0x7fd6600039e0 2024-05-30T16:42:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.403+0000 7fd67a800640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd660005080 0x7fd66000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.403+0000 7fd679400640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6600043b0 0x7fd660004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.403+0000 7fd679e00640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6600039e0 0x7fd660003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.403+0000 7fd67a800640 1 -- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6600039e0 msgr2=0x7fd660003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.403+0000 7fd67a800640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6600039e0 0x7fd660003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.403+0000 7fd67a800640 1 -- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6600043b0 msgr2=0x7fd660004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.403+0000 7fd67a800640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6600043b0 0x7fd660004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.403+0000 7fd67a800640 1 -- 172.21.15.144:0/3764897113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd660003520 con 0x7fd660005080 2024-05-30T16:42:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.404+0000 7fd67a800640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd660005080 0x7fd66000b9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd67400a770 tx=0x7fd660005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf7fb1e3132a36a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.404+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67400a390 con 0x7fd660005080 2024-05-30T16:42:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.404+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67402f070 con 0x7fd660005080 2024-05-30T16:42:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.404+0000 7fd678a00640 1 -- 172.21.15.144:0/3764897113 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67402bbe0 con 0x7fd660005080 2024-05-30T16:42:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.405+0000 7fd67b200640 1 -- 172.21.15.144:0/3764897113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd660005080 msgr2=0x7fd66000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.405+0000 7fd67b200640 1 --2- 172.21.15.144:0/3764897113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd660005080 0x7fd66000b9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd67400a770 tx=0x7fd660005830 comp rx=0 tx=0).stop 2024-05-30T16:42:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.405+0000 7fd67a800640 1 -- 172.21.15.144:0/3764897113 reap_dead start 2024-05-30T16:42:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.405+0000 7fd67b200640 1 -- 172.21.15.144:0/3764897113 shutdown_connections 2024-05-30T16:42:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.405+0000 7fd67b200640 1 -- 172.21.15.144:0/3764897113 >> 172.21.15.144:0/3764897113 conn(0x7fd67c0b20a0 msgr2=0x7fd67c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.405+0000 7fd67b200640 1 -- 172.21.15.144:0/3764897113 shutdown_connections 2024-05-30T16:42:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.405+0000 7fd67b200640 1 -- 172.21.15.144:0/3764897113 wait complete. 2024-05-30T16:42:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.406+0000 7fd67b200640 1 Processor -- start 2024-05-30T16:42:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.407+0000 7fd67b200640 1 -- start start 2024-05-30T16:42:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.407+0000 7fd67b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd660005080 0x7fd67c1f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.407+0000 7fd67b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd67c163660 0x7fd67c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.407+0000 7fd67b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd67c06ed30 0x7fd67c06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.407+0000 7fd67b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c06c260 con 0x7fd67c06ed30 2024-05-30T16:42:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.407+0000 7fd67b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c167540 con 0x7fd660005080 2024-05-30T16:42:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.407+0000 7fd67b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd67c0cf140 con 0x7fd67c163660 2024-05-30T16:42:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.408+0000 7fd67a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd67c06ed30 0x7fd67c06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.408+0000 7fd67a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd67c06ed30 0x7fd67c06f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39098/0 (socket says 172.21.15.144:39098) 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.408+0000 7fd67a800640 1 -- 172.21.15.144:0/1643760420 learned_addr learned my addr 172.21.15.144:0/1643760420 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.408+0000 7fd67a800640 1 -- 172.21.15.144:0/1643760420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd67c163660 msgr2=0x7fd67c15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.408+0000 7fd67a800640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd67c163660 0x7fd67c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.408+0000 7fd67a800640 1 -- 172.21.15.144:0/1643760420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd660005080 msgr2=0x7fd67c1f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.408+0000 7fd67a800640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd660005080 0x7fd67c1f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.408+0000 7fd67a800640 1 -- 172.21.15.144:0/1643760420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c163b40 con 0x7fd67c06ed30 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.408+0000 7fd67a800640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd67c06ed30 0x7fd67c06f1e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd67400a890 tx=0x7fd67c166de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.409+0000 7fd672000640 1 -- 172.21.15.144:0/1643760420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67402bb90 con 0x7fd67c06ed30 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.409+0000 7fd672000640 1 -- 172.21.15.144:0/1643760420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67402bd30 con 0x7fd67c06ed30 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.409+0000 7fd672000640 1 -- 172.21.15.144:0/1643760420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674034670 con 0x7fd67c06ed30 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.409+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c15fc10 con 0x7fd67c06ed30 2024-05-30T16:42:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.409+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c1601d0 con 0x7fd67c06ed30 2024-05-30T16:42:39.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.410+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c1603d0 con 0x7fd67c06ed30 2024-05-30T16:42:39.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.411+0000 7fd672000640 1 -- 172.21.15.144:0/1643760420 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd674034810 con 0x7fd67c06ed30 2024-05-30T16:42:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.412+0000 7fd672000640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd65c06c920 0x7fd65c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.412+0000 7fd672000640 1 -- 172.21.15.144:0/1643760420 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fd6740ab290 con 0x7fd67c06ed30 2024-05-30T16:42:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.412+0000 7fd679e00640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd65c06c920 0x7fd65c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.413+0000 7fd679e00640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd65c06c920 0x7fd65c06ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd66c001640 tx=0x7fd66c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:39.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.419+0000 7fd672000640 1 -- 172.21.15.144:0/1643760420 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd67c1603d0 con 0x7fd67c06ed30 2024-05-30T16:42:39.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.608+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd67c075570 con 0x7fd67c06ed30 2024-05-30T16:42:39.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.609+0000 7fd672000640 1 -- 172.21.15.144:0/1643760420 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7fd674079970 con 0x7fd67c06ed30 2024-05-30T16:42:39.609 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:39.609 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:42:39.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:39.609 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-05-30T16:42:39.609 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-05-30T16:42:39.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:39.610 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.611+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd65c06c920 msgr2=0x7fd65c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.611+0000 7fd67b200640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd65c06c920 0x7fd65c06ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd66c001640 tx=0x7fd66c009040 comp rx=0 tx=0).stop 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.611+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd67c06ed30 msgr2=0x7fd67c06f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.611+0000 7fd67b200640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd67c06ed30 0x7fd67c06f1e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd67400a890 tx=0x7fd67c166de0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.612+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 shutdown_connections 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.612+0000 7fd67b200640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd65c06c920 0x7fd65c06ede0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.612+0000 7fd67b200640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd67c06ed30 0x7fd67c06f1e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.612+0000 7fd67b200640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd67c163660 0x7fd67c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.612+0000 7fd67b200640 1 --2- 172.21.15.144:0/1643760420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd660005080 0x7fd67c1f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.612+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 >> 172.21.15.144:0/1643760420 conn(0x7fd67c0b20a0 msgr2=0x7fd67c0cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.612+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 shutdown_connections 2024-05-30T16:42:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.612+0000 7fd67b200640 1 -- 172.21.15.144:0/1643760420 wait complete. 2024-05-30T16:42:39.629 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:42:39.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:42:39.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.831+0000 7fc3abe00640 1 Processor -- start 2024-05-30T16:42:39.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.831+0000 7fc3abe00640 1 -- start start 2024-05-30T16:42:39.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.832+0000 7fc3abe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 0x7fc3ac0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.832+0000 7fc3abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc3ac0b06d0 0x7fc3ac0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.832+0000 7fc3abe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3ac06b8e0 0x7fc3ac06bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.832+0000 7fc3abe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc3ac1622b0 con 0x7fc3ac0b06d0 2024-05-30T16:42:39.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.832+0000 7fc3abe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc3ac0b48e0 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.832+0000 7fc3abe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ac0b2df0 con 0x7fc3ac161ed0 2024-05-30T16:42:39.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.832+0000 7fc3a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc3ac0b06d0 0x7fc3ac0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.833+0000 7fc3a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc3ac0b06d0 0x7fc3ac0b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39102/0 (socket says 172.21.15.144:39102) 2024-05-30T16:42:39.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.833+0000 7fc3a3e00640 1 -- 172.21.15.144:0/751385046 learned_addr learned my addr 172.21.15.144:0/751385046 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:39.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.833+0000 7fc3ab400640 1 --2- 172.21.15.144:0/751385046 >> v2:172.21.15.149:3300/0 conn(0x7fc3ac06b8e0 0x7fc3ac06bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.833+0000 7fc3aaa00640 1 --2- 172.21.15.144:0/751385046 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 0x7fc3ac0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.833+0000 7fc3a3e00640 1 -- 172.21.15.144:0/751385046 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 msgr2=0x7fc3ac0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:39.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.833+0000 7fc3a3e00640 1 --2- 172.21.15.144:0/751385046 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 0x7fc3ac0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.833+0000 7fc3a3e00640 1 -- 172.21.15.144:0/751385046 >> v2:172.21.15.149:3300/0 conn(0x7fc3ac06b8e0 msgr2=0x7fc3ac06bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:39.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.833+0000 7fc3a3e00640 1 --2- 172.21.15.144:0/751385046 >> v2:172.21.15.149:3300/0 conn(0x7fc3ac06b8e0 0x7fc3ac06bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.833+0000 7fc3a3e00640 1 -- 172.21.15.144:0/751385046 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac0b5f10 con 0x7fc3ac0b06d0 2024-05-30T16:42:39.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.834+0000 7fc3a3e00640 1 --2- 172.21.15.144:0/751385046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac0b06d0 0x7fc3ac0b28b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac062ec0 tx=0x7fc39402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2082b9ac4af7e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:39.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3aa000640 1 -- 172.21.15.144:0/751385046 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394037070 con 0x7fc3ac0b06d0 2024-05-30T16:42:39.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3aa000640 1 -- 172.21.15.144:0/751385046 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc394032440 con 0x7fc3ac0b06d0 2024-05-30T16:42:39.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3aa000640 1 -- 172.21.15.144:0/751385046 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394032810 con 0x7fc3ac0b06d0 2024-05-30T16:42:39.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3abe00640 1 -- 172.21.15.144:0/751385046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac0b06d0 msgr2=0x7fc3ac0b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3abe00640 1 --2- 172.21.15.144:0/751385046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac0b06d0 0x7fc3ac0b28b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac062ec0 tx=0x7fc39402a200 comp rx=0 tx=0).stop 2024-05-30T16:42:39.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3abe00640 1 -- 172.21.15.144:0/751385046 shutdown_connections 2024-05-30T16:42:39.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3abe00640 1 --2- 172.21.15.144:0/751385046 >> v2:172.21.15.149:3300/0 conn(0x7fc3ac06b8e0 0x7fc3ac06bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3abe00640 1 --2- 172.21.15.144:0/751385046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac0b06d0 0x7fc3ac0b28b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3abe00640 1 --2- 172.21.15.144:0/751385046 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 0x7fc3ac0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3abe00640 1 -- 172.21.15.144:0/751385046 >> 172.21.15.144:0/751385046 conn(0x7fc3ac0b67d0 msgr2=0x7fc3ac0b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:39.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3abe00640 1 -- 172.21.15.144:0/751385046 shutdown_connections 2024-05-30T16:42:39.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.835+0000 7fc3abe00640 1 -- 172.21.15.144:0/751385046 wait complete. 2024-05-30T16:42:39.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.837+0000 7fc3abe00640 1 Processor -- start 2024-05-30T16:42:39.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.837+0000 7fc3abe00640 1 -- start start 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.838+0000 7fc3abe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac06b8e0 0x7fc3ac1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.838+0000 7fc3abe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ac0b06d0 0x7fc3ac09edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.838+0000 7fc3abe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 0x7fc3ac0ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.838+0000 7fc3abe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac0b64b0 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.838+0000 7fc3abe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac0b61d0 con 0x7fc3ac0b06d0 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.838+0000 7fc3abe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ac0b4570 con 0x7fc3ac161ed0 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.838+0000 7fc3aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac06b8e0 0x7fc3ac1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.838+0000 7fc3aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac06b8e0 0x7fc3ac1584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39118/0 (socket says 172.21.15.144:39118) 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3aaa00640 1 -- 172.21.15.144:0/2141756855 learned_addr learned my addr 172.21.15.144:0/2141756855 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3a3e00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ac0b06d0 0x7fc3ac09edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3ab400640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 0x7fc3ac0ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3aaa00640 1 -- 172.21.15.144:0/2141756855 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 msgr2=0x7fc3ac0ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3aaa00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 0x7fc3ac0ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3aaa00640 1 -- 172.21.15.144:0/2141756855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ac0b06d0 msgr2=0x7fc3ac09edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:39.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3aaa00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ac0b06d0 0x7fc3ac09edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:39.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3aaa00640 1 -- 172.21.15.144:0/2141756855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac09dd50 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3aaa00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac06b8e0 0x7fc3ac1584a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00d5f0 tx=0x7fc39c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:39.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.839+0000 7fc3a2a00640 1 -- 172.21.15.144:0/2141756855 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0125f0 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.840+0000 7fc3a2a00640 1 -- 172.21.15.144:0/2141756855 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39c019070 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.840+0000 7fc3a2a00640 1 -- 172.21.15.144:0/2141756855 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0129d0 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.840+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ac09e030 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.840+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ac09e5f0 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.841+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ac075570 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.842+0000 7fc3a2a00640 1 -- 172.21.15.144:0/2141756855 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc39c012b70 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.843+0000 7fc3a2a00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc38806c8f0 0x7fc38806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:39.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.843+0000 7fc3a2a00640 1 -- 172.21.15.144:0/2141756855 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fc39c08bba0 con 0x7fc3ac06b8e0 2024-05-30T16:42:39.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.843+0000 7fc3a3e00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc38806c8f0 0x7fc38806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:39.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.844+0000 7fc3a3e00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc38806c8f0 0x7fc38806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc394034000 tx=0x7fc39402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:39.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:39.847+0000 7fc3a2a00640 1 -- 172.21.15.144:0/2141756855 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc39c05a320 con 0x7fc3ac06b8e0 2024-05-30T16:42:40.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.048+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc3ac0b7280 con 0x7fc3ac06b8e0 2024-05-30T16:42:40.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.683+0000 7fc3a2a00640 1 -- 172.21.15.144:0/2141756855 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7fc39c059c20 con 0x7fc3ac06b8e0 2024-05-30T16:42:40.684 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-05-30T16:42:40.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc38806c8f0 msgr2=0x7fc38806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc38806c8f0 0x7fc38806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc394034000 tx=0x7fc39402e000 comp rx=0 tx=0).stop 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac06b8e0 msgr2=0x7fc3ac1584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac06b8e0 0x7fc3ac1584a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00d5f0 tx=0x7fc39c00dab0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 shutdown_connections 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc38806c8f0 0x7fc38806edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ac161ed0 0x7fc3ac0ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ac0b06d0 0x7fc3ac09edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 --2- 172.21.15.144:0/2141756855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3ac06b8e0 0x7fc3ac1584a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.687+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 >> 172.21.15.144:0/2141756855 conn(0x7fc3ac0b67d0 msgr2=0x7fc3ac0b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.688+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 shutdown_connections 2024-05-30T16:42:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.688+0000 7fc3abe00640 1 -- 172.21.15.144:0/2141756855 wait complete. 2024-05-30T16:42:40.712 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:42:40.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.908+0000 7f64ed600640 1 Processor -- start 2024-05-30T16:42:40.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.908+0000 7f64ed600640 1 -- start start 2024-05-30T16:42:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.910+0000 7f64ed600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64e815c780 0x7f64e806f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.910+0000 7f64ed600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f64e806f550 0x7f64e80d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64ed600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e8073890 con 0x7f64e815b780 2024-05-30T16:42:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64ed600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f64e80d0e50 con 0x7f64e806f550 2024-05-30T16:42:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64ed600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f64e806f990 con 0x7f64e815c780 2024-05-30T16:42:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64e6a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f64e815b780 0x7f64e80b6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33316/0 (socket says 172.21.15.144:33316) 2024-05-30T16:42:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64e6a00640 1 -- 172.21.15.144:0/1490404336 learned_addr learned my addr 172.21.15.144:0/1490404336 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64e7400640 1 --2- 172.21.15.144:0/1490404336 >> v2:172.21.15.144:3300/0 conn(0x7f64e806f550 0x7f64e80d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64de000640 1 --2- 172.21.15.144:0/1490404336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64e815c780 0x7f64e806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64e6000640 1 -- 172.21.15.144:0/1490404336 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935349188 0 0) 0x7f64e8073890 con 0x7f64e815b780 2024-05-30T16:42:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64e6000640 1 -- 172.21.15.144:0/1490404336 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64cc003520 con 0x7f64e815b780 2024-05-30T16:42:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64e7400640 1 -- 172.21.15.144:0/1490404336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64e815c780 msgr2=0x7f64e806f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64e7400640 1 --2- 172.21.15.144:0/1490404336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64e815c780 0x7f64e806f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64e7400640 1 -- 172.21.15.144:0/1490404336 >> v1:172.21.15.144:6789/0 conn(0x7f64e815b780 legacy=0x7f64e80b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.911+0000 7f64e7400640 1 -- 172.21.15.144:0/1490404336 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e8073b70 con 0x7f64e806f550 2024-05-30T16:42:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.912+0000 7f64e7400640 1 --2- 172.21.15.144:0/1490404336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e806f550 0x7f64e80d1050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009d90 tx=0x7f64e002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2a4f0768ae7ff2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.913+0000 7f64e6000640 1 -- 172.21.15.144:0/1490404336 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0031600 con 0x7f64e806f550 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.913+0000 7f64e6000640 1 -- 172.21.15.144:0/1490404336 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e00317a0 con 0x7f64e806f550 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.913+0000 7f64e6000640 1 -- 172.21.15.144:0/1490404336 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0031b50 con 0x7f64e806f550 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.913+0000 7f64ed600640 1 -- 172.21.15.144:0/1490404336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e806f550 msgr2=0x7f64e80d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.913+0000 7f64ed600640 1 --2- 172.21.15.144:0/1490404336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e806f550 0x7f64e80d1050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009d90 tx=0x7f64e002a5d0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.914+0000 7f64ed600640 1 -- 172.21.15.144:0/1490404336 shutdown_connections 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.914+0000 7f64ed600640 1 --2- 172.21.15.144:0/1490404336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e806f550 0x7f64e80d1050 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.914+0000 7f64ed600640 1 --2- 172.21.15.144:0/1490404336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64e815c780 0x7f64e806f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.914+0000 7f64ed600640 1 -- 172.21.15.144:0/1490404336 >> 172.21.15.144:0/1490404336 conn(0x7f64e80b6c10 msgr2=0x7f64e80b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.914+0000 7f64ed600640 1 -- 172.21.15.144:0/1490404336 shutdown_connections 2024-05-30T16:42:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.914+0000 7f64ed600640 1 -- 172.21.15.144:0/1490404336 wait complete. 2024-05-30T16:42:40.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.915+0000 7f64ed600640 1 Processor -- start 2024-05-30T16:42:40.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.916+0000 7f64ed600640 1 -- start start 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.916+0000 7f64ed600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64e806f550 0x7f64e80aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.916+0000 7f64ed600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e815b780 0x7f64e814eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.916+0000 7f64ed600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64e815c780 0x7f64e815a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.916+0000 7f64ed600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f64e815cc10 con 0x7f64e815b780 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64ed600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f64e815bf80 con 0x7f64e806f550 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64ed600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f64e815cd90 con 0x7f64e815c780 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64de000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e815b780 0x7f64e814eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64de000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e815b780 0x7f64e814eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39146/0 (socket says 172.21.15.144:39146) 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64de000640 1 -- 172.21.15.144:0/4183515769 learned_addr learned my addr 172.21.15.144:0/4183515769 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64e6a00640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64e806f550 0x7f64e80aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64de000640 1 -- 172.21.15.144:0/4183515769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64e815c780 msgr2=0x7f64e815a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64de000640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64e815c780 0x7f64e815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64de000640 1 -- 172.21.15.144:0/4183515769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64e806f550 msgr2=0x7f64e80aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64de000640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64e806f550 0x7f64e80aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64de000640 1 -- 172.21.15.144:0/4183515769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e814f3f0 con 0x7f64e815b780 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.917+0000 7f64de000640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e815b780 0x7f64e814eeb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64d000d830 tx=0x7f64d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.918+0000 7f64df400640 1 -- 172.21.15.144:0/4183515769 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d000b6c0 con 0x7f64e815b780 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.918+0000 7f64df400640 1 -- 172.21.15.144:0/4183515769 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d0019070 con 0x7f64e815b780 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.918+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e8156980 con 0x7f64e815b780 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.918+0000 7f64df400640 1 -- 172.21.15.144:0/4183515769 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d000ba80 con 0x7f64e815b780 2024-05-30T16:42:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.918+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e8156f40 con 0x7f64e815b780 2024-05-30T16:42:40.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.919+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e8068b90 con 0x7f64e815b780 2024-05-30T16:42:40.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.920+0000 7f64df400640 1 -- 172.21.15.144:0/4183515769 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64d001e460 con 0x7f64e815b780 2024-05-30T16:42:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.921+0000 7f64df400640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f64c406c8f0 0x7f64c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.921+0000 7f64df400640 1 -- 172.21.15.144:0/4183515769 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7f64d008c0f0 con 0x7f64e815b780 2024-05-30T16:42:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.921+0000 7f64e6a00640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f64c406c8f0 0x7f64c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:40.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.922+0000 7f64e6a00640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f64c406c8f0 0x7f64c406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f64d8000f60 tx=0x7f64d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:40.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:40.926+0000 7f64df400640 1 -- 172.21.15.144:0/4183515769 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64d005a660 con 0x7f64e815b780 2024-05-30T16:42:41.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.128+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f64e8159b10 con 0x7f64e815b780 2024-05-30T16:42:41.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.712+0000 7f64df400640 1 -- 172.21.15.144:0/4183515769 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7f64d0059f60 con 0x7f64e815b780 2024-05-30T16:42:41.713 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f64c406c8f0 msgr2=0x7f64c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f64c406c8f0 0x7f64c406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f64d8000f60 tx=0x7f64d8009040 comp rx=0 tx=0).stop 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e815b780 msgr2=0x7f64e814eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e815b780 0x7f64e814eeb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64d000d830 tx=0x7f64d000dcf0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 shutdown_connections 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f64c406c8f0 0x7f64c406edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64e815c780 0x7f64e815a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64e815b780 0x7f64e814eeb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 --2- 172.21.15.144:0/4183515769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64e806f550 0x7f64e80aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.716+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 >> 172.21.15.144:0/4183515769 conn(0x7f64e80b6c10 msgr2=0x7f64e806d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.717+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 shutdown_connections 2024-05-30T16:42:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.717+0000 7f64ed600640 1 -- 172.21.15.144:0/4183515769 wait complete. 2024-05-30T16:42:41.749 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:42:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.924+0000 7f250b000640 1 Processor -- start 2024-05-30T16:42:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.924+0000 7f250b000640 1 -- start start 2024-05-30T16:42:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.925+0000 7f250b000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2504144e70 0x7f250406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.925+0000 7f250b000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25040b49d0 0x7f2504162480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.925+0000 7f250b000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25040b3500 con 0x7f2504147cc0 2024-05-30T16:42:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.925+0000 7f250b000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2504145250 con 0x7f2504144e70 2024-05-30T16:42:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.925+0000 7f250b000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f25040b3e30 con 0x7f25040b49d0 2024-05-30T16:42:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f2509c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2504144e70 0x7f250406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f2509c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2504144e70 0x7f250406dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39148/0 (socket says 172.21.15.144:39148) 2024-05-30T16:42:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f2509c00640 1 -- 172.21.15.144:0/2200357999 learned_addr learned my addr 172.21.15.144:0/2200357999 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f2509200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2504147cc0 0x7f25040b42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33322/0 (socket says 172.21.15.144:33322) 2024-05-30T16:42:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f250a600640 1 --2- 172.21.15.144:0/2200357999 >> v2:172.21.15.149:3300/0 conn(0x7f25040b49d0 0x7f2504162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f2509c00640 1 -- 172.21.15.144:0/2200357999 >> v2:172.21.15.149:3300/0 conn(0x7f25040b49d0 msgr2=0x7f2504162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f2509c00640 1 --2- 172.21.15.144:0/2200357999 >> v2:172.21.15.149:3300/0 conn(0x7f25040b49d0 0x7f2504162480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f2509c00640 1 -- 172.21.15.144:0/2200357999 >> v1:172.21.15.144:6789/0 conn(0x7f2504147cc0 legacy=0x7f25040b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f2509c00640 1 -- 172.21.15.144:0/2200357999 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25040b37e0 con 0x7f2504144e70 2024-05-30T16:42:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f2503e00640 1 -- 172.21.15.144:0/2200357999 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105673002 0 0) 0x7f25040b3500 con 0x7f2504147cc0 2024-05-30T16:42:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.926+0000 7f250a600640 1 --2- 172.21.15.144:0/2200357999 >> v2:172.21.15.149:3300/0 conn(0x7f25040b49d0 0x7f2504162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:41.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.927+0000 7f2509c00640 1 --2- 172.21.15.144:0/2200357999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 0x7f250406dd30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25040b20f0 tx=0x7f24f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce24ce80ec53183b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.928+0000 7f2503e00640 1 -- 172.21.15.144:0/2200357999 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4037070 con 0x7f2504144e70 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.928+0000 7f2503e00640 1 -- 172.21.15.144:0/2200357999 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f4032440 con 0x7f2504144e70 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.928+0000 7f2503e00640 1 -- 172.21.15.144:0/2200357999 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4032810 con 0x7f2504144e70 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.928+0000 7f250b000640 1 -- 172.21.15.144:0/2200357999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 msgr2=0x7f250406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.928+0000 7f250b000640 1 --2- 172.21.15.144:0/2200357999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 0x7f250406dd30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25040b20f0 tx=0x7f24f402a270 comp rx=0 tx=0).stop 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.929+0000 7f250b000640 1 -- 172.21.15.144:0/2200357999 shutdown_connections 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.929+0000 7f250b000640 1 --2- 172.21.15.144:0/2200357999 >> v2:172.21.15.149:3300/0 conn(0x7f25040b49d0 0x7f2504162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.929+0000 7f250b000640 1 --2- 172.21.15.144:0/2200357999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 0x7f250406dd30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.929+0000 7f250b000640 1 -- 172.21.15.144:0/2200357999 >> 172.21.15.144:0/2200357999 conn(0x7f250406b8e0 msgr2=0x7f250406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.929+0000 7f250b000640 1 -- 172.21.15.144:0/2200357999 shutdown_connections 2024-05-30T16:42:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.929+0000 7f250b000640 1 -- 172.21.15.144:0/2200357999 wait complete. 2024-05-30T16:42:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.931+0000 7f250b000640 1 Processor -- start 2024-05-30T16:42:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.931+0000 7f250b000640 1 -- start start 2024-05-30T16:42:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f250b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25040b49d0 0x7f250413e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f250b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 0x7f25041e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f250b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2504147cc0 0x7f25041f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f250b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f250406c740 con 0x7f2504144e70 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f250b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f250406c3d0 con 0x7f25040b49d0 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f250b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f250406e270 con 0x7f2504147cc0 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f2509200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 0x7f25041e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f2509200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 0x7f25041e4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39156/0 (socket says 172.21.15.144:39156) 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f2509200640 1 -- 172.21.15.144:0/2625857917 learned_addr learned my addr 172.21.15.144:0/2625857917 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f2509c00640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25040b49d0 0x7f250413e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f2509200640 1 -- 172.21.15.144:0/2625857917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2504147cc0 msgr2=0x7f25041f3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.932+0000 7f2509200640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2504147cc0 0x7f25041f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.933+0000 7f2509200640 1 -- 172.21.15.144:0/2625857917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25040b49d0 msgr2=0x7f250413e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.933+0000 7f2509200640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25040b49d0 0x7f250413e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:41.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.933+0000 7f2509200640 1 -- 172.21.15.144:0/2625857917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041e53b0 con 0x7f2504144e70 2024-05-30T16:42:41.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.933+0000 7f2509200640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 0x7f25041e4e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c890 tx=0x7f24f800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:41.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.933+0000 7f2501600640 1 -- 172.21.15.144:0/2625857917 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8018070 con 0x7f2504144e70 2024-05-30T16:42:41.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.933+0000 7f2501600640 1 -- 172.21.15.144:0/2625857917 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f800a640 con 0x7f2504144e70 2024-05-30T16:42:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.933+0000 7f2501600640 1 -- 172.21.15.144:0/2625857917 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f800aa30 con 0x7f2504144e70 2024-05-30T16:42:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.933+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250413f750 con 0x7f2504144e70 2024-05-30T16:42:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.933+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250413f190 con 0x7f2504144e70 2024-05-30T16:42:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.934+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25040632f0 con 0x7f2504144e70 2024-05-30T16:42:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.936+0000 7f2501600640 1 -- 172.21.15.144:0/2625857917 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24f801b070 con 0x7f2504144e70 2024-05-30T16:42:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.937+0000 7f2501600640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f24e806c8f0 0x7f24e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.937+0000 7f2501600640 1 -- 172.21.15.144:0/2625857917 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7f24f808b200 con 0x7f2504144e70 2024-05-30T16:42:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.938+0000 7f2509c00640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f24e806c8f0 0x7f24e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.938+0000 7f2509c00640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f24e806c8f0 0x7f24e806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f24f4034000 tx=0x7f24f402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:41.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:41.942+0000 7f2501600640 1 -- 172.21.15.144:0/2625857917 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f24f80595f0 con 0x7f2504144e70 2024-05-30T16:42:42.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.181+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2504072ec0 con 0x7f2504144e70 2024-05-30T16:42:42.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.717+0000 7f2501600640 1 -- 172.21.15.144:0/2625857917 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f24f8058ef0 con 0x7f2504144e70 2024-05-30T16:42:42.717 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 4 and data pool 5 2024-05-30T16:42:42.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f24e806c8f0 msgr2=0x7f24e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:42.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f24e806c8f0 0x7f24e806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f24f4034000 tx=0x7f24f402e000 comp rx=0 tx=0).stop 2024-05-30T16:42:42.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 msgr2=0x7f25041e4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:42.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 0x7f25041e4e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c890 tx=0x7f24f800cd50 comp rx=0 tx=0).stop 2024-05-30T16:42:42.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 shutdown_connections 2024-05-30T16:42:42.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f24e806c8f0 0x7f24e806edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2504147cc0 0x7f25041f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2504144e70 0x7f25041e4e70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 --2- 172.21.15.144:0/2625857917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25040b49d0 0x7f250413e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 >> 172.21.15.144:0/2625857917 conn(0x7f250406b8e0 msgr2=0x7f250406e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:42.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 shutdown_connections 2024-05-30T16:42:42.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.721+0000 7f250b000640 1 -- 172.21.15.144:0/2625857917 wait complete. 2024-05-30T16:42:42.761 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:42:42.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.927+0000 7f64ab200640 1 Processor -- start 2024-05-30T16:42:42.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.927+0000 7f64ab200640 1 -- start start 2024-05-30T16:42:42.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.929+0000 7f64ab200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f64ac0b4db0 0x7f64ac0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:42.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.929+0000 7f64ab200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac15eb70 con 0x7f64ac15e790 2024-05-30T16:42:42.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.929+0000 7f64ab200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac0cded0 con 0x7f64ac06b8e0 2024-05-30T16:42:42.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.929+0000 7f64ab200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f64ac0cea50 con 0x7f64ac0b4db0 2024-05-30T16:42:42.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.929+0000 7f64a9e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f64ac15e790 0x7f64ac162ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33338/0 (socket says 172.21.15.144:33338) 2024-05-30T16:42:42.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.929+0000 7f64a9e00640 1 -- 172.21.15.144:0/1775071227 learned_addr learned my addr 172.21.15.144:0/1775071227 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:42.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.929+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264722101 0 0) 0x7f649c001110 con 0x7f64ac15e790 2024-05-30T16:42:42.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.929+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6490003520 con 0x7f64ac15e790 2024-05-30T16:42:42.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.929+0000 7f64a1400640 1 --2- 172.21.15.144:0/1775071227 >> v2:172.21.15.149:3300/0 conn(0x7f64ac0b4db0 0x7f64ac0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:42.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1299404995 0 0) 0x7f6490003520 con 0x7f64ac15e790 2024-05-30T16:42:42.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 >> v2:172.21.15.149:3300/0 conn(0x7f64ac0b4db0 msgr2=0x7f64ac0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 --2- 172.21.15.144:0/1775071227 >> v2:172.21.15.149:3300/0 conn(0x7f64ac0b4db0 0x7f64ac0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 >> v1:172.21.15.149:6789/0 conn(0x7f64ac06b8e0 legacy=0x7f64ac0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac0ce1b0 con 0x7f64ac15e790 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f649c001840 con 0x7f64ac15e790 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 >> v1:172.21.15.144:6789/0 conn(0x7f64ac15e790 legacy=0x7f64ac162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f6490003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6490004800 0x7f6490004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64900052e0 0x7f649000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac0cea50 con 0x7f64900039b0 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f649000c190 con 0x7f6490004800 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f649000c390 con 0x7f64900052e0 2024-05-30T16:42:42.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9e00640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f6490003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:42.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a1400640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6490004800 0x7f6490004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:42.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9e00640 1 -- 172.21.15.144:0/1775071227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64900052e0 msgr2=0x7f649000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:42.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.930+0000 7f64a9e00640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64900052e0 0x7f649000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.931+0000 7f64a9e00640 1 -- 172.21.15.144:0/1775071227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6490004800 msgr2=0x7f6490004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:42.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.931+0000 7f64a9e00640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6490004800 0x7f6490004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.931+0000 7f64a9e00640 1 -- 172.21.15.144:0/1775071227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6490003520 con 0x7f64900039b0 2024-05-30T16:42:42.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.931+0000 7f64a1400640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6490004800 0x7f6490004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:42.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.931+0000 7f64aa800640 1 -- 172.21.15.144:0/1775071227 reap_dead start 2024-05-30T16:42:42.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.931+0000 7f64a9e00640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f6490003db0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f649c00c3b0 tx=0x7f6490005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca40e3c02b507573 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:42.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.932+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c00c0e0 con 0x7f64900039b0 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.932+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649c034070 con 0x7f64900039b0 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.932+0000 7f64a9400640 1 -- 172.21.15.144:0/1775071227 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c005d50 con 0x7f64900039b0 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.932+0000 7f64ab200640 1 -- 172.21.15.144:0/1775071227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 msgr2=0x7f6490003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.932+0000 7f64ab200640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f6490003db0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f649c00c3b0 tx=0x7f6490005830 comp rx=0 tx=0).stop 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.932+0000 7f64ab200640 1 -- 172.21.15.144:0/1775071227 shutdown_connections 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.932+0000 7f64ab200640 1 --2- 172.21.15.144:0/1775071227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f6490003db0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.932+0000 7f64ab200640 1 -- 172.21.15.144:0/1775071227 >> 172.21.15.144:0/1775071227 conn(0x7f64ac0b20a0 msgr2=0x7f64ac0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.933+0000 7f64ab200640 1 -- 172.21.15.144:0/1775071227 shutdown_connections 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.933+0000 7f64ab200640 1 -- 172.21.15.144:0/1775071227 wait complete. 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.934+0000 7f64ab200640 1 Processor -- start 2024-05-30T16:42:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.934+0000 7f64ab200640 1 -- start start 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.935+0000 7f64ab200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f64ac15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.935+0000 7f64ab200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac157940 0x7f64ac1f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.935+0000 7f64ab200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac072d50 0x7f64ac158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.935+0000 7f64ab200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac0ca840 con 0x7f64900039b0 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.935+0000 7f64ab200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac0ce770 con 0x7f64ac072d50 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.935+0000 7f64ab200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f64ac0ca9c0 con 0x7f64ac157940 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f64ac15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f64ac15ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39164/0 (socket says 172.21.15.144:39164) 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a9e00640 1 -- 172.21.15.144:0/2339144124 learned_addr learned my addr 172.21.15.144:0/2339144124 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a9e00640 1 -- 172.21.15.144:0/2339144124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac157940 msgr2=0x7f64ac1f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a9e00640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac157940 0x7f64ac1f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a9e00640 1 -- 172.21.15.144:0/2339144124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac072d50 msgr2=0x7f64ac158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a9e00640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac072d50 0x7f64ac158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a9e00640 1 -- 172.21.15.144:0/2339144124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac1f5370 con 0x7f64900039b0 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a9e00640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f64ac15ac90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f649c02afe0 tx=0x7f649c001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.936+0000 7f64a2a00640 1 -- 172.21.15.144:0/2339144124 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c004e60 con 0x7f64900039b0 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.937+0000 7f64a2a00640 1 -- 172.21.15.144:0/2339144124 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649c007480 con 0x7f64900039b0 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.937+0000 7f64a2a00640 1 -- 172.21.15.144:0/2339144124 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c001110 con 0x7f64900039b0 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.937+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac071cb0 con 0x7f64900039b0 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.937+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac072270 con 0x7f64900039b0 2024-05-30T16:42:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.938+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ac075570 con 0x7f64900039b0 2024-05-30T16:42:42.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.939+0000 7f64a2a00640 1 -- 172.21.15.144:0/2339144124 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f649c02f460 con 0x7f64900039b0 2024-05-30T16:42:42.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.940+0000 7f64a2a00640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f648806c920 0x7f648806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:42.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.940+0000 7f64a2a00640 1 -- 172.21.15.144:0/2339144124 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f649c0acc50 con 0x7f64900039b0 2024-05-30T16:42:42.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.940+0000 7f64a1400640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f648806c920 0x7f648806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:42.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.941+0000 7f64a1400640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f648806c920 0x7f648806ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0515e0 tx=0x7f6494009260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:42.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:42.944+0000 7f64a2a00640 1 -- 172.21.15.144:0/2339144124 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f649c049020 con 0x7f64900039b0 2024-05-30T16:42:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.127+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64ac0cc2b0 con 0x7f64900039b0 2024-05-30T16:42:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.130+0000 7f64a2a00640 1 -- 172.21.15.144:0/2339144124 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7f64ac1f5370 con 0x7f64900039b0 2024-05-30T16:42:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:43.131 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":30,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:42:42.182766+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:42:40.061111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:42:41.144734+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.133+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f648806c920 msgr2=0x7f648806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.133+0000 7f64ab200640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f648806c920 0x7f648806ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0515e0 tx=0x7f6494009260 comp rx=0 tx=0).stop 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.133+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 msgr2=0x7f64ac15ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.133+0000 7f64ab200640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f64ac15ac90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f649c02afe0 tx=0x7f649c001c10 comp rx=0 tx=0).stop 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.134+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 shutdown_connections 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.134+0000 7f64ab200640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f648806c920 0x7f648806ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.134+0000 7f64ab200640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac072d50 0x7f64ac158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.134+0000 7f64ab200640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac157940 0x7f64ac1f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.134+0000 7f64ab200640 1 --2- 172.21.15.144:0/2339144124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64900039b0 0x7f64ac15ac90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.134+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 >> 172.21.15.144:0/2339144124 conn(0x7f64ac0b20a0 msgr2=0x7f64ac0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.134+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 shutdown_connections 2024-05-30T16:42:43.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.134+0000 7f64ab200640 1 -- 172.21.15.144:0/2339144124 wait complete. 2024-05-30T16:42:43.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:42:43.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.347+0000 7f020be00640 1 Processor -- start 2024-05-30T16:42:43.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.347+0000 7f020be00640 1 -- start start 2024-05-30T16:42:43.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.348+0000 7f020be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c09aff0 0x7f020c0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f020be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f020c0d0b80 0x7f020c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f020be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f020c06d1c0 con 0x7f020c15e210 2024-05-30T16:42:43.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f020be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f020c0d1500 con 0x7f020c0d0b80 2024-05-30T16:42:43.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f020be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f020c06d4a0 con 0x7f020c09aff0 2024-05-30T16:42:43.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f0203e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f020c0d0b80 0x7f020c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f020b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f020c15e210 0x7f020c15e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33352/0 (socket says 172.21.15.144:33352) 2024-05-30T16:42:43.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f020b400640 1 -- 172.21.15.144:0/38729641 learned_addr learned my addr 172.21.15.144:0/38729641 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:43.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f020aa00640 1 --2- 172.21.15.144:0/38729641 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c09aff0 0x7f020c0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f0203e00640 1 -- 172.21.15.144:0/38729641 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c09aff0 msgr2=0x7f020c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:43.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f0203e00640 1 --2- 172.21.15.144:0/38729641 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c09aff0 0x7f020c0d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f0203e00640 1 -- 172.21.15.144:0/38729641 >> v1:172.21.15.144:6789/0 conn(0x7f020c15e210 legacy=0x7f020c15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f0203e00640 1 -- 172.21.15.144:0/38729641 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020c06d780 con 0x7f020c0d0b80 2024-05-30T16:42:43.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.349+0000 7f020a000640 1 -- 172.21.15.144:0/38729641 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2411690770 0 0) 0x7f020c06d1c0 con 0x7f020c15e210 2024-05-30T16:42:43.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.350+0000 7f0203e00640 1 --2- 172.21.15.144:0/38729641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 0x7f020c0d0fc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f01f40097a0 tx=0x7f01f402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b6d1f7524cd0a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.351+0000 7f020a000640 1 -- 172.21.15.144:0/38729641 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4037070 con 0x7f020c0d0b80 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.351+0000 7f020a000640 1 -- 172.21.15.144:0/38729641 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f4032440 con 0x7f020c0d0b80 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.351+0000 7f020a000640 1 -- 172.21.15.144:0/38729641 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4032810 con 0x7f020c0d0b80 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.351+0000 7f020be00640 1 -- 172.21.15.144:0/38729641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 msgr2=0x7f020c0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.351+0000 7f020be00640 1 --2- 172.21.15.144:0/38729641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 0x7f020c0d0fc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f01f40097a0 tx=0x7f01f402a180 comp rx=0 tx=0).stop 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.351+0000 7f020be00640 1 -- 172.21.15.144:0/38729641 shutdown_connections 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.351+0000 7f020be00640 1 --2- 172.21.15.144:0/38729641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 0x7f020c0d0fc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.351+0000 7f020be00640 1 --2- 172.21.15.144:0/38729641 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c09aff0 0x7f020c0d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.351+0000 7f020be00640 1 -- 172.21.15.144:0/38729641 >> 172.21.15.144:0/38729641 conn(0x7f020c0d25a0 msgr2=0x7f020c0d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.352+0000 7f020be00640 1 -- 172.21.15.144:0/38729641 shutdown_connections 2024-05-30T16:42:43.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.352+0000 7f020be00640 1 -- 172.21.15.144:0/38729641 wait complete. 2024-05-30T16:42:43.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.353+0000 7f020be00640 1 Processor -- start 2024-05-30T16:42:43.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.353+0000 7f020be00640 1 -- start start 2024-05-30T16:42:43.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.354+0000 7f020be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020c09aff0 0x7f020c15e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.354+0000 7f020be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 0x7f020c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.354+0000 7f020be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c15e210 0x7f020c06ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.354+0000 7f020be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f020c09bb00 con 0x7f020c0d0b80 2024-05-30T16:42:43.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.354+0000 7f020be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f020c0d08c0 con 0x7f020c09aff0 2024-05-30T16:42:43.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.354+0000 7f020be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f020c09bc80 con 0x7f020c15e210 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.354+0000 7f0203e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 0x7f020c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f0203e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 0x7f020c14d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39192/0 (socket says 172.21.15.144:39192) 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f0203e00640 1 -- 172.21.15.144:0/2288906333 learned_addr learned my addr 172.21.15.144:0/2288906333 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f020aa00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020c09aff0 0x7f020c15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f020b400640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c15e210 0x7f020c06ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f0203e00640 1 -- 172.21.15.144:0/2288906333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c15e210 msgr2=0x7f020c06ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f0203e00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c15e210 0x7f020c06ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f0203e00640 1 -- 172.21.15.144:0/2288906333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020c09aff0 msgr2=0x7f020c15e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f0203e00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020c09aff0 0x7f020c15e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f0203e00640 1 -- 172.21.15.144:0/2288906333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020c15ebc0 con 0x7f020c0d0b80 2024-05-30T16:42:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.355+0000 7f0203e00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 0x7f020c14d830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f01f40097a0 tx=0x7f01f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:43.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.356+0000 7f0202a00640 1 -- 172.21.15.144:0/2288906333 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4037050 con 0x7f020c0d0b80 2024-05-30T16:42:43.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.356+0000 7f0202a00640 1 -- 172.21.15.144:0/2288906333 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f4038040 con 0x7f020c0d0b80 2024-05-30T16:42:43.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.356+0000 7f0202a00640 1 -- 172.21.15.144:0/2288906333 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4006e10 con 0x7f020c0d0b80 2024-05-30T16:42:43.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.356+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020c15ee90 con 0x7f020c0d0b80 2024-05-30T16:42:43.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.356+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020c15f450 con 0x7f020c0d0b80 2024-05-30T16:42:43.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.357+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f020c0d18b0 con 0x7f020c0d0b80 2024-05-30T16:42:43.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.358+0000 7f0202a00640 1 -- 172.21.15.144:0/2288906333 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01f4030980 con 0x7f020c0d0b80 2024-05-30T16:42:43.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.359+0000 7f0202a00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01e806c8f0 0x7f01e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.359+0000 7f0202a00640 1 -- 172.21.15.144:0/2288906333 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f01f40ac620 con 0x7f020c0d0b80 2024-05-30T16:42:43.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.359+0000 7f020aa00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01e806c8f0 0x7f01e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.360+0000 7f020aa00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01e806c8f0 0x7f01e806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01fc006fd0 tx=0x7f01fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:43.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.363+0000 7f0202a00640 1 -- 172.21.15.144:0/2288906333 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f020c0d18b0 con 0x7f020c0d0b80 2024-05-30T16:42:43.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.568+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f020c075570 con 0x7f020c0d0b80 2024-05-30T16:42:43.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.571+0000 7f0202a00640 1 -- 172.21.15.144:0/2288906333 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7f01f407aae0 con 0x7f020c0d0b80 2024-05-30T16:42:43.572 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:43.572 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":30,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:42:42.182766+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:42:40.061111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:42:41.144734+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:42:43.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01e806c8f0 msgr2=0x7f01e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01e806c8f0 0x7f01e806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01fc006fd0 tx=0x7f01fc008040 comp rx=0 tx=0).stop 2024-05-30T16:42:43.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 msgr2=0x7f020c14d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 0x7f020c14d830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f01f40097a0 tx=0x7f01f40046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 shutdown_connections 2024-05-30T16:42:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01e806c8f0 0x7f01e806edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f020c15e210 0x7f020c06ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f020c0d0b80 0x7f020c14d830 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 --2- 172.21.15.144:0/2288906333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020c09aff0 0x7f020c15e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 >> 172.21.15.144:0/2288906333 conn(0x7f020c0d25a0 msgr2=0x7f020c161e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.574+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 shutdown_connections 2024-05-30T16:42:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.575+0000 7f020be00640 1 -- 172.21.15.144:0/2288906333 wait complete. 2024-05-30T16:42:43.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:42:43.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.793+0000 7f6625600640 1 Processor -- start 2024-05-30T16:42:43.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.793+0000 7f6625600640 1 -- start start 2024-05-30T16:42:43.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.794+0000 7f6625600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66200cfc40 0x7f662006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.794+0000 7f6625600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f662006f610 0x7f66200b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.794+0000 7f6625600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66200d00f0 con 0x7f6620145150 2024-05-30T16:42:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.794+0000 7f6625600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f662015f140 con 0x7f66200cfc40 2024-05-30T16:42:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.794+0000 7f6625600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f662015f390 con 0x7f662006f610 2024-05-30T16:42:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6620145150 0x7f66200cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33368/0 (socket says 172.21.15.144:33368) 2024-05-30T16:42:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661ea00640 1 -- 172.21.15.144:0/1334913420 learned_addr learned my addr 172.21.15.144:0/1334913420 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661e000640 1 --2- 172.21.15.144:0/1334913420 >> v2:172.21.15.144:3300/0 conn(0x7f66200cfc40 0x7f662006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661d600640 1 -- 172.21.15.144:0/1334913420 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324411686 0 0) 0x7f66200d00f0 con 0x7f6620145150 2024-05-30T16:42:43.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661f400640 1 --2- 172.21.15.144:0/1334913420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f662006f610 0x7f66200b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661d600640 1 -- 172.21.15.144:0/1334913420 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6604003520 con 0x7f6620145150 2024-05-30T16:42:43.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661e000640 1 -- 172.21.15.144:0/1334913420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f662006f610 msgr2=0x7f66200b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:43.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661e000640 1 --2- 172.21.15.144:0/1334913420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f662006f610 0x7f66200b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661e000640 1 -- 172.21.15.144:0/1334913420 >> v1:172.21.15.144:6789/0 conn(0x7f6620145150 legacy=0x7f66200cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.795+0000 7f661e000640 1 -- 172.21.15.144:0/1334913420 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662015f670 con 0x7f66200cfc40 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.796+0000 7f661e000640 1 --2- 172.21.15.144:0/1334913420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66200cfc40 0x7f662006f0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f66080097a0 tx=0x7f660802a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ac6a962c6549f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.797+0000 7f661d600640 1 -- 172.21.15.144:0/1334913420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608037070 con 0x7f66200cfc40 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.797+0000 7f661d600640 1 -- 172.21.15.144:0/1334913420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660802ae40 con 0x7f66200cfc40 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.797+0000 7f661d600640 1 -- 172.21.15.144:0/1334913420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608032660 con 0x7f66200cfc40 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.797+0000 7f6625600640 1 -- 172.21.15.144:0/1334913420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66200cfc40 msgr2=0x7f662006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.797+0000 7f6625600640 1 --2- 172.21.15.144:0/1334913420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66200cfc40 0x7f662006f0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f66080097a0 tx=0x7f660802a0f0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.797+0000 7f6625600640 1 -- 172.21.15.144:0/1334913420 shutdown_connections 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.797+0000 7f6625600640 1 --2- 172.21.15.144:0/1334913420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f662006f610 0x7f66200b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.797+0000 7f6625600640 1 --2- 172.21.15.144:0/1334913420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66200cfc40 0x7f662006f0d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.797+0000 7f6625600640 1 -- 172.21.15.144:0/1334913420 >> 172.21.15.144:0/1334913420 conn(0x7f662006bd00 msgr2=0x7f662006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.798+0000 7f6625600640 1 -- 172.21.15.144:0/1334913420 shutdown_connections 2024-05-30T16:42:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.798+0000 7f6625600640 1 -- 172.21.15.144:0/1334913420 wait complete. 2024-05-30T16:42:43.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.799+0000 7f6625600640 1 Processor -- start 2024-05-30T16:42:43.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.800+0000 7f6625600640 1 -- start start 2024-05-30T16:42:43.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f6625600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662006f610 0x7f66200b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f6625600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66200cfc40 0x7f66201e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f6625600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6620145150 0x7f66200b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f6625600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f662015fe70 con 0x7f662006f610 2024-05-30T16:42:43.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f6625600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f66200b64f0 con 0x7f66200cfc40 2024-05-30T16:42:43.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f6625600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f662015fff0 con 0x7f6620145150 2024-05-30T16:42:43.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662006f610 0x7f66200b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662006f610 0x7f66200b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39206/0 (socket says 172.21.15.144:39206) 2024-05-30T16:42:43.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661ea00640 1 -- 172.21.15.144:0/3219270074 learned_addr learned my addr 172.21.15.144:0/3219270074 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:43.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661e000640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66200cfc40 0x7f66201e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661f400640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6620145150 0x7f66200b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661ea00640 1 -- 172.21.15.144:0/3219270074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6620145150 msgr2=0x7f66200b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661ea00640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6620145150 0x7f66200b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661ea00640 1 -- 172.21.15.144:0/3219270074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66200cfc40 msgr2=0x7f66201e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661ea00640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66200cfc40 0x7f66201e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661ea00640 1 -- 172.21.15.144:0/3219270074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66201e5440 con 0x7f662006f610 2024-05-30T16:42:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.801+0000 7f661e000640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66200cfc40 0x7f66201e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.802+0000 7f661ea00640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662006f610 0x7f66200b1520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f661000c390 tx=0x7f661000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.802+0000 7f6616a00640 1 -- 172.21.15.144:0/3219270074 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610017070 con 0x7f662006f610 2024-05-30T16:42:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.802+0000 7f6616a00640 1 -- 172.21.15.144:0/3219270074 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6610005ce0 con 0x7f662006f610 2024-05-30T16:42:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.802+0000 7f6616a00640 1 -- 172.21.15.144:0/3219270074 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66100072f0 con 0x7f662006f610 2024-05-30T16:42:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.802+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66200b3120 con 0x7f662006f610 2024-05-30T16:42:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.802+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66200b1e20 con 0x7f662006f610 2024-05-30T16:42:43.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.804+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66200b60b0 con 0x7f662006f610 2024-05-30T16:42:43.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.804+0000 7f6616a00640 1 -- 172.21.15.144:0/3219270074 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f661001a070 con 0x7f662006f610 2024-05-30T16:42:43.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.805+0000 7f6616a00640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f65fc06c920 0x7f65fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:43.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.805+0000 7f6616a00640 1 -- 172.21.15.144:0/3219270074 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f661008aef0 con 0x7f662006f610 2024-05-30T16:42:43.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.806+0000 7f661e000640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f65fc06c920 0x7f65fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:43.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.806+0000 7f661e000640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f65fc06c920 0x7f65fc06ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6608034000 tx=0x7f660802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:43.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:43.810+0000 7f6616a00640 1 -- 172.21.15.144:0/3219270074 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f66200b60b0 con 0x7f662006f610 2024-05-30T16:42:44.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.060+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f66200b2810 con 0x7f662006f610 2024-05-30T16:42:44.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.751+0000 7f6616a00640 1 -- 172.21.15.144:0/3219270074 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f6610059320 con 0x7f662006f610 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f65fc06c920 msgr2=0x7f65fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f65fc06c920 0x7f65fc06ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6608034000 tx=0x7f660802e000 comp rx=0 tx=0).stop 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662006f610 msgr2=0x7f66200b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662006f610 0x7f66200b1520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f661000c390 tx=0x7f661000c850 comp rx=0 tx=0).stop 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 shutdown_connections 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f65fc06c920 0x7f65fc06ede0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6620145150 0x7f66200b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66200cfc40 0x7f66201e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 --2- 172.21.15.144:0/3219270074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662006f610 0x7f66200b1520 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.754+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 >> 172.21.15.144:0/3219270074 conn(0x7f662006bd00 msgr2=0x7f66200b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:44.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.755+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 shutdown_connections 2024-05-30T16:42:44.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.755+0000 7f6625600640 1 -- 172.21.15.144:0/3219270074 wait complete. 2024-05-30T16:42:44.776 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:42:44.776 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:42:44.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.975+0000 7fdbb6400640 1 Processor -- start 2024-05-30T16:42:44.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.975+0000 7fdbb6400640 1 -- start start 2024-05-30T16:42:44.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.976+0000 7fdbb6400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdbb015e7a0 0x7fdbb009b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:44.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.976+0000 7fdbb6400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdbb015eb80 0x7fdbb00b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:44.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.976+0000 7fdbb6400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb00b3310 con 0x7fdbb00b2cb0 2024-05-30T16:42:44.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.976+0000 7fdbb6400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdbb00d0520 con 0x7fdbb015e7a0 2024-05-30T16:42:44.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.976+0000 7fdbb6400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fdbb009b120 con 0x7fdbb015eb80 2024-05-30T16:42:44.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.977+0000 7fdbaf400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdbb015e7a0 0x7fdbb009b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.977+0000 7fdbafe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdbb00b2cb0 0x7fdbb00d0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33284/0 (socket says 172.21.15.144:33284) 2024-05-30T16:42:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.977+0000 7fdbafe00640 1 -- 172.21.15.144:0/3807907973 learned_addr learned my addr 172.21.15.144:0/3807907973 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.977+0000 7fdbaea00640 1 --2- 172.21.15.144:0/3807907973 >> v2:172.21.15.149:3300/0 conn(0x7fdbb015eb80 0x7fdbb00b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.977+0000 7fdbaf400640 1 -- 172.21.15.144:0/3807907973 >> v2:172.21.15.149:3300/0 conn(0x7fdbb015eb80 msgr2=0x7fdbb00b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.977+0000 7fdbaf400640 1 --2- 172.21.15.144:0/3807907973 >> v2:172.21.15.149:3300/0 conn(0x7fdbb015eb80 0x7fdbb00b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.977+0000 7fdbaf400640 1 -- 172.21.15.144:0/3807907973 >> v1:172.21.15.144:6789/0 conn(0x7fdbb00b2cb0 legacy=0x7fdbb00d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.977+0000 7fdbaf400640 1 -- 172.21.15.144:0/3807907973 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb009aad0 con 0x7fdbb015e7a0 2024-05-30T16:42:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.977+0000 7fdbae000640 1 -- 172.21.15.144:0/3807907973 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832807044 0 0) 0x7fdbb00b3310 con 0x7fdbb00b2cb0 2024-05-30T16:42:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.978+0000 7fdbaf400640 1 --2- 172.21.15.144:0/3807907973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 0x7fdbb009b5b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00d0180 tx=0x7fdb9802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f519e6031a33d36a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.979+0000 7fdbae000640 1 -- 172.21.15.144:0/3807907973 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb98037070 con 0x7fdbb015e7a0 2024-05-30T16:42:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.979+0000 7fdbae000640 1 -- 172.21.15.144:0/3807907973 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb98032440 con 0x7fdbb015e7a0 2024-05-30T16:42:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.979+0000 7fdbae000640 1 -- 172.21.15.144:0/3807907973 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9802ae60 con 0x7fdbb015e7a0 2024-05-30T16:42:44.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.979+0000 7fdbb6400640 1 -- 172.21.15.144:0/3807907973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 msgr2=0x7fdbb009b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:44.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.979+0000 7fdbb6400640 1 --2- 172.21.15.144:0/3807907973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 0x7fdbb009b5b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00d0180 tx=0x7fdb9802a110 comp rx=0 tx=0).stop 2024-05-30T16:42:44.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.979+0000 7fdbb6400640 1 -- 172.21.15.144:0/3807907973 shutdown_connections 2024-05-30T16:42:44.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.979+0000 7fdbb6400640 1 --2- 172.21.15.144:0/3807907973 >> v2:172.21.15.149:3300/0 conn(0x7fdbb015eb80 0x7fdbb00b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:44.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.979+0000 7fdbb6400640 1 --2- 172.21.15.144:0/3807907973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 0x7fdbb009b5b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:44.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.979+0000 7fdbb6400640 1 -- 172.21.15.144:0/3807907973 >> 172.21.15.144:0/3807907973 conn(0x7fdbb00d2600 msgr2=0x7fdbb00d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:44.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.980+0000 7fdbb6400640 1 -- 172.21.15.144:0/3807907973 shutdown_connections 2024-05-30T16:42:44.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.980+0000 7fdbb6400640 1 -- 172.21.15.144:0/3807907973 wait complete. 2024-05-30T16:42:44.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.981+0000 7fdbb6400640 1 Processor -- start 2024-05-30T16:42:44.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.981+0000 7fdbb6400640 1 -- start start 2024-05-30T16:42:44.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.982+0000 7fdbb6400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb00b2cb0 0x7fdbb00cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:44.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.982+0000 7fdbb6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 0x7fdbb00c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.982+0000 7fdbb6400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb015eb80 0x7fdbb015fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.982+0000 7fdbb6400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb00d12d0 con 0x7fdbb015e7a0 2024-05-30T16:42:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.982+0000 7fdbb6400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb00b35f0 con 0x7fdbb015eb80 2024-05-30T16:42:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.982+0000 7fdbb6400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb00d1450 con 0x7fdbb00b2cb0 2024-05-30T16:42:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 0x7fdbb00c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 0x7fdbb00c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32940/0 (socket says 172.21.15.144:32940) 2024-05-30T16:42:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaea00640 1 -- 172.21.15.144:0/1584876722 learned_addr learned my addr 172.21.15.144:0/1584876722 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:44.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbafe00640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb015eb80 0x7fdbb015fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:44.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaf400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb00b2cb0 0x7fdbb00cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:44.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaea00640 1 -- 172.21.15.144:0/1584876722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb00b2cb0 msgr2=0x7fdbb00cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:44.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaea00640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb00b2cb0 0x7fdbb00cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:44.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaea00640 1 -- 172.21.15.144:0/1584876722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb015eb80 msgr2=0x7fdbb015fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaea00640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb015eb80 0x7fdbb015fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaea00640 1 -- 172.21.15.144:0/1584876722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb00cb150 con 0x7fdbb015e7a0 2024-05-30T16:42:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.983+0000 7fdbaea00640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 0x7fdbb00c6af0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdba0007e40 tx=0x7fdba000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.984+0000 7fdba7400640 1 -- 172.21.15.144:0/1584876722 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0014620 con 0x7fdbb015e7a0 2024-05-30T16:42:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.984+0000 7fdba7400640 1 -- 172.21.15.144:0/1584876722 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba0019070 con 0x7fdbb015e7a0 2024-05-30T16:42:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.984+0000 7fdba7400640 1 -- 172.21.15.144:0/1584876722 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0014a00 con 0x7fdbb015e7a0 2024-05-30T16:42:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.984+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb00c7380 con 0x7fdbb015e7a0 2024-05-30T16:42:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.984+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb015f510 con 0x7fdbb015e7a0 2024-05-30T16:42:44.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.985+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb0068b90 con 0x7fdbb015e7a0 2024-05-30T16:42:44.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.986+0000 7fdba7400640 1 -- 172.21.15.144:0/1584876722 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdba0014ba0 con 0x7fdbb015e7a0 2024-05-30T16:42:44.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.987+0000 7fdba7400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:44.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.987+0000 7fdba7400640 1 -- 172.21.15.144:0/1584876722 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fdba008c400 con 0x7fdbb015e7a0 2024-05-30T16:42:44.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.987+0000 7fdbaf400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:44.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.988+0000 7fdbaf400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb98034000 tx=0x7fdb9802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:44.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:44.991+0000 7fdba7400640 1 -- 172.21.15.144:0/1584876722 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdba005a820 con 0x7fdbb015e7a0 2024-05-30T16:42:45.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.230+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdbb00b2240 con 0x7fdbb015e7a0 2024-05-30T16:42:45.299 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:42:45.307 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:42:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.762+0000 7fdba7400640 1 -- 172.21.15.144:0/1584876722 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fdba005a120 con 0x7fdbb015e7a0 2024-05-30T16:42:45.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdb8c06c8f0 msgr2=0x7fdb8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:45.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb98034000 tx=0x7fdb9802e000 comp rx=0 tx=0).stop 2024-05-30T16:42:45.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 msgr2=0x7fdbb00c6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:45.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 0x7fdbb00c6af0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdba0007e40 tx=0x7fdba000e4b0 comp rx=0 tx=0).stop 2024-05-30T16:42:45.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 shutdown_connections 2024-05-30T16:42:45.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:45.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb015eb80 0x7fdbb015fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:45.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb015e7a0 0x7fdbb00c6af0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:45.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 --2- 172.21.15.144:0/1584876722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb00b2cb0 0x7fdbb00cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:45.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 >> 172.21.15.144:0/1584876722 conn(0x7fdbb00d2600 msgr2=0x7fdbb00cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:45.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.766+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 shutdown_connections 2024-05-30T16:42:45.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.767+0000 7fdbb6400640 1 -- 172.21.15.144:0/1584876722 wait complete. 2024-05-30T16:42:45.790 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:42:45.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:42:45.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.990+0000 7ff01c200640 1 Processor -- start 2024-05-30T16:42:45.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.991+0000 7ff01c200640 1 -- start start 2024-05-30T16:42:45.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.992+0000 7ff01c200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0140b4510 0x7ff01415f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:45.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.992+0000 7ff01c200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01406c310 con 0x7ff0140b4130 2024-05-30T16:42:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.992+0000 7ff01c200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01406c5f0 con 0x7ff01415f620 2024-05-30T16:42:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.992+0000 7ff01c200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff01406cf20 con 0x7ff0140b4510 2024-05-30T16:42:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.993+0000 7ff019800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff0140b4130 0x7ff01406b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33298/0 (socket says 172.21.15.144:33298) 2024-05-30T16:42:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.993+0000 7ff019800640 1 -- 172.21.15.144:0/1257435859 learned_addr learned my addr 172.21.15.144:0/1257435859 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.993+0000 7ff018e00640 1 --2- 172.21.15.144:0/1257435859 >> v2:172.21.15.144:3300/0 conn(0x7ff0140b4510 0x7ff01415f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.993+0000 7ff018e00640 1 -- 172.21.15.144:0/1257435859 >> v1:172.21.15.149:6789/0 conn(0x7ff01415f620 legacy=0x7ff014168890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.993+0000 7ff018e00640 1 -- 172.21.15.144:0/1257435859 >> v1:172.21.15.144:6789/0 conn(0x7ff0140b4130 legacy=0x7ff01406b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.993+0000 7ff018e00640 1 -- 172.21.15.144:0/1257435859 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01406c8d0 con 0x7ff0140b4510 2024-05-30T16:42:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.993+0000 7ff013e00640 1 -- 172.21.15.144:0/1257435859 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388243743 0 0) 0x7ff01406c310 con 0x7ff0140b4130 2024-05-30T16:42:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.994+0000 7ff018e00640 1 --2- 172.21.15.144:0/1257435859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4510 0x7ff01415f0e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0000097a0 tx=0x7ff00002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3e91b70eac332 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:45.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.994+0000 7ff013e00640 1 -- 172.21.15.144:0/1257435859 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000037070 con 0x7ff0140b4510 2024-05-30T16:42:45.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.995+0000 7ff013e00640 1 -- 172.21.15.144:0/1257435859 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff000032440 con 0x7ff0140b4510 2024-05-30T16:42:45.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.995+0000 7ff013e00640 1 -- 172.21.15.144:0/1257435859 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000032810 con 0x7ff0140b4510 2024-05-30T16:42:45.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.995+0000 7ff01c200640 1 -- 172.21.15.144:0/1257435859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4510 msgr2=0x7ff01415f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:45.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.995+0000 7ff01c200640 1 --2- 172.21.15.144:0/1257435859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4510 0x7ff01415f0e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0000097a0 tx=0x7ff00002a1e0 comp rx=0 tx=0).stop 2024-05-30T16:42:45.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.995+0000 7ff01c200640 1 -- 172.21.15.144:0/1257435859 shutdown_connections 2024-05-30T16:42:45.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.995+0000 7ff01c200640 1 --2- 172.21.15.144:0/1257435859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4510 0x7ff01415f0e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:45.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.995+0000 7ff01c200640 1 -- 172.21.15.144:0/1257435859 >> 172.21.15.144:0/1257435859 conn(0x7ff0140b3150 msgr2=0x7ff0140d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:45.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.995+0000 7ff01c200640 1 -- 172.21.15.144:0/1257435859 shutdown_connections 2024-05-30T16:42:45.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.996+0000 7ff01c200640 1 -- 172.21.15.144:0/1257435859 wait complete. 2024-05-30T16:42:45.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.997+0000 7ff01c200640 1 Processor -- start 2024-05-30T16:42:45.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.997+0000 7ff01c200640 1 -- start start 2024-05-30T16:42:45.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.998+0000 7ff01c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4130 0x7ff014134db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:45.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.998+0000 7ff01c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0140b4510 0x7ff014154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:45.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.998+0000 7ff01c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff01415f620 0x7ff01415dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.998+0000 7ff01c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff01415fab0 con 0x7ff0140b4130 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.998+0000 7ff01c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff01406bff0 con 0x7ff0140b4510 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.998+0000 7ff01c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff01415fc30 con 0x7ff01415f620 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff019800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4130 0x7ff014134db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff019800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4130 0x7ff014134db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32956/0 (socket says 172.21.15.144:32956) 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff019800640 1 -- 172.21.15.144:0/2340856220 learned_addr learned my addr 172.21.15.144:0/2340856220 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff01a200640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff01415f620 0x7ff01415dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff018e00640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0140b4510 0x7ff014154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff019800640 1 -- 172.21.15.144:0/2340856220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff01415f620 msgr2=0x7ff01415dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff019800640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff01415f620 0x7ff01415dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff019800640 1 -- 172.21.15.144:0/2340856220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0140b4510 msgr2=0x7ff014154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff019800640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0140b4510 0x7ff014154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:45.999+0000 7ff019800640 1 -- 172.21.15.144:0/2340856220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff014155410 con 0x7ff0140b4130 2024-05-30T16:42:46.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.000+0000 7ff019800640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4130 0x7ff014134db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c4d0 tx=0x7ff00800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:46.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.000+0000 7ff011600640 1 -- 172.21.15.144:0/2340856220 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008018070 con 0x7ff0140b4130 2024-05-30T16:42:46.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.000+0000 7ff011600640 1 -- 172.21.15.144:0/2340856220 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff008007500 con 0x7ff0140b4130 2024-05-30T16:42:46.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.000+0000 7ff011600640 1 -- 172.21.15.144:0/2340856220 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008004a20 con 0x7ff0140b4130 2024-05-30T16:42:46.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.000+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0141599b0 con 0x7ff0140b4130 2024-05-30T16:42:46.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.000+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff014159f70 con 0x7ff0140b4130 2024-05-30T16:42:46.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.001+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff014068b90 con 0x7ff0140b4130 2024-05-30T16:42:46.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.002+0000 7ff011600640 1 -- 172.21.15.144:0/2340856220 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff008004bc0 con 0x7ff0140b4130 2024-05-30T16:42:46.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.003+0000 7ff011600640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feff406c8f0 0x7feff406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.004+0000 7ff011600640 1 -- 172.21.15.144:0/2340856220 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff00808acb0 con 0x7ff0140b4130 2024-05-30T16:42:46.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.004+0000 7ff018e00640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feff406c8f0 0x7feff406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.005+0000 7ff018e00640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feff406c8f0 0x7feff406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff000034000 tx=0x7ff00002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:46.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.008+0000 7ff011600640 1 -- 172.21.15.144:0/2340856220 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff014155410 con 0x7ff0140b4130 2024-05-30T16:42:46.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.251+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0140d1980 con 0x7ff0140b4130 2024-05-30T16:42:46.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.253+0000 7ff011600640 1 -- 172.21.15.144:0/2340856220 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7ff008058b20 con 0x7ff0140b4130 2024-05-30T16:42:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:46.253 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/476063845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":476063845},{"type":"v1","addr":"172.21.15.149:6834","nonce":476063845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3390865934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3390865934},{"type":"v1","addr":"172.21.15.144:6836","nonce":3390865934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4737,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1066829217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1066829217},{"type":"v1","addr":"172.21.15.144:6837","nonce":1066829217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:42:42.182725+0000","modified":"2024-05-30T16:42:45.231332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/2240940065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":2240940065},{"type":"v1","addr":"172.21.15.149:6835","nonce":2240940065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-30T16:42:46.253 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 17 2024-05-30T16:42:46.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feff406c8f0 msgr2=0x7feff406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feff406c8f0 0x7feff406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff000034000 tx=0x7ff00002e000 comp rx=0 tx=0).stop 2024-05-30T16:42:46.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4130 msgr2=0x7ff014134db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4130 0x7ff014134db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c4d0 tx=0x7ff00800c990 comp rx=0 tx=0).stop 2024-05-30T16:42:46.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 shutdown_connections 2024-05-30T16:42:46.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7feff406c8f0 0x7feff406edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff01415f620 0x7ff01415dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0140b4510 0x7ff014154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 --2- 172.21.15.144:0/2340856220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0140b4130 0x7ff014134db0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 >> 172.21.15.144:0/2340856220 conn(0x7ff0140b3150 msgr2=0x7ff0141609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:46.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 shutdown_connections 2024-05-30T16:42:46.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.256+0000 7ff01c200640 1 -- 172.21.15.144:0/2340856220 wait complete. 2024-05-30T16:42:46.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:42:46.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.474+0000 7f5c9b400640 1 Processor -- start 2024-05-30T16:42:46.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.474+0000 7f5c9b400640 1 -- start start 2024-05-30T16:42:46.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.475+0000 7f5c9b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5c94145150 0x7f5c940cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.475+0000 7f5c9b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c940cfa70 0x7f5c9406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.475+0000 7f5c9b400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c940d00f0 con 0x7f5c9406f610 2024-05-30T16:42:46.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.475+0000 7f5c9b400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5c940cfeb0 con 0x7f5c94145150 2024-05-30T16:42:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.475+0000 7f5c9b400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9415f140 con 0x7f5c940cfa70 2024-05-30T16:42:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.476+0000 7f5c93e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c940cfa70 0x7f5c9406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.476+0000 7f5c93e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c940cfa70 0x7f5c9406f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:48968/0 (socket says 172.21.15.144:48968) 2024-05-30T16:42:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.476+0000 7f5c93e00640 1 -- 172.21.15.144:0/1372243541 learned_addr learned my addr 172.21.15.144:0/1372243541 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.476+0000 7f5c98a00640 1 --2- 172.21.15.144:0/1372243541 >> v2:172.21.15.149:3300/0 conn(0x7f5c94145150 0x7f5c940cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.476+0000 7f5c93e00640 1 -- 172.21.15.144:0/1372243541 >> v2:172.21.15.149:3300/0 conn(0x7f5c94145150 msgr2=0x7f5c940cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.476+0000 7f5c93e00640 1 --2- 172.21.15.144:0/1372243541 >> v2:172.21.15.149:3300/0 conn(0x7f5c94145150 0x7f5c940cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.476+0000 7f5c93e00640 1 -- 172.21.15.144:0/1372243541 >> v1:172.21.15.149:6789/0 conn(0x7f5c9406f610 legacy=0x7f5c94072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.476+0000 7f5c93e00640 1 -- 172.21.15.144:0/1372243541 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9415f390 con 0x7f5c940cfa70 2024-05-30T16:42:46.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.478+0000 7f5c93e00640 1 --2- 172.21.15.144:0/1372243541 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c940cfa70 0x7f5c9406f0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009870 tx=0x7f5c8002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1c7c0d99b70d583 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:46.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.478+0000 7f5c93400640 1 -- 172.21.15.144:0/1372243541 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c80037070 con 0x7f5c940cfa70 2024-05-30T16:42:46.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.478+0000 7f5c93400640 1 -- 172.21.15.144:0/1372243541 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c80032440 con 0x7f5c940cfa70 2024-05-30T16:42:46.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.478+0000 7f5c93400640 1 -- 172.21.15.144:0/1372243541 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c80032810 con 0x7f5c940cfa70 2024-05-30T16:42:46.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.479+0000 7f5c9b400640 1 -- 172.21.15.144:0/1372243541 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c940cfa70 msgr2=0x7f5c9406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.479+0000 7f5c9b400640 1 --2- 172.21.15.144:0/1372243541 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c940cfa70 0x7f5c9406f0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009870 tx=0x7f5c8002a1c0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.479+0000 7f5c9b400640 1 -- 172.21.15.144:0/1372243541 shutdown_connections 2024-05-30T16:42:46.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.479+0000 7f5c9b400640 1 --2- 172.21.15.144:0/1372243541 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c940cfa70 0x7f5c9406f0d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.479+0000 7f5c9b400640 1 --2- 172.21.15.144:0/1372243541 >> v2:172.21.15.149:3300/0 conn(0x7f5c94145150 0x7f5c940cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.479+0000 7f5c9b400640 1 -- 172.21.15.144:0/1372243541 >> 172.21.15.144:0/1372243541 conn(0x7f5c9406bd00 msgr2=0x7f5c9406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:46.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.479+0000 7f5c9b400640 1 -- 172.21.15.144:0/1372243541 shutdown_connections 2024-05-30T16:42:46.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.479+0000 7f5c9b400640 1 -- 172.21.15.144:0/1372243541 wait complete. 2024-05-30T16:42:46.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.480+0000 7f5c9b400640 1 Processor -- start 2024-05-30T16:42:46.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.481+0000 7f5c9b400640 1 -- start start 2024-05-30T16:42:46.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.481+0000 7f5c9b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c9406f610 0x7f5c94139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c9b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c940cfa70 0x7f5c9415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c9b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c94145150 0x7f5c94143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c9b400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5c940b64f0 con 0x7f5c9406f610 2024-05-30T16:42:46.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c9b400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9415f950 con 0x7f5c940cfa70 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c9b400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9415fe70 con 0x7f5c94145150 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c98a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c9406f610 0x7f5c94139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c98a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c9406f610 0x7f5c94139120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32962/0 (socket says 172.21.15.144:32962) 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c98a00640 1 -- 172.21.15.144:0/3421539443 learned_addr learned my addr 172.21.15.144:0/3421539443 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c99400640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c94145150 0x7f5c94143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c93e00640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c940cfa70 0x7f5c9415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c98a00640 1 -- 172.21.15.144:0/3421539443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c94145150 msgr2=0x7f5c94143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c98a00640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c94145150 0x7f5c94143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c98a00640 1 -- 172.21.15.144:0/3421539443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c940cfa70 msgr2=0x7f5c9415d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c98a00640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c940cfa70 0x7f5c9415d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.482+0000 7f5c98a00640 1 -- 172.21.15.144:0/3421539443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c94139660 con 0x7f5c9406f610 2024-05-30T16:42:46.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.483+0000 7f5c98a00640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c9406f610 0x7f5c94139120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800e870 tx=0x7f5c8800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:46.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.483+0000 7f5c90c00640 1 -- 172.21.15.144:0/3421539443 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88017070 con 0x7f5c9406f610 2024-05-30T16:42:46.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.483+0000 7f5c90c00640 1 -- 172.21.15.144:0/3421539443 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8800c940 con 0x7f5c9406f610 2024-05-30T16:42:46.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.483+0000 7f5c90c00640 1 -- 172.21.15.144:0/3421539443 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800cd30 con 0x7f5c9406f610 2024-05-30T16:42:46.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.483+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9415e170 con 0x7f5c9406f610 2024-05-30T16:42:46.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.483+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c9415e730 con 0x7f5c9406f610 2024-05-30T16:42:46.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.484+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c94068b90 con 0x7f5c9406f610 2024-05-30T16:42:46.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.486+0000 7f5c90c00640 1 -- 172.21.15.144:0/3421539443 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c8801a070 con 0x7f5c9406f610 2024-05-30T16:42:46.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.486+0000 7f5c90c00640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5c7406c8f0 0x7f5c7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.486+0000 7f5c90c00640 1 -- 172.21.15.144:0/3421539443 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f5c8808b9c0 con 0x7f5c9406f610 2024-05-30T16:42:46.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.487+0000 7f5c93e00640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5c7406c8f0 0x7f5c7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.487+0000 7f5c93e00640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5c7406c8f0 0x7f5c7406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c80034000 tx=0x7f5c8002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:46.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.491+0000 7f5c90c00640 1 -- 172.21.15.144:0/3421539443 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5c8808de20 con 0x7f5c9406f610 2024-05-30T16:42:46.630 INFO:tasks.ceph.mds.b.smithi149.stderr:2024-05-30T16:42:46.629+0000 7fd5bd600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:42:46.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.693+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c940ccad0 con 0x7f5c9406f610 2024-05-30T16:42:46.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.696+0000 7f5c90c00640 1 -- 172.21.15.144:0/3421539443 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16705 (secure 0 0 0) 0x7f5c880597a0 con 0x7f5c9406f610 2024-05-30T16:42:46.696 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:46.697 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":31,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:42:43.734705+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:42:40.061111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:42:41.144734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.698+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5c7406c8f0 msgr2=0x7f5c7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.698+0000 7f5c9b400640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5c7406c8f0 0x7f5c7406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c80034000 tx=0x7f5c8002e000 comp rx=0 tx=0).stop 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.698+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c9406f610 msgr2=0x7f5c94139120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.698+0000 7f5c9b400640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c9406f610 0x7f5c94139120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800e870 tx=0x7f5c8800ec70 comp rx=0 tx=0).stop 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.699+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 shutdown_connections 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.699+0000 7f5c9b400640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5c7406c8f0 0x7f5c7406edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.699+0000 7f5c9b400640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c94145150 0x7f5c94143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.699+0000 7f5c9b400640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c940cfa70 0x7f5c9415d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.699+0000 7f5c9b400640 1 --2- 172.21.15.144:0/3421539443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c9406f610 0x7f5c94139120 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.699+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 >> 172.21.15.144:0/3421539443 conn(0x7f5c9406bd00 msgr2=0x7f5c940b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:46.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.699+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 shutdown_connections 2024-05-30T16:42:46.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.699+0000 7f5c9b400640 1 -- 172.21.15.144:0/3421539443 wait complete. 2024-05-30T16:42:46.718 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:42:46.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:42:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.913+0000 7f5e9fe00640 1 Processor -- start 2024-05-30T16:42:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.913+0000 7f5e9fe00640 1 -- start start 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.914+0000 7f5e9fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5e98145150 0x7f5e980cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.914+0000 7f5e9fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 0x7f5e9806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.914+0000 7f5e9fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5e9806f610 0x7f5e98072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5e980cfeb0 con 0x7f5e9806f610 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9fe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9815f140 con 0x7f5e98145150 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e980d00f0 con 0x7f5e980cfa70 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5e9806f610 0x7f5e98072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5e9806f610 0x7f5e98072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32978/0 (socket says 172.21.15.144:32978) 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9de00640 1 -- 172.21.15.144:0/1007943100 learned_addr learned my addr 172.21.15.144:0/1007943100 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9ca00640 1 --2- 172.21.15.144:0/1007943100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 0x7f5e9806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9de00640 1 -- 172.21.15.144:0/1007943100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 msgr2=0x7f5e9806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1007943100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 0x7f5e9806f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9d400640 1 --2- 172.21.15.144:0/1007943100 >> v2:172.21.15.149:3300/0 conn(0x7f5e98145150 0x7f5e980cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9de00640 1 -- 172.21.15.144:0/1007943100 >> v2:172.21.15.149:3300/0 conn(0x7f5e98145150 msgr2=0x7f5e980cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1007943100 >> v2:172.21.15.149:3300/0 conn(0x7f5e98145150 0x7f5e980cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9de00640 1 -- 172.21.15.144:0/1007943100 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9815f390 con 0x7f5e9806f610 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9ca00640 1 --2- 172.21.15.144:0/1007943100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 0x7f5e9806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.915+0000 7f5e9d400640 1 --2- 172.21.15.144:0/1007943100 >> v2:172.21.15.149:3300/0 conn(0x7f5e98145150 0x7f5e980cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.916+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1007943100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e9806f610 0x7f5e98072210 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5e980b3db0 tx=0x7f5e9002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751de52ca6ebc4bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.917+0000 7f5e97e00640 1 -- 172.21.15.144:0/1007943100 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90037070 con 0x7f5e9806f610 2024-05-30T16:42:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.917+0000 7f5e97e00640 1 -- 172.21.15.144:0/1007943100 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e90032440 con 0x7f5e9806f610 2024-05-30T16:42:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.917+0000 7f5e97e00640 1 -- 172.21.15.144:0/1007943100 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90032810 con 0x7f5e9806f610 2024-05-30T16:42:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.917+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1007943100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e9806f610 msgr2=0x7f5e98072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.917+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1007943100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e9806f610 0x7f5e98072210 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5e980b3db0 tx=0x7f5e9002a140 comp rx=0 tx=0).stop 2024-05-30T16:42:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.918+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1007943100 shutdown_connections 2024-05-30T16:42:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.918+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1007943100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e9806f610 0x7f5e98072210 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.918+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1007943100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 0x7f5e9806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.918+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1007943100 >> v2:172.21.15.149:3300/0 conn(0x7f5e98145150 0x7f5e980cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.918+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1007943100 >> 172.21.15.144:0/1007943100 conn(0x7f5e9806bd00 msgr2=0x7f5e9806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.918+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1007943100 shutdown_connections 2024-05-30T16:42:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.918+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1007943100 wait complete. 2024-05-30T16:42:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.919+0000 7f5e9fe00640 1 Processor -- start 2024-05-30T16:42:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.919+0000 7f5e9fe00640 1 -- start start 2024-05-30T16:42:46.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.920+0000 7f5e9fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e9806f610 0x7f5e98139d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.920+0000 7f5e9fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 0x7f5e9815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.920+0000 7f5e9fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98145150 0x7f5e9815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.920+0000 7f5e9fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e980b64f0 con 0x7f5e98145150 2024-05-30T16:42:46.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.920+0000 7f5e9fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9815f950 con 0x7f5e9806f610 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.920+0000 7f5e9fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9815fe70 con 0x7f5e980cfa70 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98145150 0x7f5e9815e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98145150 0x7f5e9815e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32988/0 (socket says 172.21.15.144:32988) 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9de00640 1 -- 172.21.15.144:0/1793349102 learned_addr learned my addr 172.21.15.144:0/1793349102 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9ca00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 0x7f5e9815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9d400640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e9806f610 0x7f5e98139d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9de00640 1 -- 172.21.15.144:0/1793349102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 msgr2=0x7f5e9815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 0x7f5e9815e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9de00640 1 -- 172.21.15.144:0/1793349102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e9806f610 msgr2=0x7f5e98139d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e9806f610 0x7f5e98139d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.921+0000 7f5e9de00640 1 -- 172.21.15.144:0/1793349102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9813fbe0 con 0x7f5e98145150 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.922+0000 7f5e9de00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98145150 0x7f5e9815e800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5e900090b0 tx=0x7f5e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.922+0000 7f5e95600640 1 -- 172.21.15.144:0/1793349102 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90041020 con 0x7f5e98145150 2024-05-30T16:42:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.922+0000 7f5e95600640 1 -- 172.21.15.144:0/1793349102 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e900306c0 con 0x7f5e98145150 2024-05-30T16:42:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.922+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9813fec0 con 0x7f5e98145150 2024-05-30T16:42:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.922+0000 7f5e95600640 1 -- 172.21.15.144:0/1793349102 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90037040 con 0x7f5e98145150 2024-05-30T16:42:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.922+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e98140480 con 0x7f5e98145150 2024-05-30T16:42:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.923+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e98068b90 con 0x7f5e98145150 2024-05-30T16:42:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.924+0000 7f5e95600640 1 -- 172.21.15.144:0/1793349102 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e90044020 con 0x7f5e98145150 2024-05-30T16:42:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.925+0000 7f5e95600640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e7806c8f0 0x7f5e7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.925+0000 7f5e95600640 1 -- 172.21.15.144:0/1793349102 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f5e900ac2e0 con 0x7f5e98145150 2024-05-30T16:42:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.925+0000 7f5e9d400640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e7806c8f0 0x7f5e7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.926+0000 7f5e9d400640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e7806c8f0 0x7f5e7806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0075b0 tx=0x7f5e8c007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:46.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:46.929+0000 7f5e95600640 1 -- 172.21.15.144:0/1793349102 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e9004b030 con 0x7f5e98145150 2024-05-30T16:42:47.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.126+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e9806cf20 con 0x7f5e7806c8f0 2024-05-30T16:42:47.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.147+0000 7f5e95600640 1 -- 172.21.15.144:0/1793349102 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f5e9806cf20 con 0x7f5e7806c8f0 2024-05-30T16:42:47.150 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e7806c8f0 msgr2=0x7f5e7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e7806c8f0 0x7f5e7806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0075b0 tx=0x7f5e8c007540 comp rx=0 tx=0).stop 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98145150 msgr2=0x7f5e9815e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98145150 0x7f5e9815e800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5e900090b0 tx=0x7f5e900046c0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 shutdown_connections 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5e7806c8f0 0x7f5e7806edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98145150 0x7f5e9815e800 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e980cfa70 0x7f5e9815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 --2- 172.21.15.144:0/1793349102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e9806f610 0x7f5e98139d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 >> 172.21.15.144:0/1793349102 conn(0x7f5e9806bd00 msgr2=0x7f5e9806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:47.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 shutdown_connections 2024-05-30T16:42:47.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.153+0000 7f5e9fe00640 1 -- 172.21.15.144:0/1793349102 wait complete. 2024-05-30T16:42:47.173 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-05-30T16:42:46.910626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220128,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754592,"statfs":{"total":773094113280,"available":772868702208,"internally_reserved":0,"allocated":4038656,"data_stored":2261156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001767"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756029+0000","last_change":"2024-05-30T16:42:42.751587+0000","last_active":"2024-05-30T16:42:43.756029+0000","last_peered":"2024-05-30T16:42:43.756029+0000","last_clean":"2024-05-30T16:42:43.756029+0000","last_became_active":"2024-05-30T16:42:42.750666+0000","last_became_peered":"2024-05-30T16:42:42.750666+0000","last_unstale":"2024-05-30T16:42:43.756029+0000","last_undegraded":"2024-05-30T16:42:43.756029+0000","last_fullsized":"2024-05-30T16:42:43.756029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:38:49.036025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962594+0000","last_change":"2024-05-30T16:42:42.759317+0000","last_active":"2024-05-30T16:42:43.962594+0000","last_peered":"2024-05-30T16:42:43.962594+0000","last_clean":"2024-05-30T16:42:43.962594+0000","last_became_active":"2024-05-30T16:42:42.757958+0000","last_became_peered":"2024-05-30T16:42:42.757958+0000","last_unstale":"2024-05-30T16:42:43.962594+0000","last_undegraded":"2024-05-30T16:42:43.962594+0000","last_fullsized":"2024-05-30T16:42:43.962594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:16:59.328423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056321+0000","last_change":"2024-05-30T16:42:42.760808+0000","last_active":"2024-05-30T16:42:44.056321+0000","last_peered":"2024-05-30T16:42:44.056321+0000","last_clean":"2024-05-30T16:42:44.056321+0000","last_became_active":"2024-05-30T16:42:42.760514+0000","last_became_peered":"2024-05-30T16:42:42.760514+0000","last_unstale":"2024-05-30T16:42:44.056321+0000","last_undegraded":"2024-05-30T16:42:44.056321+0000","last_fullsized":"2024-05-30T16:42:44.056321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:09.743258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.053830+0000","last_change":"2024-05-30T16:42:42.753374+0000","last_active":"2024-05-30T16:42:44.053830+0000","last_peered":"2024-05-30T16:42:44.053830+0000","last_clean":"2024-05-30T16:42:44.053830+0000","last_became_active":"2024-05-30T16:42:42.752998+0000","last_became_peered":"2024-05-30T16:42:42.752998+0000","last_unstale":"2024-05-30T16:42:44.053830+0000","last_undegraded":"2024-05-30T16:42:44.053830+0000","last_fullsized":"2024-05-30T16:42:44.053830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:26:38.580865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056077+0000","last_change":"2024-05-30T16:42:42.755189+0000","last_active":"2024-05-30T16:42:44.056077+0000","last_peered":"2024-05-30T16:42:44.056077+0000","last_clean":"2024-05-30T16:42:44.056077+0000","last_became_active":"2024-05-30T16:42:42.754528+0000","last_became_peered":"2024-05-30T16:42:42.754528+0000","last_unstale":"2024-05-30T16:42:44.056077+0000","last_undegraded":"2024-05-30T16:42:44.056077+0000","last_fullsized":"2024-05-30T16:42:44.056077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:55.269471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961728+0000","last_change":"2024-05-30T16:42:42.750059+0000","last_active":"2024-05-30T16:42:43.961728+0000","last_peered":"2024-05-30T16:42:43.961728+0000","last_clean":"2024-05-30T16:42:43.961728+0000","last_became_active":"2024-05-30T16:42:42.749719+0000","last_became_peered":"2024-05-30T16:42:42.749719+0000","last_unstale":"2024-05-30T16:42:43.961728+0000","last_undegraded":"2024-05-30T16:42:43.961728+0000","last_fullsized":"2024-05-30T16:42:43.961728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:09.743258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055003+0000","last_change":"2024-05-30T16:42:42.737475+0000","last_active":"2024-05-30T16:42:44.055003+0000","last_peered":"2024-05-30T16:42:44.055003+0000","last_clean":"2024-05-30T16:42:44.055003+0000","last_became_active":"2024-05-30T16:42:42.736800+0000","last_became_peered":"2024-05-30T16:42:42.736800+0000","last_unstale":"2024-05-30T16:42:44.055003+0000","last_undegraded":"2024-05-30T16:42:44.055003+0000","last_fullsized":"2024-05-30T16:42:44.055003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:21.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054530+0000","last_change":"2024-05-30T16:42:42.746813+0000","last_active":"2024-05-30T16:42:44.054530+0000","last_peered":"2024-05-30T16:42:44.054530+0000","last_clean":"2024-05-30T16:42:44.054530+0000","last_became_active":"2024-05-30T16:42:42.745229+0000","last_became_peered":"2024-05-30T16:42:42.745229+0000","last_unstale":"2024-05-30T16:42:44.054530+0000","last_undegraded":"2024-05-30T16:42:44.054530+0000","last_fullsized":"2024-05-30T16:42:44.054530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:09.743258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757926+0000","last_change":"2024-05-30T16:42:42.753096+0000","last_active":"2024-05-30T16:42:43.757926+0000","last_peered":"2024-05-30T16:42:43.757926+0000","last_clean":"2024-05-30T16:42:43.757926+0000","last_became_active":"2024-05-30T16:42:42.752746+0000","last_became_peered":"2024-05-30T16:42:42.752746+0000","last_unstale":"2024-05-30T16:42:43.757926+0000","last_undegraded":"2024-05-30T16:42:43.757926+0000","last_fullsized":"2024-05-30T16:42:43.757926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:42.521056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054341+0000","last_change":"2024-05-30T16:42:42.759512+0000","last_active":"2024-05-30T16:42:44.054341+0000","last_peered":"2024-05-30T16:42:44.054341+0000","last_clean":"2024-05-30T16:42:44.054341+0000","last_became_active":"2024-05-30T16:42:42.756159+0000","last_became_peered":"2024-05-30T16:42:42.756159+0000","last_unstale":"2024-05-30T16:42:44.054341+0000","last_undegraded":"2024-05-30T16:42:44.054341+0000","last_fullsized":"2024-05-30T16:42:44.054341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:20:24.238664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056449+0000","last_change":"2024-05-30T16:42:42.750039+0000","last_active":"2024-05-30T16:42:44.056449+0000","last_peered":"2024-05-30T16:42:44.056449+0000","last_clean":"2024-05-30T16:42:44.056449+0000","last_became_active":"2024-05-30T16:42:42.749740+0000","last_became_peered":"2024-05-30T16:42:42.749740+0000","last_unstale":"2024-05-30T16:42:44.056449+0000","last_undegraded":"2024-05-30T16:42:44.056449+0000","last_fullsized":"2024-05-30T16:42:44.056449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:42:29.748462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055922+0000","last_change":"2024-05-30T16:42:42.750413+0000","last_active":"2024-05-30T16:42:44.055922+0000","last_peered":"2024-05-30T16:42:44.055922+0000","last_clean":"2024-05-30T16:42:44.055922+0000","last_became_active":"2024-05-30T16:42:42.750007+0000","last_became_peered":"2024-05-30T16:42:42.750007+0000","last_unstale":"2024-05-30T16:42:44.055922+0000","last_undegraded":"2024-05-30T16:42:44.055922+0000","last_fullsized":"2024-05-30T16:42:44.055922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:08:57.303506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056133+0000","last_change":"2024-05-30T16:42:42.746499+0000","last_active":"2024-05-30T16:42:44.056133+0000","last_peered":"2024-05-30T16:42:44.056133+0000","last_clean":"2024-05-30T16:42:44.056133+0000","last_became_active":"2024-05-30T16:42:42.745755+0000","last_became_peered":"2024-05-30T16:42:42.745755+0000","last_unstale":"2024-05-30T16:42:44.056133+0000","last_undegraded":"2024-05-30T16:42:44.056133+0000","last_fullsized":"2024-05-30T16:42:44.056133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:56:01.301428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961906+0000","last_change":"2024-05-30T16:42:42.757776+0000","last_active":"2024-05-30T16:42:43.961906+0000","last_peered":"2024-05-30T16:42:43.961906+0000","last_clean":"2024-05-30T16:42:43.961906+0000","last_became_active":"2024-05-30T16:42:42.754897+0000","last_became_peered":"2024-05-30T16:42:42.754897+0000","last_unstale":"2024-05-30T16:42:43.961906+0000","last_undegraded":"2024-05-30T16:42:43.961906+0000","last_fullsized":"2024-05-30T16:42:43.961906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:45.024839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055618+0000","last_change":"2024-05-30T16:42:42.754518+0000","last_active":"2024-05-30T16:42:44.055618+0000","last_peered":"2024-05-30T16:42:44.055618+0000","last_clean":"2024-05-30T16:42:44.055618+0000","last_became_active":"2024-05-30T16:42:42.753028+0000","last_became_peered":"2024-05-30T16:42:42.753028+0000","last_unstale":"2024-05-30T16:42:44.055618+0000","last_undegraded":"2024-05-30T16:42:44.055618+0000","last_fullsized":"2024-05-30T16:42:44.055618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:51:39.829308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056914+0000","last_change":"2024-05-30T16:42:42.754322+0000","last_active":"2024-05-30T16:42:44.056914+0000","last_peered":"2024-05-30T16:42:44.056914+0000","last_clean":"2024-05-30T16:42:44.056914+0000","last_became_active":"2024-05-30T16:42:42.753996+0000","last_became_peered":"2024-05-30T16:42:42.753996+0000","last_unstale":"2024-05-30T16:42:44.056914+0000","last_undegraded":"2024-05-30T16:42:44.056914+0000","last_fullsized":"2024-05-30T16:42:44.056914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:50.638515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.057576+0000","last_change":"2024-05-30T16:42:42.746413+0000","last_active":"2024-05-30T16:42:44.057576+0000","last_peered":"2024-05-30T16:42:44.057576+0000","last_clean":"2024-05-30T16:42:44.057576+0000","last_became_active":"2024-05-30T16:42:42.744307+0000","last_became_peered":"2024-05-30T16:42:42.744307+0000","last_unstale":"2024-05-30T16:42:44.057576+0000","last_undegraded":"2024-05-30T16:42:44.057576+0000","last_fullsized":"2024-05-30T16:42:44.057576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:26:20.151471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962433+0000","last_change":"2024-05-30T16:42:42.754256+0000","last_active":"2024-05-30T16:42:43.962433+0000","last_peered":"2024-05-30T16:42:43.962433+0000","last_clean":"2024-05-30T16:42:43.962433+0000","last_became_active":"2024-05-30T16:42:42.753909+0000","last_became_peered":"2024-05-30T16:42:42.753909+0000","last_unstale":"2024-05-30T16:42:43.962433+0000","last_undegraded":"2024-05-30T16:42:43.962433+0000","last_fullsized":"2024-05-30T16:42:43.962433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:22.664691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962144+0000","last_change":"2024-05-30T16:42:42.754775+0000","last_active":"2024-05-30T16:42:43.962144+0000","last_peered":"2024-05-30T16:42:43.962144+0000","last_clean":"2024-05-30T16:42:43.962144+0000","last_became_active":"2024-05-30T16:42:42.753333+0000","last_became_peered":"2024-05-30T16:42:42.753333+0000","last_unstale":"2024-05-30T16:42:43.962144+0000","last_undegraded":"2024-05-30T16:42:43.962144+0000","last_fullsized":"2024-05-30T16:42:43.962144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:21.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056562+0000","last_change":"2024-05-30T16:42:42.746446+0000","last_active":"2024-05-30T16:42:44.056562+0000","last_peered":"2024-05-30T16:42:44.056562+0000","last_clean":"2024-05-30T16:42:44.056562+0000","last_became_active":"2024-05-30T16:42:42.746142+0000","last_became_peered":"2024-05-30T16:42:42.746142+0000","last_unstale":"2024-05-30T16:42:44.056562+0000","last_undegraded":"2024-05-30T16:42:44.056562+0000","last_fullsized":"2024-05-30T16:42:44.056562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:53.489399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756930+0000","last_change":"2024-05-30T16:42:42.752906+0000","last_active":"2024-05-30T16:42:43.756930+0000","last_peered":"2024-05-30T16:42:43.756930+0000","last_clean":"2024-05-30T16:42:43.756930+0000","last_became_active":"2024-05-30T16:42:42.752045+0000","last_became_peered":"2024-05-30T16:42:42.752045+0000","last_unstale":"2024-05-30T16:42:43.756930+0000","last_undegraded":"2024-05-30T16:42:43.756930+0000","last_fullsized":"2024-05-30T16:42:43.756930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:00.798641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757981+0000","last_change":"2024-05-30T16:42:42.755256+0000","last_active":"2024-05-30T16:42:43.757981+0000","last_peered":"2024-05-30T16:42:43.757981+0000","last_clean":"2024-05-30T16:42:43.757981+0000","last_became_active":"2024-05-30T16:42:42.754146+0000","last_became_peered":"2024-05-30T16:42:42.754146+0000","last_unstale":"2024-05-30T16:42:43.757981+0000","last_undegraded":"2024-05-30T16:42:43.757981+0000","last_fullsized":"2024-05-30T16:42:43.757981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:20:24.238664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753086+0000","last_change":"2024-05-30T16:42:42.743574+0000","last_active":"2024-05-30T16:42:43.753086+0000","last_peered":"2024-05-30T16:42:43.753086+0000","last_clean":"2024-05-30T16:42:43.753086+0000","last_became_active":"2024-05-30T16:42:42.743305+0000","last_became_peered":"2024-05-30T16:42:42.743305+0000","last_unstale":"2024-05-30T16:42:43.753086+0000","last_undegraded":"2024-05-30T16:42:43.753086+0000","last_fullsized":"2024-05-30T16:42:43.753086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:00.798641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055322+0000","last_change":"2024-05-30T16:42:42.757774+0000","last_active":"2024-05-30T16:42:44.055322+0000","last_peered":"2024-05-30T16:42:44.055322+0000","last_clean":"2024-05-30T16:42:44.055322+0000","last_became_active":"2024-05-30T16:42:42.757564+0000","last_became_peered":"2024-05-30T16:42:42.757564+0000","last_unstale":"2024-05-30T16:42:44.055322+0000","last_undegraded":"2024-05-30T16:42:44.055322+0000","last_fullsized":"2024-05-30T16:42:44.055322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:01:35.750026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054327+0000","last_change":"2024-05-30T16:42:42.751133+0000","last_active":"2024-05-30T16:42:44.054327+0000","last_peered":"2024-05-30T16:42:44.054327+0000","last_clean":"2024-05-30T16:42:44.054327+0000","last_became_active":"2024-05-30T16:42:42.750791+0000","last_became_peered":"2024-05-30T16:42:42.750791+0000","last_unstale":"2024-05-30T16:42:44.054327+0000","last_undegraded":"2024-05-30T16:42:44.054327+0000","last_fullsized":"2024-05-30T16:42:44.054327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:55:41.225189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962595+0000","last_change":"2024-05-30T16:42:42.752952+0000","last_active":"2024-05-30T16:42:43.962595+0000","last_peered":"2024-05-30T16:42:43.962595+0000","last_clean":"2024-05-30T16:42:43.962595+0000","last_became_active":"2024-05-30T16:42:42.752739+0000","last_became_peered":"2024-05-30T16:42:42.752739+0000","last_unstale":"2024-05-30T16:42:43.962595+0000","last_undegraded":"2024-05-30T16:42:43.962595+0000","last_fullsized":"2024-05-30T16:42:43.962595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:42:29.748462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054616+0000","last_change":"2024-05-30T16:42:42.755635+0000","last_active":"2024-05-30T16:42:44.054616+0000","last_peered":"2024-05-30T16:42:44.054616+0000","last_clean":"2024-05-30T16:42:44.054616+0000","last_became_active":"2024-05-30T16:42:42.755399+0000","last_became_peered":"2024-05-30T16:42:42.755399+0000","last_unstale":"2024-05-30T16:42:44.054616+0000","last_undegraded":"2024-05-30T16:42:44.054616+0000","last_fullsized":"2024-05-30T16:42:44.054616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:38:41.595493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056371+0000","last_change":"2024-05-30T16:42:42.752470+0000","last_active":"2024-05-30T16:42:44.056371+0000","last_peered":"2024-05-30T16:42:44.056371+0000","last_clean":"2024-05-30T16:42:44.056371+0000","last_became_active":"2024-05-30T16:42:42.752202+0000","last_became_peered":"2024-05-30T16:42:42.752202+0000","last_unstale":"2024-05-30T16:42:44.056371+0000","last_undegraded":"2024-05-30T16:42:44.056371+0000","last_fullsized":"2024-05-30T16:42:44.056371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:10.874134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757141+0000","last_change":"2024-05-30T16:42:42.756264+0000","last_active":"2024-05-30T16:42:43.757141+0000","last_peered":"2024-05-30T16:42:43.757141+0000","last_clean":"2024-05-30T16:42:43.757141+0000","last_became_active":"2024-05-30T16:42:42.754661+0000","last_became_peered":"2024-05-30T16:42:42.754661+0000","last_unstale":"2024-05-30T16:42:43.757141+0000","last_undegraded":"2024-05-30T16:42:43.757141+0000","last_fullsized":"2024-05-30T16:42:43.757141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:01:12.047292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055899+0000","last_change":"2024-05-30T16:42:42.741720+0000","last_active":"2024-05-30T16:42:44.055899+0000","last_peered":"2024-05-30T16:42:44.055899+0000","last_clean":"2024-05-30T16:42:44.055899+0000","last_became_active":"2024-05-30T16:42:42.741408+0000","last_became_peered":"2024-05-30T16:42:42.741408+0000","last_unstale":"2024-05-30T16:42:44.055899+0000","last_undegraded":"2024-05-30T16:42:44.055899+0000","last_fullsized":"2024-05-30T16:42:44.055899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:22.664691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755376+0000","last_change":"2024-05-30T16:42:42.756471+0000","last_active":"2024-05-30T16:42:43.755376+0000","last_peered":"2024-05-30T16:42:43.755376+0000","last_clean":"2024-05-30T16:42:43.755376+0000","last_became_active":"2024-05-30T16:42:42.755539+0000","last_became_peered":"2024-05-30T16:42:42.755539+0000","last_unstale":"2024-05-30T16:42:43.755376+0000","last_undegraded":"2024-05-30T16:42:43.755376+0000","last_fullsized":"2024-05-30T16:42:43.755376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:11:39.422648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054598+0000","last_change":"2024-05-30T16:42:42.752541+0000","last_active":"2024-05-30T16:42:44.054598+0000","last_peered":"2024-05-30T16:42:44.054598+0000","last_clean":"2024-05-30T16:42:44.054598+0000","last_became_active":"2024-05-30T16:42:42.752290+0000","last_became_peered":"2024-05-30T16:42:42.752290+0000","last_unstale":"2024-05-30T16:42:44.054598+0000","last_undegraded":"2024-05-30T16:42:44.054598+0000","last_fullsized":"2024-05-30T16:42:44.054598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:10.874134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.754023+0000","last_change":"2024-05-30T16:42:42.744868+0000","last_active":"2024-05-30T16:42:43.754023+0000","last_peered":"2024-05-30T16:42:43.754023+0000","last_clean":"2024-05-30T16:42:43.754023+0000","last_became_active":"2024-05-30T16:42:42.744630+0000","last_became_peered":"2024-05-30T16:42:42.744630+0000","last_unstale":"2024-05-30T16:42:43.754023+0000","last_undegraded":"2024-05-30T16:42:43.754023+0000","last_fullsized":"2024-05-30T16:42:43.754023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:01:12.047292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756133+0000","last_change":"2024-05-30T16:42:41.743244+0000","last_active":"2024-05-30T16:42:43.756133+0000","last_peered":"2024-05-30T16:42:43.756133+0000","last_clean":"2024-05-30T16:42:43.756133+0000","last_became_active":"2024-05-30T16:42:41.742009+0000","last_became_peered":"2024-05-30T16:42:41.742009+0000","last_unstale":"2024-05-30T16:42:43.756133+0000","last_undegraded":"2024-05-30T16:42:43.756133+0000","last_fullsized":"2024-05-30T16:42:43.756133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:47.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756361+0000","last_change":"2024-05-30T16:42:42.743976+0000","last_active":"2024-05-30T16:42:43.756361+0000","last_peered":"2024-05-30T16:42:43.756361+0000","last_clean":"2024-05-30T16:42:43.756361+0000","last_became_active":"2024-05-30T16:42:42.743664+0000","last_became_peered":"2024-05-30T16:42:42.743664+0000","last_unstale":"2024-05-30T16:42:43.756361+0000","last_undegraded":"2024-05-30T16:42:43.756361+0000","last_fullsized":"2024-05-30T16:42:43.756361+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:01:12.047292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.754205+0000","last_change":"2024-05-30T16:42:41.750126+0000","last_active":"2024-05-30T16:42:43.754205+0000","last_peered":"2024-05-30T16:42:43.754205+0000","last_clean":"2024-05-30T16:42:43.754205+0000","last_became_active":"2024-05-30T16:42:41.749868+0000","last_became_peered":"2024-05-30T16:42:41.749868+0000","last_unstale":"2024-05-30T16:42:43.754205+0000","last_undegraded":"2024-05-30T16:42:43.754205+0000","last_fullsized":"2024-05-30T16:42:43.754205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:48:31.987774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757638+0000","last_change":"2024-05-30T16:42:42.755320+0000","last_active":"2024-05-30T16:42:43.757638+0000","last_peered":"2024-05-30T16:42:43.757638+0000","last_clean":"2024-05-30T16:42:43.757638+0000","last_became_active":"2024-05-30T16:42:42.753561+0000","last_became_peered":"2024-05-30T16:42:42.753561+0000","last_unstale":"2024-05-30T16:42:43.757638+0000","last_undegraded":"2024-05-30T16:42:43.757638+0000","last_fullsized":"2024-05-30T16:42:43.757638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:29:08.687823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961877+0000","last_change":"2024-05-30T16:42:41.742647+0000","last_active":"2024-05-30T16:42:43.961877+0000","last_peered":"2024-05-30T16:42:43.961877+0000","last_clean":"2024-05-30T16:42:43.961877+0000","last_became_active":"2024-05-30T16:42:41.742376+0000","last_became_peered":"2024-05-30T16:42:41.742376+0000","last_unstale":"2024-05-30T16:42:43.961877+0000","last_undegraded":"2024-05-30T16:42:43.961877+0000","last_fullsized":"2024-05-30T16:42:43.961877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:22.690394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054893+0000","last_change":"2024-05-30T16:42:42.755110+0000","last_active":"2024-05-30T16:42:44.054893+0000","last_peered":"2024-05-30T16:42:44.054893+0000","last_clean":"2024-05-30T16:42:44.054893+0000","last_became_active":"2024-05-30T16:42:42.754424+0000","last_became_peered":"2024-05-30T16:42:42.754424+0000","last_unstale":"2024-05-30T16:42:44.054893+0000","last_undegraded":"2024-05-30T16:42:44.054893+0000","last_fullsized":"2024-05-30T16:42:44.054893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:51:39.829308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056489+0000","last_change":"2024-05-30T16:42:41.740532+0000","last_active":"2024-05-30T16:42:44.056489+0000","last_peered":"2024-05-30T16:42:44.056489+0000","last_clean":"2024-05-30T16:42:44.056489+0000","last_became_active":"2024-05-30T16:42:41.740005+0000","last_became_peered":"2024-05-30T16:42:41.740005+0000","last_unstale":"2024-05-30T16:42:44.056489+0000","last_undegraded":"2024-05-30T16:42:44.056489+0000","last_fullsized":"2024-05-30T16:42:44.056489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:33:00.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056321+0000","last_change":"2024-05-30T16:42:42.755551+0000","last_active":"2024-05-30T16:42:44.056321+0000","last_peered":"2024-05-30T16:42:44.056321+0000","last_clean":"2024-05-30T16:42:44.056321+0000","last_became_active":"2024-05-30T16:42:42.754330+0000","last_became_peered":"2024-05-30T16:42:42.754330+0000","last_unstale":"2024-05-30T16:42:44.056321+0000","last_undegraded":"2024-05-30T16:42:44.056321+0000","last_fullsized":"2024-05-30T16:42:44.056321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:16:59.328423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757211+0000","last_change":"2024-05-30T16:42:41.748238+0000","last_active":"2024-05-30T16:42:43.757211+0000","last_peered":"2024-05-30T16:42:43.757211+0000","last_clean":"2024-05-30T16:42:43.757211+0000","last_became_active":"2024-05-30T16:42:41.746951+0000","last_became_peered":"2024-05-30T16:42:41.746951+0000","last_unstale":"2024-05-30T16:42:43.757211+0000","last_undegraded":"2024-05-30T16:42:43.757211+0000","last_fullsized":"2024-05-30T16:42:43.757211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:54.248310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055427+0000","last_change":"2024-05-30T16:42:42.760224+0000","last_active":"2024-05-30T16:42:44.055427+0000","last_peered":"2024-05-30T16:42:44.055427+0000","last_clean":"2024-05-30T16:42:44.055427+0000","last_became_active":"2024-05-30T16:42:42.759294+0000","last_became_peered":"2024-05-30T16:42:42.759294+0000","last_unstale":"2024-05-30T16:42:44.055427+0000","last_undegraded":"2024-05-30T16:42:44.055427+0000","last_fullsized":"2024-05-30T16:42:44.055427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:38:41.595493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757377+0000","last_change":"2024-05-30T16:42:41.747787+0000","last_active":"2024-05-30T16:42:43.757377+0000","last_peered":"2024-05-30T16:42:43.757377+0000","last_clean":"2024-05-30T16:42:43.757377+0000","last_became_active":"2024-05-30T16:42:41.744920+0000","last_became_peered":"2024-05-30T16:42:41.744920+0000","last_unstale":"2024-05-30T16:42:43.757377+0000","last_undegraded":"2024-05-30T16:42:43.757377+0000","last_fullsized":"2024-05-30T16:42:43.757377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:41.071633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757650+0000","last_change":"2024-05-30T16:42:42.743773+0000","last_active":"2024-05-30T16:42:43.757650+0000","last_peered":"2024-05-30T16:42:43.757650+0000","last_clean":"2024-05-30T16:42:43.757650+0000","last_became_active":"2024-05-30T16:42:42.743505+0000","last_became_peered":"2024-05-30T16:42:42.743505+0000","last_unstale":"2024-05-30T16:42:43.757650+0000","last_undegraded":"2024-05-30T16:42:43.757650+0000","last_fullsized":"2024-05-30T16:42:43.757650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:26:38.580865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961019+0000","last_change":"2024-05-30T16:42:41.738656+0000","last_active":"2024-05-30T16:42:43.961019+0000","last_peered":"2024-05-30T16:42:43.961019+0000","last_clean":"2024-05-30T16:42:43.961019+0000","last_became_active":"2024-05-30T16:42:41.738399+0000","last_became_peered":"2024-05-30T16:42:41.738399+0000","last_unstale":"2024-05-30T16:42:43.961019+0000","last_undegraded":"2024-05-30T16:42:43.961019+0000","last_fullsized":"2024-05-30T16:42:43.961019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:54:35.876656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.053926+0000","last_change":"2024-05-30T16:42:42.749790+0000","last_active":"2024-05-30T16:42:44.053926+0000","last_peered":"2024-05-30T16:42:44.053926+0000","last_clean":"2024-05-30T16:42:44.053926+0000","last_became_active":"2024-05-30T16:42:42.749517+0000","last_became_peered":"2024-05-30T16:42:42.749517+0000","last_unstale":"2024-05-30T16:42:44.053926+0000","last_undegraded":"2024-05-30T16:42:44.053926+0000","last_fullsized":"2024-05-30T16:42:44.053926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:29:08.687823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756618+0000","last_change":"2024-05-30T16:42:41.742690+0000","last_active":"2024-05-30T16:42:43.756618+0000","last_peered":"2024-05-30T16:42:43.756618+0000","last_clean":"2024-05-30T16:42:43.756618+0000","last_became_active":"2024-05-30T16:42:41.742472+0000","last_became_peered":"2024-05-30T16:42:41.742472+0000","last_unstale":"2024-05-30T16:42:43.756618+0000","last_undegraded":"2024-05-30T16:42:43.756618+0000","last_fullsized":"2024-05-30T16:42:43.756618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:12:56.385694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055802+0000","last_change":"2024-05-30T16:42:42.750346+0000","last_active":"2024-05-30T16:42:44.055802+0000","last_peered":"2024-05-30T16:42:44.055802+0000","last_clean":"2024-05-30T16:42:44.055802+0000","last_became_active":"2024-05-30T16:42:42.750072+0000","last_became_peered":"2024-05-30T16:42:42.750072+0000","last_unstale":"2024-05-30T16:42:44.055802+0000","last_undegraded":"2024-05-30T16:42:44.055802+0000","last_fullsized":"2024-05-30T16:42:44.055802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:21:09.349326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962613+0000","last_change":"2024-05-30T16:42:41.750992+0000","last_active":"2024-05-30T16:42:43.962613+0000","last_peered":"2024-05-30T16:42:43.962613+0000","last_clean":"2024-05-30T16:42:43.962613+0000","last_became_active":"2024-05-30T16:42:41.750716+0000","last_became_peered":"2024-05-30T16:42:41.750716+0000","last_unstale":"2024-05-30T16:42:43.962613+0000","last_undegraded":"2024-05-30T16:42:43.962613+0000","last_fullsized":"2024-05-30T16:42:43.962613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:01:11.026130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962855+0000","last_change":"2024-05-30T16:42:42.754988+0000","last_active":"2024-05-30T16:42:43.962855+0000","last_peered":"2024-05-30T16:42:43.962855+0000","last_clean":"2024-05-30T16:42:43.962855+0000","last_became_active":"2024-05-30T16:42:42.754201+0000","last_became_peered":"2024-05-30T16:42:42.754201+0000","last_unstale":"2024-05-30T16:42:43.962855+0000","last_undegraded":"2024-05-30T16:42:43.962855+0000","last_fullsized":"2024-05-30T16:42:43.962855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:49:55.903916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.754410+0000","last_change":"2024-05-30T16:42:41.741044+0000","last_active":"2024-05-30T16:42:43.754410+0000","last_peered":"2024-05-30T16:42:43.754410+0000","last_clean":"2024-05-30T16:42:43.754410+0000","last_became_active":"2024-05-30T16:42:41.740734+0000","last_became_peered":"2024-05-30T16:42:41.740734+0000","last_unstale":"2024-05-30T16:42:43.754410+0000","last_undegraded":"2024-05-30T16:42:43.754410+0000","last_fullsized":"2024-05-30T16:42:43.754410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:08:11.081820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962529+0000","last_change":"2024-05-30T16:42:42.762163+0000","last_active":"2024-05-30T16:42:43.962529+0000","last_peered":"2024-05-30T16:42:43.962529+0000","last_clean":"2024-05-30T16:42:43.962529+0000","last_became_active":"2024-05-30T16:42:42.761769+0000","last_became_peered":"2024-05-30T16:42:42.761769+0000","last_unstale":"2024-05-30T16:42:43.962529+0000","last_undegraded":"2024-05-30T16:42:43.962529+0000","last_fullsized":"2024-05-30T16:42:43.962529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:47:36.652618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056428+0000","last_change":"2024-05-30T16:42:41.752758+0000","last_active":"2024-05-30T16:42:44.056428+0000","last_peered":"2024-05-30T16:42:44.056428+0000","last_clean":"2024-05-30T16:42:44.056428+0000","last_became_active":"2024-05-30T16:42:41.752402+0000","last_became_peered":"2024-05-30T16:42:41.752402+0000","last_unstale":"2024-05-30T16:42:44.056428+0000","last_undegraded":"2024-05-30T16:42:44.056428+0000","last_fullsized":"2024-05-30T16:42:44.056428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:25:19.288583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056277+0000","last_change":"2024-05-30T16:42:42.761000+0000","last_active":"2024-05-30T16:42:44.056277+0000","last_peered":"2024-05-30T16:42:44.056277+0000","last_clean":"2024-05-30T16:42:44.056277+0000","last_became_active":"2024-05-30T16:42:42.760705+0000","last_became_peered":"2024-05-30T16:42:42.760705+0000","last_unstale":"2024-05-30T16:42:44.056277+0000","last_undegraded":"2024-05-30T16:42:44.056277+0000","last_fullsized":"2024-05-30T16:42:44.056277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:25.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962342+0000","last_change":"2024-05-30T16:42:41.738190+0000","last_active":"2024-05-30T16:42:43.962342+0000","last_peered":"2024-05-30T16:42:43.962342+0000","last_clean":"2024-05-30T16:42:43.962342+0000","last_became_active":"2024-05-30T16:42:41.737720+0000","last_became_peered":"2024-05-30T16:42:41.737720+0000","last_unstale":"2024-05-30T16:42:43.962342+0000","last_undegraded":"2024-05-30T16:42:43.962342+0000","last_fullsized":"2024-05-30T16:42:43.962342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:03:59.777480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054409+0000","last_change":"2024-05-30T16:42:42.754803+0000","last_active":"2024-05-30T16:42:44.054409+0000","last_peered":"2024-05-30T16:42:44.054409+0000","last_clean":"2024-05-30T16:42:44.054409+0000","last_became_active":"2024-05-30T16:42:42.754389+0000","last_became_peered":"2024-05-30T16:42:42.754389+0000","last_unstale":"2024-05-30T16:42:44.054409+0000","last_undegraded":"2024-05-30T16:42:44.054409+0000","last_fullsized":"2024-05-30T16:42:44.054409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:01:35.750026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757355+0000","last_change":"2024-05-30T16:42:41.743284+0000","last_active":"2024-05-30T16:42:43.757355+0000","last_peered":"2024-05-30T16:42:43.757355+0000","last_clean":"2024-05-30T16:42:43.757355+0000","last_became_active":"2024-05-30T16:42:41.742539+0000","last_became_peered":"2024-05-30T16:42:41.742539+0000","last_unstale":"2024-05-30T16:42:43.757355+0000","last_undegraded":"2024-05-30T16:42:43.757355+0000","last_fullsized":"2024-05-30T16:42:43.757355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:56:00.280266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961760+0000","last_change":"2024-05-30T16:42:42.739254+0000","last_active":"2024-05-30T16:42:43.961760+0000","last_peered":"2024-05-30T16:42:43.961760+0000","last_clean":"2024-05-30T16:42:43.961760+0000","last_became_active":"2024-05-30T16:42:42.738933+0000","last_became_peered":"2024-05-30T16:42:42.738933+0000","last_unstale":"2024-05-30T16:42:43.961760+0000","last_undegraded":"2024-05-30T16:42:43.961760+0000","last_fullsized":"2024-05-30T16:42:43.961760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:10.874134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.053648+0000","last_change":"2024-05-30T16:42:41.746465+0000","last_active":"2024-05-30T16:42:44.053648+0000","last_peered":"2024-05-30T16:42:44.053648+0000","last_clean":"2024-05-30T16:42:44.053648+0000","last_became_active":"2024-05-30T16:42:41.746127+0000","last_became_peered":"2024-05-30T16:42:41.746127+0000","last_unstale":"2024-05-30T16:42:44.053648+0000","last_undegraded":"2024-05-30T16:42:44.053648+0000","last_fullsized":"2024-05-30T16:42:44.053648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:47.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056822+0000","last_change":"2024-05-30T16:42:42.746765+0000","last_active":"2024-05-30T16:42:44.056822+0000","last_peered":"2024-05-30T16:42:44.056822+0000","last_clean":"2024-05-30T16:42:44.056822+0000","last_became_active":"2024-05-30T16:42:42.746498+0000","last_became_peered":"2024-05-30T16:42:42.746498+0000","last_unstale":"2024-05-30T16:42:44.056822+0000","last_undegraded":"2024-05-30T16:42:44.056822+0000","last_fullsized":"2024-05-30T16:42:44.056822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:49:55.903916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961096+0000","last_change":"2024-05-30T16:42:41.750992+0000","last_active":"2024-05-30T16:42:43.961096+0000","last_peered":"2024-05-30T16:42:43.961096+0000","last_clean":"2024-05-30T16:42:43.961096+0000","last_became_active":"2024-05-30T16:42:41.750704+0000","last_became_peered":"2024-05-30T16:42:41.750704+0000","last_unstale":"2024-05-30T16:42:43.961096+0000","last_undegraded":"2024-05-30T16:42:43.961096+0000","last_fullsized":"2024-05-30T16:42:43.961096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:25:19.288583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755391+0000","last_change":"2024-05-30T16:42:42.743756+0000","last_active":"2024-05-30T16:42:43.755391+0000","last_peered":"2024-05-30T16:42:43.755391+0000","last_clean":"2024-05-30T16:42:43.755391+0000","last_became_active":"2024-05-30T16:42:42.743390+0000","last_became_peered":"2024-05-30T16:42:42.743390+0000","last_unstale":"2024-05-30T16:42:43.755391+0000","last_undegraded":"2024-05-30T16:42:43.755391+0000","last_fullsized":"2024-05-30T16:42:43.755391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:00.798641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961189+0000","last_change":"2024-05-30T16:42:41.736022+0000","last_active":"2024-05-30T16:42:43.961189+0000","last_peered":"2024-05-30T16:42:43.961189+0000","last_clean":"2024-05-30T16:42:43.961189+0000","last_became_active":"2024-05-30T16:42:41.735491+0000","last_became_peered":"2024-05-30T16:42:41.735491+0000","last_unstale":"2024-05-30T16:42:43.961189+0000","last_undegraded":"2024-05-30T16:42:43.961189+0000","last_fullsized":"2024-05-30T16:42:43.961189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:11:38.401486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757050+0000","last_change":"2024-05-30T16:42:42.751254+0000","last_active":"2024-05-30T16:42:43.757050+0000","last_peered":"2024-05-30T16:42:43.757050+0000","last_clean":"2024-05-30T16:42:43.757050+0000","last_became_active":"2024-05-30T16:42:42.750946+0000","last_became_peered":"2024-05-30T16:42:42.750946+0000","last_unstale":"2024-05-30T16:42:43.757050+0000","last_undegraded":"2024-05-30T16:42:43.757050+0000","last_fullsized":"2024-05-30T16:42:43.757050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:38:49.036025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054395+0000","last_change":"2024-05-30T16:42:41.743736+0000","last_active":"2024-05-30T16:42:44.054395+0000","last_peered":"2024-05-30T16:42:44.054395+0000","last_clean":"2024-05-30T16:42:44.054395+0000","last_became_active":"2024-05-30T16:42:41.743387+0000","last_became_peered":"2024-05-30T16:42:41.743387+0000","last_unstale":"2024-05-30T16:42:44.054395+0000","last_undegraded":"2024-05-30T16:42:44.054395+0000","last_fullsized":"2024-05-30T16:42:44.054395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:26:31.080690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.057112+0000","last_change":"2024-05-30T16:42:42.755648+0000","last_active":"2024-05-30T16:42:44.057112+0000","last_peered":"2024-05-30T16:42:44.057112+0000","last_clean":"2024-05-30T16:42:44.057112+0000","last_became_active":"2024-05-30T16:42:42.752465+0000","last_became_peered":"2024-05-30T16:42:42.752465+0000","last_unstale":"2024-05-30T16:42:44.057112+0000","last_undegraded":"2024-05-30T16:42:44.057112+0000","last_fullsized":"2024-05-30T16:42:44.057112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:45.024839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757221+0000","last_change":"2024-05-30T16:42:41.742596+0000","last_active":"2024-05-30T16:42:43.757221+0000","last_peered":"2024-05-30T16:42:43.757221+0000","last_clean":"2024-05-30T16:42:43.757221+0000","last_became_active":"2024-05-30T16:42:41.742096+0000","last_became_peered":"2024-05-30T16:42:41.742096+0000","last_unstale":"2024-05-30T16:42:43.757221+0000","last_undegraded":"2024-05-30T16:42:43.757221+0000","last_fullsized":"2024-05-30T16:42:43.757221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:52.712163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054290+0000","last_change":"2024-05-30T16:42:42.761749+0000","last_active":"2024-05-30T16:42:44.054290+0000","last_peered":"2024-05-30T16:42:44.054290+0000","last_clean":"2024-05-30T16:42:44.054290+0000","last_became_active":"2024-05-30T16:42:42.761339+0000","last_became_peered":"2024-05-30T16:42:42.761339+0000","last_unstale":"2024-05-30T16:42:44.054290+0000","last_undegraded":"2024-05-30T16:42:44.054290+0000","last_fullsized":"2024-05-30T16:42:44.054290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:42.521056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757988+0000","last_change":"2024-05-30T16:42:41.749790+0000","last_active":"2024-05-30T16:42:43.757988+0000","last_peered":"2024-05-30T16:42:43.757988+0000","last_clean":"2024-05-30T16:42:43.757988+0000","last_became_active":"2024-05-30T16:42:41.748492+0000","last_became_peered":"2024-05-30T16:42:41.748492+0000","last_unstale":"2024-05-30T16:42:43.757988+0000","last_undegraded":"2024-05-30T16:42:43.757988+0000","last_fullsized":"2024-05-30T16:42:43.757988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:52.468238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056828+0000","last_change":"2024-05-30T16:42:42.744395+0000","last_active":"2024-05-30T16:42:44.056828+0000","last_peered":"2024-05-30T16:42:44.056828+0000","last_clean":"2024-05-30T16:42:44.056828+0000","last_became_active":"2024-05-30T16:42:42.744138+0000","last_became_peered":"2024-05-30T16:42:42.744138+0000","last_unstale":"2024-05-30T16:42:44.056828+0000","last_undegraded":"2024-05-30T16:42:44.056828+0000","last_fullsized":"2024-05-30T16:42:44.056828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:10:33.326622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757536+0000","last_change":"2024-05-30T16:42:41.745408+0000","last_active":"2024-05-30T16:42:43.757536+0000","last_peered":"2024-05-30T16:42:43.757536+0000","last_clean":"2024-05-30T16:42:43.757536+0000","last_became_active":"2024-05-30T16:42:41.744693+0000","last_became_peered":"2024-05-30T16:42:41.744693+0000","last_unstale":"2024-05-30T16:42:43.757536+0000","last_undegraded":"2024-05-30T16:42:43.757536+0000","last_fullsized":"2024-05-30T16:42:43.757536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:47.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056045+0000","last_change":"2024-05-30T16:42:42.758043+0000","last_active":"2024-05-30T16:42:44.056045+0000","last_peered":"2024-05-30T16:42:44.056045+0000","last_clean":"2024-05-30T16:42:44.056045+0000","last_became_active":"2024-05-30T16:42:42.755572+0000","last_became_peered":"2024-05-30T16:42:42.755572+0000","last_unstale":"2024-05-30T16:42:44.056045+0000","last_undegraded":"2024-05-30T16:42:44.056045+0000","last_fullsized":"2024-05-30T16:42:44.056045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:42.092795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753693+0000","last_change":"2024-05-30T16:42:41.745755+0000","last_active":"2024-05-30T16:42:43.753693+0000","last_peered":"2024-05-30T16:42:43.753693+0000","last_clean":"2024-05-30T16:42:43.753693+0000","last_became_active":"2024-05-30T16:42:41.745481+0000","last_became_peered":"2024-05-30T16:42:41.745481+0000","last_unstale":"2024-05-30T16:42:43.753693+0000","last_undegraded":"2024-05-30T16:42:43.753693+0000","last_fullsized":"2024-05-30T16:42:43.753693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:47.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056485+0000","last_change":"2024-05-30T16:42:42.744979+0000","last_active":"2024-05-30T16:42:44.056485+0000","last_peered":"2024-05-30T16:42:44.056485+0000","last_clean":"2024-05-30T16:42:44.056485+0000","last_became_active":"2024-05-30T16:42:42.744627+0000","last_became_peered":"2024-05-30T16:42:42.744627+0000","last_unstale":"2024-05-30T16:42:44.056485+0000","last_undegraded":"2024-05-30T16:42:44.056485+0000","last_fullsized":"2024-05-30T16:42:44.056485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:53.733325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755511+0000","last_change":"2024-05-30T16:42:41.744345+0000","last_active":"2024-05-30T16:42:43.755511+0000","last_peered":"2024-05-30T16:42:43.755511+0000","last_clean":"2024-05-30T16:42:43.755511+0000","last_became_active":"2024-05-30T16:42:41.744018+0000","last_became_peered":"2024-05-30T16:42:41.744018+0000","last_unstale":"2024-05-30T16:42:43.755511+0000","last_undegraded":"2024-05-30T16:42:43.755511+0000","last_fullsized":"2024-05-30T16:42:43.755511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:48:31.987774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055519+0000","last_change":"2024-05-30T16:42:42.743982+0000","last_active":"2024-05-30T16:42:44.055519+0000","last_peered":"2024-05-30T16:42:44.055519+0000","last_clean":"2024-05-30T16:42:44.055519+0000","last_became_active":"2024-05-30T16:42:42.743624+0000","last_became_peered":"2024-05-30T16:42:42.743624+0000","last_unstale":"2024-05-30T16:42:44.055519+0000","last_undegraded":"2024-05-30T16:42:44.055519+0000","last_fullsized":"2024-05-30T16:42:44.055519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:57:27.291809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756811+0000","last_change":"2024-05-30T16:42:41.744388+0000","last_active":"2024-05-30T16:42:43.756811+0000","last_peered":"2024-05-30T16:42:43.756811+0000","last_clean":"2024-05-30T16:42:43.756811+0000","last_became_active":"2024-05-30T16:42:41.743856+0000","last_became_peered":"2024-05-30T16:42:41.743856+0000","last_unstale":"2024-05-30T16:42:43.756811+0000","last_undegraded":"2024-05-30T16:42:43.756811+0000","last_fullsized":"2024-05-30T16:42:43.756811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:10:32.305461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054795+0000","last_change":"2024-05-30T16:42:42.737753+0000","last_active":"2024-05-30T16:42:44.054795+0000","last_peered":"2024-05-30T16:42:44.054795+0000","last_clean":"2024-05-30T16:42:44.054795+0000","last_became_active":"2024-05-30T16:42:42.737215+0000","last_became_peered":"2024-05-30T16:42:42.737215+0000","last_unstale":"2024-05-30T16:42:44.054795+0000","last_undegraded":"2024-05-30T16:42:44.054795+0000","last_fullsized":"2024-05-30T16:42:44.054795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:45.024839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055449+0000","last_change":"2024-05-30T16:42:41.751355+0000","last_active":"2024-05-30T16:42:44.055449+0000","last_peered":"2024-05-30T16:42:44.055449+0000","last_clean":"2024-05-30T16:42:44.055449+0000","last_became_active":"2024-05-30T16:42:41.750891+0000","last_became_peered":"2024-05-30T16:42:41.750891+0000","last_unstale":"2024-05-30T16:42:44.055449+0000","last_undegraded":"2024-05-30T16:42:44.055449+0000","last_fullsized":"2024-05-30T16:42:44.055449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:35.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.057240+0000","last_change":"2024-05-30T16:42:42.753814+0000","last_active":"2024-05-30T16:42:44.057240+0000","last_peered":"2024-05-30T16:42:44.057240+0000","last_clean":"2024-05-30T16:42:44.057240+0000","last_became_active":"2024-05-30T16:42:42.753521+0000","last_became_peered":"2024-05-30T16:42:42.753521+0000","last_unstale":"2024-05-30T16:42:44.057240+0000","last_undegraded":"2024-05-30T16:42:44.057240+0000","last_fullsized":"2024-05-30T16:42:44.057240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:19.249546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054505+0000","last_change":"2024-05-30T16:42:41.746799+0000","last_active":"2024-05-30T16:42:44.054505+0000","last_peered":"2024-05-30T16:42:44.054505+0000","last_clean":"2024-05-30T16:42:44.054505+0000","last_became_active":"2024-05-30T16:42:41.746476+0000","last_became_peered":"2024-05-30T16:42:41.746476+0000","last_unstale":"2024-05-30T16:42:44.054505+0000","last_undegraded":"2024-05-30T16:42:44.054505+0000","last_fullsized":"2024-05-30T16:42:44.054505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:08:11.081820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.057384+0000","last_change":"2024-05-30T16:42:42.760932+0000","last_active":"2024-05-30T16:42:44.057384+0000","last_peered":"2024-05-30T16:42:44.057384+0000","last_clean":"2024-05-30T16:42:44.057384+0000","last_became_active":"2024-05-30T16:42:42.760561+0000","last_became_peered":"2024-05-30T16:42:42.760561+0000","last_unstale":"2024-05-30T16:42:44.057384+0000","last_undegraded":"2024-05-30T16:42:44.057384+0000","last_fullsized":"2024-05-30T16:42:44.057384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:21.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.733900+0000","last_change":"2024-05-30T16:42:41.745666+0000","last_active":"2024-05-30T16:42:44.733900+0000","last_peered":"2024-05-30T16:42:44.733900+0000","last_clean":"2024-05-30T16:42:44.733900+0000","last_became_active":"2024-05-30T16:42:41.745360+0000","last_became_peered":"2024-05-30T16:42:41.745360+0000","last_unstale":"2024-05-30T16:42:44.733900+0000","last_undegraded":"2024-05-30T16:42:44.733900+0000","last_fullsized":"2024-05-30T16:42:44.733900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:26:31.080690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753974+0000","last_change":"2024-05-30T16:42:42.746958+0000","last_active":"2024-05-30T16:42:43.753974+0000","last_peered":"2024-05-30T16:42:43.753974+0000","last_clean":"2024-05-30T16:42:43.753974+0000","last_became_active":"2024-05-30T16:42:42.746730+0000","last_became_peered":"2024-05-30T16:42:42.746730+0000","last_unstale":"2024-05-30T16:42:43.753974+0000","last_undegraded":"2024-05-30T16:42:43.753974+0000","last_fullsized":"2024-05-30T16:42:43.753974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:38:49.036025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054645+0000","last_change":"2024-05-30T16:42:41.743686+0000","last_active":"2024-05-30T16:42:44.054645+0000","last_peered":"2024-05-30T16:42:44.054645+0000","last_clean":"2024-05-30T16:42:44.054645+0000","last_became_active":"2024-05-30T16:42:41.743399+0000","last_became_peered":"2024-05-30T16:42:41.743399+0000","last_unstale":"2024-05-30T16:42:44.054645+0000","last_undegraded":"2024-05-30T16:42:44.054645+0000","last_fullsized":"2024-05-30T16:42:44.054645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:48:31.987774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755595+0000","last_change":"2024-05-30T16:42:42.739280+0000","last_active":"2024-05-30T16:42:43.755595+0000","last_peered":"2024-05-30T16:42:43.755595+0000","last_clean":"2024-05-30T16:42:43.755595+0000","last_became_active":"2024-05-30T16:42:42.738930+0000","last_became_peered":"2024-05-30T16:42:42.738930+0000","last_unstale":"2024-05-30T16:42:43.755595+0000","last_undegraded":"2024-05-30T16:42:43.755595+0000","last_fullsized":"2024-05-30T16:42:43.755595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:23.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753672+0000","last_change":"2024-05-30T16:42:41.744516+0000","last_active":"2024-05-30T16:42:43.753672+0000","last_peered":"2024-05-30T16:42:43.753672+0000","last_clean":"2024-05-30T16:42:43.753672+0000","last_became_active":"2024-05-30T16:42:41.744249+0000","last_became_peered":"2024-05-30T16:42:41.744249+0000","last_unstale":"2024-05-30T16:42:43.753672+0000","last_undegraded":"2024-05-30T16:42:43.753672+0000","last_fullsized":"2024-05-30T16:42:43.753672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:59.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753481+0000","last_change":"2024-05-30T16:42:42.738306+0000","last_active":"2024-05-30T16:42:43.753481+0000","last_peered":"2024-05-30T16:42:43.753481+0000","last_clean":"2024-05-30T16:42:43.753481+0000","last_became_active":"2024-05-30T16:42:42.738000+0000","last_became_peered":"2024-05-30T16:42:42.738000+0000","last_unstale":"2024-05-30T16:42:43.753481+0000","last_undegraded":"2024-05-30T16:42:43.753481+0000","last_fullsized":"2024-05-30T16:42:43.753481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:23.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.053916+0000","last_change":"2024-05-30T16:42:41.746821+0000","last_active":"2024-05-30T16:42:44.053916+0000","last_peered":"2024-05-30T16:42:44.053916+0000","last_clean":"2024-05-30T16:42:44.053916+0000","last_became_active":"2024-05-30T16:42:41.746527+0000","last_became_peered":"2024-05-30T16:42:41.746527+0000","last_unstale":"2024-05-30T16:42:44.053916+0000","last_undegraded":"2024-05-30T16:42:44.053916+0000","last_fullsized":"2024-05-30T16:42:44.053916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:59.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961346+0000","last_change":"2024-05-30T16:42:42.742896+0000","last_active":"2024-05-30T16:42:43.961346+0000","last_peered":"2024-05-30T16:42:43.961346+0000","last_clean":"2024-05-30T16:42:43.961346+0000","last_became_active":"2024-05-30T16:42:42.742588+0000","last_became_peered":"2024-05-30T16:42:42.742588+0000","last_unstale":"2024-05-30T16:42:43.961346+0000","last_undegraded":"2024-05-30T16:42:43.961346+0000","last_fullsized":"2024-05-30T16:42:43.961346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:25.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756966+0000","last_change":"2024-05-30T16:42:41.745443+0000","last_active":"2024-05-30T16:42:43.756966+0000","last_peered":"2024-05-30T16:42:43.756966+0000","last_clean":"2024-05-30T16:42:43.756966+0000","last_became_active":"2024-05-30T16:42:41.745166+0000","last_became_peered":"2024-05-30T16:42:41.745166+0000","last_unstale":"2024-05-30T16:42:43.756966+0000","last_undegraded":"2024-05-30T16:42:43.756966+0000","last_fullsized":"2024-05-30T16:42:43.756966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:18.228384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756941+0000","last_change":"2024-05-30T16:42:42.755635+0000","last_active":"2024-05-30T16:42:43.756941+0000","last_peered":"2024-05-30T16:42:43.756941+0000","last_clean":"2024-05-30T16:42:43.756941+0000","last_became_active":"2024-05-30T16:42:42.755407+0000","last_became_peered":"2024-05-30T16:42:42.755407+0000","last_unstale":"2024-05-30T16:42:43.756941+0000","last_undegraded":"2024-05-30T16:42:43.756941+0000","last_fullsized":"2024-05-30T16:42:43.756941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:23.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961441+0000","last_change":"2024-05-30T16:42:41.758475+0000","last_active":"2024-05-30T16:42:43.961441+0000","last_peered":"2024-05-30T16:42:43.961441+0000","last_clean":"2024-05-30T16:42:43.961441+0000","last_became_active":"2024-05-30T16:42:41.758144+0000","last_became_peered":"2024-05-30T16:42:41.758144+0000","last_unstale":"2024-05-30T16:42:43.961441+0000","last_undegraded":"2024-05-30T16:42:43.961441+0000","last_fullsized":"2024-05-30T16:42:43.961441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:35.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056250+0000","last_change":"2024-05-30T16:42:42.744710+0000","last_active":"2024-05-30T16:42:44.056250+0000","last_peered":"2024-05-30T16:42:44.056250+0000","last_clean":"2024-05-30T16:42:44.056250+0000","last_became_active":"2024-05-30T16:42:42.744341+0000","last_became_peered":"2024-05-30T16:42:42.744341+0000","last_unstale":"2024-05-30T16:42:44.056250+0000","last_undegraded":"2024-05-30T16:42:44.056250+0000","last_fullsized":"2024-05-30T16:42:44.056250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:47:36.652618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755680+0000","last_change":"2024-05-30T16:42:41.746534+0000","last_active":"2024-05-30T16:42:43.755680+0000","last_peered":"2024-05-30T16:42:43.755680+0000","last_clean":"2024-05-30T16:42:43.755680+0000","last_became_active":"2024-05-30T16:42:41.744355+0000","last_became_peered":"2024-05-30T16:42:41.744355+0000","last_unstale":"2024-05-30T16:42:43.755680+0000","last_undegraded":"2024-05-30T16:42:43.755680+0000","last_fullsized":"2024-05-30T16:42:43.755680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:59.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056957+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:42:44.056957+0000","last_peered":"2024-05-30T16:42:44.056957+0000","last_clean":"2024-05-30T16:42:44.056957+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:42:44.056957+0000","last_undegraded":"2024-05-30T16:42:44.056957+0000","last_fullsized":"2024-05-30T16:42:44.056957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":724908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":135122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":136084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":136084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":724818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:42:47.177 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:42:47.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.414+0000 7fde5c400640 1 Processor -- start 2024-05-30T16:42:47.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.414+0000 7fde5c400640 1 -- start start 2024-05-30T16:42:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.416+0000 7fde5c400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde5413f760 0x7fde5406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.416+0000 7fde5c400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fde540cec70 0x7fde540b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.416+0000 7fde5c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde540b5e00 0x7fde54142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.416+0000 7fde5c400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fde541612b0 con 0x7fde540cec70 2024-05-30T16:42:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.416+0000 7fde5c400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fde5413fb40 con 0x7fde5413f760 2024-05-30T16:42:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.416+0000 7fde5c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fde5406ee80 con 0x7fde540b5e00 2024-05-30T16:42:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.416+0000 7fde59000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fde540cec70 0x7fde540b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.416+0000 7fde59000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fde540cec70 0x7fde540b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32998/0 (socket says 172.21.15.144:32998) 2024-05-30T16:42:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.416+0000 7fde59000640 1 -- 172.21.15.144:0/1767771856 learned_addr learned my addr 172.21.15.144:0/1767771856 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.417+0000 7fde59000640 1 -- 172.21.15.144:0/1767771856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde540b5e00 msgr2=0x7fde54142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.417+0000 7fde5a400640 1 --2- 172.21.15.144:0/1767771856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde540b5e00 0x7fde54142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.417+0000 7fde59a00640 1 --2- 172.21.15.144:0/1767771856 >> v2:172.21.15.149:3300/0 conn(0x7fde5413f760 0x7fde5406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.417+0000 7fde59000640 1 --2- 172.21.15.144:0/1767771856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde540b5e00 0x7fde54142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.417+0000 7fde59000640 1 -- 172.21.15.144:0/1767771856 >> v2:172.21.15.149:3300/0 conn(0x7fde5413f760 msgr2=0x7fde5406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.417+0000 7fde59000640 1 --2- 172.21.15.144:0/1767771856 >> v2:172.21.15.149:3300/0 conn(0x7fde5413f760 0x7fde5406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.417+0000 7fde59000640 1 -- 172.21.15.144:0/1767771856 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde54160730 con 0x7fde540cec70 2024-05-30T16:42:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.417+0000 7fde5a400640 1 --2- 172.21.15.144:0/1767771856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde540b5e00 0x7fde54142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.418+0000 7fde59000640 1 --2- 172.21.15.144:0/1767771856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 0x7fde540b58c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fde5406e8a0 tx=0x7fde4002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df26ae99cc8abbe7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:47.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.418+0000 7fde53e00640 1 -- 172.21.15.144:0/1767771856 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40036070 con 0x7fde540cec70 2024-05-30T16:42:47.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.418+0000 7fde53e00640 1 -- 172.21.15.144:0/1767771856 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde40031600 con 0x7fde540cec70 2024-05-30T16:42:47.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.418+0000 7fde53e00640 1 -- 172.21.15.144:0/1767771856 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400319d0 con 0x7fde540cec70 2024-05-30T16:42:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.419+0000 7fde5c400640 1 -- 172.21.15.144:0/1767771856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 msgr2=0x7fde540b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.419+0000 7fde5c400640 1 --2- 172.21.15.144:0/1767771856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 0x7fde540b58c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fde5406e8a0 tx=0x7fde4002a730 comp rx=0 tx=0).stop 2024-05-30T16:42:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.419+0000 7fde5c400640 1 -- 172.21.15.144:0/1767771856 shutdown_connections 2024-05-30T16:42:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.419+0000 7fde5c400640 1 --2- 172.21.15.144:0/1767771856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde540b5e00 0x7fde54142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.419+0000 7fde5c400640 1 --2- 172.21.15.144:0/1767771856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 0x7fde540b58c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.419+0000 7fde5c400640 1 --2- 172.21.15.144:0/1767771856 >> v2:172.21.15.149:3300/0 conn(0x7fde5413f760 0x7fde5406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.419+0000 7fde5c400640 1 -- 172.21.15.144:0/1767771856 >> 172.21.15.144:0/1767771856 conn(0x7fde5406bd00 msgr2=0x7fde5406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.419+0000 7fde5c400640 1 -- 172.21.15.144:0/1767771856 shutdown_connections 2024-05-30T16:42:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.419+0000 7fde5c400640 1 -- 172.21.15.144:0/1767771856 wait complete. 2024-05-30T16:42:47.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.421+0000 7fde5c400640 1 Processor -- start 2024-05-30T16:42:47.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.421+0000 7fde5c400640 1 -- start start 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde5c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde540b5e00 0x7fde54159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde5c400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 0x7fde54152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde5c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde5413f760 0x7fde5415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde5c400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde54160fd0 con 0x7fde540cec70 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde5c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fde54160cf0 con 0x7fde540b5e00 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde5c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fde540cf0d0 con 0x7fde5413f760 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde59000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 0x7fde54152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde59000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 0x7fde54152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33014/0 (socket says 172.21.15.144:33014) 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde59000640 1 -- 172.21.15.144:0/663532168 learned_addr learned my addr 172.21.15.144:0/663532168 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde59a00640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde540b5e00 0x7fde54159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.422+0000 7fde5a400640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde5413f760 0x7fde5415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.423+0000 7fde59000640 1 -- 172.21.15.144:0/663532168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde5413f760 msgr2=0x7fde5415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.423+0000 7fde59000640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde5413f760 0x7fde5415aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.423+0000 7fde59000640 1 -- 172.21.15.144:0/663532168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde540b5e00 msgr2=0x7fde54159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.423+0000 7fde59000640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde540b5e00 0x7fde54159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.423+0000 7fde59000640 1 -- 172.21.15.144:0/663532168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5415b410 con 0x7fde540cec70 2024-05-30T16:42:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.423+0000 7fde59000640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 0x7fde54152af0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde40009f40 tx=0x7fde40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.423+0000 7fde51600640 1 -- 172.21.15.144:0/663532168 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4003f020 con 0x7fde540cec70 2024-05-30T16:42:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.424+0000 7fde51600640 1 -- 172.21.15.144:0/663532168 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde40037040 con 0x7fde540cec70 2024-05-30T16:42:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.424+0000 7fde51600640 1 -- 172.21.15.144:0/663532168 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40036070 con 0x7fde540cec70 2024-05-30T16:42:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.424+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5415b6f0 con 0x7fde540cec70 2024-05-30T16:42:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.424+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5415bcb0 con 0x7fde540cec70 2024-05-30T16:42:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.425+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde54068b90 con 0x7fde540cec70 2024-05-30T16:42:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.426+0000 7fde51600640 1 -- 172.21.15.144:0/663532168 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde40042020 con 0x7fde540cec70 2024-05-30T16:42:47.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.427+0000 7fde51600640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde3406c8f0 0x7fde3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.427+0000 7fde51600640 1 -- 172.21.15.144:0/663532168 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fde400abf30 con 0x7fde540cec70 2024-05-30T16:42:47.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.427+0000 7fde59a00640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde3406c8f0 0x7fde3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.428+0000 7fde59a00640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde3406c8f0 0x7fde3406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde4400aa20 tx=0x7fde44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:47.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.431+0000 7fde51600640 1 -- 172.21.15.144:0/663532168 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde40049030 con 0x7fde540cec70 2024-05-30T16:42:47.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.627+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde540af690 con 0x7fde3406c8f0 2024-05-30T16:42:47.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.647+0000 7fde51600640 1 -- 172.21.15.144:0/663532168 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7fde540af690 con 0x7fde3406c8f0 2024-05-30T16:42:47.649 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:47.652 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:42:47.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde3406c8f0 msgr2=0x7fde3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde3406c8f0 0x7fde3406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde4400aa20 tx=0x7fde44008040 comp rx=0 tx=0).stop 2024-05-30T16:42:47.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 msgr2=0x7fde54152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 0x7fde54152af0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde40009f40 tx=0x7fde40004a40 comp rx=0 tx=0).stop 2024-05-30T16:42:47.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 shutdown_connections 2024-05-30T16:42:47.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde3406c8f0 0x7fde3406edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde5413f760 0x7fde5415aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde540cec70 0x7fde54152af0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 --2- 172.21.15.144:0/663532168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde540b5e00 0x7fde54159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 >> 172.21.15.144:0/663532168 conn(0x7fde5406bd00 msgr2=0x7fde5406e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:47.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 shutdown_connections 2024-05-30T16:42:47.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.654+0000 7fde5c400640 1 -- 172.21.15.144:0/663532168 wait complete. 2024-05-30T16:42:47.673 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-05-30T16:42:46.910626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220128,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754592,"statfs":{"total":773094113280,"available":772868702208,"internally_reserved":0,"allocated":4038656,"data_stored":2261156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001767"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756029+0000","last_change":"2024-05-30T16:42:42.751587+0000","last_active":"2024-05-30T16:42:43.756029+0000","last_peered":"2024-05-30T16:42:43.756029+0000","last_clean":"2024-05-30T16:42:43.756029+0000","last_became_active":"2024-05-30T16:42:42.750666+0000","last_became_peered":"2024-05-30T16:42:42.750666+0000","last_unstale":"2024-05-30T16:42:43.756029+0000","last_undegraded":"2024-05-30T16:42:43.756029+0000","last_fullsized":"2024-05-30T16:42:43.756029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:38:49.036025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962594+0000","last_change":"2024-05-30T16:42:42.759317+0000","last_active":"2024-05-30T16:42:43.962594+0000","last_peered":"2024-05-30T16:42:43.962594+0000","last_clean":"2024-05-30T16:42:43.962594+0000","last_became_active":"2024-05-30T16:42:42.757958+0000","last_became_peered":"2024-05-30T16:42:42.757958+0000","last_unstale":"2024-05-30T16:42:43.962594+0000","last_undegraded":"2024-05-30T16:42:43.962594+0000","last_fullsized":"2024-05-30T16:42:43.962594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:16:59.328423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056321+0000","last_change":"2024-05-30T16:42:42.760808+0000","last_active":"2024-05-30T16:42:44.056321+0000","last_peered":"2024-05-30T16:42:44.056321+0000","last_clean":"2024-05-30T16:42:44.056321+0000","last_became_active":"2024-05-30T16:42:42.760514+0000","last_became_peered":"2024-05-30T16:42:42.760514+0000","last_unstale":"2024-05-30T16:42:44.056321+0000","last_undegraded":"2024-05-30T16:42:44.056321+0000","last_fullsized":"2024-05-30T16:42:44.056321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:09.743258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.053830+0000","last_change":"2024-05-30T16:42:42.753374+0000","last_active":"2024-05-30T16:42:44.053830+0000","last_peered":"2024-05-30T16:42:44.053830+0000","last_clean":"2024-05-30T16:42:44.053830+0000","last_became_active":"2024-05-30T16:42:42.752998+0000","last_became_peered":"2024-05-30T16:42:42.752998+0000","last_unstale":"2024-05-30T16:42:44.053830+0000","last_undegraded":"2024-05-30T16:42:44.053830+0000","last_fullsized":"2024-05-30T16:42:44.053830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:26:38.580865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056077+0000","last_change":"2024-05-30T16:42:42.755189+0000","last_active":"2024-05-30T16:42:44.056077+0000","last_peered":"2024-05-30T16:42:44.056077+0000","last_clean":"2024-05-30T16:42:44.056077+0000","last_became_active":"2024-05-30T16:42:42.754528+0000","last_became_peered":"2024-05-30T16:42:42.754528+0000","last_unstale":"2024-05-30T16:42:44.056077+0000","last_undegraded":"2024-05-30T16:42:44.056077+0000","last_fullsized":"2024-05-30T16:42:44.056077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:55.269471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961728+0000","last_change":"2024-05-30T16:42:42.750059+0000","last_active":"2024-05-30T16:42:43.961728+0000","last_peered":"2024-05-30T16:42:43.961728+0000","last_clean":"2024-05-30T16:42:43.961728+0000","last_became_active":"2024-05-30T16:42:42.749719+0000","last_became_peered":"2024-05-30T16:42:42.749719+0000","last_unstale":"2024-05-30T16:42:43.961728+0000","last_undegraded":"2024-05-30T16:42:43.961728+0000","last_fullsized":"2024-05-30T16:42:43.961728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:09.743258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055003+0000","last_change":"2024-05-30T16:42:42.737475+0000","last_active":"2024-05-30T16:42:44.055003+0000","last_peered":"2024-05-30T16:42:44.055003+0000","last_clean":"2024-05-30T16:42:44.055003+0000","last_became_active":"2024-05-30T16:42:42.736800+0000","last_became_peered":"2024-05-30T16:42:42.736800+0000","last_unstale":"2024-05-30T16:42:44.055003+0000","last_undegraded":"2024-05-30T16:42:44.055003+0000","last_fullsized":"2024-05-30T16:42:44.055003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:21.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054530+0000","last_change":"2024-05-30T16:42:42.746813+0000","last_active":"2024-05-30T16:42:44.054530+0000","last_peered":"2024-05-30T16:42:44.054530+0000","last_clean":"2024-05-30T16:42:44.054530+0000","last_became_active":"2024-05-30T16:42:42.745229+0000","last_became_peered":"2024-05-30T16:42:42.745229+0000","last_unstale":"2024-05-30T16:42:44.054530+0000","last_undegraded":"2024-05-30T16:42:44.054530+0000","last_fullsized":"2024-05-30T16:42:44.054530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:09.743258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757926+0000","last_change":"2024-05-30T16:42:42.753096+0000","last_active":"2024-05-30T16:42:43.757926+0000","last_peered":"2024-05-30T16:42:43.757926+0000","last_clean":"2024-05-30T16:42:43.757926+0000","last_became_active":"2024-05-30T16:42:42.752746+0000","last_became_peered":"2024-05-30T16:42:42.752746+0000","last_unstale":"2024-05-30T16:42:43.757926+0000","last_undegraded":"2024-05-30T16:42:43.757926+0000","last_fullsized":"2024-05-30T16:42:43.757926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:42.521056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054341+0000","last_change":"2024-05-30T16:42:42.759512+0000","last_active":"2024-05-30T16:42:44.054341+0000","last_peered":"2024-05-30T16:42:44.054341+0000","last_clean":"2024-05-30T16:42:44.054341+0000","last_became_active":"2024-05-30T16:42:42.756159+0000","last_became_peered":"2024-05-30T16:42:42.756159+0000","last_unstale":"2024-05-30T16:42:44.054341+0000","last_undegraded":"2024-05-30T16:42:44.054341+0000","last_fullsized":"2024-05-30T16:42:44.054341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:20:24.238664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056449+0000","last_change":"2024-05-30T16:42:42.750039+0000","last_active":"2024-05-30T16:42:44.056449+0000","last_peered":"2024-05-30T16:42:44.056449+0000","last_clean":"2024-05-30T16:42:44.056449+0000","last_became_active":"2024-05-30T16:42:42.749740+0000","last_became_peered":"2024-05-30T16:42:42.749740+0000","last_unstale":"2024-05-30T16:42:44.056449+0000","last_undegraded":"2024-05-30T16:42:44.056449+0000","last_fullsized":"2024-05-30T16:42:44.056449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:42:29.748462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055922+0000","last_change":"2024-05-30T16:42:42.750413+0000","last_active":"2024-05-30T16:42:44.055922+0000","last_peered":"2024-05-30T16:42:44.055922+0000","last_clean":"2024-05-30T16:42:44.055922+0000","last_became_active":"2024-05-30T16:42:42.750007+0000","last_became_peered":"2024-05-30T16:42:42.750007+0000","last_unstale":"2024-05-30T16:42:44.055922+0000","last_undegraded":"2024-05-30T16:42:44.055922+0000","last_fullsized":"2024-05-30T16:42:44.055922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:08:57.303506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056133+0000","last_change":"2024-05-30T16:42:42.746499+0000","last_active":"2024-05-30T16:42:44.056133+0000","last_peered":"2024-05-30T16:42:44.056133+0000","last_clean":"2024-05-30T16:42:44.056133+0000","last_became_active":"2024-05-30T16:42:42.745755+0000","last_became_peered":"2024-05-30T16:42:42.745755+0000","last_unstale":"2024-05-30T16:42:44.056133+0000","last_undegraded":"2024-05-30T16:42:44.056133+0000","last_fullsized":"2024-05-30T16:42:44.056133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:56:01.301428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961906+0000","last_change":"2024-05-30T16:42:42.757776+0000","last_active":"2024-05-30T16:42:43.961906+0000","last_peered":"2024-05-30T16:42:43.961906+0000","last_clean":"2024-05-30T16:42:43.961906+0000","last_became_active":"2024-05-30T16:42:42.754897+0000","last_became_peered":"2024-05-30T16:42:42.754897+0000","last_unstale":"2024-05-30T16:42:43.961906+0000","last_undegraded":"2024-05-30T16:42:43.961906+0000","last_fullsized":"2024-05-30T16:42:43.961906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:45.024839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055618+0000","last_change":"2024-05-30T16:42:42.754518+0000","last_active":"2024-05-30T16:42:44.055618+0000","last_peered":"2024-05-30T16:42:44.055618+0000","last_clean":"2024-05-30T16:42:44.055618+0000","last_became_active":"2024-05-30T16:42:42.753028+0000","last_became_peered":"2024-05-30T16:42:42.753028+0000","last_unstale":"2024-05-30T16:42:44.055618+0000","last_undegraded":"2024-05-30T16:42:44.055618+0000","last_fullsized":"2024-05-30T16:42:44.055618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:51:39.829308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056914+0000","last_change":"2024-05-30T16:42:42.754322+0000","last_active":"2024-05-30T16:42:44.056914+0000","last_peered":"2024-05-30T16:42:44.056914+0000","last_clean":"2024-05-30T16:42:44.056914+0000","last_became_active":"2024-05-30T16:42:42.753996+0000","last_became_peered":"2024-05-30T16:42:42.753996+0000","last_unstale":"2024-05-30T16:42:44.056914+0000","last_undegraded":"2024-05-30T16:42:44.056914+0000","last_fullsized":"2024-05-30T16:42:44.056914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:22:50.638515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.057576+0000","last_change":"2024-05-30T16:42:42.746413+0000","last_active":"2024-05-30T16:42:44.057576+0000","last_peered":"2024-05-30T16:42:44.057576+0000","last_clean":"2024-05-30T16:42:44.057576+0000","last_became_active":"2024-05-30T16:42:42.744307+0000","last_became_peered":"2024-05-30T16:42:42.744307+0000","last_unstale":"2024-05-30T16:42:44.057576+0000","last_undegraded":"2024-05-30T16:42:44.057576+0000","last_fullsized":"2024-05-30T16:42:44.057576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:26:20.151471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962433+0000","last_change":"2024-05-30T16:42:42.754256+0000","last_active":"2024-05-30T16:42:43.962433+0000","last_peered":"2024-05-30T16:42:43.962433+0000","last_clean":"2024-05-30T16:42:43.962433+0000","last_became_active":"2024-05-30T16:42:42.753909+0000","last_became_peered":"2024-05-30T16:42:42.753909+0000","last_unstale":"2024-05-30T16:42:43.962433+0000","last_undegraded":"2024-05-30T16:42:43.962433+0000","last_fullsized":"2024-05-30T16:42:43.962433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:22.664691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962144+0000","last_change":"2024-05-30T16:42:42.754775+0000","last_active":"2024-05-30T16:42:43.962144+0000","last_peered":"2024-05-30T16:42:43.962144+0000","last_clean":"2024-05-30T16:42:43.962144+0000","last_became_active":"2024-05-30T16:42:42.753333+0000","last_became_peered":"2024-05-30T16:42:42.753333+0000","last_unstale":"2024-05-30T16:42:43.962144+0000","last_undegraded":"2024-05-30T16:42:43.962144+0000","last_fullsized":"2024-05-30T16:42:43.962144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:21.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056562+0000","last_change":"2024-05-30T16:42:42.746446+0000","last_active":"2024-05-30T16:42:44.056562+0000","last_peered":"2024-05-30T16:42:44.056562+0000","last_clean":"2024-05-30T16:42:44.056562+0000","last_became_active":"2024-05-30T16:42:42.746142+0000","last_became_peered":"2024-05-30T16:42:42.746142+0000","last_unstale":"2024-05-30T16:42:44.056562+0000","last_undegraded":"2024-05-30T16:42:44.056562+0000","last_fullsized":"2024-05-30T16:42:44.056562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:53.489399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756930+0000","last_change":"2024-05-30T16:42:42.752906+0000","last_active":"2024-05-30T16:42:43.756930+0000","last_peered":"2024-05-30T16:42:43.756930+0000","last_clean":"2024-05-30T16:42:43.756930+0000","last_became_active":"2024-05-30T16:42:42.752045+0000","last_became_peered":"2024-05-30T16:42:42.752045+0000","last_unstale":"2024-05-30T16:42:43.756930+0000","last_undegraded":"2024-05-30T16:42:43.756930+0000","last_fullsized":"2024-05-30T16:42:43.756930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:00.798641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757981+0000","last_change":"2024-05-30T16:42:42.755256+0000","last_active":"2024-05-30T16:42:43.757981+0000","last_peered":"2024-05-30T16:42:43.757981+0000","last_clean":"2024-05-30T16:42:43.757981+0000","last_became_active":"2024-05-30T16:42:42.754146+0000","last_became_peered":"2024-05-30T16:42:42.754146+0000","last_unstale":"2024-05-30T16:42:43.757981+0000","last_undegraded":"2024-05-30T16:42:43.757981+0000","last_fullsized":"2024-05-30T16:42:43.757981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:20:24.238664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753086+0000","last_change":"2024-05-30T16:42:42.743574+0000","last_active":"2024-05-30T16:42:43.753086+0000","last_peered":"2024-05-30T16:42:43.753086+0000","last_clean":"2024-05-30T16:42:43.753086+0000","last_became_active":"2024-05-30T16:42:42.743305+0000","last_became_peered":"2024-05-30T16:42:42.743305+0000","last_unstale":"2024-05-30T16:42:43.753086+0000","last_undegraded":"2024-05-30T16:42:43.753086+0000","last_fullsized":"2024-05-30T16:42:43.753086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:00.798641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055322+0000","last_change":"2024-05-30T16:42:42.757774+0000","last_active":"2024-05-30T16:42:44.055322+0000","last_peered":"2024-05-30T16:42:44.055322+0000","last_clean":"2024-05-30T16:42:44.055322+0000","last_became_active":"2024-05-30T16:42:42.757564+0000","last_became_peered":"2024-05-30T16:42:42.757564+0000","last_unstale":"2024-05-30T16:42:44.055322+0000","last_undegraded":"2024-05-30T16:42:44.055322+0000","last_fullsized":"2024-05-30T16:42:44.055322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:01:35.750026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054327+0000","last_change":"2024-05-30T16:42:42.751133+0000","last_active":"2024-05-30T16:42:44.054327+0000","last_peered":"2024-05-30T16:42:44.054327+0000","last_clean":"2024-05-30T16:42:44.054327+0000","last_became_active":"2024-05-30T16:42:42.750791+0000","last_became_peered":"2024-05-30T16:42:42.750791+0000","last_unstale":"2024-05-30T16:42:44.054327+0000","last_undegraded":"2024-05-30T16:42:44.054327+0000","last_fullsized":"2024-05-30T16:42:44.054327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:55:41.225189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962595+0000","last_change":"2024-05-30T16:42:42.752952+0000","last_active":"2024-05-30T16:42:43.962595+0000","last_peered":"2024-05-30T16:42:43.962595+0000","last_clean":"2024-05-30T16:42:43.962595+0000","last_became_active":"2024-05-30T16:42:42.752739+0000","last_became_peered":"2024-05-30T16:42:42.752739+0000","last_unstale":"2024-05-30T16:42:43.962595+0000","last_undegraded":"2024-05-30T16:42:43.962595+0000","last_fullsized":"2024-05-30T16:42:43.962595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:42:29.748462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054616+0000","last_change":"2024-05-30T16:42:42.755635+0000","last_active":"2024-05-30T16:42:44.054616+0000","last_peered":"2024-05-30T16:42:44.054616+0000","last_clean":"2024-05-30T16:42:44.054616+0000","last_became_active":"2024-05-30T16:42:42.755399+0000","last_became_peered":"2024-05-30T16:42:42.755399+0000","last_unstale":"2024-05-30T16:42:44.054616+0000","last_undegraded":"2024-05-30T16:42:44.054616+0000","last_fullsized":"2024-05-30T16:42:44.054616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:38:41.595493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056371+0000","last_change":"2024-05-30T16:42:42.752470+0000","last_active":"2024-05-30T16:42:44.056371+0000","last_peered":"2024-05-30T16:42:44.056371+0000","last_clean":"2024-05-30T16:42:44.056371+0000","last_became_active":"2024-05-30T16:42:42.752202+0000","last_became_peered":"2024-05-30T16:42:42.752202+0000","last_unstale":"2024-05-30T16:42:44.056371+0000","last_undegraded":"2024-05-30T16:42:44.056371+0000","last_fullsized":"2024-05-30T16:42:44.056371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:10.874134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757141+0000","last_change":"2024-05-30T16:42:42.756264+0000","last_active":"2024-05-30T16:42:43.757141+0000","last_peered":"2024-05-30T16:42:43.757141+0000","last_clean":"2024-05-30T16:42:43.757141+0000","last_became_active":"2024-05-30T16:42:42.754661+0000","last_became_peered":"2024-05-30T16:42:42.754661+0000","last_unstale":"2024-05-30T16:42:43.757141+0000","last_undegraded":"2024-05-30T16:42:43.757141+0000","last_fullsized":"2024-05-30T16:42:43.757141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:01:12.047292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055899+0000","last_change":"2024-05-30T16:42:42.741720+0000","last_active":"2024-05-30T16:42:44.055899+0000","last_peered":"2024-05-30T16:42:44.055899+0000","last_clean":"2024-05-30T16:42:44.055899+0000","last_became_active":"2024-05-30T16:42:42.741408+0000","last_became_peered":"2024-05-30T16:42:42.741408+0000","last_unstale":"2024-05-30T16:42:44.055899+0000","last_undegraded":"2024-05-30T16:42:44.055899+0000","last_fullsized":"2024-05-30T16:42:44.055899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:09:22.664691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755376+0000","last_change":"2024-05-30T16:42:42.756471+0000","last_active":"2024-05-30T16:42:43.755376+0000","last_peered":"2024-05-30T16:42:43.755376+0000","last_clean":"2024-05-30T16:42:43.755376+0000","last_became_active":"2024-05-30T16:42:42.755539+0000","last_became_peered":"2024-05-30T16:42:42.755539+0000","last_unstale":"2024-05-30T16:42:43.755376+0000","last_undegraded":"2024-05-30T16:42:43.755376+0000","last_fullsized":"2024-05-30T16:42:43.755376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:11:39.422648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054598+0000","last_change":"2024-05-30T16:42:42.752541+0000","last_active":"2024-05-30T16:42:44.054598+0000","last_peered":"2024-05-30T16:42:44.054598+0000","last_clean":"2024-05-30T16:42:44.054598+0000","last_became_active":"2024-05-30T16:42:42.752290+0000","last_became_peered":"2024-05-30T16:42:42.752290+0000","last_unstale":"2024-05-30T16:42:44.054598+0000","last_undegraded":"2024-05-30T16:42:44.054598+0000","last_fullsized":"2024-05-30T16:42:44.054598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:10.874134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.754023+0000","last_change":"2024-05-30T16:42:42.744868+0000","last_active":"2024-05-30T16:42:43.754023+0000","last_peered":"2024-05-30T16:42:43.754023+0000","last_clean":"2024-05-30T16:42:43.754023+0000","last_became_active":"2024-05-30T16:42:42.744630+0000","last_became_peered":"2024-05-30T16:42:42.744630+0000","last_unstale":"2024-05-30T16:42:43.754023+0000","last_undegraded":"2024-05-30T16:42:43.754023+0000","last_fullsized":"2024-05-30T16:42:43.754023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:01:12.047292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756133+0000","last_change":"2024-05-30T16:42:41.743244+0000","last_active":"2024-05-30T16:42:43.756133+0000","last_peered":"2024-05-30T16:42:43.756133+0000","last_clean":"2024-05-30T16:42:43.756133+0000","last_became_active":"2024-05-30T16:42:41.742009+0000","last_became_peered":"2024-05-30T16:42:41.742009+0000","last_unstale":"2024-05-30T16:42:43.756133+0000","last_undegraded":"2024-05-30T16:42:43.756133+0000","last_fullsized":"2024-05-30T16:42:43.756133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:47.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756361+0000","last_change":"2024-05-30T16:42:42.743976+0000","last_active":"2024-05-30T16:42:43.756361+0000","last_peered":"2024-05-30T16:42:43.756361+0000","last_clean":"2024-05-30T16:42:43.756361+0000","last_became_active":"2024-05-30T16:42:42.743664+0000","last_became_peered":"2024-05-30T16:42:42.743664+0000","last_unstale":"2024-05-30T16:42:43.756361+0000","last_undegraded":"2024-05-30T16:42:43.756361+0000","last_fullsized":"2024-05-30T16:42:43.756361+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:01:12.047292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.754205+0000","last_change":"2024-05-30T16:42:41.750126+0000","last_active":"2024-05-30T16:42:43.754205+0000","last_peered":"2024-05-30T16:42:43.754205+0000","last_clean":"2024-05-30T16:42:43.754205+0000","last_became_active":"2024-05-30T16:42:41.749868+0000","last_became_peered":"2024-05-30T16:42:41.749868+0000","last_unstale":"2024-05-30T16:42:43.754205+0000","last_undegraded":"2024-05-30T16:42:43.754205+0000","last_fullsized":"2024-05-30T16:42:43.754205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:48:31.987774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757638+0000","last_change":"2024-05-30T16:42:42.755320+0000","last_active":"2024-05-30T16:42:43.757638+0000","last_peered":"2024-05-30T16:42:43.757638+0000","last_clean":"2024-05-30T16:42:43.757638+0000","last_became_active":"2024-05-30T16:42:42.753561+0000","last_became_peered":"2024-05-30T16:42:42.753561+0000","last_unstale":"2024-05-30T16:42:43.757638+0000","last_undegraded":"2024-05-30T16:42:43.757638+0000","last_fullsized":"2024-05-30T16:42:43.757638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:29:08.687823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961877+0000","last_change":"2024-05-30T16:42:41.742647+0000","last_active":"2024-05-30T16:42:43.961877+0000","last_peered":"2024-05-30T16:42:43.961877+0000","last_clean":"2024-05-30T16:42:43.961877+0000","last_became_active":"2024-05-30T16:42:41.742376+0000","last_became_peered":"2024-05-30T16:42:41.742376+0000","last_unstale":"2024-05-30T16:42:43.961877+0000","last_undegraded":"2024-05-30T16:42:43.961877+0000","last_fullsized":"2024-05-30T16:42:43.961877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:22.690394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054893+0000","last_change":"2024-05-30T16:42:42.755110+0000","last_active":"2024-05-30T16:42:44.054893+0000","last_peered":"2024-05-30T16:42:44.054893+0000","last_clean":"2024-05-30T16:42:44.054893+0000","last_became_active":"2024-05-30T16:42:42.754424+0000","last_became_peered":"2024-05-30T16:42:42.754424+0000","last_unstale":"2024-05-30T16:42:44.054893+0000","last_undegraded":"2024-05-30T16:42:44.054893+0000","last_fullsized":"2024-05-30T16:42:44.054893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:51:39.829308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056489+0000","last_change":"2024-05-30T16:42:41.740532+0000","last_active":"2024-05-30T16:42:44.056489+0000","last_peered":"2024-05-30T16:42:44.056489+0000","last_clean":"2024-05-30T16:42:44.056489+0000","last_became_active":"2024-05-30T16:42:41.740005+0000","last_became_peered":"2024-05-30T16:42:41.740005+0000","last_unstale":"2024-05-30T16:42:44.056489+0000","last_undegraded":"2024-05-30T16:42:44.056489+0000","last_fullsized":"2024-05-30T16:42:44.056489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:33:00.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056321+0000","last_change":"2024-05-30T16:42:42.755551+0000","last_active":"2024-05-30T16:42:44.056321+0000","last_peered":"2024-05-30T16:42:44.056321+0000","last_clean":"2024-05-30T16:42:44.056321+0000","last_became_active":"2024-05-30T16:42:42.754330+0000","last_became_peered":"2024-05-30T16:42:42.754330+0000","last_unstale":"2024-05-30T16:42:44.056321+0000","last_undegraded":"2024-05-30T16:42:44.056321+0000","last_fullsized":"2024-05-30T16:42:44.056321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:16:59.328423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757211+0000","last_change":"2024-05-30T16:42:41.748238+0000","last_active":"2024-05-30T16:42:43.757211+0000","last_peered":"2024-05-30T16:42:43.757211+0000","last_clean":"2024-05-30T16:42:43.757211+0000","last_became_active":"2024-05-30T16:42:41.746951+0000","last_became_peered":"2024-05-30T16:42:41.746951+0000","last_unstale":"2024-05-30T16:42:43.757211+0000","last_undegraded":"2024-05-30T16:42:43.757211+0000","last_fullsized":"2024-05-30T16:42:43.757211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:54.248310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055427+0000","last_change":"2024-05-30T16:42:42.760224+0000","last_active":"2024-05-30T16:42:44.055427+0000","last_peered":"2024-05-30T16:42:44.055427+0000","last_clean":"2024-05-30T16:42:44.055427+0000","last_became_active":"2024-05-30T16:42:42.759294+0000","last_became_peered":"2024-05-30T16:42:42.759294+0000","last_unstale":"2024-05-30T16:42:44.055427+0000","last_undegraded":"2024-05-30T16:42:44.055427+0000","last_fullsized":"2024-05-30T16:42:44.055427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:38:41.595493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757377+0000","last_change":"2024-05-30T16:42:41.747787+0000","last_active":"2024-05-30T16:42:43.757377+0000","last_peered":"2024-05-30T16:42:43.757377+0000","last_clean":"2024-05-30T16:42:43.757377+0000","last_became_active":"2024-05-30T16:42:41.744920+0000","last_became_peered":"2024-05-30T16:42:41.744920+0000","last_unstale":"2024-05-30T16:42:43.757377+0000","last_undegraded":"2024-05-30T16:42:43.757377+0000","last_fullsized":"2024-05-30T16:42:43.757377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:41.071633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757650+0000","last_change":"2024-05-30T16:42:42.743773+0000","last_active":"2024-05-30T16:42:43.757650+0000","last_peered":"2024-05-30T16:42:43.757650+0000","last_clean":"2024-05-30T16:42:43.757650+0000","last_became_active":"2024-05-30T16:42:42.743505+0000","last_became_peered":"2024-05-30T16:42:42.743505+0000","last_unstale":"2024-05-30T16:42:43.757650+0000","last_undegraded":"2024-05-30T16:42:43.757650+0000","last_fullsized":"2024-05-30T16:42:43.757650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:26:38.580865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961019+0000","last_change":"2024-05-30T16:42:41.738656+0000","last_active":"2024-05-30T16:42:43.961019+0000","last_peered":"2024-05-30T16:42:43.961019+0000","last_clean":"2024-05-30T16:42:43.961019+0000","last_became_active":"2024-05-30T16:42:41.738399+0000","last_became_peered":"2024-05-30T16:42:41.738399+0000","last_unstale":"2024-05-30T16:42:43.961019+0000","last_undegraded":"2024-05-30T16:42:43.961019+0000","last_fullsized":"2024-05-30T16:42:43.961019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:54:35.876656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.053926+0000","last_change":"2024-05-30T16:42:42.749790+0000","last_active":"2024-05-30T16:42:44.053926+0000","last_peered":"2024-05-30T16:42:44.053926+0000","last_clean":"2024-05-30T16:42:44.053926+0000","last_became_active":"2024-05-30T16:42:42.749517+0000","last_became_peered":"2024-05-30T16:42:42.749517+0000","last_unstale":"2024-05-30T16:42:44.053926+0000","last_undegraded":"2024-05-30T16:42:44.053926+0000","last_fullsized":"2024-05-30T16:42:44.053926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:29:08.687823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756618+0000","last_change":"2024-05-30T16:42:41.742690+0000","last_active":"2024-05-30T16:42:43.756618+0000","last_peered":"2024-05-30T16:42:43.756618+0000","last_clean":"2024-05-30T16:42:43.756618+0000","last_became_active":"2024-05-30T16:42:41.742472+0000","last_became_peered":"2024-05-30T16:42:41.742472+0000","last_unstale":"2024-05-30T16:42:43.756618+0000","last_undegraded":"2024-05-30T16:42:43.756618+0000","last_fullsized":"2024-05-30T16:42:43.756618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:12:56.385694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055802+0000","last_change":"2024-05-30T16:42:42.750346+0000","last_active":"2024-05-30T16:42:44.055802+0000","last_peered":"2024-05-30T16:42:44.055802+0000","last_clean":"2024-05-30T16:42:44.055802+0000","last_became_active":"2024-05-30T16:42:42.750072+0000","last_became_peered":"2024-05-30T16:42:42.750072+0000","last_unstale":"2024-05-30T16:42:44.055802+0000","last_undegraded":"2024-05-30T16:42:44.055802+0000","last_fullsized":"2024-05-30T16:42:44.055802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:21:09.349326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962613+0000","last_change":"2024-05-30T16:42:41.750992+0000","last_active":"2024-05-30T16:42:43.962613+0000","last_peered":"2024-05-30T16:42:43.962613+0000","last_clean":"2024-05-30T16:42:43.962613+0000","last_became_active":"2024-05-30T16:42:41.750716+0000","last_became_peered":"2024-05-30T16:42:41.750716+0000","last_unstale":"2024-05-30T16:42:43.962613+0000","last_undegraded":"2024-05-30T16:42:43.962613+0000","last_fullsized":"2024-05-30T16:42:43.962613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:01:11.026130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962855+0000","last_change":"2024-05-30T16:42:42.754988+0000","last_active":"2024-05-30T16:42:43.962855+0000","last_peered":"2024-05-30T16:42:43.962855+0000","last_clean":"2024-05-30T16:42:43.962855+0000","last_became_active":"2024-05-30T16:42:42.754201+0000","last_became_peered":"2024-05-30T16:42:42.754201+0000","last_unstale":"2024-05-30T16:42:43.962855+0000","last_undegraded":"2024-05-30T16:42:43.962855+0000","last_fullsized":"2024-05-30T16:42:43.962855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:49:55.903916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.754410+0000","last_change":"2024-05-30T16:42:41.741044+0000","last_active":"2024-05-30T16:42:43.754410+0000","last_peered":"2024-05-30T16:42:43.754410+0000","last_clean":"2024-05-30T16:42:43.754410+0000","last_became_active":"2024-05-30T16:42:41.740734+0000","last_became_peered":"2024-05-30T16:42:41.740734+0000","last_unstale":"2024-05-30T16:42:43.754410+0000","last_undegraded":"2024-05-30T16:42:43.754410+0000","last_fullsized":"2024-05-30T16:42:43.754410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:08:11.081820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962529+0000","last_change":"2024-05-30T16:42:42.762163+0000","last_active":"2024-05-30T16:42:43.962529+0000","last_peered":"2024-05-30T16:42:43.962529+0000","last_clean":"2024-05-30T16:42:43.962529+0000","last_became_active":"2024-05-30T16:42:42.761769+0000","last_became_peered":"2024-05-30T16:42:42.761769+0000","last_unstale":"2024-05-30T16:42:43.962529+0000","last_undegraded":"2024-05-30T16:42:43.962529+0000","last_fullsized":"2024-05-30T16:42:43.962529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:47:36.652618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056428+0000","last_change":"2024-05-30T16:42:41.752758+0000","last_active":"2024-05-30T16:42:44.056428+0000","last_peered":"2024-05-30T16:42:44.056428+0000","last_clean":"2024-05-30T16:42:44.056428+0000","last_became_active":"2024-05-30T16:42:41.752402+0000","last_became_peered":"2024-05-30T16:42:41.752402+0000","last_unstale":"2024-05-30T16:42:44.056428+0000","last_undegraded":"2024-05-30T16:42:44.056428+0000","last_fullsized":"2024-05-30T16:42:44.056428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:25:19.288583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056277+0000","last_change":"2024-05-30T16:42:42.761000+0000","last_active":"2024-05-30T16:42:44.056277+0000","last_peered":"2024-05-30T16:42:44.056277+0000","last_clean":"2024-05-30T16:42:44.056277+0000","last_became_active":"2024-05-30T16:42:42.760705+0000","last_became_peered":"2024-05-30T16:42:42.760705+0000","last_unstale":"2024-05-30T16:42:44.056277+0000","last_undegraded":"2024-05-30T16:42:44.056277+0000","last_fullsized":"2024-05-30T16:42:44.056277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:25.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.962342+0000","last_change":"2024-05-30T16:42:41.738190+0000","last_active":"2024-05-30T16:42:43.962342+0000","last_peered":"2024-05-30T16:42:43.962342+0000","last_clean":"2024-05-30T16:42:43.962342+0000","last_became_active":"2024-05-30T16:42:41.737720+0000","last_became_peered":"2024-05-30T16:42:41.737720+0000","last_unstale":"2024-05-30T16:42:43.962342+0000","last_undegraded":"2024-05-30T16:42:43.962342+0000","last_fullsized":"2024-05-30T16:42:43.962342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:03:59.777480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054409+0000","last_change":"2024-05-30T16:42:42.754803+0000","last_active":"2024-05-30T16:42:44.054409+0000","last_peered":"2024-05-30T16:42:44.054409+0000","last_clean":"2024-05-30T16:42:44.054409+0000","last_became_active":"2024-05-30T16:42:42.754389+0000","last_became_peered":"2024-05-30T16:42:42.754389+0000","last_unstale":"2024-05-30T16:42:44.054409+0000","last_undegraded":"2024-05-30T16:42:44.054409+0000","last_fullsized":"2024-05-30T16:42:44.054409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:01:35.750026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757355+0000","last_change":"2024-05-30T16:42:41.743284+0000","last_active":"2024-05-30T16:42:43.757355+0000","last_peered":"2024-05-30T16:42:43.757355+0000","last_clean":"2024-05-30T16:42:43.757355+0000","last_became_active":"2024-05-30T16:42:41.742539+0000","last_became_peered":"2024-05-30T16:42:41.742539+0000","last_unstale":"2024-05-30T16:42:43.757355+0000","last_undegraded":"2024-05-30T16:42:43.757355+0000","last_fullsized":"2024-05-30T16:42:43.757355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:56:00.280266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961760+0000","last_change":"2024-05-30T16:42:42.739254+0000","last_active":"2024-05-30T16:42:43.961760+0000","last_peered":"2024-05-30T16:42:43.961760+0000","last_clean":"2024-05-30T16:42:43.961760+0000","last_became_active":"2024-05-30T16:42:42.738933+0000","last_became_peered":"2024-05-30T16:42:42.738933+0000","last_unstale":"2024-05-30T16:42:43.961760+0000","last_undegraded":"2024-05-30T16:42:43.961760+0000","last_fullsized":"2024-05-30T16:42:43.961760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:07:10.874134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.053648+0000","last_change":"2024-05-30T16:42:41.746465+0000","last_active":"2024-05-30T16:42:44.053648+0000","last_peered":"2024-05-30T16:42:44.053648+0000","last_clean":"2024-05-30T16:42:44.053648+0000","last_became_active":"2024-05-30T16:42:41.746127+0000","last_became_peered":"2024-05-30T16:42:41.746127+0000","last_unstale":"2024-05-30T16:42:44.053648+0000","last_undegraded":"2024-05-30T16:42:44.053648+0000","last_fullsized":"2024-05-30T16:42:44.053648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:47.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056822+0000","last_change":"2024-05-30T16:42:42.746765+0000","last_active":"2024-05-30T16:42:44.056822+0000","last_peered":"2024-05-30T16:42:44.056822+0000","last_clean":"2024-05-30T16:42:44.056822+0000","last_became_active":"2024-05-30T16:42:42.746498+0000","last_became_peered":"2024-05-30T16:42:42.746498+0000","last_unstale":"2024-05-30T16:42:44.056822+0000","last_undegraded":"2024-05-30T16:42:44.056822+0000","last_fullsized":"2024-05-30T16:42:44.056822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:49:55.903916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961096+0000","last_change":"2024-05-30T16:42:41.750992+0000","last_active":"2024-05-30T16:42:43.961096+0000","last_peered":"2024-05-30T16:42:43.961096+0000","last_clean":"2024-05-30T16:42:43.961096+0000","last_became_active":"2024-05-30T16:42:41.750704+0000","last_became_peered":"2024-05-30T16:42:41.750704+0000","last_unstale":"2024-05-30T16:42:43.961096+0000","last_undegraded":"2024-05-30T16:42:43.961096+0000","last_fullsized":"2024-05-30T16:42:43.961096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:25:19.288583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755391+0000","last_change":"2024-05-30T16:42:42.743756+0000","last_active":"2024-05-30T16:42:43.755391+0000","last_peered":"2024-05-30T16:42:43.755391+0000","last_clean":"2024-05-30T16:42:43.755391+0000","last_became_active":"2024-05-30T16:42:42.743390+0000","last_became_peered":"2024-05-30T16:42:42.743390+0000","last_unstale":"2024-05-30T16:42:43.755391+0000","last_undegraded":"2024-05-30T16:42:43.755391+0000","last_fullsized":"2024-05-30T16:42:43.755391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:00.798641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961189+0000","last_change":"2024-05-30T16:42:41.736022+0000","last_active":"2024-05-30T16:42:43.961189+0000","last_peered":"2024-05-30T16:42:43.961189+0000","last_clean":"2024-05-30T16:42:43.961189+0000","last_became_active":"2024-05-30T16:42:41.735491+0000","last_became_peered":"2024-05-30T16:42:41.735491+0000","last_unstale":"2024-05-30T16:42:43.961189+0000","last_undegraded":"2024-05-30T16:42:43.961189+0000","last_fullsized":"2024-05-30T16:42:43.961189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:11:38.401486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757050+0000","last_change":"2024-05-30T16:42:42.751254+0000","last_active":"2024-05-30T16:42:43.757050+0000","last_peered":"2024-05-30T16:42:43.757050+0000","last_clean":"2024-05-30T16:42:43.757050+0000","last_became_active":"2024-05-30T16:42:42.750946+0000","last_became_peered":"2024-05-30T16:42:42.750946+0000","last_unstale":"2024-05-30T16:42:43.757050+0000","last_undegraded":"2024-05-30T16:42:43.757050+0000","last_fullsized":"2024-05-30T16:42:43.757050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:38:49.036025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054395+0000","last_change":"2024-05-30T16:42:41.743736+0000","last_active":"2024-05-30T16:42:44.054395+0000","last_peered":"2024-05-30T16:42:44.054395+0000","last_clean":"2024-05-30T16:42:44.054395+0000","last_became_active":"2024-05-30T16:42:41.743387+0000","last_became_peered":"2024-05-30T16:42:41.743387+0000","last_unstale":"2024-05-30T16:42:44.054395+0000","last_undegraded":"2024-05-30T16:42:44.054395+0000","last_fullsized":"2024-05-30T16:42:44.054395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:26:31.080690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.057112+0000","last_change":"2024-05-30T16:42:42.755648+0000","last_active":"2024-05-30T16:42:44.057112+0000","last_peered":"2024-05-30T16:42:44.057112+0000","last_clean":"2024-05-30T16:42:44.057112+0000","last_became_active":"2024-05-30T16:42:42.752465+0000","last_became_peered":"2024-05-30T16:42:42.752465+0000","last_unstale":"2024-05-30T16:42:44.057112+0000","last_undegraded":"2024-05-30T16:42:44.057112+0000","last_fullsized":"2024-05-30T16:42:44.057112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:45.024839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757221+0000","last_change":"2024-05-30T16:42:41.742596+0000","last_active":"2024-05-30T16:42:43.757221+0000","last_peered":"2024-05-30T16:42:43.757221+0000","last_clean":"2024-05-30T16:42:43.757221+0000","last_became_active":"2024-05-30T16:42:41.742096+0000","last_became_peered":"2024-05-30T16:42:41.742096+0000","last_unstale":"2024-05-30T16:42:43.757221+0000","last_undegraded":"2024-05-30T16:42:43.757221+0000","last_fullsized":"2024-05-30T16:42:43.757221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:52.712163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054290+0000","last_change":"2024-05-30T16:42:42.761749+0000","last_active":"2024-05-30T16:42:44.054290+0000","last_peered":"2024-05-30T16:42:44.054290+0000","last_clean":"2024-05-30T16:42:44.054290+0000","last_became_active":"2024-05-30T16:42:42.761339+0000","last_became_peered":"2024-05-30T16:42:42.761339+0000","last_unstale":"2024-05-30T16:42:44.054290+0000","last_undegraded":"2024-05-30T16:42:44.054290+0000","last_fullsized":"2024-05-30T16:42:44.054290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:39:42.521056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757988+0000","last_change":"2024-05-30T16:42:41.749790+0000","last_active":"2024-05-30T16:42:43.757988+0000","last_peered":"2024-05-30T16:42:43.757988+0000","last_clean":"2024-05-30T16:42:43.757988+0000","last_became_active":"2024-05-30T16:42:41.748492+0000","last_became_peered":"2024-05-30T16:42:41.748492+0000","last_unstale":"2024-05-30T16:42:43.757988+0000","last_undegraded":"2024-05-30T16:42:43.757988+0000","last_fullsized":"2024-05-30T16:42:43.757988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:44:52.468238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056828+0000","last_change":"2024-05-30T16:42:42.744395+0000","last_active":"2024-05-30T16:42:44.056828+0000","last_peered":"2024-05-30T16:42:44.056828+0000","last_clean":"2024-05-30T16:42:44.056828+0000","last_became_active":"2024-05-30T16:42:42.744138+0000","last_became_peered":"2024-05-30T16:42:42.744138+0000","last_unstale":"2024-05-30T16:42:44.056828+0000","last_undegraded":"2024-05-30T16:42:44.056828+0000","last_fullsized":"2024-05-30T16:42:44.056828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:10:33.326622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.757536+0000","last_change":"2024-05-30T16:42:41.745408+0000","last_active":"2024-05-30T16:42:43.757536+0000","last_peered":"2024-05-30T16:42:43.757536+0000","last_clean":"2024-05-30T16:42:43.757536+0000","last_became_active":"2024-05-30T16:42:41.744693+0000","last_became_peered":"2024-05-30T16:42:41.744693+0000","last_unstale":"2024-05-30T16:42:43.757536+0000","last_undegraded":"2024-05-30T16:42:43.757536+0000","last_fullsized":"2024-05-30T16:42:43.757536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:47.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056045+0000","last_change":"2024-05-30T16:42:42.758043+0000","last_active":"2024-05-30T16:42:44.056045+0000","last_peered":"2024-05-30T16:42:44.056045+0000","last_clean":"2024-05-30T16:42:44.056045+0000","last_became_active":"2024-05-30T16:42:42.755572+0000","last_became_peered":"2024-05-30T16:42:42.755572+0000","last_unstale":"2024-05-30T16:42:44.056045+0000","last_undegraded":"2024-05-30T16:42:44.056045+0000","last_fullsized":"2024-05-30T16:42:44.056045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:42.092795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753693+0000","last_change":"2024-05-30T16:42:41.745755+0000","last_active":"2024-05-30T16:42:43.753693+0000","last_peered":"2024-05-30T16:42:43.753693+0000","last_clean":"2024-05-30T16:42:43.753693+0000","last_became_active":"2024-05-30T16:42:41.745481+0000","last_became_peered":"2024-05-30T16:42:41.745481+0000","last_unstale":"2024-05-30T16:42:43.753693+0000","last_undegraded":"2024-05-30T16:42:43.753693+0000","last_fullsized":"2024-05-30T16:42:43.753693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:47.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056485+0000","last_change":"2024-05-30T16:42:42.744979+0000","last_active":"2024-05-30T16:42:44.056485+0000","last_peered":"2024-05-30T16:42:44.056485+0000","last_clean":"2024-05-30T16:42:44.056485+0000","last_became_active":"2024-05-30T16:42:42.744627+0000","last_became_peered":"2024-05-30T16:42:42.744627+0000","last_unstale":"2024-05-30T16:42:44.056485+0000","last_undegraded":"2024-05-30T16:42:44.056485+0000","last_fullsized":"2024-05-30T16:42:44.056485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:53.733325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755511+0000","last_change":"2024-05-30T16:42:41.744345+0000","last_active":"2024-05-30T16:42:43.755511+0000","last_peered":"2024-05-30T16:42:43.755511+0000","last_clean":"2024-05-30T16:42:43.755511+0000","last_became_active":"2024-05-30T16:42:41.744018+0000","last_became_peered":"2024-05-30T16:42:41.744018+0000","last_unstale":"2024-05-30T16:42:43.755511+0000","last_undegraded":"2024-05-30T16:42:43.755511+0000","last_fullsized":"2024-05-30T16:42:43.755511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:48:31.987774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055519+0000","last_change":"2024-05-30T16:42:42.743982+0000","last_active":"2024-05-30T16:42:44.055519+0000","last_peered":"2024-05-30T16:42:44.055519+0000","last_clean":"2024-05-30T16:42:44.055519+0000","last_became_active":"2024-05-30T16:42:42.743624+0000","last_became_peered":"2024-05-30T16:42:42.743624+0000","last_unstale":"2024-05-30T16:42:44.055519+0000","last_undegraded":"2024-05-30T16:42:44.055519+0000","last_fullsized":"2024-05-30T16:42:44.055519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:57:27.291809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756811+0000","last_change":"2024-05-30T16:42:41.744388+0000","last_active":"2024-05-30T16:42:43.756811+0000","last_peered":"2024-05-30T16:42:43.756811+0000","last_clean":"2024-05-30T16:42:43.756811+0000","last_became_active":"2024-05-30T16:42:41.743856+0000","last_became_peered":"2024-05-30T16:42:41.743856+0000","last_unstale":"2024-05-30T16:42:43.756811+0000","last_undegraded":"2024-05-30T16:42:43.756811+0000","last_fullsized":"2024-05-30T16:42:43.756811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:10:32.305461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054795+0000","last_change":"2024-05-30T16:42:42.737753+0000","last_active":"2024-05-30T16:42:44.054795+0000","last_peered":"2024-05-30T16:42:44.054795+0000","last_clean":"2024-05-30T16:42:44.054795+0000","last_became_active":"2024-05-30T16:42:42.737215+0000","last_became_peered":"2024-05-30T16:42:42.737215+0000","last_unstale":"2024-05-30T16:42:44.054795+0000","last_undegraded":"2024-05-30T16:42:44.054795+0000","last_fullsized":"2024-05-30T16:42:44.054795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:19:45.024839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.055449+0000","last_change":"2024-05-30T16:42:41.751355+0000","last_active":"2024-05-30T16:42:44.055449+0000","last_peered":"2024-05-30T16:42:44.055449+0000","last_clean":"2024-05-30T16:42:44.055449+0000","last_became_active":"2024-05-30T16:42:41.750891+0000","last_became_peered":"2024-05-30T16:42:41.750891+0000","last_unstale":"2024-05-30T16:42:44.055449+0000","last_undegraded":"2024-05-30T16:42:44.055449+0000","last_fullsized":"2024-05-30T16:42:44.055449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:35.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.057240+0000","last_change":"2024-05-30T16:42:42.753814+0000","last_active":"2024-05-30T16:42:44.057240+0000","last_peered":"2024-05-30T16:42:44.057240+0000","last_clean":"2024-05-30T16:42:44.057240+0000","last_became_active":"2024-05-30T16:42:42.753521+0000","last_became_peered":"2024-05-30T16:42:42.753521+0000","last_unstale":"2024-05-30T16:42:44.057240+0000","last_undegraded":"2024-05-30T16:42:44.057240+0000","last_fullsized":"2024-05-30T16:42:44.057240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:19.249546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054505+0000","last_change":"2024-05-30T16:42:41.746799+0000","last_active":"2024-05-30T16:42:44.054505+0000","last_peered":"2024-05-30T16:42:44.054505+0000","last_clean":"2024-05-30T16:42:44.054505+0000","last_became_active":"2024-05-30T16:42:41.746476+0000","last_became_peered":"2024-05-30T16:42:41.746476+0000","last_unstale":"2024-05-30T16:42:44.054505+0000","last_undegraded":"2024-05-30T16:42:44.054505+0000","last_fullsized":"2024-05-30T16:42:44.054505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:08:11.081820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.057384+0000","last_change":"2024-05-30T16:42:42.760932+0000","last_active":"2024-05-30T16:42:44.057384+0000","last_peered":"2024-05-30T16:42:44.057384+0000","last_clean":"2024-05-30T16:42:44.057384+0000","last_became_active":"2024-05-30T16:42:42.760561+0000","last_became_peered":"2024-05-30T16:42:42.760561+0000","last_unstale":"2024-05-30T16:42:44.057384+0000","last_undegraded":"2024-05-30T16:42:44.057384+0000","last_fullsized":"2024-05-30T16:42:44.057384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:21.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.733900+0000","last_change":"2024-05-30T16:42:41.745666+0000","last_active":"2024-05-30T16:42:44.733900+0000","last_peered":"2024-05-30T16:42:44.733900+0000","last_clean":"2024-05-30T16:42:44.733900+0000","last_became_active":"2024-05-30T16:42:41.745360+0000","last_became_peered":"2024-05-30T16:42:41.745360+0000","last_unstale":"2024-05-30T16:42:44.733900+0000","last_undegraded":"2024-05-30T16:42:44.733900+0000","last_fullsized":"2024-05-30T16:42:44.733900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:26:31.080690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753974+0000","last_change":"2024-05-30T16:42:42.746958+0000","last_active":"2024-05-30T16:42:43.753974+0000","last_peered":"2024-05-30T16:42:43.753974+0000","last_clean":"2024-05-30T16:42:43.753974+0000","last_became_active":"2024-05-30T16:42:42.746730+0000","last_became_peered":"2024-05-30T16:42:42.746730+0000","last_unstale":"2024-05-30T16:42:43.753974+0000","last_undegraded":"2024-05-30T16:42:43.753974+0000","last_fullsized":"2024-05-30T16:42:43.753974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:38:49.036025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.054645+0000","last_change":"2024-05-30T16:42:41.743686+0000","last_active":"2024-05-30T16:42:44.054645+0000","last_peered":"2024-05-30T16:42:44.054645+0000","last_clean":"2024-05-30T16:42:44.054645+0000","last_became_active":"2024-05-30T16:42:41.743399+0000","last_became_peered":"2024-05-30T16:42:41.743399+0000","last_unstale":"2024-05-30T16:42:44.054645+0000","last_undegraded":"2024-05-30T16:42:44.054645+0000","last_fullsized":"2024-05-30T16:42:44.054645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:48:31.987774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755595+0000","last_change":"2024-05-30T16:42:42.739280+0000","last_active":"2024-05-30T16:42:43.755595+0000","last_peered":"2024-05-30T16:42:43.755595+0000","last_clean":"2024-05-30T16:42:43.755595+0000","last_became_active":"2024-05-30T16:42:42.738930+0000","last_became_peered":"2024-05-30T16:42:42.738930+0000","last_unstale":"2024-05-30T16:42:43.755595+0000","last_undegraded":"2024-05-30T16:42:43.755595+0000","last_fullsized":"2024-05-30T16:42:43.755595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:23.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753672+0000","last_change":"2024-05-30T16:42:41.744516+0000","last_active":"2024-05-30T16:42:43.753672+0000","last_peered":"2024-05-30T16:42:43.753672+0000","last_clean":"2024-05-30T16:42:43.753672+0000","last_became_active":"2024-05-30T16:42:41.744249+0000","last_became_peered":"2024-05-30T16:42:41.744249+0000","last_unstale":"2024-05-30T16:42:43.753672+0000","last_undegraded":"2024-05-30T16:42:43.753672+0000","last_fullsized":"2024-05-30T16:42:43.753672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:59.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.753481+0000","last_change":"2024-05-30T16:42:42.738306+0000","last_active":"2024-05-30T16:42:43.753481+0000","last_peered":"2024-05-30T16:42:43.753481+0000","last_clean":"2024-05-30T16:42:43.753481+0000","last_became_active":"2024-05-30T16:42:42.738000+0000","last_became_peered":"2024-05-30T16:42:42.738000+0000","last_unstale":"2024-05-30T16:42:43.753481+0000","last_undegraded":"2024-05-30T16:42:43.753481+0000","last_fullsized":"2024-05-30T16:42:43.753481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:23.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.053916+0000","last_change":"2024-05-30T16:42:41.746821+0000","last_active":"2024-05-30T16:42:44.053916+0000","last_peered":"2024-05-30T16:42:44.053916+0000","last_clean":"2024-05-30T16:42:44.053916+0000","last_became_active":"2024-05-30T16:42:41.746527+0000","last_became_peered":"2024-05-30T16:42:41.746527+0000","last_unstale":"2024-05-30T16:42:44.053916+0000","last_undegraded":"2024-05-30T16:42:44.053916+0000","last_fullsized":"2024-05-30T16:42:44.053916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:59.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961346+0000","last_change":"2024-05-30T16:42:42.742896+0000","last_active":"2024-05-30T16:42:43.961346+0000","last_peered":"2024-05-30T16:42:43.961346+0000","last_clean":"2024-05-30T16:42:43.961346+0000","last_became_active":"2024-05-30T16:42:42.742588+0000","last_became_peered":"2024-05-30T16:42:42.742588+0000","last_unstale":"2024-05-30T16:42:43.961346+0000","last_undegraded":"2024-05-30T16:42:43.961346+0000","last_fullsized":"2024-05-30T16:42:43.961346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:25.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756966+0000","last_change":"2024-05-30T16:42:41.745443+0000","last_active":"2024-05-30T16:42:43.756966+0000","last_peered":"2024-05-30T16:42:43.756966+0000","last_clean":"2024-05-30T16:42:43.756966+0000","last_became_active":"2024-05-30T16:42:41.745166+0000","last_became_peered":"2024-05-30T16:42:41.745166+0000","last_unstale":"2024-05-30T16:42:43.756966+0000","last_undegraded":"2024-05-30T16:42:43.756966+0000","last_fullsized":"2024-05-30T16:42:43.756966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:18.228384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.756941+0000","last_change":"2024-05-30T16:42:42.755635+0000","last_active":"2024-05-30T16:42:43.756941+0000","last_peered":"2024-05-30T16:42:43.756941+0000","last_clean":"2024-05-30T16:42:43.756941+0000","last_became_active":"2024-05-30T16:42:42.755407+0000","last_became_peered":"2024-05-30T16:42:42.755407+0000","last_unstale":"2024-05-30T16:42:43.756941+0000","last_undegraded":"2024-05-30T16:42:43.756941+0000","last_fullsized":"2024-05-30T16:42:43.756941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:23.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.961441+0000","last_change":"2024-05-30T16:42:41.758475+0000","last_active":"2024-05-30T16:42:43.961441+0000","last_peered":"2024-05-30T16:42:43.961441+0000","last_clean":"2024-05-30T16:42:43.961441+0000","last_became_active":"2024-05-30T16:42:41.758144+0000","last_became_peered":"2024-05-30T16:42:41.758144+0000","last_unstale":"2024-05-30T16:42:43.961441+0000","last_undegraded":"2024-05-30T16:42:43.961441+0000","last_fullsized":"2024-05-30T16:42:43.961441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:40:35.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056250+0000","last_change":"2024-05-30T16:42:42.744710+0000","last_active":"2024-05-30T16:42:44.056250+0000","last_peered":"2024-05-30T16:42:44.056250+0000","last_clean":"2024-05-30T16:42:44.056250+0000","last_became_active":"2024-05-30T16:42:42.744341+0000","last_became_peered":"2024-05-30T16:42:42.744341+0000","last_unstale":"2024-05-30T16:42:44.056250+0000","last_undegraded":"2024-05-30T16:42:44.056250+0000","last_fullsized":"2024-05-30T16:42:44.056250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:41.698843+0000","last_clean_scrub_stamp":"2024-05-30T16:42:41.698843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:47:36.652618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:43.755680+0000","last_change":"2024-05-30T16:42:41.746534+0000","last_active":"2024-05-30T16:42:43.755680+0000","last_peered":"2024-05-30T16:42:43.755680+0000","last_clean":"2024-05-30T16:42:43.755680+0000","last_became_active":"2024-05-30T16:42:41.744355+0000","last_became_peered":"2024-05-30T16:42:41.744355+0000","last_unstale":"2024-05-30T16:42:43.755680+0000","last_undegraded":"2024-05-30T16:42:43.755680+0000","last_fullsized":"2024-05-30T16:42:43.755680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:42:40.677681+0000","last_clean_scrub_stamp":"2024-05-30T16:42:40.677681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:59.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-30T16:42:44.056957+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:42:44.056957+0000","last_peered":"2024-05-30T16:42:44.056957+0000","last_clean":"2024-05-30T16:42:44.056957+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:42:44.056957+0000","last_undegraded":"2024-05-30T16:42:44.056957+0000","last_fullsized":"2024-05-30T16:42:44.056957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":724908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":135122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":136084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":136084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":724818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:42:47.677 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:42:47.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T16:42:47.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.931+0000 7fd63c600640 1 Processor -- start 2024-05-30T16:42:47.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.931+0000 7fd63c600640 1 -- start start 2024-05-30T16:42:47.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.933+0000 7fd63c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63413f760 0x7fd63406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.933+0000 7fd63c600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd6340cec70 0x7fd6340b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.933+0000 7fd63c600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd63406ee80 con 0x7fd6340b5e00 2024-05-30T16:42:47.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.933+0000 7fd63c600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd6341612b0 con 0x7fd6340cec70 2024-05-30T16:42:47.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.933+0000 7fd63c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd63413fb40 con 0x7fd63413f760 2024-05-30T16:42:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.933+0000 7fd63a600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd6340b5e00 0x7fd634142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33312/0 (socket says 172.21.15.144:33312) 2024-05-30T16:42:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.933+0000 7fd63a600640 1 -- 172.21.15.144:0/1623878765 learned_addr learned my addr 172.21.15.144:0/1623878765 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.933+0000 7fd639c00640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63413f760 0x7fd63406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139337809 0 0) 0x7fd63406ee80 con 0x7fd6340b5e00 2024-05-30T16:42:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd61c003520 con 0x7fd6340b5e00 2024-05-30T16:42:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd639200640 1 --2- 172.21.15.144:0/1623878765 >> v2:172.21.15.149:3300/0 conn(0x7fd6340cec70 0x7fd6340b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 875936643 0 0) 0x7fd61c003520 con 0x7fd6340b5e00 2024-05-30T16:42:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63413f760 msgr2=0x7fd63406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63413f760 0x7fd63406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 >> v2:172.21.15.149:3300/0 conn(0x7fd6340cec70 msgr2=0x7fd6340b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 --2- 172.21.15.144:0/1623878765 >> v2:172.21.15.149:3300/0 conn(0x7fd6340cec70 0x7fd6340b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd634160730 con 0x7fd6340b5e00 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fd62c0019f0 con 0x7fd6340b5e00 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 >> v1:172.21.15.144:6789/0 conn(0x7fd6340b5e00 legacy=0x7fd634142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd61c0039b0 0x7fd61c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63413f760 0x7fd61c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd61c004d40 0x7fd61c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341612b0 con 0x7fd61c0039b0 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c00b9c0 con 0x7fd61c004d40 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd61c00bb70 con 0x7fd63413f760 2024-05-30T16:42:47.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.934+0000 7fd639c00640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd61c0039b0 0x7fd61c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.935+0000 7fd639c00640 1 -- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63413f760 msgr2=0x7fd61c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:47.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.935+0000 7fd639200640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63413f760 0x7fd61c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.935+0000 7fd63a600640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd61c004d40 0x7fd61c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.935+0000 7fd639c00640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63413f760 0x7fd61c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.935+0000 7fd639c00640 1 -- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd61c004d40 msgr2=0x7fd61c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:47.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.935+0000 7fd639c00640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd61c004d40 0x7fd61c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.935+0000 7fd639c00640 1 -- 172.21.15.144:0/1623878765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c003520 con 0x7fd61c0039b0 2024-05-30T16:42:47.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.936+0000 7fd639c00640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd61c0039b0 0x7fd61c003dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd628009ac0 tx=0x7fd61c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6062bfef64c47332 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:47.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.936+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628036070 con 0x7fd61c0039b0 2024-05-30T16:42:47.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.936+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd628031400 con 0x7fd61c0039b0 2024-05-30T16:42:47.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.936+0000 7fd633e00640 1 -- 172.21.15.144:0/1623878765 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628009690 con 0x7fd61c0039b0 2024-05-30T16:42:47.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.937+0000 7fd63c600640 1 -- 172.21.15.144:0/1623878765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd61c0039b0 msgr2=0x7fd61c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.937+0000 7fd63c600640 1 --2- 172.21.15.144:0/1623878765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd61c0039b0 0x7fd61c003dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd628009ac0 tx=0x7fd61c005830 comp rx=0 tx=0).stop 2024-05-30T16:42:47.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.937+0000 7fd63a600640 1 -- 172.21.15.144:0/1623878765 reap_dead start 2024-05-30T16:42:47.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.937+0000 7fd63c600640 1 -- 172.21.15.144:0/1623878765 shutdown_connections 2024-05-30T16:42:47.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.937+0000 7fd63c600640 1 -- 172.21.15.144:0/1623878765 >> 172.21.15.144:0/1623878765 conn(0x7fd63406bd00 msgr2=0x7fd63406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:47.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.937+0000 7fd63c600640 1 -- 172.21.15.144:0/1623878765 shutdown_connections 2024-05-30T16:42:47.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.937+0000 7fd63c600640 1 -- 172.21.15.144:0/1623878765 wait complete. 2024-05-30T16:42:47.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.939+0000 7fd63c600640 1 Processor -- start 2024-05-30T16:42:47.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.939+0000 7fd63c600640 1 -- start start 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd63c600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd61c0039b0 0x7fd634139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd63c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340b5160 0x7fd63413cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd63c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b55e0 0x7fd63413d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd63c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd634160fd0 con 0x7fd6340b55e0 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd63c600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd634160cf0 con 0x7fd61c0039b0 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd63c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd6340cf0d0 con 0x7fd6340b5160 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd63a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b55e0 0x7fd63413d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd63a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b55e0 0x7fd63413d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33022/0 (socket says 172.21.15.144:33022) 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd63a600640 1 -- 172.21.15.144:0/4128079913 learned_addr learned my addr 172.21.15.144:0/4128079913 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.940+0000 7fd639200640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340b5160 0x7fd63413cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd63a600640 1 -- 172.21.15.144:0/4128079913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340b5160 msgr2=0x7fd63413cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd63a600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340b5160 0x7fd63413cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd639c00640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd61c0039b0 0x7fd634139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd63a600640 1 -- 172.21.15.144:0/4128079913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd61c0039b0 msgr2=0x7fd634139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:47.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd63a600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd61c0039b0 0x7fd634139d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:47.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd63a600640 1 -- 172.21.15.144:0/4128079913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6340b3880 con 0x7fd6340b55e0 2024-05-30T16:42:47.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd639200640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340b5160 0x7fd63413cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:47.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd63a600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b55e0 0x7fd63413d4f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00dbe0 tx=0x7fd62c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:47.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd631600640 1 -- 172.21.15.144:0/4128079913 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00bdb0 con 0x7fd6340b55e0 2024-05-30T16:42:47.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd631600640 1 -- 172.21.15.144:0/4128079913 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62c004b60 con 0x7fd6340b55e0 2024-05-30T16:42:47.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6340b3b60 con 0x7fd6340b55e0 2024-05-30T16:42:47.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd631600640 1 -- 172.21.15.144:0/4128079913 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c007070 con 0x7fd6340b55e0 2024-05-30T16:42:47.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.941+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6340b4120 con 0x7fd6340b55e0 2024-05-30T16:42:47.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.943+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6340cdfe0 con 0x7fd6340b55e0 2024-05-30T16:42:47.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.944+0000 7fd631600640 1 -- 172.21.15.144:0/4128079913 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd62c01b020 con 0x7fd6340b55e0 2024-05-30T16:42:47.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.944+0000 7fd631600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd61406c8c0 0x7fd61406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:47.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.945+0000 7fd631600640 1 -- 172.21.15.144:0/4128079913 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd62c08bd50 con 0x7fd6340b55e0 2024-05-30T16:42:47.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.945+0000 7fd639c00640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd61406c8c0 0x7fd61406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:47.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.945+0000 7fd639c00640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd61406c8c0 0x7fd61406ed80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd628009ac0 tx=0x7fd628008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:47.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:47.949+0000 7fd631600640 1 -- 172.21.15.144:0/4128079913 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd6340cdfe0 con 0x7fd6340b55e0 2024-05-30T16:42:48.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.219+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd634068b90 con 0x7fd6340b55e0 2024-05-30T16:42:48.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.223+0000 7fd631600640 1 -- 172.21.15.144:0/4128079913 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fd62c059a90 con 0x7fd6340b55e0 2024-05-30T16:42:48.223 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-05-30T16:42:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA== 2024-05-30T16:42:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-05-30T16:42:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-05-30T16:42:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T16:42:48.223 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-05-30T16:42:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd61406c8c0 msgr2=0x7fd61406ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd61406c8c0 0x7fd61406ed80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd628009ac0 tx=0x7fd628008030 comp rx=0 tx=0).stop 2024-05-30T16:42:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b55e0 msgr2=0x7fd63413d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b55e0 0x7fd63413d4f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00dbe0 tx=0x7fd62c00b4a0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 shutdown_connections 2024-05-30T16:42:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd61406c8c0 0x7fd61406ed80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b55e0 0x7fd63413d4f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340b5160 0x7fd63413cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 --2- 172.21.15.144:0/4128079913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd61c0039b0 0x7fd634139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 >> 172.21.15.144:0/4128079913 conn(0x7fd63406bd00 msgr2=0x7fd634140bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 shutdown_connections 2024-05-30T16:42:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.226+0000 7fd63c600640 1 -- 172.21.15.144:0/4128079913 wait complete. 2024-05-30T16:42:48.245 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:42:48.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.434+0000 7f59c8800640 1 Processor -- start 2024-05-30T16:42:48.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.435+0000 7f59c8800640 1 -- start start 2024-05-30T16:42:48.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.436+0000 7f59c8800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f59c0145150 0x7f59c00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:48.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.436+0000 7f59c8800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c00cfa70 0x7f59c006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:48.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.436+0000 7f59c8800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c00d00f0 con 0x7f59c006f610 2024-05-30T16:42:48.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.436+0000 7f59c8800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f59c00cfeb0 con 0x7f59c0145150 2024-05-30T16:42:48.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.436+0000 7f59c8800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f59c015f140 con 0x7f59c00cfa70 2024-05-30T16:42:48.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c6800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f59c006f610 0x7f59c0072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33318/0 (socket says 172.21.15.144:33318) 2024-05-30T16:42:48.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c6800640 1 -- 172.21.15.144:0/2744889824 learned_addr learned my addr 172.21.15.144:0/2744889824 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:48.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c5e00640 1 --2- 172.21.15.144:0/2744889824 >> v2:172.21.15.149:3300/0 conn(0x7f59c0145150 0x7f59c00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:48.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c5400640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c00cfa70 0x7f59c006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:48.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149927285 0 0) 0x7f59c00d00f0 con 0x7f59c006f610 2024-05-30T16:42:48.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8003520 con 0x7f59c006f610 2024-05-30T16:42:48.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 533509455 0 0) 0x7f59a8003520 con 0x7f59c006f610 2024-05-30T16:42:48.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c00cfa70 msgr2=0x7f59c006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c4a00640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c00cfa70 0x7f59c006f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.437+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 >> v2:172.21.15.149:3300/0 conn(0x7f59c0145150 msgr2=0x7f59c00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 --2- 172.21.15.144:0/2744889824 >> v2:172.21.15.149:3300/0 conn(0x7f59c0145150 0x7f59c00cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c015f390 con 0x7f59c006f610 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f59bc0019f0 con 0x7f59c006f610 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 >> v1:172.21.15.144:6789/0 conn(0x7f59c006f610 legacy=0x7f59c0072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c00cfa70 0x7f59a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59a8003f30 0x7f59a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59a8004d40 0x7f59a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59c00cfeb0 con 0x7f59a8004d40 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f59c015f140 con 0x7f59a8003f30 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f59a800dc20 con 0x7f59c00cfa70 2024-05-30T16:42:48.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c6800640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59a8004d40 0x7f59a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:48.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c5e00640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c00cfa70 0x7f59a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:48.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c5400640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59a8003f30 0x7f59a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:48.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c6800640 1 -- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c00cfa70 msgr2=0x7f59a80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:48.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c6800640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c00cfa70 0x7f59a80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c6800640 1 -- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59a8003f30 msgr2=0x7f59a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:48.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.438+0000 7f59c6800640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59a8003f30 0x7f59a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.439+0000 7f59c6800640 1 -- 172.21.15.144:0/2744889824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a8003520 con 0x7f59a8004d40 2024-05-30T16:42:48.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.440+0000 7f59c6800640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59a8004d40 0x7f59a80051c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00a8a0 tx=0x7f59a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e36007e3ddefbd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:48.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.440+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00a4c0 con 0x7f59a8004d40 2024-05-30T16:42:48.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.440+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc02f070 con 0x7f59a8004d40 2024-05-30T16:42:48.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.440+0000 7f59c4a00640 1 -- 172.21.15.144:0/2744889824 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc02bcd0 con 0x7f59a8004d40 2024-05-30T16:42:48.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.441+0000 7f59c8800640 1 -- 172.21.15.144:0/2744889824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59a8004d40 msgr2=0x7f59a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:48.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.441+0000 7f59c8800640 1 --2- 172.21.15.144:0/2744889824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59a8004d40 0x7f59a80051c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00a8a0 tx=0x7f59a8005830 comp rx=0 tx=0).stop 2024-05-30T16:42:48.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.441+0000 7f59c6800640 1 -- 172.21.15.144:0/2744889824 reap_dead start 2024-05-30T16:42:48.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.441+0000 7f59c8800640 1 -- 172.21.15.144:0/2744889824 shutdown_connections 2024-05-30T16:42:48.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.441+0000 7f59c8800640 1 -- 172.21.15.144:0/2744889824 >> 172.21.15.144:0/2744889824 conn(0x7f59c006bd00 msgr2=0x7f59c006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:48.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.441+0000 7f59c8800640 1 -- 172.21.15.144:0/2744889824 shutdown_connections 2024-05-30T16:42:48.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.441+0000 7f59c8800640 1 -- 172.21.15.144:0/2744889824 wait complete. 2024-05-30T16:42:48.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.442+0000 7f59c8800640 1 Processor -- start 2024-05-30T16:42:48.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.443+0000 7f59c8800640 1 -- start start 2024-05-30T16:42:48.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.443+0000 7f59c8800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59c01f7520 0x7f59c00afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.443+0000 7f59c8800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c01f7900 0x7f59c0143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c8800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c015bb80 0x7f59c0143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c8800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59c00b64f0 con 0x7f59c01f7900 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c8800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f59c015f950 con 0x7f59c01f7520 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c8800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f59c015fe70 con 0x7f59c015bb80 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c01f7900 0x7f59c0143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c01f7900 0x7f59c0143940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33046/0 (socket says 172.21.15.144:33046) 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c5400640 1 -- 172.21.15.144:0/3262689555 learned_addr learned my addr 172.21.15.144:0/3262689555 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c5e00640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59c01f7520 0x7f59c00afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c6800640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c015bb80 0x7f59c0143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c5400640 1 -- 172.21.15.144:0/3262689555 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c015bb80 msgr2=0x7f59c0143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c5400640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c015bb80 0x7f59c0143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c5400640 1 -- 172.21.15.144:0/3262689555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59c01f7520 msgr2=0x7f59c00afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:48.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c5400640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59c01f7520 0x7f59c00afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.444+0000 7f59c5400640 1 -- 172.21.15.144:0/3262689555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c015c0f0 con 0x7f59c01f7900 2024-05-30T16:42:48.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.445+0000 7f59c5400640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c01f7900 0x7f59c0143940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f59b0011560 tx=0x7f59b0011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:48.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.445+0000 7f59ba000640 1 -- 172.21.15.144:0/3262689555 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0015870 con 0x7f59c01f7900 2024-05-30T16:42:48.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.445+0000 7f59ba000640 1 -- 172.21.15.144:0/3262689555 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b0015a10 con 0x7f59c01f7900 2024-05-30T16:42:48.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.445+0000 7f59ba000640 1 -- 172.21.15.144:0/3262689555 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0015e00 con 0x7f59c01f7900 2024-05-30T16:42:48.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.445+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c015c3d0 con 0x7f59c01f7900 2024-05-30T16:42:48.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.445+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c015c990 con 0x7f59c01f7900 2024-05-30T16:42:48.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.446+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c00ccb40 con 0x7f59c01f7900 2024-05-30T16:42:48.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.447+0000 7f59ba000640 1 -- 172.21.15.144:0/3262689555 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59b000f460 con 0x7f59c01f7900 2024-05-30T16:42:48.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.448+0000 7f59ba000640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f59a406c8f0 0x7f59a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:48.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.448+0000 7f59ba000640 1 -- 172.21.15.144:0/3262689555 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f59b008c500 con 0x7f59c01f7900 2024-05-30T16:42:48.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.448+0000 7f59c5e00640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f59a406c8f0 0x7f59a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:48.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.449+0000 7f59c5e00640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f59a406c8f0 0x7f59a406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009a90 tx=0x7f59b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:48.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.453+0000 7f59ba000640 1 -- 172.21.15.144:0/3262689555 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59c00ccb40 con 0x7f59c01f7900 2024-05-30T16:42:48.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.679+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59c0068b90 con 0x7f59c01f7900 2024-05-30T16:42:48.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.680+0000 7f59ba000640 1 -- 172.21.15.144:0/3262689555 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f59b0019030 con 0x7f59c01f7900 2024-05-30T16:42:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:42:48.681 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/476063845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":476063845},{"type":"v1","addr":"172.21.15.149:6834","nonce":476063845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3390865934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3390865934},{"type":"v1","addr":"172.21.15.144:6836","nonce":3390865934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4737,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1066829217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1066829217},{"type":"v1","addr":"172.21.15.144:6837","nonce":1066829217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:42:42.182725+0000","modified":"2024-05-30T16:42:45.231332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/2240940065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":2240940065},{"type":"v1","addr":"172.21.15.149:6835","nonce":2240940065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-30T16:42:48.681 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 17 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.684+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f59a406c8f0 msgr2=0x7f59a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.684+0000 7f59c8800640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f59a406c8f0 0x7f59a406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009a90 tx=0x7f59b4008040 comp rx=0 tx=0).stop 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.684+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c01f7900 msgr2=0x7f59c0143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.684+0000 7f59c8800640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c01f7900 0x7f59c0143940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f59b0011560 tx=0x7f59b0011a20 comp rx=0 tx=0).stop 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.685+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 shutdown_connections 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.685+0000 7f59c8800640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f59a406c8f0 0x7f59a406edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.685+0000 7f59c8800640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59c015bb80 0x7f59c0143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.685+0000 7f59c8800640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c01f7900 0x7f59c0143940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.685+0000 7f59c8800640 1 --2- 172.21.15.144:0/3262689555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59c01f7520 0x7f59c00afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.685+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 >> 172.21.15.144:0/3262689555 conn(0x7f59c006bd00 msgr2=0x7f59c006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.685+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 shutdown_connections 2024-05-30T16:42:48.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:48.685+0000 7f59c8800640 1 -- 172.21.15.144:0/3262689555 wait complete. 2024-05-30T16:42:49.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:42:42.182725+0000', 'modified': '2024-05-30T16:42:45.231332+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4749}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4749': {'gid': 4749, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6835/2240940065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6833', 'nonce': 2240940065}, {'type': 'v1', 'addr': '172.21.15.149:6835', 'nonce': 2240940065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4749, 'qdb_cluster': [4749]} 2024-05-30T16:42:49.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:42:49.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-30T16:42:49.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.314+0000 7fa4d5400640 1 Processor -- start 2024-05-30T16:42:49.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.314+0000 7fa4d5400640 1 -- start start 2024-05-30T16:42:49.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.316+0000 7fa4d5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4d006efb0 0x7fa4d015f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.316+0000 7fa4d5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d015fe40 0x7fa4d00ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.316+0000 7fa4d5400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d015f120 con 0x7fa4d0159320 2024-05-30T16:42:49.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.316+0000 7fa4d5400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d00cee40 con 0x7fa4d006efb0 2024-05-30T16:42:49.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.316+0000 7fa4d5400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d00cf120 con 0x7fa4d015fe40 2024-05-30T16:42:49.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.316+0000 7fa4c5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4d006efb0 0x7fa4d015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.317+0000 7fa4c5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4d006efb0 0x7fa4d015f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33060/0 (socket says 172.21.15.144:33060) 2024-05-30T16:42:49.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.317+0000 7fa4c5e00640 1 -- 172.21.15.144:0/3896354273 learned_addr learned my addr 172.21.15.144:0/3896354273 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:49.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.317+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3896354273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d015fe40 0x7fa4d00ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.317+0000 7fa4c5e00640 1 -- 172.21.15.144:0/3896354273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d015fe40 msgr2=0x7fa4d00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.317+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/3896354273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d015fe40 0x7fa4d00ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.317+0000 7fa4c5e00640 1 -- 172.21.15.144:0/3896354273 >> v1:172.21.15.149:6789/0 conn(0x7fa4d0159320 legacy=0x7fa4d006f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.317+0000 7fa4c5e00640 1 -- 172.21.15.144:0/3896354273 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d00cf400 con 0x7fa4d006efb0 2024-05-30T16:42:49.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.318+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/3896354273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d006efb0 0x7fa4d015f900 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df86a2e08264667 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.318+0000 7fa4cde00640 1 -- 172.21.15.144:0/3896354273 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8037070 con 0x7fa4d006efb0 2024-05-30T16:42:49.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.318+0000 7fa4cde00640 1 -- 172.21.15.144:0/3896354273 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b8032440 con 0x7fa4d006efb0 2024-05-30T16:42:49.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.319+0000 7fa4cde00640 1 -- 172.21.15.144:0/3896354273 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8032810 con 0x7fa4d006efb0 2024-05-30T16:42:49.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.319+0000 7fa4d5400640 1 -- 172.21.15.144:0/3896354273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d006efb0 msgr2=0x7fa4d015f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.319+0000 7fa4d5400640 1 --2- 172.21.15.144:0/3896354273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d006efb0 0x7fa4d015f900 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b802a1e0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.319+0000 7fa4d5400640 1 -- 172.21.15.144:0/3896354273 shutdown_connections 2024-05-30T16:42:49.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.319+0000 7fa4d5400640 1 --2- 172.21.15.144:0/3896354273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d015fe40 0x7fa4d00ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.319+0000 7fa4d5400640 1 --2- 172.21.15.144:0/3896354273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d006efb0 0x7fa4d015f900 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.319+0000 7fa4d5400640 1 -- 172.21.15.144:0/3896354273 >> 172.21.15.144:0/3896354273 conn(0x7fa4d00629c0 msgr2=0x7fa4d006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:49.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.319+0000 7fa4d5400640 1 -- 172.21.15.144:0/3896354273 shutdown_connections 2024-05-30T16:42:49.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.319+0000 7fa4d5400640 1 -- 172.21.15.144:0/3896354273 wait complete. 2024-05-30T16:42:49.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.321+0000 7fa4d5400640 1 Processor -- start 2024-05-30T16:42:49.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.321+0000 7fa4d5400640 1 -- start start 2024-05-30T16:42:49.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.322+0000 7fa4d5400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d006efb0 0x7fa4d0149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.322+0000 7fa4d5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d0159320 0x7fa4d01f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.322+0000 7fa4d5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d0161320 0x7fa4d0161790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.322+0000 7fa4d5400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d00cd260 con 0x7fa4d0161320 2024-05-30T16:42:49.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.322+0000 7fa4d5400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d00cd0e0 con 0x7fa4d006efb0 2024-05-30T16:42:49.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.322+0000 7fa4d5400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d00cd3e0 con 0x7fa4d0159320 2024-05-30T16:42:49.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.322+0000 7fa4cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d0161320 0x7fa4d0161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.322+0000 7fa4cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d0161320 0x7fa4d0161790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33072/0 (socket says 172.21.15.144:33072) 2024-05-30T16:42:49.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.322+0000 7fa4cf200640 1 -- 172.21.15.144:0/3273840780 learned_addr learned my addr 172.21.15.144:0/3273840780 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:49.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d0159320 0x7fa4d01f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4cf200640 1 -- 172.21.15.144:0/3273840780 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d0159320 msgr2=0x7fa4d01f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4ce800640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d006efb0 0x7fa4d0149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d0159320 0x7fa4d01f80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4cf200640 1 -- 172.21.15.144:0/3273840780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d006efb0 msgr2=0x7fa4d0149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d006efb0 0x7fa4d0149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4cf200640 1 -- 172.21.15.144:0/3273840780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d01f8fe0 con 0x7fa4d0161320 2024-05-30T16:42:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d0161320 0x7fa4d0161790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007e30 tx=0x7fa4c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4c7400640 1 -- 172.21.15.144:0/3273840780 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8014620 con 0x7fa4d0161320 2024-05-30T16:42:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4c7400640 1 -- 172.21.15.144:0/3273840780 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c8019070 con 0x7fa4d0161320 2024-05-30T16:42:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4c7400640 1 -- 172.21.15.144:0/3273840780 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8014a00 con 0x7fa4d0161320 2024-05-30T16:42:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.323+0000 7fa4d5400640 1 -- 172.21.15.144:0/3273840780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d01f8a20 con 0x7fa4d0161320 2024-05-30T16:42:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.324+0000 7fa4d5400640 1 -- 172.21.15.144:0/3273840780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d0154230 con 0x7fa4d0161320 2024-05-30T16:42:49.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.326+0000 7fa4c7400640 1 -- 172.21.15.144:0/3273840780 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4c8014ba0 con 0x7fa4d0161320 2024-05-30T16:42:49.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.328+0000 7fa4c7400640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa4ac06c8f0 0x7fa4ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.328+0000 7fa4c7400640 1 -- 172.21.15.144:0/3273840780 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa4c808c500 con 0x7fa4d0161320 2024-05-30T16:42:49.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.328+0000 7fa4ce800640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa4ac06c8f0 0x7fa4ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.328+0000 7fa4d8180740 1 Processor -- start 2024-05-30T16:42:49.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.328+0000 7fa4d8180740 1 -- start start 2024-05-30T16:42:49.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4ce800640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa4ac06c8f0 0x7fa4ac06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00015a0 tx=0x7fa4c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a10d2a0 0x56078a110a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a110f60 0x56078a12cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a12d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4d8180740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56078a04ab10 con 0x56078a110f60 2024-05-30T16:42:49.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4d8180740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x560789ff12b0 con 0x56078a12d3e0 2024-05-30T16:42:49.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4d8180740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56078a046ad0 con 0x56078a10d2a0 2024-05-30T16:42:49.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4c5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a110f60 0x56078a12cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4c5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a110f60 0x56078a12cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33078/0 (socket says 172.21.15.144:33078) 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.329+0000 7fa4c5e00640 1 -- 172.21.15.144:0/3286504966 learned_addr learned my addr 172.21.15.144:0/3286504966 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.330+0000 7fa4c5e00640 1 -- 172.21.15.144:0/3286504966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a10d2a0 msgr2=0x56078a110a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.330+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/3286504966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a10d2a0 0x56078a110a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.330+0000 7fa4c5e00640 1 -- 172.21.15.144:0/3286504966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 msgr2=0x56078a12d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.330+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/3286504966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a12d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.330+0000 7fa4c5e00640 1 -- 172.21.15.144:0/3286504966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560789d5d2d0 con 0x56078a110f60 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.330+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/3286504966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a110f60 0x56078a12cea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93bc67081d6af65 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.330+0000 7fa4bf000640 1 -- 172.21.15.144:0/3286504966 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8037040 con 0x56078a110f60 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.330+0000 7fa4bf000640 1 -- 172.21.15.144:0/3286504966 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b8042070 con 0x56078a110f60 2024-05-30T16:42:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.330+0000 7fa4bf000640 1 -- 172.21.15.144:0/3286504966 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b803c8a0 con 0x56078a110f60 2024-05-30T16:42:49.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.331+0000 7fa4d8180740 1 -- 172.21.15.144:0/3286504966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a110f60 msgr2=0x56078a12cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.331+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3286504966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a110f60 0x56078a12cea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b802c000 comp rx=0 tx=0).stop 2024-05-30T16:42:49.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.331+0000 7fa4d8180740 1 -- 172.21.15.144:0/3286504966 shutdown_connections 2024-05-30T16:42:49.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.331+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3286504966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a12d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.331+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3286504966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a110f60 0x56078a12cea0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.331+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3286504966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a10d2a0 0x56078a110a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.331+0000 7fa4d8180740 1 -- 172.21.15.144:0/3286504966 >> 172.21.15.144:0/3286504966 conn(0x56078a0e3280 msgr2=0x56078a0e4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:49.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.331+0000 7fa4d8180740 1 -- 172.21.15.144:0/3286504966 shutdown_connections 2024-05-30T16:42:49.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.331+0000 7fa4d8180740 1 -- 172.21.15.144:0/3286504966 wait complete. 2024-05-30T16:42:49.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.332+0000 7fa4d8180740 1 -- start start 2024-05-30T16:42:49.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.332+0000 7fa4d8180740 1 Processor -- start 2024-05-30T16:42:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.333+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 0x56078a1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.333+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a114760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.333+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a113a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.333+0000 7fa4d8180740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56078a0e10b0 con 0x56078a10ad70 2024-05-30T16:42:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.333+0000 7fa4d8180740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56078a004570 con 0x56078a12d3e0 2024-05-30T16:42:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.333+0000 7fa4d8180740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56078a0e1390 con 0x56078a110f60 2024-05-30T16:42:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.333+0000 7fa4d8180740 10 client.0 _ll_register_callbacks cb 0x560789fd2fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33080/0 (socket says 172.21.15.144:33080) 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4cf200640 1 -- 172.21.15.144:0/3045879520 learned_addr learned my addr 172.21.15.144:0/3045879520 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4cf200640 1 -- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 msgr2=0x56078a1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4ce800640 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 0x56078a1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a114760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 0x56078a1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4cf200640 1 -- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 msgr2=0x56078a114760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a114760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4cf200640 1 -- 172.21.15.144:0/3045879520 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560789e276b0 con 0x56078a10ad70 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4ce800640 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 0x56078a1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a113a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8062840 tx=0x7fa4c805a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576b2a7a1bb81588 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.334+0000 7fa4b3400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:42:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4b3400640 1 -- 172.21.15.144:0/3045879520 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8062d70 con 0x56078a10ad70 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4b3400640 1 -- 172.21.15.144:0/3045879520 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa4c8056800 con 0x56078a10ad70 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4d8180740 1 -- 172.21.15.144:0/3045879520 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4b8042070 con 0x56078a10ad70 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4b3400640 1 -- 172.21.15.144:0/3045879520 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa4c805e170 con 0x56078a10ad70 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4d8180740 10 client.4917 fetch_fsmap learned FSMap version 17 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4d8180740 1 -- 172.21.15.144:0/3045879520 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56078a10bff0 con 0x56078a10ad70 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4b3400640 1 -- 172.21.15.144:0/3045879520 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b8042070 con 0x56078a10ad70 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4b3400640 1 -- 172.21.15.144:0/3045879520 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fa4c8085070 con 0x56078a10ad70 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4d8180740 10 client.4917 fetch_fsmap finished waiting for FSMap version 17 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4d8180740 10 client.4917 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4d8180740 20 client.4917 populate_metadata read hostname 'smithi144' 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] conn(0x56078a111f90 0x56078a128230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4d8180740 4 client.4917 mds_command: new command op to 4749 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:42:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.335+0000 7fa4d8180740 1 -- 172.21.15.144:0/3045879520 --> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56078a058530 con 0x56078a111f90 2024-05-30T16:42:49.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.336+0000 7fa4ce800640 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] conn(0x56078a111f90 0x56078a128230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.337+0000 7fa4ce800640 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] conn(0x56078a111f90 0x56078a128230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe436ab7ff1f270 server_cookie=55be04d085657451 in_seq=0 out_seq=0 2024-05-30T16:42:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.337+0000 7fa4b3400640 10 client.4917 ms_handle_connect on v2:172.21.15.149:6833/2240940065 2024-05-30T16:42:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.339+0000 7fa4b3400640 1 -- 172.21.15.144:0/3045879520 <== mds.0 v2:172.21.15.149:6833/2240940065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56078a058530 con 0x56078a111f90 2024-05-30T16:42:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.339+0000 7fa4b3400640 10 client.4917 handle_command_reply: tid=0 2024-05-30T16:42:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.339+0000 7fa4d8180740 1 client.4917 shutdown 2024-05-30T16:42:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 -- 172.21.15.144:0/3045879520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 msgr2=0x56078a113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a113a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8062840 tx=0x7fa4c805a9d0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 -- 172.21.15.144:0/3045879520 shutdown_connections 2024-05-30T16:42:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] conn(0x56078a111f90 0x56078a128230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a113a60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a114760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3045879520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 0x56078a1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4b3400640 0 client.4917 ms_handle_reset on v2:172.21.15.149:6833/2240940065 2024-05-30T16:42:49.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 -- 172.21.15.144:0/3045879520 >> 172.21.15.144:0/3045879520 conn(0x56078a10d2a0 msgr2=0x56078a0dfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:49.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 -- 172.21.15.144:0/3045879520 shutdown_connections 2024-05-30T16:42:49.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 1 -- 172.21.15.144:0/3045879520 wait complete. 2024-05-30T16:42:49.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.340+0000 7fa4d8180740 20 client.4917 trim_cache size 0 max 16384 2024-05-30T16:42:49.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.360+0000 7fa4d8180740 1 Processor -- start 2024-05-30T16:42:49.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.360+0000 7fa4d8180740 1 -- start start 2024-05-30T16:42:49.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.360+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a14f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.360+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a110f60 0x56078a14f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.360+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a12d3e0 0x56078a0e1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.360+0000 7fa4d8180740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d01ffe70 con 0x56078a10ad70 2024-05-30T16:42:49.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.360+0000 7fa4d8180740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d01ff250 con 0x56078a110f60 2024-05-30T16:42:49.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.360+0000 7fa4d8180740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d01ff820 con 0x56078a12d3e0 2024-05-30T16:42:49.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a14f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a14f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33084/0 (socket says 172.21.15.144:33084) 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4ce800640 1 -- 172.21.15.144:0/1739541613 learned_addr learned my addr 172.21.15.144:0/1739541613 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4cf200640 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a12d3e0 0x56078a0e1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4ce800640 1 -- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a12d3e0 msgr2=0x56078a0e1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4ce800640 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a12d3e0 0x56078a0e1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a110f60 0x56078a14f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4ce800640 1 -- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a110f60 msgr2=0x56078a14f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4ce800640 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a110f60 0x56078a14f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4ce800640 1 -- 172.21.15.144:0/1739541613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078a12dbb0 con 0x56078a10ad70 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4cf200640 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a12d3e0 0x56078a0e1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.361+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a110f60 0x56078a14f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:49.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.362+0000 7fa4ce800640 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a14f170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0001e30 tx=0x7fa4c0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdccf87b407fe3e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.362+0000 7fa4be600640 1 -- 172.21.15.144:0/1739541613 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0014af0 con 0x56078a10ad70 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.362+0000 7fa4be600640 1 -- 172.21.15.144:0/1739541613 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c002a070 con 0x56078a10ad70 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.362+0000 7fa4be600640 1 -- 172.21.15.144:0/1739541613 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0024180 con 0x56078a10ad70 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.362+0000 7fa4d8180740 1 -- 172.21.15.144:0/1739541613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 msgr2=0x56078a14f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.362+0000 7fa4d8180740 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a14f170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0001e30 tx=0x7fa4c0010000 comp rx=0 tx=0).stop 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.363+0000 7fa4d8180740 1 -- 172.21.15.144:0/1739541613 shutdown_connections 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.363+0000 7fa4d8180740 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a12d3e0 0x56078a0e1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.363+0000 7fa4d8180740 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a110f60 0x56078a14f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.363+0000 7fa4d8180740 1 --2- 172.21.15.144:0/1739541613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a10ad70 0x56078a14f170 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.363+0000 7fa4d8180740 1 -- 172.21.15.144:0/1739541613 >> 172.21.15.144:0/1739541613 conn(0x56078a10d2a0 msgr2=0x56078a0e6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.363+0000 7fa4d8180740 1 -- 172.21.15.144:0/1739541613 shutdown_connections 2024-05-30T16:42:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.363+0000 7fa4d8180740 1 -- 172.21.15.144:0/1739541613 wait complete. 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.363+0000 7fa4d8180740 1 -- start start 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.364+0000 7fa4d8180740 1 Processor -- start 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.364+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 0x56078a10f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a12f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4d8180740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a12fc50 0x56078a0dfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4d8180740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56078a111e10 con 0x56078a12fc50 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4d8180740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56078a112860 con 0x56078a12d3e0 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4d8180740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56078a1123d0 con 0x56078a110f60 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4d8180740 10 client.0 _ll_register_callbacks cb 0x7fa4c800ee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a12fc50 0x56078a0dfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a12fc50 0x56078a0dfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33094/0 (socket says 172.21.15.144:33094) 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4cf200640 1 -- 172.21.15.144:0/3641524183 learned_addr learned my addr 172.21.15.144:0/3641524183 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4cf200640 1 -- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 msgr2=0x56078a10f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 0x56078a10f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4cf200640 1 -- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 msgr2=0x56078a12f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4c5e00640 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a12f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a12f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4cf200640 1 -- 172.21.15.144:0/3641524183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078a126b50 con 0x56078a12fc50 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4cf200640 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a12fc50 0x56078a0dfea0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa4c805e330 tx=0x7fa4c8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff2e89b293f4249 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.365+0000 7fa4b3400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4b3400640 1 -- 172.21.15.144:0/3641524183 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c807d020 con 0x56078a12fc50 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4b3400640 1 -- 172.21.15.144:0/3641524183 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa4c806edb0 con 0x56078a12fc50 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4d8180740 1 -- 172.21.15.144:0/3641524183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4c002a070 con 0x56078a12fc50 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4b3400640 1 -- 172.21.15.144:0/3641524183 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa4c8062d70 con 0x56078a12fc50 2024-05-30T16:42:49.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4d8180740 10 client.4923 fetch_fsmap learned FSMap version 17 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4d8180740 1 -- 172.21.15.144:0/3641524183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56078a12c490 con 0x56078a12fc50 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4b3400640 1 -- 172.21.15.144:0/3641524183 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c002a070 con 0x56078a12fc50 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4b3400640 1 -- 172.21.15.144:0/3641524183 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fa4c8080020 con 0x56078a12fc50 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4d8180740 10 client.4923 fetch_fsmap finished waiting for FSMap version 17 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4d8180740 10 client.4923 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4d8180740 20 client.4923 populate_metadata read hostname 'smithi144' 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] conn(0x56078a109d00 0x56078a10a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4d8180740 4 client.4923 mds_command: new command op to 4749 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.366+0000 7fa4d8180740 1 -- 172.21.15.144:0/3641524183 --> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] -- command(tid 0: {"prefix": "status"}) -- 0x56078a0523a0 con 0x56078a109d00 2024-05-30T16:42:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.367+0000 7fa4ce800640 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] conn(0x56078a109d00 0x56078a10a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.368+0000 7fa4ce800640 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] conn(0x56078a109d00 0x56078a10a0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1b1cebf7a351907 server_cookie=3c92917f02d2cd24 in_seq=0 out_seq=0 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.368+0000 7fa4b3400640 10 client.4923 ms_handle_connect on v2:172.21.15.149:6833/2240940065 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4b3400640 1 -- 172.21.15.144:0/3641524183 <== mds.0 v2:172.21.15.149:6833/2240940065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56078a0523a0 con 0x56078a109d00 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4b3400640 10 client.4923 handle_command_reply: tid=0 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 client.4923 shutdown 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 -- 172.21.15.144:0/3641524183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a12fc50 msgr2=0x56078a0dfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a12fc50 0x56078a0dfea0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa4c805e330 tx=0x7fa4c8016040 comp rx=0 tx=0).stop 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 -- 172.21.15.144:0/3641524183 shutdown_connections 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:6833/2240940065,v1:172.21.15.149:6835/2240940065] conn(0x56078a109d00 0x56078a10a0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56078a12fc50 0x56078a0dfea0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56078a12d3e0 0x56078a12f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 --2- 172.21.15.144:0/3641524183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56078a110f60 0x56078a10f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4b3400640 0 client.4923 ms_handle_reset on v2:172.21.15.149:6833/2240940065 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 -- 172.21.15.144:0/3641524183 >> 172.21.15.144:0/3641524183 conn(0x56078a10d2a0 msgr2=0x56078a126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 -- 172.21.15.144:0/3641524183 shutdown_connections 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 1 -- 172.21.15.144:0/3641524183 wait complete. 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.369+0000 7fa4d8180740 20 client.4923 trim_cache size 0 max 16384 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4749, 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-05-30T16:42:49.372 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.6493447019999996, 2024-05-30T16:42:49.373 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 17, 2024-05-30T16:42:49.373 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 31, 2024-05-30T16:42:49.373 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 31, 2024-05-30T16:42:49.373 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 14.500060006 2024-05-30T16:42:49.373 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 -- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa4ac06c8f0 msgr2=0x7fa4ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa4ac06c8f0 0x7fa4ac06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00015a0 tx=0x7fa4c0009040 comp rx=0 tx=0).stop 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 -- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d0161320 msgr2=0x7fa4d0161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d0161320 0x7fa4d0161790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007e30 tx=0x7fa4c800e4b0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 -- 172.21.15.144:0/3273840780 shutdown_connections 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa4ac06c8f0 0x7fa4ac06edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d0161320 0x7fa4d0161790 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4d0159320 0x7fa4d01f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 --2- 172.21.15.144:0/3273840780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d006efb0 0x7fa4d0149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 -- 172.21.15.144:0/3273840780 >> 172.21.15.144:0/3273840780 conn(0x7fa4d00629c0 msgr2=0x7fa4d00af150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 -- 172.21.15.144:0/3273840780 shutdown_connections 2024-05-30T16:42:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.370+0000 7fa4d5400640 1 -- 172.21.15.144:0/3273840780 wait complete. 2024-05-30T16:42:49.387 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:42:49.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.577+0000 7f3984c00640 1 Processor -- start 2024-05-30T16:42:49.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.577+0000 7f3984c00640 1 -- start start 2024-05-30T16:42:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.579+0000 7f3984c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f398015e960 0x7f3980162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.579+0000 7f3984c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f39800cfbe0 0x7f39800d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.579+0000 7f3984c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398015ed40 con 0x7f39800ba090 2024-05-30T16:42:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.579+0000 7f3984c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f39800d2b40 con 0x7f398015e960 2024-05-30T16:42:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.579+0000 7f3984c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f39801629d0 con 0x7f39800cfbe0 2024-05-30T16:42:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.579+0000 7f397f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f398015e960 0x7f3980162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.579+0000 7f3976a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f39800ba090 0x7f39800cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33330/0 (socket says 172.21.15.144:33330) 2024-05-30T16:42:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.579+0000 7f3976a00640 1 -- 172.21.15.144:0/1373045347 learned_addr learned my addr 172.21.15.144:0/1373045347 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.580+0000 7f397fe00640 1 --2- 172.21.15.144:0/1373045347 >> v2:172.21.15.149:3300/0 conn(0x7f39800cfbe0 0x7f39800d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.580+0000 7f397ea00640 1 -- 172.21.15.144:0/1373045347 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588075709 0 0) 0x7f398015ed40 con 0x7f39800ba090 2024-05-30T16:42:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.580+0000 7f397ea00640 1 -- 172.21.15.144:0/1373045347 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3964003520 con 0x7f39800ba090 2024-05-30T16:42:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.580+0000 7f397f400640 1 -- 172.21.15.144:0/1373045347 >> v2:172.21.15.149:3300/0 conn(0x7f39800cfbe0 msgr2=0x7f39800d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.580+0000 7f397f400640 1 --2- 172.21.15.144:0/1373045347 >> v2:172.21.15.149:3300/0 conn(0x7f39800cfbe0 0x7f39800d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.580+0000 7f397f400640 1 -- 172.21.15.144:0/1373045347 >> v1:172.21.15.144:6789/0 conn(0x7f39800ba090 legacy=0x7f39800cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.580+0000 7f397f400640 1 -- 172.21.15.144:0/1373045347 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3980162ca0 con 0x7f398015e960 2024-05-30T16:42:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.581+0000 7f397f400640 1 --2- 172.21.15.144:0/1373045347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 0x7f3980162490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39800cf110 tx=0x7f397002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e71a7a2b5dc4dd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.581+0000 7f397ea00640 1 -- 172.21.15.144:0/1373045347 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970007740 con 0x7f398015e960 2024-05-30T16:42:49.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.581+0000 7f397ea00640 1 -- 172.21.15.144:0/1373045347 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39700078e0 con 0x7f398015e960 2024-05-30T16:42:49.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.581+0000 7f397ea00640 1 -- 172.21.15.144:0/1373045347 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970007cb0 con 0x7f398015e960 2024-05-30T16:42:49.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.582+0000 7f3984c00640 1 -- 172.21.15.144:0/1373045347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 msgr2=0x7f3980162490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.582+0000 7f3984c00640 1 --2- 172.21.15.144:0/1373045347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 0x7f3980162490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39800cf110 tx=0x7f397002a680 comp rx=0 tx=0).stop 2024-05-30T16:42:49.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.582+0000 7f3984c00640 1 -- 172.21.15.144:0/1373045347 shutdown_connections 2024-05-30T16:42:49.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.582+0000 7f3984c00640 1 --2- 172.21.15.144:0/1373045347 >> v2:172.21.15.149:3300/0 conn(0x7f39800cfbe0 0x7f39800d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.582+0000 7f3984c00640 1 --2- 172.21.15.144:0/1373045347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 0x7f3980162490 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.582+0000 7f3984c00640 1 -- 172.21.15.144:0/1373045347 >> 172.21.15.144:0/1373045347 conn(0x7f39800d1360 msgr2=0x7f39800d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:49.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.582+0000 7f3984c00640 1 -- 172.21.15.144:0/1373045347 shutdown_connections 2024-05-30T16:42:49.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.582+0000 7f3984c00640 1 -- 172.21.15.144:0/1373045347 wait complete. 2024-05-30T16:42:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.584+0000 7f3984c00640 1 Processor -- start 2024-05-30T16:42:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.584+0000 7f3984c00640 1 -- start start 2024-05-30T16:42:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f3984c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39800ba090 0x7f39800ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f3984c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39800cfbe0 0x7f3980147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f3984c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 0x7f398015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f3984c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f39800d2d90 con 0x7f398015e960 2024-05-30T16:42:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f3984c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3980163260 con 0x7f39800ba090 2024-05-30T16:42:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f3984c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f39800b78a0 con 0x7f39800cfbe0 2024-05-30T16:42:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 0x7f398015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 0x7f398015c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33108/0 (socket says 172.21.15.144:33108) 2024-05-30T16:42:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397fe00640 1 -- 172.21.15.144:0/493602753 learned_addr learned my addr 172.21.15.144:0/493602753 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397f400640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39800ba090 0x7f39800ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f3976a00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39800cfbe0 0x7f3980147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397fe00640 1 -- 172.21.15.144:0/493602753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39800cfbe0 msgr2=0x7f3980147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397fe00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39800cfbe0 0x7f3980147960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397fe00640 1 -- 172.21.15.144:0/493602753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39800ba090 msgr2=0x7f39800ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397fe00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39800ba090 0x7f39800ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397fe00640 1 -- 172.21.15.144:0/493602753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39801556a0 con 0x7f398015e960 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.586+0000 7f397f400640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39800ba090 0x7f39800ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.587+0000 7f397fe00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 0x7f398015c9c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f397800d5a0 tx=0x7f397800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.587+0000 7f3977e00640 1 -- 172.21.15.144:0/493602753 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39780125f0 con 0x7f398015e960 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.587+0000 7f3977e00640 1 -- 172.21.15.144:0/493602753 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3978019070 con 0x7f398015e960 2024-05-30T16:42:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.587+0000 7f3977e00640 1 -- 172.21.15.144:0/493602753 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39780129d0 con 0x7f398015e960 2024-05-30T16:42:49.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.587+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3980155980 con 0x7f398015e960 2024-05-30T16:42:49.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.587+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398014a7b0 con 0x7f398015e960 2024-05-30T16:42:49.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.588+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3980075570 con 0x7f398015e960 2024-05-30T16:42:49.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.589+0000 7f3977e00640 1 -- 172.21.15.144:0/493602753 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3978012b70 con 0x7f398015e960 2024-05-30T16:42:49.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.590+0000 7f3977e00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f395c06c8f0 0x7f395c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:49.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.590+0000 7f3977e00640 1 -- 172.21.15.144:0/493602753 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f397808bff0 con 0x7f398015e960 2024-05-30T16:42:49.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.590+0000 7f397f400640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f395c06c8f0 0x7f395c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:49.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.591+0000 7f397f400640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f395c06c8f0 0x7f395c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3970034000 tx=0x7f397002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:49.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.595+0000 7f3977e00640 1 -- 172.21.15.144:0/493602753 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f397805a380 con 0x7f398015e960 2024-05-30T16:42:49.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.823+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f39800d2410 con 0x7f398015e960 2024-05-30T16:42:49.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.823+0000 7f3977e00640 1 -- 172.21.15.144:0/493602753 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f3978059c80 con 0x7f398015e960 2024-05-30T16:42:49.825 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:42:49.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f395c06c8f0 msgr2=0x7f395c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f395c06c8f0 0x7f395c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3970034000 tx=0x7f397002f000 comp rx=0 tx=0).stop 2024-05-30T16:42:49.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 msgr2=0x7f398015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 0x7f398015c9c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f397800d5a0 tx=0x7f397800da60 comp rx=0 tx=0).stop 2024-05-30T16:42:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 shutdown_connections 2024-05-30T16:42:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f395c06c8f0 0x7f395c06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398015e960 0x7f398015c9c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39800cfbe0 0x7f3980147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 --2- 172.21.15.144:0/493602753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39800ba090 0x7f39800ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 >> 172.21.15.144:0/493602753 conn(0x7f39800d1360 msgr2=0x7f398015d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 shutdown_connections 2024-05-30T16:42:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:49.826+0000 7f3984c00640 1 -- 172.21.15.144:0/493602753 wait complete. 2024-05-30T16:42:49.848 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T16:42:49.848 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:42:49.848 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-05-30T16:42:49.848 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:42:49.848 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:42:49.848 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T16:42:49.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T16:42:49.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:42:49.849 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:42:49.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:49.849 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-05-30T16:42:49.900 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-05-30T16:42:49.901 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42517sec preferred_lft 42517sec 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9019:bbff:fe7f:ed10/64 scope link 2024-05-30T16:42:49.902 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:49.903 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:42:49.903 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:42:49.903 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9c4d:5aff:fe40:b9d1/64 scope link 2024-05-30T16:42:49.903 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:49.903 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:42:49.903 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:dc:91:e3:69:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:42:49.903 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9cdc:91ff:fee3:6906/64 scope link 2024-05-30T16:42:49.903 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:42:49.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:49.904 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:42:49.977 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-05-30T16:42:49.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:49.982 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-05-30T16:42:50.033 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-05-30T16:42:50.033 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:42:50.033 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:42:50.033 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:42:50.034 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:42:50.035 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:42:50.035 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:42:50.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:42:50.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:42:50.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:42:50.035 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:42:50.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:42:50.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:50.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:50.247 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:42:50.295 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:42:50.295 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:42:50.295 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:42:50.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:50.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-05-30T16:42:50.374 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:50.375 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:42:50.424 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:42:50.424 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:42:50.425 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:42:50.471 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T16:42:50.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:50.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:50.595 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:50.596 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:50.629 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:42:50.629 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:42:50.629 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-05-30T16:42:50.629 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@865cdc9a-e28b-4870-8751-0312b261bc38.cephfs=/ 2024-05-30T16:42:50.630 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-05-30T16:42:50.631 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-30T16:42:50.631 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-05-30T16:42:50.631 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-30T16:42:50.632 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-05-30T16:42:50.632 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-30T16:42:50.635 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T16:42:50.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:50.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:42:50.710 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:42:50.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:42:50.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:42:50.847 INFO:teuthology.orchestra.run.smithi144.stdout:client4550 2024-05-30T16:42:50.847 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:50.847 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:50.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T16:42:51.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.102+0000 7fdff1400640 1 Processor -- start 2024-05-30T16:42:51.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.102+0000 7fdff1400640 1 -- start start 2024-05-30T16:42:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.104+0000 7fdff1400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdfec071d60 0x7fdfec0721f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.104+0000 7fdff1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.104+0000 7fdff1400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfec0b4370 con 0x7fdfec0cfe30 2024-05-30T16:42:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.104+0000 7fdff1400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fdfec0d0210 con 0x7fdfec071d60 2024-05-30T16:42:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.104+0000 7fdff1400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdfec1632c0 con 0x7fdfec0ce0a0 2024-05-30T16:42:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.104+0000 7fdff0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.105+0000 7fdff0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec0ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:49138/0 (socket says 172.21.15.144:49138) 2024-05-30T16:42:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.105+0000 7fdff0a00640 1 -- 172.21.15.144:0/2575763904 learned_addr learned my addr 172.21.15.144:0/2575763904 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.105+0000 7fdfe3e00640 1 --2- 172.21.15.144:0/2575763904 >> v2:172.21.15.149:3300/0 conn(0x7fdfec071d60 0x7fdfec0721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.105+0000 7fdff0a00640 1 -- 172.21.15.144:0/2575763904 >> v2:172.21.15.149:3300/0 conn(0x7fdfec071d60 msgr2=0x7fdfec0721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.105+0000 7fdff0a00640 1 --2- 172.21.15.144:0/2575763904 >> v2:172.21.15.149:3300/0 conn(0x7fdfec071d60 0x7fdfec0721f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.105+0000 7fdff0a00640 1 -- 172.21.15.144:0/2575763904 >> v1:172.21.15.149:6789/0 conn(0x7fdfec0cfe30 legacy=0x7fdfec0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.105+0000 7fdff0a00640 1 -- 172.21.15.144:0/2575763904 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec1635a0 con 0x7fdfec0ce0a0 2024-05-30T16:42:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.105+0000 7fdfeb400640 1 -- 172.21.15.144:0/2575763904 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273656581 0 0) 0x7fdfec0b4370 con 0x7fdfec0cfe30 2024-05-30T16:42:51.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.107+0000 7fdff0a00640 1 --2- 172.21.15.144:0/2575763904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec0ce4e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009e50 tx=0x7fdfe402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2cddf1268c2fd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:51.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.107+0000 7fdfeb400640 1 -- 172.21.15.144:0/2575763904 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4036070 con 0x7fdfec0ce0a0 2024-05-30T16:42:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdfeb400640 1 -- 172.21.15.144:0/2575763904 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe4031600 con 0x7fdfec0ce0a0 2024-05-30T16:42:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdfeb400640 1 -- 172.21.15.144:0/2575763904 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40319d0 con 0x7fdfec0ce0a0 2024-05-30T16:42:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdff1400640 1 -- 172.21.15.144:0/2575763904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 msgr2=0x7fdfec0ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdff1400640 1 --2- 172.21.15.144:0/2575763904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec0ce4e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009e50 tx=0x7fdfe402a710 comp rx=0 tx=0).stop 2024-05-30T16:42:51.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdff1400640 1 -- 172.21.15.144:0/2575763904 shutdown_connections 2024-05-30T16:42:51.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdff1400640 1 --2- 172.21.15.144:0/2575763904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec0ce4e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdff1400640 1 --2- 172.21.15.144:0/2575763904 >> v2:172.21.15.149:3300/0 conn(0x7fdfec071d60 0x7fdfec0721f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdff1400640 1 -- 172.21.15.144:0/2575763904 >> 172.21.15.144:0/2575763904 conn(0x7fdfec0b2160 msgr2=0x7fdfec0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:51.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdff1400640 1 -- 172.21.15.144:0/2575763904 shutdown_connections 2024-05-30T16:42:51.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.108+0000 7fdff1400640 1 -- 172.21.15.144:0/2575763904 wait complete. 2024-05-30T16:42:51.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.110+0000 7fdff1400640 1 Processor -- start 2024-05-30T16:42:51.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.110+0000 7fdff1400640 1 -- start start 2024-05-30T16:42:51.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.111+0000 7fdff1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfec071d60 0x7fdfec0aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:51.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.111+0000 7fdff1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec1fb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:51.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.111+0000 7fdff1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec0cfe30 0x7fdfec0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:51.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.111+0000 7fdff1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec164080 con 0x7fdfec071d60 2024-05-30T16:42:51.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.111+0000 7fdff1400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec163b60 con 0x7fdfec0cfe30 2024-05-30T16:42:51.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.111+0000 7fdff1400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdfec0b5540 con 0x7fdfec0ce0a0 2024-05-30T16:42:51.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.111+0000 7fdfebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfec071d60 0x7fdfec0aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:51.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.111+0000 7fdfebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfec071d60 0x7fdfec0aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33118/0 (socket says 172.21.15.144:33118) 2024-05-30T16:42:51.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.111+0000 7fdfebe00640 1 -- 172.21.15.144:0/2247609433 learned_addr learned my addr 172.21.15.144:0/2247609433 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.112+0000 7fdfe3e00640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec1fb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.112+0000 7fdff0a00640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec0cfe30 0x7fdfec0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.112+0000 7fdfebe00640 1 -- 172.21.15.144:0/2247609433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 msgr2=0x7fdfec1fb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.112+0000 7fdfebe00640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec1fb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.112+0000 7fdfebe00640 1 -- 172.21.15.144:0/2247609433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec0cfe30 msgr2=0x7fdfec0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.112+0000 7fdfebe00640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec0cfe30 0x7fdfec0b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.112+0000 7fdfebe00640 1 -- 172.21.15.144:0/2247609433 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec159510 con 0x7fdfec071d60 2024-05-30T16:42:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.112+0000 7fdfebe00640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfec071d60 0x7fdfec0aed30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00c3e0 tx=0x7fdfdc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.112+0000 7fdfe8c00640 1 -- 172.21.15.144:0/2247609433 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc017070 con 0x7fdfec071d60 2024-05-30T16:42:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.113+0000 7fdfe8c00640 1 -- 172.21.15.144:0/2247609433 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc0052d0 con 0x7fdfec071d60 2024-05-30T16:42:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.113+0000 7fdfe8c00640 1 -- 172.21.15.144:0/2247609433 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc003830 con 0x7fdfec071d60 2024-05-30T16:42:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.113+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec0af270 con 0x7fdfec071d60 2024-05-30T16:42:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.113+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec1fc2f0 con 0x7fdfec071d60 2024-05-30T16:42:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.114+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfec075570 con 0x7fdfec071d60 2024-05-30T16:42:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.115+0000 7fdfe8c00640 1 -- 172.21.15.144:0/2247609433 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfdc01a070 con 0x7fdfec071d60 2024-05-30T16:42:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.116+0000 7fdfe8c00640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdfc806c920 0x7fdfc806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.116+0000 7fdfe8c00640 1 -- 172.21.15.144:0/2247609433 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fdfdc08afe0 con 0x7fdfec071d60 2024-05-30T16:42:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.116+0000 7fdfe3e00640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdfc806c920 0x7fdfc806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.117+0000 7fdfe3e00640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdfc806c920 0x7fdfc806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfec1fb720 tx=0x7fdfd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:51.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.120+0000 7fdfe8c00640 1 -- 172.21.15.144:0/2247609433 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfdc059320 con 0x7fdfec071d60 2024-05-30T16:42:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.361+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fdfec1fbd00 con 0x7fdfec071d60 2024-05-30T16:42:51.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.794+0000 7fdfe8c00640 1 -- 172.21.15.144:0/2247609433 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) ==== 136+0+0 (secure 0 0 0) 0x7fdfdc058c20 con 0x7fdfec071d60 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.797+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdfc806c920 msgr2=0x7fdfc806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.797+0000 7fdff1400640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdfc806c920 0x7fdfc806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfec1fb720 tx=0x7fdfd4008040 comp rx=0 tx=0).stop 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.797+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfec071d60 msgr2=0x7fdfec0aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.797+0000 7fdff1400640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfec071d60 0x7fdfec0aed30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00c3e0 tx=0x7fdfdc00c8a0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.798+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 shutdown_connections 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.798+0000 7fdff1400640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdfc806c920 0x7fdfc806ede0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.798+0000 7fdff1400640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec0cfe30 0x7fdfec0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.798+0000 7fdff1400640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0ce0a0 0x7fdfec1fb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.798+0000 7fdff1400640 1 --2- 172.21.15.144:0/2247609433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfec071d60 0x7fdfec0aed30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.798+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 >> 172.21.15.144:0/2247609433 conn(0x7fdfec0b2160 msgr2=0x7fdfec0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:51.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.798+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 shutdown_connections 2024-05-30T16:42:51.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:51.798+0000 7fdff1400640 1 -- 172.21.15.144:0/2247609433 wait complete. 2024-05-30T16:42:51.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:42:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.021+0000 7f42ac000640 1 Processor -- start 2024-05-30T16:42:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.021+0000 7f42ac000640 1 -- start start 2024-05-30T16:42:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.023+0000 7f42ac000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f42a40b6470 0x7f42a40b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.023+0000 7f42ac000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a415ed10 0x7f42a40d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.023+0000 7f42ac000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a4162d60 con 0x7f42a415e930 2024-05-30T16:42:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.023+0000 7f42ac000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f42a40b80a0 con 0x7f42a40b6470 2024-05-30T16:42:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.023+0000 7f42ac000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f42a4163030 con 0x7f42a415ed10 2024-05-30T16:42:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.023+0000 7f42a8c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f42a40b6470 0x7f42a40b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.024+0000 7f42aa000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a415ed10 0x7f42a40d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.024+0000 7f42a8c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f42a40b6470 0x7f42a40b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:45808/0 (socket says 172.21.15.144:45808) 2024-05-30T16:42:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.024+0000 7f42a8c00640 1 -- 172.21.15.144:0/3781393483 learned_addr learned my addr 172.21.15.144:0/3781393483 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:52.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.024+0000 7f42a8c00640 1 -- 172.21.15.144:0/3781393483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a415ed10 msgr2=0x7f42a40d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:52.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.024+0000 7f42a8c00640 1 --2- 172.21.15.144:0/3781393483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a415ed10 0x7f42a40d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.024+0000 7f42a8c00640 1 -- 172.21.15.144:0/3781393483 >> v1:172.21.15.149:6789/0 conn(0x7f42a415e930 legacy=0x7f42a4162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.024+0000 7f42a8c00640 1 -- 172.21.15.144:0/3781393483 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a4163310 con 0x7f42a40b6470 2024-05-30T16:42:52.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.026+0000 7f42a8c00640 1 --2- 172.21.15.144:0/3781393483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a40b6470 0x7f42a40b7b60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4294009e50 tx=0x7f429402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99a1545e76d127f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:52.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.026+0000 7f42a3e00640 1 -- 172.21.15.144:0/3781393483 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294036070 con 0x7f42a40b6470 2024-05-30T16:42:52.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.026+0000 7f42a3e00640 1 -- 172.21.15.144:0/3781393483 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4294031600 con 0x7f42a40b6470 2024-05-30T16:42:52.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.027+0000 7f42a3e00640 1 -- 172.21.15.144:0/3781393483 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42940319d0 con 0x7f42a40b6470 2024-05-30T16:42:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.027+0000 7f42ac000640 1 -- 172.21.15.144:0/3781393483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a40b6470 msgr2=0x7f42a40b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.027+0000 7f42ac000640 1 --2- 172.21.15.144:0/3781393483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a40b6470 0x7f42a40b7b60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4294009e50 tx=0x7f429402a710 comp rx=0 tx=0).stop 2024-05-30T16:42:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.027+0000 7f42ac000640 1 -- 172.21.15.144:0/3781393483 shutdown_connections 2024-05-30T16:42:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.027+0000 7f42ac000640 1 --2- 172.21.15.144:0/3781393483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a415ed10 0x7f42a40d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.027+0000 7f42ac000640 1 --2- 172.21.15.144:0/3781393483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a40b6470 0x7f42a40b7b60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.027+0000 7f42ac000640 1 -- 172.21.15.144:0/3781393483 >> 172.21.15.144:0/3781393483 conn(0x7f42a4062390 msgr2=0x7f42a40627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.027+0000 7f42ac000640 1 -- 172.21.15.144:0/3781393483 shutdown_connections 2024-05-30T16:42:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.027+0000 7f42ac000640 1 -- 172.21.15.144:0/3781393483 wait complete. 2024-05-30T16:42:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.029+0000 7f42ac000640 1 Processor -- start 2024-05-30T16:42:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.029+0000 7f42ac000640 1 -- start start 2024-05-30T16:42:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.030+0000 7f42ac000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a40b6470 0x7f42a414cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.030+0000 7f42ac000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415e930 0x7f42a415faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.030+0000 7f42ac000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a415ed10 0x7f42a4161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.030+0000 7f42ac000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42a40d1840 con 0x7f42a415e930 2024-05-30T16:42:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.030+0000 7f42ac000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f42a40d3000 con 0x7f42a415ed10 2024-05-30T16:42:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.030+0000 7f42ac000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f42a40d19c0 con 0x7f42a40b6470 2024-05-30T16:42:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.030+0000 7f42a8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415e930 0x7f42a415faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.030+0000 7f42a8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415e930 0x7f42a415faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33128/0 (socket says 172.21.15.144:33128) 2024-05-30T16:42:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.030+0000 7f42a8c00640 1 -- 172.21.15.144:0/50619035 learned_addr learned my addr 172.21.15.144:0/50619035 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.031+0000 7f42a9600640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a40b6470 0x7f42a414cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.031+0000 7f42aa000640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a415ed10 0x7f42a4161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.031+0000 7f42a8c00640 1 -- 172.21.15.144:0/50619035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a40b6470 msgr2=0x7f42a414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.031+0000 7f42a8c00640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a40b6470 0x7f42a414cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.031+0000 7f42a8c00640 1 -- 172.21.15.144:0/50619035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a415ed10 msgr2=0x7f42a4161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.031+0000 7f42a8c00640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a415ed10 0x7f42a4161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.031+0000 7f42a8c00640 1 -- 172.21.15.144:0/50619035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a4160590 con 0x7f42a415e930 2024-05-30T16:42:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.031+0000 7f42a8c00640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415e930 0x7f42a415faf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4294034040 tx=0x7f4294004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:52.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.032+0000 7f42a1600640 1 -- 172.21.15.144:0/50619035 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294036050 con 0x7f42a415e930 2024-05-30T16:42:52.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.032+0000 7f42a1600640 1 -- 172.21.15.144:0/50619035 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4294042070 con 0x7f42a415e930 2024-05-30T16:42:52.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.032+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a40cbaf0 con 0x7f42a415e930 2024-05-30T16:42:52.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.032+0000 7f42a1600640 1 -- 172.21.15.144:0/50619035 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294009510 con 0x7f42a415e930 2024-05-30T16:42:52.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.032+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a40cc0b0 con 0x7f42a415e930 2024-05-30T16:42:52.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.033+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a40cc2b0 con 0x7f42a415e930 2024-05-30T16:42:52.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.034+0000 7f42a1600640 1 -- 172.21.15.144:0/50619035 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4294007c70 con 0x7f42a415e930 2024-05-30T16:42:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.036+0000 7f42a1600640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f428806c8f0 0x7f428806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.036+0000 7f42a1600640 1 -- 172.21.15.144:0/50619035 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f42940ac8c0 con 0x7f42a415e930 2024-05-30T16:42:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.036+0000 7f42a9600640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f428806c8f0 0x7f428806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.037+0000 7f42a9600640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f428806c8f0 0x7f428806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4298007fd0 tx=0x7f4298009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.040+0000 7f42a1600640 1 -- 172.21.15.144:0/50619035 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42a40cc2b0 con 0x7f42a415e930 2024-05-30T16:42:52.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.266+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f42a415e150 con 0x7f428806c8f0 2024-05-30T16:42:52.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.270+0000 7f42a1600640 1 -- 172.21.15.144:0/50619035 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f42a415e150 con 0x7f428806c8f0 2024-05-30T16:42:52.271 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:42:52.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:42:52.271 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-05-30T16:42:52.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:42:52.271 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:42:52.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f428806c8f0 msgr2=0x7f428806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f428806c8f0 0x7f428806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4298007fd0 tx=0x7f4298009040 comp rx=0 tx=0).stop 2024-05-30T16:42:52.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415e930 msgr2=0x7f42a415faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415e930 0x7f42a415faf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4294034040 tx=0x7f4294004a40 comp rx=0 tx=0).stop 2024-05-30T16:42:52.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 shutdown_connections 2024-05-30T16:42:52.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f428806c8f0 0x7f428806edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a415ed10 0x7f42a4161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415e930 0x7f42a415faf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 --2- 172.21.15.144:0/50619035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a40b6470 0x7f42a414cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.272+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 >> 172.21.15.144:0/50619035 conn(0x7f42a4062390 msgr2=0x7f42a40d4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:52.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.273+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 shutdown_connections 2024-05-30T16:42:52.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.273+0000 7f42ac000640 1 -- 172.21.15.144:0/50619035 wait complete. 2024-05-30T16:42:52.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:42:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.492+0000 7f95e7e00640 1 Processor -- start 2024-05-30T16:42:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.492+0000 7f95e7e00640 1 -- start start 2024-05-30T16:42:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.494+0000 7f95e7e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f95e8145f10 0x7f95e80cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.494+0000 7f95e7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e80cd3e0 con 0x7f95e8160990 2024-05-30T16:42:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.494+0000 7f95e7e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e80cd6c0 con 0x7f95e806c3d0 2024-05-30T16:42:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.494+0000 7f95e7e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f95e806c840 con 0x7f95e8145f10 2024-05-30T16:42:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.494+0000 7f95e7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f95e8160990 0x7f95e806dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33336/0 (socket says 172.21.15.144:33336) 2024-05-30T16:42:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.494+0000 7f95e7400640 1 -- 172.21.15.144:0/1561377928 learned_addr learned my addr 172.21.15.144:0/1561377928 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:52.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e6a00640 1 --2- 172.21.15.144:0/1561377928 >> v2:172.21.15.149:3300/0 conn(0x7f95e8145f10 0x7f95e80cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250617757 0 0) 0x7f95e80cd3e0 con 0x7f95e8160990 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95cc003520 con 0x7f95e8160990 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 978799855 0 0) 0x7f95cc003520 con 0x7f95e8160990 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 >> v2:172.21.15.149:3300/0 conn(0x7f95e8145f10 msgr2=0x7f95e80cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 --2- 172.21.15.144:0/1561377928 >> v2:172.21.15.149:3300/0 conn(0x7f95e8145f10 0x7f95e80cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 >> v1:172.21.15.149:6789/0 conn(0x7f95e806c3d0 legacy=0x7f95e8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e80cd9a0 con 0x7f95e8160990 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f95e00019f0 con 0x7f95e8160990 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 >> v1:172.21.15.144:6789/0 conn(0x7f95e8160990 legacy=0x7f95e806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc003a00 0x7f95cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc004800 0x7f95cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95cc0051c0 0x7f95cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f95e806c840 con 0x7f95cc0051c0 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc00c0c0 con 0x7f95cc004800 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.495+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc00c2c0 con 0x7f95cc003a00 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.496+0000 7f95e7400640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95cc0051c0 0x7f95cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.496+0000 7f95e6a00640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc003a00 0x7f95cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.496+0000 7f95e7400640 1 -- 172.21.15.144:0/1561377928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc003a00 msgr2=0x7f95cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.496+0000 7f95e7400640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc003a00 0x7f95cc003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.496+0000 7f95e7400640 1 -- 172.21.15.144:0/1561377928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc004800 msgr2=0x7f95cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.496+0000 7f95e6000640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc004800 0x7f95cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.496+0000 7f95e7400640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc004800 0x7f95cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.496+0000 7f95e7400640 1 -- 172.21.15.144:0/1561377928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc003520 con 0x7f95cc0051c0 2024-05-30T16:42:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.496+0000 7f95e6000640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc004800 0x7f95cc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.497+0000 7f95e7400640 1 -- 172.21.15.144:0/1561377928 reap_dead start 2024-05-30T16:42:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.497+0000 7f95e7400640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95cc0051c0 0x7f95cc00b9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f95e000a740 tx=0x7f95cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cc7a2c47a37e0e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e000a390 con 0x7f95cc0051c0 2024-05-30T16:42:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e002f070 con 0x7f95cc0051c0 2024-05-30T16:42:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e5600640 1 -- 172.21.15.144:0/1561377928 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e002bbc0 con 0x7f95cc0051c0 2024-05-30T16:42:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e7e00640 1 -- 172.21.15.144:0/1561377928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95cc0051c0 msgr2=0x7f95cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e7e00640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95cc0051c0 0x7f95cc00b9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f95e000a740 tx=0x7f95cc005830 comp rx=0 tx=0).stop 2024-05-30T16:42:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e7e00640 1 -- 172.21.15.144:0/1561377928 shutdown_connections 2024-05-30T16:42:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e7e00640 1 --2- 172.21.15.144:0/1561377928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95cc0051c0 0x7f95cc00b9c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e7e00640 1 -- 172.21.15.144:0/1561377928 >> 172.21.15.144:0/1561377928 conn(0x7f95e806b8e0 msgr2=0x7f95e806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e7e00640 1 -- 172.21.15.144:0/1561377928 shutdown_connections 2024-05-30T16:42:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.498+0000 7f95e7e00640 1 -- 172.21.15.144:0/1561377928 wait complete. 2024-05-30T16:42:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.500+0000 7f95e7e00640 1 Processor -- start 2024-05-30T16:42:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.500+0000 7f95e7e00640 1 -- start start 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.501+0000 7f95e7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0051c0 0x7f95e813c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.501+0000 7f95e7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e8142c50 0x7f95e81430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.501+0000 7f95e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95e80ada10 0x7f95e80adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.501+0000 7f95e7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80cdf60 con 0x7f95e80ada10 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.501+0000 7f95e7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95e8161100 con 0x7f95e8142c50 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.501+0000 7f95e7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95e81462f0 con 0x7f95cc0051c0 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95e80ada10 0x7f95e80adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95e80ada10 0x7f95e80adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33144/0 (socket says 172.21.15.144:33144) 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e7400640 1 -- 172.21.15.144:0/44181388 learned_addr learned my addr 172.21.15.144:0/44181388 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e6a00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0051c0 0x7f95e813c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e6000640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e8142c50 0x7f95e81430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e7400640 1 -- 172.21.15.144:0/44181388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0051c0 msgr2=0x7f95e813c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e7400640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0051c0 0x7f95e813c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e7400640 1 -- 172.21.15.144:0/44181388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e8142c50 msgr2=0x7f95e81430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e7400640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e8142c50 0x7f95e81430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e7400640 1 -- 172.21.15.144:0/44181388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e813d330 con 0x7f95e80ada10 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e6a00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0051c0 0x7f95e813c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.502+0000 7f95e7400640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95e80ada10 0x7f95e80adec0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f95e000a830 tx=0x7f95e80b20f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.503+0000 7f95df400640 1 -- 172.21.15.144:0/44181388 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0001ee0 con 0x7f95e80ada10 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.503+0000 7f95df400640 1 -- 172.21.15.144:0/44181388 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e0001250 con 0x7f95e80ada10 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.503+0000 7f95df400640 1 -- 172.21.15.144:0/44181388 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e002bd40 con 0x7f95e80ada10 2024-05-30T16:42:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.503+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e813d5a0 con 0x7f95e80ada10 2024-05-30T16:42:52.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.503+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e813db60 con 0x7f95e80ada10 2024-05-30T16:42:52.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.504+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e80632f0 con 0x7f95e80ada10 2024-05-30T16:42:52.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.505+0000 7f95df400640 1 -- 172.21.15.144:0/44181388 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95e0034470 con 0x7f95e80ada10 2024-05-30T16:42:52.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.506+0000 7f95df400640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f95c806c920 0x7f95c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.506+0000 7f95df400640 1 -- 172.21.15.144:0/44181388 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f95e00ab920 con 0x7f95e80ada10 2024-05-30T16:42:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.506+0000 7f95e6a00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f95c806c920 0x7f95c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.507+0000 7f95e6a00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f95c806c920 0x7f95c806ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f95d80099e0 tx=0x7f95d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:52.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.510+0000 7f95df400640 1 -- 172.21.15.144:0/44181388 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95e0079cb0 con 0x7f95e80ada10 2024-05-30T16:42:52.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.711+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f95e8075570 con 0x7f95e80ada10 2024-05-30T16:42:52.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.711+0000 7f95df400640 1 -- 172.21.15.144:0/44181388 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f95e00795b0 con 0x7f95e80ada10 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f95c806c920 msgr2=0x7f95c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f95c806c920 0x7f95c806ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f95d80099e0 tx=0x7f95d8008040 comp rx=0 tx=0).stop 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95e80ada10 msgr2=0x7f95e80adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95e80ada10 0x7f95e80adec0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f95e000a830 tx=0x7f95e80b20f0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 shutdown_connections 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f95c806c920 0x7f95c806ede0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95e80ada10 0x7f95e80adec0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e8142c50 0x7f95e81430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 --2- 172.21.15.144:0/44181388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0051c0 0x7f95e813c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.714+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 >> 172.21.15.144:0/44181388 conn(0x7f95e806b8e0 msgr2=0x7f95e80af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:52.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.715+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 shutdown_connections 2024-05-30T16:42:52.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.715+0000 7f95e7e00640 1 -- 172.21.15.144:0/44181388 wait complete. 2024-05-30T16:42:52.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T16:42:52.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.940+0000 7f3c55c00640 1 Processor -- start 2024-05-30T16:42:52.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.940+0000 7f3c55c00640 1 -- start start 2024-05-30T16:42:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.942+0000 7f3c55c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c5013f760 0x7f3c5006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.942+0000 7f3c55c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3c500b5fd0 0x7f3c50142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.942+0000 7f3c55c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c5006ee80 con 0x7f3c500cec70 2024-05-30T16:42:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.942+0000 7f3c55c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3c501612b0 con 0x7f3c500b5fd0 2024-05-30T16:42:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.942+0000 7f3c55c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5013fb40 con 0x7f3c5013f760 2024-05-30T16:42:52.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.943+0000 7f3c4f400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3c500b5fd0 0x7f3c50142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.943+0000 7f3c4ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c5013f760 0x7f3c5006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.943+0000 7f3c4f400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3c500b5fd0 0x7f3c50142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:45842/0 (socket says 172.21.15.144:45842) 2024-05-30T16:42:52.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.943+0000 7f3c4f400640 1 -- 172.21.15.144:0/2656598344 learned_addr learned my addr 172.21.15.144:0/2656598344 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.943+0000 7f3c4f400640 1 -- 172.21.15.144:0/2656598344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c5013f760 msgr2=0x7f3c5006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.943+0000 7f3c4f400640 1 --2- 172.21.15.144:0/2656598344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c5013f760 0x7f3c5006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.943+0000 7f3c4f400640 1 -- 172.21.15.144:0/2656598344 >> v1:172.21.15.149:6789/0 conn(0x7f3c500cec70 legacy=0x7f3c500b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.943+0000 7f3c4f400640 1 -- 172.21.15.144:0/2656598344 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c50160730 con 0x7f3c500b5fd0 2024-05-30T16:42:52.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.945+0000 7f3c4f400640 1 --2- 172.21.15.144:0/2656598344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500b5fd0 0x7f3c50142200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009e50 tx=0x7f3c4802a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4a61d0998e3fdeb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:52.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.945+0000 7f3c4d600640 1 -- 172.21.15.144:0/2656598344 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48036070 con 0x7f3c500b5fd0 2024-05-30T16:42:52.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c4d600640 1 -- 172.21.15.144:0/2656598344 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c48031600 con 0x7f3c500b5fd0 2024-05-30T16:42:52.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c4d600640 1 -- 172.21.15.144:0/2656598344 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c480319d0 con 0x7f3c500b5fd0 2024-05-30T16:42:52.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c55c00640 1 -- 172.21.15.144:0/2656598344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500b5fd0 msgr2=0x7f3c50142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c55c00640 1 --2- 172.21.15.144:0/2656598344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500b5fd0 0x7f3c50142200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009e50 tx=0x7f3c4802a7a0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c55c00640 1 -- 172.21.15.144:0/2656598344 shutdown_connections 2024-05-30T16:42:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c55c00640 1 --2- 172.21.15.144:0/2656598344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500b5fd0 0x7f3c50142200 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c55c00640 1 --2- 172.21.15.144:0/2656598344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c5013f760 0x7f3c5006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c55c00640 1 -- 172.21.15.144:0/2656598344 >> 172.21.15.144:0/2656598344 conn(0x7f3c5006bd00 msgr2=0x7f3c5006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c55c00640 1 -- 172.21.15.144:0/2656598344 shutdown_connections 2024-05-30T16:42:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.946+0000 7f3c55c00640 1 -- 172.21.15.144:0/2656598344 wait complete. 2024-05-30T16:42:52.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.948+0000 7f3c55c00640 1 Processor -- start 2024-05-30T16:42:52.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.949+0000 7f3c55c00640 1 -- start start 2024-05-30T16:42:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c55c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c500b5fd0 0x7f3c5013e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c55c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500cec70 0x7f3c500aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c55c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5013f760 0x7f3c500b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c55c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50160fd0 con 0x7f3c5013f760 2024-05-30T16:42:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c55c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50160cf0 con 0x7f3c500cec70 2024-05-30T16:42:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c55c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3c500cf0d0 con 0x7f3c500b5fd0 2024-05-30T16:42:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c4f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5013f760 0x7f3c500b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c4f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5013f760 0x7f3c500b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33154/0 (socket says 172.21.15.144:33154) 2024-05-30T16:42:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c4f400640 1 -- 172.21.15.144:0/2849349782 learned_addr learned my addr 172.21.15.144:0/2849349782 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.950+0000 7f3c4ea00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c500b5fd0 0x7f3c5013e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c4e000640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500cec70 0x7f3c500aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c4f400640 1 -- 172.21.15.144:0/2849349782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c500b5fd0 msgr2=0x7f3c5013e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c4f400640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c500b5fd0 0x7f3c5013e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c4f400640 1 -- 172.21.15.144:0/2849349782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500cec70 msgr2=0x7f3c500aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c4f400640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500cec70 0x7f3c500aa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c4f400640 1 -- 172.21.15.144:0/2849349782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5013eec0 con 0x7f3c5013f760 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c4e000640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500cec70 0x7f3c500aa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c4f400640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5013f760 0x7f3c500b1870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009f70 tx=0x7f3c48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c46a00640 1 -- 172.21.15.144:0/2849349782 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48036050 con 0x7f3c5013f760 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c46a00640 1 -- 172.21.15.144:0/2849349782 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c48042070 con 0x7f3c5013f760 2024-05-30T16:42:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c46a00640 1 -- 172.21.15.144:0/2849349782 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48009510 con 0x7f3c5013f760 2024-05-30T16:42:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.951+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c500b4790 con 0x7f3c5013f760 2024-05-30T16:42:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.952+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c500b4d50 con 0x7f3c5013f760 2024-05-30T16:42:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.953+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c50068b90 con 0x7f3c5013f760 2024-05-30T16:42:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.954+0000 7f3c46a00640 1 -- 172.21.15.144:0/2849349782 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c48007bf0 con 0x7f3c5013f760 2024-05-30T16:42:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.955+0000 7f3c46a00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3c3006c920 0x7f3c3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.955+0000 7f3c46a00640 1 -- 172.21.15.144:0/2849349782 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3c480ac300 con 0x7f3c5013f760 2024-05-30T16:42:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.955+0000 7f3c4ea00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3c3006c920 0x7f3c3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.956+0000 7f3c4ea00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3c3006c920 0x7f3c3006ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c500b2430 tx=0x7f3c40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:52.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:52.959+0000 7f3c46a00640 1 -- 172.21.15.144:0/2849349782 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3c4804b020 con 0x7f3c5013f760 2024-05-30T16:42:53.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.185+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f3c500b5cd0 con 0x7f3c3006c920 2024-05-30T16:42:53.193 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:42:53.192+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:42:53.193 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:42:53.192+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:42:53.194 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:42:53.192+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:42:53.194 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:42:53.193+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:42:53.194 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:42:53.193+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:42:53.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.264+0000 7f3c46a00640 1 -- 172.21.15.144:0/2849349782 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3c500b5cd0 con 0x7f3c3006c920 2024-05-30T16:42:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.267+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3c3006c920 msgr2=0x7f3c3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.267+0000 7f3c55c00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3c3006c920 0x7f3c3006ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c500b2430 tx=0x7f3c40008040 comp rx=0 tx=0).stop 2024-05-30T16:42:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.267+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5013f760 msgr2=0x7f3c500b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.267+0000 7f3c55c00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5013f760 0x7f3c500b1870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009f70 tx=0x7f3c48004a40 comp rx=0 tx=0).stop 2024-05-30T16:42:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.267+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 shutdown_connections 2024-05-30T16:42:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.268+0000 7f3c55c00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3c3006c920 0x7f3c3006ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.268+0000 7f3c55c00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5013f760 0x7f3c500b1870 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.268+0000 7f3c55c00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c500cec70 0x7f3c500aa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.268+0000 7f3c55c00640 1 --2- 172.21.15.144:0/2849349782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c500b5fd0 0x7f3c5013e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.268+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 >> 172.21.15.144:0/2849349782 conn(0x7f3c5006bd00 msgr2=0x7f3c5013fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:53.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.268+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 shutdown_connections 2024-05-30T16:42:53.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.268+0000 7f3c55c00640 1 -- 172.21.15.144:0/2849349782 wait complete. 2024-05-30T16:42:53.290 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:42:53.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.489+0000 7f4982600640 1 Processor -- start 2024-05-30T16:42:53.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.489+0000 7f4982600640 1 -- start start 2024-05-30T16:42:53.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.490+0000 7f4982600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f497c0cfc40 0x7f497c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:53.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.490+0000 7f4982600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c06f610 0x7f497c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:53.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.490+0000 7f4982600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497c0d00f0 con 0x7f497c145150 2024-05-30T16:42:53.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.490+0000 7f4982600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f497c15f140 con 0x7f497c0cfc40 2024-05-30T16:42:53.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.490+0000 7f4982600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f497c15f390 con 0x7f497c06f610 2024-05-30T16:42:53.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.491+0000 7f497b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f497c145150 0x7f497c0cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33350/0 (socket says 172.21.15.144:33350) 2024-05-30T16:42:53.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.491+0000 7f497b400640 1 -- 172.21.15.144:0/3355350386 learned_addr learned my addr 172.21.15.144:0/3355350386 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:42:53.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.491+0000 7f4973e00640 1 --2- 172.21.15.144:0/3355350386 >> v2:172.21.15.149:3300/0 conn(0x7f497c0cfc40 0x7f497c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:53.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.491+0000 7f497be00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c06f610 0x7f497c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:53.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.491+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962712655 0 0) 0x7f497c0d00f0 con 0x7f497c145150 2024-05-30T16:42:53.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.491+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4960003520 con 0x7f497c145150 2024-05-30T16:42:53.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2734572224 0 0) 0x7f4960003520 con 0x7f497c145150 2024-05-30T16:42:53.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c06f610 msgr2=0x7f497c0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:53.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c06f610 0x7f497c0b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 >> v2:172.21.15.149:3300/0 conn(0x7f497c0cfc40 msgr2=0x7f497c06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 --2- 172.21.15.144:0/3355350386 >> v2:172.21.15.149:3300/0 conn(0x7f497c0cfc40 0x7f497c06f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c15f670 con 0x7f497c145150 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f496c001670 con 0x7f497c145150 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 >> v1:172.21.15.144:6789/0 conn(0x7f497c145150 legacy=0x7f497c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49600039b0 0x7f4960003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c06f610 0x7f4960004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f49600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f497c15f140 con 0x7f4960004d40 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f497c15f390 con 0x7f49600039b0 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f496000dbd0 con 0x7f497c06f610 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497be00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f49600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.492+0000 7f497b400640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49600039b0 0x7f4960003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.493+0000 7f4973e00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c06f610 0x7f4960004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.493+0000 7f497be00640 1 -- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c06f610 msgr2=0x7f4960004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.493+0000 7f497be00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c06f610 0x7f4960004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.493+0000 7f497be00640 1 -- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49600039b0 msgr2=0x7f4960003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.493+0000 7f497be00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49600039b0 0x7f4960003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.493+0000 7f497be00640 1 -- 172.21.15.144:0/3355350386 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4960003520 con 0x7f4960004d40 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.494+0000 7f497be00640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f49600051c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4974009fc0 tx=0x7f4960005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe961b14676d371 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.494+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974009c10 con 0x7f4960004d40 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.494+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4974036070 con 0x7f4960004d40 2024-05-30T16:42:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.494+0000 7f497aa00640 1 -- 172.21.15.144:0/3355350386 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974031880 con 0x7f4960004d40 2024-05-30T16:42:53.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.495+0000 7f4982600640 1 -- 172.21.15.144:0/3355350386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 msgr2=0x7f49600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:53.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.495+0000 7f4982600640 1 --2- 172.21.15.144:0/3355350386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f49600051c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4974009fc0 tx=0x7f4960005830 comp rx=0 tx=0).stop 2024-05-30T16:42:53.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.495+0000 7f497be00640 1 -- 172.21.15.144:0/3355350386 reap_dead start 2024-05-30T16:42:53.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.495+0000 7f4982600640 1 -- 172.21.15.144:0/3355350386 shutdown_connections 2024-05-30T16:42:53.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.495+0000 7f4982600640 1 -- 172.21.15.144:0/3355350386 >> 172.21.15.144:0/3355350386 conn(0x7f497c06bd00 msgr2=0x7f497c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:53.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.495+0000 7f4982600640 1 -- 172.21.15.144:0/3355350386 shutdown_connections 2024-05-30T16:42:53.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.495+0000 7f4982600640 1 -- 172.21.15.144:0/3355350386 wait complete. 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.496+0000 7f4982600640 1 Processor -- start 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.497+0000 7f4982600640 1 -- start start 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f4982600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f497c0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f4982600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c15c560 0x7f497c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f4982600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f497c1f0380 0x7f497c15de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f4982600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f497c15fe70 con 0x7f4960004d40 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f4982600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0b64f0 con 0x7f497c1f0380 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f4982600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f497c15fff0 con 0x7f497c15c560 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f497c0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f497c0b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33194/0 (socket says 172.21.15.144:33194) 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497b400640 1 -- 172.21.15.144:0/2483949834 learned_addr learned my addr 172.21.15.144:0/2483949834 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:42:53.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f4973e00640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c15c560 0x7f497c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497be00640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f497c1f0380 0x7f497c15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497b400640 1 -- 172.21.15.144:0/2483949834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c15c560 msgr2=0x7f497c0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497b400640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c15c560 0x7f497c0aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497b400640 1 -- 172.21.15.144:0/2483949834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f497c1f0380 msgr2=0x7f497c15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497b400640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f497c1f0380 0x7f497c15de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497b400640 1 -- 172.21.15.144:0/2483949834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c15cd70 con 0x7f4960004d40 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.498+0000 7f497be00640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f497c1f0380 0x7f497c15de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.499+0000 7f497b400640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f497c0b2d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f496c00e870 tx=0x7f496c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.499+0000 7f4973400640 1 -- 172.21.15.144:0/2483949834 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c00c870 con 0x7f4960004d40 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.499+0000 7f4973400640 1 -- 172.21.15.144:0/2483949834 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c018070 con 0x7f4960004d40 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.499+0000 7f4973400640 1 -- 172.21.15.144:0/2483949834 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c00cc50 con 0x7f4960004d40 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.499+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c15d050 con 0x7f4960004d40 2024-05-30T16:42:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.499+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c15d610 con 0x7f4960004d40 2024-05-30T16:42:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.500+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497c068b90 con 0x7f4960004d40 2024-05-30T16:42:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.501+0000 7f4973400640 1 -- 172.21.15.144:0/2483949834 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f496c01d460 con 0x7f4960004d40 2024-05-30T16:42:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.502+0000 7f4973400640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f495806c920 0x7f495806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:42:53.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.502+0000 7f4973400640 1 -- 172.21.15.144:0/2483949834 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f496c08bb00 con 0x7f4960004d40 2024-05-30T16:42:53.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.502+0000 7f4973e00640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f495806c920 0x7f495806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:42:53.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.503+0000 7f4973e00640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f495806c920 0x7f495806ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f497c13d130 tx=0x7f4964008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:42:53.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.507+0000 7f4973400640 1 -- 172.21.15.144:0/2483949834 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f496c059f50 con 0x7f4960004d40 2024-05-30T16:42:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.741+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f497c141a00 con 0x7f495806c920 2024-05-30T16:42:53.749 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d 2024-05-30T16:42:53.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.747+0000 7f4973400640 1 -- 172.21.15.144:0/2483949834 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f497c141a00 con 0x7f495806c920 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f495806c920 msgr2=0x7f495806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f495806c920 0x7f495806ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f497c13d130 tx=0x7f4964008040 comp rx=0 tx=0).stop 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 msgr2=0x7f497c0b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f497c0b2d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f496c00e870 tx=0x7f496c00ed30 comp rx=0 tx=0).stop 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 shutdown_connections 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f495806c920 0x7f495806ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f497c1f0380 0x7f497c15de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f497c15c560 0x7f497c0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 --2- 172.21.15.144:0/2483949834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4960004d40 0x7f497c0b2d80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.750+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 >> 172.21.15.144:0/2483949834 conn(0x7f497c06bd00 msgr2=0x7f497c06eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.751+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 shutdown_connections 2024-05-30T16:42:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:42:53.751+0000 7f4982600640 1 -- 172.21.15.144:0/2483949834 wait complete. 2024-05-30T16:42:53.771 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d 2024-05-30T16:42:53.771 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:42:53.771 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:42:53.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:42:53.819 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:43:01.117 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:43:01.117 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:43:01.117 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.18149 s, 150 MB/s 2024-05-30T16:43:01.119 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:43:01.119 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:43:01.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:43:01.156 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:43:08.341 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:43:08.341 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:43:08.341 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.09393 s, 151 MB/s 2024-05-30T16:43:08.342 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:43:08.342 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:43:08.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:43:08.379 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:43:15.443 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:43:15.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:43:15.834 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:43:15.835 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:43:15.835 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.36388 s, 146 MB/s 2024-05-30T16:43:15.836 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:43:15.836 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:43:15.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:43:15.874 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:43:23.295 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:43:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:43:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.32952 s, 146 MB/s 2024-05-30T16:43:23.297 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:43:23.297 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:43:23.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:43:23.336 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:43:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:43:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:43:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.39406 s, 145 MB/s 2024-05-30T16:43:30.820 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:43:30.820 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:43:30.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:43:30.856 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:43:38.284 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:43:38.284 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:43:38.284 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.33453 s, 146 MB/s 2024-05-30T16:43:38.285 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:43:38.285 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:43:38.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:43:38.322 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:43:45.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:43:45.586 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:43:45.605 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:43:45.607 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:43:45.608 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.19363 s, 149 MB/s 2024-05-30T16:43:45.608 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:43:45.609 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:43:45.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:43:45.693 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:43:52.934 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:43:52.934 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:43:52.934 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.14363 s, 150 MB/s 2024-05-30T16:43:52.935 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:43:52.935 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:43:52.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:43:52.976 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:44:00.144 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:44:00.144 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:44:00.144 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.07595 s, 152 MB/s 2024-05-30T16:44:00.146 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:44:00.146 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:44:00.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:44:00.183 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:44:07.527 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:44:07.527 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:44:07.527 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.25352 s, 148 MB/s 2024-05-30T16:44:07.529 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T16:44:07.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.693+0000 7fa716e00640 1 Processor -- start 2024-05-30T16:44:07.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.693+0000 7fa716e00640 1 -- start start 2024-05-30T16:44:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.694+0000 7fa716e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa7100cec70 0x7fa7100b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.694+0000 7fa716e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100b5e00 0x7fa710142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.694+0000 7fa716e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa710160730 con 0x7fa71013f760 2024-05-30T16:44:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.694+0000 7fa716e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa7101612b0 con 0x7fa7100cec70 2024-05-30T16:44:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.694+0000 7fa716e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa71013fb40 con 0x7fa7100b5e00 2024-05-30T16:44:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.694+0000 7fa70fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa71013f760 0x7fa71006e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37236/0 (socket says 172.21.15.144:37236) 2024-05-30T16:44:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70fe00640 1 -- 172.21.15.144:0/2006171395 learned_addr learned my addr 172.21.15.144:0/2006171395 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa707e00640 1 --2- 172.21.15.144:0/2006171395 >> v2:172.21.15.149:3300/0 conn(0x7fa7100cec70 0x7fa7100b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa714e00640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100b5e00 0x7fa710142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603138374 0 0) 0x7fa710160730 con 0x7fa71013f760 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6f4003520 con 0x7fa71013f760 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4014966454 0 0) 0x7fa6f4003520 con 0x7fa71013f760 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100b5e00 msgr2=0x7fa710142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100b5e00 0x7fa710142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 >> v2:172.21.15.149:3300/0 conn(0x7fa7100cec70 msgr2=0x7fa7100b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 --2- 172.21.15.144:0/2006171395 >> v2:172.21.15.149:3300/0 conn(0x7fa7100cec70 0x7fa7100b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa710160a10 con 0x7fa71013f760 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fa700001670 con 0x7fa71013f760 2024-05-30T16:44:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 >> v1:172.21.15.144:6789/0 conn(0x7fa71013f760 legacy=0x7fa71006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100b5e00 0x7fa6f40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.695+0000 7fa70f400640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f4003f30 0x7fa6f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa70f400640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f4004d40 0x7fa6f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101612b0 con 0x7fa6f4003f30 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f400ba20 con 0x7fa6f4004d40 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f400bc20 con 0x7fa7100b5e00 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa707e00640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f4003f30 0x7fa6f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa714e00640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f4004d40 0x7fa6f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa707e00640 1 -- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100b5e00 msgr2=0x7fa6f40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa707e00640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100b5e00 0x7fa6f40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa707e00640 1 -- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f4004d40 msgr2=0x7fa6f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa707e00640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f4004d40 0x7fa6f40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.696+0000 7fa707e00640 1 -- 172.21.15.144:0/2006171395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f4003520 con 0x7fa6f4003f30 2024-05-30T16:44:07.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.697+0000 7fa707e00640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f4003f30 0x7fa6f4004800 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009ac0 tx=0x7fa6f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3417e980cb673b06 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:07.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.697+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8036070 con 0x7fa6f4003f30 2024-05-30T16:44:07.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.697+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f8031400 con 0x7fa6f4003f30 2024-05-30T16:44:07.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.697+0000 7fa70f400640 1 -- 172.21.15.144:0/2006171395 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8009690 con 0x7fa6f4003f30 2024-05-30T16:44:07.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.698+0000 7fa716e00640 1 -- 172.21.15.144:0/2006171395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f4003f30 msgr2=0x7fa6f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:07.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.698+0000 7fa716e00640 1 --2- 172.21.15.144:0/2006171395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f4003f30 0x7fa6f4004800 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009ac0 tx=0x7fa6f4005830 comp rx=0 tx=0).stop 2024-05-30T16:44:07.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.698+0000 7fa714e00640 1 -- 172.21.15.144:0/2006171395 reap_dead start 2024-05-30T16:44:07.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.698+0000 7fa716e00640 1 -- 172.21.15.144:0/2006171395 shutdown_connections 2024-05-30T16:44:07.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.698+0000 7fa716e00640 1 -- 172.21.15.144:0/2006171395 >> 172.21.15.144:0/2006171395 conn(0x7fa71006bd00 msgr2=0x7fa71006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:07.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.698+0000 7fa716e00640 1 -- 172.21.15.144:0/2006171395 shutdown_connections 2024-05-30T16:44:07.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.698+0000 7fa716e00640 1 -- 172.21.15.144:0/2006171395 wait complete. 2024-05-30T16:44:07.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.700+0000 7fa716e00640 1 Processor -- start 2024-05-30T16:44:07.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.700+0000 7fa716e00640 1 -- start start 2024-05-30T16:44:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa716e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f4003f30 0x7fa71015e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa716e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71013e9a0 0x7fa71013ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa716e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100c8830 0x7fa7100c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa716e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa7100cf0d0 con 0x7fa71013e9a0 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa716e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa710160fd0 con 0x7fa6f4003f30 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa716e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa7100cf250 con 0x7fa7100c8830 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa707e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71013e9a0 0x7fa71013ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa707e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71013e9a0 0x7fa71013ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35282/0 (socket says 172.21.15.144:35282) 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa707e00640 1 -- 172.21.15.144:0/3739587343 learned_addr learned my addr 172.21.15.144:0/3739587343 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa70fe00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f4003f30 0x7fa71015e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa707e00640 1 -- 172.21.15.144:0/3739587343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100c8830 msgr2=0x7fa7100c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa707e00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100c8830 0x7fa7100c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa707e00640 1 -- 172.21.15.144:0/3739587343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f4003f30 msgr2=0x7fa71015e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:07.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa707e00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f4003f30 0x7fa71015e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.701+0000 7fa707e00640 1 -- 172.21.15.144:0/3739587343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7100c95a0 con 0x7fa71013e9a0 2024-05-30T16:44:07.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.702+0000 7fa707e00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71013e9a0 0x7fa71013ee20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8000c00 tx=0x7fa6f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:07.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.702+0000 7fa70cc00640 1 -- 172.21.15.144:0/3739587343 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8040020 con 0x7fa71013e9a0 2024-05-30T16:44:07.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.702+0000 7fa70cc00640 1 -- 172.21.15.144:0/3739587343 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f8003c60 con 0x7fa71013e9a0 2024-05-30T16:44:07.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.702+0000 7fa70cc00640 1 -- 172.21.15.144:0/3739587343 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8036040 con 0x7fa71013e9a0 2024-05-30T16:44:07.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.702+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7101f52d0 con 0x7fa71013e9a0 2024-05-30T16:44:07.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.702+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7100c9880 con 0x7fa71013e9a0 2024-05-30T16:44:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.703+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa710068b90 con 0x7fa71013e9a0 2024-05-30T16:44:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.704+0000 7fa70cc00640 1 -- 172.21.15.144:0/3739587343 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 91040+0+0 (secure 0 0 0) 0x7fa6f8043020 con 0x7fa71013e9a0 2024-05-30T16:44:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.705+0000 7fa70cc00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6ec06c920 0x7fa6ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.705+0000 7fa70cc00640 1 -- 172.21.15.144:0/3739587343 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa6f80abcd0 con 0x7fa71013e9a0 2024-05-30T16:44:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.705+0000 7fa70fe00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6ec06c920 0x7fa6ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:07.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.706+0000 7fa70fe00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6ec06c920 0x7fa6ec06ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa700000f60 tx=0x7fa700009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.710+0000 7fa70cc00640 1 -- 172.21.15.144:0/3739587343 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa6f804a070 con 0x7fa71013e9a0 2024-05-30T16:44:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.929+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7fa710075f70 con 0x7fa6ec06c920 2024-05-30T16:44:07.936 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:07.935+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:07.936 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:07.935+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:07.936 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:07.935+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:07.936 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:07.935+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:07.936 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:07.935+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:07.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.973+0000 7fa70cc00640 1 -- 172.21.15.144:0/3739587343 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa70000d860 con 0x7fa6ec06c920 2024-05-30T16:44:07.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.975+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6ec06c920 msgr2=0x7fa6ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:07.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.975+0000 7fa716e00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6ec06c920 0x7fa6ec06ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa700000f60 tx=0x7fa700009040 comp rx=0 tx=0).stop 2024-05-30T16:44:07.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.975+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71013e9a0 msgr2=0x7fa71013ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:07.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.975+0000 7fa716e00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71013e9a0 0x7fa71013ee20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8000c00 tx=0x7fa6f8004730 comp rx=0 tx=0).stop 2024-05-30T16:44:07.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.976+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 shutdown_connections 2024-05-30T16:44:07.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.976+0000 7fa716e00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6ec06c920 0x7fa6ec06ede0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.976+0000 7fa716e00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7100c8830 0x7fa7100c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.976+0000 7fa716e00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71013e9a0 0x7fa71013ee20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.976+0000 7fa716e00640 1 --2- 172.21.15.144:0/3739587343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f4003f30 0x7fa71015e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:07.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.976+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 >> 172.21.15.144:0/3739587343 conn(0x7fa71006bd00 msgr2=0x7fa71015ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:07.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.976+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 shutdown_connections 2024-05-30T16:44:07.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:07.976+0000 7fa716e00640 1 -- 172.21.15.144:0/3739587343 wait complete. 2024-05-30T16:44:07.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:44:08.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.164+0000 7f18e3200640 1 Processor -- start 2024-05-30T16:44:08.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.164+0000 7f18e3200640 1 -- start start 2024-05-30T16:44:08.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.165+0000 7f18e3200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f18e4145f10 0x7f18e40cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:08.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.165+0000 7f18e3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18e406c3d0 0x7f18e4160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:08.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.165+0000 7f18e3200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e40cd3e0 con 0x7f18e41607c0 2024-05-30T16:44:08.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.165+0000 7f18e3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f18e406c840 con 0x7f18e406c3d0 2024-05-30T16:44:08.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.165+0000 7f18e3200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f18e4160c30 con 0x7f18e4145f10 2024-05-30T16:44:08.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.166+0000 7f18dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18e406c3d0 0x7f18e4160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:08.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.166+0000 7f18dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18e406c3d0 0x7f18e4160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35300/0 (socket says 172.21.15.144:35300) 2024-05-30T16:44:08.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.166+0000 7f18dbe00640 1 -- 172.21.15.144:0/184314966 learned_addr learned my addr 172.21.15.144:0/184314966 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:08.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.166+0000 7f18e1e00640 1 --2- 172.21.15.144:0/184314966 >> v2:172.21.15.149:3300/0 conn(0x7f18e4145f10 0x7f18e40cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:08.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.166+0000 7f18dbe00640 1 -- 172.21.15.144:0/184314966 >> v2:172.21.15.149:3300/0 conn(0x7f18e4145f10 msgr2=0x7f18e40cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:08.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.166+0000 7f18dbe00640 1 --2- 172.21.15.144:0/184314966 >> v2:172.21.15.149:3300/0 conn(0x7f18e4145f10 0x7f18e40cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:08.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.166+0000 7f18dbe00640 1 -- 172.21.15.144:0/184314966 >> v1:172.21.15.149:6789/0 conn(0x7f18e41607c0 legacy=0x7f18e415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:08.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.166+0000 7f18dbe00640 1 -- 172.21.15.144:0/184314966 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e40cd6c0 con 0x7f18e406c3d0 2024-05-30T16:44:08.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.167+0000 7f18dbe00640 1 --2- 172.21.15.144:0/184314966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e406c3d0 0x7f18e4160280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f18e406da50 tx=0x7f18cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602814d24e3f2594 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:08.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e1400640 1 -- 172.21.15.144:0/184314966 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc037070 con 0x7f18e406c3d0 2024-05-30T16:44:08.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e1400640 1 -- 172.21.15.144:0/184314966 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18cc032440 con 0x7f18e406c3d0 2024-05-30T16:44:08.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e1400640 1 -- 172.21.15.144:0/184314966 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc032810 con 0x7f18e406c3d0 2024-05-30T16:44:08.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e3200640 1 -- 172.21.15.144:0/184314966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e406c3d0 msgr2=0x7f18e4160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:08.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e3200640 1 --2- 172.21.15.144:0/184314966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e406c3d0 0x7f18e4160280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f18e406da50 tx=0x7f18cc02a210 comp rx=0 tx=0).stop 2024-05-30T16:44:08.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e3200640 1 -- 172.21.15.144:0/184314966 shutdown_connections 2024-05-30T16:44:08.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e3200640 1 --2- 172.21.15.144:0/184314966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e406c3d0 0x7f18e4160280 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:08.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e3200640 1 --2- 172.21.15.144:0/184314966 >> v2:172.21.15.149:3300/0 conn(0x7f18e4145f10 0x7f18e40cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:08.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e3200640 1 -- 172.21.15.144:0/184314966 >> 172.21.15.144:0/184314966 conn(0x7f18e406b8e0 msgr2=0x7f18e406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:08.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.168+0000 7f18e3200640 1 -- 172.21.15.144:0/184314966 shutdown_connections 2024-05-30T16:44:08.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.169+0000 7f18e3200640 1 -- 172.21.15.144:0/184314966 wait complete. 2024-05-30T16:44:08.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.170+0000 7f18e3200640 1 Processor -- start 2024-05-30T16:44:08.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.170+0000 7f18e3200640 1 -- start start 2024-05-30T16:44:08.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.171+0000 7f18e3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e406c3d0 0x7f18e40aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:08.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.171+0000 7f18e3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18e4145f10 0x7f18e40af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:08.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.171+0000 7f18e3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e41607c0 0x7f18e40abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:08.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.171+0000 7f18e3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f18e40cdc80 con 0x7f18e41607c0 2024-05-30T16:44:08.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.171+0000 7f18e3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f18e4161100 con 0x7f18e406c3d0 2024-05-30T16:44:08.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.171+0000 7f18e3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f18e40cdf60 con 0x7f18e4145f10 2024-05-30T16:44:08.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.171+0000 7f18e2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e41607c0 0x7f18e40abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:08.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.171+0000 7f18e2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e41607c0 0x7f18e40abe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35306/0 (socket says 172.21.15.144:35306) 2024-05-30T16:44:08.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.171+0000 7f18e2800640 1 -- 172.21.15.144:0/3037947443 learned_addr learned my addr 172.21.15.144:0/3037947443 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:08.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18dbe00640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18e4145f10 0x7f18e40af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:08.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18e2800640 1 -- 172.21.15.144:0/3037947443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18e4145f10 msgr2=0x7f18e40af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18e2800640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18e4145f10 0x7f18e40af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18e2800640 1 -- 172.21.15.144:0/3037947443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e406c3d0 msgr2=0x7f18e40aa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18e1e00640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e406c3d0 0x7f18e40aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18e2800640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e406c3d0 0x7f18e40aa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18e2800640 1 -- 172.21.15.144:0/3037947443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e415ddf0 con 0x7f18e41607c0 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18e2800640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e41607c0 0x7f18e40abe20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00b990 tx=0x7f18dc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18da000640 1 -- 172.21.15.144:0/3037947443 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc019070 con 0x7f18e41607c0 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18da000640 1 -- 172.21.15.144:0/3037947443 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18dc00cba0 con 0x7f18e41607c0 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e40aa780 con 0x7f18e41607c0 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18da000640 1 -- 172.21.15.144:0/3037947443 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc014440 con 0x7f18e41607c0 2024-05-30T16:44:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.172+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e40aad40 con 0x7f18e41607c0 2024-05-30T16:44:08.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.173+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e40632f0 con 0x7f18e41607c0 2024-05-30T16:44:08.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.174+0000 7f18da000640 1 -- 172.21.15.144:0/3037947443 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 91040+0+0 (secure 0 0 0) 0x7f18dc01c070 con 0x7f18e41607c0 2024-05-30T16:44:08.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.176+0000 7f18da000640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f18c006c8f0 0x7f18c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:08.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.176+0000 7f18da000640 1 -- 172.21.15.144:0/3037947443 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f18dc08b8d0 con 0x7f18e41607c0 2024-05-30T16:44:08.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.176+0000 7f18e1e00640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f18c006c8f0 0x7f18c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:08.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.176+0000 7f18e1e00640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f18c006c8f0 0x7f18c006edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f18d4006fd0 tx=0x7f18d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:08.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.180+0000 7f18da000640 1 -- 172.21.15.144:0/3037947443 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f18dc059d00 con 0x7f18e41607c0 2024-05-30T16:44:08.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.396+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f18e4075570 con 0x7f18c006c8f0 2024-05-30T16:44:08.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.407+0000 7f18da000640 1 -- 172.21.15.144:0/3037947443 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f18e4075570 con 0x7f18c006c8f0 2024-05-30T16:44:08.408 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d 2024-05-30T16:44:08.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.409+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f18c006c8f0 msgr2=0x7f18c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:08.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.409+0000 7f18e3200640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f18c006c8f0 0x7f18c006edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f18d4006fd0 tx=0x7f18d4008040 comp rx=0 tx=0).stop 2024-05-30T16:44:08.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.409+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e41607c0 msgr2=0x7f18e40abe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:08.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.409+0000 7f18e3200640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e41607c0 0x7f18e40abe20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00b990 tx=0x7f18dc00be50 comp rx=0 tx=0).stop 2024-05-30T16:44:08.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.410+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 shutdown_connections 2024-05-30T16:44:08.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.410+0000 7f18e3200640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f18c006c8f0 0x7f18c006edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:08.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.410+0000 7f18e3200640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e41607c0 0x7f18e40abe20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:08.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.410+0000 7f18e3200640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18e4145f10 0x7f18e40af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:08.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.410+0000 7f18e3200640 1 --2- 172.21.15.144:0/3037947443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e406c3d0 0x7f18e40aa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:08.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.410+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 >> 172.21.15.144:0/3037947443 conn(0x7f18e406b8e0 msgr2=0x7f18e4141530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:08.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.410+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 shutdown_connections 2024-05-30T16:44:08.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:08.410+0000 7f18e3200640 1 -- 172.21.15.144:0/3037947443 wait complete. 2024-05-30T16:44:08.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:44:08.428 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d 2024-05-30T16:44:08.428 DEBUG:teuthology.orchestra.run.smithi144:> ) 2024-05-30T16:44:08.474 INFO:teuthology.orchestra.run.smithi144.stdout:# file: volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d 2024-05-30T16:44:08.474 INFO:teuthology.orchestra.run.smithi144.stdout:ceph.dir.rbytes="10322329600" 2024-05-30T16:44:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:08.475 INFO:tasks.cephfs.test_volumes:r_size = 10322329600 exp_size = 10737418240 2024-05-30T16:44:10.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:44:10.476 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d 2024-05-30T16:44:10.476 DEBUG:teuthology.orchestra.run.smithi144:> ) 2024-05-30T16:44:10.535 INFO:teuthology.orchestra.run.smithi144.stdout:# file: volumes/_nogroup/sv1/7586c9e2-9cc3-4c1c-80af-4582edfc9b4d 2024-05-30T16:44:10.535 INFO:teuthology.orchestra.run.smithi144.stdout:ceph.dir.rbytes="10737418240" 2024-05-30T16:44:10.535 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:10.536 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-05-30T16:44:10.536 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-05-30T16:44:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.752+0000 7fc125800640 1 Processor -- start 2024-05-30T16:44:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.752+0000 7fc125800640 1 -- start start 2024-05-30T16:44:10.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.753+0000 7fc125800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc120145150 0x7fc1200cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:10.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.754+0000 7fc125800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc12006f7e0 0x7fc1200b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:10.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.754+0000 7fc125800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1200d00f0 con 0x7fc1200cfa70 2024-05-30T16:44:10.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.754+0000 7fc125800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc1200cfeb0 con 0x7fc120145150 2024-05-30T16:44:10.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.754+0000 7fc125800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc12015f140 con 0x7fc12006f7e0 2024-05-30T16:44:10.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.754+0000 7fc11ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc120145150 0x7fc1200cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:10.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.754+0000 7fc11ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc120145150 0x7fc1200cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35316/0 (socket says 172.21.15.144:35316) 2024-05-30T16:44:10.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.754+0000 7fc11ea00640 1 -- 172.21.15.144:0/1429839954 learned_addr learned my addr 172.21.15.144:0/1429839954 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:10.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.755+0000 7fc11ea00640 1 -- 172.21.15.144:0/1429839954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc12006f7e0 msgr2=0x7fc1200b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:10.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.755+0000 7fc11ea00640 1 --2- 172.21.15.144:0/1429839954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc12006f7e0 0x7fc1200b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:10.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.755+0000 7fc11ea00640 1 -- 172.21.15.144:0/1429839954 >> v1:172.21.15.149:6789/0 conn(0x7fc1200cfa70 legacy=0x7fc12006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:10.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.755+0000 7fc11ea00640 1 -- 172.21.15.144:0/1429839954 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12015f390 con 0x7fc120145150 2024-05-30T16:44:10.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.756+0000 7fc11ea00640 1 --2- 172.21.15.144:0/1429839954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc120145150 0x7fc1200cf530 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc110009870 tx=0x7fc11002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae337550b01ee95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:10.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.757+0000 7fc11e000640 1 -- 172.21.15.144:0/1429839954 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110037070 con 0x7fc120145150 2024-05-30T16:44:10.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.757+0000 7fc11e000640 1 -- 172.21.15.144:0/1429839954 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc110032440 con 0x7fc120145150 2024-05-30T16:44:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.757+0000 7fc11e000640 1 -- 172.21.15.144:0/1429839954 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110032810 con 0x7fc120145150 2024-05-30T16:44:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.757+0000 7fc125800640 1 -- 172.21.15.144:0/1429839954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc120145150 msgr2=0x7fc1200cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.757+0000 7fc125800640 1 --2- 172.21.15.144:0/1429839954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc120145150 0x7fc1200cf530 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc110009870 tx=0x7fc11002a180 comp rx=0 tx=0).stop 2024-05-30T16:44:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.757+0000 7fc125800640 1 -- 172.21.15.144:0/1429839954 shutdown_connections 2024-05-30T16:44:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.757+0000 7fc125800640 1 --2- 172.21.15.144:0/1429839954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc12006f7e0 0x7fc1200b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.757+0000 7fc125800640 1 --2- 172.21.15.144:0/1429839954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc120145150 0x7fc1200cf530 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.757+0000 7fc125800640 1 -- 172.21.15.144:0/1429839954 >> 172.21.15.144:0/1429839954 conn(0x7fc12006bd00 msgr2=0x7fc12006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.758+0000 7fc125800640 1 -- 172.21.15.144:0/1429839954 shutdown_connections 2024-05-30T16:44:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.758+0000 7fc125800640 1 -- 172.21.15.144:0/1429839954 wait complete. 2024-05-30T16:44:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.759+0000 7fc125800640 1 Processor -- start 2024-05-30T16:44:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.759+0000 7fc125800640 1 -- start start 2024-05-30T16:44:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.760+0000 7fc125800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc12006f7e0 0x7fc1200b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.760+0000 7fc125800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1200cfa70 0x7fc120136f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.760+0000 7fc125800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc120145150 0x7fc12015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.760+0000 7fc125800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1200b64f0 con 0x7fc1200cfa70 2024-05-30T16:44:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.760+0000 7fc125800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc12015f950 con 0x7fc12006f7e0 2024-05-30T16:44:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.760+0000 7fc125800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc12015fe70 con 0x7fc120145150 2024-05-30T16:44:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc117e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1200cfa70 0x7fc120136f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc117e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1200cfa70 0x7fc120136f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35320/0 (socket says 172.21.15.144:35320) 2024-05-30T16:44:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc117e00640 1 -- 172.21.15.144:0/1708155000 learned_addr learned my addr 172.21.15.144:0/1708155000 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc11ea00640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc12006f7e0 0x7fc1200b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc11f400640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc120145150 0x7fc12015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc117e00640 1 -- 172.21.15.144:0/1708155000 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc120145150 msgr2=0x7fc12015bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc117e00640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc120145150 0x7fc12015bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc117e00640 1 -- 172.21.15.144:0/1708155000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc12006f7e0 msgr2=0x7fc1200b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc117e00640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc12006f7e0 0x7fc1200b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.761+0000 7fc117e00640 1 -- 172.21.15.144:0/1708155000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12015e560 con 0x7fc1200cfa70 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.762+0000 7fc117e00640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1200cfa70 0x7fc120136f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c460 tx=0x7fc10800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.762+0000 7fc116a00640 1 -- 172.21.15.144:0/1708155000 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108011790 con 0x7fc1200cfa70 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.762+0000 7fc116a00640 1 -- 172.21.15.144:0/1708155000 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc108017070 con 0x7fc1200cfa70 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.762+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12015e840 con 0x7fc1200cfa70 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.762+0000 7fc116a00640 1 -- 172.21.15.144:0/1708155000 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108011bb0 con 0x7fc1200cfa70 2024-05-30T16:44:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.762+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12015ee00 con 0x7fc1200cfa70 2024-05-30T16:44:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.763+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc120068b90 con 0x7fc1200cfa70 2024-05-30T16:44:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.764+0000 7fc116a00640 1 -- 172.21.15.144:0/1708155000 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 91091+0+0 (secure 0 0 0) 0x7fc10801c460 con 0x7fc1200cfa70 2024-05-30T16:44:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.766+0000 7fc116a00640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0fc06c980 0x7fc0fc06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.766+0000 7fc116a00640 1 -- 172.21.15.144:0/1708155000 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc10808b950 con 0x7fc1200cfa70 2024-05-30T16:44:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.766+0000 7fc11ea00640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0fc06c980 0x7fc0fc06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.767+0000 7fc11ea00640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0fc06c980 0x7fc0fc06ee40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc110034000 tx=0x7fc11002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:10.771+0000 7fc116a00640 1 -- 172.21.15.144:0/1708155000 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc108059e20 con 0x7fc1200cfa70 2024-05-30T16:44:11.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.011+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fc120075f70 con 0x7fc0fc06c980 2024-05-30T16:44:11.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.210+0000 7fc116a00640 1 -- 172.21.15.144:0/1708155000 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc1100327f0 con 0x7fc0fc06c980 2024-05-30T16:44:11.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0fc06c980 msgr2=0x7fc0fc06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:11.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0fc06c980 0x7fc0fc06ee40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc110034000 tx=0x7fc11002e000 comp rx=0 tx=0).stop 2024-05-30T16:44:11.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1200cfa70 msgr2=0x7fc120136f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:11.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1200cfa70 0x7fc120136f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c460 tx=0x7fc10800c920 comp rx=0 tx=0).stop 2024-05-30T16:44:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 shutdown_connections 2024-05-30T16:44:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc0fc06c980 0x7fc0fc06ee40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc120145150 0x7fc12015bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1200cfa70 0x7fc120136f70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 --2- 172.21.15.144:0/1708155000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc12006f7e0 0x7fc1200b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 >> 172.21.15.144:0/1708155000 conn(0x7fc12006bd00 msgr2=0x7fc120143f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 shutdown_connections 2024-05-30T16:44:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.214+0000 7fc125800640 1 -- 172.21.15.144:0/1708155000 wait complete. 2024-05-30T16:44:11.217 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.217+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.218 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.217+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.218 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.217+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.218 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.217+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.218 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.217+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:11.247 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.247+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.248 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.247+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.248 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.247+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.248 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.247+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.248 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:11.247+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:11.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.416+0000 7f51b5e00640 1 Processor -- start 2024-05-30T16:44:11.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.417+0000 7f51b5e00640 1 -- start start 2024-05-30T16:44:11.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.418+0000 7f51b5e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0141510 0x7f51b01418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:11.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.418+0000 7f51b5e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f51b0144020 0x7f51b006e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:11.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.418+0000 7f51b5e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b00b3fd0 con 0x7f51b015f8f0 2024-05-30T16:44:11.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.418+0000 7f51b5e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f51b006dfc0 con 0x7f51b0144020 2024-05-30T16:44:11.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.418+0000 7f51b5e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f51b015fd80 con 0x7f51b0141510 2024-05-30T16:44:11.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.419+0000 7f51aea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0141510 0x7f51b01418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:11.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.419+0000 7f51af400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f51b0144020 0x7f51b006e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:11.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.419+0000 7f51aea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0141510 0x7f51b01418f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:33592/0 (socket says 172.21.15.144:33592) 2024-05-30T16:44:11.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.419+0000 7f51aea00640 1 -- 172.21.15.144:0/3162332873 learned_addr learned my addr 172.21.15.144:0/3162332873 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:11.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.420+0000 7f51aea00640 1 -- 172.21.15.144:0/3162332873 >> v2:172.21.15.149:3300/0 conn(0x7f51b0144020 msgr2=0x7f51b006e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:11.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.420+0000 7f51aea00640 1 --2- 172.21.15.144:0/3162332873 >> v2:172.21.15.149:3300/0 conn(0x7f51b0144020 0x7f51b006e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.420+0000 7f51aea00640 1 -- 172.21.15.144:0/3162332873 >> v1:172.21.15.149:6789/0 conn(0x7f51b015f8f0 legacy=0x7f51b00b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:11.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.420+0000 7f51aea00640 1 -- 172.21.15.144:0/3162332873 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b0144790 con 0x7f51b0141510 2024-05-30T16:44:11.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.421+0000 7f51aea00640 1 --2- 172.21.15.144:0/3162332873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0141510 0x7f51b01418f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009870 tx=0x7f51a002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb4cf8a88781ee1d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:11.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.421+0000 7f51ae000640 1 -- 172.21.15.144:0/3162332873 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0037070 con 0x7f51b0141510 2024-05-30T16:44:11.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51ae000640 1 -- 172.21.15.144:0/3162332873 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a0032440 con 0x7f51b0141510 2024-05-30T16:44:11.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51ae000640 1 -- 172.21.15.144:0/3162332873 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0032810 con 0x7f51b0141510 2024-05-30T16:44:11.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51b5e00640 1 -- 172.21.15.144:0/3162332873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0141510 msgr2=0x7f51b01418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:11.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51b5e00640 1 --2- 172.21.15.144:0/3162332873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0141510 0x7f51b01418f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009870 tx=0x7f51a002a130 comp rx=0 tx=0).stop 2024-05-30T16:44:11.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51b5e00640 1 -- 172.21.15.144:0/3162332873 shutdown_connections 2024-05-30T16:44:11.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51b5e00640 1 --2- 172.21.15.144:0/3162332873 >> v2:172.21.15.149:3300/0 conn(0x7f51b0144020 0x7f51b006e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51b5e00640 1 --2- 172.21.15.144:0/3162332873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0141510 0x7f51b01418f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51b5e00640 1 -- 172.21.15.144:0/3162332873 >> 172.21.15.144:0/3162332873 conn(0x7f51b006bd00 msgr2=0x7f51b006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:11.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51b5e00640 1 -- 172.21.15.144:0/3162332873 shutdown_connections 2024-05-30T16:44:11.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.422+0000 7f51b5e00640 1 -- 172.21.15.144:0/3162332873 wait complete. 2024-05-30T16:44:11.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.424+0000 7f51b5e00640 1 Processor -- start 2024-05-30T16:44:11.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.424+0000 7f51b5e00640 1 -- start start 2024-05-30T16:44:11.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.425+0000 7f51b5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0141510 0x7f51b01f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:11.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.425+0000 7f51b5e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0144020 0x7f51b013e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:11.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.425+0000 7f51b5e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b015f8f0 0x7f51b0160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:11.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.425+0000 7f51b5e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51b006e210 con 0x7f51b0141510 2024-05-30T16:44:11.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.425+0000 7f51b5e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0144d50 con 0x7f51b015f8f0 2024-05-30T16:44:11.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.425+0000 7f51b5e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f51b0144450 con 0x7f51b0144020 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51aea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0141510 0x7f51b01f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51aea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0141510 0x7f51b01f89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35364/0 (socket says 172.21.15.144:35364) 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51aea00640 1 -- 172.21.15.144:0/3892605272 learned_addr learned my addr 172.21.15.144:0/3892605272 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51a7e00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0144020 0x7f51b013e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51af400640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b015f8f0 0x7f51b0160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51aea00640 1 -- 172.21.15.144:0/3892605272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0144020 msgr2=0x7f51b013e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51aea00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0144020 0x7f51b013e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51aea00640 1 -- 172.21.15.144:0/3892605272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b015f8f0 msgr2=0x7f51b0160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51aea00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b015f8f0 0x7f51b0160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51aea00640 1 -- 172.21.15.144:0/3892605272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b013ec90 con 0x7f51b0141510 2024-05-30T16:44:11.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51af400640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b015f8f0 0x7f51b0160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:11.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.426+0000 7f51aea00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0141510 0x7f51b01f89d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f51a0000c00 tx=0x7f51a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:11.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.427+0000 7f51a7400640 1 -- 172.21.15.144:0/3892605272 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0041020 con 0x7f51b0141510 2024-05-30T16:44:11.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.427+0000 7f51a7400640 1 -- 172.21.15.144:0/3892605272 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a0030640 con 0x7f51b0141510 2024-05-30T16:44:11.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.427+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b0157fa0 con 0x7f51b0141510 2024-05-30T16:44:11.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.427+0000 7f51a7400640 1 -- 172.21.15.144:0/3892605272 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0037040 con 0x7f51b0141510 2024-05-30T16:44:11.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.427+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b0158560 con 0x7f51b0141510 2024-05-30T16:44:11.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.428+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b0068b90 con 0x7f51b0141510 2024-05-30T16:44:11.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.429+0000 7f51a7400640 1 -- 172.21.15.144:0/3892605272 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 91091+0+0 (secure 0 0 0) 0x7f51a0044020 con 0x7f51b0141510 2024-05-30T16:44:11.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.430+0000 7f51a7400640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f518c06c980 0x7f518c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:11.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.430+0000 7f51a7400640 1 -- 172.21.15.144:0/3892605272 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f51a00ac3a0 con 0x7f51b0141510 2024-05-30T16:44:11.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.430+0000 7f51a7e00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f518c06c980 0x7f518c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:11.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.431+0000 7f51a7e00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f518c06c980 0x7f518c06ee40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5198007fd0 tx=0x7f5198009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:11.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.435+0000 7f51a7400640 1 -- 172.21.15.144:0/3892605272 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51a004b030 con 0x7f51b0141510 2024-05-30T16:44:11.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.704+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f51b0143b80 con 0x7f51b0141510 2024-05-30T16:44:11.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.705+0000 7f51a7400640 1 -- 172.21.15.144:0/3892605272 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1829 (secure 0 0 0) 0x7f51a007a7f0 con 0x7f51b0141510 2024-05-30T16:44:11.706 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:11.706 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:11.706 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:11.706 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:11.706 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:11.706 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:11.706 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 163, 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:11.707 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:11.708 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2392, 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 9929032888, 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 19587833856, 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 753506279424, 2024-05-30T16:44:11.709 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 111466167, 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 28 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:11.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:11.711 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": {} 2024-05-30T16:44:11.712 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:11.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f518c06c980 msgr2=0x7f518c06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:11.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f518c06c980 0x7f518c06ee40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5198007fd0 tx=0x7f5198009040 comp rx=0 tx=0).stop 2024-05-30T16:44:11.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0141510 msgr2=0x7f51b01f89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:11.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0141510 0x7f51b01f89d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f51a0000c00 tx=0x7f51a00046c0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 shutdown_connections 2024-05-30T16:44:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f518c06c980 0x7f518c06ee40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b015f8f0 0x7f51b0160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51b0144020 0x7f51b013e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 --2- 172.21.15.144:0/3892605272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0141510 0x7f51b01f89d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.707+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 >> 172.21.15.144:0/3892605272 conn(0x7f51b006bd00 msgr2=0x7f51b006e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.708+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 shutdown_connections 2024-05-30T16:44:11.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:11.708+0000 7f51b5e00640 1 -- 172.21.15.144:0/3892605272 wait complete. 2024-05-30T16:44:13.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:13.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.934+0000 7f2e83e00640 1 Processor -- start 2024-05-30T16:44:13.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.934+0000 7f2e83e00640 1 -- start start 2024-05-30T16:44:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e83e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2e8415e960 0x7f2e84162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e83e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e840ba090 0x7f2e840cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e83e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8415ed40 con 0x7f2e840cfa10 2024-05-30T16:44:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e83e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2e840d2b40 con 0x7f2e8415e960 2024-05-30T16:44:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e83e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2e841629d0 con 0x7f2e840ba090 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e83400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2e840cfa10 0x7f2e8406c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37252/0 (socket says 172.21.15.144:37252) 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e83400640 1 -- 172.21.15.144:0/1583682899 learned_addr learned my addr 172.21.15.144:0/1583682899 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e82a00640 1 --2- 172.21.15.144:0/1583682899 >> v2:172.21.15.149:3300/0 conn(0x7f2e8415e960 0x7f2e84162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e82000640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e840ba090 0x7f2e840cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2090894186 0 0) 0x7f2e8415ed40 con 0x7f2e840cfa10 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.936+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e68003520 con 0x7f2e840cfa10 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1887687512 0 0) 0x7f2e68003520 con 0x7f2e840cfa10 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e840ba090 msgr2=0x7f2e840cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e840ba090 0x7f2e840cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 >> v2:172.21.15.149:3300/0 conn(0x7f2e8415e960 msgr2=0x7f2e84162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 --2- 172.21.15.144:0/1583682899 >> v2:172.21.15.149:3300/0 conn(0x7f2e8415e960 0x7f2e84162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e84162ca0 con 0x7f2e840cfa10 2024-05-30T16:44:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f2e7c001670 con 0x7f2e840cfa10 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e82000640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e840ba090 0x7f2e840cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 >> v1:172.21.15.144:6789/0 conn(0x7f2e840cfa10 legacy=0x7f2e8406c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e680039b0 0x7f2e68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e840ba090 0x7f2e680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e840d2b40 con 0x7f2e68004800 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2e841629d0 con 0x7f2e680039b0 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6800b9c0 con 0x7f2e840ba090 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.937+0000 7f2e82000640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.938+0000 7f2e82a00640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e680039b0 0x7f2e68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.938+0000 7f2e82000640 1 -- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e840ba090 msgr2=0x7f2e680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:13.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.938+0000 7f2e82000640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e840ba090 0x7f2e680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:13.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.938+0000 7f2e82000640 1 -- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e680039b0 msgr2=0x7f2e68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:13.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.938+0000 7f2e82000640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e680039b0 0x7f2e68003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:13.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.938+0000 7f2e82000640 1 -- 172.21.15.144:0/1583682899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e68003520 con 0x7f2e68004800 2024-05-30T16:44:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.939+0000 7f2e82000640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e68004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0098d0 tx=0x7f2e68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4ca4adc47019d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.939+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00f040 con 0x7f2e68004800 2024-05-30T16:44:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.939+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6c02ad20 con 0x7f2e68004800 2024-05-30T16:44:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.939+0000 7f2e81600640 1 -- 172.21.15.144:0/1583682899 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c004250 con 0x7f2e68004800 2024-05-30T16:44:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.940+0000 7f2e83e00640 1 -- 172.21.15.144:0/1583682899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 msgr2=0x7f2e68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.940+0000 7f2e83e00640 1 --2- 172.21.15.144:0/1583682899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e68004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0098d0 tx=0x7f2e68005830 comp rx=0 tx=0).stop 2024-05-30T16:44:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.940+0000 7f2e83400640 1 -- 172.21.15.144:0/1583682899 reap_dead start 2024-05-30T16:44:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.940+0000 7f2e83e00640 1 -- 172.21.15.144:0/1583682899 shutdown_connections 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.940+0000 7f2e83e00640 1 -- 172.21.15.144:0/1583682899 >> 172.21.15.144:0/1583682899 conn(0x7f2e840d1360 msgr2=0x7f2e840d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.940+0000 7f2e83e00640 1 -- 172.21.15.144:0/1583682899 shutdown_connections 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.940+0000 7f2e83e00640 1 -- 172.21.15.144:0/1583682899 wait complete. 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.942+0000 7f2e83e00640 1 Processor -- start 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.942+0000 7f2e83e00640 1 -- start start 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e841f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e83e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8415d6e0 0x7f2e8415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e83e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e840ad290 0x7f2e840ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e83e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e840d2d90 con 0x7f2e68004800 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e83e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84163260 con 0x7f2e840ad290 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e83e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2e840b78a0 con 0x7f2e8415d6e0 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e841f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e841f5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35382/0 (socket says 172.21.15.144:35382) 2024-05-30T16:44:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e82a00640 1 -- 172.21.15.144:0/1805007223 learned_addr learned my addr 172.21.15.144:0/1805007223 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:13.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e82a00640 1 -- 172.21.15.144:0/1805007223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8415d6e0 msgr2=0x7f2e8415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:13.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e82000640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8415d6e0 0x7f2e8415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:13.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e82a00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8415d6e0 0x7f2e8415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:13.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e82a00640 1 -- 172.21.15.144:0/1805007223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e840ad290 msgr2=0x7f2e840ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:13.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e82a00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e840ad290 0x7f2e840ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:13.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.943+0000 7f2e82a00640 1 -- 172.21.15.144:0/1805007223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e840ac4d0 con 0x7f2e68004800 2024-05-30T16:44:13.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.944+0000 7f2e82a00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e841f5650 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400f400 tx=0x7f2e7400f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.944+0000 7f2e7aa00640 1 -- 172.21.15.144:0/1805007223 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e740147e0 con 0x7f2e68004800 2024-05-30T16:44:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.944+0000 7f2e7aa00640 1 -- 172.21.15.144:0/1805007223 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7401b070 con 0x7f2e68004800 2024-05-30T16:44:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.944+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e840ac7b0 con 0x7f2e68004800 2024-05-30T16:44:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.944+0000 7f2e7aa00640 1 -- 172.21.15.144:0/1805007223 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74014be0 con 0x7f2e68004800 2024-05-30T16:44:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.944+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8415db60 con 0x7f2e68004800 2024-05-30T16:44:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.945+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e84075570 con 0x7f2e68004800 2024-05-30T16:44:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.946+0000 7f2e7aa00640 1 -- 172.21.15.144:0/1805007223 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7f2e74005d10 con 0x7f2e68004800 2024-05-30T16:44:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.947+0000 7f2e7aa00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2e6006caa0 0x7f2e6006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.947+0000 7f2e7aa00640 1 -- 172.21.15.144:0/1805007223 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2e7408ce20 con 0x7f2e68004800 2024-05-30T16:44:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.947+0000 7f2e82000640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2e6006caa0 0x7f2e6006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.948+0000 7f2e82000640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2e6006caa0 0x7f2e6006ef60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c033000 tx=0x7f2e6c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:13.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:13.952+0000 7f2e7aa00640 1 -- 172.21.15.144:0/1805007223 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e74025020 con 0x7f2e68004800 2024-05-30T16:44:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.225+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2e84161d80 con 0x7f2e68004800 2024-05-30T16:44:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.226+0000 7f2e7aa00640 1 -- 172.21.15.144:0/1805007223 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1860 (secure 0 0 0) 0x7f2e7405aee0 con 0x7f2e68004800 2024-05-30T16:44:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:14.227 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 166, 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2585, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 10738567329, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 21735391232, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 751358722048, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 85, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 178903344, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 45 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": {} 2024-05-30T16:44:14.234 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2e6006caa0 msgr2=0x7f2e6006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2e6006caa0 0x7f2e6006ef60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c033000 tx=0x7f2e6c02e000 comp rx=0 tx=0).stop 2024-05-30T16:44:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 msgr2=0x7f2e841f5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e841f5650 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400f400 tx=0x7f2e7400f8c0 comp rx=0 tx=0).stop 2024-05-30T16:44:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 shutdown_connections 2024-05-30T16:44:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2e6006caa0 0x7f2e6006ef60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e840ad290 0x7f2e840ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8415d6e0 0x7f2e8415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 --2- 172.21.15.144:0/1805007223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e68004800 0x7f2e841f5650 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 >> 172.21.15.144:0/1805007223 conn(0x7f2e840d1360 msgr2=0x7f2e840d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 shutdown_connections 2024-05-30T16:44:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:14.229+0000 7f2e83e00640 1 -- 172.21.15.144:0/1805007223 wait complete. 2024-05-30T16:44:15.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:44:15.721 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:44:16.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:16.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.547+0000 7f6d2d000640 1 Processor -- start 2024-05-30T16:44:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.547+0000 7f6d2d000640 1 -- start start 2024-05-30T16:44:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.549+0000 7f6d2d000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6d2815eb80 0x7f6d28162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.549+0000 7f6d2d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d280cfc70 0x7f6d280d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.549+0000 7f6d2d000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d28163550 con 0x7f6d280ba2b0 2024-05-30T16:44:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.549+0000 7f6d2d000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2815ef60 con 0x7f6d280cfc70 2024-05-30T16:44:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.549+0000 7f6d2d000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6d28162f90 con 0x7f6d2815eb80 2024-05-30T16:44:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.550+0000 7f6d26800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d280cfc70 0x7f6d280d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.550+0000 7f6d26800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d280cfc70 0x7f6d280d3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57682/0 (socket says 172.21.15.144:57682) 2024-05-30T16:44:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.550+0000 7f6d26800640 1 -- 172.21.15.144:0/481209908 learned_addr learned my addr 172.21.15.144:0/481209908 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.550+0000 7f6d26800640 1 -- 172.21.15.144:0/481209908 >> v2:172.21.15.149:3300/0 conn(0x7f6d2815eb80 msgr2=0x7f6d28162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.550+0000 7f6d26800640 1 --2- 172.21.15.144:0/481209908 >> v2:172.21.15.149:3300/0 conn(0x7f6d2815eb80 0x7f6d28162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.550+0000 7f6d26800640 1 -- 172.21.15.144:0/481209908 >> v1:172.21.15.144:6789/0 conn(0x7f6d280ba2b0 legacy=0x7f6d280cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.550+0000 7f6d26800640 1 -- 172.21.15.144:0/481209908 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d28163270 con 0x7f6d280cfc70 2024-05-30T16:44:16.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.552+0000 7f6d26800640 1 --2- 172.21.15.144:0/481209908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 0x7f6d280d3570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d2808cfe0 tx=0x7f6d2002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cf73aaf8293b8f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:16.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.552+0000 7f6d25400640 1 -- 172.21.15.144:0/481209908 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d20036070 con 0x7f6d280cfc70 2024-05-30T16:44:16.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.552+0000 7f6d25400640 1 -- 172.21.15.144:0/481209908 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d20031600 con 0x7f6d280cfc70 2024-05-30T16:44:16.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.552+0000 7f6d25400640 1 -- 172.21.15.144:0/481209908 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d20031a10 con 0x7f6d280cfc70 2024-05-30T16:44:16.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.553+0000 7f6d2d000640 1 -- 172.21.15.144:0/481209908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 msgr2=0x7f6d280d3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:16.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.553+0000 7f6d2d000640 1 --2- 172.21.15.144:0/481209908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 0x7f6d280d3570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d2808cfe0 tx=0x7f6d2002a750 comp rx=0 tx=0).stop 2024-05-30T16:44:16.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.553+0000 7f6d2d000640 1 -- 172.21.15.144:0/481209908 shutdown_connections 2024-05-30T16:44:16.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.553+0000 7f6d2d000640 1 --2- 172.21.15.144:0/481209908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 0x7f6d280d3570 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:16.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.553+0000 7f6d2d000640 1 --2- 172.21.15.144:0/481209908 >> v2:172.21.15.149:3300/0 conn(0x7f6d2815eb80 0x7f6d28162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:16.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.553+0000 7f6d2d000640 1 -- 172.21.15.144:0/481209908 >> 172.21.15.144:0/481209908 conn(0x7f6d2806cf40 msgr2=0x7f6d2806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:16.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.553+0000 7f6d2d000640 1 -- 172.21.15.144:0/481209908 shutdown_connections 2024-05-30T16:44:16.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.553+0000 7f6d2d000640 1 -- 172.21.15.144:0/481209908 wait complete. 2024-05-30T16:44:16.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.555+0000 7f6d2d000640 1 Processor -- start 2024-05-30T16:44:16.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.555+0000 7f6d2d000640 1 -- start start 2024-05-30T16:44:16.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.556+0000 7f6d2d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d280ba2b0 0x7f6d2815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:16.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.556+0000 7f6d2d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 0x7f6d2814a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:16.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.556+0000 7f6d2d000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2815eb80 0x7f6d280b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:16.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.556+0000 7f6d2d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d28162b80 con 0x7f6d280cfc70 2024-05-30T16:44:16.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.556+0000 7f6d2d000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d280d3050 con 0x7f6d2815eb80 2024-05-30T16:44:16.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.556+0000 7f6d2d000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d28162d00 con 0x7f6d280ba2b0 2024-05-30T16:44:16.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.557+0000 7f6d1fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 0x7f6d2814a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:16.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.557+0000 7f6d1fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 0x7f6d2814a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57690/0 (socket says 172.21.15.144:57690) 2024-05-30T16:44:16.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.557+0000 7f6d1fe00640 1 -- 172.21.15.144:0/3816796565 learned_addr learned my addr 172.21.15.144:0/3816796565 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:16.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.557+0000 7f6d25e00640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d280ba2b0 0x7f6d2815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:16.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.557+0000 7f6d1fe00640 1 -- 172.21.15.144:0/3816796565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d280ba2b0 msgr2=0x7f6d2815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:16.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.557+0000 7f6d1fe00640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d280ba2b0 0x7f6d2815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:16.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.557+0000 7f6d1fe00640 1 -- 172.21.15.144:0/3816796565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2815eb80 msgr2=0x7f6d280b9150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:44:16.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.557+0000 7f6d1fe00640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2815eb80 0x7f6d280b9150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:16.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.557+0000 7f6d1fe00640 1 -- 172.21.15.144:0/3816796565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d280c9550 con 0x7f6d280cfc70 2024-05-30T16:44:16.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.558+0000 7f6d1fe00640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 0x7f6d2814a8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c470 tx=0x7f6d10001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:16.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.558+0000 7f6d1e000640 1 -- 172.21.15.144:0/3816796565 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d100052d0 con 0x7f6d280cfc70 2024-05-30T16:44:16.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.558+0000 7f6d1e000640 1 -- 172.21.15.144:0/3816796565 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10005470 con 0x7f6d280cfc70 2024-05-30T16:44:16.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.559+0000 7f6d1e000640 1 -- 172.21.15.144:0/3816796565 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10007260 con 0x7f6d280cfc70 2024-05-30T16:44:16.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.559+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d280ca9b0 con 0x7f6d280cfc70 2024-05-30T16:44:16.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.559+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d280cac50 con 0x7f6d280cfc70 2024-05-30T16:44:16.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.560+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d28068b90 con 0x7f6d280cfc70 2024-05-30T16:44:16.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.563+0000 7f6d1e000640 1 -- 172.21.15.144:0/3816796565 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7f6d10007400 con 0x7f6d280cfc70 2024-05-30T16:44:16.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.564+0000 7f6d1e000640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d0406caa0 0x7f6d0406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:16.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.564+0000 7f6d1e000640 1 -- 172.21.15.144:0/3816796565 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6d1008b2b0 con 0x7f6d280cfc70 2024-05-30T16:44:16.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.564+0000 7f6d25e00640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d0406caa0 0x7f6d0406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:16.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.565+0000 7f6d25e00640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d0406caa0 0x7f6d0406ef60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800b810 tx=0x7f6d18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:16.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:16.571+0000 7f6d1e000640 1 -- 172.21.15.144:0/3816796565 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d280c9550 con 0x7f6d280cfc70 2024-05-30T16:44:17.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.043+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6d2814dc30 con 0x7f6d280cfc70 2024-05-30T16:44:17.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.043+0000 7f6d1e000640 1 -- 172.21.15.144:0/3816796565 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2094 (secure 0 0 0) 0x7f6d10059460 con 0x7f6d280cfc70 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 169, 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2585, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 10738567329, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 21735391232, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 751358722048, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 85, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 89449033, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:44:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 22 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "ff9f6066-74fc-4a5f-89fb-cf36a585c6d6": { 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "1 ongoing clones; Avg progress is 0.0% (0s)\n [............................] ", 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0, 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:17.052 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:17.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d0406caa0 msgr2=0x7f6d0406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:17.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d0406caa0 0x7f6d0406ef60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800b810 tx=0x7f6d18008040 comp rx=0 tx=0).stop 2024-05-30T16:44:17.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 msgr2=0x7f6d2814a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:17.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 0x7f6d2814a8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c470 tx=0x7f6d10001e70 comp rx=0 tx=0).stop 2024-05-30T16:44:17.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 shutdown_connections 2024-05-30T16:44:17.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d0406caa0 0x7f6d0406ef60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:17.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2815eb80 0x7f6d280b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:17.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d280cfc70 0x7f6d2814a8f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:17.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 --2- 172.21.15.144:0/3816796565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d280ba2b0 0x7f6d2815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:17.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.050+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 >> 172.21.15.144:0/3816796565 conn(0x7f6d2806cf40 msgr2=0x7f6d28159c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:17.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.051+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 shutdown_connections 2024-05-30T16:44:17.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.051+0000 7f6d2d000640 1 -- 172.21.15.144:0/3816796565 wait complete. 2024-05-30T16:44:17.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-05-30T16:44:17.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.398+0000 7f9e04200640 1 Processor -- start 2024-05-30T16:44:17.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.398+0000 7f9e04200640 1 -- start start 2024-05-30T16:44:17.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.399+0000 7f9e04200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9dfc072500 0x7f9dfc144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:17.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.399+0000 7f9e04200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9dfc144790 0x7f9dfc15ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:17.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.399+0000 7f9e04200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dfc0cff40 con 0x7f9dfc141780 2024-05-30T16:44:17.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.400+0000 7f9e04200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9dfc162600 con 0x7f9dfc072500 2024-05-30T16:44:17.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.400+0000 7f9e04200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9dfc1628e0 con 0x7f9dfc144790 2024-05-30T16:44:17.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.400+0000 7f9e02200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9dfc144790 0x7f9dfc15ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:17.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.400+0000 7f9e02200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9dfc144790 0x7f9dfc15ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:57900/0 (socket says 172.21.15.144:57900) 2024-05-30T16:44:17.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.400+0000 7f9e02200640 1 -- 172.21.15.144:0/1814087695 learned_addr learned my addr 172.21.15.144:0/1814087695 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:17.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.401+0000 7f9e02200640 1 -- 172.21.15.144:0/1814087695 >> v2:172.21.15.144:3300/0 conn(0x7f9dfc072500 msgr2=0x7f9dfc144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:17.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.401+0000 7f9e02200640 1 --2- 172.21.15.144:0/1814087695 >> v2:172.21.15.144:3300/0 conn(0x7f9dfc072500 0x7f9dfc144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:17.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.401+0000 7f9e02200640 1 -- 172.21.15.144:0/1814087695 >> v1:172.21.15.149:6789/0 conn(0x7f9dfc141780 legacy=0x7f9dfc071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:17.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.401+0000 7f9e02200640 1 -- 172.21.15.144:0/1814087695 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc162bc0 con 0x7f9dfc144790 2024-05-30T16:44:17.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.403+0000 7f9e02200640 1 --2- 172.21.15.144:0/1814087695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dfc144790 0x7f9dfc15ee30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc155f20 tx=0x7f9df4032f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59b8f34f93f9661c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.403+0000 7f9dfbe00640 1 -- 172.21.15.144:0/1814087695 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4033a20 con 0x7f9dfc144790 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.403+0000 7f9dfbe00640 1 -- 172.21.15.144:0/1814087695 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df4033bc0 con 0x7f9dfc144790 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.403+0000 7f9dfbe00640 1 -- 172.21.15.144:0/1814087695 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df403b3f0 con 0x7f9dfc144790 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.404+0000 7f9e04200640 1 -- 172.21.15.144:0/1814087695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dfc144790 msgr2=0x7f9dfc15ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.404+0000 7f9e04200640 1 --2- 172.21.15.144:0/1814087695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dfc144790 0x7f9dfc15ee30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc155f20 tx=0x7f9df4032f20 comp rx=0 tx=0).stop 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.404+0000 7f9e04200640 1 -- 172.21.15.144:0/1814087695 shutdown_connections 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.404+0000 7f9e04200640 1 --2- 172.21.15.144:0/1814087695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dfc144790 0x7f9dfc15ee30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.404+0000 7f9e04200640 1 --2- 172.21.15.144:0/1814087695 >> v2:172.21.15.144:3300/0 conn(0x7f9dfc072500 0x7f9dfc144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.404+0000 7f9e04200640 1 -- 172.21.15.144:0/1814087695 >> 172.21.15.144:0/1814087695 conn(0x7f9dfc070050 msgr2=0x7f9dfc06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.404+0000 7f9e04200640 1 -- 172.21.15.144:0/1814087695 shutdown_connections 2024-05-30T16:44:17.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.405+0000 7f9e04200640 1 -- 172.21.15.144:0/1814087695 wait complete. 2024-05-30T16:44:17.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.406+0000 7f9e04200640 1 Processor -- start 2024-05-30T16:44:17.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.406+0000 7f9e04200640 1 -- start start 2024-05-30T16:44:17.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.407+0000 7f9e04200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dfc072500 0x7f9dfc0abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:17.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.407+0000 7f9e04200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dfc141780 0x7f9dfc140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:17.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.407+0000 7f9e04200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dfc144790 0x7f9dfc13be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:17.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.407+0000 7f9e04200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc144c20 con 0x7f9dfc072500 2024-05-30T16:44:17.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.407+0000 7f9e04200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc141b60 con 0x7f9dfc144790 2024-05-30T16:44:17.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.407+0000 7f9e04200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9dfc0b5390 con 0x7f9dfc141780 2024-05-30T16:44:17.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.407+0000 7f9e01800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dfc072500 0x7f9dfc0abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:17.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.408+0000 7f9e01800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dfc072500 0x7f9dfc0abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57700/0 (socket says 172.21.15.144:57700) 2024-05-30T16:44:17.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.408+0000 7f9e01800640 1 -- 172.21.15.144:0/3253254868 learned_addr learned my addr 172.21.15.144:0/3253254868 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:17.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.408+0000 7f9e02200640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dfc144790 0x7f9dfc13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:17.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.408+0000 7f9e01800640 1 -- 172.21.15.144:0/3253254868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dfc141780 msgr2=0x7f9dfc140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:17.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.408+0000 7f9e01800640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dfc141780 0x7f9dfc140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:17.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.408+0000 7f9e01800640 1 -- 172.21.15.144:0/3253254868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dfc144790 msgr2=0x7f9dfc13be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:17.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.408+0000 7f9e01800640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dfc144790 0x7f9dfc13be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:17.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.408+0000 7f9e01800640 1 -- 172.21.15.144:0/3253254868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc0aaeb0 con 0x7f9dfc072500 2024-05-30T16:44:17.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.409+0000 7f9e01800640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dfc072500 0x7f9dfc0abf50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c460 tx=0x7f9df000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:17.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.409+0000 7f9df9600640 1 -- 172.21.15.144:0/3253254868 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0016020 con 0x7f9dfc072500 2024-05-30T16:44:17.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.409+0000 7f9df9600640 1 -- 172.21.15.144:0/3253254868 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df0012870 con 0x7f9dfc072500 2024-05-30T16:44:17.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.409+0000 7f9df9600640 1 -- 172.21.15.144:0/3253254868 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0012c60 con 0x7f9dfc072500 2024-05-30T16:44:17.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.411+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc0ab190 con 0x7f9dfc072500 2024-05-30T16:44:17.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.411+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc0ab750 con 0x7f9dfc072500 2024-05-30T16:44:17.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.413+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc068b90 con 0x7f9dfc072500 2024-05-30T16:44:17.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.414+0000 7f9df9600640 1 -- 172.21.15.144:0/3253254868 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7f9df0019020 con 0x7f9dfc072500 2024-05-30T16:44:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.415+0000 7f9df9600640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9de006caa0 0x7f9de006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:17.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.416+0000 7f9df9600640 1 -- 172.21.15.144:0/3253254868 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f9df008bc70 con 0x7f9dfc072500 2024-05-30T16:44:17.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.416+0000 7f9e00e00640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9de006caa0 0x7f9de006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:17.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.417+0000 7f9e00e00640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9de006caa0 0x7f9de006ef60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009710 tx=0x7f9dec006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:17.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.420+0000 7f9df9600640 1 -- 172.21.15.144:0/3253254868 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9df0020030 con 0x7f9dfc072500 2024-05-30T16:44:17.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:17.777+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f9dfc075f70 con 0x7f9de006caa0 2024-05-30T16:44:18.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.013+0000 7f9df9600640 1 -- 172.21.15.144:0/3253254868 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9dec00b480 con 0x7f9de006caa0 2024-05-30T16:44:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.015+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9de006caa0 msgr2=0x7f9de006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.015+0000 7f9e04200640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9de006caa0 0x7f9de006ef60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009710 tx=0x7f9dec006c90 comp rx=0 tx=0).stop 2024-05-30T16:44:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.015+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dfc072500 msgr2=0x7f9dfc0abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.015+0000 7f9e04200640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dfc072500 0x7f9dfc0abf50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c460 tx=0x7f9df000c920 comp rx=0 tx=0).stop 2024-05-30T16:44:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.016+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 shutdown_connections 2024-05-30T16:44:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.016+0000 7f9e04200640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9de006caa0 0x7f9de006ef60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.016+0000 7f9e04200640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dfc144790 0x7f9dfc13be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.016+0000 7f9e04200640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dfc141780 0x7f9dfc140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.016+0000 7f9e04200640 1 --2- 172.21.15.144:0/3253254868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dfc072500 0x7f9dfc0abf50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.016+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 >> 172.21.15.144:0/3253254868 conn(0x7f9dfc070050 msgr2=0x7f9dfc141ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.016+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 shutdown_connections 2024-05-30T16:44:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.016+0000 7f9e04200640 1 -- 172.21.15.144:0/3253254868 wait complete. 2024-05-30T16:44:18.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:44:18.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.208+0000 7f1b46e00640 1 Processor -- start 2024-05-30T16:44:18.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.208+0000 7f1b46e00640 1 -- start start 2024-05-30T16:44:18.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.210+0000 7f1b46e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1b401418b0 0x7f1b40141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.210+0000 7f1b46e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b400b3730 con 0x7f1b400b2e40 2024-05-30T16:44:18.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.210+0000 7f1b46e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b400b3a10 con 0x7f1b401414d0 2024-05-30T16:44:18.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.210+0000 7f1b46e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f1b401422f0 con 0x7f1b401418b0 2024-05-30T16:44:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.210+0000 7f1b46400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1b400b2e40 0x7f1b401625e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34020/0 (socket says 172.21.15.144:34020) 2024-05-30T16:44:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.210+0000 7f1b46400640 1 -- 172.21.15.144:0/3878432170 learned_addr learned my addr 172.21.15.144:0/3878432170 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b45000640 1 --2- 172.21.15.144:0/3878432170 >> v2:172.21.15.149:3300/0 conn(0x7f1b401418b0 0x7f1b40141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2016201939 0 0) 0x7f1b400b3730 con 0x7f1b400b2e40 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b28003520 con 0x7f1b400b2e40 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 833114609 0 0) 0x7f1b28003520 con 0x7f1b400b2e40 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 >> v2:172.21.15.149:3300/0 conn(0x7f1b401418b0 msgr2=0x7f1b40141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 --2- 172.21.15.144:0/3878432170 >> v2:172.21.15.149:3300/0 conn(0x7f1b401418b0 0x7f1b40141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 >> v1:172.21.15.149:6789/0 conn(0x7f1b401414d0 legacy=0x7f1b400b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b400b3cf0 con 0x7f1b400b2e40 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f1b380019f0 con 0x7f1b400b2e40 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 >> v1:172.21.15.144:6789/0 conn(0x7f1b400b2e40 legacy=0x7f1b401625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b28003a00 0x7f1b28003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b28004800 0x7f1b28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2800c110 con 0x7f1b28005210 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2800c2c0 con 0x7f1b28004800 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.211+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2800c4c0 con 0x7f1b28003a00 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.212+0000 7f1b46400640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.212+0000 7f1b45000640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b28004800 0x7f1b28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.212+0000 7f1b45a00640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b28003a00 0x7f1b28003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.212+0000 7f1b46400640 1 -- 172.21.15.144:0/3878432170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b28003a00 msgr2=0x7f1b28003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.212+0000 7f1b46400640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b28003a00 0x7f1b28003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.212+0000 7f1b46400640 1 -- 172.21.15.144:0/3878432170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b28004800 msgr2=0x7f1b28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.212+0000 7f1b46400640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b28004800 0x7f1b28004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.212+0000 7f1b46400640 1 -- 172.21.15.144:0/3878432170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b28003520 con 0x7f1b28005210 2024-05-30T16:44:18.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.213+0000 7f1b46400640 1 -- 172.21.15.144:0/3878432170 reap_dead start 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.213+0000 7f1b46400640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b2800b9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b400cfe20 tx=0x7f1b28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d614b69e7d0de1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.213+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800a3b0 con 0x7f1b28005210 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.213+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3802f070 con 0x7f1b28005210 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.213+0000 7f1b3fe00640 1 -- 172.21.15.144:0/3878432170 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3802bb90 con 0x7f1b28005210 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.214+0000 7f1b46e00640 1 -- 172.21.15.144:0/3878432170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 msgr2=0x7f1b2800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.214+0000 7f1b46e00640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b2800b9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b400cfe20 tx=0x7f1b28005830 comp rx=0 tx=0).stop 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.214+0000 7f1b46e00640 1 -- 172.21.15.144:0/3878432170 shutdown_connections 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.214+0000 7f1b46e00640 1 --2- 172.21.15.144:0/3878432170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b2800b9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.214+0000 7f1b46e00640 1 -- 172.21.15.144:0/3878432170 >> 172.21.15.144:0/3878432170 conn(0x7f1b400627b0 msgr2=0x7f1b4006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.214+0000 7f1b46e00640 1 -- 172.21.15.144:0/3878432170 shutdown_connections 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.214+0000 7f1b46e00640 1 -- 172.21.15.144:0/3878432170 wait complete. 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.216+0000 7f1b46e00640 1 Processor -- start 2024-05-30T16:44:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.216+0000 7f1b46e00640 1 -- start start 2024-05-30T16:44:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b46e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b4013c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b46e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b401593b0 0x7f1b4013dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b46e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4014fcf0 0x7f1b40154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b46e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b40141f30 con 0x7f1b28005210 2024-05-30T16:44:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b46e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b40141db0 con 0x7f1b4014fcf0 2024-05-30T16:44:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b46e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b401420b0 con 0x7f1b401593b0 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b45a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b4013c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b45a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b4013c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57708/0 (socket says 172.21.15.144:57708) 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b45a00640 1 -- 172.21.15.144:0/815161834 learned_addr learned my addr 172.21.15.144:0/815161834 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b45a00640 1 -- 172.21.15.144:0/815161834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b401593b0 msgr2=0x7f1b4013dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b45a00640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b401593b0 0x7f1b4013dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b45a00640 1 -- 172.21.15.144:0/815161834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4014fcf0 msgr2=0x7f1b40154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b45a00640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4014fcf0 0x7f1b40154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.217+0000 7f1b45a00640 1 -- 172.21.15.144:0/815161834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4013b1c0 con 0x7f1b28005210 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.218+0000 7f1b45a00640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b4013c860 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400d510 tx=0x7f1b3400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.218+0000 7f1b3d600640 1 -- 172.21.15.144:0/815161834 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34016070 con 0x7f1b28005210 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.218+0000 7f1b3d600640 1 -- 172.21.15.144:0/815161834 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b34012800 con 0x7f1b28005210 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.218+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4013ce40 con 0x7f1b28005210 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.218+0000 7f1b3d600640 1 -- 172.21.15.144:0/815161834 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34012bf0 con 0x7f1b28005210 2024-05-30T16:44:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.218+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4013d400 con 0x7f1b28005210 2024-05-30T16:44:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.219+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b400c9e30 con 0x7f1b28005210 2024-05-30T16:44:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.220+0000 7f1b3d600640 1 -- 172.21.15.144:0/815161834 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7f1b34019070 con 0x7f1b28005210 2024-05-30T16:44:18.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.221+0000 7f1b3d600640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b2006caa0 0x7f1b2006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.221+0000 7f1b3d600640 1 -- 172.21.15.144:0/815161834 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f1b3408bf10 con 0x7f1b28005210 2024-05-30T16:44:18.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.221+0000 7f1b45000640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b2006caa0 0x7f1b2006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.222+0000 7f1b45000640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b2006caa0 0x7f1b2006ef60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c006a90 tx=0x7f1b2c006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.226+0000 7f1b3d600640 1 -- 172.21.15.144:0/815161834 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b400c9e30 con 0x7f1b28005210 2024-05-30T16:44:18.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.434+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f1b40075570 con 0x7f1b2006caa0 2024-05-30T16:44:18.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.436+0000 7f1b3d600640 1 -- 172.21.15.144:0/815161834 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f1b40075570 con 0x7f1b2006caa0 2024-05-30T16:44:18.437 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:44:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-05-30T16:44:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:18.437 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:44:18.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b2006caa0 msgr2=0x7f1b2006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b2006caa0 0x7f1b2006ef60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c006a90 tx=0x7f1b2c006a20 comp rx=0 tx=0).stop 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 msgr2=0x7f1b4013c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b4013c860 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400d510 tx=0x7f1b3400d9d0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 shutdown_connections 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b2006caa0 0x7f1b2006ef60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4014fcf0 0x7f1b40154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b401593b0 0x7f1b4013dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 --2- 172.21.15.144:0/815161834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b28005210 0x7f1b4013c860 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 >> 172.21.15.144:0/815161834 conn(0x7f1b400627b0 msgr2=0x7f1b400b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 shutdown_connections 2024-05-30T16:44:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.438+0000 7f1b46e00640 1 -- 172.21.15.144:0/815161834 wait complete. 2024-05-30T16:44:18.457 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:18.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.646+0000 7fa701a00640 1 Processor -- start 2024-05-30T16:44:18.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.646+0000 7fa701a00640 1 -- start start 2024-05-30T16:44:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.648+0000 7fa701a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6fc15e960 0x7fa6fc162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.648+0000 7fa701a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6fc0cfbe0 0x7fa6fc0d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.648+0000 7fa701a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6fc15ed40 con 0x7fa6fc0ba090 2024-05-30T16:44:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.648+0000 7fa701a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa6fc0d2b40 con 0x7fa6fc15e960 2024-05-30T16:44:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.648+0000 7fa701a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa6fc1629d0 con 0x7fa6fc0cfbe0 2024-05-30T16:44:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.648+0000 7fa6fbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6fc15e960 0x7fa6fc162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.648+0000 7fa6fbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6fc15e960 0x7fa6fc162490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57716/0 (socket says 172.21.15.144:57716) 2024-05-30T16:44:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.648+0000 7fa6fbe00640 1 -- 172.21.15.144:0/1813520533 learned_addr learned my addr 172.21.15.144:0/1813520533 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.649+0000 7fa6fbe00640 1 -- 172.21.15.144:0/1813520533 >> v2:172.21.15.149:3300/0 conn(0x7fa6fc0cfbe0 msgr2=0x7fa6fc0d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.649+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/1813520533 >> v2:172.21.15.149:3300/0 conn(0x7fa6fc0cfbe0 0x7fa6fc0d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.649+0000 7fa6fbe00640 1 -- 172.21.15.144:0/1813520533 >> v1:172.21.15.149:6789/0 conn(0x7fa6fc0ba090 legacy=0x7fa6fc0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.649+0000 7fa6fbe00640 1 -- 172.21.15.144:0/1813520533 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc162ca0 con 0x7fa6fc15e960 2024-05-30T16:44:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.650+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/1813520533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 0x7fa6fc162490 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0cf110 tx=0x7fa6ec02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8173bca7a5eaf2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.650+0000 7fa6fb400640 1 -- 172.21.15.144:0/1813520533 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec037070 con 0x7fa6fc15e960 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.650+0000 7fa6fb400640 1 -- 172.21.15.144:0/1813520533 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6ec032440 con 0x7fa6fc15e960 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.650+0000 7fa6fb400640 1 -- 172.21.15.144:0/1813520533 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec032810 con 0x7fa6fc15e960 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.650+0000 7fa701a00640 1 -- 172.21.15.144:0/1813520533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 msgr2=0x7fa6fc162490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.650+0000 7fa701a00640 1 --2- 172.21.15.144:0/1813520533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 0x7fa6fc162490 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0cf110 tx=0x7fa6ec02a250 comp rx=0 tx=0).stop 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.651+0000 7fa701a00640 1 -- 172.21.15.144:0/1813520533 shutdown_connections 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.651+0000 7fa701a00640 1 --2- 172.21.15.144:0/1813520533 >> v2:172.21.15.149:3300/0 conn(0x7fa6fc0cfbe0 0x7fa6fc0d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.651+0000 7fa701a00640 1 --2- 172.21.15.144:0/1813520533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 0x7fa6fc162490 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.651+0000 7fa701a00640 1 -- 172.21.15.144:0/1813520533 >> 172.21.15.144:0/1813520533 conn(0x7fa6fc0d1360 msgr2=0x7fa6fc0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.651+0000 7fa701a00640 1 -- 172.21.15.144:0/1813520533 shutdown_connections 2024-05-30T16:44:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.651+0000 7fa701a00640 1 -- 172.21.15.144:0/1813520533 wait complete. 2024-05-30T16:44:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.652+0000 7fa701a00640 1 Processor -- start 2024-05-30T16:44:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.652+0000 7fa701a00640 1 -- start start 2024-05-30T16:44:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.653+0000 7fa701a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6fc0ba090 0x7fa6fc0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.653+0000 7fa701a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc0cfbe0 0x7fa6fc155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.653+0000 7fa701a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 0x7fa6fc159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.653+0000 7fa701a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc0d2d90 con 0x7fa6fc15e960 2024-05-30T16:44:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.653+0000 7fa701a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc163260 con 0x7fa6fc0cfbe0 2024-05-30T16:44:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.653+0000 7fa701a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6fc0b78a0 con 0x7fa6fc0ba090 2024-05-30T16:44:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.653+0000 7fa701000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 0x7fa6fc159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa701000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 0x7fa6fc159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57728/0 (socket says 172.21.15.144:57728) 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa701000640 1 -- 172.21.15.144:0/667209342 learned_addr learned my addr 172.21.15.144:0/667209342 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6fc0ba090 0x7fa6fc0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa6f3400640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc0cfbe0 0x7fa6fc155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa701000640 1 -- 172.21.15.144:0/667209342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6fc0ba090 msgr2=0x7fa6fc0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa701000640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6fc0ba090 0x7fa6fc0ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa701000640 1 -- 172.21.15.144:0/667209342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc0cfbe0 msgr2=0x7fa6fc155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa701000640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc0cfbe0 0x7fa6fc155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa701000640 1 -- 172.21.15.144:0/667209342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc155f50 con 0x7fa6fc15e960 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa6f3400640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc0cfbe0 0x7fa6fc155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.654+0000 7fa701000640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 0x7fa6fc159e30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400b9e0 tx=0x7fa6f400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.655+0000 7fa6f8c00640 1 -- 172.21.15.144:0/667209342 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4019070 con 0x7fa6fc15e960 2024-05-30T16:44:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.655+0000 7fa6f8c00640 1 -- 172.21.15.144:0/667209342 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f400cb20 con 0x7fa6fc15e960 2024-05-30T16:44:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.655+0000 7fa6f8c00640 1 -- 172.21.15.144:0/667209342 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4014440 con 0x7fa6fc15e960 2024-05-30T16:44:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.655+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6fc156230 con 0x7fa6fc15e960 2024-05-30T16:44:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.655+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6fc1567f0 con 0x7fa6fc15e960 2024-05-30T16:44:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.656+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6fc075570 con 0x7fa6fc15e960 2024-05-30T16:44:18.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.657+0000 7fa6f8c00640 1 -- 172.21.15.144:0/667209342 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7fa6f401c070 con 0x7fa6fc15e960 2024-05-30T16:44:18.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.657+0000 7fa6f8c00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6d806cad0 0x7fa6d806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:18.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.657+0000 7fa6f8c00640 1 -- 172.21.15.144:0/667209342 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa6f408bbd0 con 0x7fa6fc15e960 2024-05-30T16:44:18.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.658+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6d806cad0 0x7fa6d806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:18.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.658+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6d806cad0 0x7fa6d806ef90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec034000 tx=0x7fa6ec02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:18.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.662+0000 7fa6f8c00640 1 -- 172.21.15.144:0/667209342 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa6f4059cf0 con 0x7fa6fc15e960 2024-05-30T16:44:18.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.922+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa6fc0d2410 con 0x7fa6fc15e960 2024-05-30T16:44:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.923+0000 7fa6f8c00640 1 -- 172.21.15.144:0/667209342 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2125 (secure 0 0 0) 0x7fa6f40595f0 con 0x7fa6fc15e960 2024-05-30T16:44:18.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:18.924 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:18.924 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:18.924 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:18.924 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:18.924 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 171, 2024-05-30T16:44:18.925 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:18.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2660, 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 11036458549, 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 21777522688, 2024-05-30T16:44:18.927 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 751316590592, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 29001527, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 114272278, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 7, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 31 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:18.928 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:44:18.930 INFO:teuthology.orchestra.run.smithi144.stdout: "ff9f6066-74fc-4a5f-89fb-cf36a585c6d6": { 2024-05-30T16:44:18.931 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "1 ongoing clones; Avg progress is 3.125% (1s)\n [............................] (remaining: 32s)", 2024-05-30T16:44:18.931 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.03125, 2024-05-30T16:44:18.931 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:44:18.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:18.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6d806cad0 msgr2=0x7fa6d806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6d806cad0 0x7fa6d806ef90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec034000 tx=0x7fa6ec02e000 comp rx=0 tx=0).stop 2024-05-30T16:44:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 msgr2=0x7fa6fc159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 0x7fa6fc159e30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400b9e0 tx=0x7fa6f400bea0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 shutdown_connections 2024-05-30T16:44:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6d806cad0 0x7fa6d806ef90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6fc15e960 0x7fa6fc159e30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc0cfbe0 0x7fa6fc155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 --2- 172.21.15.144:0/667209342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6fc0ba090 0x7fa6fc0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.925+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 >> 172.21.15.144:0/667209342 conn(0x7fa6fc0d1360 msgr2=0x7fa6fc15ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.926+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 shutdown_connections 2024-05-30T16:44:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:18.926+0000 7fa701a00640 1 -- 172.21.15.144:0/667209342 wait complete. 2024-05-30T16:44:23.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:24.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.153+0000 7fcf46a00640 1 Processor -- start 2024-05-30T16:44:24.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.154+0000 7fcf46a00640 1 -- start start 2024-05-30T16:44:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.155+0000 7fcf46a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400cb2f0 0x7fcf4015c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.155+0000 7fcf46a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf4015f780 con 0x7fcf400caf10 2024-05-30T16:44:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.155+0000 7fcf46a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf4015fa60 con 0x7fcf4015c780 2024-05-30T16:44:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.155+0000 7fcf46a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4015fd40 con 0x7fcf400cb2f0 2024-05-30T16:44:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf45600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcf400caf10 0x7fcf4015efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34032/0 (socket says 172.21.15.144:34032) 2024-05-30T16:44:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf45600640 1 -- 172.21.15.144:0/371890404 learned_addr learned my addr 172.21.15.144:0/371890404 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf44c00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400cb2f0 0x7fcf4015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:24.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627982787 0 0) 0x7fcf4015f780 con 0x7fcf400caf10 2024-05-30T16:44:24.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf28005730 con 0x7fcf400caf10 2024-05-30T16:44:24.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 70139922 0 0) 0x7fcf28005730 con 0x7fcf400caf10 2024-05-30T16:44:24.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400cb2f0 msgr2=0x7fcf4015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:24.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf3fe00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400cb2f0 0x7fcf4015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 >> v1:172.21.15.149:6789/0 conn(0x7fcf4015c780 legacy=0x7fcf400b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4015b950 con 0x7fcf400caf10 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fcf34001670 con 0x7fcf400caf10 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.156+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 >> v1:172.21.15.144:6789/0 conn(0x7fcf400caf10 legacy=0x7fcf4015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf3fe00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf28005bf0 0x7fcf28006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf3fe00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf28006a10 0x7fcf28006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf3fe00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400cb2f0 0x7fcf280073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4015fd40 con 0x7fcf28006a10 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2800dc80 con 0x7fcf28005bf0 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2800de80 con 0x7fcf400cb2f0 2024-05-30T16:44:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf44c00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf28006a10 0x7fcf28006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:24.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf44c00640 1 -- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400cb2f0 msgr2=0x7fcf280073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:24.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf44c00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400cb2f0 0x7fcf280073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:24.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf44c00640 1 -- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf28005bf0 msgr2=0x7fcf28006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:24.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf45600640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf28005bf0 0x7fcf28006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:24.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf44c00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf28005bf0 0x7fcf28006010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:24.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.157+0000 7fcf44c00640 1 -- 172.21.15.144:0/371890404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf28005730 con 0x7fcf28006a10 2024-05-30T16:44:24.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.158+0000 7fcf44c00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf28006a10 0x7fcf28006e90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009a90 tx=0x7fcf28007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411534c0aa210a80 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:24.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30036070 con 0x7fcf28006a10 2024-05-30T16:44:24.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf30031400 con 0x7fcf28006a10 2024-05-30T16:44:24.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf3fe00640 1 -- 172.21.15.144:0/371890404 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30009690 con 0x7fcf28006a10 2024-05-30T16:44:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf46a00640 1 -- 172.21.15.144:0/371890404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf28006a10 msgr2=0x7fcf28006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf46a00640 1 --2- 172.21.15.144:0/371890404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf28006a10 0x7fcf28006e90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009a90 tx=0x7fcf28007a40 comp rx=0 tx=0).stop 2024-05-30T16:44:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf46000640 1 -- 172.21.15.144:0/371890404 reap_dead start 2024-05-30T16:44:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf46a00640 1 -- 172.21.15.144:0/371890404 shutdown_connections 2024-05-30T16:44:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf46a00640 1 -- 172.21.15.144:0/371890404 >> 172.21.15.144:0/371890404 conn(0x7fcf400b20a0 msgr2=0x7fcf400b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf46a00640 1 -- 172.21.15.144:0/371890404 shutdown_connections 2024-05-30T16:44:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.159+0000 7fcf46a00640 1 -- 172.21.15.144:0/371890404 wait complete. 2024-05-30T16:44:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.161+0000 7fcf46a00640 1 Processor -- start 2024-05-30T16:44:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.161+0000 7fcf46a00640 1 -- start start 2024-05-30T16:44:24.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.162+0000 7fcf46a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf28006a10 0x7fcf40073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:24.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.162+0000 7fcf46a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4006ed30 0x7fcf4006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:24.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.162+0000 7fcf46a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40155290 0x7fcf40155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.162+0000 7fcf46a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf400cf8b0 con 0x7fcf4006ed30 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.162+0000 7fcf46a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcf400b3b60 con 0x7fcf40155290 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.162+0000 7fcf46a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcf400cfa30 con 0x7fcf28006a10 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf44c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4006ed30 0x7fcf4006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf44c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4006ed30 0x7fcf4006f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57750/0 (socket says 172.21.15.144:57750) 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf44c00640 1 -- 172.21.15.144:0/2151841195 learned_addr learned my addr 172.21.15.144:0/2151841195 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf46000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40155290 0x7fcf40155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf45600640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf28006a10 0x7fcf40073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf44c00640 1 -- 172.21.15.144:0/2151841195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf28006a10 msgr2=0x7fcf40073890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf44c00640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf28006a10 0x7fcf40073890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf44c00640 1 -- 172.21.15.144:0/2151841195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40155290 msgr2=0x7fcf40155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:24.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf44c00640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40155290 0x7fcf40155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.163+0000 7fcf44c00640 1 -- 172.21.15.144:0/2151841195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf400ad240 con 0x7fcf4006ed30 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.164+0000 7fcf44c00640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4006ed30 0x7fcf4006f1b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009a90 tx=0x7fcf30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.164+0000 7fcf3d600640 1 -- 172.21.15.144:0/2151841195 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30040020 con 0x7fcf4006ed30 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.164+0000 7fcf3d600640 1 -- 172.21.15.144:0/2151841195 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf30003bc0 con 0x7fcf4006ed30 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.164+0000 7fcf3d600640 1 -- 172.21.15.144:0/2151841195 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30036040 con 0x7fcf4006ed30 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.164+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf40155c80 con 0x7fcf4006ed30 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.164+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf400ad790 con 0x7fcf4006ed30 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.165+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf40075570 con 0x7fcf4006ed30 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.166+0000 7fcf3d600640 1 -- 172.21.15.144:0/2151841195 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7fcf30043020 con 0x7fcf4006ed30 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.167+0000 7fcf3d600640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf2406cad0 0x7fcf2406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:24.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.167+0000 7fcf3d600640 1 -- 172.21.15.144:0/2151841195 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fcf300ac2a0 con 0x7fcf4006ed30 2024-05-30T16:44:24.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.168+0000 7fcf45600640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf2406cad0 0x7fcf2406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:24.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.168+0000 7fcf45600640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf2406cad0 0x7fcf2406ef90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf34001200 tx=0x7fcf34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:24.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.172+0000 7fcf3d600640 1 -- 172.21.15.144:0/2151841195 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf3004a030 con 0x7fcf4006ed30 2024-05-30T16:44:24.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.451+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcf400b5000 con 0x7fcf4006ed30 2024-05-30T16:44:24.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.452+0000 7fcf3d600640 1 -- 172.21.15.144:0/2151841195 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2122 (secure 0 0 0) 0x7fcf300044e0 con 0x7fcf4006ed30 2024-05-30T16:44:24.453 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:24.453 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:24.453 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:24.453 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:24.453 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:24.453 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:24.453 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:24.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:24.454 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:24.454 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:24.454 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:24.454 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:24.454 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:24.454 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:24.454 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:24.454 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:24.454 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 176, 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:24.455 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:24.456 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:24.457 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2892, 2024-05-30T16:44:24.457 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 12005440938, 2024-05-30T16:44:24.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 24269168640, 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 748824944640, 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 107619596, 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 172980822, 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 26, 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 48 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:24.458 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:24.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:24.460 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout: "ff9f6066-74fc-4a5f-89fb-cf36a585c6d6": { 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 26.0 seconds before exiting (7s)\n [============================] ", 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:24.461 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:24.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf2406cad0 msgr2=0x7fcf2406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:24.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf2406cad0 0x7fcf2406ef90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf34001200 tx=0x7fcf34009040 comp rx=0 tx=0).stop 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4006ed30 msgr2=0x7fcf4006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4006ed30 0x7fcf4006f1b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009a90 tx=0x7fcf30004730 comp rx=0 tx=0).stop 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 shutdown_connections 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf2406cad0 0x7fcf2406ef90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40155290 0x7fcf40155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4006ed30 0x7fcf4006f1b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 --2- 172.21.15.144:0/2151841195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf28006a10 0x7fcf40073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.454+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 >> 172.21.15.144:0/2151841195 conn(0x7fcf400b20a0 msgr2=0x7fcf400cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.455+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 shutdown_connections 2024-05-30T16:44:24.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:24.455+0000 7fcf46a00640 1 -- 172.21.15.144:0/2151841195 wait complete. 2024-05-30T16:44:29.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:29.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.684+0000 7f2a44e00640 1 Processor -- start 2024-05-30T16:44:29.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.685+0000 7f2a44e00640 1 -- start start 2024-05-30T16:44:29.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.686+0000 7f2a44e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2a40145150 0x7f2a400cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:29.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.686+0000 7f2a44e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a400cfa70 0x7f2a4006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:29.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.686+0000 7f2a44e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a4006f610 0x7f2a40072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.686+0000 7f2a44e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2a400cfeb0 con 0x7f2a4006f610 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.686+0000 7f2a44e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2a4015f140 con 0x7f2a40145150 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.686+0000 7f2a44e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2a400d00f0 con 0x7f2a400cfa70 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a4006f610 0x7f2a40072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a4006f610 0x7f2a40072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54034/0 (socket says 172.21.15.144:54034) 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3e800640 1 -- 172.21.15.144:0/4236595036 learned_addr learned my addr 172.21.15.144:0/4236595036 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3de00640 1 --2- 172.21.15.144:0/4236595036 >> v2:172.21.15.149:3300/0 conn(0x7f2a40145150 0x7f2a400cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3d400640 1 --2- 172.21.15.144:0/4236595036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a400cfa70 0x7f2a4006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3e800640 1 -- 172.21.15.144:0/4236595036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a400cfa70 msgr2=0x7f2a4006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3e800640 1 --2- 172.21.15.144:0/4236595036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a400cfa70 0x7f2a4006f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3e800640 1 -- 172.21.15.144:0/4236595036 >> v2:172.21.15.149:3300/0 conn(0x7f2a40145150 msgr2=0x7f2a400cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3e800640 1 --2- 172.21.15.144:0/4236595036 >> v2:172.21.15.149:3300/0 conn(0x7f2a40145150 0x7f2a400cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.687+0000 7f2a3e800640 1 -- 172.21.15.144:0/4236595036 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4015f390 con 0x7f2a4006f610 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.688+0000 7f2a3e800640 1 --2- 172.21.15.144:0/4236595036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a4006f610 0x7f2a40072210 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2a400b3db0 tx=0x7f2a3802c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100d39df68706b39 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a3ca00640 1 -- 172.21.15.144:0/4236595036 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a38039070 con 0x7f2a4006f610 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a3ca00640 1 -- 172.21.15.144:0/4236595036 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a38009600 con 0x7f2a4006f610 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a3ca00640 1 -- 172.21.15.144:0/4236595036 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a380099f0 con 0x7f2a4006f610 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a44e00640 1 -- 172.21.15.144:0/4236595036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a4006f610 msgr2=0x7f2a40072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4236595036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a4006f610 0x7f2a40072210 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2a400b3db0 tx=0x7f2a3802c810 comp rx=0 tx=0).stop 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a44e00640 1 -- 172.21.15.144:0/4236595036 shutdown_connections 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4236595036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a4006f610 0x7f2a40072210 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4236595036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a400cfa70 0x7f2a4006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4236595036 >> v2:172.21.15.149:3300/0 conn(0x7f2a40145150 0x7f2a400cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.689+0000 7f2a44e00640 1 -- 172.21.15.144:0/4236595036 >> 172.21.15.144:0/4236595036 conn(0x7f2a4006bd00 msgr2=0x7f2a4006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.690+0000 7f2a44e00640 1 -- 172.21.15.144:0/4236595036 shutdown_connections 2024-05-30T16:44:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.690+0000 7f2a44e00640 1 -- 172.21.15.144:0/4236595036 wait complete. 2024-05-30T16:44:29.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.691+0000 7f2a44e00640 1 Processor -- start 2024-05-30T16:44:29.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.691+0000 7f2a44e00640 1 -- start start 2024-05-30T16:44:29.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.692+0000 7f2a44e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a4006f610 0x7f2a4015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:29.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.692+0000 7f2a44e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a400cfa70 0x7f2a4013fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:29.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.692+0000 7f2a44e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a40145150 0x7f2a40141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:29.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.692+0000 7f2a44e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a400b64f0 con 0x7f2a40145150 2024-05-30T16:44:29.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.692+0000 7f2a44e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4015f950 con 0x7f2a4006f610 2024-05-30T16:44:29.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.692+0000 7f2a44e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4015fe70 con 0x7f2a400cfa70 2024-05-30T16:44:29.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a3e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a40145150 0x7f2a40141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:29.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a3e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a40145150 0x7f2a40141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54046/0 (socket says 172.21.15.144:54046) 2024-05-30T16:44:29.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a3e800640 1 -- 172.21.15.144:0/4122830225 learned_addr learned my addr 172.21.15.144:0/4122830225 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:29.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a3e800640 1 -- 172.21.15.144:0/4122830225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a400cfa70 msgr2=0x7f2a4013fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:29.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a3e800640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a400cfa70 0x7f2a4013fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a3e800640 1 -- 172.21.15.144:0/4122830225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a4006f610 msgr2=0x7f2a4015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:29.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a3e800640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a4006f610 0x7f2a4015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a3e800640 1 -- 172.21.15.144:0/4122830225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4015e530 con 0x7f2a40145150 2024-05-30T16:44:29.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a3e800640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a40145150 0x7f2a40141db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2a3802c850 tx=0x7f2a38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:29.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.693+0000 7f2a36000640 1 -- 172.21.15.144:0/4122830225 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a38044070 con 0x7f2a40145150 2024-05-30T16:44:29.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.694+0000 7f2a36000640 1 -- 172.21.15.144:0/4122830225 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a38004040 con 0x7f2a40145150 2024-05-30T16:44:29.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.694+0000 7f2a36000640 1 -- 172.21.15.144:0/4122830225 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a38039070 con 0x7f2a40145150 2024-05-30T16:44:29.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.694+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4015e810 con 0x7f2a40145150 2024-05-30T16:44:29.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.694+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4015b0f0 con 0x7f2a40145150 2024-05-30T16:44:29.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.695+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4015eeb0 con 0x7f2a40145150 2024-05-30T16:44:29.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.696+0000 7f2a36000640 1 -- 172.21.15.144:0/4122830225 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7f2a38047070 con 0x7f2a40145150 2024-05-30T16:44:29.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.697+0000 7f2a36000640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2a1c06cad0 0x7f2a1c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:29.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.697+0000 7f2a36000640 1 -- 172.21.15.144:0/4122830225 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2a380ac6c0 con 0x7f2a40145150 2024-05-30T16:44:29.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.697+0000 7f2a3de00640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2a1c06cad0 0x7f2a1c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:29.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.698+0000 7f2a3de00640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2a1c06cad0 0x7f2a1c06ef90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2a300098f0 tx=0x7f2a30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:29.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.702+0000 7f2a36000640 1 -- 172.21.15.144:0/4122830225 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a4015eeb0 con 0x7f2a40145150 2024-05-30T16:44:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.968+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2a40068b90 con 0x7f2a40145150 2024-05-30T16:44:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.969+0000 7f2a36000640 1 -- 172.21.15.144:0/4122830225 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2121 (secure 0 0 0) 0x7f2a3807a750 con 0x7f2a40145150 2024-05-30T16:44:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:29.970 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:29.970 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 182, 2024-05-30T16:44:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2891, 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 12005462175, 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 24269201408, 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 748824911872, 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 78613934, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 80721464, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 19, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 23 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "ff9f6066-74fc-4a5f-89fb-cf36a585c6d6": { 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 20.0 seconds before exiting (13s)\n [============================] ", 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:44:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:44:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:29.977 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2a1c06cad0 msgr2=0x7f2a1c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2a1c06cad0 0x7f2a1c06ef90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2a300098f0 tx=0x7f2a30008040 comp rx=0 tx=0).stop 2024-05-30T16:44:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a40145150 msgr2=0x7f2a40141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a40145150 0x7f2a40141db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2a3802c850 tx=0x7f2a38004a40 comp rx=0 tx=0).stop 2024-05-30T16:44:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 shutdown_connections 2024-05-30T16:44:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2a1c06cad0 0x7f2a1c06ef90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a40145150 0x7f2a40141db0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a400cfa70 0x7f2a4013fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 --2- 172.21.15.144:0/4122830225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a4006f610 0x7f2a4015abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 >> 172.21.15.144:0/4122830225 conn(0x7f2a4006bd00 msgr2=0x7f2a400b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 shutdown_connections 2024-05-30T16:44:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:29.971+0000 7f2a44e00640 1 -- 172.21.15.144:0/4122830225 wait complete. 2024-05-30T16:44:34.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:35.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.203+0000 7fdda9600640 1 Processor -- start 2024-05-30T16:44:35.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.203+0000 7fdda9600640 1 -- start start 2024-05-30T16:44:35.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.205+0000 7fdda9600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdda415ea70 0x7fdda40d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:35.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.205+0000 7fdda9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda40d4560 0x7fdda4168520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:35.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.205+0000 7fdda9600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda40d1e10 con 0x7fdda40d29a0 2024-05-30T16:44:35.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.205+0000 7fdda9600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdda415ee50 con 0x7fdda415ea70 2024-05-30T16:44:35.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.205+0000 7fdda9600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdda40d15f0 con 0x7fdda40d4560 2024-05-30T16:44:35.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.205+0000 7fdda3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdda415ea70 0x7fdda40d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:35.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.205+0000 7fdda3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdda415ea70 0x7fdda40d18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59906/0 (socket says 172.21.15.144:59906) 2024-05-30T16:44:35.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.205+0000 7fdda3e00640 1 -- 172.21.15.144:0/1984501711 learned_addr learned my addr 172.21.15.144:0/1984501711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:35.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.206+0000 7fdda8c00640 1 --2- 172.21.15.144:0/1984501711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda40d4560 0x7fdda4168520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:35.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.206+0000 7fdda3e00640 1 -- 172.21.15.144:0/1984501711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda40d4560 msgr2=0x7fdda4168520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:35.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.206+0000 7fdda3e00640 1 --2- 172.21.15.144:0/1984501711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda40d4560 0x7fdda4168520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.206+0000 7fdda3e00640 1 -- 172.21.15.144:0/1984501711 >> v1:172.21.15.149:6789/0 conn(0x7fdda40d29a0 legacy=0x7fdda40d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:35.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.206+0000 7fdda3e00640 1 -- 172.21.15.144:0/1984501711 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda40d2e30 con 0x7fdda415ea70 2024-05-30T16:44:35.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.207+0000 7fdda3e00640 1 --2- 172.21.15.144:0/1984501711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 0x7fdda40d18d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdda408d510 tx=0x7fdd9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cf6bb72a161898 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:35.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.207+0000 7fdda2a00640 1 -- 172.21.15.144:0/1984501711 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94037070 con 0x7fdda415ea70 2024-05-30T16:44:35.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.207+0000 7fdda2a00640 1 -- 172.21.15.144:0/1984501711 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd94032440 con 0x7fdda415ea70 2024-05-30T16:44:35.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.207+0000 7fdda2a00640 1 -- 172.21.15.144:0/1984501711 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94032810 con 0x7fdda415ea70 2024-05-30T16:44:35.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.208+0000 7fdda9600640 1 -- 172.21.15.144:0/1984501711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 msgr2=0x7fdda40d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:35.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.208+0000 7fdda9600640 1 --2- 172.21.15.144:0/1984501711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 0x7fdda40d18d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdda408d510 tx=0x7fdd9402a1e0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.208+0000 7fdda9600640 1 -- 172.21.15.144:0/1984501711 shutdown_connections 2024-05-30T16:44:35.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.208+0000 7fdda9600640 1 --2- 172.21.15.144:0/1984501711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda40d4560 0x7fdda4168520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.208+0000 7fdda9600640 1 --2- 172.21.15.144:0/1984501711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 0x7fdda40d18d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.208+0000 7fdda9600640 1 -- 172.21.15.144:0/1984501711 >> 172.21.15.144:0/1984501711 conn(0x7fdda4062390 msgr2=0x7fdda40627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:35.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.208+0000 7fdda9600640 1 -- 172.21.15.144:0/1984501711 shutdown_connections 2024-05-30T16:44:35.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.208+0000 7fdda9600640 1 -- 172.21.15.144:0/1984501711 wait complete. 2024-05-30T16:44:35.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.210+0000 7fdda9600640 1 Processor -- start 2024-05-30T16:44:35.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.210+0000 7fdda9600640 1 -- start start 2024-05-30T16:44:35.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.211+0000 7fdda9600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdda40d4560 0x7fdda415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:35.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.211+0000 7fdda9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 0x7fdda415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:35.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.211+0000 7fdda9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda415c190 0x7fdda40cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:35.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.211+0000 7fdda9600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdda40d36d0 con 0x7fdda415ea70 2024-05-30T16:44:35.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.211+0000 7fdda9600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdda40d33f0 con 0x7fdda40d4560 2024-05-30T16:44:35.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.211+0000 7fdda9600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdda40d39b0 con 0x7fdda415c190 2024-05-30T16:44:35.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.211+0000 7fdda3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 0x7fdda415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:35.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.211+0000 7fdda3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 0x7fdda415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59908/0 (socket says 172.21.15.144:59908) 2024-05-30T16:44:35.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.211+0000 7fdda3400640 1 -- 172.21.15.144:0/436192128 learned_addr learned my addr 172.21.15.144:0/436192128 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:35.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdda8c00640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda415c190 0x7fdda40cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:35.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdda3400640 1 -- 172.21.15.144:0/436192128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda415c190 msgr2=0x7fdda40cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:35.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdda3e00640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdda40d4560 0x7fdda415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:35.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdda3400640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda415c190 0x7fdda40cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdda3400640 1 -- 172.21.15.144:0/436192128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdda40d4560 msgr2=0x7fdda415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:35.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdda3400640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdda40d4560 0x7fdda415f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdda3400640 1 -- 172.21.15.144:0/436192128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda415c7c0 con 0x7fdda415ea70 2024-05-30T16:44:35.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdda3400640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 0x7fdda415bc50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c7f0 tx=0x7fdd8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:35.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdd9be00640 1 -- 172.21.15.144:0/436192128 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c016020 con 0x7fdda415ea70 2024-05-30T16:44:35.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdd9be00640 1 -- 172.21.15.144:0/436192128 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00aa50 con 0x7fdda415ea70 2024-05-30T16:44:35.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda415caa0 con 0x7fdda415ea70 2024-05-30T16:44:35.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.212+0000 7fdd9be00640 1 -- 172.21.15.144:0/436192128 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00ae40 con 0x7fdda415ea70 2024-05-30T16:44:35.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.213+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda415d060 con 0x7fdda415ea70 2024-05-30T16:44:35.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.214+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda4073fb0 con 0x7fdda415ea70 2024-05-30T16:44:35.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.215+0000 7fdd9be00640 1 -- 172.21.15.144:0/436192128 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7fdd8c019020 con 0x7fdda415ea70 2024-05-30T16:44:35.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.215+0000 7fdd9be00640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdd8006caa0 0x7fdd8006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:35.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.216+0000 7fdd9be00640 1 -- 172.21.15.144:0/436192128 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fdd8c08bd10 con 0x7fdda415ea70 2024-05-30T16:44:35.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.216+0000 7fdda3e00640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdd8006caa0 0x7fdd8006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:35.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.217+0000 7fdda3e00640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdd8006caa0 0x7fdd8006ef60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdd94034000 tx=0x7fdd9402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:35.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.221+0000 7fdd9be00640 1 -- 172.21.15.144:0/436192128 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd8c091020 con 0x7fdda415ea70 2024-05-30T16:44:35.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.525+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdda40cf8b0 con 0x7fdda415ea70 2024-05-30T16:44:35.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.526+0000 7fdd9be00640 1 -- 172.21.15.144:0/436192128 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2109 (secure 0 0 0) 0x7fdd8c020070 con 0x7fdda415ea70 2024-05-30T16:44:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:35.526 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 187, 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2891, 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 12005463790, 2024-05-30T16:44:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 24269201408, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 748824911872, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 85, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 2303, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 1 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "ff9f6066-74fc-4a5f-89fb-cf36a585c6d6": { 2024-05-30T16:44:35.532 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 14.0 seconds before exiting (19s)\n [============================] ", 2024-05-30T16:44:35.533 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:44:35.533 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:44:35.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:35.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:35.533 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:35.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdd8006caa0 msgr2=0x7fdd8006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:35.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdd8006caa0 0x7fdd8006ef60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdd94034000 tx=0x7fdd9402e000 comp rx=0 tx=0).stop 2024-05-30T16:44:35.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 msgr2=0x7fdda415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:35.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 0x7fdda415bc50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c7f0 tx=0x7fdd8c00ccb0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 shutdown_connections 2024-05-30T16:44:35.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdd8006caa0 0x7fdd8006ef60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdda415c190 0x7fdda40cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdda415ea70 0x7fdda415bc50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 --2- 172.21.15.144:0/436192128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdda40d4560 0x7fdda415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:35.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 >> 172.21.15.144:0/436192128 conn(0x7fdda4062390 msgr2=0x7fdda415dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:35.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 shutdown_connections 2024-05-30T16:44:35.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:35.529+0000 7fdda9600640 1 -- 172.21.15.144:0/436192128 wait complete. 2024-05-30T16:44:40.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:40.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.761+0000 7fe899c00640 1 Processor -- start 2024-05-30T16:44:40.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.761+0000 7fe899c00640 1 -- start start 2024-05-30T16:44:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.762+0000 7fe899c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8940cc0b0 0x7fe89415d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.763+0000 7fe899c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe89415da70 con 0x7fe89406b8e0 2024-05-30T16:44:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.763+0000 7fe899c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe894160ec0 con 0x7fe89406fcf0 2024-05-30T16:44:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.763+0000 7fe899c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe8940ccd20 con 0x7fe8940cc0b0 2024-05-30T16:44:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.763+0000 7fe893e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8940cc0b0 0x7fe89415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.763+0000 7fe893400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe89406b8e0 0x7fe8941600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50690/0 (socket says 172.21.15.144:50690) 2024-05-30T16:44:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.763+0000 7fe893400640 1 -- 172.21.15.144:0/850075454 learned_addr learned my addr 172.21.15.144:0/850075454 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.763+0000 7fe893e00640 1 -- 172.21.15.144:0/850075454 >> v1:172.21.15.149:6789/0 conn(0x7fe89406fcf0 legacy=0x7fe8941607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.763+0000 7fe893e00640 1 -- 172.21.15.144:0/850075454 >> v1:172.21.15.144:6789/0 conn(0x7fe89406b8e0 legacy=0x7fe8941600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.763+0000 7fe893e00640 1 -- 172.21.15.144:0/850075454 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8940cd000 con 0x7fe8940cc0b0 2024-05-30T16:44:40.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.764+0000 7fe893e00640 1 --2- 172.21.15.144:0/850075454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8940cc0b0 0x7fe89415d530 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe8840097a0 tx=0x7fe88402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f17fe7fa47a1d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:40.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.765+0000 7fe892a00640 1 -- 172.21.15.144:0/850075454 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884037070 con 0x7fe8940cc0b0 2024-05-30T16:44:40.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.765+0000 7fe892a00640 1 -- 172.21.15.144:0/850075454 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88402ae50 con 0x7fe8940cc0b0 2024-05-30T16:44:40.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.765+0000 7fe892a00640 1 -- 172.21.15.144:0/850075454 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884032660 con 0x7fe8940cc0b0 2024-05-30T16:44:40.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.765+0000 7fe899c00640 1 -- 172.21.15.144:0/850075454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8940cc0b0 msgr2=0x7fe89415d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:40.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.765+0000 7fe899c00640 1 --2- 172.21.15.144:0/850075454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8940cc0b0 0x7fe89415d530 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe8840097a0 tx=0x7fe88402a140 comp rx=0 tx=0).stop 2024-05-30T16:44:40.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.765+0000 7fe899c00640 1 -- 172.21.15.144:0/850075454 shutdown_connections 2024-05-30T16:44:40.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.765+0000 7fe899c00640 1 --2- 172.21.15.144:0/850075454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8940cc0b0 0x7fe89415d530 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:40.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.765+0000 7fe899c00640 1 -- 172.21.15.144:0/850075454 >> 172.21.15.144:0/850075454 conn(0x7fe8940b20a0 msgr2=0x7fe8940b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:40.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.766+0000 7fe899c00640 1 -- 172.21.15.144:0/850075454 shutdown_connections 2024-05-30T16:44:40.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.766+0000 7fe899c00640 1 -- 172.21.15.144:0/850075454 wait complete. 2024-05-30T16:44:40.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.768+0000 7fe899c00640 1 Processor -- start 2024-05-30T16:44:40.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.768+0000 7fe899c00640 1 -- start start 2024-05-30T16:44:40.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.769+0000 7fe899c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe89406b8e0 0x7fe8940cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:40.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.769+0000 7fe899c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe89406fcf0 0x7fe894147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:40.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.769+0000 7fe899c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8940cc0b0 0x7fe8940afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:40.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.769+0000 7fe899c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8940cc9e0 con 0x7fe89406b8e0 2024-05-30T16:44:40.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.769+0000 7fe899c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe8940cd5c0 con 0x7fe8940cc0b0 2024-05-30T16:44:40.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.769+0000 7fe899c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe8940cc490 con 0x7fe89406fcf0 2024-05-30T16:44:40.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.769+0000 7fe893e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe89406b8e0 0x7fe8940cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:40.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.769+0000 7fe893e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe89406b8e0 0x7fe8940cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59924/0 (socket says 172.21.15.144:59924) 2024-05-30T16:44:40.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.769+0000 7fe893e00640 1 -- 172.21.15.144:0/1666720502 learned_addr learned my addr 172.21.15.144:0/1666720502 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe893e00640 1 -- 172.21.15.144:0/1666720502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe89406fcf0 msgr2=0x7fe894147640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe893e00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe89406fcf0 0x7fe894147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe893e00640 1 -- 172.21.15.144:0/1666720502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8940cc0b0 msgr2=0x7fe8940afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe893e00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8940cc0b0 0x7fe8940afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe893e00640 1 -- 172.21.15.144:0/1666720502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8940cf1e0 con 0x7fe89406b8e0 2024-05-30T16:44:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe893e00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe89406b8e0 0x7fe8940cebe0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe884000c00 tx=0x7fe8840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe88be00640 1 -- 172.21.15.144:0/1666720502 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884042070 con 0x7fe89406b8e0 2024-05-30T16:44:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe88be00640 1 -- 172.21.15.144:0/1666720502 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88403e670 con 0x7fe89406b8e0 2024-05-30T16:44:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe88be00640 1 -- 172.21.15.144:0/1666720502 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884037040 con 0x7fe89406b8e0 2024-05-30T16:44:40.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.770+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8940cf4c0 con 0x7fe89406b8e0 2024-05-30T16:44:40.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.771+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8940cfa80 con 0x7fe89406b8e0 2024-05-30T16:44:40.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.772+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe89406c230 con 0x7fe89406b8e0 2024-05-30T16:44:40.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.773+0000 7fe88be00640 1 -- 172.21.15.144:0/1666720502 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7fe884045070 con 0x7fe89406b8e0 2024-05-30T16:44:40.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.774+0000 7fe88be00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe87406caa0 0x7fe87406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:40.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.774+0000 7fe88be00640 1 -- 172.21.15.144:0/1666720502 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe8840ac8d0 con 0x7fe89406b8e0 2024-05-30T16:44:40.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.774+0000 7fe893400640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe87406caa0 0x7fe87406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.775+0000 7fe893400640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe87406caa0 0x7fe87406ef60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe880000f60 tx=0x7fe880007a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:40.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:40.778+0000 7fe88be00640 1 -- 172.21.15.144:0/1666720502 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe89406c230 con 0x7fe89406b8e0 2024-05-30T16:44:41.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.054+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe89406e400 con 0x7fe89406b8e0 2024-05-30T16:44:41.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.055+0000 7fe88be00640 1 -- 172.21.15.144:0/1666720502 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2079 (secure 0 0 0) 0x7fe89406e400 con 0x7fe89406b8e0 2024-05-30T16:44:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:41.055 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 193, 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2891, 2024-05-30T16:44:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 12005480334, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 24269225984, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 748824887296, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 1791, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "ff9f6066-74fc-4a5f-89fb-cf36a585c6d6": { 2024-05-30T16:44:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 10.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T16:44:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:44:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:44:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:41.062 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.057+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe87406caa0 msgr2=0x7fe87406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.057+0000 7fe899c00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe87406caa0 0x7fe87406ef60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe880000f60 tx=0x7fe880007a80 comp rx=0 tx=0).stop 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe89406b8e0 msgr2=0x7fe8940cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe89406b8e0 0x7fe8940cebe0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe884000c00 tx=0x7fe8840046c0 comp rx=0 tx=0).stop 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 shutdown_connections 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe87406caa0 0x7fe87406ef60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8940cc0b0 0x7fe8940afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe89406fcf0 0x7fe894147640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 --2- 172.21.15.144:0/1666720502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe89406b8e0 0x7fe8940cebe0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 >> 172.21.15.144:0/1666720502 conn(0x7fe8940b20a0 msgr2=0x7fe894155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:41.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 shutdown_connections 2024-05-30T16:44:41.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:41.058+0000 7fe899c00640 1 -- 172.21.15.144:0/1666720502 wait complete. 2024-05-30T16:44:45.878 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:44:45.886 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:44:46.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:46.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.286+0000 7ffa67200640 1 Processor -- start 2024-05-30T16:44:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.287+0000 7ffa67200640 1 -- start start 2024-05-30T16:44:46.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.288+0000 7ffa67200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffa680ba090 0x7ffa680cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:46.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.288+0000 7ffa67200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6815ed40 con 0x7ffa680cfa10 2024-05-30T16:44:46.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.288+0000 7ffa67200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa68162ca0 con 0x7ffa6815e960 2024-05-30T16:44:46.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.288+0000 7ffa67200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680cfe80 con 0x7ffa680ba090 2024-05-30T16:44:46.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.288+0000 7ffa65400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffa680ba090 0x7ffa680cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:46.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.288+0000 7ffa65400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffa680ba090 0x7ffa680cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42948/0 (socket says 172.21.15.144:42948) 2024-05-30T16:44:46.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.288+0000 7ffa66800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ffa680cfa10 0x7ffa680d32b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:59462/0 (socket says 172.21.15.144:59462) 2024-05-30T16:44:46.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.288+0000 7ffa65400640 1 -- 172.21.15.144:0/2244769269 learned_addr learned my addr 172.21.15.144:0/2244769269 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:46.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.289+0000 7ffa65400640 1 -- 172.21.15.144:0/2244769269 >> v1:172.21.15.149:6789/0 conn(0x7ffa6815e960 legacy=0x7ffa68162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:46.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.289+0000 7ffa65400640 1 -- 172.21.15.144:0/2244769269 >> v1:172.21.15.144:6789/0 conn(0x7ffa680cfa10 legacy=0x7ffa680d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:46.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.289+0000 7ffa65400640 1 -- 172.21.15.144:0/2244769269 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa68162f80 con 0x7ffa680ba090 2024-05-30T16:44:46.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.290+0000 7ffa65400640 1 --2- 172.21.15.144:0/2244769269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa680ba090 0x7ffa680cf4d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009e50 tx=0x7ffa5802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5890955f9666bd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:46.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.290+0000 7ffa64a00640 1 -- 172.21.15.144:0/2244769269 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58036070 con 0x7ffa680ba090 2024-05-30T16:44:46.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.290+0000 7ffa64a00640 1 -- 172.21.15.144:0/2244769269 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa58031600 con 0x7ffa680ba090 2024-05-30T16:44:46.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.290+0000 7ffa64a00640 1 -- 172.21.15.144:0/2244769269 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa580319d0 con 0x7ffa680ba090 2024-05-30T16:44:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.291+0000 7ffa67200640 1 -- 172.21.15.144:0/2244769269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa680ba090 msgr2=0x7ffa680cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.291+0000 7ffa67200640 1 --2- 172.21.15.144:0/2244769269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa680ba090 0x7ffa680cf4d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009e50 tx=0x7ffa5802a760 comp rx=0 tx=0).stop 2024-05-30T16:44:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.291+0000 7ffa67200640 1 -- 172.21.15.144:0/2244769269 shutdown_connections 2024-05-30T16:44:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.291+0000 7ffa67200640 1 --2- 172.21.15.144:0/2244769269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa680ba090 0x7ffa680cf4d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.291+0000 7ffa67200640 1 -- 172.21.15.144:0/2244769269 >> 172.21.15.144:0/2244769269 conn(0x7ffa680d1360 msgr2=0x7ffa680d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.291+0000 7ffa67200640 1 -- 172.21.15.144:0/2244769269 shutdown_connections 2024-05-30T16:44:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.291+0000 7ffa67200640 1 -- 172.21.15.144:0/2244769269 wait complete. 2024-05-30T16:44:46.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.293+0000 7ffa67200640 1 Processor -- start 2024-05-30T16:44:46.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.293+0000 7ffa67200640 1 -- start start 2024-05-30T16:44:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.294+0000 7ffa67200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa680ba090 0x7ffa68156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.294+0000 7ffa67200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa680cfa10 0x7ffa680cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.294+0000 7ffa67200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6815e960 0x7ffa68157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.294+0000 7ffa67200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680d2d90 con 0x7ffa6815e960 2024-05-30T16:44:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.294+0000 7ffa67200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680d2b40 con 0x7ffa680cfa10 2024-05-30T16:44:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.294+0000 7ffa67200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffa680b78a0 con 0x7ffa680ba090 2024-05-30T16:44:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.294+0000 7ffa66800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6815e960 0x7ffa68157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.294+0000 7ffa66800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6815e960 0x7ffa68157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42950/0 (socket says 172.21.15.144:42950) 2024-05-30T16:44:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.294+0000 7ffa66800640 1 -- 172.21.15.144:0/3166599599 learned_addr learned my addr 172.21.15.144:0/3166599599 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa66800640 1 -- 172.21.15.144:0/3166599599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa680ba090 msgr2=0x7ffa68156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa66800640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa680ba090 0x7ffa68156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa65400640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa680cfa10 0x7ffa680cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa66800640 1 -- 172.21.15.144:0/3166599599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa680cfa10 msgr2=0x7ffa680cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa66800640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa680cfa10 0x7ffa680cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa66800640 1 -- 172.21.15.144:0/3166599599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa681556f0 con 0x7ffa6815e960 2024-05-30T16:44:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa66800640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6815e960 0x7ffa68157c40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c430 tx=0x7ffa6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa5e000640 1 -- 172.21.15.144:0/3166599599 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa600074e0 con 0x7ffa6815e960 2024-05-30T16:44:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa5e000640 1 -- 172.21.15.144:0/3166599599 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60007680 con 0x7ffa6815e960 2024-05-30T16:44:46.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa5e000640 1 -- 172.21.15.144:0/3166599599 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa600049e0 con 0x7ffa6815e960 2024-05-30T16:44:46.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.295+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa68158380 con 0x7ffa6815e960 2024-05-30T16:44:46.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.296+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa681604b0 con 0x7ffa6815e960 2024-05-30T16:44:46.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.297+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6815ffc0 con 0x7ffa6815e960 2024-05-30T16:44:46.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.298+0000 7ffa5e000640 1 -- 172.21.15.144:0/3166599599 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7ffa6001a020 con 0x7ffa6815e960 2024-05-30T16:44:46.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.298+0000 7ffa5e000640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffa4406caa0 0x7ffa4406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:46.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.299+0000 7ffa5e000640 1 -- 172.21.15.144:0/3166599599 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ffa6008b6a0 con 0x7ffa6815e960 2024-05-30T16:44:46.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.299+0000 7ffa65e00640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffa4406caa0 0x7ffa4406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:46.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.299+0000 7ffa65e00640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffa4406caa0 0x7ffa4406ef60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffa50003cc0 tx=0x7ffa500079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:46.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.303+0000 7ffa5e000640 1 -- 172.21.15.144:0/3166599599 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa60059840 con 0x7ffa6815e960 2024-05-30T16:44:46.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.580+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ffa68075570 con 0x7ffa6815e960 2024-05-30T16:44:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.581+0000 7ffa5e000640 1 -- 172.21.15.144:0/3166599599 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7ffa60059140 con 0x7ffa6815e960 2024-05-30T16:44:46.582 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:46.582 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 198, 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2891, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 12005480334, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 24269234176, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 748824879104, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 1620, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "ff9f6066-74fc-4a5f-89fb-cf36a585c6d6": { 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 4.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T16:44:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:44:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:44:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:46.589 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffa4406caa0 msgr2=0x7ffa4406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffa4406caa0 0x7ffa4406ef60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffa50003cc0 tx=0x7ffa500079b0 comp rx=0 tx=0).stop 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6815e960 msgr2=0x7ffa68157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6815e960 0x7ffa68157c40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c430 tx=0x7ffa6000c8f0 comp rx=0 tx=0).stop 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 shutdown_connections 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffa4406caa0 0x7ffa4406ef60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6815e960 0x7ffa68157c40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa680cfa10 0x7ffa680cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 --2- 172.21.15.144:0/3166599599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa680ba090 0x7ffa68156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 >> 172.21.15.144:0/3166599599 conn(0x7ffa680d1360 msgr2=0x7ffa680d3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 shutdown_connections 2024-05-30T16:44:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:46.584+0000 7ffa67200640 1 -- 172.21.15.144:0/3166599599 wait complete. 2024-05-30T16:44:51.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:44:51.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.815+0000 7f3075e00640 1 Processor -- start 2024-05-30T16:44:51.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.816+0000 7f3075e00640 1 -- start start 2024-05-30T16:44:51.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.817+0000 7f3075e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30700cc0b0 0x7f307015d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:51.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.817+0000 7f3075e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f307006b8e0 0x7f307006bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:51.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.817+0000 7f3075e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307015da70 con 0x7f30701600a0 2024-05-30T16:44:51.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.817+0000 7f3075e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f30700ccd20 con 0x7f307006b8e0 2024-05-30T16:44:51.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.817+0000 7f3075e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f30700cd000 con 0x7f30700cc0b0 2024-05-30T16:44:51.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.817+0000 7f306fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f307006b8e0 0x7f307006bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:51.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.818+0000 7f306fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f307006b8e0 0x7f307006bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42952/0 (socket says 172.21.15.144:42952) 2024-05-30T16:44:51.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.818+0000 7f306fe00640 1 -- 172.21.15.144:0/2894416395 learned_addr learned my addr 172.21.15.144:0/2894416395 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:51.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.818+0000 7f3074a00640 1 --2- 172.21.15.144:0/2894416395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30700cc0b0 0x7f307015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:51.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.818+0000 7f306fe00640 1 -- 172.21.15.144:0/2894416395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30700cc0b0 msgr2=0x7f307015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:51.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.818+0000 7f306fe00640 1 --2- 172.21.15.144:0/2894416395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30700cc0b0 0x7f307015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:51.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.818+0000 7f306fe00640 1 -- 172.21.15.144:0/2894416395 >> v1:172.21.15.144:6789/0 conn(0x7f30701600a0 legacy=0x7f3070160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:51.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.818+0000 7f306fe00640 1 -- 172.21.15.144:0/2894416395 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30700cd2e0 con 0x7f307006b8e0 2024-05-30T16:44:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.819+0000 7f306fe00640 1 --2- 172.21.15.144:0/2894416395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307006b8e0 0x7f307006bd60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3058009870 tx=0x7f305802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2341edf5edd410ed server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.819+0000 7f306f400640 1 -- 172.21.15.144:0/2894416395 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058037070 con 0x7f307006b8e0 2024-05-30T16:44:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.819+0000 7f306f400640 1 -- 172.21.15.144:0/2894416395 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3058032440 con 0x7f307006b8e0 2024-05-30T16:44:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.819+0000 7f306f400640 1 -- 172.21.15.144:0/2894416395 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058032810 con 0x7f307006b8e0 2024-05-30T16:44:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.820+0000 7f3075e00640 1 -- 172.21.15.144:0/2894416395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307006b8e0 msgr2=0x7f307006bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:51.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.820+0000 7f3075e00640 1 --2- 172.21.15.144:0/2894416395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307006b8e0 0x7f307006bd60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3058009870 tx=0x7f305802a1c0 comp rx=0 tx=0).stop 2024-05-30T16:44:51.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.820+0000 7f3075e00640 1 -- 172.21.15.144:0/2894416395 shutdown_connections 2024-05-30T16:44:51.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.820+0000 7f3075e00640 1 --2- 172.21.15.144:0/2894416395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307006b8e0 0x7f307006bd60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:51.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.820+0000 7f3075e00640 1 --2- 172.21.15.144:0/2894416395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30700cc0b0 0x7f307015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:51.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.820+0000 7f3075e00640 1 -- 172.21.15.144:0/2894416395 >> 172.21.15.144:0/2894416395 conn(0x7f30700b20a0 msgr2=0x7f30700b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:51.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.820+0000 7f3075e00640 1 -- 172.21.15.144:0/2894416395 shutdown_connections 2024-05-30T16:44:51.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.820+0000 7f3075e00640 1 -- 172.21.15.144:0/2894416395 wait complete. 2024-05-30T16:44:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.822+0000 7f3075e00640 1 Processor -- start 2024-05-30T16:44:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.822+0000 7f3075e00640 1 -- start start 2024-05-30T16:44:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.823+0000 7f3075e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307006b8e0 0x7f3070146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.823+0000 7f3075e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700cc0b0 0x7f3070147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.823+0000 7f3075e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30701600a0 0x7f30701583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.823+0000 7f3075e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f30700cc490 con 0x7f30700cc0b0 2024-05-30T16:44:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.823+0000 7f3075e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f30700cc9e0 con 0x7f30701600a0 2024-05-30T16:44:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.823+0000 7f3075e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3070157310 con 0x7f307006b8e0 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.823+0000 7f306fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700cc0b0 0x7f3070147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.823+0000 7f306fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700cc0b0 0x7f3070147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42960/0 (socket says 172.21.15.144:42960) 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.823+0000 7f306fe00640 1 -- 172.21.15.144:0/3100420061 learned_addr learned my addr 172.21.15.144:0/3100420061 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f3074a00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307006b8e0 0x7f3070146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f306fe00640 1 -- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307006b8e0 msgr2=0x7f3070146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f306fe00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307006b8e0 0x7f3070146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f3075400640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30701600a0 0x7f30701583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f306fe00640 1 -- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30701600a0 msgr2=0x7f30701583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f306fe00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30701600a0 0x7f30701583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f306fe00640 1 -- 172.21.15.144:0/3100420061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30701575f0 con 0x7f30700cc0b0 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f3074a00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307006b8e0 0x7f3070146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f3075400640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30701600a0 0x7f30701583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.824+0000 7f306fe00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700cc0b0 0x7f3070147180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3058000c00 tx=0x7f30580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.825+0000 7f306cc00640 1 -- 172.21.15.144:0/3100420061 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058041020 con 0x7f30700cc0b0 2024-05-30T16:44:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.825+0000 7f306cc00640 1 -- 172.21.15.144:0/3100420061 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30580306c0 con 0x7f30700cc0b0 2024-05-30T16:44:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.825+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30701578d0 con 0x7f30700cc0b0 2024-05-30T16:44:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.825+0000 7f306cc00640 1 -- 172.21.15.144:0/3100420061 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058037040 con 0x7f30700cc0b0 2024-05-30T16:44:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.825+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3070146b50 con 0x7f30700cc0b0 2024-05-30T16:44:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.826+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3070075570 con 0x7f30700cc0b0 2024-05-30T16:44:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.827+0000 7f306cc00640 1 -- 172.21.15.144:0/3100420061 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7f3058044020 con 0x7f30700cc0b0 2024-05-30T16:44:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.828+0000 7f306cc00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f304c06caa0 0x7f304c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.828+0000 7f306cc00640 1 -- 172.21.15.144:0/3100420061 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f30580ac6d0 con 0x7f30700cc0b0 2024-05-30T16:44:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.828+0000 7f3074a00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f304c06caa0 0x7f304c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:51.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.829+0000 7f3074a00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f304c06caa0 0x7f304c06ef60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f307006c050 tx=0x7f306000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:51.833+0000 7f306cc00640 1 -- 172.21.15.144:0/3100420061 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f305804b030 con 0x7f30700cc0b0 2024-05-30T16:44:52.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.107+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f307015d850 con 0x7f30700cc0b0 2024-05-30T16:44:52.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.107+0000 7f306cc00640 1 -- 172.21.15.144:0/3100420061 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1821 (secure 0 0 0) 0x7f305807a870 con 0x7f30700cc0b0 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:44:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 204, 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:44:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 31, 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:44:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2891, 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 12005480334, 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 24269234176, 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 748824879104, 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 0, 2024-05-30T16:44:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 18, 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 2, 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 2, 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:44:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4749 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:44:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 5, 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:43:46.935941+0000", 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": {} 2024-05-30T16:44:52.115 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:44:52.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f304c06caa0 msgr2=0x7f304c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f304c06caa0 0x7f304c06ef60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f307006c050 tx=0x7f306000b040 comp rx=0 tx=0).stop 2024-05-30T16:44:52.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700cc0b0 msgr2=0x7f3070147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700cc0b0 0x7f3070147180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3058000c00 tx=0x7f30580046c0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 shutdown_connections 2024-05-30T16:44:52.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f304c06caa0 0x7f304c06ef60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30701600a0 0x7f30701583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700cc0b0 0x7f3070147180 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 --2- 172.21.15.144:0/3100420061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f307006b8e0 0x7f3070146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 >> 172.21.15.144:0/3100420061 conn(0x7f30700b20a0 msgr2=0x7f307015cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:52.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 shutdown_connections 2024-05-30T16:44:52.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.110+0000 7f3075e00640 1 -- 172.21.15.144:0/3100420061 wait complete. 2024-05-30T16:44:52.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T16:44:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.335+0000 7f563e400640 1 Processor -- start 2024-05-30T16:44:52.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.335+0000 7f563e400640 1 -- start start 2024-05-30T16:44:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.337+0000 7f563e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5638161f80 0x7f56380d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.337+0000 7f563e400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f56380d0210 0x7f56380b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.337+0000 7f563e400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56380cf060 con 0x7f56380b74d0 2024-05-30T16:44:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.337+0000 7f563e400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f56380b55d0 con 0x7f56380d0210 2024-05-30T16:44:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.337+0000 7f563e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f56380b5820 con 0x7f5638161f80 2024-05-30T16:44:52.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.338+0000 7f563da00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f56380d0210 0x7f56380b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.338+0000 7f563d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5638161f80 0x7f56380d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.338+0000 7f563da00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f56380d0210 0x7f56380b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:40082/0 (socket says 172.21.15.144:40082) 2024-05-30T16:44:52.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.338+0000 7f563d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5638161f80 0x7f56380d0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:38064/0 (socket says 172.21.15.144:38064) 2024-05-30T16:44:52.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.338+0000 7f563da00640 1 -- 172.21.15.144:0/3799873186 learned_addr learned my addr 172.21.15.144:0/3799873186 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:52.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.339+0000 7f563da00640 1 -- 172.21.15.144:0/3799873186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5638161f80 msgr2=0x7f56380d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:52.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.339+0000 7f563da00640 1 --2- 172.21.15.144:0/3799873186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5638161f80 0x7f56380d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.339+0000 7f563da00640 1 -- 172.21.15.144:0/3799873186 >> v1:172.21.15.149:6789/0 conn(0x7f56380b74d0 legacy=0x7f56380cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.339+0000 7f563da00640 1 -- 172.21.15.144:0/3799873186 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56380b5b00 con 0x7f56380d0210 2024-05-30T16:44:52.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.340+0000 7f563da00640 1 --2- 172.21.15.144:0/3799873186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56380d0210 0x7f56380b6100 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5630009870 tx=0x7f563002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=245373733433e0cd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.341+0000 7f5637400640 1 -- 172.21.15.144:0/3799873186 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630037070 con 0x7f56380d0210 2024-05-30T16:44:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.341+0000 7f5637400640 1 -- 172.21.15.144:0/3799873186 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5630032440 con 0x7f56380d0210 2024-05-30T16:44:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.341+0000 7f5637400640 1 -- 172.21.15.144:0/3799873186 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630032810 con 0x7f56380d0210 2024-05-30T16:44:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.342+0000 7f563e400640 1 -- 172.21.15.144:0/3799873186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56380d0210 msgr2=0x7f56380b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.342+0000 7f563e400640 1 --2- 172.21.15.144:0/3799873186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56380d0210 0x7f56380b6100 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5630009870 tx=0x7f563002a250 comp rx=0 tx=0).stop 2024-05-30T16:44:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.342+0000 7f563e400640 1 -- 172.21.15.144:0/3799873186 shutdown_connections 2024-05-30T16:44:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.342+0000 7f563e400640 1 --2- 172.21.15.144:0/3799873186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56380d0210 0x7f56380b6100 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.342+0000 7f563e400640 1 --2- 172.21.15.144:0/3799873186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5638161f80 0x7f56380d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.342+0000 7f563e400640 1 -- 172.21.15.144:0/3799873186 >> 172.21.15.144:0/3799873186 conn(0x7f563808bfc0 msgr2=0x7f56380d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.342+0000 7f563e400640 1 -- 172.21.15.144:0/3799873186 shutdown_connections 2024-05-30T16:44:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.342+0000 7f563e400640 1 -- 172.21.15.144:0/3799873186 wait complete. 2024-05-30T16:44:52.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.344+0000 7f563e400640 1 Processor -- start 2024-05-30T16:44:52.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.344+0000 7f563e400640 1 -- start start 2024-05-30T16:44:52.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.345+0000 7f563e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56380b74d0 0x7f563814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.345+0000 7f563e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56380d0210 0x7f56380cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.345+0000 7f563e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5638161f80 0x7f56380ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.345+0000 7f563e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f56380d5230 con 0x7f5638161f80 2024-05-30T16:44:52.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.345+0000 7f563e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f56380cf5e0 con 0x7f56380b74d0 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.345+0000 7f563e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5638162360 con 0x7f56380d0210 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f563da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5638161f80 0x7f56380ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f563da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5638161f80 0x7f56380ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42976/0 (socket says 172.21.15.144:42976) 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f563da00640 1 -- 172.21.15.144:0/4167264085 learned_addr learned my addr 172.21.15.144:0/4167264085 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f563d000640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56380b74d0 0x7f563814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f5637e00640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56380d0210 0x7f56380cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f563da00640 1 -- 172.21.15.144:0/4167264085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56380d0210 msgr2=0x7f56380cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f563da00640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56380d0210 0x7f56380cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f563da00640 1 -- 172.21.15.144:0/4167264085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56380b74d0 msgr2=0x7f563814fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f563da00640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56380b74d0 0x7f563814fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.346+0000 7f563da00640 1 -- 172.21.15.144:0/4167264085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56380cca20 con 0x7f5638161f80 2024-05-30T16:44:52.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.347+0000 7f563da00640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5638161f80 0x7f56380ca420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5630009870 tx=0x7f56300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:52.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.347+0000 7f5634c00640 1 -- 172.21.15.144:0/4167264085 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630041020 con 0x7f5638161f80 2024-05-30T16:44:52.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.347+0000 7f5634c00640 1 -- 172.21.15.144:0/4167264085 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563003d640 con 0x7f5638161f80 2024-05-30T16:44:52.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.347+0000 7f5634c00640 1 -- 172.21.15.144:0/4167264085 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630037040 con 0x7f5638161f80 2024-05-30T16:44:52.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.347+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56380cc180 con 0x7f5638161f80 2024-05-30T16:44:52.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.347+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56380cc740 con 0x7f5638161f80 2024-05-30T16:44:52.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.349+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5638075570 con 0x7f5638161f80 2024-05-30T16:44:52.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.350+0000 7f5634c00640 1 -- 172.21.15.144:0/4167264085 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7f5630044020 con 0x7f5638161f80 2024-05-30T16:44:52.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.351+0000 7f5634c00640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806cad0 0x7f561806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.351+0000 7f5634c00640 1 -- 172.21.15.144:0/4167264085 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f56300ac670 con 0x7f5638161f80 2024-05-30T16:44:52.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.351+0000 7f563d000640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806cad0 0x7f561806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.352+0000 7f563d000640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806cad0 0x7f561806ef90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56280073f0 tx=0x7f562800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:52.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.355+0000 7f5634c00640 1 -- 172.21.15.144:0/4167264085 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f563004b030 con 0x7f5638161f80 2024-05-30T16:44:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.588+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56380b6ca0 con 0x7f561806cad0 2024-05-30T16:44:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.598+0000 7f5634c00640 1 -- 172.21.15.144:0/4167264085 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7f56380b6ca0 con 0x7f561806cad0 2024-05-30T16:44:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:52.600 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:44:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sv1" 2024-05-30T16:44:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:44:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ss1clone1" 2024-05-30T16:44:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:52.601 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806cad0 msgr2=0x7f561806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806cad0 0x7f561806ef90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56280073f0 tx=0x7f562800b040 comp rx=0 tx=0).stop 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5638161f80 msgr2=0x7f56380ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5638161f80 0x7f56380ca420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5630009870 tx=0x7f56300046c0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 shutdown_connections 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806cad0 0x7f561806ef90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5638161f80 0x7f56380ca420 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56380d0210 0x7f56380cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 --2- 172.21.15.144:0/4167264085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56380b74d0 0x7f563814fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.601+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 >> 172.21.15.144:0/4167264085 conn(0x7f563808bfc0 msgr2=0x7f56380d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.602+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 shutdown_connections 2024-05-30T16:44:52.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.602+0000 7f563e400640 1 -- 172.21.15.144:0/4167264085 wait complete. 2024-05-30T16:44:52.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T16:44:52.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.823+0000 7f0007e00640 1 Processor -- start 2024-05-30T16:44:52.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.824+0000 7f0007e00640 1 -- start start 2024-05-30T16:44:52.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.825+0000 7f0007e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008146010 0x7f00081600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.825+0000 7f0007e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0008072470 0x7f00080cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.825+0000 7f0007e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0008160b90 con 0x7f0008160630 2024-05-30T16:44:52.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.826+0000 7f0007e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f0008160e70 con 0x7f0008072470 2024-05-30T16:44:52.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.826+0000 7f0007e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f00080cce00 con 0x7f0008146010 2024-05-30T16:44:52.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.826+0000 7f0006a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008146010 0x7f00081600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.826+0000 7f0007400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0008072470 0x7f00080cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.826+0000 7f0007400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0008072470 0x7f00080cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:40096/0 (socket says 172.21.15.144:40096) 2024-05-30T16:44:52.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.826+0000 7f0006a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008146010 0x7f00081600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:38076/0 (socket says 172.21.15.144:38076) 2024-05-30T16:44:52.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.826+0000 7f0007400640 1 -- 172.21.15.144:0/1661253188 learned_addr learned my addr 172.21.15.144:0/1661253188 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:52.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.827+0000 7f0006a00640 1 -- 172.21.15.144:0/1661253188 >> v2:172.21.15.149:3300/0 conn(0x7f0008072470 msgr2=0x7f00080cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:52.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.827+0000 7f0006a00640 1 --2- 172.21.15.144:0/1661253188 >> v2:172.21.15.149:3300/0 conn(0x7f0008072470 0x7f00080cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.827+0000 7f0006a00640 1 -- 172.21.15.144:0/1661253188 >> v1:172.21.15.149:6789/0 conn(0x7f0008160630 legacy=0x7f0008071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.827+0000 7f0006a00640 1 -- 172.21.15.144:0/1661253188 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00080cd0e0 con 0x7f0008146010 2024-05-30T16:44:52.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.828+0000 7f0006a00640 1 --2- 172.21.15.144:0/1661253188 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008146010 0x7f00081600f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efff80097a0 tx=0x7efff802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6e5379cc9bfe7e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:52.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.829+0000 7f0006000640 1 -- 172.21.15.144:0/1661253188 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8037070 con 0x7f0008146010 2024-05-30T16:44:52.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.829+0000 7f0006000640 1 -- 172.21.15.144:0/1661253188 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff8032440 con 0x7f0008146010 2024-05-30T16:44:52.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.829+0000 7f0006000640 1 -- 172.21.15.144:0/1661253188 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8032810 con 0x7f0008146010 2024-05-30T16:44:52.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.829+0000 7f0007e00640 1 -- 172.21.15.144:0/1661253188 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008146010 msgr2=0x7f00081600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.829+0000 7f0007e00640 1 --2- 172.21.15.144:0/1661253188 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008146010 0x7f00081600f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efff80097a0 tx=0x7efff802a180 comp rx=0 tx=0).stop 2024-05-30T16:44:52.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.830+0000 7f0007e00640 1 -- 172.21.15.144:0/1661253188 shutdown_connections 2024-05-30T16:44:52.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.830+0000 7f0007e00640 1 --2- 172.21.15.144:0/1661253188 >> v2:172.21.15.149:3300/0 conn(0x7f0008072470 0x7f00080cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.830+0000 7f0007e00640 1 --2- 172.21.15.144:0/1661253188 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008146010 0x7f00081600f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.830+0000 7f0007e00640 1 -- 172.21.15.144:0/1661253188 >> 172.21.15.144:0/1661253188 conn(0x7f00080b2160 msgr2=0x7f00080b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:52.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.830+0000 7f0007e00640 1 -- 172.21.15.144:0/1661253188 shutdown_connections 2024-05-30T16:44:52.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.830+0000 7f0007e00640 1 -- 172.21.15.144:0/1661253188 wait complete. 2024-05-30T16:44:52.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.832+0000 7f0007e00640 1 Processor -- start 2024-05-30T16:44:52.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.832+0000 7f0007e00640 1 -- start start 2024-05-30T16:44:52.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7f0007e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008072470 0x7f000815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7f0007e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0008146010 0x7f000815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7f0007e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0008160630 0x7f000815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7f0007e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f000815cea0 con 0x7f0008146010 2024-05-30T16:44:52.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7f0007e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f000815cd20 con 0x7f0008160630 2024-05-30T16:44:52.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7f0007e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f00080cde20 con 0x7f0008072470 2024-05-30T16:44:52.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7effffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0008146010 0x7f000815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7effffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0008146010 0x7f000815ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42986/0 (socket says 172.21.15.144:42986) 2024-05-30T16:44:52.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7effffe00640 1 -- 172.21.15.144:0/2178874022 learned_addr learned my addr 172.21.15.144:0/2178874022 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:52.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.833+0000 7f0006a00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008072470 0x7f000815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7f0007400640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0008160630 0x7f000815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7effffe00640 1 -- 172.21.15.144:0/2178874022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008072470 msgr2=0x7f000815bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7effffe00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008072470 0x7f000815bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7effffe00640 1 -- 172.21.15.144:0/2178874022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0008160630 msgr2=0x7f000815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:52.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7effffe00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0008160630 0x7f000815f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:52.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7effffe00640 1 -- 172.21.15.144:0/2178874022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000813f890 con 0x7f0008146010 2024-05-30T16:44:52.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7effffe00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0008146010 0x7f000815ecb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efff000c3f0 tx=0x7efff000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:52.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7efffea00640 1 -- 172.21.15.144:0/2178874022 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff00052d0 con 0x7f0008146010 2024-05-30T16:44:52.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7efffea00640 1 -- 172.21.15.144:0/2178874022 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff0005490 con 0x7f0008146010 2024-05-30T16:44:52.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7efffea00640 1 -- 172.21.15.144:0/2178874022 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0007260 con 0x7f0008146010 2024-05-30T16:44:52.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000815c060 con 0x7f0008146010 2024-05-30T16:44:52.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.834+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00080b37b0 con 0x7f0008146010 2024-05-30T16:44:52.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.836+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0008075570 con 0x7f0008146010 2024-05-30T16:44:52.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.837+0000 7efffea00640 1 -- 172.21.15.144:0/2178874022 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7efff0007400 con 0x7f0008146010 2024-05-30T16:44:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.838+0000 7efffea00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7effe406caa0 0x7effe406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.838+0000 7efffea00640 1 -- 172.21.15.144:0/2178874022 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7efff008b430 con 0x7f0008146010 2024-05-30T16:44:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.838+0000 7f0006a00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7effe406caa0 0x7effe406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.839+0000 7f0006a00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7effe406caa0 0x7effe406ef60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efff8034000 tx=0x7efff802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:52.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:52.842+0000 7efffea00640 1 -- 172.21.15.144:0/2178874022 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efff0059540 con 0x7f0008146010 2024-05-30T16:44:53.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.067+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0008072dc0 con 0x7effe406caa0 2024-05-30T16:44:53.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.094+0000 7efffea00640 1 -- 172.21.15.144:0/2178874022 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f0008072dc0 con 0x7effe406caa0 2024-05-30T16:44:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:53.096 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:44:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:44:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ss1" 2024-05-30T16:44:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:44:53.096 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:44:53.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7effe406caa0 msgr2=0x7effe406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7effe406caa0 0x7effe406ef60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efff8034000 tx=0x7efff802e000 comp rx=0 tx=0).stop 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0008146010 msgr2=0x7f000815ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0008146010 0x7f000815ecb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efff000c3f0 tx=0x7efff000c8b0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 shutdown_connections 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7effe406caa0 0x7effe406ef60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0008160630 0x7f000815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0008146010 0x7f000815ecb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 --2- 172.21.15.144:0/2178874022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0008072470 0x7f000815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 >> 172.21.15.144:0/2178874022 conn(0x7f00080b2160 msgr2=0x7f00080b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 shutdown_connections 2024-05-30T16:44:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.097+0000 7f0007e00640 1 -- 172.21.15.144:0/2178874022 wait complete. 2024-05-30T16:44:53.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T16:44:53.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.313+0000 7fb168e00640 1 Processor -- start 2024-05-30T16:44:53.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.313+0000 7fb168e00640 1 -- start start 2024-05-30T16:44:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.315+0000 7fb168e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1641605a0 0x7fb1640b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.315+0000 7fb168e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb16415dcf0 con 0x7fb16406f010 2024-05-30T16:44:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.315+0000 7fb168e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb16415cf30 con 0x7fb164160980 2024-05-30T16:44:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.315+0000 7fb168e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1640b0730 con 0x7fb1641605a0 2024-05-30T16:44:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.315+0000 7fb162800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb16406f010 0x7fb164152ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:59486/0 (socket says 172.21.15.144:59486) 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.315+0000 7fb162800640 1 -- 172.21.15.144:0/3889930016 learned_addr learned my addr 172.21.15.144:0/3889930016 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb161e00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1641605a0 0x7fb1640b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4055821716 0 0) 0x7fb16415dcf0 con 0x7fb16406f010 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb148003520 con 0x7fb16406f010 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3093117364 0 0) 0x7fb148003520 con 0x7fb16406f010 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1641605a0 msgr2=0x7fb1640b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1641605a0 0x7fb1640b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 >> v1:172.21.15.149:6789/0 conn(0x7fb164160980 legacy=0x7fb16406e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16415d210 con 0x7fb16406f010 2024-05-30T16:44:53.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fb15c0019f0 con 0x7fb16406f010 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 >> v1:172.21.15.144:6789/0 conn(0x7fb16406f010 legacy=0x7fb164152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1480039e0 0x7fb148003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1641605a0 0x7fb148004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148004d40 0x7fb1480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1640b0730 con 0x7fb1480039e0 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb14800ba70 con 0x7fb148004d40 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.316+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb14800bc70 con 0x7fb1641605a0 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb161e00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1480039e0 0x7fb148003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb161400640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1641605a0 0x7fb148004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb162800640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148004d40 0x7fb1480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb161e00640 1 -- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1641605a0 msgr2=0x7fb148004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb161e00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1641605a0 0x7fb148004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb161e00640 1 -- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148004d40 msgr2=0x7fb1480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:53.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb161e00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148004d40 0x7fb1480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb161e00640 1 -- 172.21.15.144:0/3889930016 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb148003520 con 0x7fb1480039e0 2024-05-30T16:44:53.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb161400640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1641605a0 0x7fb148004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:53.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.317+0000 7fb162800640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148004d40 0x7fb1480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:53.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.318+0000 7fb161e00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1480039e0 0x7fb148003e00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb154009a90 tx=0x7fb148005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208f0e5f1db56928 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:53.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.318+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154036070 con 0x7fb1480039e0 2024-05-30T16:44:53.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.318+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb154031400 con 0x7fb1480039e0 2024-05-30T16:44:53.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.318+0000 7fb160a00640 1 -- 172.21.15.144:0/3889930016 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154009690 con 0x7fb1480039e0 2024-05-30T16:44:53.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.319+0000 7fb168e00640 1 -- 172.21.15.144:0/3889930016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1480039e0 msgr2=0x7fb148003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.319+0000 7fb168e00640 1 --2- 172.21.15.144:0/3889930016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1480039e0 0x7fb148003e00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb154009a90 tx=0x7fb148005830 comp rx=0 tx=0).stop 2024-05-30T16:44:53.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.319+0000 7fb162800640 1 -- 172.21.15.144:0/3889930016 reap_dead start 2024-05-30T16:44:53.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.319+0000 7fb168e00640 1 -- 172.21.15.144:0/3889930016 shutdown_connections 2024-05-30T16:44:53.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.319+0000 7fb168e00640 1 -- 172.21.15.144:0/3889930016 >> 172.21.15.144:0/3889930016 conn(0x7fb1640d10a0 msgr2=0x7fb1640d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:53.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.319+0000 7fb168e00640 1 -- 172.21.15.144:0/3889930016 shutdown_connections 2024-05-30T16:44:53.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.319+0000 7fb168e00640 1 -- 172.21.15.144:0/3889930016 wait complete. 2024-05-30T16:44:53.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.321+0000 7fb168e00640 1 Processor -- start 2024-05-30T16:44:53.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.321+0000 7fb168e00640 1 -- start start 2024-05-30T16:44:53.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.322+0000 7fb168e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1480039e0 0x7fb1641577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.322+0000 7fb168e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb16415e550 0x7fb16415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.322+0000 7fb168e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1641481e0 0x7fb164148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.322+0000 7fb168e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb16406c8f0 con 0x7fb1641481e0 2024-05-30T16:44:53.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.322+0000 7fb168e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb16415d7d0 con 0x7fb1480039e0 2024-05-30T16:44:53.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.322+0000 7fb168e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb164160dc0 con 0x7fb16415e550 2024-05-30T16:44:53.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.322+0000 7fb162800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1641481e0 0x7fb164148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.322+0000 7fb162800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1641481e0 0x7fb164148640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43014/0 (socket says 172.21.15.144:43014) 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.322+0000 7fb162800640 1 -- 172.21.15.144:0/1694353416 learned_addr learned my addr 172.21.15.144:0/1694353416 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb162800640 1 -- 172.21.15.144:0/1694353416 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb16415e550 msgr2=0x7fb16415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb162800640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb16415e550 0x7fb16415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb162800640 1 -- 172.21.15.144:0/1694353416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1480039e0 msgr2=0x7fb1641577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb162800640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1480039e0 0x7fb1641577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb162800640 1 -- 172.21.15.144:0/1694353416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb164148b80 con 0x7fb1641481e0 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb162800640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1641481e0 0x7fb164148640 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb1640b6010 tx=0x7fb15c00b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb15a000640 1 -- 172.21.15.144:0/1694353416 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00b870 con 0x7fb1641481e0 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb15a000640 1 -- 172.21.15.144:0/1694353416 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15c00ba10 con 0x7fb1641481e0 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb15a000640 1 -- 172.21.15.144:0/1694353416 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00bde0 con 0x7fb1641481e0 2024-05-30T16:44:53.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb164156900 con 0x7fb1641481e0 2024-05-30T16:44:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.323+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16415f440 con 0x7fb1641481e0 2024-05-30T16:44:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.324+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb164068b90 con 0x7fb1641481e0 2024-05-30T16:44:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.325+0000 7fb15a000640 1 -- 172.21.15.144:0/1694353416 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7fb15c01b020 con 0x7fb1641481e0 2024-05-30T16:44:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.326+0000 7fb15a000640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb14406cad0 0x7fb14406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.326+0000 7fb15a000640 1 -- 172.21.15.144:0/1694353416 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb15c08bfe0 con 0x7fb1641481e0 2024-05-30T16:44:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.326+0000 7fb161e00640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb14406cad0 0x7fb14406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.327+0000 7fb161e00640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb14406cad0 0x7fb14406ef90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb154033000 tx=0x7fb15402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.331+0000 7fb15a000640 1 -- 172.21.15.144:0/1694353416 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb164156900 con 0x7fb1641481e0 2024-05-30T16:44:53.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.570+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1641e9030 con 0x7fb14406cad0 2024-05-30T16:44:53.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.640+0000 7fb15a000640 1 -- 172.21.15.144:0/1694353416 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb1641e9030 con 0x7fb14406cad0 2024-05-30T16:44:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:53.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb14406cad0 msgr2=0x7fb14406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb14406cad0 0x7fb14406ef90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb154033000 tx=0x7fb15402e000 comp rx=0 tx=0).stop 2024-05-30T16:44:53.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1641481e0 msgr2=0x7fb164148640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1641481e0 0x7fb164148640 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb1640b6010 tx=0x7fb15c00b0d0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 shutdown_connections 2024-05-30T16:44:53.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb14406cad0 0x7fb14406ef90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1641481e0 0x7fb164148640 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb16415e550 0x7fb16415e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 --2- 172.21.15.144:0/1694353416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1480039e0 0x7fb1641577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.644+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 >> 172.21.15.144:0/1694353416 conn(0x7fb1640d10a0 msgr2=0x7fb1640b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:53.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.645+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 shutdown_connections 2024-05-30T16:44:53.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.645+0000 7fb168e00640 1 -- 172.21.15.144:0/1694353416 wait complete. 2024-05-30T16:44:53.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T16:44:53.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.868+0000 7fe13e200640 1 Processor -- start 2024-05-30T16:44:53.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.868+0000 7fe13e200640 1 -- start start 2024-05-30T16:44:53.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe138145f10 0x7fe1380cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13e200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe13806c3d0 0x7fe138160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1381607c0 0x7fe13815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13e200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe138160c50 con 0x7fe1381607c0 2024-05-30T16:44:53.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13e200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe138161100 con 0x7fe13806c3d0 2024-05-30T16:44:53.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe13806c810 con 0x7fe138145f10 2024-05-30T16:44:53.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13d800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1381607c0 0x7fe13815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13d800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1381607c0 0x7fe13815cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43026/0 (socket says 172.21.15.144:43026) 2024-05-30T16:44:53.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13d800640 1 -- 172.21.15.144:0/3275833361 learned_addr learned my addr 172.21.15.144:0/3275833361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:53.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe137e00640 1 --2- 172.21.15.144:0/3275833361 >> v2:172.21.15.149:3300/0 conn(0x7fe13806c3d0 0x7fe138160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.870+0000 7fe13ce00640 1 --2- 172.21.15.144:0/3275833361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe138145f10 0x7fe1380cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.871+0000 7fe13d800640 1 -- 172.21.15.144:0/3275833361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe138145f10 msgr2=0x7fe1380cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:53.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.871+0000 7fe13d800640 1 --2- 172.21.15.144:0/3275833361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe138145f10 0x7fe1380cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.871+0000 7fe13d800640 1 -- 172.21.15.144:0/3275833361 >> v2:172.21.15.149:3300/0 conn(0x7fe13806c3d0 msgr2=0x7fe138160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:53.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.871+0000 7fe13d800640 1 --2- 172.21.15.144:0/3275833361 >> v2:172.21.15.149:3300/0 conn(0x7fe13806c3d0 0x7fe138160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.871+0000 7fe13d800640 1 -- 172.21.15.144:0/3275833361 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1380cd3e0 con 0x7fe1381607c0 2024-05-30T16:44:53.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.872+0000 7fe13d800640 1 --2- 172.21.15.144:0/3275833361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1381607c0 0x7fe13815cd30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe13806dc80 tx=0x7fe13002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67de6f9ad997aa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:53.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.872+0000 7fe137400640 1 -- 172.21.15.144:0/3275833361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130036070 con 0x7fe1381607c0 2024-05-30T16:44:53.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.872+0000 7fe137400640 1 -- 172.21.15.144:0/3275833361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe130031600 con 0x7fe1381607c0 2024-05-30T16:44:53.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.872+0000 7fe137400640 1 -- 172.21.15.144:0/3275833361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1300319d0 con 0x7fe1381607c0 2024-05-30T16:44:53.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.873+0000 7fe13e200640 1 -- 172.21.15.144:0/3275833361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1381607c0 msgr2=0x7fe13815cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.873+0000 7fe13e200640 1 --2- 172.21.15.144:0/3275833361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1381607c0 0x7fe13815cd30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe13806dc80 tx=0x7fe13002a6c0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.873+0000 7fe13e200640 1 -- 172.21.15.144:0/3275833361 shutdown_connections 2024-05-30T16:44:53.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.873+0000 7fe13e200640 1 --2- 172.21.15.144:0/3275833361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1381607c0 0x7fe13815cd30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.873+0000 7fe13e200640 1 --2- 172.21.15.144:0/3275833361 >> v2:172.21.15.149:3300/0 conn(0x7fe13806c3d0 0x7fe138160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.873+0000 7fe13e200640 1 --2- 172.21.15.144:0/3275833361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe138145f10 0x7fe1380cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.873+0000 7fe13e200640 1 -- 172.21.15.144:0/3275833361 >> 172.21.15.144:0/3275833361 conn(0x7fe13806b8e0 msgr2=0x7fe13806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:53.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.873+0000 7fe13e200640 1 -- 172.21.15.144:0/3275833361 shutdown_connections 2024-05-30T16:44:53.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.873+0000 7fe13e200640 1 -- 172.21.15.144:0/3275833361 wait complete. 2024-05-30T16:44:53.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.874+0000 7fe13e200640 1 Processor -- start 2024-05-30T16:44:53.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.875+0000 7fe13e200640 1 -- start start 2024-05-30T16:44:53.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.875+0000 7fe13e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe13806c3d0 0x7fe1380b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe13e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe138145f10 0x7fe13806eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe13e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1381607c0 0x7fe1381f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe13e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe1380cdc80 con 0x7fe138145f10 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe13e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1380cd9a0 con 0x7fe1381607c0 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe13e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe1380cdf60 con 0x7fe13806c3d0 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe137e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe138145f10 0x7fe13806eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe137e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe138145f10 0x7fe13806eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43030/0 (socket says 172.21.15.144:43030) 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe137e00640 1 -- 172.21.15.144:0/275693375 learned_addr learned my addr 172.21.15.144:0/275693375 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe13ce00640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe13806c3d0 0x7fe1380b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe13d800640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1381607c0 0x7fe1381f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe137e00640 1 -- 172.21.15.144:0/275693375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe13806c3d0 msgr2=0x7fe1380b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe137e00640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe13806c3d0 0x7fe1380b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe137e00640 1 -- 172.21.15.144:0/275693375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1381607c0 msgr2=0x7fe1381f7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:53.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe137e00640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1381607c0 0x7fe1381f7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:53.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe137e00640 1 -- 172.21.15.144:0/275693375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1381f86a0 con 0x7fe138145f10 2024-05-30T16:44:53.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.876+0000 7fe13d800640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1381607c0 0x7fe1381f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:53.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.877+0000 7fe137e00640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe138145f10 0x7fe13806eff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe12400d800 tx=0x7fe12400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:53.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.877+0000 7fe134c00640 1 -- 172.21.15.144:0/275693375 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124018020 con 0x7fe138145f10 2024-05-30T16:44:53.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.877+0000 7fe134c00640 1 -- 172.21.15.144:0/275693375 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1240096a0 con 0x7fe138145f10 2024-05-30T16:44:53.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.877+0000 7fe134c00640 1 -- 172.21.15.144:0/275693375 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124009a70 con 0x7fe138145f10 2024-05-30T16:44:53.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.877+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1380b4650 con 0x7fe138145f10 2024-05-30T16:44:53.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.877+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe138140d30 con 0x7fe138145f10 2024-05-30T16:44:53.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.878+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe138075570 con 0x7fe138145f10 2024-05-30T16:44:53.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.879+0000 7fe134c00640 1 -- 172.21.15.144:0/275693375 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7fe12401b020 con 0x7fe138145f10 2024-05-30T16:44:53.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.880+0000 7fe134c00640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11806caa0 0x7fe11806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:53.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.880+0000 7fe134c00640 1 -- 172.21.15.144:0/275693375 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe12408c240 con 0x7fe138145f10 2024-05-30T16:44:53.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.880+0000 7fe13ce00640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11806caa0 0x7fe11806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:53.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.881+0000 7fe13ce00640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11806caa0 0x7fe11806ef60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe12c006fd0 tx=0x7fe12c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:53.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:53.884+0000 7fe134c00640 1 -- 172.21.15.144:0/275693375 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe124022030 con 0x7fe138145f10 2024-05-30T16:44:54.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.097+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fe1380b1dd0 con 0x7fe11806caa0 2024-05-30T16:44:54.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.141+0000 7fe134c00640 1 -- 172.21.15.144:0/275693375 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe1380b1dd0 con 0x7fe11806caa0 2024-05-30T16:44:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.143+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11806caa0 msgr2=0x7fe11806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.143+0000 7fe13e200640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11806caa0 0x7fe11806ef60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe12c006fd0 tx=0x7fe12c008040 comp rx=0 tx=0).stop 2024-05-30T16:44:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe138145f10 msgr2=0x7fe13806eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe138145f10 0x7fe13806eff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe12400d800 tx=0x7fe12400dcc0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 shutdown_connections 2024-05-30T16:44:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe11806caa0 0x7fe11806ef60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1381607c0 0x7fe1381f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe138145f10 0x7fe13806eff0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 --2- 172.21.15.144:0/275693375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe13806c3d0 0x7fe1380b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 >> 172.21.15.144:0/275693375 conn(0x7fe13806b8e0 msgr2=0x7fe1380aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 shutdown_connections 2024-05-30T16:44:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.144+0000 7fe13e200640 1 -- 172.21.15.144:0/275693375 wait complete. 2024-05-30T16:44:54.149 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.148+0000 7fe1cc400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.149 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.148+0000 7fe1cc400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.149 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.148+0000 7fe1cc400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.149 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.148+0000 7fe1cc400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.150 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.148+0000 7fe1cc400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-05-30T16:44:54.176 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.175+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.177 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.175+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.177 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.175+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.177 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.175+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.177 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:44:54.175+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:44:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.338+0000 7f89f9200640 1 Processor -- start 2024-05-30T16:44:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.338+0000 7f89f9200640 1 -- start start 2024-05-30T16:44:54.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.339+0000 7f89f9200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f89f40b7060 0x7f89f406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.339+0000 7f89f9200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f40b45d0 con 0x7f89f4070d70 2024-05-30T16:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.339+0000 7f89f9200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f40b48b0 con 0x7f89f415ea90 2024-05-30T16:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.339+0000 7f89f9200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f89f4070180 con 0x7f89f40b7060 2024-05-30T16:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.340+0000 7f89f2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f89f40b7060 0x7f89f406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.340+0000 7f89f2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f89f40b7060 0x7f89f406efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43080/0 (socket says 172.21.15.144:43080) 2024-05-30T16:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.340+0000 7f89f2800640 1 -- 172.21.15.144:0/3150201052 learned_addr learned my addr 172.21.15.144:0/3150201052 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.340+0000 7f89f2800640 1 -- 172.21.15.144:0/3150201052 >> v1:172.21.15.149:6789/0 conn(0x7f89f415ea90 legacy=0x7f89f40b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.340+0000 7f89f2800640 1 -- 172.21.15.144:0/3150201052 >> v1:172.21.15.144:6789/0 conn(0x7f89f4070d70 legacy=0x7f89f40b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.340+0000 7f89f2800640 1 -- 172.21.15.144:0/3150201052 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f40b62c0 con 0x7f89f40b7060 2024-05-30T16:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.341+0000 7f89f2800640 1 --2- 172.21.15.144:0/3150201052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f40b7060 0x7f89f406efc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009e50 tx=0x7f89ec02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec958b04e964557 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.341+0000 7f89f0a00640 1 -- 172.21.15.144:0/3150201052 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec036070 con 0x7f89f40b7060 2024-05-30T16:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.341+0000 7f89f0a00640 1 -- 172.21.15.144:0/3150201052 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ec031600 con 0x7f89f40b7060 2024-05-30T16:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.341+0000 7f89f0a00640 1 -- 172.21.15.144:0/3150201052 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0319d0 con 0x7f89f40b7060 2024-05-30T16:44:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.342+0000 7f89f9200640 1 -- 172.21.15.144:0/3150201052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f40b7060 msgr2=0x7f89f406efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.342+0000 7f89f9200640 1 --2- 172.21.15.144:0/3150201052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f40b7060 0x7f89f406efc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009e50 tx=0x7f89ec02a640 comp rx=0 tx=0).stop 2024-05-30T16:44:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.342+0000 7f89f9200640 1 -- 172.21.15.144:0/3150201052 shutdown_connections 2024-05-30T16:44:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.342+0000 7f89f9200640 1 --2- 172.21.15.144:0/3150201052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f40b7060 0x7f89f406efc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.342+0000 7f89f9200640 1 -- 172.21.15.144:0/3150201052 >> 172.21.15.144:0/3150201052 conn(0x7f89f4073460 msgr2=0x7f89f409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.342+0000 7f89f9200640 1 -- 172.21.15.144:0/3150201052 shutdown_connections 2024-05-30T16:44:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.342+0000 7f89f9200640 1 -- 172.21.15.144:0/3150201052 wait complete. 2024-05-30T16:44:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.344+0000 7f89f9200640 1 Processor -- start 2024-05-30T16:44:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.344+0000 7f89f9200640 1 -- start start 2024-05-30T16:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f4070d70 0x7f89f4153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89f40b7060 0x7f89f4152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f415ea90 0x7f89f4155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41625f0 con 0x7f89f415ea90 2024-05-30T16:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40b6630 con 0x7f89f4070d70 2024-05-30T16:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f89f4162770 con 0x7f89f40b7060 2024-05-30T16:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f415ea90 0x7f89f4155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f415ea90 0x7f89f4155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43092/0 (socket says 172.21.15.144:43092) 2024-05-30T16:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f2800640 1 -- 172.21.15.144:0/1506276737 learned_addr learned my addr 172.21.15.144:0/1506276737 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f2800640 1 -- 172.21.15.144:0/1506276737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89f40b7060 msgr2=0x7f89f4152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f2800640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89f40b7060 0x7f89f4152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f2800640 1 -- 172.21.15.144:0/1506276737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f4070d70 msgr2=0x7f89f4153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f2800640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f4070d70 0x7f89f4153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.345+0000 7f89f2800640 1 -- 172.21.15.144:0/1506276737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f41543a0 con 0x7f89f415ea90 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.346+0000 7f89f2800640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f415ea90 0x7f89f4155440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009e50 tx=0x7f89ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.346+0000 7f89ea000640 1 -- 172.21.15.144:0/1506276737 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec036050 con 0x7f89f415ea90 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.346+0000 7f89ea000640 1 -- 172.21.15.144:0/1506276737 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ec042070 con 0x7f89f415ea90 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.346+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f4154680 con 0x7f89f415ea90 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.346+0000 7f89ea000640 1 -- 172.21.15.144:0/1506276737 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec007bd0 con 0x7f89f415ea90 2024-05-30T16:44:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.346+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f4154c40 con 0x7f89f415ea90 2024-05-30T16:44:54.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.347+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f4068b90 con 0x7f89f415ea90 2024-05-30T16:44:54.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.348+0000 7f89ea000640 1 -- 172.21.15.144:0/1506276737 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7f89ec047460 con 0x7f89f415ea90 2024-05-30T16:44:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.349+0000 7f89ea000640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f89d406caa0 0x7f89d406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.349+0000 7f89ea000640 1 -- 172.21.15.144:0/1506276737 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f89ec0ad0c0 con 0x7f89f415ea90 2024-05-30T16:44:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.349+0000 7f89f1e00640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f89d406caa0 0x7f89d406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:54.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.350+0000 7f89f1e00640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f89d406caa0 0x7f89d406ef60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f89e4006fd0 tx=0x7f89e4006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.354+0000 7f89ea000640 1 -- 172.21.15.144:0/1506276737 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f89ec02ae20 con 0x7f89f415ea90 2024-05-30T16:44:54.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.581+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f89f4075f70 con 0x7f89d406caa0 2024-05-30T16:44:54.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.626+0000 7f89ea000640 1 -- 172.21.15.144:0/1506276737 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f89e4009280 con 0x7f89d406caa0 2024-05-30T16:44:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.629+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f89d406caa0 msgr2=0x7f89d406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.629+0000 7f89f9200640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f89d406caa0 0x7f89d406ef60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f89e4006fd0 tx=0x7f89e4006bc0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.629+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f415ea90 msgr2=0x7f89f4155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.629+0000 7f89f9200640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f415ea90 0x7f89f4155440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009e50 tx=0x7f89ec004a40 comp rx=0 tx=0).stop 2024-05-30T16:44:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.630+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 shutdown_connections 2024-05-30T16:44:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.630+0000 7f89f9200640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f89d406caa0 0x7f89d406ef60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.630+0000 7f89f9200640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f415ea90 0x7f89f4155440 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.630+0000 7f89f9200640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89f40b7060 0x7f89f4152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.630+0000 7f89f9200640 1 --2- 172.21.15.144:0/1506276737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f4070d70 0x7f89f4153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:54.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.630+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 >> 172.21.15.144:0/1506276737 conn(0x7f89f4073460 msgr2=0x7f89f406efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:54.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.630+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 shutdown_connections 2024-05-30T16:44:54.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54.630+0000 7f89f9200640 1 -- 172.21.15.144:0/1506276737 wait complete. 2024-05-30T16:44:54.653 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T16:44:54.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:44:54.813 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-05-30T16:44:54.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:44:54.823 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:44:54.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:44:54.922 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:44:55.029 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:44:55.029 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:44:55.029 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:44:55.030 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:44:55.086 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:44:55.086 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:44:55.139 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:44:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.339+0000 7f10f4a00640 1 Processor -- start 2024-05-30T16:44:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.339+0000 7f10f4a00640 1 -- start start 2024-05-30T16:44:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.341+0000 7f10f4a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f10f015cb20 0x7f10f00cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.341+0000 7f10f4a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f015d020 con 0x7f10f00cf6c0 2024-05-30T16:44:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.341+0000 7f10f4a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f015d300 con 0x7f10f00b2b70 2024-05-30T16:44:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.341+0000 7f10f4a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f10f00cfb20 con 0x7f10f015cb20 2024-05-30T16:44:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.341+0000 7f10ef200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f10f00cf6c0 0x7f10f0140000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53784/0 (socket says 172.21.15.144:53784) 2024-05-30T16:44:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.341+0000 7f10ef200640 1 -- 172.21.15.144:0/1401267342 learned_addr learned my addr 172.21.15.144:0/1401267342 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.341+0000 7f10ede00640 1 --2- 172.21.15.144:0/1401267342 >> v2:172.21.15.149:3300/0 conn(0x7f10f015cb20 0x7f10f00cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907293176 0 0) 0x7f10f015d020 con 0x7f10f00cf6c0 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d4003520 con 0x7f10f00cf6c0 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1210634744 0 0) 0x7f10d4003520 con 0x7f10f00cf6c0 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 >> v2:172.21.15.149:3300/0 conn(0x7f10f015cb20 msgr2=0x7f10f00cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 --2- 172.21.15.144:0/1401267342 >> v2:172.21.15.149:3300/0 conn(0x7f10f015cb20 0x7f10f00cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 >> v1:172.21.15.149:6789/0 conn(0x7f10f00b2b70 legacy=0x7f10f0142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f015d5e0 con 0x7f10f00cf6c0 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f10e80019f0 con 0x7f10f00cf6c0 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 >> v1:172.21.15.144:6789/0 conn(0x7f10f00cf6c0 legacy=0x7f10f0140000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 --2- 172.21.15.144:0/1401267342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10d4003a00 0x7f10d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 --2- 172.21.15.144:0/1401267342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 --2- 172.21.15.144:0/1401267342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10d40051c0 0x7f10d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10d400c090 con 0x7f10d4004800 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10d400c240 con 0x7f10d40051c0 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f10d400c440 con 0x7f10d4003a00 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.342+0000 7f10ede00640 1 --2- 172.21.15.144:0/1401267342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.343+0000 7f10ede00640 1 -- 172.21.15.144:0/1401267342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10d4003a00 msgr2=0x7f10d4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.343+0000 7f10ede00640 1 --2- 172.21.15.144:0/1401267342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10d4003a00 0x7f10d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.343+0000 7f10ede00640 1 -- 172.21.15.144:0/1401267342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10d40051c0 msgr2=0x7f10d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.343+0000 7f10ede00640 1 --2- 172.21.15.144:0/1401267342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10d40051c0 0x7f10d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.343+0000 7f10ede00640 1 -- 172.21.15.144:0/1401267342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d4003520 con 0x7f10d4004800 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.343+0000 7f10ef200640 1 -- 172.21.15.144:0/1401267342 reap_dead start 2024-05-30T16:44:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.344+0000 7f10ede00640 1 --2- 172.21.15.144:0/1401267342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10d4004c80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f10f00d0020 tx=0x7f10d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888244839eb97014 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.344+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc036070 con 0x7f10d4004800 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.344+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10dc031400 con 0x7f10d4004800 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.344+0000 7f10ed400640 1 -- 172.21.15.144:0/1401267342 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc009690 con 0x7f10d4004800 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.345+0000 7f10f4a00640 1 -- 172.21.15.144:0/1401267342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 msgr2=0x7f10d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.345+0000 7f10f4a00640 1 --2- 172.21.15.144:0/1401267342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10d4004c80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f10f00d0020 tx=0x7f10d4005830 comp rx=0 tx=0).stop 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.345+0000 7f10f4a00640 1 -- 172.21.15.144:0/1401267342 shutdown_connections 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.345+0000 7f10f4a00640 1 --2- 172.21.15.144:0/1401267342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10d4004c80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.345+0000 7f10f4a00640 1 -- 172.21.15.144:0/1401267342 >> 172.21.15.144:0/1401267342 conn(0x7f10f00627b0 msgr2=0x7f10f006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.345+0000 7f10f4a00640 1 -- 172.21.15.144:0/1401267342 shutdown_connections 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.345+0000 7f10f4a00640 1 -- 172.21.15.144:0/1401267342 wait complete. 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.347+0000 7f10f4a00640 1 Processor -- start 2024-05-30T16:44:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.347+0000 7f10f4a00640 1 -- start start 2024-05-30T16:44:55.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10f4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10f0155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:55.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10f4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10f013e5f0 0x7f10f00c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:55.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10f4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f00c8bf0 0x7f10f01f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:55.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10f4a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10f00b2f50 con 0x7f10d4004800 2024-05-30T16:44:55.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10f4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10f00c6760 con 0x7f10f013e5f0 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10f4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f10f00b30d0 con 0x7f10f00c8bf0 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10ee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10f0155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10ee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10f0155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40754/0 (socket says 172.21.15.144:40754) 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10ee800640 1 -- 172.21.15.144:0/1455312076 learned_addr learned my addr 172.21.15.144:0/1455312076 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10ee800640 1 -- 172.21.15.144:0/1455312076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f00c8bf0 msgr2=0x7f10f01f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10ee800640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f00c8bf0 0x7f10f01f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10ede00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10f013e5f0 0x7f10f00c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.348+0000 7f10ee800640 1 -- 172.21.15.144:0/1455312076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10f013e5f0 msgr2=0x7f10f00c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.349+0000 7f10ee800640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10f013e5f0 0x7f10f00c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.349+0000 7f10ee800640 1 -- 172.21.15.144:0/1455312076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f00ce2b0 con 0x7f10d4004800 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.349+0000 7f10ee800640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10f0155f90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c430 tx=0x7f10e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.349+0000 7f10e6a00640 1 -- 172.21.15.144:0/1455312076 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0017070 con 0x7f10d4004800 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.349+0000 7f10e6a00640 1 -- 172.21.15.144:0/1455312076 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00052f0 con 0x7f10d4004800 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.349+0000 7f10e6a00640 1 -- 172.21.15.144:0/1455312076 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0003830 con 0x7f10d4004800 2024-05-30T16:44:55.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.349+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f00cdcf0 con 0x7f10d4004800 2024-05-30T16:44:55.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.349+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f0157ba0 con 0x7f10d4004800 2024-05-30T16:44:55.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.351+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f0075570 con 0x7f10d4004800 2024-05-30T16:44:55.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.351+0000 7f10e6a00640 1 -- 172.21.15.144:0/1455312076 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 91193+0+0 (secure 0 0 0) 0x7f10e001a070 con 0x7f10d4004800 2024-05-30T16:44:55.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.352+0000 7f10e6a00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10d006cad0 0x7f10d006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:55.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.352+0000 7f10e6a00640 1 -- 172.21.15.144:0/1455312076 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f10e008b0f0 con 0x7f10d4004800 2024-05-30T16:44:55.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.352+0000 7f10ede00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10d006cad0 0x7f10d006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:55.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.353+0000 7f10ede00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10d006cad0 0x7f10d006ef90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f10dc033000 tx=0x7f10dc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:55.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.357+0000 7f10e6a00640 1 -- 172.21.15.144:0/1455312076 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f10f00ce2b0 con 0x7f10d4004800 2024-05-30T16:44:55.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.471+0000 7f10e6a00640 1 -- 172.21.15.144:0/1455312076 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f10e0055200 con 0x7f10d4004800 2024-05-30T16:44:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.588+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f10f015abc0 con 0x7f10d4004800 2024-05-30T16:44:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.588+0000 7f10e6a00640 1 -- 172.21.15.144:0/1455312076 <== mon.0 v2:172.21.15.144:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f10e005f6a0 con 0x7f10d4004800 2024-05-30T16:44:55.590 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-05-30T16:44:55.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10d006cad0 msgr2=0x7f10d006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10d006cad0 0x7f10d006ef90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f10dc033000 tx=0x7f10dc008030 comp rx=0 tx=0).stop 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 msgr2=0x7f10f0155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10f0155f90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c430 tx=0x7f10e000c8f0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 shutdown_connections 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10d006cad0 0x7f10d006ef90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f00c8bf0 0x7f10f01f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10f013e5f0 0x7f10f00c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 --2- 172.21.15.144:0/1455312076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10d4004800 0x7f10f0155f90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 >> 172.21.15.144:0/1455312076 conn(0x7f10f00627b0 msgr2=0x7f10f00c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 shutdown_connections 2024-05-30T16:44:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:55.591+0000 7f10f4a00640 1 -- 172.21.15.144:0/1455312076 wait complete. 2024-05-30T16:44:55.611 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T16:44:55.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:44:55.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T16:44:55.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:44:55.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:44:55.741 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:44:55.787 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:44:55.787 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:44:55.788 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:44:55.826 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:44:55.826 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:44:55.827 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:44:55.827 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:44:55.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:44:55.866 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:44:55.866 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:44:55.866 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:44:55.909 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:44:55.909 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:44:56.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.099+0000 7fd5ee600640 1 Processor -- start 2024-05-30T16:44:56.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.099+0000 7fd5ee600640 1 -- start start 2024-05-30T16:44:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.100+0000 7fd5ee600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e815ec60 0x7fd5e806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.100+0000 7fd5ee600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5e80d1dc0 0x7fd5e806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.100+0000 7fd5ee600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e80d08d0 con 0x7fd5e806cc70 2024-05-30T16:44:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.100+0000 7fd5ee600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e815f5e0 con 0x7fd5e80d1dc0 2024-05-30T16:44:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.100+0000 7fd5ee600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e815f8c0 con 0x7fd5e815ec60 2024-05-30T16:44:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.101+0000 7fd5e7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5e80d1dc0 0x7fd5e806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.101+0000 7fd5e6a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd5e806cc70 0x7fd5e809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53794/0 (socket says 172.21.15.144:53794) 2024-05-30T16:44:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.101+0000 7fd5e7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5e80d1dc0 0x7fd5e806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40770/0 (socket says 172.21.15.144:40770) 2024-05-30T16:44:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.101+0000 7fd5e6a00640 1 -- 172.21.15.144:0/1916376391 learned_addr learned my addr 172.21.15.144:0/1916376391 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:56.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.101+0000 7fd5e7400640 1 --2- 172.21.15.144:0/1916376391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e815ec60 0x7fd5e806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.101+0000 7fd5e7e00640 1 -- 172.21.15.144:0/1916376391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e815ec60 msgr2=0x7fd5e806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:56.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.101+0000 7fd5e7e00640 1 --2- 172.21.15.144:0/1916376391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e815ec60 0x7fd5e806d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.101+0000 7fd5e7e00640 1 -- 172.21.15.144:0/1916376391 >> v1:172.21.15.144:6789/0 conn(0x7fd5e806cc70 legacy=0x7fd5e809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.101+0000 7fd5e7e00640 1 -- 172.21.15.144:0/1916376391 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e815fba0 con 0x7fd5e80d1dc0 2024-05-30T16:44:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.102+0000 7fd5e7e00640 1 --2- 172.21.15.144:0/1916376391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e80d1dc0 0x7fd5e806d620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009d90 tx=0x7fd5e002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e7e4fa1735db59 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.102+0000 7fd5e6000640 1 -- 172.21.15.144:0/1916376391 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0031600 con 0x7fd5e80d1dc0 2024-05-30T16:44:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5e6000640 1 -- 172.21.15.144:0/1916376391 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e00317a0 con 0x7fd5e80d1dc0 2024-05-30T16:44:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5e6000640 1 -- 172.21.15.144:0/1916376391 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0031b70 con 0x7fd5e80d1dc0 2024-05-30T16:44:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5ee600640 1 -- 172.21.15.144:0/1916376391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e80d1dc0 msgr2=0x7fd5e806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5ee600640 1 --2- 172.21.15.144:0/1916376391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e80d1dc0 0x7fd5e806d620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009d90 tx=0x7fd5e002a5d0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5ee600640 1 -- 172.21.15.144:0/1916376391 shutdown_connections 2024-05-30T16:44:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5ee600640 1 --2- 172.21.15.144:0/1916376391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e80d1dc0 0x7fd5e806d620 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5ee600640 1 --2- 172.21.15.144:0/1916376391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e815ec60 0x7fd5e806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5ee600640 1 -- 172.21.15.144:0/1916376391 >> 172.21.15.144:0/1916376391 conn(0x7fd5e80b4180 msgr2=0x7fd5e80b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5ee600640 1 -- 172.21.15.144:0/1916376391 shutdown_connections 2024-05-30T16:44:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.103+0000 7fd5ee600640 1 -- 172.21.15.144:0/1916376391 wait complete. 2024-05-30T16:44:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.105+0000 7fd5ee600640 1 Processor -- start 2024-05-30T16:44:56.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.105+0000 7fd5ee600640 1 -- start start 2024-05-30T16:44:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.106+0000 7fd5ee600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e806cc70 0x7fd5e80c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.106+0000 7fd5ee600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e80d1dc0 0x7fd5e8152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.106+0000 7fd5ee600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e815ec60 0x7fd5e80cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.106+0000 7fd5ee600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e81627f0 con 0x7fd5e815ec60 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.106+0000 7fd5ee600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e8162670 con 0x7fd5e80d1dc0 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.106+0000 7fd5ee600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e8162970 con 0x7fd5e806cc70 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.106+0000 7fd5e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e815ec60 0x7fd5e80cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.106+0000 7fd5e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e815ec60 0x7fd5e80cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40778/0 (socket says 172.21.15.144:40778) 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.107+0000 7fd5e7e00640 1 -- 172.21.15.144:0/2317720525 learned_addr learned my addr 172.21.15.144:0/2317720525 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.107+0000 7fd5e7400640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e806cc70 0x7fd5e80c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.107+0000 7fd5e6a00640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e80d1dc0 0x7fd5e8152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.107+0000 7fd5e7e00640 1 -- 172.21.15.144:0/2317720525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e806cc70 msgr2=0x7fd5e80c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.107+0000 7fd5e7e00640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e806cc70 0x7fd5e80c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.107+0000 7fd5e7e00640 1 -- 172.21.15.144:0/2317720525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e80d1dc0 msgr2=0x7fd5e8152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.107+0000 7fd5e7e00640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e80d1dc0 0x7fd5e8152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.107+0000 7fd5e7e00640 1 -- 172.21.15.144:0/2317720525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e8152f00 con 0x7fd5e815ec60 2024-05-30T16:44:56.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.107+0000 7fd5e7e00640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e815ec60 0x7fd5e80cae90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009eb0 tx=0x7fd5e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.108+0000 7fd5df400640 1 -- 172.21.15.144:0/2317720525 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e003f070 con 0x7fd5e815ec60 2024-05-30T16:44:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.108+0000 7fd5df400640 1 -- 172.21.15.144:0/2317720525 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e0030b60 con 0x7fd5e815ec60 2024-05-30T16:44:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.108+0000 7fd5df400640 1 -- 172.21.15.144:0/2317720525 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0044460 con 0x7fd5e815ec60 2024-05-30T16:44:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.108+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e80c9df0 con 0x7fd5e815ec60 2024-05-30T16:44:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.108+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e80ca3b0 con 0x7fd5e815ec60 2024-05-30T16:44:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.109+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e8068b90 con 0x7fd5e815ec60 2024-05-30T16:44:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.110+0000 7fd5df400640 1 -- 172.21.15.144:0/2317720525 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fd5e003b410 con 0x7fd5e815ec60 2024-05-30T16:44:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.111+0000 7fd5df400640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5c806cbc0 0x7fd5c806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.111+0000 7fd5df400640 1 -- 172.21.15.144:0/2317720525 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5765+0+0 (secure 0 0 0) 0x7fd5e00ad8b0 con 0x7fd5e815ec60 2024-05-30T16:44:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.111+0000 7fd5e7400640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5c806cbc0 0x7fd5c806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.112+0000 7fd5e7400640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5c806cbc0 0x7fd5c806f080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8006fd0 tx=0x7fd5d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.116+0000 7fd5df400640 1 -- 172.21.15.144:0/2317720525 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5e007b8c0 con 0x7fd5e815ec60 2024-05-30T16:44:56.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.354+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5e80b4ea0 con 0x7fd5e815ec60 2024-05-30T16:44:56.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.356+0000 7fd5df400640 1 -- 172.21.15.144:0/2317720525 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5190 (secure 0 0 0) 0x7fd5e007b1c0 con 0x7fd5e815ec60 2024-05-30T16:44:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:56.357 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/476063845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":476063845},{"type":"v1","addr":"172.21.15.149:6834","nonce":476063845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3390865934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3390865934},{"type":"v1","addr":"172.21.15.144:6836","nonce":3390865934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4737,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1066829217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1066829217},{"type":"v1","addr":"172.21.15.144:6837","nonce":1066829217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:42:42.182725+0000","modified":"2024-05-30T16:42:45.231332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/2240940065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":2240940065},{"type":"v1","addr":"172.21.15.149:6835","nonce":2240940065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-30T16:44:56.357 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-05-30T16:44:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5c806cbc0 msgr2=0x7fd5c806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5c806cbc0 0x7fd5c806f080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8006fd0 tx=0x7fd5d8008040 comp rx=0 tx=0).stop 2024-05-30T16:44:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e815ec60 msgr2=0x7fd5e80cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e815ec60 0x7fd5e80cae90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009eb0 tx=0x7fd5e0004a40 comp rx=0 tx=0).stop 2024-05-30T16:44:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 shutdown_connections 2024-05-30T16:44:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5c806cbc0 0x7fd5c806f080 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e815ec60 0x7fd5e80cae90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e80d1dc0 0x7fd5e8152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 --2- 172.21.15.144:0/2317720525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e806cc70 0x7fd5e80c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.358+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 >> 172.21.15.144:0/2317720525 conn(0x7fd5e80b4180 msgr2=0x7fd5e8074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.359+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 shutdown_connections 2024-05-30T16:44:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.359+0000 7fd5ee600640 1 -- 172.21.15.144:0/2317720525 wait complete. 2024-05-30T16:44:56.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:44:56.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.574+0000 7f3468200640 1 Processor -- start 2024-05-30T16:44:56.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.574+0000 7f3468200640 1 -- start start 2024-05-30T16:44:56.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.575+0000 7f3468200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34600cec70 0x7f34600b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.575+0000 7f3468200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f34600b5e00 0x7f3460142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.575+0000 7f3468200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3460160730 con 0x7f346013f760 2024-05-30T16:44:56.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.575+0000 7f3468200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f34601612b0 con 0x7f34600cec70 2024-05-30T16:44:56.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.575+0000 7f3468200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f346013fb40 con 0x7f34600b5e00 2024-05-30T16:44:56.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f3464e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34600cec70 0x7f34600b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f3465800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f346013f760 0x7f346006e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53798/0 (socket says 172.21.15.144:53798) 2024-05-30T16:44:56.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f3465800640 1 -- 172.21.15.144:0/2725483226 learned_addr learned my addr 172.21.15.144:0/2725483226 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:56.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f3466200640 1 --2- 172.21.15.144:0/2725483226 >> v2:172.21.15.149:3300/0 conn(0x7f34600b5e00 0x7f3460142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f3464e00640 1 -- 172.21.15.144:0/2725483226 >> v2:172.21.15.149:3300/0 conn(0x7f34600b5e00 msgr2=0x7f3460142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:56.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f3464e00640 1 --2- 172.21.15.144:0/2725483226 >> v2:172.21.15.149:3300/0 conn(0x7f34600b5e00 0x7f3460142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f3464e00640 1 -- 172.21.15.144:0/2725483226 >> v1:172.21.15.144:6789/0 conn(0x7f346013f760 legacy=0x7f346006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f3464e00640 1 -- 172.21.15.144:0/2725483226 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3460160a10 con 0x7f34600cec70 2024-05-30T16:44:56.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f3466200640 1 --2- 172.21.15.144:0/2725483226 >> v2:172.21.15.149:3300/0 conn(0x7f34600b5e00 0x7f3460142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:56.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.576+0000 7f345fe00640 1 -- 172.21.15.144:0/2725483226 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88504596 0 0) 0x7f3460160730 con 0x7f346013f760 2024-05-30T16:44:56.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.577+0000 7f3464e00640 1 --2- 172.21.15.144:0/2725483226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34600cec70 0x7f34600b58c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f346015de30 tx=0x7f344c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4aecb5a2c989c8a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:56.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f345fe00640 1 -- 172.21.15.144:0/2725483226 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c037070 con 0x7f34600cec70 2024-05-30T16:44:56.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f345fe00640 1 -- 172.21.15.144:0/2725483226 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344c032440 con 0x7f34600cec70 2024-05-30T16:44:56.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f345fe00640 1 -- 172.21.15.144:0/2725483226 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c032810 con 0x7f34600cec70 2024-05-30T16:44:56.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f3468200640 1 -- 172.21.15.144:0/2725483226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34600cec70 msgr2=0x7f34600b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f3468200640 1 --2- 172.21.15.144:0/2725483226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34600cec70 0x7f34600b58c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f346015de30 tx=0x7f344c02a230 comp rx=0 tx=0).stop 2024-05-30T16:44:56.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f3468200640 1 -- 172.21.15.144:0/2725483226 shutdown_connections 2024-05-30T16:44:56.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f3468200640 1 --2- 172.21.15.144:0/2725483226 >> v2:172.21.15.149:3300/0 conn(0x7f34600b5e00 0x7f3460142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f3468200640 1 --2- 172.21.15.144:0/2725483226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34600cec70 0x7f34600b58c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f3468200640 1 -- 172.21.15.144:0/2725483226 >> 172.21.15.144:0/2725483226 conn(0x7f346006bd00 msgr2=0x7f346006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:56.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f3468200640 1 -- 172.21.15.144:0/2725483226 shutdown_connections 2024-05-30T16:44:56.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.578+0000 7f3468200640 1 -- 172.21.15.144:0/2725483226 wait complete. 2024-05-30T16:44:56.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.580+0000 7f3468200640 1 Processor -- start 2024-05-30T16:44:56.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.580+0000 7f3468200640 1 -- start start 2024-05-30T16:44:56.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.581+0000 7f3468200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34600b5e00 0x7f3460131510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.581+0000 7f3468200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34600cec70 0x7f346015f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.581+0000 7f3468200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346013f760 0x7f346015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.581+0000 7f3468200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34600cf0d0 con 0x7f346013f760 2024-05-30T16:44:56.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.581+0000 7f3468200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3460160fd0 con 0x7f34600cec70 2024-05-30T16:44:56.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.581+0000 7f3468200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34600cf250 con 0x7f34600b5e00 2024-05-30T16:44:56.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.581+0000 7f3466200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346013f760 0x7f346015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.581+0000 7f3466200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346013f760 0x7f346015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40802/0 (socket says 172.21.15.144:40802) 2024-05-30T16:44:56.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.581+0000 7f3466200640 1 -- 172.21.15.144:0/2354645551 learned_addr learned my addr 172.21.15.144:0/2354645551 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3466200640 1 -- 172.21.15.144:0/2354645551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34600b5e00 msgr2=0x7f3460131510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3465800640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34600b5e00 0x7f3460131510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3464e00640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34600cec70 0x7f346015f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3466200640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34600b5e00 0x7f3460131510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3466200640 1 -- 172.21.15.144:0/2354645551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34600cec70 msgr2=0x7f346015f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3466200640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34600cec70 0x7f346015f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3466200640 1 -- 172.21.15.144:0/2354645551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34601f88a0 con 0x7f346013f760 2024-05-30T16:44:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3464e00640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34600cec70 0x7f346015f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3466200640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346013f760 0x7f346015f570 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f345800cef0 tx=0x7f345800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:56.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f345d600640 1 -- 172.21.15.144:0/2354645551 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345801a070 con 0x7f346013f760 2024-05-30T16:44:56.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f345d600640 1 -- 172.21.15.144:0/2354645551 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345800d860 con 0x7f346013f760 2024-05-30T16:44:56.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f345d600640 1 -- 172.21.15.144:0/2354645551 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345800dc50 con 0x7f346013f760 2024-05-30T16:44:56.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.582+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3460131dc0 con 0x7f346013f760 2024-05-30T16:44:56.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.583+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3460132380 con 0x7f346013f760 2024-05-30T16:44:56.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.584+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3460068b90 con 0x7f346013f760 2024-05-30T16:44:56.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.585+0000 7f345d600640 1 -- 172.21.15.144:0/2354645551 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f345801d070 con 0x7f346013f760 2024-05-30T16:44:56.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.586+0000 7f345d600640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f344006cbc0 0x7f344006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:56.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.586+0000 7f345d600640 1 -- 172.21.15.144:0/2354645551 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5765+0+0 (secure 0 0 0) 0x7f345808c9d0 con 0x7f346013f760 2024-05-30T16:44:56.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.586+0000 7f3465800640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f344006cbc0 0x7f344006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:56.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.587+0000 7f3465800640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f344006cbc0 0x7f344006f080 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3454000f60 tx=0x7f3454009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:56.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.590+0000 7f345d600640 1 -- 172.21.15.144:0/2354645551 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f345805aa10 con 0x7f346013f760 2024-05-30T16:44:56.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.813+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f346006c3c0 con 0x7f346013f760 2024-05-30T16:44:56.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.814+0000 7f345d600640 1 -- 172.21.15.144:0/2354645551 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5190 (secure 0 0 0) 0x7f345805a310 con 0x7f346013f760 2024-05-30T16:44:56.815 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:56.815 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/476063845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":476063845},{"type":"v1","addr":"172.21.15.149:6834","nonce":476063845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3390865934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3390865934},{"type":"v1","addr":"172.21.15.144:6836","nonce":3390865934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4737,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1066829217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1066829217},{"type":"v1","addr":"172.21.15.144:6837","nonce":1066829217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:42:42.182725+0000","modified":"2024-05-30T16:42:45.231332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/2240940065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":2240940065},{"type":"v1","addr":"172.21.15.149:6835","nonce":2240940065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-30T16:44:56.816 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-05-30T16:44:56.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f344006cbc0 msgr2=0x7f344006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f344006cbc0 0x7f344006f080 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3454000f60 tx=0x7f3454009040 comp rx=0 tx=0).stop 2024-05-30T16:44:56.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346013f760 msgr2=0x7f346015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:56.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346013f760 0x7f346015f570 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f345800cef0 tx=0x7f345800a710 comp rx=0 tx=0).stop 2024-05-30T16:44:56.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 shutdown_connections 2024-05-30T16:44:56.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f344006cbc0 0x7f344006f080 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346013f760 0x7f346015f570 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34600cec70 0x7f346015f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 --2- 172.21.15.144:0/2354645551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34600b5e00 0x7f3460131510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:56.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 >> 172.21.15.144:0/2354645551 conn(0x7f346006bd00 msgr2=0x7f34600b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:56.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 shutdown_connections 2024-05-30T16:44:56.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:56.817+0000 7f3468200640 1 -- 172.21.15.144:0/2354645551 wait complete. 2024-05-30T16:44:56.837 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:44:57.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.070+0000 7f6102a00640 1 Processor -- start 2024-05-30T16:44:57.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.070+0000 7f6102a00640 1 -- start start 2024-05-30T16:44:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.072+0000 7f6102a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f60fc15e6d0 0x7f60fc162cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.072+0000 7f6102a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f60fc0cd310 0x7f60fc0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.072+0000 7f6102a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60fc0ce160 con 0x7f60fc0ca840 2024-05-30T16:44:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.072+0000 7f6102a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f60fc163200 con 0x7f60fc15e6d0 2024-05-30T16:44:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.072+0000 7f6102a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f60fc0ce440 con 0x7f60fc0cd310 2024-05-30T16:44:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.073+0000 7f6100c00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f60fc0ca840 0x7f60fc0ccc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:49786/0 (socket says 172.21.15.144:49786) 2024-05-30T16:44:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.073+0000 7f6100c00640 1 -- 172.21.15.144:0/957306083 learned_addr learned my addr 172.21.15.144:0/957306083 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:57.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.073+0000 7f6101600640 1 --2- 172.21.15.144:0/957306083 >> v2:172.21.15.144:3300/0 conn(0x7f60fc15e6d0 0x7f60fc162cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.073+0000 7f60fbe00640 1 -- 172.21.15.144:0/957306083 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1920759907 0 0) 0x7f60fc0ce160 con 0x7f60fc0ca840 2024-05-30T16:44:57.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.074+0000 7f60fbe00640 1 -- 172.21.15.144:0/957306083 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60e4003520 con 0x7f60fc0ca840 2024-05-30T16:44:57.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.074+0000 7f6101600640 1 -- 172.21.15.144:0/957306083 >> v2:172.21.15.149:3300/0 conn(0x7f60fc0cd310 msgr2=0x7f60fc0b3bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:44:57.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.074+0000 7f6101600640 1 --2- 172.21.15.144:0/957306083 >> v2:172.21.15.149:3300/0 conn(0x7f60fc0cd310 0x7f60fc0b3bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.074+0000 7f6101600640 1 -- 172.21.15.144:0/957306083 >> v1:172.21.15.149:6789/0 conn(0x7f60fc0ca840 legacy=0x7f60fc0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:57.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.074+0000 7f6101600640 1 -- 172.21.15.144:0/957306083 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc0ce720 con 0x7f60fc15e6d0 2024-05-30T16:44:57.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.075+0000 7f6101600640 1 --2- 172.21.15.144:0/957306083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 0x7f60fc162cc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0c9c50 tx=0x7f60f002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c7b24e45f915ce server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:57.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.076+0000 7f60fbe00640 1 -- 172.21.15.144:0/957306083 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0037070 con 0x7f60fc15e6d0 2024-05-30T16:44:57.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.076+0000 7f60fbe00640 1 -- 172.21.15.144:0/957306083 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f0032440 con 0x7f60fc15e6d0 2024-05-30T16:44:57.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.076+0000 7f60fbe00640 1 -- 172.21.15.144:0/957306083 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f00327f0 con 0x7f60fc15e6d0 2024-05-30T16:44:57.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.077+0000 7f6102a00640 1 -- 172.21.15.144:0/957306083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 msgr2=0x7f60fc162cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:57.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.077+0000 7f6102a00640 1 --2- 172.21.15.144:0/957306083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 0x7f60fc162cc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0c9c50 tx=0x7f60f002a130 comp rx=0 tx=0).stop 2024-05-30T16:44:57.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.077+0000 7f6102a00640 1 -- 172.21.15.144:0/957306083 shutdown_connections 2024-05-30T16:44:57.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.077+0000 7f6102a00640 1 --2- 172.21.15.144:0/957306083 >> v2:172.21.15.149:3300/0 conn(0x7f60fc0cd310 0x7f60fc0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.077+0000 7f6102a00640 1 --2- 172.21.15.144:0/957306083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 0x7f60fc162cc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.077+0000 7f6102a00640 1 -- 172.21.15.144:0/957306083 >> 172.21.15.144:0/957306083 conn(0x7f60fc0b20a0 msgr2=0x7f60fc0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:57.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.078+0000 7f6102a00640 1 -- 172.21.15.144:0/957306083 shutdown_connections 2024-05-30T16:44:57.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.078+0000 7f6102a00640 1 -- 172.21.15.144:0/957306083 wait complete. 2024-05-30T16:44:57.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.080+0000 7f6102a00640 1 Processor -- start 2024-05-30T16:44:57.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.080+0000 7f6102a00640 1 -- start start 2024-05-30T16:44:57.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.082+0000 7f6102a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60fc0ca840 0x7f60fc1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.082+0000 7f6102a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc0cd310 0x7f60fc155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.082+0000 7f6102a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 0x7f60fc160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.082+0000 7f6102a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc0cddc0 con 0x7f60fc15e6d0 2024-05-30T16:44:57.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.082+0000 7f6102a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc0b4f70 con 0x7f60fc0cd310 2024-05-30T16:44:57.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.082+0000 7f6102a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f60fc0cdf40 con 0x7f60fc0ca840 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.083+0000 7f6102000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 0x7f60fc160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.083+0000 7f6101600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60fc0ca840 0x7f60fc1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.083+0000 7f6101600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60fc0ca840 0x7f60fc1564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:57294/0 (socket says 172.21.15.144:57294) 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.083+0000 7f6101600640 1 -- 172.21.15.144:0/1516135723 learned_addr learned my addr 172.21.15.144:0/1516135723 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.083+0000 7f6100c00640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc0cd310 0x7f60fc155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.084+0000 7f6102000640 1 -- 172.21.15.144:0/1516135723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60fc0ca840 msgr2=0x7f60fc1564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.084+0000 7f6102000640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60fc0ca840 0x7f60fc1564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.084+0000 7f6102000640 1 -- 172.21.15.144:0/1516135723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc0cd310 msgr2=0x7f60fc155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.084+0000 7f6102000640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc0cd310 0x7f60fc155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.084+0000 7f6102000640 1 -- 172.21.15.144:0/1516135723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc1561c0 con 0x7f60fc15e6d0 2024-05-30T16:44:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.084+0000 7f6102000640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 0x7f60fc160540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f60f400be30 tx=0x7f60f400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.084+0000 7f60f9600640 1 -- 172.21.15.144:0/1516135723 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4019070 con 0x7f60fc15e6d0 2024-05-30T16:44:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.085+0000 7f60f9600640 1 -- 172.21.15.144:0/1516135723 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f4014440 con 0x7f60fc15e6d0 2024-05-30T16:44:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.085+0000 7f60f9600640 1 -- 172.21.15.144:0/1516135723 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4014830 con 0x7f60fc15e6d0 2024-05-30T16:44:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.085+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60fc0727a0 con 0x7f60fc15e6d0 2024-05-30T16:44:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.085+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60fc160a80 con 0x7f60fc15e6d0 2024-05-30T16:44:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.087+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60fc0c9640 con 0x7f60fc15e6d0 2024-05-30T16:44:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.089+0000 7f60f9600640 1 -- 172.21.15.144:0/1516135723 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f60f401c070 con 0x7f60fc15e6d0 2024-05-30T16:44:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.093+0000 7f60f9600640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f60dc06cbc0 0x7f60dc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.093+0000 7f60f9600640 1 -- 172.21.15.144:0/1516135723 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5765+0+0 (secure 0 0 0) 0x7f60f408bf30 con 0x7f60fc15e6d0 2024-05-30T16:44:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.094+0000 7f6101600640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f60dc06cbc0 0x7f60dc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.095+0000 7f6101600640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f60dc06cbc0 0x7f60dc06f080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009560 tx=0x7f60f002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:57.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.101+0000 7f60f9600640 1 -- 172.21.15.144:0/1516135723 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f60f4059900 con 0x7f60fc15e6d0 2024-05-30T16:44:57.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.432+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60fc072570 con 0x7f60fc15e6d0 2024-05-30T16:44:57.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.433+0000 7f60f9600640 1 -- 172.21.15.144:0/1516135723 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16813 (secure 0 0 0) 0x7f60f405dc00 con 0x7f60fc15e6d0 2024-05-30T16:44:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:57.435 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":32,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:44:55.437008+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:42:40.061111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:42:41.144734+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:44:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f60dc06cbc0 msgr2=0x7f60dc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f60dc06cbc0 0x7f60dc06f080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009560 tx=0x7f60f002e000 comp rx=0 tx=0).stop 2024-05-30T16:44:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 msgr2=0x7f60fc160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 0x7f60fc160540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f60f400be30 tx=0x7f60f400bf20 comp rx=0 tx=0).stop 2024-05-30T16:44:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 shutdown_connections 2024-05-30T16:44:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f60dc06cbc0 0x7f60dc06f080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc15e6d0 0x7f60fc160540 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc0cd310 0x7f60fc155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 --2- 172.21.15.144:0/1516135723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60fc0ca840 0x7f60fc1564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 >> 172.21.15.144:0/1516135723 conn(0x7f60fc0b20a0 msgr2=0x7f60fc0cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:57.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.437+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 shutdown_connections 2024-05-30T16:44:57.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.438+0000 7f6102a00640 1 -- 172.21.15.144:0/1516135723 wait complete. 2024-05-30T16:44:57.462 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:44:57.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:44:57.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.701+0000 7fc354a00640 1 Processor -- start 2024-05-30T16:44:57.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.701+0000 7fc354a00640 1 -- start start 2024-05-30T16:44:57.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc354a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc350160860 0x7fc3501672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc354a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3500cefd0 0x7fc3500d3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc354a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc3500d4200 0x7fc3500d2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc354a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc350163400 con 0x7fc3500d4200 2024-05-30T16:44:57.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc354a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc3501636e0 con 0x7fc3500cefd0 2024-05-30T16:44:57.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc354a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc3501639c0 con 0x7fc350160860 2024-05-30T16:44:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc34fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc3500d4200 0x7fc3500d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc34f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc350160860 0x7fc3501672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc34f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc350160860 0x7fc3501672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:57304/0 (socket says 172.21.15.144:57304) 2024-05-30T16:44:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc34f400640 1 -- 172.21.15.144:0/586817633 learned_addr learned my addr 172.21.15.144:0/586817633 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.702+0000 7fc34ea00640 1 --2- 172.21.15.144:0/586817633 >> v2:172.21.15.149:3300/0 conn(0x7fc3500cefd0 0x7fc3500d3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.703+0000 7fc34fe00640 1 -- 172.21.15.144:0/586817633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc350160860 msgr2=0x7fc3501672a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:57.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.703+0000 7fc34fe00640 1 --2- 172.21.15.144:0/586817633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc350160860 0x7fc3501672a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.703+0000 7fc34fe00640 1 -- 172.21.15.144:0/586817633 >> v2:172.21.15.149:3300/0 conn(0x7fc3500cefd0 msgr2=0x7fc3500d3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:57.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.703+0000 7fc34fe00640 1 --2- 172.21.15.144:0/586817633 >> v2:172.21.15.149:3300/0 conn(0x7fc3500cefd0 0x7fc3500d3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.703+0000 7fc34fe00640 1 -- 172.21.15.144:0/586817633 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc350163ca0 con 0x7fc3500d4200 2024-05-30T16:44:57.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.704+0000 7fc34fe00640 1 --2- 172.21.15.144:0/586817633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3500d4200 0x7fc3500d2550 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc3500d5a80 tx=0x7fc34802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a255557e176ce420 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:57.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.705+0000 7fc34e000640 1 -- 172.21.15.144:0/586817633 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348031600 con 0x7fc3500d4200 2024-05-30T16:44:57.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.705+0000 7fc34e000640 1 -- 172.21.15.144:0/586817633 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3480317a0 con 0x7fc3500d4200 2024-05-30T16:44:57.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.705+0000 7fc34e000640 1 -- 172.21.15.144:0/586817633 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348031b70 con 0x7fc3500d4200 2024-05-30T16:44:57.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.706+0000 7fc354a00640 1 -- 172.21.15.144:0/586817633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3500d4200 msgr2=0x7fc3500d2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:57.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.706+0000 7fc354a00640 1 --2- 172.21.15.144:0/586817633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3500d4200 0x7fc3500d2550 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc3500d5a80 tx=0x7fc34802a5d0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.706+0000 7fc354a00640 1 -- 172.21.15.144:0/586817633 shutdown_connections 2024-05-30T16:44:57.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.706+0000 7fc354a00640 1 --2- 172.21.15.144:0/586817633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3500d4200 0x7fc3500d2550 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.706+0000 7fc354a00640 1 --2- 172.21.15.144:0/586817633 >> v2:172.21.15.149:3300/0 conn(0x7fc3500cefd0 0x7fc3500d3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.706+0000 7fc354a00640 1 --2- 172.21.15.144:0/586817633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc350160860 0x7fc3501672a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.706+0000 7fc354a00640 1 -- 172.21.15.144:0/586817633 >> 172.21.15.144:0/586817633 conn(0x7fc350062390 msgr2=0x7fc3500627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.707+0000 7fc354a00640 1 -- 172.21.15.144:0/586817633 shutdown_connections 2024-05-30T16:44:57.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.707+0000 7fc354a00640 1 -- 172.21.15.144:0/586817633 wait complete. 2024-05-30T16:44:57.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.709+0000 7fc354a00640 1 Processor -- start 2024-05-30T16:44:57.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.710+0000 7fc354a00640 1 -- start start 2024-05-30T16:44:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.711+0000 7fc354a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3500cefd0 0x7fc350153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.711+0000 7fc354a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3500d4200 0x7fc3500b6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.711+0000 7fc354a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc350160860 0x7fc3500b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc354a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc3500d0d80 con 0x7fc350160860 2024-05-30T16:44:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc354a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc3500d0c00 con 0x7fc3500cefd0 2024-05-30T16:44:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc354a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc3500d2a90 con 0x7fc3500d4200 2024-05-30T16:44:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc34fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc350160860 0x7fc3500b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc34fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc350160860 0x7fc3500b6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40832/0 (socket says 172.21.15.144:40832) 2024-05-30T16:44:57.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc34fe00640 1 -- 172.21.15.144:0/3294931409 learned_addr learned my addr 172.21.15.144:0/3294931409 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:57.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc34f400640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3500cefd0 0x7fc350153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc34ea00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3500d4200 0x7fc3500b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc34fe00640 1 -- 172.21.15.144:0/3294931409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3500d4200 msgr2=0x7fc3500b6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.712+0000 7fc34fe00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3500d4200 0x7fc3500b6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.713+0000 7fc34fe00640 1 -- 172.21.15.144:0/3294931409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3500cefd0 msgr2=0x7fc350153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.713+0000 7fc34fe00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3500cefd0 0x7fc350153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.713+0000 7fc34fe00640 1 -- 172.21.15.144:0/3294931409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3500b4fa0 con 0x7fc350160860 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.713+0000 7fc34fe00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc350160860 0x7fc3500b6a80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc34802abc0 tx=0x7fc348004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.714+0000 7fc347400640 1 -- 172.21.15.144:0/3294931409 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348040070 con 0x7fc350160860 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.714+0000 7fc347400640 1 -- 172.21.15.144:0/3294931409 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34803c8f0 con 0x7fc350160860 2024-05-30T16:44:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.714+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3500b5280 con 0x7fc350160860 2024-05-30T16:44:57.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.714+0000 7fc347400640 1 -- 172.21.15.144:0/3294931409 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34803ccc0 con 0x7fc350160860 2024-05-30T16:44:57.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.714+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3500b5840 con 0x7fc350160860 2024-05-30T16:44:57.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.715+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc350069120 con 0x7fc350160860 2024-05-30T16:44:57.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.717+0000 7fc347400640 1 -- 172.21.15.144:0/3294931409 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fc348039040 con 0x7fc350160860 2024-05-30T16:44:57.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.719+0000 7fc347400640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc33006cc10 0x7fc33006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:57.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.719+0000 7fc347400640 1 -- 172.21.15.144:0/3294931409 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5737+0+0 (secure 0 0 0) 0x7fc3480ad5f0 con 0x7fc350160860 2024-05-30T16:44:57.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.721+0000 7fc34f400640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc33006cc10 0x7fc33006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:57.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.722+0000 7fc34f400640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc33006cc10 0x7fc33006f0d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc350072f40 tx=0x7fc340009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:57.725+0000 7fc347400640 1 -- 172.21.15.144:0/3294931409 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc350069120 con 0x7fc350160860 2024-05-30T16:44:58.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.120+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc350075570 con 0x7fc350160860 2024-05-30T16:44:58.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.122+0000 7fc347400640 1 -- 172.21.15.144:0/3294931409 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5190 (secure 0 0 0) 0x7fc34807b5e0 con 0x7fc350160860 2024-05-30T16:44:58.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:58.123 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/476063845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":476063845},{"type":"v1","addr":"172.21.15.149:6834","nonce":476063845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3390865934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3390865934},{"type":"v1","addr":"172.21.15.144:6836","nonce":3390865934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4737,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1066829217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1066829217},{"type":"v1","addr":"172.21.15.144:6837","nonce":1066829217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:42:42.182725+0000","modified":"2024-05-30T16:42:45.231332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/2240940065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":2240940065},{"type":"v1","addr":"172.21.15.149:6835","nonce":2240940065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-30T16:44:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-05-30T16:44:58.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc33006cc10 msgr2=0x7fc33006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc33006cc10 0x7fc33006f0d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc350072f40 tx=0x7fc340009240 comp rx=0 tx=0).stop 2024-05-30T16:44:58.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc350160860 msgr2=0x7fc3500b6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc350160860 0x7fc3500b6a80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc34802abc0 tx=0x7fc348004a40 comp rx=0 tx=0).stop 2024-05-30T16:44:58.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 shutdown_connections 2024-05-30T16:44:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc33006cc10 0x7fc33006f0d0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc350072f40 tx=0x7fc340009240 comp rx=0 tx=0).stop 2024-05-30T16:44:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc350160860 0x7fc3500b6a80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3500d4200 0x7fc3500b6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 --2- 172.21.15.144:0/3294931409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3500cefd0 0x7fc350153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.126+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 >> 172.21.15.144:0/3294931409 conn(0x7fc350062390 msgr2=0x7fc350062770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.128+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 shutdown_connections 2024-05-30T16:44:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.128+0000 7fc354a00640 1 -- 172.21.15.144:0/3294931409 wait complete. 2024-05-30T16:44:58.150 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:44:58.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.390+0000 7f82ed200640 1 Processor -- start 2024-05-30T16:44:58.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.390+0000 7f82ed200640 1 -- start start 2024-05-30T16:44:58.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.392+0000 7f82ed200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82e8161e60 0x7f82e80ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.392+0000 7f82ed200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f82e80b6020 0x7f82e806b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.392+0000 7f82ed200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e80b4450 con 0x7f82e80b64b0 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.392+0000 7f82ed200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f82e80b4730 con 0x7f82e8161e60 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.392+0000 7f82ed200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f82e80b4a10 con 0x7f82e80b6020 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.393+0000 7f82e7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82e8161e60 0x7f82e80ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.393+0000 7f82e6a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f82e80b6020 0x7f82e806b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.393+0000 7f82e7e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f82e80b64b0 0x7f82e806f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:49800/0 (socket says 172.21.15.144:49800) 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.393+0000 7f82e7e00640 1 -- 172.21.15.144:0/2317173096 learned_addr learned my addr 172.21.15.144:0/2317173096 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.393+0000 7f82e7400640 1 -- 172.21.15.144:0/2317173096 >> v2:172.21.15.149:3300/0 conn(0x7f82e80b6020 msgr2=0x7f82e806b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.393+0000 7f82e7400640 1 --2- 172.21.15.144:0/2317173096 >> v2:172.21.15.149:3300/0 conn(0x7f82e80b6020 0x7f82e806b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.393+0000 7f82e7400640 1 -- 172.21.15.144:0/2317173096 >> v1:172.21.15.149:6789/0 conn(0x7f82e80b64b0 legacy=0x7f82e806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.393+0000 7f82e7400640 1 -- 172.21.15.144:0/2317173096 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e806eeb0 con 0x7f82e8161e60 2024-05-30T16:44:58.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.395+0000 7f82e7400640 1 --2- 172.21.15.144:0/2317173096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e8161e60 0x7f82e80ae300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82e8076200 tx=0x7f82d803b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e099042f3989b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:58.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.397+0000 7f82e6000640 1 -- 172.21.15.144:0/2317173096 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d803bd70 con 0x7f82e8161e60 2024-05-30T16:44:58.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.397+0000 7f82e6000640 1 -- 172.21.15.144:0/2317173096 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d80110d0 con 0x7f82e8161e60 2024-05-30T16:44:58.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.397+0000 7f82e6000640 1 -- 172.21.15.144:0/2317173096 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d80114a0 con 0x7f82e8161e60 2024-05-30T16:44:58.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.398+0000 7f82ed200640 1 -- 172.21.15.144:0/2317173096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e8161e60 msgr2=0x7f82e80ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.398+0000 7f82ed200640 1 --2- 172.21.15.144:0/2317173096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e8161e60 0x7f82e80ae300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82e8076200 tx=0x7f82d803b020 comp rx=0 tx=0).stop 2024-05-30T16:44:58.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.398+0000 7f82ed200640 1 -- 172.21.15.144:0/2317173096 shutdown_connections 2024-05-30T16:44:58.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.398+0000 7f82ed200640 1 --2- 172.21.15.144:0/2317173096 >> v2:172.21.15.149:3300/0 conn(0x7f82e80b6020 0x7f82e806b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.398+0000 7f82ed200640 1 --2- 172.21.15.144:0/2317173096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e8161e60 0x7f82e80ae300 secure :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82e8076200 tx=0x7f82d803b020 comp rx=0 tx=0).stop 2024-05-30T16:44:58.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.398+0000 7f82ed200640 1 -- 172.21.15.144:0/2317173096 >> 172.21.15.144:0/2317173096 conn(0x7f82e80b6a60 msgr2=0x7f82e809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:58.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.399+0000 7f82ed200640 1 -- 172.21.15.144:0/2317173096 shutdown_connections 2024-05-30T16:44:58.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.399+0000 7f82ed200640 1 -- 172.21.15.144:0/2317173096 wait complete. 2024-05-30T16:44:58.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.401+0000 7f82ed200640 1 Processor -- start 2024-05-30T16:44:58.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.401+0000 7f82ed200640 1 -- start start 2024-05-30T16:44:58.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.402+0000 7f82ed200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80b6020 0x7f82e8153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.402+0000 7f82ed200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e80b64b0 0x7f82e815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.402+0000 7f82ed200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82e8148eb0 0x7f82e815fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.402+0000 7f82ed200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8070e10 con 0x7f82e80b64b0 2024-05-30T16:44:58.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.402+0000 7f82ed200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8070c90 con 0x7f82e80b6020 2024-05-30T16:44:58.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.402+0000 7f82ed200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82e806be20 con 0x7f82e8148eb0 2024-05-30T16:44:58.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.403+0000 7f82e7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82e8148eb0 0x7f82e815fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.403+0000 7f82e7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82e8148eb0 0x7f82e815fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:57316/0 (socket says 172.21.15.144:57316) 2024-05-30T16:44:58.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.403+0000 7f82e7e00640 1 -- 172.21.15.144:0/217504810 learned_addr learned my addr 172.21.15.144:0/217504810 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:58.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.403+0000 7f82e6a00640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e80b64b0 0x7f82e815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.404+0000 7f82e7400640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80b6020 0x7f82e8153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.404+0000 7f82e6a00640 1 -- 172.21.15.144:0/217504810 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82e8148eb0 msgr2=0x7f82e815fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.404+0000 7f82e6a00640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82e8148eb0 0x7f82e815fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.404+0000 7f82e6a00640 1 -- 172.21.15.144:0/217504810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80b6020 msgr2=0x7f82e8153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.404+0000 7f82e6a00640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80b6020 0x7f82e8153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.404+0000 7f82e6a00640 1 -- 172.21.15.144:0/217504810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e815e5d0 con 0x7f82e80b64b0 2024-05-30T16:44:58.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.404+0000 7f82e7e00640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82e8148eb0 0x7f82e815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:44:58.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.404+0000 7f82e6a00640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e80b64b0 0x7f82e815dd80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f82d400e850 tx=0x7f82d400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:58.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.407+0000 7f82df400640 1 -- 172.21.15.144:0/217504810 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4017070 con 0x7f82e80b64b0 2024-05-30T16:44:58.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.407+0000 7f82df400640 1 -- 172.21.15.144:0/217504810 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d400c940 con 0x7f82e80b64b0 2024-05-30T16:44:58.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.407+0000 7f82df400640 1 -- 172.21.15.144:0/217504810 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d400cd10 con 0x7f82e80b64b0 2024-05-30T16:44:58.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.407+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e8154310 con 0x7f82e80b64b0 2024-05-30T16:44:58.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.407+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e81548d0 con 0x7f82e80b64b0 2024-05-30T16:44:58.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.409+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e8075570 con 0x7f82e80b64b0 2024-05-30T16:44:58.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.412+0000 7f82df400640 1 -- 172.21.15.144:0/217504810 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f82d401a070 con 0x7f82e80b64b0 2024-05-30T16:44:58.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.413+0000 7f82df400640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82c806cbc0 0x7f82c806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.413+0000 7f82df400640 1 -- 172.21.15.144:0/217504810 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5737+0+0 (secure 0 0 0) 0x7f82d408c670 con 0x7f82e80b64b0 2024-05-30T16:44:58.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.415+0000 7f82e7400640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82c806cbc0 0x7f82c806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.418+0000 7f82e7400640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82c806cbc0 0x7f82c806f080 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f82d8044000 tx=0x7f82d803f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:58.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.419+0000 7f82df400640 1 -- 172.21.15.144:0/217504810 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f82d405a120 con 0x7f82e80b64b0 2024-05-30T16:44:58.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.749+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82e806c410 con 0x7f82e80b64b0 2024-05-30T16:44:58.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.750+0000 7f82df400640 1 -- 172.21.15.144:0/217504810 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5190 (secure 0 0 0) 0x7f82d405e420 con 0x7f82e80b64b0 2024-05-30T16:44:58.751 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:58.752 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/476063845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":476063845},{"type":"v1","addr":"172.21.15.149:6834","nonce":476063845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3390865934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3390865934},{"type":"v1","addr":"172.21.15.144:6836","nonce":3390865934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4737,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1066829217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1066829217},{"type":"v1","addr":"172.21.15.144:6837","nonce":1066829217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:42:42.182725+0000","modified":"2024-05-30T16:42:45.231332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6835/2240940065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":2240940065},{"type":"v1","addr":"172.21.15.149:6835","nonce":2240940065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-30T16:44:58.752 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82c806cbc0 msgr2=0x7f82c806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82c806cbc0 0x7f82c806f080 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f82d8044000 tx=0x7f82d803f000 comp rx=0 tx=0).stop 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e80b64b0 msgr2=0x7f82e815dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e80b64b0 0x7f82e815dd80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f82d400e850 tx=0x7f82d400ed10 comp rx=0 tx=0).stop 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 shutdown_connections 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82c806cbc0 0x7f82c806f080 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82e8148eb0 0x7f82e815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e80b64b0 0x7f82e815dd80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 --2- 172.21.15.144:0/217504810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80b6020 0x7f82e8153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.753+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 >> 172.21.15.144:0/217504810 conn(0x7f82e80b6a60 msgr2=0x7f82e8162240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:58.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.754+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 shutdown_connections 2024-05-30T16:44:58.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.754+0000 7f82ed200640 1 -- 172.21.15.144:0/217504810 wait complete. 2024-05-30T16:44:58.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:44:58.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.945+0000 7f426e000640 1 Processor -- start 2024-05-30T16:44:58.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.946+0000 7f426e000640 1 -- start start 2024-05-30T16:44:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f426e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f426815ec60 0x7f426806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f426e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42680d1dc0 0x7f426806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f426e000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42680d08d0 con 0x7f426806cc70 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f426e000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f426815f5e0 con 0x7f426815ec60 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f426e000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f426815f8c0 con 0x7f42680d1dc0 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f4267400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f426815ec60 0x7f426806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f425ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f426806cc70 0x7f426809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53812/0 (socket says 172.21.15.144:53812) 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f425ea00640 1 -- 172.21.15.144:0/2202918613 learned_addr learned my addr 172.21.15.144:0/2202918613 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f4267e00640 1 --2- 172.21.15.144:0/2202918613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42680d1dc0 0x7f426806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f4267400640 1 -- 172.21.15.144:0/2202918613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42680d1dc0 msgr2=0x7f426806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f4267400640 1 --2- 172.21.15.144:0/2202918613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42680d1dc0 0x7f426806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f4267400640 1 -- 172.21.15.144:0/2202918613 >> v1:172.21.15.144:6789/0 conn(0x7f426806cc70 legacy=0x7f426809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.947+0000 7f4267400640 1 -- 172.21.15.144:0/2202918613 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426815fba0 con 0x7f426815ec60 2024-05-30T16:44:58.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.948+0000 7f4267400640 1 --2- 172.21.15.144:0/2202918613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f426815ec60 0x7f426806d0e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f42580097a0 tx=0x7f425802a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ccc504a005097f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:58.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f4266a00640 1 -- 172.21.15.144:0/2202918613 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258037070 con 0x7f426815ec60 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f4266a00640 1 -- 172.21.15.144:0/2202918613 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425802ae40 con 0x7f426815ec60 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f4266a00640 1 -- 172.21.15.144:0/2202918613 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258032660 con 0x7f426815ec60 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f426e000640 1 -- 172.21.15.144:0/2202918613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f426815ec60 msgr2=0x7f426806d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f426e000640 1 --2- 172.21.15.144:0/2202918613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f426815ec60 0x7f426806d0e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f42580097a0 tx=0x7f425802a0f0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f426e000640 1 -- 172.21.15.144:0/2202918613 shutdown_connections 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f426e000640 1 --2- 172.21.15.144:0/2202918613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42680d1dc0 0x7f426806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f426e000640 1 --2- 172.21.15.144:0/2202918613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f426815ec60 0x7f426806d0e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f426e000640 1 -- 172.21.15.144:0/2202918613 >> 172.21.15.144:0/2202918613 conn(0x7f42680b4180 msgr2=0x7f42680b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f426e000640 1 -- 172.21.15.144:0/2202918613 shutdown_connections 2024-05-30T16:44:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.949+0000 7f426e000640 1 -- 172.21.15.144:0/2202918613 wait complete. 2024-05-30T16:44:58.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.951+0000 7f426e000640 1 Processor -- start 2024-05-30T16:44:58.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.951+0000 7f426e000640 1 -- start start 2024-05-30T16:44:58.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.952+0000 7f426e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f426806cc70 0x7f42680b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.952+0000 7f426e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680d1dc0 0x7f42680cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.952+0000 7f426e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426815ec60 0x7f42680cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.952+0000 7f426e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42681627f0 con 0x7f42680d1dc0 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.952+0000 7f426e000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4268162670 con 0x7f426815ec60 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.952+0000 7f426e000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4268162970 con 0x7f426806cc70 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.952+0000 7f425ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680d1dc0 0x7f42680cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.952+0000 7f425ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680d1dc0 0x7f42680cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40844/0 (socket says 172.21.15.144:40844) 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.952+0000 7f425ea00640 1 -- 172.21.15.144:0/3794230382 learned_addr learned my addr 172.21.15.144:0/3794230382 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f425ea00640 1 -- 172.21.15.144:0/3794230382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f426806cc70 msgr2=0x7f42680b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f425ea00640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f426806cc70 0x7f42680b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f425ea00640 1 -- 172.21.15.144:0/3794230382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426815ec60 msgr2=0x7f42680cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f425ea00640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426815ec60 0x7f42680cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:58.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f425ea00640 1 -- 172.21.15.144:0/3794230382 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42680b6840 con 0x7f42680d1dc0 2024-05-30T16:44:58.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f425ea00640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680d1dc0 0x7f42680cd9b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f425000c3c0 tx=0x7f425000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:58.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f425fe00640 1 -- 172.21.15.144:0/3794230382 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4250017070 con 0x7f42680d1dc0 2024-05-30T16:44:58.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f425fe00640 1 -- 172.21.15.144:0/3794230382 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4250005ce0 con 0x7f42680d1dc0 2024-05-30T16:44:58.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f425fe00640 1 -- 172.21.15.144:0/3794230382 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42500072f0 con 0x7f42680d1dc0 2024-05-30T16:44:58.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42680b6b20 con 0x7f42680d1dc0 2024-05-30T16:44:58.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.953+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42680b70e0 con 0x7f42680d1dc0 2024-05-30T16:44:58.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.954+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4268068b90 con 0x7f42680d1dc0 2024-05-30T16:44:58.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.955+0000 7f425fe00640 1 -- 172.21.15.144:0/3794230382 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f425001a070 con 0x7f42680d1dc0 2024-05-30T16:44:58.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.956+0000 7f425fe00640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f424406cbc0 0x7f424406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:58.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.956+0000 7f425fe00640 1 -- 172.21.15.144:0/3794230382 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5737+0+0 (secure 0 0 0) 0x7f425008b420 con 0x7f42680d1dc0 2024-05-30T16:44:58.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.956+0000 7f4267400640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f424406cbc0 0x7f424406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:58.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.957+0000 7f4267400640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f424406cbc0 0x7f424406f080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4258034000 tx=0x7f425802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:58.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:58.961+0000 7f425fe00640 1 -- 172.21.15.144:0/3794230382 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42500593c0 con 0x7f42680d1dc0 2024-05-30T16:44:59.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.148+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42680b4ea0 con 0x7f42680d1dc0 2024-05-30T16:44:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.150+0000 7f425fe00640 1 -- 172.21.15.144:0/3794230382 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16770 (secure 0 0 0) 0x7f4250082e20 con 0x7f42680d1dc0 2024-05-30T16:44:59.151 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:44:59.151 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":33,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:44:57.596045+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:42:40.061111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T16:42:41.144734+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f424406cbc0 msgr2=0x7f424406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f424406cbc0 0x7f424406f080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4258034000 tx=0x7f425802c000 comp rx=0 tx=0).stop 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680d1dc0 msgr2=0x7f42680cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680d1dc0 0x7f42680cd9b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f425000c3c0 tx=0x7f425000c880 comp rx=0 tx=0).stop 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 shutdown_connections 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f424406cbc0 0x7f424406f080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426815ec60 0x7f42680cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680d1dc0 0x7f42680cd9b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 --2- 172.21.15.144:0/3794230382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f426806cc70 0x7f42680b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 >> 172.21.15.144:0/3794230382 conn(0x7f42680b4180 msgr2=0x7f42680718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 shutdown_connections 2024-05-30T16:44:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.153+0000 7f426e000640 1 -- 172.21.15.144:0/3794230382 wait complete. 2024-05-30T16:44:59.173 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T16:44:59.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.367+0000 7fe9cb600640 1 Processor -- start 2024-05-30T16:44:59.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.367+0000 7fe9cb600640 1 -- start start 2024-05-30T16:44:59.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.369+0000 7fe9cb600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159320 0x7fe9c406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.369+0000 7fe9cb600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe9c406f770 0x7fe9c415f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.369+0000 7fe9cb600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c415f120 con 0x7fe9c415fe40 2024-05-30T16:44:59.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.369+0000 7fe9cb600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c40cee40 con 0x7fe9c406f770 2024-05-30T16:44:59.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.369+0000 7fe9cb600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c40cf120 con 0x7fe9c4159320 2024-05-30T16:44:59.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.370+0000 7fe9c8c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159320 0x7fe9c406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.370+0000 7fe9c3e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe9c406f770 0x7fe9c415f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.370+0000 7fe9c8c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159320 0x7fe9c406efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:57340/0 (socket says 172.21.15.144:57340) 2024-05-30T16:44:59.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.370+0000 7fe9c8c00640 1 -- 172.21.15.144:0/1567257339 learned_addr learned my addr 172.21.15.144:0/1567257339 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:59.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.370+0000 7fe9c3e00640 1 --2- 172.21.15.144:0/1567257339 >> v2:172.21.15.149:3300/0 conn(0x7fe9c406f770 0x7fe9c415f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:59006/0 (socket says 172.21.15.144:59006) 2024-05-30T16:44:59.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.371+0000 7fe9c3e00640 1 -- 172.21.15.144:0/1567257339 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159320 msgr2=0x7fe9c406efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:59.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.371+0000 7fe9c3e00640 1 --2- 172.21.15.144:0/1567257339 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159320 0x7fe9c406efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.371+0000 7fe9c3e00640 1 -- 172.21.15.144:0/1567257339 >> v1:172.21.15.149:6789/0 conn(0x7fe9c415fe40 legacy=0x7fe9c40ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.371+0000 7fe9c3e00640 1 -- 172.21.15.144:0/1567257339 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c40cf400 con 0x7fe9c406f770 2024-05-30T16:44:59.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.371+0000 7fe9c8c00640 1 --2- 172.21.15.144:0/1567257339 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159320 0x7fe9c406efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:44:59.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.372+0000 7fe9c3e00640 1 --2- 172.21.15.144:0/1567257339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c406f770 0x7fe9c415f900 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00097a0 tx=0x7fe9b002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e274d8d340be606a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:59.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.372+0000 7fe9c3400640 1 -- 172.21.15.144:0/1567257339 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0037070 con 0x7fe9c406f770 2024-05-30T16:44:59.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.372+0000 7fe9c3400640 1 -- 172.21.15.144:0/1567257339 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b002ae50 con 0x7fe9c406f770 2024-05-30T16:44:59.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.372+0000 7fe9c3400640 1 -- 172.21.15.144:0/1567257339 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0032660 con 0x7fe9c406f770 2024-05-30T16:44:59.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.373+0000 7fe9cb600640 1 -- 172.21.15.144:0/1567257339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c406f770 msgr2=0x7fe9c415f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.373+0000 7fe9cb600640 1 --2- 172.21.15.144:0/1567257339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c406f770 0x7fe9c415f900 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00097a0 tx=0x7fe9b002a100 comp rx=0 tx=0).stop 2024-05-30T16:44:59.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.373+0000 7fe9cb600640 1 -- 172.21.15.144:0/1567257339 shutdown_connections 2024-05-30T16:44:59.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.373+0000 7fe9cb600640 1 --2- 172.21.15.144:0/1567257339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c406f770 0x7fe9c415f900 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.373+0000 7fe9cb600640 1 --2- 172.21.15.144:0/1567257339 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159320 0x7fe9c406efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.373+0000 7fe9cb600640 1 -- 172.21.15.144:0/1567257339 >> 172.21.15.144:0/1567257339 conn(0x7fe9c40629c0 msgr2=0x7fe9c406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:59.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.373+0000 7fe9cb600640 1 -- 172.21.15.144:0/1567257339 shutdown_connections 2024-05-30T16:44:59.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.373+0000 7fe9cb600640 1 -- 172.21.15.144:0/1567257339 wait complete. 2024-05-30T16:44:59.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.375+0000 7fe9cb600640 1 Processor -- start 2024-05-30T16:44:59.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.375+0000 7fe9cb600640 1 -- start start 2024-05-30T16:44:59.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.375+0000 7fe9cb600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c406f770 0x7fe9c4142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9cb600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c4159320 0x7fe9c414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9cb600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c41f8ce0 0x7fe9c41502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9cb600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c40cd2b0 con 0x7fe9c406f770 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9cb600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c406fbd0 con 0x7fe9c4159320 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9cb600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c40cd430 con 0x7fe9c41f8ce0 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c406f770 0x7fe9c4142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c406f770 0x7fe9c4142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40858/0 (socket says 172.21.15.144:40858) 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c8c00640 1 -- 172.21.15.144:0/2236759254 learned_addr learned my addr 172.21.15.144:0/2236759254 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c8c00640 1 -- 172.21.15.144:0/2236759254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c41f8ce0 msgr2=0x7fe9c41502c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c3e00640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c4159320 0x7fe9c414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c8c00640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c41f8ce0 0x7fe9c41502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c8c00640 1 -- 172.21.15.144:0/2236759254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c4159320 msgr2=0x7fe9c414ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c8c00640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c4159320 0x7fe9c414ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c8c00640 1 -- 172.21.15.144:0/2236759254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c414f6e0 con 0x7fe9c406f770 2024-05-30T16:44:59.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.376+0000 7fe9c3e00640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c4159320 0x7fe9c414ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:44:59.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.377+0000 7fe9c8c00640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c406f770 0x7fe9c4142130 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009f20 tx=0x7fe9b400c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:59.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.377+0000 7fe9c0c00640 1 -- 172.21.15.144:0/2236759254 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4014480 con 0x7fe9c406f770 2024-05-30T16:44:59.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.377+0000 7fe9c0c00640 1 -- 172.21.15.144:0/2236759254 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b4019070 con 0x7fe9c406f770 2024-05-30T16:44:59.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.377+0000 7fe9c0c00640 1 -- 172.21.15.144:0/2236759254 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4014820 con 0x7fe9c406f770 2024-05-30T16:44:59.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.377+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c414f9c0 con 0x7fe9c406f770 2024-05-30T16:44:59.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.377+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c414f320 con 0x7fe9c406f770 2024-05-30T16:44:59.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.378+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c406c870 con 0x7fe9c406f770 2024-05-30T16:44:59.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.379+0000 7fe9c0c00640 1 -- 172.21.15.144:0/2236759254 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fe9b4005d10 con 0x7fe9c406f770 2024-05-30T16:44:59.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.380+0000 7fe9c0c00640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe9a406cbc0 0x7fe9a406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.380+0000 7fe9c0c00640 1 -- 172.21.15.144:0/2236759254 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5737+0+0 (secure 0 0 0) 0x7fe9b408c570 con 0x7fe9c406f770 2024-05-30T16:44:59.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.380+0000 7fe9c3e00640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe9a406cbc0 0x7fe9a406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.380+0000 7fe9c3e00640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe9a406cbc0 0x7fe9a406f080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0034000 tx=0x7fe9b002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:59.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.384+0000 7fe9c0c00640 1 -- 172.21.15.144:0/2236759254 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe9b4010040 con 0x7fe9c406f770 2024-05-30T16:44:59.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.608+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe9c4068b20 con 0x7fe9c406f770 2024-05-30T16:44:59.611 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-05-30T16:44:59.610+0000 7fd91d600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T16:44:59.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.622+0000 7fe9c0c00640 1 -- 172.21.15.144:0/2236759254 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fe9b405a5b0 con 0x7fe9c406f770 2024-05-30T16:44:59.623 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe9a406cbc0 msgr2=0x7fe9a406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe9a406cbc0 0x7fe9a406f080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0034000 tx=0x7fe9b002e000 comp rx=0 tx=0).stop 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c406f770 msgr2=0x7fe9c4142130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c406f770 0x7fe9c4142130 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009f20 tx=0x7fe9b400c550 comp rx=0 tx=0).stop 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 shutdown_connections 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe9a406cbc0 0x7fe9a406f080 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c41f8ce0 0x7fe9c41502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c4159320 0x7fe9c414ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 --2- 172.21.15.144:0/2236759254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c406f770 0x7fe9c4142130 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.625+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 >> 172.21.15.144:0/2236759254 conn(0x7fe9c40629c0 msgr2=0x7fe9c40cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:59.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.626+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 shutdown_connections 2024-05-30T16:44:59.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.626+0000 7fe9cb600640 1 -- 172.21.15.144:0/2236759254 wait complete. 2024-05-30T16:44:59.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T16:44:59.749 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-05-30T16:44:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.837+0000 7f8b72800640 1 Processor -- start 2024-05-30T16:44:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.838+0000 7f8b72800640 1 -- start start 2024-05-30T16:44:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.839+0000 7f8b72800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8b6c0cfc40 0x7f8b6c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.839+0000 7f8b72800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8b6c06f610 0x7f8b6c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.839+0000 7f8b72800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b6c0d00f0 con 0x7f8b6c145150 2024-05-30T16:44:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.839+0000 7f8b72800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6c06fa60 con 0x7f8b6c0cfc40 2024-05-30T16:44:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.839+0000 7f8b72800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6c15f140 con 0x7f8b6c06f610 2024-05-30T16:44:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.840+0000 7f8b6aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8b6c0cfc40 0x7f8b6c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.840+0000 7f8b6aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8b6c0cfc40 0x7f8b6c06f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40870/0 (socket says 172.21.15.144:40870) 2024-05-30T16:44:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.840+0000 7f8b6aa00640 1 -- 172.21.15.144:0/3651405954 learned_addr learned my addr 172.21.15.144:0/3651405954 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.840+0000 7f8b6be00640 1 --2- 172.21.15.144:0/3651405954 >> v2:172.21.15.149:3300/0 conn(0x7f8b6c06f610 0x7f8b6c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.840+0000 7f8b6aa00640 1 -- 172.21.15.144:0/3651405954 >> v2:172.21.15.149:3300/0 conn(0x7f8b6c06f610 msgr2=0x7f8b6c0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.840+0000 7f8b6aa00640 1 --2- 172.21.15.144:0/3651405954 >> v2:172.21.15.149:3300/0 conn(0x7f8b6c06f610 0x7f8b6c0b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.840+0000 7f8b6aa00640 1 -- 172.21.15.144:0/3651405954 >> v1:172.21.15.149:6789/0 conn(0x7f8b6c145150 legacy=0x7f8b6c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:44:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.840+0000 7f8b6aa00640 1 -- 172.21.15.144:0/3651405954 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c15f390 con 0x7f8b6c0cfc40 2024-05-30T16:44:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.841+0000 7f8b6aa00640 1 --2- 172.21.15.144:0/3651405954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c0cfc40 0x7f8b6c06f0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c06fe00 tx=0x7f8b5802c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c225a36b6199e01 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.841+0000 7f8b6a000640 1 -- 172.21.15.144:0/3651405954 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58039070 con 0x7f8b6c0cfc40 2024-05-30T16:44:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.841+0000 7f8b6a000640 1 -- 172.21.15.144:0/3651405954 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b58034640 con 0x7f8b6c0cfc40 2024-05-30T16:44:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.841+0000 7f8b6a000640 1 -- 172.21.15.144:0/3651405954 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58034a10 con 0x7f8b6c0cfc40 2024-05-30T16:44:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.842+0000 7f8b72800640 1 -- 172.21.15.144:0/3651405954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c0cfc40 msgr2=0x7f8b6c06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.842+0000 7f8b72800640 1 --2- 172.21.15.144:0/3651405954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c0cfc40 0x7f8b6c06f0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c06fe00 tx=0x7f8b5802c3b0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.842+0000 7f8b72800640 1 -- 172.21.15.144:0/3651405954 shutdown_connections 2024-05-30T16:44:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.842+0000 7f8b72800640 1 --2- 172.21.15.144:0/3651405954 >> v2:172.21.15.149:3300/0 conn(0x7f8b6c06f610 0x7f8b6c0b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.842+0000 7f8b72800640 1 --2- 172.21.15.144:0/3651405954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c0cfc40 0x7f8b6c06f0d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.842+0000 7f8b72800640 1 -- 172.21.15.144:0/3651405954 >> 172.21.15.144:0/3651405954 conn(0x7f8b6c06bd00 msgr2=0x7f8b6c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:44:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.842+0000 7f8b72800640 1 -- 172.21.15.144:0/3651405954 shutdown_connections 2024-05-30T16:44:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.842+0000 7f8b72800640 1 -- 172.21.15.144:0/3651405954 wait complete. 2024-05-30T16:44:59.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.844+0000 7f8b72800640 1 Processor -- start 2024-05-30T16:44:59.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.844+0000 7f8b72800640 1 -- start start 2024-05-30T16:44:59.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.845+0000 7f8b72800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c06f610 0x7f8b6c1e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.845+0000 7f8b72800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b6c0cfc40 0x7f8b6c140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.845+0000 7f8b72800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b6c145150 0x7f8b6c0c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.845+0000 7f8b72800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c0b64f0 con 0x7f8b6c06f610 2024-05-30T16:44:59.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.845+0000 7f8b72800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c15f950 con 0x7f8b6c145150 2024-05-30T16:44:59.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.845+0000 7f8b72800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6c15fe70 con 0x7f8b6c0cfc40 2024-05-30T16:44:59.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.845+0000 7f8b6b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c06f610 0x7f8b6c1e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.845+0000 7f8b6b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c06f610 0x7f8b6c1e5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40880/0 (socket says 172.21.15.144:40880) 2024-05-30T16:44:59.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.845+0000 7f8b6b400640 1 -- 172.21.15.144:0/627473469 learned_addr learned my addr 172.21.15.144:0/627473469 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:44:59.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b6b400640 1 -- 172.21.15.144:0/627473469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b6c0cfc40 msgr2=0x7f8b6c140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b6b400640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b6c0cfc40 0x7f8b6c140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b6b400640 1 -- 172.21.15.144:0/627473469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b6c145150 msgr2=0x7f8b6c0c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:44:59.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b6be00640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b6c145150 0x7f8b6c0c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b6b400640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b6c145150 0x7f8b6c0c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:44:59.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b6b400640 1 -- 172.21.15.144:0/627473469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c1e6370 con 0x7f8b6c06f610 2024-05-30T16:44:59.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b6b400640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c06f610 0x7f8b6c1e5e30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00b3e0 tx=0x7f8b5c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:59.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b63400640 1 -- 172.21.15.144:0/627473469 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c015020 con 0x7f8b6c06f610 2024-05-30T16:44:59.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b63400640 1 -- 172.21.15.144:0/627473469 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c011850 con 0x7f8b6c06f610 2024-05-30T16:44:59.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b63400640 1 -- 172.21.15.144:0/627473469 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c011c40 con 0x7f8b6c06f610 2024-05-30T16:44:59.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.846+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6c15bd20 con 0x7f8b6c06f610 2024-05-30T16:44:59.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.847+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6c15c2e0 con 0x7f8b6c06f610 2024-05-30T16:44:59.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.848+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6c068b90 con 0x7f8b6c06f610 2024-05-30T16:44:59.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.848+0000 7f8b63400640 1 -- 172.21.15.144:0/627473469 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f8b5c018020 con 0x7f8b6c06f610 2024-05-30T16:44:59.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.849+0000 7f8b63400640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8b4c06cbc0 0x7f8b4c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:44:59.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.849+0000 7f8b63400640 1 -- 172.21.15.144:0/627473469 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f8b5c08bfc0 con 0x7f8b6c06f610 2024-05-30T16:44:59.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.850+0000 7f8b6aa00640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8b4c06cbc0 0x7f8b4c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:44:59.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.850+0000 7f8b6aa00640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8b4c06cbc0 0x7f8b4c06f080 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8b58036000 tx=0x7f8b5802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:44:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:44:59.854+0000 7f8b63400640 1 -- 172.21.15.144:0/627473469 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b5c01f020 con 0x7f8b6c06f610 2024-05-30T16:45:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.080+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8b6c144950 con 0x7f8b6c06f610 2024-05-30T16:45:00.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.627+0000 7f8b63400640 1 -- 172.21.15.144:0/627473469 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f8b5c0172c0 con 0x7f8b6c06f610 2024-05-30T16:45:00.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8b4c06cbc0 msgr2=0x7f8b4c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:00.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8b4c06cbc0 0x7f8b4c06f080 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8b58036000 tx=0x7f8b5802e000 comp rx=0 tx=0).stop 2024-05-30T16:45:00.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c06f610 msgr2=0x7f8b6c1e5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:00.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c06f610 0x7f8b6c1e5e30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00b3e0 tx=0x7f8b5c00b8a0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 shutdown_connections 2024-05-30T16:45:00.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8b4c06cbc0 0x7f8b4c06f080 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b6c145150 0x7f8b6c0c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b6c0cfc40 0x7f8b6c140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 --2- 172.21.15.144:0/627473469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b6c06f610 0x7f8b6c1e5e30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 >> 172.21.15.144:0/627473469 conn(0x7f8b6c06bd00 msgr2=0x7f8b6c0b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:00.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 shutdown_connections 2024-05-30T16:45:00.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.631+0000 7f8b72800640 1 -- 172.21.15.144:0/627473469 wait complete. 2024-05-30T16:45:00.657 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T16:45:00.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.858+0000 7fb99f000640 1 Processor -- start 2024-05-30T16:45:00.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.858+0000 7fb99f000640 1 -- start start 2024-05-30T16:45:00.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.860+0000 7fb99f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9980afa00 0x7fb99815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:00.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.860+0000 7fb99f000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb9980cc7a0 0x7fb998140570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:00.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.860+0000 7fb99f000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9980cd030 con 0x7fb99806dfc0 2024-05-30T16:45:00.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.860+0000 7fb99f000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb9981413f0 con 0x7fb9980cc7a0 2024-05-30T16:45:00.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.860+0000 7fb99f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb9980cd860 con 0x7fb9980afa00 2024-05-30T16:45:00.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.860+0000 7fb99d000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb99806dfc0 0x7fb99815e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53814/0 (socket says 172.21.15.144:53814) 2024-05-30T16:45:00.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.860+0000 7fb99d000640 1 -- 172.21.15.144:0/3116650732 learned_addr learned my addr 172.21.15.144:0/3116650732 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:00.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.860+0000 7fb997e00640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9980afa00 0x7fb99815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:00.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959148783 0 0) 0x7fb9980cd030 con 0x7fb99806dfc0 2024-05-30T16:45:00.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb978003520 con 0x7fb99806dfc0 2024-05-30T16:45:00.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb98f400640 1 --2- 172.21.15.144:0/3116650732 >> v2:172.21.15.149:3300/0 conn(0x7fb9980cc7a0 0x7fb998140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:00.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2227341636 0 0) 0x7fb978003520 con 0x7fb99806dfc0 2024-05-30T16:45:00.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9980afa00 msgr2=0x7fb99815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:00.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9980afa00 0x7fb99815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 >> v2:172.21.15.149:3300/0 conn(0x7fb9980cc7a0 msgr2=0x7fb998140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:00.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 --2- 172.21.15.144:0/3116650732 >> v2:172.21.15.149:3300/0 conn(0x7fb9980cc7a0 0x7fb998140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99815c2d0 con 0x7fb99806dfc0 2024-05-30T16:45:00.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fb9900019f0 con 0x7fb99806dfc0 2024-05-30T16:45:00.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb98f400640 1 --2- 172.21.15.144:0/3116650732 >> v2:172.21.15.149:3300/0 conn(0x7fb9980cc7a0 0x7fb998140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:45:00.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 >> v1:172.21.15.144:6789/0 conn(0x7fb99806dfc0 legacy=0x7fb99815e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:00.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780039e0 0x7fb978003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:00.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9980afa00 0x7fb978004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:00.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb978004d40 0x7fb9780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:00.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9980cd860 con 0x7fb9780039e0 2024-05-30T16:45:00.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb97800b9c0 con 0x7fb978004d40 2024-05-30T16:45:00.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb97800bb70 con 0x7fb9980afa00 2024-05-30T16:45:00.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.861+0000 7fb997e00640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780039e0 0x7fb978003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:00.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.862+0000 7fb997e00640 1 -- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9980afa00 msgr2=0x7fb978004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:00.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.862+0000 7fb997e00640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9980afa00 0x7fb978004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.862+0000 7fb997e00640 1 -- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb978004d40 msgr2=0x7fb9780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:00.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.862+0000 7fb99d000640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb978004d40 0x7fb9780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:00.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.862+0000 7fb997e00640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb978004d40 0x7fb9780051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.862+0000 7fb997e00640 1 -- 172.21.15.144:0/3116650732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb978003520 con 0x7fb9780039e0 2024-05-30T16:45:00.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.863+0000 7fb997e00640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780039e0 0x7fb978003e00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb980009650 tx=0x7fb978005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85ac9c61f8265b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:00.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.863+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980038070 con 0x7fb9780039e0 2024-05-30T16:45:00.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.863+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb980033400 con 0x7fb9780039e0 2024-05-30T16:45:00.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.863+0000 7fb997400640 1 -- 172.21.15.144:0/3116650732 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980009690 con 0x7fb9780039e0 2024-05-30T16:45:00.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.864+0000 7fb99f000640 1 -- 172.21.15.144:0/3116650732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780039e0 msgr2=0x7fb978003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:00.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.864+0000 7fb99f000640 1 --2- 172.21.15.144:0/3116650732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780039e0 0x7fb978003e00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb980009650 tx=0x7fb978005830 comp rx=0 tx=0).stop 2024-05-30T16:45:00.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.864+0000 7fb99d000640 1 -- 172.21.15.144:0/3116650732 reap_dead start 2024-05-30T16:45:00.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.864+0000 7fb99f000640 1 -- 172.21.15.144:0/3116650732 shutdown_connections 2024-05-30T16:45:00.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.864+0000 7fb99f000640 1 -- 172.21.15.144:0/3116650732 >> 172.21.15.144:0/3116650732 conn(0x7fb99806bd00 msgr2=0x7fb99806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:00.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.864+0000 7fb99f000640 1 -- 172.21.15.144:0/3116650732 shutdown_connections 2024-05-30T16:45:00.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.864+0000 7fb99f000640 1 -- 172.21.15.144:0/3116650732 wait complete. 2024-05-30T16:45:00.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.865+0000 7fb99f000640 1 Processor -- start 2024-05-30T16:45:00.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.866+0000 7fb99f000640 1 -- start start 2024-05-30T16:45:00.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.866+0000 7fb99f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780039e0 0x7fb99813c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:00.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.866+0000 7fb99f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb998139cf0 0x7fb9980b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:00.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99f000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9980b5b20 0x7fb998146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:00.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99f000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9980cd580 con 0x7fb9980b5b20 2024-05-30T16:45:00.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99f000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb9980cd2a0 con 0x7fb998139cf0 2024-05-30T16:45:00.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb9980ccc60 con 0x7fb9780039e0 2024-05-30T16:45:00.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9980b5b20 0x7fb998146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:00.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9980b5b20 0x7fb998146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40898/0 (socket says 172.21.15.144:40898) 2024-05-30T16:45:00.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99d000640 1 -- 172.21.15.144:0/452233456 learned_addr learned my addr 172.21.15.144:0/452233456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:00.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb997e00640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780039e0 0x7fb99813c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:00.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb98f400640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb998139cf0 0x7fb9980b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:00.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99d000640 1 -- 172.21.15.144:0/452233456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780039e0 msgr2=0x7fb99813c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:00.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99d000640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780039e0 0x7fb99813c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99d000640 1 -- 172.21.15.144:0/452233456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb998139cf0 msgr2=0x7fb9980b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99d000640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb998139cf0 0x7fb9980b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb99d000640 1 -- 172.21.15.144:0/452233456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99813b620 con 0x7fb9980b5b20 2024-05-30T16:45:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.867+0000 7fb98f400640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb998139cf0 0x7fb9980b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.868+0000 7fb99d000640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9980b5b20 0x7fb998146df0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb9980b63e0 tx=0x7fb99000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.868+0000 7fb994c00640 1 -- 172.21.15.144:0/452233456 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990004d60 con 0x7fb9980b5b20 2024-05-30T16:45:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.868+0000 7fb994c00640 1 -- 172.21.15.144:0/452233456 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99000bb20 con 0x7fb9980b5b20 2024-05-30T16:45:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.868+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9981f0a50 con 0x7fb9980b5b20 2024-05-30T16:45:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.868+0000 7fb994c00640 1 -- 172.21.15.144:0/452233456 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990007070 con 0x7fb9980b5b20 2024-05-30T16:45:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.868+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99813bb80 con 0x7fb9980b5b20 2024-05-30T16:45:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.869+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9980b5fa0 con 0x7fb9980b5b20 2024-05-30T16:45:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.870+0000 7fb994c00640 1 -- 172.21.15.144:0/452233456 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fb99001b020 con 0x7fb9980b5b20 2024-05-30T16:45:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.871+0000 7fb994c00640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb97406cbf0 0x7fb97406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.871+0000 7fb994c00640 1 -- 172.21.15.144:0/452233456 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7fb99008c2c0 con 0x7fb9980b5b20 2024-05-30T16:45:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.871+0000 7fb997e00640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb97406cbf0 0x7fb97406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:00.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.872+0000 7fb997e00640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb97406cbf0 0x7fb97406f0b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb980000c00 tx=0x7fb980008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:00.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:00.875+0000 7fb994c00640 1 -- 172.21.15.144:0/452233456 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb99813b620 con 0x7fb9980b5b20 2024-05-30T16:45:01.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.063+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb998068b90 con 0x7fb9980b5b20 2024-05-30T16:45:01.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.638+0000 7fb994c00640 1 -- 172.21.15.144:0/452233456 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7fb99815c2d0 con 0x7fb9980b5b20 2024-05-30T16:45:01.639 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.641+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb97406cbf0 msgr2=0x7fb97406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.641+0000 7fb99f000640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb97406cbf0 0x7fb97406f0b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb980000c00 tx=0x7fb980008030 comp rx=0 tx=0).stop 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.641+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9980b5b20 msgr2=0x7fb998146df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.641+0000 7fb99f000640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9980b5b20 0x7fb998146df0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb9980b63e0 tx=0x7fb99000b4a0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.642+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 shutdown_connections 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.642+0000 7fb99f000640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb97406cbf0 0x7fb97406f0b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.642+0000 7fb99f000640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9980b5b20 0x7fb998146df0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.642+0000 7fb99f000640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb998139cf0 0x7fb9980b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.642+0000 7fb99f000640 1 --2- 172.21.15.144:0/452233456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780039e0 0x7fb99813c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.642+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 >> 172.21.15.144:0/452233456 conn(0x7fb99806bd00 msgr2=0x7fb9980b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.642+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 shutdown_connections 2024-05-30T16:45:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.642+0000 7fb99f000640 1 -- 172.21.15.144:0/452233456 wait complete. 2024-05-30T16:45:01.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T16:45:01.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.851+0000 7fe73dc00640 1 Processor -- start 2024-05-30T16:45:01.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.851+0000 7fe73dc00640 1 -- start start 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.853+0000 7fe73dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe73813f760 0x7fe73806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.853+0000 7fe73dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7380cec70 0x7fe7380b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.853+0000 7fe73dc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7380b5e00 0x7fe738142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.853+0000 7fe73dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe7381612b0 con 0x7fe73813f760 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.853+0000 7fe73dc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe73813fb40 con 0x7fe7380b5e00 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.853+0000 7fe73dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe73806ee80 con 0x7fe7380cec70 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.853+0000 7fe736a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe73813f760 0x7fe73806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.853+0000 7fe736a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe73813f760 0x7fe73806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40912/0 (socket says 172.21.15.144:40912) 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.853+0000 7fe736a00640 1 -- 172.21.15.144:0/574102592 learned_addr learned my addr 172.21.15.144:0/574102592 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.854+0000 7fe736a00640 1 -- 172.21.15.144:0/574102592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7380cec70 msgr2=0x7fe7380b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.854+0000 7fe736a00640 1 --2- 172.21.15.144:0/574102592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7380cec70 0x7fe7380b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.854+0000 7fe736a00640 1 -- 172.21.15.144:0/574102592 >> v2:172.21.15.149:3300/0 conn(0x7fe7380b5e00 msgr2=0x7fe738142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:01.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.854+0000 7fe737400640 1 --2- 172.21.15.144:0/574102592 >> v2:172.21.15.149:3300/0 conn(0x7fe7380b5e00 0x7fe738142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:01.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.854+0000 7fe736a00640 1 --2- 172.21.15.144:0/574102592 >> v2:172.21.15.149:3300/0 conn(0x7fe7380b5e00 0x7fe738142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.854+0000 7fe736a00640 1 -- 172.21.15.144:0/574102592 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe738160730 con 0x7fe73813f760 2024-05-30T16:45:01.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.855+0000 7fe736a00640 1 --2- 172.21.15.144:0/574102592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73813f760 0x7fe73806e940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe7380cdfe0 tx=0x7fe72802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f884f5aae029557c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:01.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.855+0000 7fe735600640 1 -- 172.21.15.144:0/574102592 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728037070 con 0x7fe73813f760 2024-05-30T16:45:01.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.855+0000 7fe735600640 1 -- 172.21.15.144:0/574102592 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe728032440 con 0x7fe73813f760 2024-05-30T16:45:01.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.855+0000 7fe735600640 1 -- 172.21.15.144:0/574102592 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728032810 con 0x7fe73813f760 2024-05-30T16:45:01.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.856+0000 7fe73dc00640 1 -- 172.21.15.144:0/574102592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73813f760 msgr2=0x7fe73806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:01.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.856+0000 7fe73dc00640 1 --2- 172.21.15.144:0/574102592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73813f760 0x7fe73806e940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe7380cdfe0 tx=0x7fe72802a270 comp rx=0 tx=0).stop 2024-05-30T16:45:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.856+0000 7fe73dc00640 1 -- 172.21.15.144:0/574102592 shutdown_connections 2024-05-30T16:45:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.856+0000 7fe73dc00640 1 --2- 172.21.15.144:0/574102592 >> v2:172.21.15.149:3300/0 conn(0x7fe7380b5e00 0x7fe738142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.856+0000 7fe73dc00640 1 --2- 172.21.15.144:0/574102592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7380cec70 0x7fe7380b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.856+0000 7fe73dc00640 1 --2- 172.21.15.144:0/574102592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73813f760 0x7fe73806e940 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.856+0000 7fe73dc00640 1 -- 172.21.15.144:0/574102592 >> 172.21.15.144:0/574102592 conn(0x7fe73806bd00 msgr2=0x7fe73806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.856+0000 7fe73dc00640 1 -- 172.21.15.144:0/574102592 shutdown_connections 2024-05-30T16:45:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.856+0000 7fe73dc00640 1 -- 172.21.15.144:0/574102592 wait complete. 2024-05-30T16:45:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.857+0000 7fe73dc00640 1 Processor -- start 2024-05-30T16:45:01.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.858+0000 7fe73dc00640 1 -- start start 2024-05-30T16:45:01.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.858+0000 7fe73dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7380b5e00 0x7fe7380b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:01.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.858+0000 7fe73dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7380cec70 0x7fe7380b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:01.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.858+0000 7fe73dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe73813f760 0x7fe738155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:01.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.858+0000 7fe73dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe738160fd0 con 0x7fe7380cec70 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.858+0000 7fe73dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe738160cf0 con 0x7fe73813f760 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.858+0000 7fe73dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7380cf0d0 con 0x7fe7380b5e00 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe736000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7380cec70 0x7fe7380b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe736000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7380cec70 0x7fe7380b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40922/0 (socket says 172.21.15.144:40922) 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe736000640 1 -- 172.21.15.144:0/1052166187 learned_addr learned my addr 172.21.15.144:0/1052166187 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe736000640 1 -- 172.21.15.144:0/1052166187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7380b5e00 msgr2=0x7fe7380b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe737400640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe73813f760 0x7fe738155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe736000640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7380b5e00 0x7fe7380b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe736000640 1 -- 172.21.15.144:0/1052166187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe73813f760 msgr2=0x7fe738155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe736000640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe73813f760 0x7fe738155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe736000640 1 -- 172.21.15.144:0/1052166187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7381f22c0 con 0x7fe7380cec70 2024-05-30T16:45:01.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.859+0000 7fe736000640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7380cec70 0x7fe7380b1ee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe72400b4d0 tx=0x7fe72400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:01.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.860+0000 7fe72ea00640 1 -- 172.21.15.144:0/1052166187 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724014070 con 0x7fe7380cec70 2024-05-30T16:45:01.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.860+0000 7fe72ea00640 1 -- 172.21.15.144:0/1052166187 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe724010870 con 0x7fe7380cec70 2024-05-30T16:45:01.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.860+0000 7fe72ea00640 1 -- 172.21.15.144:0/1052166187 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724010c60 con 0x7fe7380cec70 2024-05-30T16:45:01.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.860+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7380b0a70 con 0x7fe7380cec70 2024-05-30T16:45:01.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.860+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7380b1030 con 0x7fe7380cec70 2024-05-30T16:45:01.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.861+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe738068b90 con 0x7fe7380cec70 2024-05-30T16:45:01.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.862+0000 7fe72ea00640 1 -- 172.21.15.144:0/1052166187 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fe724017070 con 0x7fe7380cec70 2024-05-30T16:45:01.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.863+0000 7fe72ea00640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe71806cbc0 0x7fe71806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:01.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.863+0000 7fe72ea00640 1 -- 172.21.15.144:0/1052166187 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7fe72408bd60 con 0x7fe7380cec70 2024-05-30T16:45:01.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.863+0000 7fe736a00640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe71806cbc0 0x7fe71806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:01.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.864+0000 7fe736a00640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe71806cbc0 0x7fe71806f080 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe728034000 tx=0x7fe72802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:01.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:01.867+0000 7fe72ea00640 1 -- 172.21.15.144:0/1052166187 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe724059e80 con 0x7fe7380cec70 2024-05-30T16:45:02.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.058+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe738153a20 con 0x7fe7380cec70 2024-05-30T16:45:02.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.650+0000 7fe72ea00640 1 -- 172.21.15.144:0/1052166187 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7fe724059780 con 0x7fe7380cec70 2024-05-30T16:45:02.651 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-05-30T16:45:02.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe71806cbc0 msgr2=0x7fe71806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:02.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe71806cbc0 0x7fe71806f080 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe728034000 tx=0x7fe72802c000 comp rx=0 tx=0).stop 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7380cec70 msgr2=0x7fe7380b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7380cec70 0x7fe7380b1ee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe72400b4d0 tx=0x7fe72400b990 comp rx=0 tx=0).stop 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 shutdown_connections 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe71806cbc0 0x7fe71806f080 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe73813f760 0x7fe738155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7380cec70 0x7fe7380b1ee0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 --2- 172.21.15.144:0/1052166187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7380b5e00 0x7fe7380b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 >> 172.21.15.144:0/1052166187 conn(0x7fe73806bd00 msgr2=0x7fe73806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 shutdown_connections 2024-05-30T16:45:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.655+0000 7fe73dc00640 1 -- 172.21.15.144:0/1052166187 wait complete. 2024-05-30T16:45:02.679 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T16:45:02.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.880+0000 7f602de00640 1 Processor -- start 2024-05-30T16:45:02.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.880+0000 7f602de00640 1 -- start start 2024-05-30T16:45:02.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.882+0000 7f602de00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f60280b6a10 0x7f60280ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:02.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.882+0000 7f602de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60280b91c0 con 0x7f602815ea90 2024-05-30T16:45:02.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.882+0000 7f602de00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60280b94a0 con 0x7f60280d3b70 2024-05-30T16:45:02.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.882+0000 7f602de00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f60280b9dd0 con 0x7f60280b6a10 2024-05-30T16:45:02.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.882+0000 7f6026a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f602815ea90 0x7f60280b6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53822/0 (socket says 172.21.15.144:53822) 2024-05-30T16:45:02.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.882+0000 7f6026a00640 1 -- 172.21.15.144:0/3590103971 learned_addr learned my addr 172.21.15.144:0/3590103971 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.882+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464096901 0 0) 0x7f60280b91c0 con 0x7f602815ea90 2024-05-30T16:45:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.882+0000 7f6026000640 1 --2- 172.21.15.144:0/3590103971 >> v2:172.21.15.149:3300/0 conn(0x7f60280b6a10 0x7f60280ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.882+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f600c003520 con 0x7f602815ea90 2024-05-30T16:45:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2876592494 0 0) 0x7f600c003520 con 0x7f602815ea90 2024-05-30T16:45:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 >> v2:172.21.15.149:3300/0 conn(0x7f60280b6a10 msgr2=0x7f60280ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 --2- 172.21.15.144:0/3590103971 >> v2:172.21.15.149:3300/0 conn(0x7f60280b6a10 0x7f60280ba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 >> v1:172.21.15.149:6789/0 conn(0x7f60280d3b70 legacy=0x7f60280b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60280b9780 con 0x7f602815ea90 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f6018001670 con 0x7f602815ea90 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 >> v1:172.21.15.144:6789/0 conn(0x7f602815ea90 legacy=0x7f60280b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f600c0039b0 0x7f600c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f600c004800 0x7f600c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f600c0051c0 0x7f600c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f600c00c0c0 con 0x7f600c004800 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f600c00c270 con 0x7f600c0039b0 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f600c00c470 con 0x7f600c0051c0 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.883+0000 7f6026000640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f600c004800 0x7f600c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.884+0000 7f6026a00640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f600c0039b0 0x7f600c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.884+0000 7f6026000640 1 -- 172.21.15.144:0/3590103971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f600c0051c0 msgr2=0x7f600c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.884+0000 7f6026000640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f600c0051c0 0x7f600c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.884+0000 7f6026000640 1 -- 172.21.15.144:0/3590103971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f600c0039b0 msgr2=0x7f600c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.884+0000 7f6026000640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f600c0039b0 0x7f600c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.884+0000 7f6026000640 1 -- 172.21.15.144:0/3590103971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c003520 con 0x7f600c004800 2024-05-30T16:45:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.884+0000 7f6027400640 1 -- 172.21.15.144:0/3590103971 reap_dead start 2024-05-30T16:45:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.885+0000 7f6026000640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f600c004800 0x7f600c004c80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f601400ba00 tx=0x7f600c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe95c8d83d16af5c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.885+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014030070 con 0x7f600c004800 2024-05-30T16:45:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.885+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601402ad70 con 0x7f600c004800 2024-05-30T16:45:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.885+0000 7f6025600640 1 -- 172.21.15.144:0/3590103971 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601400b600 con 0x7f600c004800 2024-05-30T16:45:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.886+0000 7f602de00640 1 -- 172.21.15.144:0/3590103971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f600c004800 msgr2=0x7f600c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.886+0000 7f602de00640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f600c004800 0x7f600c004c80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f601400ba00 tx=0x7f600c005830 comp rx=0 tx=0).stop 2024-05-30T16:45:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.886+0000 7f602de00640 1 -- 172.21.15.144:0/3590103971 shutdown_connections 2024-05-30T16:45:02.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.886+0000 7f602de00640 1 --2- 172.21.15.144:0/3590103971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f600c004800 0x7f600c004c80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.886+0000 7f602de00640 1 -- 172.21.15.144:0/3590103971 >> 172.21.15.144:0/3590103971 conn(0x7f60280627b0 msgr2=0x7f6028062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:02.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.886+0000 7f602de00640 1 -- 172.21.15.144:0/3590103971 shutdown_connections 2024-05-30T16:45:02.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.886+0000 7f602de00640 1 -- 172.21.15.144:0/3590103971 wait complete. 2024-05-30T16:45:02.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.888+0000 7f602de00640 1 Processor -- start 2024-05-30T16:45:02.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.888+0000 7f602de00640 1 -- start start 2024-05-30T16:45:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.889+0000 7f602de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f600c004800 0x7f602815eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.889+0000 7f602de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60280d29b0 0x7f60280d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.889+0000 7f602de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60281f7c40 0x7f60281f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.889+0000 7f602de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60280ba330 con 0x7f60281f7c40 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.889+0000 7f602de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f602815ee70 con 0x7f60280d29b0 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.889+0000 7f602de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f60280ba4b0 con 0x7f600c004800 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.889+0000 7f6027400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60281f7c40 0x7f60281f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.889+0000 7f6027400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60281f7c40 0x7f60281f80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40946/0 (socket says 172.21.15.144:40946) 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.889+0000 7f6027400640 1 -- 172.21.15.144:0/2501968787 learned_addr learned my addr 172.21.15.144:0/2501968787 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f6026a00640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f600c004800 0x7f602815eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f6027400640 1 -- 172.21.15.144:0/2501968787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f600c004800 msgr2=0x7f602815eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f6027400640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f600c004800 0x7f602815eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f6027400640 1 -- 172.21.15.144:0/2501968787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60280d29b0 msgr2=0x7f60280d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f6027400640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60280d29b0 0x7f60280d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f6027400640 1 -- 172.21.15.144:0/2501968787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602815f530 con 0x7f60281f7c40 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f6027400640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60281f7c40 0x7f60281f80c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f60280d20b0 tx=0x7f602000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f601f400640 1 -- 172.21.15.144:0/2501968787 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6020017070 con 0x7f60281f7c40 2024-05-30T16:45:02.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f601f400640 1 -- 172.21.15.144:0/2501968787 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60200070d0 con 0x7f60281f7c40 2024-05-30T16:45:02.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f601f400640 1 -- 172.21.15.144:0/2501968787 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60200074c0 con 0x7f60281f7c40 2024-05-30T16:45:02.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60281f8600 con 0x7f60281f7c40 2024-05-30T16:45:02.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.890+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6028149ee0 con 0x7f60281f7c40 2024-05-30T16:45:02.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.892+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6028068b90 con 0x7f60281f7c40 2024-05-30T16:45:02.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.892+0000 7f601f400640 1 -- 172.21.15.144:0/2501968787 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f602001a070 con 0x7f60281f7c40 2024-05-30T16:45:02.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.893+0000 7f601f400640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f600806cbc0 0x7f600806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:02.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.893+0000 7f601f400640 1 -- 172.21.15.144:0/2501968787 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f602008b060 con 0x7f60281f7c40 2024-05-30T16:45:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.894+0000 7f6026a00640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f600806cbc0 0x7f600806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.894+0000 7f6026a00640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f600806cbc0 0x7f600806f080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6018001eb0 tx=0x7f6018001e00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:02.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:02.898+0000 7f601f400640 1 -- 172.21.15.144:0/2501968787 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f60200593b0 con 0x7f60281f7c40 2024-05-30T16:45:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.100+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f60280b3980 con 0x7f60281f7c40 2024-05-30T16:45:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.107+0000 7f601f400640 1 -- 172.21.15.144:0/2501968787 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f6020058cb0 con 0x7f60281f7c40 2024-05-30T16:45:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f600806cbc0 msgr2=0x7f600806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f600806cbc0 0x7f600806f080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6018001eb0 tx=0x7f6018001e00 comp rx=0 tx=0).stop 2024-05-30T16:45:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60281f7c40 msgr2=0x7f60281f80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60281f7c40 0x7f60281f80c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f60280d20b0 tx=0x7f602000c960 comp rx=0 tx=0).stop 2024-05-30T16:45:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 shutdown_connections 2024-05-30T16:45:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f600806cbc0 0x7f600806f080 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60281f7c40 0x7f60281f80c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60280d29b0 0x7f60280d2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 --2- 172.21.15.144:0/2501968787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f600c004800 0x7f602815eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 >> 172.21.15.144:0/2501968787 conn(0x7f60280627b0 msgr2=0x7f60280b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:03.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 shutdown_connections 2024-05-30T16:45:03.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.110+0000 7f602de00640 1 -- 172.21.15.144:0/2501968787 wait complete. 2024-05-30T16:45:03.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-30T16:45:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.326+0000 7f0453000640 1 Processor -- start 2024-05-30T16:45:03.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.326+0000 7f0453000640 1 -- start start 2024-05-30T16:45:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.328+0000 7f0453000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f044c141510 0x7f044c1418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.328+0000 7f0453000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c144020 0x7f044c06e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.328+0000 7f0453000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f044c0b3fd0 con 0x7f044c15f8f0 2024-05-30T16:45:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.328+0000 7f0453000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f044c06dfc0 con 0x7f044c141510 2024-05-30T16:45:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.328+0000 7f0453000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f044c15fd80 con 0x7f044c144020 2024-05-30T16:45:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.329+0000 7f044be00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f044c141510 0x7f044c1418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.329+0000 7f0451000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c144020 0x7f044c06e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.329+0000 7f0451000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c144020 0x7f044c06e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:57426/0 (socket says 172.21.15.144:57426) 2024-05-30T16:45:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.329+0000 7f0451000640 1 -- 172.21.15.144:0/2648800695 learned_addr learned my addr 172.21.15.144:0/2648800695 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.329+0000 7f044be00640 1 -- 172.21.15.144:0/2648800695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c144020 msgr2=0x7f044c06e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.329+0000 7f044be00640 1 --2- 172.21.15.144:0/2648800695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c144020 0x7f044c06e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.330+0000 7f044be00640 1 -- 172.21.15.144:0/2648800695 >> v1:172.21.15.149:6789/0 conn(0x7f044c15f8f0 legacy=0x7f044c0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.330+0000 7f044be00640 1 -- 172.21.15.144:0/2648800695 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c144790 con 0x7f044c141510 2024-05-30T16:45:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.331+0000 7f044be00640 1 --2- 172.21.15.144:0/2648800695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f044c141510 0x7f044c1418f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f043c009d90 tx=0x7f043c02a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12e054e7c04b9814 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.331+0000 7f044b400640 1 -- 172.21.15.144:0/2648800695 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c007740 con 0x7f044c141510 2024-05-30T16:45:03.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.332+0000 7f044b400640 1 -- 172.21.15.144:0/2648800695 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043c0078e0 con 0x7f044c141510 2024-05-30T16:45:03.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.332+0000 7f044b400640 1 -- 172.21.15.144:0/2648800695 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c007cb0 con 0x7f044c141510 2024-05-30T16:45:03.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.332+0000 7f0453000640 1 -- 172.21.15.144:0/2648800695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f044c141510 msgr2=0x7f044c1418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.332+0000 7f0453000640 1 --2- 172.21.15.144:0/2648800695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f044c141510 0x7f044c1418f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f043c009d90 tx=0x7f043c02a530 comp rx=0 tx=0).stop 2024-05-30T16:45:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.332+0000 7f0453000640 1 -- 172.21.15.144:0/2648800695 shutdown_connections 2024-05-30T16:45:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.332+0000 7f0453000640 1 --2- 172.21.15.144:0/2648800695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c144020 0x7f044c06e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.332+0000 7f0453000640 1 --2- 172.21.15.144:0/2648800695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f044c141510 0x7f044c1418f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.332+0000 7f0453000640 1 -- 172.21.15.144:0/2648800695 >> 172.21.15.144:0/2648800695 conn(0x7f044c06bd00 msgr2=0x7f044c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.332+0000 7f0453000640 1 -- 172.21.15.144:0/2648800695 shutdown_connections 2024-05-30T16:45:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.333+0000 7f0453000640 1 -- 172.21.15.144:0/2648800695 wait complete. 2024-05-30T16:45:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.334+0000 7f0453000640 1 Processor -- start 2024-05-30T16:45:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.334+0000 7f0453000640 1 -- start start 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.335+0000 7f0453000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f044c141510 0x7f044c13b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.335+0000 7f0453000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c144020 0x7f044c147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.335+0000 7f0453000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c15f8f0 0x7f044c0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.335+0000 7f0453000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f044c06e210 con 0x7f044c144020 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.335+0000 7f0453000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f044c144d50 con 0x7f044c141510 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.335+0000 7f0453000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f044c144490 con 0x7f044c15f8f0 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0443400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c144020 0x7f044c147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0443400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c144020 0x7f044c147a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40950/0 (socket says 172.21.15.144:40950) 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0443400640 1 -- 172.21.15.144:0/42626942 learned_addr learned my addr 172.21.15.144:0/42626942 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0451000640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c15f8f0 0x7f044c0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f044be00640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f044c141510 0x7f044c13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0443400640 1 -- 172.21.15.144:0/42626942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c15f8f0 msgr2=0x7f044c0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0443400640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c15f8f0 0x7f044c0b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0443400640 1 -- 172.21.15.144:0/42626942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f044c141510 msgr2=0x7f044c13b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0443400640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f044c141510 0x7f044c13b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0443400640 1 -- 172.21.15.144:0/42626942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c147f80 con 0x7f044c144020 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.336+0000 7f0443400640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c144020 0x7f044c147a40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f043400c400 tx=0x7f043400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.337+0000 7f0448c00640 1 -- 172.21.15.144:0/42626942 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04340052d0 con 0x7f044c144020 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.337+0000 7f0448c00640 1 -- 172.21.15.144:0/42626942 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0434005490 con 0x7f044c144020 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.337+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c157030 con 0x7f044c144020 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.337+0000 7f0448c00640 1 -- 172.21.15.144:0/42626942 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434007260 con 0x7f044c144020 2024-05-30T16:45:03.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.337+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c147240 con 0x7f044c144020 2024-05-30T16:45:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.338+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044c157510 con 0x7f044c144020 2024-05-30T16:45:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.339+0000 7f0448c00640 1 -- 172.21.15.144:0/42626942 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f0434007400 con 0x7f044c144020 2024-05-30T16:45:03.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.340+0000 7f0448c00640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f042806cbf0 0x7f042806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.340+0000 7f0448c00640 1 -- 172.21.15.144:0/42626942 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f043408b180 con 0x7f044c144020 2024-05-30T16:45:03.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.340+0000 7f044be00640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f042806cbf0 0x7f042806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.341+0000 7f044be00640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f042806cbf0 0x7f042806f0b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f043c034000 tx=0x7f043c033040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:03.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.345+0000 7f0448c00640 1 -- 172.21.15.144:0/42626942 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f044c147f80 con 0x7f044c144020 2024-05-30T16:45:03.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.612+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7f044c0b1c90 con 0x7f044c144020 2024-05-30T16:45:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.653+0000 7f0448c00640 1 -- 172.21.15.144:0/42626942 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v156) ==== 160+0+0 (secure 0 0 0) 0x7f04340595b0 con 0x7f044c144020 2024-05-30T16:45:03.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.655+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f042806cbf0 msgr2=0x7f042806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.655+0000 7f0453000640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f042806cbf0 0x7f042806f0b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f043c034000 tx=0x7f043c033040 comp rx=0 tx=0).stop 2024-05-30T16:45:03.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.655+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c144020 msgr2=0x7f044c147a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.655+0000 7f0453000640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c144020 0x7f044c147a40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f043400c400 tx=0x7f043400c8c0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.656+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 shutdown_connections 2024-05-30T16:45:03.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.656+0000 7f0453000640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f042806cbf0 0x7f042806f0b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.656+0000 7f0453000640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f044c15f8f0 0x7f044c0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.656+0000 7f0453000640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c144020 0x7f044c147a40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.656+0000 7f0453000640 1 --2- 172.21.15.144:0/42626942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f044c141510 0x7f044c13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.656+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 >> 172.21.15.144:0/42626942 conn(0x7f044c06bd00 msgr2=0x7f044c160120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:03.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.656+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 shutdown_connections 2024-05-30T16:45:03.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.656+0000 7f0453000640 1 -- 172.21.15.144:0/42626942 wait complete. 2024-05-30T16:45:03.678 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed ... ok 2024-05-30T16:45:03.678 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bars_for_4_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that one progress bar is printed when number of clone jobs is 2024-05-30T16:45:03.679 INFO:tasks.cephfs_test_runner:test_progress_bars_for_4_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:45:03.679 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:45:03.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.874+0000 7faa10a00640 1 Processor -- start 2024-05-30T16:45:03.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.874+0000 7faa10a00640 1 -- start start 2024-05-30T16:45:03.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.876+0000 7faa10a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa0c0ba2b0 0x7faa0c0cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.876+0000 7faa10a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0c163550 con 0x7faa0c0cfaa0 2024-05-30T16:45:03.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.876+0000 7faa10a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0c162f90 con 0x7faa0c15eb80 2024-05-30T16:45:03.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.876+0000 7faa10a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7faa0c15ef60 con 0x7faa0c0ba2b0 2024-05-30T16:45:03.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.876+0000 7faa0a800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faa0c0cfaa0 0x7faa0c0d3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53836/0 (socket says 172.21.15.144:53836) 2024-05-30T16:45:03.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.876+0000 7faa0a800640 1 -- 172.21.15.144:0/4029838960 learned_addr learned my addr 172.21.15.144:0/4029838960 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa03e00640 1 --2- 172.21.15.144:0/4029838960 >> v2:172.21.15.149:3300/0 conn(0x7faa0c0ba2b0 0x7faa0c0cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1125708845 0 0) 0x7faa0c163550 con 0x7faa0c0cfaa0 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9f0003520 con 0x7faa0c0cfaa0 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2393814184 0 0) 0x7fa9f0003520 con 0x7faa0c0cfaa0 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 >> v2:172.21.15.149:3300/0 conn(0x7faa0c0ba2b0 msgr2=0x7faa0c0cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 --2- 172.21.15.144:0/4029838960 >> v2:172.21.15.149:3300/0 conn(0x7faa0c0ba2b0 0x7faa0c0cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 >> v1:172.21.15.149:6789/0 conn(0x7faa0c15eb80 legacy=0x7faa0c162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c163270 con 0x7faa0c0cfaa0 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7faa040019f0 con 0x7faa0c0cfaa0 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 >> v1:172.21.15.144:6789/0 conn(0x7faa0c0cfaa0 legacy=0x7faa0c0d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.877+0000 7faa09400640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f0003a00 0x7fa9f0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa09400640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f0004800 0x7fa9f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa09400640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7fa9f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c15ef60 con 0x7fa9f00051c0 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f000c0c0 con 0x7fa9f0004800 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f000c2c0 con 0x7fa9f0003a00 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa0a800640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7fa9f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa03e00640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f0004800 0x7fa9f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa09e00640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f0003a00 0x7fa9f0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa0a800640 1 -- 172.21.15.144:0/4029838960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f0003a00 msgr2=0x7fa9f0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa0a800640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f0003a00 0x7fa9f0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa0a800640 1 -- 172.21.15.144:0/4029838960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f0004800 msgr2=0x7fa9f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:03.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa0a800640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f0004800 0x7fa9f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa0a800640 1 -- 172.21.15.144:0/4029838960 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f0003520 con 0x7fa9f00051c0 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.878+0000 7faa09e00640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9f0003a00 0x7fa9f0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.879+0000 7faa0a800640 1 -- 172.21.15.144:0/4029838960 reap_dead start 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.879+0000 7faa0a800640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7fa9f000b9c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa0400a7b0 tx=0x7fa9f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7c2aeaafdb193d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0400a3d0 con 0x7fa9f00051c0 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa0402f070 con 0x7fa9f00051c0 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa09400640 1 -- 172.21.15.144:0/4029838960 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0402bc00 con 0x7fa9f00051c0 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa10a00640 1 -- 172.21.15.144:0/4029838960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 msgr2=0x7fa9f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa10a00640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7fa9f000b9c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa0400a7b0 tx=0x7fa9f0005830 comp rx=0 tx=0).stop 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa10a00640 1 -- 172.21.15.144:0/4029838960 shutdown_connections 2024-05-30T16:45:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa10a00640 1 --2- 172.21.15.144:0/4029838960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7fa9f000b9c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa10a00640 1 -- 172.21.15.144:0/4029838960 >> 172.21.15.144:0/4029838960 conn(0x7faa0c06cf40 msgr2=0x7faa0c06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:03.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa10a00640 1 -- 172.21.15.144:0/4029838960 shutdown_connections 2024-05-30T16:45:03.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.880+0000 7faa10a00640 1 -- 172.21.15.144:0/4029838960 wait complete. 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.882+0000 7faa10a00640 1 Processor -- start 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.882+0000 7faa10a00640 1 -- start start 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.883+0000 7faa10a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7faa0c0caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.883+0000 7faa10a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa0c0b7d90 0x7faa0c0b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.883+0000 7faa10a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa0c13d3a0 0x7faa0c13d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.883+0000 7faa10a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0b7a30 con 0x7fa9f00051c0 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.883+0000 7faa10a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0d3050 con 0x7faa0c13d3a0 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.883+0000 7faa10a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c0b7bb0 con 0x7faa0c0b7d90 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.883+0000 7faa09e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7faa0c0caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.883+0000 7faa09e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7faa0c0caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40976/0 (socket says 172.21.15.144:40976) 2024-05-30T16:45:03.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.883+0000 7faa09e00640 1 -- 172.21.15.144:0/3597491371 learned_addr learned my addr 172.21.15.144:0/3597491371 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa09e00640 1 -- 172.21.15.144:0/3597491371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa0c0b7d90 msgr2=0x7faa0c0b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa03e00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa0c0b7d90 0x7faa0c0b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa0a800640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa0c13d3a0 0x7faa0c13d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa09e00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa0c0b7d90 0x7faa0c0b8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa09e00640 1 -- 172.21.15.144:0/3597491371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa0c13d3a0 msgr2=0x7faa0c13d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa09e00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa0c13d3a0 0x7faa0c13d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa09e00640 1 -- 172.21.15.144:0/3597491371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c13c5e0 con 0x7fa9f00051c0 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa09e00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7faa0c0caa60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00d7a0 tx=0x7fa9fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa02000640 1 -- 172.21.15.144:0/3597491371 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc005070 con 0x7fa9f00051c0 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa02000640 1 -- 172.21.15.144:0/3597491371 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc005210 con 0x7fa9f00051c0 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa02000640 1 -- 172.21.15.144:0/3597491371 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc007030 con 0x7fa9f00051c0 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c13c8c0 con 0x7fa9f00051c0 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.884+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c13ce80 con 0x7fa9f00051c0 2024-05-30T16:45:03.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.885+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c068b90 con 0x7fa9f00051c0 2024-05-30T16:45:03.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.886+0000 7faa02000640 1 -- 172.21.15.144:0/3597491371 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fa9fc01a020 con 0x7fa9f00051c0 2024-05-30T16:45:03.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.887+0000 7faa02000640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e806cbc0 0x7fa9e806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:03.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.887+0000 7faa02000640 1 -- 172.21.15.144:0/3597491371 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fa9fc08b610 con 0x7fa9f00051c0 2024-05-30T16:45:03.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.888+0000 7faa03e00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e806cbc0 0x7fa9e806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:03.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.888+0000 7faa03e00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e806cbc0 0x7fa9e806f080 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0ba6d0 tx=0x7fa9f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:03.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:03.892+0000 7faa02000640 1 -- 172.21.15.144:0/3597491371 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa9fc059970 con 0x7fa9f00051c0 2024-05-30T16:45:04.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.077+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa0c15f780 con 0x7fa9f00051c0 2024-05-30T16:45:04.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.079+0000 7faa02000640 1 -- 172.21.15.144:0/3597491371 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13058 (secure 0 0 0) 0x7fa9fc059270 con 0x7fa9f00051c0 2024-05-30T16:45:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:04.081 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":36,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:45:02.639461+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6835/2240940065":"2024-05-31T16:44:59.611606+0000","172.21.15.149:6833/2240940065":"2024-05-31T16:44:59.611606+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:45:04.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e806cbc0 msgr2=0x7fa9e806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e806cbc0 0x7fa9e806f080 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0ba6d0 tx=0x7fa9f4008040 comp rx=0 tx=0).stop 2024-05-30T16:45:04.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 msgr2=0x7faa0c0caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7faa0c0caa60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00d7a0 tx=0x7fa9fc00dc60 comp rx=0 tx=0).stop 2024-05-30T16:45:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 shutdown_connections 2024-05-30T16:45:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9e806cbc0 0x7fa9e806f080 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa0c13d3a0 0x7faa0c13d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa0c0b7d90 0x7faa0c0b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 --2- 172.21.15.144:0/3597491371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9f00051c0 0x7faa0c0caa60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 >> 172.21.15.144:0/3597491371 conn(0x7faa0c06cf40 msgr2=0x7faa0c141a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 shutdown_connections 2024-05-30T16:45:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.082+0000 7faa10a00640 1 -- 172.21.15.144:0/3597491371 wait complete. 2024-05-30T16:45:04.102 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:41:40.927129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T16:45:04.102 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T16:45:04.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.307+0000 7f2ba8200640 1 Processor -- start 2024-05-30T16:45:04.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.308+0000 7f2ba8200640 1 -- start start 2024-05-30T16:45:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.309+0000 7f2ba8200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ba015c780 0x7f2ba00b2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.309+0000 7f2ba8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba015cb60 0x7f2ba00cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.309+0000 7f2ba8200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2ba00b2ab0 0x7f2ba00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.309+0000 7f2ba8200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2ba00b3b90 con 0x7f2ba015c780 2024-05-30T16:45:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.309+0000 7f2ba8200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2ba00b2f80 con 0x7f2ba00b2ab0 2024-05-30T16:45:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.309+0000 7f2ba8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba00b3260 con 0x7f2ba015cb60 2024-05-30T16:45:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.309+0000 7f2ba5800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ba015c780 0x7f2ba00b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.309+0000 7f2ba5800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ba015c780 0x7f2ba00b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40984/0 (socket says 172.21.15.144:40984) 2024-05-30T16:45:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.309+0000 7f2ba5800640 1 -- 172.21.15.144:0/2466065286 learned_addr learned my addr 172.21.15.144:0/2466065286 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:04.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.310+0000 7f2ba5800640 1 -- 172.21.15.144:0/2466065286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba015cb60 msgr2=0x7f2ba00cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:04.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.310+0000 7f2ba4e00640 1 --2- 172.21.15.144:0/2466065286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba015cb60 0x7f2ba00cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.310+0000 7f2ba6200640 1 --2- 172.21.15.144:0/2466065286 >> v2:172.21.15.149:3300/0 conn(0x7f2ba00b2ab0 0x7f2ba00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.310+0000 7f2ba5800640 1 --2- 172.21.15.144:0/2466065286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba015cb60 0x7f2ba00cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.310+0000 7f2ba5800640 1 -- 172.21.15.144:0/2466065286 >> v2:172.21.15.149:3300/0 conn(0x7f2ba00b2ab0 msgr2=0x7f2ba00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.310+0000 7f2ba5800640 1 --2- 172.21.15.144:0/2466065286 >> v2:172.21.15.149:3300/0 conn(0x7f2ba00b2ab0 0x7f2ba00cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.310+0000 7f2ba5800640 1 -- 172.21.15.144:0/2466065286 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba00b3540 con 0x7f2ba015c780 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.310+0000 7f2ba4e00640 1 --2- 172.21.15.144:0/2466065286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba015cb60 0x7f2ba00cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.310+0000 7f2ba6200640 1 --2- 172.21.15.144:0/2466065286 >> v2:172.21.15.149:3300/0 conn(0x7f2ba00b2ab0 0x7f2ba00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.311+0000 7f2ba5800640 1 --2- 172.21.15.144:0/2466065286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 0x7f2ba00b2570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00d1ae0 tx=0x7f2b9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d111f3cd1ef5c733 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.311+0000 7f2b9fe00640 1 -- 172.21.15.144:0/2466065286 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94037070 con 0x7f2ba015c780 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.311+0000 7f2b9fe00640 1 -- 172.21.15.144:0/2466065286 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b94032440 con 0x7f2ba015c780 2024-05-30T16:45:04.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.311+0000 7f2b9fe00640 1 -- 172.21.15.144:0/2466065286 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94032810 con 0x7f2ba015c780 2024-05-30T16:45:04.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.312+0000 7f2ba8200640 1 -- 172.21.15.144:0/2466065286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 msgr2=0x7f2ba00b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.312+0000 7f2ba8200640 1 --2- 172.21.15.144:0/2466065286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 0x7f2ba00b2570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00d1ae0 tx=0x7f2b9402a1e0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.312+0000 7f2ba8200640 1 -- 172.21.15.144:0/2466065286 shutdown_connections 2024-05-30T16:45:04.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.312+0000 7f2ba8200640 1 --2- 172.21.15.144:0/2466065286 >> v2:172.21.15.149:3300/0 conn(0x7f2ba00b2ab0 0x7f2ba00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.312+0000 7f2ba8200640 1 --2- 172.21.15.144:0/2466065286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba015cb60 0x7f2ba00cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.312+0000 7f2ba8200640 1 --2- 172.21.15.144:0/2466065286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 0x7f2ba00b2570 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.312+0000 7f2ba8200640 1 -- 172.21.15.144:0/2466065286 >> 172.21.15.144:0/2466065286 conn(0x7f2ba00d2600 msgr2=0x7f2ba00d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:04.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.312+0000 7f2ba8200640 1 -- 172.21.15.144:0/2466065286 shutdown_connections 2024-05-30T16:45:04.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.312+0000 7f2ba8200640 1 -- 172.21.15.144:0/2466065286 wait complete. 2024-05-30T16:45:04.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.314+0000 7f2ba8200640 1 Processor -- start 2024-05-30T16:45:04.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.314+0000 7f2ba8200640 1 -- start start 2024-05-30T16:45:04.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.315+0000 7f2ba8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba00b2ab0 0x7f2ba00c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.315+0000 7f2ba8200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 0x7f2ba00c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.315+0000 7f2ba8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ba015cb60 0x7f2ba0151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.315+0000 7f2ba8200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba00d0e90 con 0x7f2ba015c780 2024-05-30T16:45:04.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.315+0000 7f2ba8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba00d0d10 con 0x7f2ba015cb60 2024-05-30T16:45:04.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.315+0000 7f2ba8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba009aa30 con 0x7f2ba00b2ab0 2024-05-30T16:45:04.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.315+0000 7f2ba4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 0x7f2ba00c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.315+0000 7f2ba4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 0x7f2ba00c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41000/0 (socket says 172.21.15.144:41000) 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.315+0000 7f2ba4e00640 1 -- 172.21.15.144:0/3538917624 learned_addr learned my addr 172.21.15.144:0/3538917624 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba5800640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba00b2ab0 0x7f2ba00c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba6200640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ba015cb60 0x7f2ba0151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba4e00640 1 -- 172.21.15.144:0/3538917624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba00b2ab0 msgr2=0x7f2ba00c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba4e00640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba00b2ab0 0x7f2ba00c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba4e00640 1 -- 172.21.15.144:0/3538917624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ba015cb60 msgr2=0x7f2ba0151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba4e00640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ba015cb60 0x7f2ba0151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba4e00640 1 -- 172.21.15.144:0/3538917624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba00c94d0 con 0x7f2ba015c780 2024-05-30T16:45:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba5800640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba00b2ab0 0x7f2ba00c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:04.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba4e00640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 0x7f2ba00c8f90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c7f0 tx=0x7f2b8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:04.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2b9d600640 1 -- 172.21.15.144:0/3538917624 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c015070 con 0x7f2ba015c780 2024-05-30T16:45:04.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2b9d600640 1 -- 172.21.15.144:0/3538917624 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c007820 con 0x7f2ba015c780 2024-05-30T16:45:04.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba0152520 con 0x7f2ba015c780 2024-05-30T16:45:04.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.316+0000 7f2b9d600640 1 -- 172.21.15.144:0/3538917624 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c007bf0 con 0x7f2ba015c780 2024-05-30T16:45:04.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.317+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba00cc040 con 0x7f2ba015c780 2024-05-30T16:45:04.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.318+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba0068b90 con 0x7f2ba015c780 2024-05-30T16:45:04.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.318+0000 7f2b9d600640 1 -- 172.21.15.144:0/3538917624 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f2b8c018070 con 0x7f2ba015c780 2024-05-30T16:45:04.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.319+0000 7f2b9d600640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b8006cbc0 0x7f2b8006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.319+0000 7f2b9d600640 1 -- 172.21.15.144:0/3538917624 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f2b8c08bdd0 con 0x7f2ba015c780 2024-05-30T16:45:04.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.320+0000 7f2ba5800640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b8006cbc0 0x7f2b8006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.320+0000 7f2ba5800640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b8006cbc0 0x7f2b8006f080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b94034000 tx=0x7f2b9402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:04.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.324+0000 7f2b9d600640 1 -- 172.21.15.144:0/3538917624 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ba00c94d0 con 0x7f2ba015c780 2024-05-30T16:45:04.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.508+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2ba009c0c0 con 0x7f2ba015c780 2024-05-30T16:45:04.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.509+0000 7f2b9d600640 1 -- 172.21.15.144:0/3538917624 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7f2b8c05a130 con 0x7f2ba015c780 2024-05-30T16:45:04.510 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-05-30T16:45:04.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.511+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b8006cbc0 msgr2=0x7f2b8006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b8006cbc0 0x7f2b8006f080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b94034000 tx=0x7f2b9402e000 comp rx=0 tx=0).stop 2024-05-30T16:45:04.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 msgr2=0x7f2ba00c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 0x7f2ba00c8f90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c7f0 tx=0x7f2b8c00ccb0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 shutdown_connections 2024-05-30T16:45:04.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b8006cbc0 0x7f2b8006f080 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ba015cb60 0x7f2ba0151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba015c780 0x7f2ba00c8f90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 --2- 172.21.15.144:0/3538917624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ba00b2ab0 0x7f2ba00c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 >> 172.21.15.144:0/3538917624 conn(0x7f2ba00d2600 msgr2=0x7f2ba009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:04.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 shutdown_connections 2024-05-30T16:45:04.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.512+0000 7f2ba8200640 1 -- 172.21.15.144:0/3538917624 wait complete. 2024-05-30T16:45:04.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones' 2024-05-30T16:45:04.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.729+0000 7fc03be00640 1 Processor -- start 2024-05-30T16:45:04.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.730+0000 7fc03be00640 1 -- start start 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.731+0000 7fc03be00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc03c0cc0b0 0x7fc03c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.731+0000 7fc03be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc03c06fcf0 0x7fc03c06bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.731+0000 7fc03be00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03c15da70 con 0x7fc03c06b8e0 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.731+0000 7fc03be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc03c0ccd20 con 0x7fc03c06fcf0 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.731+0000 7fc03be00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc03c0cd000 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.731+0000 7fc03b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc03c06fcf0 0x7fc03c06bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.731+0000 7fc03b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc03c06fcf0 0x7fc03c06bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41002/0 (socket says 172.21.15.144:41002) 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.732+0000 7fc03b400640 1 -- 172.21.15.144:0/1913276050 learned_addr learned my addr 172.21.15.144:0/1913276050 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.732+0000 7fc03aa00640 1 --2- 172.21.15.144:0/1913276050 >> v2:172.21.15.149:3300/0 conn(0x7fc03c0cc0b0 0x7fc03c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.732+0000 7fc03b400640 1 -- 172.21.15.144:0/1913276050 >> v2:172.21.15.149:3300/0 conn(0x7fc03c0cc0b0 msgr2=0x7fc03c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:04.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.732+0000 7fc03b400640 1 --2- 172.21.15.144:0/1913276050 >> v2:172.21.15.149:3300/0 conn(0x7fc03c0cc0b0 0x7fc03c15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.732+0000 7fc03b400640 1 -- 172.21.15.144:0/1913276050 >> v1:172.21.15.149:6789/0 conn(0x7fc03c06b8e0 legacy=0x7fc03c1600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:04.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.732+0000 7fc03b400640 1 -- 172.21.15.144:0/1913276050 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c0cd2e0 con 0x7fc03c06fcf0 2024-05-30T16:45:04.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.733+0000 7fc03b400640 1 --2- 172.21.15.144:0/1913276050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c06fcf0 0x7fc03c06bd60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0cfff0 tx=0x7fc03402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818ee06010204c30 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:04.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.733+0000 7fc03a000640 1 -- 172.21.15.144:0/1913276050 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034036070 con 0x7fc03c06fcf0 2024-05-30T16:45:04.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.733+0000 7fc03a000640 1 -- 172.21.15.144:0/1913276050 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc034031600 con 0x7fc03c06fcf0 2024-05-30T16:45:04.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.733+0000 7fc03a000640 1 -- 172.21.15.144:0/1913276050 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0340319d0 con 0x7fc03c06fcf0 2024-05-30T16:45:04.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.734+0000 7fc03be00640 1 -- 172.21.15.144:0/1913276050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c06fcf0 msgr2=0x7fc03c06bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.734+0000 7fc03be00640 1 --2- 172.21.15.144:0/1913276050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c06fcf0 0x7fc03c06bd60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0cfff0 tx=0x7fc03402a660 comp rx=0 tx=0).stop 2024-05-30T16:45:04.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.734+0000 7fc03be00640 1 -- 172.21.15.144:0/1913276050 shutdown_connections 2024-05-30T16:45:04.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.734+0000 7fc03be00640 1 --2- 172.21.15.144:0/1913276050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c06fcf0 0x7fc03c06bd60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.734+0000 7fc03be00640 1 --2- 172.21.15.144:0/1913276050 >> v2:172.21.15.149:3300/0 conn(0x7fc03c0cc0b0 0x7fc03c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.734+0000 7fc03be00640 1 -- 172.21.15.144:0/1913276050 >> 172.21.15.144:0/1913276050 conn(0x7fc03c0b20a0 msgr2=0x7fc03c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:04.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.734+0000 7fc03be00640 1 -- 172.21.15.144:0/1913276050 shutdown_connections 2024-05-30T16:45:04.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.734+0000 7fc03be00640 1 -- 172.21.15.144:0/1913276050 wait complete. 2024-05-30T16:45:04.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.736+0000 7fc03be00640 1 Processor -- start 2024-05-30T16:45:04.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.736+0000 7fc03be00640 1 -- start start 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.737+0000 7fc03be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc03c06b8e0 0x7fc03c14c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.737+0000 7fc03be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc03c06fcf0 0x7fc03c0aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.737+0000 7fc03be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c0cc0b0 0x7fc03c0d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.737+0000 7fc03be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c0cc490 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.737+0000 7fc03be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c0cc9e0 con 0x7fc03c06fcf0 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.737+0000 7fc03be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc03c0ae2b0 con 0x7fc03c06b8e0 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.737+0000 7fc03b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c0cc0b0 0x7fc03c0d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc03b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c0cc0b0 0x7fc03c0d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41010/0 (socket says 172.21.15.144:41010) 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc03b400640 1 -- 172.21.15.144:0/1925502478 learned_addr learned my addr 172.21.15.144:0/1925502478 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc03aa00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc03c06b8e0 0x7fc03c14c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc033e00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc03c06fcf0 0x7fc03c0aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc03b400640 1 -- 172.21.15.144:0/1925502478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc03c06b8e0 msgr2=0x7fc03c14c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc03b400640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc03c06b8e0 0x7fc03c14c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc03b400640 1 -- 172.21.15.144:0/1925502478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc03c06fcf0 msgr2=0x7fc03c0aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc03b400640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc03c06fcf0 0x7fc03c0aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc03b400640 1 -- 172.21.15.144:0/1925502478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c0ad6a0 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc033e00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc03c06fcf0 0x7fc03c0aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.738+0000 7fc03b400640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c0cc0b0 0x7fc03c0d00c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc03402ac50 tx=0x7fc034004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.739+0000 7fc032a00640 1 -- 172.21.15.144:0/1925502478 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034036050 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.739+0000 7fc032a00640 1 -- 172.21.15.144:0/1925502478 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc034042070 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.739+0000 7fc032a00640 1 -- 172.21.15.144:0/1925502478 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034009510 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.739+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03c0ad980 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.739+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03c0adf40 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.740+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03c1589b0 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.741+0000 7fc032a00640 1 -- 172.21.15.144:0/1925502478 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fc034007bd0 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.742+0000 7fc032a00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc01806cbf0 0x7fc01806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:04.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.742+0000 7fc032a00640 1 -- 172.21.15.144:0/1925502478 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fc0340acce0 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.742+0000 7fc03aa00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc01806cbf0 0x7fc01806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:04.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.743+0000 7fc03aa00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc01806cbf0 0x7fc01806f0b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc02c006fd0 tx=0x7fc02c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:04.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.746+0000 7fc032a00640 1 -- 172.21.15.144:0/1925502478 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc03c1589b0 con 0x7fc03c0cc0b0 2024-05-30T16:45:04.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:04.998+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]} v 0) -- 0x7fc03c075570 con 0x7fc03c0cc0b0 2024-05-30T16:45:05.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.666+0000 7fc032a00640 1 -- 172.21.15.144:0/1925502478 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]}]=0 v158) ==== 165+0+0 (secure 0 0 0) 0x7fc03c15da70 con 0x7fc03c0cc0b0 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc01806cbf0 msgr2=0x7fc01806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc01806cbf0 0x7fc01806f0b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc02c006fd0 tx=0x7fc02c008040 comp rx=0 tx=0).stop 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c0cc0b0 msgr2=0x7fc03c0d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c0cc0b0 0x7fc03c0d00c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc03402ac50 tx=0x7fc034004a40 comp rx=0 tx=0).stop 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 shutdown_connections 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc01806cbf0 0x7fc01806f0b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc03c0cc0b0 0x7fc03c0d00c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc03c06fcf0 0x7fc03c0aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 --2- 172.21.15.144:0/1925502478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc03c06b8e0 0x7fc03c14c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.670+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 >> 172.21.15.144:0/1925502478 conn(0x7fc03c0b20a0 msgr2=0x7fc03c0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.671+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 shutdown_connections 2024-05-30T16:45:05.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.671+0000 7fc03be00640 1 -- 172.21.15.144:0/1925502478 wait complete. 2024-05-30T16:45:05.693 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:45:05.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.899+0000 7fe9c4c00640 1 Processor -- start 2024-05-30T16:45:05.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.900+0000 7fe9c4c00640 1 -- start start 2024-05-30T16:45:05.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.901+0000 7fe9c4c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe9c00d2240 0x7fe9c00b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:05.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.901+0000 7fe9c4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c00b66c0 0x7fe9c006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:05.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.901+0000 7fe9c4c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c00d2740 con 0x7fe9c006e790 2024-05-30T16:45:05.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.901+0000 7fe9c4c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c00d07c0 con 0x7fe9c00d2240 2024-05-30T16:45:05.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.901+0000 7fe9c4c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c00d2a20 con 0x7fe9c00b66c0 2024-05-30T16:45:05.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.901+0000 7fe9bea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe9c00d2240 0x7fe9c00b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:05.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.901+0000 7fe9bea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe9c00d2240 0x7fe9c00b6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40324/0 (socket says 172.21.15.144:40324) 2024-05-30T16:45:05.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.901+0000 7fe9bea00640 1 -- 172.21.15.144:0/628598449 learned_addr learned my addr 172.21.15.144:0/628598449 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:05.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.902+0000 7fe9bfe00640 1 --2- 172.21.15.144:0/628598449 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c00b66c0 0x7fe9c006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:05.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.902+0000 7fe9bea00640 1 -- 172.21.15.144:0/628598449 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c00b66c0 msgr2=0x7fe9c006ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:05.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.902+0000 7fe9bea00640 1 --2- 172.21.15.144:0/628598449 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c00b66c0 0x7fe9c006ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:05.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.902+0000 7fe9bea00640 1 -- 172.21.15.144:0/628598449 >> v1:172.21.15.149:6789/0 conn(0x7fe9c006e790 legacy=0x7fe9c00d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:05.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.902+0000 7fe9bea00640 1 -- 172.21.15.144:0/628598449 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c00d2d00 con 0x7fe9c00d2240 2024-05-30T16:45:05.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.903+0000 7fe9bea00640 1 --2- 172.21.15.144:0/628598449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 0x7fe9c00b6180 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009e50 tx=0x7fe9b002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574b17c6a8e114aa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:05.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.903+0000 7fe9be000640 1 -- 172.21.15.144:0/628598449 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0036070 con 0x7fe9c00d2240 2024-05-30T16:45:05.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.903+0000 7fe9be000640 1 -- 172.21.15.144:0/628598449 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b0031600 con 0x7fe9c00d2240 2024-05-30T16:45:05.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.903+0000 7fe9be000640 1 -- 172.21.15.144:0/628598449 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b00319d0 con 0x7fe9c00d2240 2024-05-30T16:45:05.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.904+0000 7fe9c4c00640 1 -- 172.21.15.144:0/628598449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 msgr2=0x7fe9c00b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:05.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.904+0000 7fe9c4c00640 1 --2- 172.21.15.144:0/628598449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 0x7fe9c00b6180 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009e50 tx=0x7fe9b002a630 comp rx=0 tx=0).stop 2024-05-30T16:45:05.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.904+0000 7fe9c4c00640 1 -- 172.21.15.144:0/628598449 shutdown_connections 2024-05-30T16:45:05.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.904+0000 7fe9c4c00640 1 --2- 172.21.15.144:0/628598449 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c00b66c0 0x7fe9c006ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:05.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.904+0000 7fe9c4c00640 1 --2- 172.21.15.144:0/628598449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 0x7fe9c00b6180 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:05.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.904+0000 7fe9c4c00640 1 -- 172.21.15.144:0/628598449 >> 172.21.15.144:0/628598449 conn(0x7fe9c008bfc0 msgr2=0x7fe9c00d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:05.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.904+0000 7fe9c4c00640 1 -- 172.21.15.144:0/628598449 shutdown_connections 2024-05-30T16:45:05.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.904+0000 7fe9c4c00640 1 -- 172.21.15.144:0/628598449 wait complete. 2024-05-30T16:45:05.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.906+0000 7fe9c4c00640 1 Processor -- start 2024-05-30T16:45:05.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.906+0000 7fe9c4c00640 1 -- start start 2024-05-30T16:45:05.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9c4c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c006e790 0x7fe9c0156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:05.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9c4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c00b66c0 0x7fe9c00b8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9c4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 0x7fe9c00b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9c4c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c006cf90 con 0x7fe9c00d2240 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9c4c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00d32c0 con 0x7fe9c006e790 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9c4c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c006d110 con 0x7fe9c00b66c0 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 0x7fe9c00b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 0x7fe9c00b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40336/0 (socket says 172.21.15.144:40336) 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9bfe00640 1 -- 172.21.15.144:0/1787431906 learned_addr learned my addr 172.21.15.144:0/1787431906 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9bf400640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c006e790 0x7fe9c0156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9bfe00640 1 -- 172.21.15.144:0/1787431906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c00b66c0 msgr2=0x7fe9c00b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9bfe00640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c00b66c0 0x7fe9c00b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9bfe00640 1 -- 172.21.15.144:0/1787431906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c006e790 msgr2=0x7fe9c0156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9bfe00640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c006e790 0x7fe9c0156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:05.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.908+0000 7fe9bfe00640 1 -- 172.21.15.144:0/1787431906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c00b8f00 con 0x7fe9c00d2240 2024-05-30T16:45:05.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.909+0000 7fe9bfe00640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 0x7fe9c00b2960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800d830 tx=0x7fe9b800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:05.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.909+0000 7fe9b7400640 1 -- 172.21.15.144:0/1787431906 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800b6c0 con 0x7fe9c00d2240 2024-05-30T16:45:05.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.909+0000 7fe9b7400640 1 -- 172.21.15.144:0/1787431906 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b8019070 con 0x7fe9c00d2240 2024-05-30T16:45:05.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.909+0000 7fe9b7400640 1 -- 172.21.15.144:0/1787431906 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800bac0 con 0x7fe9c00d2240 2024-05-30T16:45:05.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.909+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c00b7320 con 0x7fe9c00d2240 2024-05-30T16:45:05.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.909+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c00b78e0 con 0x7fe9c00d2240 2024-05-30T16:45:05.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.910+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c0075570 con 0x7fe9c00d2240 2024-05-30T16:45:05.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.911+0000 7fe9b7400640 1 -- 172.21.15.144:0/1787431906 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fe9b801e460 con 0x7fe9c00d2240 2024-05-30T16:45:05.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.912+0000 7fe9b7400640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe99c06cbc0 0x7fe99c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:05.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.913+0000 7fe9b7400640 1 -- 172.21.15.144:0/1787431906 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fe9b808c470 con 0x7fe9c00d2240 2024-05-30T16:45:05.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.913+0000 7fe9bf400640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe99c06cbc0 0x7fe99c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:05.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.913+0000 7fe9bf400640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe99c06cbc0 0x7fe99c06f080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8003d90 tx=0x7fe9a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:05.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:05.917+0000 7fe9b7400640 1 -- 172.21.15.144:0/1787431906 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe9b805a780 con 0x7fe9c00d2240 2024-05-30T16:45:06.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.118+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe9c00ba580 con 0x7fe9c00d2240 2024-05-30T16:45:06.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.126+0000 7fe9b7400640 1 -- 172.21.15.144:0/1787431906 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fe9b805a080 con 0x7fe9c00d2240 2024-05-30T16:45:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe99c06cbc0 msgr2=0x7fe99c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe99c06cbc0 0x7fe99c06f080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8003d90 tx=0x7fe9a8009040 comp rx=0 tx=0).stop 2024-05-30T16:45:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 msgr2=0x7fe9c00b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 0x7fe9c00b2960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800d830 tx=0x7fe9b800dcf0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 shutdown_connections 2024-05-30T16:45:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe99c06cbc0 0x7fe99c06f080 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9c00d2240 0x7fe9c00b2960 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c00b66c0 0x7fe9c00b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 --2- 172.21.15.144:0/1787431906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c006e790 0x7fe9c0156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 >> 172.21.15.144:0/1787431906 conn(0x7fe9c008bfc0 msgr2=0x7fe9c00b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 shutdown_connections 2024-05-30T16:45:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.129+0000 7fe9c4c00640 1 -- 172.21.15.144:0/1787431906 wait complete. 2024-05-30T16:45:06.149 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:45:06.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:45:06.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:45:06.354 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:45:06.354 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:45:06.354 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:06.413 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:45:06.413 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:45:06.413 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:06.470 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:45:06.471 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:45:06.471 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:06.527 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:45:06.527 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:45:06.527 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:06.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:45:06.587 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T16:45:06.587 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:45:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.792+0000 7fbdec200640 1 Processor -- start 2024-05-30T16:45:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.792+0000 7fbdec200640 1 -- start start 2024-05-30T16:45:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.793+0000 7fbdec200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbde40d0710 0x7fbde415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.793+0000 7fbdec200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde415ccd0 con 0x7fbde40d0af0 2024-05-30T16:45:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.794+0000 7fbdec200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde409aa30 con 0x7fbde40cd1a0 2024-05-30T16:45:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.794+0000 7fbdec200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fbde409ad10 con 0x7fbde40d0710 2024-05-30T16:45:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.794+0000 7fbde8e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbde40d0af0 0x7fbde40d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50308/0 (socket says 172.21.15.144:50308) 2024-05-30T16:45:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.794+0000 7fbde8e00640 1 -- 172.21.15.144:0/198822327 learned_addr learned my addr 172.21.15.144:0/198822327 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.794+0000 7fbde9800640 1 --2- 172.21.15.144:0/198822327 >> v2:172.21.15.149:3300/0 conn(0x7fbde40d0710 0x7fbde415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.794+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507545899 0 0) 0x7fbde415ccd0 con 0x7fbde40d0af0 2024-05-30T16:45:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.794+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdcc003520 con 0x7fbde40d0af0 2024-05-30T16:45:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1153330974 0 0) 0x7fbdcc003520 con 0x7fbde40d0af0 2024-05-30T16:45:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 >> v2:172.21.15.149:3300/0 conn(0x7fbde40d0710 msgr2=0x7fbde415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 --2- 172.21.15.144:0/198822327 >> v2:172.21.15.149:3300/0 conn(0x7fbde40d0710 0x7fbde415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 >> v1:172.21.15.149:6789/0 conn(0x7fbde40cd1a0 legacy=0x7fbde40cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde409aff0 con 0x7fbde40d0af0 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fbdd0001670 con 0x7fbde40d0af0 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 >> v1:172.21.15.144:6789/0 conn(0x7fbde40d0af0 legacy=0x7fbde40d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdcc0039b0 0x7fbdcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdcc004800 0x7fbdcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbdcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbde409ad10 con 0x7fbdcc0051c0 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc00c070 con 0x7fbdcc0039b0 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbdcc00c270 con 0x7fbdcc004800 2024-05-30T16:45:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.795+0000 7fbdea200640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbdcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.796+0000 7fbde9800640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdcc0039b0 0x7fbdcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.796+0000 7fbdea200640 1 -- 172.21.15.144:0/198822327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdcc004800 msgr2=0x7fbdcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.796+0000 7fbdea200640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdcc004800 0x7fbdcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.796+0000 7fbdea200640 1 -- 172.21.15.144:0/198822327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdcc0039b0 msgr2=0x7fbdcc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.796+0000 7fbdea200640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdcc0039b0 0x7fbdcc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.796+0000 7fbdea200640 1 -- 172.21.15.144:0/198822327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdcc003520 con 0x7fbdcc0051c0 2024-05-30T16:45:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.797+0000 7fbdea200640 1 -- 172.21.15.144:0/198822327 reap_dead start 2024-05-30T16:45:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.797+0000 7fbdea200640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbdcc00b9c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbddc001e50 tx=0x7fbdcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c9104b2778d06a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.797+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc001a70 con 0x7fbdcc0051c0 2024-05-30T16:45:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.797+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc003970 con 0x7fbdcc0051c0 2024-05-30T16:45:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.797+0000 7fbde3e00640 1 -- 172.21.15.144:0/198822327 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc003d60 con 0x7fbdcc0051c0 2024-05-30T16:45:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.798+0000 7fbdec200640 1 -- 172.21.15.144:0/198822327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 msgr2=0x7fbdcc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.798+0000 7fbdec200640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbdcc00b9c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbddc001e50 tx=0x7fbdcc005830 comp rx=0 tx=0).stop 2024-05-30T16:45:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.798+0000 7fbdec200640 1 -- 172.21.15.144:0/198822327 shutdown_connections 2024-05-30T16:45:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.798+0000 7fbdec200640 1 --2- 172.21.15.144:0/198822327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbdcc00b9c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.798+0000 7fbdec200640 1 -- 172.21.15.144:0/198822327 >> 172.21.15.144:0/198822327 conn(0x7fbde40b4180 msgr2=0x7fbde40b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.798+0000 7fbdec200640 1 -- 172.21.15.144:0/198822327 shutdown_connections 2024-05-30T16:45:06.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.798+0000 7fbdec200640 1 -- 172.21.15.144:0/198822327 wait complete. 2024-05-30T16:45:06.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.800+0000 7fbdec200640 1 Processor -- start 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.800+0000 7fbdec200640 1 -- start start 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbdec200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbde41f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbdec200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbde40b7d90 0x7fbde41f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbdec200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbde406de10 0x7fbde4150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbdec200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbde409bad0 con 0x7fbdcc0051c0 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbdec200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbde409b5b0 con 0x7fbde40b7d90 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbdec200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbde409bc50 con 0x7fbde406de10 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbde9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbde41f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbde9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbde41f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40350/0 (socket says 172.21.15.144:40350) 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbde9800640 1 -- 172.21.15.144:0/1496357880 learned_addr learned my addr 172.21.15.144:0/1496357880 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbde9800640 1 -- 172.21.15.144:0/1496357880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbde406de10 msgr2=0x7fbde4150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:06.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbde9800640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbde406de10 0x7fbde4150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbde9800640 1 -- 172.21.15.144:0/1496357880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbde40b7d90 msgr2=0x7fbde41f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:06.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbde9800640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbde40b7d90 0x7fbde41f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:06.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.801+0000 7fbde9800640 1 -- 172.21.15.144:0/1496357880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde41f5ec0 con 0x7fbdcc0051c0 2024-05-30T16:45:06.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.802+0000 7fbde9800640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbde41f5980 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8011540 tx=0x7fbdd8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:06.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.802+0000 7fbde1600640 1 -- 172.21.15.144:0/1496357880 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8015930 con 0x7fbdcc0051c0 2024-05-30T16:45:06.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.802+0000 7fbde1600640 1 -- 172.21.15.144:0/1496357880 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd8015ad0 con 0x7fbdcc0051c0 2024-05-30T16:45:06.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.802+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde41f8eb0 con 0x7fbdcc0051c0 2024-05-30T16:45:06.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.802+0000 7fbde1600640 1 -- 172.21.15.144:0/1496357880 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd801d400 con 0x7fbdcc0051c0 2024-05-30T16:45:06.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.802+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde41f5180 con 0x7fbdcc0051c0 2024-05-30T16:45:06.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.803+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde40ceab0 con 0x7fbdcc0051c0 2024-05-30T16:45:06.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.804+0000 7fbde1600640 1 -- 172.21.15.144:0/1496357880 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fbdd801d5a0 con 0x7fbdcc0051c0 2024-05-30T16:45:06.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.805+0000 7fbde1600640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdc406cbc0 0x7fbdc406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:06.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.805+0000 7fbde1600640 1 -- 172.21.15.144:0/1496357880 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fbdd808c640 con 0x7fbdcc0051c0 2024-05-30T16:45:06.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.805+0000 7fbde8e00640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdc406cbc0 0x7fbdc406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:06.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.806+0000 7fbde8e00640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdc406cbc0 0x7fbdc406f080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00011e0 tx=0x7fbdd0001590 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:06.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:06.810+0000 7fbde1600640 1 -- 172.21.15.144:0/1496357880 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbde40ceab0 con 0x7fbdcc0051c0 2024-05-30T16:45:07.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.048+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbde41f93d0 con 0x7fbdcc0051c0 2024-05-30T16:45:07.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.049+0000 7fbde1600640 1 -- 172.21.15.144:0/1496357880 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3875 (secure 0 0 0) 0x7fbde41f93d0 con 0x7fbdcc0051c0 2024-05-30T16:45:07.051 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:07.051 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/476063845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":476063845},{"type":"v1","addr":"172.21.15.149:6834","nonce":476063845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3390865934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3390865934},{"type":"v1","addr":"172.21.15.144:6836","nonce":3390865934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4737,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1066829217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1066829217},{"type":"v1","addr":"172.21.15.144:6837","nonce":1066829217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/554482079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":554482079},{"type":"v1","addr":"172.21.15.149:6835","nonce":554482079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-05-30T16:45:07.052 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 20 2024-05-30T16:45:07.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdc406cbc0 msgr2=0x7fbdc406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdc406cbc0 0x7fbdc406f080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00011e0 tx=0x7fbdd0001590 comp rx=0 tx=0).stop 2024-05-30T16:45:07.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 msgr2=0x7fbde41f5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbde41f5980 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8011540 tx=0x7fbdd8011a00 comp rx=0 tx=0).stop 2024-05-30T16:45:07.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 shutdown_connections 2024-05-30T16:45:07.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbdc406cbc0 0x7fbdc406f080 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbde406de10 0x7fbde4150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbde40b7d90 0x7fbde41f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 --2- 172.21.15.144:0/1496357880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdcc0051c0 0x7fbde41f5980 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 >> 172.21.15.144:0/1496357880 conn(0x7fbde40b4180 msgr2=0x7fbde4156c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:07.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 shutdown_connections 2024-05-30T16:45:07.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.052+0000 7fbdec200640 1 -- 172.21.15.144:0/1496357880 wait complete. 2024-05-30T16:45:07.072 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:45:07.072 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T16:45:07.072 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:45:07.072 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:45:07.072 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:45:07.073 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T16:45:07.073 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:45:07.073 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:45:07.073 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:45:07.073 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T16:45:07.073 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:45:07.073 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:45:07.074 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:45:07.074 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T16:45:07.074 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:45:07.074 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:45:07.090 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:45:07.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:45:07.091 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:45:07.091 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:45:07.099 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:45:07.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:45:07.101 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:45:07.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:45:07.138 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:45:07.138 DEBUG:teuthology.parallel:result is None 2024-05-30T16:45:07.143 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:45:07.143 DEBUG:teuthology.parallel:result is None 2024-05-30T16:45:07.145 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:45:07.145 DEBUG:teuthology.parallel:result is None 2024-05-30T16:45:07.151 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:45:07.151 DEBUG:teuthology.parallel:result is None 2024-05-30T16:45:07.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T16:45:07.280 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-05-30T16:45:07.281 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-05-30T16:45:07.302 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-05-30T16:45:07.303 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-05-30T16:45:07.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.324+0000 7f649b200640 1 Processor -- start 2024-05-30T16:45:07.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.324+0000 7f649b200640 1 -- start start 2024-05-30T16:45:07.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f649b200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f64940ce390 0x7f649415e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f649b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64941604c0 0x7f649406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f649b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6494160c40 con 0x7f649415da50 2024-05-30T16:45:07.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f649b200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f649415dee0 con 0x7f64940ce390 2024-05-30T16:45:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f649b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6494160f20 con 0x7f64941604c0 2024-05-30T16:45:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f648b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f649415da50 0x7f64940ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50314/0 (socket says 172.21.15.144:50314) 2024-05-30T16:45:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f648b400640 1 -- 172.21.15.144:0/401908612 learned_addr learned my addr 172.21.15.144:0/401908612 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f6493e00640 1 --2- 172.21.15.144:0/401908612 >> v2:172.21.15.149:3300/0 conn(0x7f64940ce390 0x7f649415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f6499200640 1 --2- 172.21.15.144:0/401908612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64941604c0 0x7f649406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f6493400640 1 -- 172.21.15.144:0/401908612 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 729596925 0 0) 0x7f6494160c40 con 0x7f649415da50 2024-05-30T16:45:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.326+0000 7f6493400640 1 -- 172.21.15.144:0/401908612 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6478003520 con 0x7f649415da50 2024-05-30T16:45:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.327+0000 7f6493e00640 1 -- 172.21.15.144:0/401908612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64941604c0 msgr2=0x7f649406ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.327+0000 7f6493e00640 1 --2- 172.21.15.144:0/401908612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64941604c0 0x7f649406ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.327+0000 7f6493e00640 1 -- 172.21.15.144:0/401908612 >> v1:172.21.15.144:6789/0 conn(0x7f649415da50 legacy=0x7f64940ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.327+0000 7f6493400640 1 -- 172.21.15.144:0/401908612 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3097507658 0 0) 0x7f6478003520 con 0x7f649415da50 2024-05-30T16:45:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.327+0000 7f6493e00640 1 -- 172.21.15.144:0/401908612 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6494161200 con 0x7f64940ce390 2024-05-30T16:45:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.328+0000 7f6493e00640 1 --2- 172.21.15.144:0/401908612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 0x7f649415e090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f64840097a0 tx=0x7f648402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=380905cf50959942 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.328+0000 7f6493400640 1 -- 172.21.15.144:0/401908612 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484037070 con 0x7f64940ce390 2024-05-30T16:45:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.328+0000 7f6493400640 1 -- 172.21.15.144:0/401908612 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648402aba0 con 0x7f64940ce390 2024-05-30T16:45:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.328+0000 7f6493400640 1 -- 172.21.15.144:0/401908612 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c001670 con 0x7f64940ce390 2024-05-30T16:45:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.329+0000 7f649b200640 1 -- 172.21.15.144:0/401908612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 msgr2=0x7f649415e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.329+0000 7f649b200640 1 --2- 172.21.15.144:0/401908612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 0x7f649415e090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f64840097a0 tx=0x7f648402a110 comp rx=0 tx=0).stop 2024-05-30T16:45:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.329+0000 7f649b200640 1 -- 172.21.15.144:0/401908612 shutdown_connections 2024-05-30T16:45:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.329+0000 7f649b200640 1 --2- 172.21.15.144:0/401908612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64941604c0 0x7f649406ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.329+0000 7f649b200640 1 --2- 172.21.15.144:0/401908612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 0x7f649415e090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.329+0000 7f649b200640 1 -- 172.21.15.144:0/401908612 >> 172.21.15.144:0/401908612 conn(0x7f64940629c0 msgr2=0x7f649406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.329+0000 7f649b200640 1 -- 172.21.15.144:0/401908612 shutdown_connections 2024-05-30T16:45:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.329+0000 7f649b200640 1 -- 172.21.15.144:0/401908612 wait complete. 2024-05-30T16:45:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.330+0000 7f649b200640 1 Processor -- start 2024-05-30T16:45:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.331+0000 7f649b200640 1 -- start start 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.331+0000 7f649b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 0x7f64941f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.331+0000 7f649b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f649415da50 0x7f6494155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.331+0000 7f649b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64941604c0 0x7f64940b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.331+0000 7f649b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6494143130 con 0x7f64941604c0 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f649b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f64941608d0 con 0x7f64940ce390 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f649b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f64941432b0 con 0x7f649415da50 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6499200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64941604c0 0x7f64940b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6499200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64941604c0 0x7f64940b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40396/0 (socket says 172.21.15.144:40396) 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6499200640 1 -- 172.21.15.144:0/3141276159 learned_addr learned my addr 172.21.15.144:0/3141276159 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:07.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6493e00640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 0x7f64941f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f648b400640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f649415da50 0x7f6494155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6499200640 1 -- 172.21.15.144:0/3141276159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f649415da50 msgr2=0x7f6494155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6499200640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f649415da50 0x7f6494155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6499200640 1 -- 172.21.15.144:0/3141276159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 msgr2=0x7f64941f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6499200640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 0x7f64941f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6499200640 1 -- 172.21.15.144:0/3141276159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64941562c0 con 0x7f64941604c0 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.332+0000 7f6493e00640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 0x7f64941f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.333+0000 7f6499200640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64941604c0 0x7f64940b0190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f648c009dd0 tx=0x7f648c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.333+0000 7f6490c00640 1 -- 172.21.15.144:0/3141276159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c018020 con 0x7f64941604c0 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.333+0000 7f6490c00640 1 -- 172.21.15.144:0/3141276159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c014480 con 0x7f64941604c0 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.333+0000 7f6490c00640 1 -- 172.21.15.144:0/3141276159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c014870 con 0x7f64941604c0 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.333+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64941565a0 con 0x7f64941604c0 2024-05-30T16:45:07.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.333+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6494156b60 con 0x7f64941604c0 2024-05-30T16:45:07.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.334+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649406c870 con 0x7f64941604c0 2024-05-30T16:45:07.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.335+0000 7f6490c00640 1 -- 172.21.15.144:0/3141276159 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f648c01b020 con 0x7f64941604c0 2024-05-30T16:45:07.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.336+0000 7f6490c00640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f647006cbc0 0x7f647006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.336+0000 7f6490c00640 1 -- 172.21.15.144:0/3141276159 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f648c08c820 con 0x7f64941604c0 2024-05-30T16:45:07.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.336+0000 7f6493e00640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f647006cbc0 0x7f647006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.337+0000 7f6493e00640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f647006cbc0 0x7f647006f080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6484034000 tx=0x7f648402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:07.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.341+0000 7f6490c00640 1 -- 172.21.15.144:0/3141276159 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f648c022030 con 0x7f64941604c0 2024-05-30T16:45:07.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.536+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f64940cddd0 con 0x7f64941604c0 2024-05-30T16:45:07.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.693+0000 7f6490c00640 1 -- 172.21.15.144:0/3141276159 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) ==== 97+0+0 (secure 0 0 0) 0x7f648c010040 con 0x7f64941604c0 2024-05-30T16:45:07.694 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-05-30T16:45:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f647006cbc0 msgr2=0x7f647006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f647006cbc0 0x7f647006f080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6484034000 tx=0x7f648402e000 comp rx=0 tx=0).stop 2024-05-30T16:45:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64941604c0 msgr2=0x7f64940b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64941604c0 0x7f64940b0190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f648c009dd0 tx=0x7f648c00c490 comp rx=0 tx=0).stop 2024-05-30T16:45:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 shutdown_connections 2024-05-30T16:45:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f647006cbc0 0x7f647006f080 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64941604c0 0x7f64940b0190 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f649415da50 0x7f6494155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 --2- 172.21.15.144:0/3141276159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64940ce390 0x7f64941f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.696+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 >> 172.21.15.144:0/3141276159 conn(0x7f64940629c0 msgr2=0x7f6494075010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.697+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 shutdown_connections 2024-05-30T16:45:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.697+0000 7f649b200640 1 -- 172.21.15.144:0/3141276159 wait complete. 2024-05-30T16:45:07.721 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T16:45:07.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.921+0000 7f6171000640 1 Processor -- start 2024-05-30T16:45:07.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.921+0000 7f6171000640 1 -- start start 2024-05-30T16:45:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.922+0000 7f6171000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f616c0cb2f0 0x7f616c15c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.922+0000 7f6171000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f616c15f780 con 0x7f616c15c780 2024-05-30T16:45:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.922+0000 7f6171000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f616c15fa60 con 0x7f616c0caf10 2024-05-30T16:45:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.922+0000 7f6171000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f616c15fd40 con 0x7f616c0cb2f0 2024-05-30T16:45:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.923+0000 7f616be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f616c15c780 0x7f616c0b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50320/0 (socket says 172.21.15.144:50320) 2024-05-30T16:45:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.923+0000 7f616be00640 1 -- 172.21.15.144:0/1238274280 learned_addr learned my addr 172.21.15.144:0/1238274280 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.923+0000 7f6162a00640 1 --2- 172.21.15.144:0/1238274280 >> v2:172.21.15.149:3300/0 conn(0x7f616c0cb2f0 0x7f616c15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.923+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291689933 0 0) 0x7f616c15f780 con 0x7f616c15c780 2024-05-30T16:45:07.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.923+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6150005730 con 0x7f616c15c780 2024-05-30T16:45:07.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3828213799 0 0) 0x7f6150005730 con 0x7f616c15c780 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 >> v2:172.21.15.149:3300/0 conn(0x7f616c0cb2f0 msgr2=0x7f616c15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 --2- 172.21.15.144:0/1238274280 >> v2:172.21.15.149:3300/0 conn(0x7f616c0cb2f0 0x7f616c15c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 >> v1:172.21.15.149:6789/0 conn(0x7f616c0caf10 legacy=0x7f616c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c15b950 con 0x7f616c15c780 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f6164001670 con 0x7f616c15c780 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 >> v1:172.21.15.144:6789/0 conn(0x7f616c15c780 legacy=0x7f616c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 --2- 172.21.15.144:0/1238274280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6150005bc0 0x7f6150005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 --2- 172.21.15.144:0/1238274280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6150006a10 0x7f6150006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 --2- 172.21.15.144:0/1238274280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61500073d0 0x7f615000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f616c15fd40 con 0x7f61500073d0 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f615000e270 con 0x7f6150006a10 2024-05-30T16:45:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f615000e470 con 0x7f6150005bc0 2024-05-30T16:45:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616be00640 1 --2- 172.21.15.144:0/1238274280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61500073d0 0x7f615000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616be00640 1 -- 172.21.15.144:0/1238274280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6150005bc0 msgr2=0x7f6150005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616be00640 1 --2- 172.21.15.144:0/1238274280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6150005bc0 0x7f6150005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616be00640 1 -- 172.21.15.144:0/1238274280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6150006a10 msgr2=0x7f6150006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616be00640 1 --2- 172.21.15.144:0/1238274280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6150006a10 0x7f6150006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.924+0000 7f616be00640 1 -- 172.21.15.144:0/1238274280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6150005730 con 0x7f61500073d0 2024-05-30T16:45:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.925+0000 7f616be00640 1 -- 172.21.15.144:0/1238274280 reap_dead start 2024-05-30T16:45:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.925+0000 7f616be00640 1 --2- 172.21.15.144:0/1238274280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61500073d0 0x7f615000dbd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f616c15bd60 tx=0x7f6150007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabd94755dc8cd63 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.926+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6164007d30 con 0x7f61500073d0 2024-05-30T16:45:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.926+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6164005ad0 con 0x7f61500073d0 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.926+0000 7f616aa00640 1 -- 172.21.15.144:0/1238274280 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6164007070 con 0x7f61500073d0 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.926+0000 7f6171000640 1 -- 172.21.15.144:0/1238274280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61500073d0 msgr2=0x7f615000dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.926+0000 7f6171000640 1 --2- 172.21.15.144:0/1238274280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61500073d0 0x7f615000dbd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f616c15bd60 tx=0x7f6150007a40 comp rx=0 tx=0).stop 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.926+0000 7f6171000640 1 -- 172.21.15.144:0/1238274280 shutdown_connections 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.926+0000 7f6171000640 1 --2- 172.21.15.144:0/1238274280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61500073d0 0x7f615000dbd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.926+0000 7f6171000640 1 -- 172.21.15.144:0/1238274280 >> 172.21.15.144:0/1238274280 conn(0x7f616c0b20a0 msgr2=0x7f616c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.927+0000 7f6171000640 1 -- 172.21.15.144:0/1238274280 shutdown_connections 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.927+0000 7f6171000640 1 -- 172.21.15.144:0/1238274280 wait complete. 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.928+0000 7f6171000640 1 Processor -- start 2024-05-30T16:45:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.928+0000 7f6171000640 1 -- start start 2024-05-30T16:45:07.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.929+0000 7f6171000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61500073d0 0x7f616c14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.929+0000 7f6171000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f616c0ae140 0x7f616c0ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.929+0000 7f6171000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f616c0b00f0 0x7f616c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.929+0000 7f6171000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f616c15c240 con 0x7f616c0ae140 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.929+0000 7f6171000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f616c0cfac0 con 0x7f616c0b00f0 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.929+0000 7f6171000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f616c15c3c0 con 0x7f61500073d0 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f6162a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f616c0ae140 0x7f616c0ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f6162a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f616c0ae140 0x7f616c0ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40418/0 (socket says 172.21.15.144:40418) 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f6162a00640 1 -- 172.21.15.144:0/2399897766 learned_addr learned my addr 172.21.15.144:0/2399897766 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f6162a00640 1 -- 172.21.15.144:0/2399897766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61500073d0 msgr2=0x7f616c14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f616be00640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f616c0b00f0 0x7f616c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f616b400640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61500073d0 0x7f616c14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f6162a00640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61500073d0 0x7f616c14a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f6162a00640 1 -- 172.21.15.144:0/2399897766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f616c0b00f0 msgr2=0x7f616c0b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f6162a00640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f616c0b00f0 0x7f616c0b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:07.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f6162a00640 1 -- 172.21.15.144:0/2399897766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c0b0eb0 con 0x7f616c0ae140 2024-05-30T16:45:07.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.930+0000 7f6162a00640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f616c0ae140 0x7f616c0ae5c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f615400e7c0 tx=0x7f615400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:07.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.931+0000 7f6163e00640 1 -- 172.21.15.144:0/2399897766 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154017070 con 0x7f616c0ae140 2024-05-30T16:45:07.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.931+0000 7f6163e00640 1 -- 172.21.15.144:0/2399897766 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f615400c8c0 con 0x7f616c0ae140 2024-05-30T16:45:07.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.931+0000 7f6163e00640 1 -- 172.21.15.144:0/2399897766 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615400ccb0 con 0x7f616c0ae140 2024-05-30T16:45:07.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.931+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616c0b1190 con 0x7f616c0ae140 2024-05-30T16:45:07.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.931+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f616c0b1750 con 0x7f616c0ae140 2024-05-30T16:45:07.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.932+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f616c075570 con 0x7f616c0ae140 2024-05-30T16:45:07.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.933+0000 7f6163e00640 1 -- 172.21.15.144:0/2399897766 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f615401a070 con 0x7f616c0ae140 2024-05-30T16:45:07.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.934+0000 7f6163e00640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f614806cbf0 0x7f614806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:07.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.934+0000 7f6163e00640 1 -- 172.21.15.144:0/2399897766 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f615408bf00 con 0x7f616c0ae140 2024-05-30T16:45:07.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.934+0000 7f616b400640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f614806cbf0 0x7f614806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:07.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.935+0000 7f616b400640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f614806cbf0 0x7f614806f0b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f615c001d00 tx=0x7f615c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:07.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:07.938+0000 7f6163e00640 1 -- 172.21.15.144:0/2399897766 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f615405a2a0 con 0x7f616c0ae140 2024-05-30T16:45:08.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.209+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f616c15e990 con 0x7f616c0ae140 2024-05-30T16:45:08.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.210+0000 7f6163e00640 1 -- 172.21.15.144:0/2399897766 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f6154059ba0 con 0x7f616c0ae140 2024-05-30T16:45:08.211 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmF+/kKhAA0L6yP95TzJQ6K4jpCd5+tg==", 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmn8xEDRAAjwGDHViLwz305wNijyo18g==", 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.213 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmuIxAORAA/N4DIL7c+EuojamnyYrt8Q==", 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-05-30T16:45:08.214 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmohxgGxAA4vjzBoeVO37nSNV38b13jQ==", 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAVrFhmdJ6TFxAAFhv8K0nLudGT9rT6oHmhvQ==", 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:45:08.215 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAYrFhmC1VXIhAAyyeKMhil2CcMD+5mm3xcvg==", 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.216 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAbrFhmid0VLRAA/StAYue0HlyInB/n42h3wg==", 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAerFhmJwCyNhAAkvkgyy7RRMOwwfYhyd19XA==", 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.217 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAlrFhm/8G1CxAAAlDJwijmpj2gS8x2BhgIpA==", 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAorFhmO1zgJhAAxdZsdLD/lBuyuhEdX2AF6g==", 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAsrFhmPtDmAxAA1+YfFHQ7XLtQQIOp4BLnwQ==", 2024-05-30T16:45:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAvrFhmbqIVDxAAr6NR0hbs+v/4CP4/WRT1SA==", 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA==", 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmVgMROxAA2SCdaM/Q+v9jhyfF7SZoWg==", 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmvzKvMBAAIPPum2n8LgNjGXjueMBuqQ==", 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQASrFhmdx2UCRAAFENiZ9XGo/B0vBmixV0k0A==", 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:45:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAPrFhmtLjtJBAAhR92wuSYl1aS8+gl0+zhcg==", 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmn/cwIBAAc0kCDj+gFH2f0tY5cbGrjg==", 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhm8GMmFRAAtPZbiQkY1GfShaqCf3b4Zw==", 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:45:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-05-30T16:45:08.226 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:45:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f614806cbf0 msgr2=0x7f614806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f614806cbf0 0x7f614806f0b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f615c001d00 tx=0x7f615c009040 comp rx=0 tx=0).stop 2024-05-30T16:45:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f616c0ae140 msgr2=0x7f616c0ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f616c0ae140 0x7f616c0ae5c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f615400e7c0 tx=0x7f615400ec80 comp rx=0 tx=0).stop 2024-05-30T16:45:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 shutdown_connections 2024-05-30T16:45:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f614806cbf0 0x7f614806f0b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f616c0b00f0 0x7f616c0b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f616c0ae140 0x7f616c0ae5c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 --2- 172.21.15.144:0/2399897766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61500073d0 0x7f616c14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.213+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 >> 172.21.15.144:0/2399897766 conn(0x7f616c0b20a0 msgr2=0x7f616c0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.214+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 shutdown_connections 2024-05-30T16:45:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.214+0000 7f6171000640 1 -- 172.21.15.144:0/2399897766 wait complete. 2024-05-30T16:45:08.234 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:45:08.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.432+0000 7faba1400640 1 Processor -- start 2024-05-30T16:45:08.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.432+0000 7faba1400640 1 -- start start 2024-05-30T16:45:08.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.434+0000 7faba1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c13f760 0x7fab9c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.434+0000 7faba1400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab9c06ee80 con 0x7fab9c0cec70 2024-05-30T16:45:08.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.434+0000 7faba1400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab9c160730 con 0x7fab9c0b5fd0 2024-05-30T16:45:08.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.434+0000 7faba1400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab9c1612b0 con 0x7fab9c13f760 2024-05-30T16:45:08.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.434+0000 7fab93e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fab9c0cec70 0x7fab9c0b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50330/0 (socket says 172.21.15.144:50330) 2024-05-30T16:45:08.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.434+0000 7fab93e00640 1 -- 172.21.15.144:0/1669956368 learned_addr learned my addr 172.21.15.144:0/1669956368 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:08.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.434+0000 7fab9a800640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c13f760 0x7fab9c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.434+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 360029585 0 0) 0x7fab9c06ee80 con 0x7fab9c0cec70 2024-05-30T16:45:08.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab80003520 con 0x7fab9c0cec70 2024-05-30T16:45:08.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3383507046 0 0) 0x7fab80003520 con 0x7fab9c0cec70 2024-05-30T16:45:08.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c13f760 msgr2=0x7fab9c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:08.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c13f760 0x7fab9c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 >> v1:172.21.15.149:6789/0 conn(0x7fab9c0b5fd0 legacy=0x7fab9c142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c160a10 con 0x7fab9c0cec70 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fab84001670 con 0x7fab9c0cec70 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 >> v1:172.21.15.144:6789/0 conn(0x7fab9c0cec70 legacy=0x7fab9c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab80003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c13f760 0x7fab80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab80004d40 0x7fab800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c1612b0 con 0x7fab800039e0 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab8000bb00 con 0x7fab80004d40 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.435+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab8000bd00 con 0x7fab9c13f760 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.436+0000 7fab9a800640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab80003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.436+0000 7fab93e00640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c13f760 0x7fab80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.436+0000 7fab9a800640 1 -- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c13f760 msgr2=0x7fab80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:08.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.436+0000 7fab9a800640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c13f760 0x7fab80004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.436+0000 7fab9b200640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab80004d40 0x7fab800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.436+0000 7fab9a800640 1 -- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab80004d40 msgr2=0x7fab800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:08.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.436+0000 7fab9a800640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab80004d40 0x7fab800051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.436+0000 7fab9a800640 1 -- 172.21.15.144:0/1669956368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab80003520 con 0x7fab800039e0 2024-05-30T16:45:08.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.437+0000 7fab9a800640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab80003e00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009a90 tx=0x7fab80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d24f9cf78861616 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:08.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.437+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c036070 con 0x7fab800039e0 2024-05-30T16:45:08.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.437+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8c031400 con 0x7fab800039e0 2024-05-30T16:45:08.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.437+0000 7fab99e00640 1 -- 172.21.15.144:0/1669956368 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c009690 con 0x7fab800039e0 2024-05-30T16:45:08.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.438+0000 7faba1400640 1 -- 172.21.15.144:0/1669956368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 msgr2=0x7fab80003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.438+0000 7faba1400640 1 --2- 172.21.15.144:0/1669956368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab80003e00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009a90 tx=0x7fab80005830 comp rx=0 tx=0).stop 2024-05-30T16:45:08.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.438+0000 7fab9b200640 1 -- 172.21.15.144:0/1669956368 reap_dead start 2024-05-30T16:45:08.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.438+0000 7faba1400640 1 -- 172.21.15.144:0/1669956368 shutdown_connections 2024-05-30T16:45:08.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.438+0000 7faba1400640 1 -- 172.21.15.144:0/1669956368 >> 172.21.15.144:0/1669956368 conn(0x7fab9c06bd00 msgr2=0x7fab9c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:08.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.438+0000 7faba1400640 1 -- 172.21.15.144:0/1669956368 shutdown_connections 2024-05-30T16:45:08.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.438+0000 7faba1400640 1 -- 172.21.15.144:0/1669956368 wait complete. 2024-05-30T16:45:08.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.440+0000 7faba1400640 1 Processor -- start 2024-05-30T16:45:08.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.440+0000 7faba1400640 1 -- start start 2024-05-30T16:45:08.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.441+0000 7faba1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab9c13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.441+0000 7faba1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c0a9630 0x7fab9c0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.441+0000 7faba1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c0a9ab0 0x7fab9c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.441+0000 7faba1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c160fd0 con 0x7fab800039e0 2024-05-30T16:45:08.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.441+0000 7faba1400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c0cf0d0 con 0x7fab9c0a9630 2024-05-30T16:45:08.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.441+0000 7faba1400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab9c0cf250 con 0x7fab9c0a9ab0 2024-05-30T16:45:08.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.441+0000 7fab9a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab9c13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.441+0000 7fab9a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab9c13edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40438/0 (socket says 172.21.15.144:40438) 2024-05-30T16:45:08.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.441+0000 7fab9a800640 1 -- 172.21.15.144:0/4202735017 learned_addr learned my addr 172.21.15.144:0/4202735017 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:08.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.442+0000 7fab9a800640 1 -- 172.21.15.144:0/4202735017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c0a9ab0 msgr2=0x7fab9c0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.442+0000 7fab93e00640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c0a9630 0x7fab9c0b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.442+0000 7fab9a800640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c0a9ab0 0x7fab9c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.442+0000 7fab9a800640 1 -- 172.21.15.144:0/4202735017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c0a9630 msgr2=0x7fab9c0b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.442+0000 7fab9a800640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c0a9630 0x7fab9c0b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.442+0000 7fab9a800640 1 -- 172.21.15.144:0/4202735017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c13f310 con 0x7fab800039e0 2024-05-30T16:45:08.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.442+0000 7fab93e00640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c0a9630 0x7fab9c0b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:08.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.442+0000 7fab9a800640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab9c13edd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009bb0 tx=0x7fab8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:08.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.443+0000 7fab92a00640 1 -- 172.21.15.144:0/4202735017 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c040020 con 0x7fab800039e0 2024-05-30T16:45:08.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.443+0000 7fab92a00640 1 -- 172.21.15.144:0/4202735017 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8c003940 con 0x7fab800039e0 2024-05-30T16:45:08.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.443+0000 7fab92a00640 1 -- 172.21.15.144:0/4202735017 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c036040 con 0x7fab800039e0 2024-05-30T16:45:08.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.443+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9c154ac0 con 0x7fab800039e0 2024-05-30T16:45:08.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.443+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9c155740 con 0x7fab800039e0 2024-05-30T16:45:08.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.444+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab9c068b90 con 0x7fab800039e0 2024-05-30T16:45:08.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.445+0000 7fab92a00640 1 -- 172.21.15.144:0/4202735017 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fab8c043020 con 0x7fab800039e0 2024-05-30T16:45:08.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.446+0000 7fab92a00640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab7806cbc0 0x7fab7806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.446+0000 7fab92a00640 1 -- 172.21.15.144:0/4202735017 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7fab8c0abd90 con 0x7fab800039e0 2024-05-30T16:45:08.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.446+0000 7fab93e00640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab7806cbc0 0x7fab7806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.447+0000 7fab93e00640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab7806cbc0 0x7fab7806f080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab84001200 tx=0x7fab84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:08.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.451+0000 7fab92a00640 1 -- 172.21.15.144:0/4202735017 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab8c04a070 con 0x7fab800039e0 2024-05-30T16:45:08.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.652+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fab9c06cf20 con 0x7fab800039e0 2024-05-30T16:45:08.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.653+0000 7fab92a00640 1 -- 172.21.15.144:0/4202735017 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) ==== 84+0+65 (secure 0 0 0) 0x7fab9c13f310 con 0x7fab800039e0 2024-05-30T16:45:08.654 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:08.654 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:45:08.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:08.654 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-05-30T16:45:08.654 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-05-30T16:45:08.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:08.655 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:45:08.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab7806cbc0 msgr2=0x7fab7806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab7806cbc0 0x7fab7806f080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab84001200 tx=0x7fab84009040 comp rx=0 tx=0).stop 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 msgr2=0x7fab9c13edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab9c13edd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009bb0 tx=0x7fab8c004730 comp rx=0 tx=0).stop 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 shutdown_connections 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab7806cbc0 0x7fab7806f080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab9c0a9ab0 0x7fab9c0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c0a9630 0x7fab9c0b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 --2- 172.21.15.144:0/4202735017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab800039e0 0x7fab9c13edd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 >> 172.21.15.144:0/4202735017 conn(0x7fab9c06bd00 msgr2=0x7fab9c0721e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 shutdown_connections 2024-05-30T16:45:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.656+0000 7faba1400640 1 -- 172.21.15.144:0/4202735017 wait complete. 2024-05-30T16:45:08.676 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:45:08.676 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:45:08.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.867+0000 7f8c73200640 1 Processor -- start 2024-05-30T16:45:08.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.867+0000 7f8c73200640 1 -- start start 2024-05-30T16:45:08.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.869+0000 7f8c73200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8c740b4470 0x7f8c74169780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.869+0000 7f8c73200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c74148450 con 0x7f8c74144f90 2024-05-30T16:45:08.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.869+0000 7f8c73200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7406e740 con 0x7f8c7406c3d0 2024-05-30T16:45:08.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.869+0000 7f8c73200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7406ea00 con 0x7f8c740b4470 2024-05-30T16:45:08.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.869+0000 7f8c71e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8c74144f90 0x7f8c740aecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50342/0 (socket says 172.21.15.144:50342) 2024-05-30T16:45:08.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.869+0000 7f8c71e00640 1 -- 172.21.15.144:0/3141327207 learned_addr learned my addr 172.21.15.144:0/3141327207 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:08.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.869+0000 7f8c72800640 1 --2- 172.21.15.144:0/3141327207 >> v2:172.21.15.149:3300/0 conn(0x7f8c740b4470 0x7f8c74169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1248799722 0 0) 0x7f8c74148450 con 0x7f8c74144f90 2024-05-30T16:45:08.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c58003520 con 0x7f8c74144f90 2024-05-30T16:45:08.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 278578349 0 0) 0x7f8c58003520 con 0x7f8c74144f90 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 >> v2:172.21.15.149:3300/0 conn(0x7f8c740b4470 msgr2=0x7f8c74169780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 --2- 172.21.15.144:0/3141327207 >> v2:172.21.15.149:3300/0 conn(0x7f8c740b4470 0x7f8c74169780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 >> v1:172.21.15.149:6789/0 conn(0x7f8c7406c3d0 legacy=0x7f8c740af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7406ece0 con 0x7f8c74144f90 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f8c64001670 con 0x7f8c74144f90 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 >> v1:172.21.15.144:6789/0 conn(0x7f8c74144f90 legacy=0x7f8c740aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c58004800 0x7f8c58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c580051c0 0x7f8c5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7406ea00 con 0x7f8c580039b0 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5800c160 con 0x7f8c58004800 2024-05-30T16:45:08.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5800c360 con 0x7f8c580051c0 2024-05-30T16:45:08.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.870+0000 7f8c71e00640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.871+0000 7f8c71400640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c58004800 0x7f8c58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.871+0000 7f8c72800640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c580051c0 0x7f8c5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.871+0000 7f8c71e00640 1 -- 172.21.15.144:0/3141327207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c580051c0 msgr2=0x7f8c5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:08.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.871+0000 7f8c71e00640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c580051c0 0x7f8c5800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.871+0000 7f8c71e00640 1 -- 172.21.15.144:0/3141327207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c58004800 msgr2=0x7f8c58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:08.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.871+0000 7f8c71e00640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c58004800 0x7f8c58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.871+0000 7f8c71e00640 1 -- 172.21.15.144:0/3141327207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c58003520 con 0x7f8c580039b0 2024-05-30T16:45:08.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.871+0000 7f8c72800640 1 -- 172.21.15.144:0/3141327207 reap_dead start 2024-05-30T16:45:08.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.872+0000 7f8c71e00640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c58003dd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c240 tx=0x7f8c58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e62fc9e700e9db server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:08.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.872+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64007d10 con 0x7f8c580039b0 2024-05-30T16:45:08.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.872+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c64005ad0 con 0x7f8c580039b0 2024-05-30T16:45:08.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.872+0000 7f8c70a00640 1 -- 172.21.15.144:0/3141327207 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64007070 con 0x7f8c580039b0 2024-05-30T16:45:08.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.873+0000 7f8c73200640 1 -- 172.21.15.144:0/3141327207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 msgr2=0x7f8c58003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.873+0000 7f8c73200640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c58003dd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c240 tx=0x7f8c58005830 comp rx=0 tx=0).stop 2024-05-30T16:45:08.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.873+0000 7f8c73200640 1 -- 172.21.15.144:0/3141327207 shutdown_connections 2024-05-30T16:45:08.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.873+0000 7f8c73200640 1 --2- 172.21.15.144:0/3141327207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c58003dd0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.873+0000 7f8c73200640 1 -- 172.21.15.144:0/3141327207 >> 172.21.15.144:0/3141327207 conn(0x7f8c7406b8e0 msgr2=0x7f8c7406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:08.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.873+0000 7f8c73200640 1 -- 172.21.15.144:0/3141327207 shutdown_connections 2024-05-30T16:45:08.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.873+0000 7f8c73200640 1 -- 172.21.15.144:0/3141327207 wait complete. 2024-05-30T16:45:08.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.875+0000 7f8c73200640 1 Processor -- start 2024-05-30T16:45:08.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.875+0000 7f8c73200640 1 -- start start 2024-05-30T16:45:08.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.876+0000 7f8c73200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c7413f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.876+0000 7f8c73200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c741435c0 0x7f8c74143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.876+0000 7f8c73200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c740c6130 0x7f8c740c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.876+0000 7f8c73200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8c740b3460 con 0x7f8c580039b0 2024-05-30T16:45:08.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.876+0000 7f8c73200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7406f2a0 con 0x7f8c741435c0 2024-05-30T16:45:08.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.876+0000 7f8c73200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8c740b35e0 con 0x7f8c740c6130 2024-05-30T16:45:08.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.876+0000 7f8c71e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c7413f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.876+0000 7f8c71e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c7413f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40452/0 (socket says 172.21.15.144:40452) 2024-05-30T16:45:08.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.876+0000 7f8c71e00640 1 -- 172.21.15.144:0/1785905177 learned_addr learned my addr 172.21.15.144:0/1785905177 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:08.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c71400640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c741435c0 0x7f8c74143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c71e00640 1 -- 172.21.15.144:0/1785905177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c740c6130 msgr2=0x7f8c740c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c71e00640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c740c6130 0x7f8c740c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c71e00640 1 -- 172.21.15.144:0/1785905177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c741435c0 msgr2=0x7f8c74143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c71e00640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c741435c0 0x7f8c74143a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c71e00640 1 -- 172.21.15.144:0/1785905177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c741f4b20 con 0x7f8c580039b0 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c71e00640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c7413f140 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c360 tx=0x7f8c7406eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c6a000640 1 -- 172.21.15.144:0/1785905177 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64037040 con 0x7f8c580039b0 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c6a000640 1 -- 172.21.15.144:0/1785905177 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c640047e0 con 0x7f8c580039b0 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c6a000640 1 -- 172.21.15.144:0/1785905177 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64007d10 con 0x7f8c580039b0 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c741f4e00 con 0x7f8c580039b0 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.877+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c740c6af0 con 0x7f8c580039b0 2024-05-30T16:45:08.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.878+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c74075570 con 0x7f8c580039b0 2024-05-30T16:45:08.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.879+0000 7f8c6a000640 1 -- 172.21.15.144:0/1785905177 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f8c64004bd0 con 0x7f8c580039b0 2024-05-30T16:45:08.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.880+0000 7f8c6a000640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8c5006cbf0 0x7f8c5006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:08.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.880+0000 7f8c6a000640 1 -- 172.21.15.144:0/1785905177 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f8c640ab920 con 0x7f8c580039b0 2024-05-30T16:45:08.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.881+0000 7f8c71400640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8c5006cbf0 0x7f8c5006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:08.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.881+0000 7f8c71400640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8c5006cbf0 0x7f8c5006f0b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c007fd0 tx=0x7f8c5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:08.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:08.885+0000 7f8c6a000640 1 -- 172.21.15.144:0/1785905177 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c64079d90 con 0x7f8c580039b0 2024-05-30T16:45:09.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.090+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8c74072e20 con 0x7f8c580039b0 2024-05-30T16:45:09.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.713+0000 7f8c6a000640 1 -- 172.21.15.144:0/1785905177 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) ==== 138+0+0 (secure 0 0 0) 0x7f8c64079690 con 0x7f8c580039b0 2024-05-30T16:45:09.715 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-05-30T16:45:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.716+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8c5006cbf0 msgr2=0x7f8c5006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.716+0000 7f8c73200640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8c5006cbf0 0x7f8c5006f0b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c007fd0 tx=0x7f8c5c009040 comp rx=0 tx=0).stop 2024-05-30T16:45:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.716+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 msgr2=0x7f8c7413f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.716+0000 7f8c73200640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c7413f140 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c360 tx=0x7f8c7406eeb0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.717+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 shutdown_connections 2024-05-30T16:45:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.717+0000 7f8c73200640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8c5006cbf0 0x7f8c5006f0b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.717+0000 7f8c73200640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c740c6130 0x7f8c740c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.717+0000 7f8c73200640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c741435c0 0x7f8c74143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.717+0000 7f8c73200640 1 --2- 172.21.15.144:0/1785905177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c580039b0 0x7f8c7413f140 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.717+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 >> 172.21.15.144:0/1785905177 conn(0x7f8c7406b8e0 msgr2=0x7f8c740b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.717+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 shutdown_connections 2024-05-30T16:45:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.717+0000 7f8c73200640 1 -- 172.21.15.144:0/1785905177 wait complete. 2024-05-30T16:45:09.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:45:09.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.933+0000 7f47e3200640 1 Processor -- start 2024-05-30T16:45:09.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.933+0000 7f47e3200640 1 -- start start 2024-05-30T16:45:09.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.935+0000 7f47e3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47dc140c80 0x7f47dc165c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:09.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.935+0000 7f47e3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc0cd030 con 0x7f47dc0afa00 2024-05-30T16:45:09.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.935+0000 7f47e3200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc0ceca0 con 0x7f47dc0cc7a0 2024-05-30T16:45:09.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.935+0000 7f47e3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47dc1413f0 con 0x7f47dc140c80 2024-05-30T16:45:09.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.935+0000 7f47dbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f47dc0afa00 0x7f47dc15bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50352/0 (socket says 172.21.15.144:50352) 2024-05-30T16:45:09.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.935+0000 7f47dbe00640 1 -- 172.21.15.144:0/1762976365 learned_addr learned my addr 172.21.15.144:0/1762976365 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47e1200640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47dc140c80 0x7f47dc165c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483354998 0 0) 0x7f47dc0cd030 con 0x7f47dc0afa00 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47c0003440 con 0x7f47dc0afa00 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1191781341 0 0) 0x7f47c0003440 con 0x7f47dc0afa00 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47dc140c80 msgr2=0x7f47dc165c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47dc140c80 0x7f47dc165c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 >> v1:172.21.15.149:6789/0 conn(0x7f47dc0cc7a0 legacy=0x7f47dc140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc0cd2a0 con 0x7f47dc0afa00 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f47cc001670 con 0x7f47dc0afa00 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 >> v1:172.21.15.144:6789/0 conn(0x7f47dc0afa00 legacy=0x7f47dc15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c0003ad0 0x7f47c0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.936+0000 7f47daa00640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c00088a0 0x7f47c000acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47daa00640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47dc140c80 0x7f47c000d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47c000dd40 con 0x7f47c0003ad0 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47c000def0 con 0x7f47c00088a0 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47c000e0f0 con 0x7f47dc140c80 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47dbe00640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c0003ad0 0x7f47c0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47db400640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c00088a0 0x7f47c000acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47e1200640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47dc140c80 0x7f47c000d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47dbe00640 1 -- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47dc140c80 msgr2=0x7f47c000d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47dbe00640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47dc140c80 0x7f47c000d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47dbe00640 1 -- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c00088a0 msgr2=0x7f47c000acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47dbe00640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c00088a0 0x7f47c000acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.937+0000 7f47dbe00640 1 -- 172.21.15.144:0/1762976365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c0003440 con 0x7f47c0003ad0 2024-05-30T16:45:09.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.938+0000 7f47dbe00640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c0003ad0 0x7f47c0003ef0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f47cc00c110 tx=0x7f47c0003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c58ed051310129 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.939+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc007c40 con 0x7f47c0003ad0 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.939+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47cc005af0 con 0x7f47c0003ad0 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.939+0000 7f47daa00640 1 -- 172.21.15.144:0/1762976365 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc007070 con 0x7f47c0003ad0 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.939+0000 7f47e3200640 1 -- 172.21.15.144:0/1762976365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c0003ad0 msgr2=0x7f47c0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.939+0000 7f47e3200640 1 --2- 172.21.15.144:0/1762976365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c0003ad0 0x7f47c0003ef0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f47cc00c110 tx=0x7f47c0003730 comp rx=0 tx=0).stop 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.939+0000 7f47e1200640 1 -- 172.21.15.144:0/1762976365 reap_dead start 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.939+0000 7f47e3200640 1 -- 172.21.15.144:0/1762976365 shutdown_connections 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.939+0000 7f47e3200640 1 -- 172.21.15.144:0/1762976365 >> 172.21.15.144:0/1762976365 conn(0x7f47dc06bd00 msgr2=0x7f47dc06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.940+0000 7f47e3200640 1 -- 172.21.15.144:0/1762976365 shutdown_connections 2024-05-30T16:45:09.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.940+0000 7f47e3200640 1 -- 172.21.15.144:0/1762976365 wait complete. 2024-05-30T16:45:09.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.942+0000 7f47e3200640 1 Processor -- start 2024-05-30T16:45:09.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.942+0000 7f47e3200640 1 -- start start 2024-05-30T16:45:09.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.943+0000 7f47e3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c0003ad0 0x7f47dc13ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:09.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.943+0000 7f47e3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47dc15c3d0 0x7f47dc1e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:09.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.943+0000 7f47e3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47dc1e64c0 0x7f47dc1e8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:09.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.943+0000 7f47e3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc0ccc60 con 0x7f47dc15c3d0 2024-05-30T16:45:09.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.943+0000 7f47e3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc0cd860 con 0x7f47dc1e64c0 2024-05-30T16:45:09.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.943+0000 7f47e3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47dc0afde0 con 0x7f47c0003ad0 2024-05-30T16:45:09.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.943+0000 7f47db400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47dc15c3d0 0x7f47dc1e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:09.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.943+0000 7f47db400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47dc15c3d0 0x7f47dc1e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40480/0 (socket says 172.21.15.144:40480) 2024-05-30T16:45:09.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.943+0000 7f47db400640 1 -- 172.21.15.144:0/2166416402 learned_addr learned my addr 172.21.15.144:0/2166416402 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:09.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47dbe00640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c0003ad0 0x7f47dc13ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:09.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47e1200640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47dc1e64c0 0x7f47dc1e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:09.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47db400640 1 -- 172.21.15.144:0/2166416402 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c0003ad0 msgr2=0x7f47dc13ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47db400640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c0003ad0 0x7f47dc13ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47db400640 1 -- 172.21.15.144:0/2166416402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47dc1e64c0 msgr2=0x7f47dc1e8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47db400640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47dc1e64c0 0x7f47dc1e8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47db400640 1 -- 172.21.15.144:0/2166416402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc1e6940 con 0x7f47dc15c3d0 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47e1200640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47dc1e64c0 0x7f47dc1e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47db400640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47dc15c3d0 0x7f47dc1e5f80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f47c800e410 tx=0x7f47c800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47d3e00640 1 -- 172.21.15.144:0/2166416402 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8019070 con 0x7f47dc15c3d0 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47d3e00640 1 -- 172.21.15.144:0/2166416402 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c80053a0 con 0x7f47dc15c3d0 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47dc1e6bd0 con 0x7f47dc15c3d0 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.944+0000 7f47d3e00640 1 -- 172.21.15.144:0/2166416402 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8003810 con 0x7f47dc15c3d0 2024-05-30T16:45:09.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.945+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47dc1e3e50 con 0x7f47dc15c3d0 2024-05-30T16:45:09.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.946+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47dc1e70f0 con 0x7f47dc15c3d0 2024-05-30T16:45:09.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.947+0000 7f47d3e00640 1 -- 172.21.15.144:0/2166416402 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f47c801c070 con 0x7f47dc15c3d0 2024-05-30T16:45:09.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.948+0000 7f47d3e00640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f47bc06cbf0 0x7f47bc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:09.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.948+0000 7f47d3e00640 1 -- 172.21.15.144:0/2166416402 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5227+0+0 (secure 0 0 0) 0x7f47c808bc20 con 0x7f47dc15c3d0 2024-05-30T16:45:09.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.949+0000 7f47dbe00640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f47bc06cbf0 0x7f47bc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:09.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.949+0000 7f47dbe00640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f47bc06cbf0 0x7f47bc06f0b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f47cc032000 tx=0x7f47cc009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:09.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:09.952+0000 7f47d3e00640 1 -- 172.21.15.144:0/2166416402 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f47dc1e70f0 con 0x7f47dc15c3d0 2024-05-30T16:45:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.153+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f47dc068b90 con 0x7f47dc15c3d0 2024-05-30T16:45:10.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.731+0000 7f47d3e00640 1 -- 172.21.15.144:0/2166416402 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) ==== 170+0+0 (secure 0 0 0) 0x7f47c8059850 con 0x7f47dc15c3d0 2024-05-30T16:45:10.733 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-05-30T16:45:10.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.735+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f47bc06cbf0 msgr2=0x7f47bc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:10.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.735+0000 7f47e3200640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f47bc06cbf0 0x7f47bc06f0b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f47cc032000 tx=0x7f47cc009030 comp rx=0 tx=0).stop 2024-05-30T16:45:10.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.735+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47dc15c3d0 msgr2=0x7f47dc1e5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:10.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.735+0000 7f47e3200640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47dc15c3d0 0x7f47dc1e5f80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f47c800e410 tx=0x7f47c800e8d0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.736+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 shutdown_connections 2024-05-30T16:45:10.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.736+0000 7f47e3200640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f47bc06cbf0 0x7f47bc06f0b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.736+0000 7f47e3200640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47dc1e64c0 0x7f47dc1e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.736+0000 7f47e3200640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47dc15c3d0 0x7f47dc1e5f80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.736+0000 7f47e3200640 1 --2- 172.21.15.144:0/2166416402 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c0003ad0 0x7f47dc13ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.736+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 >> 172.21.15.144:0/2166416402 conn(0x7f47dc06bd00 msgr2=0x7f47dc13fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:10.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.737+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 shutdown_connections 2024-05-30T16:45:10.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.737+0000 7f47e3200640 1 -- 172.21.15.144:0/2166416402 wait complete. 2024-05-30T16:45:10.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:45:10.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.949+0000 7f284ae00640 1 Processor -- start 2024-05-30T16:45:10.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.949+0000 7f284ae00640 1 -- start start 2024-05-30T16:45:10.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.950+0000 7f284ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2844147cc0 0x7f28440b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:10.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.950+0000 7f284ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28440b4800 0x7f2844162480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:10.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.950+0000 7f284ae00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f284406e440 con 0x7f2844144e70 2024-05-30T16:45:10.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.950+0000 7f284ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2844145250 con 0x7f2844147cc0 2024-05-30T16:45:10.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.950+0000 7f284ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f28440b3e30 con 0x7f28440b4800 2024-05-30T16:45:10.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.951+0000 7f2849000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2844147cc0 0x7f28440b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:10.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.951+0000 7f2849000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2844147cc0 0x7f28440b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40486/0 (socket says 172.21.15.144:40486) 2024-05-30T16:45:10.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.951+0000 7f2849000640 1 -- 172.21.15.144:0/1830572493 learned_addr learned my addr 172.21.15.144:0/1830572493 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:10.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.951+0000 7f284a400640 1 --2- 172.21.15.144:0/1830572493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28440b4800 0x7f2844162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:10.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.951+0000 7f2849000640 1 -- 172.21.15.144:0/1830572493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28440b4800 msgr2=0x7f2844162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:10.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.951+0000 7f2849000640 1 --2- 172.21.15.144:0/1830572493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28440b4800 0x7f2844162480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.951+0000 7f2849000640 1 -- 172.21.15.144:0/1830572493 >> v1:172.21.15.149:6789/0 conn(0x7f2844144e70 legacy=0x7f284406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:10.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.951+0000 7f2849000640 1 -- 172.21.15.144:0/1830572493 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28440b4c90 con 0x7f2844147cc0 2024-05-30T16:45:10.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.951+0000 7f284a400640 1 --2- 172.21.15.144:0/1830572493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28440b4800 0x7f2844162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:10.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.952+0000 7f2849000640 1 --2- 172.21.15.144:0/1830572493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2844147cc0 0x7f28440b42c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2834009870 tx=0x7f283402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8446c102729e56 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:10.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.953+0000 7f2843e00640 1 -- 172.21.15.144:0/1830572493 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834037070 con 0x7f2844147cc0 2024-05-30T16:45:10.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.953+0000 7f2843e00640 1 -- 172.21.15.144:0/1830572493 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2834032440 con 0x7f2844147cc0 2024-05-30T16:45:10.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.953+0000 7f2843e00640 1 -- 172.21.15.144:0/1830572493 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834032810 con 0x7f2844147cc0 2024-05-30T16:45:10.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.953+0000 7f284ae00640 1 -- 172.21.15.144:0/1830572493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2844147cc0 msgr2=0x7f28440b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:10.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.953+0000 7f284ae00640 1 --2- 172.21.15.144:0/1830572493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2844147cc0 0x7f28440b42c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2834009870 tx=0x7f283402a200 comp rx=0 tx=0).stop 2024-05-30T16:45:10.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.953+0000 7f284ae00640 1 -- 172.21.15.144:0/1830572493 shutdown_connections 2024-05-30T16:45:10.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.953+0000 7f284ae00640 1 --2- 172.21.15.144:0/1830572493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28440b4800 0x7f2844162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.953+0000 7f284ae00640 1 --2- 172.21.15.144:0/1830572493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2844147cc0 0x7f28440b42c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.953+0000 7f284ae00640 1 -- 172.21.15.144:0/1830572493 >> 172.21.15.144:0/1830572493 conn(0x7f284406b8e0 msgr2=0x7f284406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:10.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.954+0000 7f284ae00640 1 -- 172.21.15.144:0/1830572493 shutdown_connections 2024-05-30T16:45:10.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.954+0000 7f284ae00640 1 -- 172.21.15.144:0/1830572493 wait complete. 2024-05-30T16:45:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.955+0000 7f284ae00640 1 Processor -- start 2024-05-30T16:45:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.956+0000 7f284ae00640 1 -- start start 2024-05-30T16:45:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.956+0000 7f284ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28440b4800 0x7f28441411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.956+0000 7f284ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2844144e70 0x7f284415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f284ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2844147cc0 0x7f28440cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f284ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f28440b3ac0 con 0x7f28440b4800 2024-05-30T16:45:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f284ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f28440b37e0 con 0x7f2844144e70 2024-05-30T16:45:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f284ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f284406c3d0 con 0x7f2844147cc0 2024-05-30T16:45:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28440b4800 0x7f28441411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28440b4800 0x7f28441411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40502/0 (socket says 172.21.15.144:40502) 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849a00640 1 -- 172.21.15.144:0/3905364340 learned_addr learned my addr 172.21.15.144:0/3905364340 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849000640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2844144e70 0x7f284415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f284a400640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2844147cc0 0x7f28440cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849a00640 1 -- 172.21.15.144:0/3905364340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2844147cc0 msgr2=0x7f28440cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849a00640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2844147cc0 0x7f28440cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849a00640 1 -- 172.21.15.144:0/3905364340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2844144e70 msgr2=0x7f284415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849a00640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2844144e70 0x7f284415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849a00640 1 -- 172.21.15.144:0/3905364340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28440ce3f0 con 0x7f28440b4800 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.957+0000 7f2849000640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2844144e70 0x7f284415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.958+0000 7f2849a00640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28440b4800 0x7f28441411a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f283800c430 tx=0x7f283800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.958+0000 7f2841600640 1 -- 172.21.15.144:0/3905364340 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838011790 con 0x7f28440b4800 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.958+0000 7f2841600640 1 -- 172.21.15.144:0/3905364340 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2838017070 con 0x7f28440b4800 2024-05-30T16:45:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.958+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28440ce6d0 con 0x7f28440b4800 2024-05-30T16:45:10.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.958+0000 7f2841600640 1 -- 172.21.15.144:0/3905364340 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838011bb0 con 0x7f28440b4800 2024-05-30T16:45:10.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.958+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28440cec90 con 0x7f28440b4800 2024-05-30T16:45:10.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.959+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28440632f0 con 0x7f28440b4800 2024-05-30T16:45:10.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.961+0000 7f2841600640 1 -- 172.21.15.144:0/3905364340 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f283801c460 con 0x7f28440b4800 2024-05-30T16:45:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.962+0000 7f2841600640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f282806cbc0 0x7f282806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.962+0000 7f2841600640 1 -- 172.21.15.144:0/3905364340 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5609+0+0 (secure 0 0 0) 0x7f283808bf30 con 0x7f28440b4800 2024-05-30T16:45:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.962+0000 7f2849000640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f282806cbc0 0x7f282806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.963+0000 7f2849000640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f282806cbc0 0x7f282806f080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2834034000 tx=0x7f283402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:10.967+0000 7f2841600640 1 -- 172.21.15.144:0/3905364340 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2838059fa0 con 0x7f28440b4800 2024-05-30T16:45:11.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.207+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2844075570 con 0x7f28440b4800 2024-05-30T16:45:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.758+0000 7f2841600640 1 -- 172.21.15.144:0/3905364340 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v23) ==== 172+0+0 (secure 0 0 0) 0x7f28380598a0 con 0x7f28440b4800 2024-05-30T16:45:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 6 and data pool 7 2024-05-30T16:45:11.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.764+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f282806cbc0 msgr2=0x7f282806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:11.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.764+0000 7f284ae00640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f282806cbc0 0x7f282806f080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2834034000 tx=0x7f283402e000 comp rx=0 tx=0).stop 2024-05-30T16:45:11.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.764+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28440b4800 msgr2=0x7f28441411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:11.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.764+0000 7f284ae00640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28440b4800 0x7f28441411a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f283800c430 tx=0x7f283800c8f0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.765+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 shutdown_connections 2024-05-30T16:45:11.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.765+0000 7f284ae00640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f282806cbc0 0x7f282806f080 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.765+0000 7f284ae00640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2844147cc0 0x7f28440cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.765+0000 7f284ae00640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2844144e70 0x7f284415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.765+0000 7f284ae00640 1 --2- 172.21.15.144:0/3905364340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28440b4800 0x7f28441411a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.765+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 >> 172.21.15.144:0/3905364340 conn(0x7f284406b8e0 msgr2=0x7f28440b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:11.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.765+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 shutdown_connections 2024-05-30T16:45:11.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.767+0000 7f284ae00640 1 -- 172.21.15.144:0/3905364340 wait complete. 2024-05-30T16:45:11.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:45:11.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.968+0000 7fd8eba00640 1 Processor -- start 2024-05-30T16:45:11.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.968+0000 7fd8eba00640 1 -- start start 2024-05-30T16:45:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.969+0000 7fd8eba00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd8e413f760 0x7fd8e406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.969+0000 7fd8eba00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8e40cec70 0x7fd8e40b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.969+0000 7fd8eba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8e40b5e00 0x7fd8e4142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.969+0000 7fd8eba00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd8e41612b0 con 0x7fd8e40cec70 2024-05-30T16:45:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.969+0000 7fd8eba00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd8e413fb40 con 0x7fd8e413f760 2024-05-30T16:45:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.969+0000 7fd8eba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e406ee80 con 0x7fd8e40b5e00 2024-05-30T16:45:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8e40cec70 0x7fd8e40b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8e40cec70 0x7fd8e40b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40512/0 (socket says 172.21.15.144:40512) 2024-05-30T16:45:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8dbe00640 1 -- 172.21.15.144:0/2678201577 learned_addr learned my addr 172.21.15.144:0/2678201577 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:11.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8e9000640 1 --2- 172.21.15.144:0/2678201577 >> v2:172.21.15.149:3300/0 conn(0x7fd8e413f760 0x7fd8e406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:11.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8e9a00640 1 --2- 172.21.15.144:0/2678201577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8e40b5e00 0x7fd8e4142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:11.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8dbe00640 1 -- 172.21.15.144:0/2678201577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8e40b5e00 msgr2=0x7fd8e4142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:11.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8dbe00640 1 --2- 172.21.15.144:0/2678201577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8e40b5e00 0x7fd8e4142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8dbe00640 1 -- 172.21.15.144:0/2678201577 >> v2:172.21.15.149:3300/0 conn(0x7fd8e413f760 msgr2=0x7fd8e406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:11.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8dbe00640 1 --2- 172.21.15.144:0/2678201577 >> v2:172.21.15.149:3300/0 conn(0x7fd8e413f760 0x7fd8e406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.970+0000 7fd8dbe00640 1 -- 172.21.15.144:0/2678201577 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e4160730 con 0x7fd8e40cec70 2024-05-30T16:45:11.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.971+0000 7fd8dbe00640 1 --2- 172.21.15.144:0/2678201577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40cec70 0x7fd8e40b58c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd8e406e8a0 tx=0x7fd8cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3955a50f666e786 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:11.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.971+0000 7fd8e3e00640 1 -- 172.21.15.144:0/2678201577 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc037070 con 0x7fd8e40cec70 2024-05-30T16:45:11.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.971+0000 7fd8e3e00640 1 -- 172.21.15.144:0/2678201577 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8cc032440 con 0x7fd8e40cec70 2024-05-30T16:45:11.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.971+0000 7fd8e3e00640 1 -- 172.21.15.144:0/2678201577 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc032810 con 0x7fd8e40cec70 2024-05-30T16:45:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.972+0000 7fd8eba00640 1 -- 172.21.15.144:0/2678201577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40cec70 msgr2=0x7fd8e40b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.972+0000 7fd8eba00640 1 --2- 172.21.15.144:0/2678201577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40cec70 0x7fd8e40b58c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd8e406e8a0 tx=0x7fd8cc02a270 comp rx=0 tx=0).stop 2024-05-30T16:45:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.972+0000 7fd8eba00640 1 -- 172.21.15.144:0/2678201577 shutdown_connections 2024-05-30T16:45:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.972+0000 7fd8eba00640 1 --2- 172.21.15.144:0/2678201577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8e40b5e00 0x7fd8e4142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.972+0000 7fd8eba00640 1 --2- 172.21.15.144:0/2678201577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40cec70 0x7fd8e40b58c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.972+0000 7fd8eba00640 1 --2- 172.21.15.144:0/2678201577 >> v2:172.21.15.149:3300/0 conn(0x7fd8e413f760 0x7fd8e406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.972+0000 7fd8eba00640 1 -- 172.21.15.144:0/2678201577 >> 172.21.15.144:0/2678201577 conn(0x7fd8e406bd00 msgr2=0x7fd8e406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.972+0000 7fd8eba00640 1 -- 172.21.15.144:0/2678201577 shutdown_connections 2024-05-30T16:45:11.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.972+0000 7fd8eba00640 1 -- 172.21.15.144:0/2678201577 wait complete. 2024-05-30T16:45:11.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.974+0000 7fd8eba00640 1 Processor -- start 2024-05-30T16:45:11.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.974+0000 7fd8eba00640 1 -- start start 2024-05-30T16:45:11.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.975+0000 7fd8eba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40b5e00 0x7fd8e4136ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.975+0000 7fd8eba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8e40cec70 0x7fd8e40b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.975+0000 7fd8eba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e413f760 0x7fd8e40a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.975+0000 7fd8eba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e4160fd0 con 0x7fd8e40b5e00 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.975+0000 7fd8eba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e4160cf0 con 0x7fd8e413f760 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.975+0000 7fd8eba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e40cf0d0 con 0x7fd8e40cec70 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.975+0000 7fd8e9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40b5e00 0x7fd8e4136ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.975+0000 7fd8e9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40b5e00 0x7fd8e4136ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40524/0 (socket says 172.21.15.144:40524) 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.975+0000 7fd8e9000640 1 -- 172.21.15.144:0/339841998 learned_addr learned my addr 172.21.15.144:0/339841998 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e9a00640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e413f760 0x7fd8e40a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e9000640 1 -- 172.21.15.144:0/339841998 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8e40cec70 msgr2=0x7fd8e40b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e9000640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8e40cec70 0x7fd8e40b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e9000640 1 -- 172.21.15.144:0/339841998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e413f760 msgr2=0x7fd8e40a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e9000640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e413f760 0x7fd8e40a9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:11.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e9000640 1 -- 172.21.15.144:0/339841998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e40b41f0 con 0x7fd8e40b5e00 2024-05-30T16:45:11.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e9000640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40b5e00 0x7fd8e4136ce0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400d5f0 tx=0x7fd8d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e1600640 1 -- 172.21.15.144:0/339841998 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40125f0 con 0x7fd8e40b5e00 2024-05-30T16:45:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e1600640 1 -- 172.21.15.144:0/339841998 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d4019070 con 0x7fd8e40b5e00 2024-05-30T16:45:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e40b44d0 con 0x7fd8e40b5e00 2024-05-30T16:45:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8e1600640 1 -- 172.21.15.144:0/339841998 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40129d0 con 0x7fd8e40b5e00 2024-05-30T16:45:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.976+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e40b4a90 con 0x7fd8e40b5e00 2024-05-30T16:45:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.977+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e4068b90 con 0x7fd8e40b5e00 2024-05-30T16:45:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.978+0000 7fd8e1600640 1 -- 172.21.15.144:0/339841998 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fd8d4012b70 con 0x7fd8e40b5e00 2024-05-30T16:45:11.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.980+0000 7fd8e1600640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8c006cbc0 0x7fd8c006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:11.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.980+0000 7fd8e1600640 1 -- 172.21.15.144:0/339841998 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fd8d408c360 con 0x7fd8e40b5e00 2024-05-30T16:45:11.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.980+0000 7fd8dbe00640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8c006cbc0 0x7fd8c006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:11.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.981+0000 7fd8dbe00640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8c006cbc0 0x7fd8c006f080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc034000 tx=0x7fd8cc02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:11.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:11.984+0000 7fd8e1600640 1 -- 172.21.15.144:0/339841998 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd8d405a4d0 con 0x7fd8e40b5e00 2024-05-30T16:45:12.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.170+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8e41405e0 con 0x7fd8e40b5e00 2024-05-30T16:45:12.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.173+0000 7fd8e1600640 1 -- 172.21.15.144:0/339841998 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16662 (secure 0 0 0) 0x7fd8d4059dd0 con 0x7fd8e40b5e00 2024-05-30T16:45:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:12.174 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":43,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:45:11.209829+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:45:09.108059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:45:10.167194+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:45:12.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.175+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8c006cbc0 msgr2=0x7fd8c006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.175+0000 7fd8eba00640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8c006cbc0 0x7fd8c006f080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc034000 tx=0x7fd8cc02c000 comp rx=0 tx=0).stop 2024-05-30T16:45:12.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.175+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40b5e00 msgr2=0x7fd8e4136ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.175+0000 7fd8eba00640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40b5e00 0x7fd8e4136ce0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400d5f0 tx=0x7fd8d400dab0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.176+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 shutdown_connections 2024-05-30T16:45:12.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.176+0000 7fd8eba00640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd8c006cbc0 0x7fd8c006f080 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.176+0000 7fd8eba00640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e413f760 0x7fd8e40a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.176+0000 7fd8eba00640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8e40cec70 0x7fd8e40b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.176+0000 7fd8eba00640 1 --2- 172.21.15.144:0/339841998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e40b5e00 0x7fd8e4136ce0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.176+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 >> 172.21.15.144:0/339841998 conn(0x7fd8e406bd00 msgr2=0x7fd8e406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:12.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.176+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 shutdown_connections 2024-05-30T16:45:12.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.176+0000 7fd8eba00640 1 -- 172.21.15.144:0/339841998 wait complete. 2024-05-30T16:45:12.194 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:45:12.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.389+0000 7f4edee00640 1 Processor -- start 2024-05-30T16:45:12.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.389+0000 7f4edee00640 1 -- start start 2024-05-30T16:45:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.391+0000 7f4edee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ed813f760 0x7f4ed806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.391+0000 7f4edee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed80b5fd0 0x7f4ed8142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.391+0000 7f4edee00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ed806ee80 con 0x7f4ed80cec70 2024-05-30T16:45:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.391+0000 7f4edee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4ed81612b0 con 0x7f4ed813f760 2024-05-30T16:45:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.391+0000 7f4edee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed813fb40 con 0x7f4ed80b5fd0 2024-05-30T16:45:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.391+0000 7f4ed7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ed813f760 0x7f4ed806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.391+0000 7f4ed7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ed813f760 0x7f4ed806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40536/0 (socket says 172.21.15.144:40536) 2024-05-30T16:45:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.391+0000 7f4ed7e00640 1 -- 172.21.15.144:0/942435666 learned_addr learned my addr 172.21.15.144:0/942435666 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.392+0000 7f4edce00640 1 --2- 172.21.15.144:0/942435666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed80b5fd0 0x7f4ed8142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.392+0000 7f4ed7e00640 1 -- 172.21.15.144:0/942435666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed80b5fd0 msgr2=0x7f4ed8142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.392+0000 7f4ed7e00640 1 --2- 172.21.15.144:0/942435666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed80b5fd0 0x7f4ed8142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.392+0000 7f4ed7e00640 1 -- 172.21.15.144:0/942435666 >> v1:172.21.15.149:6789/0 conn(0x7f4ed80cec70 legacy=0x7f4ed80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.392+0000 7f4ed7e00640 1 -- 172.21.15.144:0/942435666 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed8160730 con 0x7f4ed813f760 2024-05-30T16:45:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.392+0000 7f4edce00640 1 --2- 172.21.15.144:0/942435666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed80b5fd0 0x7f4ed8142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:45:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.393+0000 7f4ed7e00640 1 --2- 172.21.15.144:0/942435666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed813f760 0x7f4ed806e940 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009870 tx=0x7f4ec802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc3f5ec577ee416 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:12.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.394+0000 7f4ed7400640 1 -- 172.21.15.144:0/942435666 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8037070 con 0x7f4ed813f760 2024-05-30T16:45:12.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.394+0000 7f4ed7400640 1 -- 172.21.15.144:0/942435666 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec802ae50 con 0x7f4ed813f760 2024-05-30T16:45:12.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.394+0000 7f4ed7400640 1 -- 172.21.15.144:0/942435666 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8032860 con 0x7f4ed813f760 2024-05-30T16:45:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.394+0000 7f4edee00640 1 -- 172.21.15.144:0/942435666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed813f760 msgr2=0x7f4ed806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.394+0000 7f4edee00640 1 --2- 172.21.15.144:0/942435666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed813f760 0x7f4ed806e940 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009870 tx=0x7f4ec802a300 comp rx=0 tx=0).stop 2024-05-30T16:45:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.395+0000 7f4edee00640 1 -- 172.21.15.144:0/942435666 shutdown_connections 2024-05-30T16:45:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.395+0000 7f4edee00640 1 --2- 172.21.15.144:0/942435666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed80b5fd0 0x7f4ed8142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.395+0000 7f4edee00640 1 --2- 172.21.15.144:0/942435666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed813f760 0x7f4ed806e940 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.395+0000 7f4edee00640 1 -- 172.21.15.144:0/942435666 >> 172.21.15.144:0/942435666 conn(0x7f4ed806bd00 msgr2=0x7f4ed806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.395+0000 7f4edee00640 1 -- 172.21.15.144:0/942435666 shutdown_connections 2024-05-30T16:45:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.395+0000 7f4edee00640 1 -- 172.21.15.144:0/942435666 wait complete. 2024-05-30T16:45:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.396+0000 7f4edee00640 1 Processor -- start 2024-05-30T16:45:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.397+0000 7f4edee00640 1 -- start start 2024-05-30T16:45:12.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4edee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ed80b5fd0 0x7f4ed8153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4edee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed80cec70 0x7f4ed813c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4edee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed813f760 0x7f4ed813c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4edee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed8160fd0 con 0x7f4ed80cec70 2024-05-30T16:45:12.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4edee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed8160cf0 con 0x7f4ed80b5fd0 2024-05-30T16:45:12.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4edee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed80cf0d0 con 0x7f4ed813f760 2024-05-30T16:45:12.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4ecfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed80cec70 0x7f4ed813c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:12.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4ecfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed80cec70 0x7f4ed813c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40542/0 (socket says 172.21.15.144:40542) 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4ecfe00640 1 -- 172.21.15.144:0/2792620819 learned_addr learned my addr 172.21.15.144:0/2792620819 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4edce00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed813f760 0x7f4ed813c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4ecfe00640 1 -- 172.21.15.144:0/2792620819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed813f760 msgr2=0x7f4ed813c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4ecfe00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed813f760 0x7f4ed813c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4ed7e00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ed80b5fd0 0x7f4ed8153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4ecfe00640 1 -- 172.21.15.144:0/2792620819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ed80b5fd0 msgr2=0x7f4ed8153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4ecfe00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ed80b5fd0 0x7f4ed8153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.398+0000 7f4ecfe00640 1 -- 172.21.15.144:0/2792620819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed8153f20 con 0x7f4ed80cec70 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.399+0000 7f4ecfe00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed80cec70 0x7f4ed813c060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c500 tx=0x7f4ec000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.399+0000 7f4ed4c00640 1 -- 172.21.15.144:0/2792620819 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00052d0 con 0x7f4ed80cec70 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.399+0000 7f4ed4c00640 1 -- 172.21.15.144:0/2792620819 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec0005470 con 0x7f4ed80cec70 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.399+0000 7f4ed4c00640 1 -- 172.21.15.144:0/2792620819 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0012850 con 0x7f4ed80cec70 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.399+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed8154200 con 0x7f4ed80cec70 2024-05-30T16:45:12.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.399+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed81547c0 con 0x7f4ed80cec70 2024-05-30T16:45:12.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.400+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed8068b90 con 0x7f4ed80cec70 2024-05-30T16:45:12.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.401+0000 7f4ed4c00640 1 -- 172.21.15.144:0/2792620819 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f4ec00129f0 con 0x7f4ed80cec70 2024-05-30T16:45:12.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.402+0000 7f4ed4c00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4eb406cbc0 0x7f4eb406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.402+0000 7f4ed4c00640 1 -- 172.21.15.144:0/2792620819 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f4ec008bbf0 con 0x7f4ed80cec70 2024-05-30T16:45:12.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.403+0000 7f4ed7e00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4eb406cbc0 0x7f4eb406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:12.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.403+0000 7f4ed7e00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4eb406cbc0 0x7f4eb406f080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8034000 tx=0x7f4ec802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:12.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.406+0000 7f4ed4c00640 1 -- 172.21.15.144:0/2792620819 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ec0059ca0 con 0x7f4ed80cec70 2024-05-30T16:45:12.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.609+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ed806cf20 con 0x7f4ed80cec70 2024-05-30T16:45:12.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.610+0000 7f4ed4c00640 1 -- 172.21.15.144:0/2792620819 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16662 (secure 0 0 0) 0x7f4ec00595a0 con 0x7f4ed80cec70 2024-05-30T16:45:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:12.612 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":43,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:45:11.209829+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:45:09.108059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:45:10.167194+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:45:12.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4eb406cbc0 msgr2=0x7f4eb406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4eb406cbc0 0x7f4eb406f080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8034000 tx=0x7f4ec802e000 comp rx=0 tx=0).stop 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed80cec70 msgr2=0x7f4ed813c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed80cec70 0x7f4ed813c060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c500 tx=0x7f4ec000c9c0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 shutdown_connections 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4eb406cbc0 0x7f4eb406f080 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed813f760 0x7f4ed813c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed80cec70 0x7f4ed813c060 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 --2- 172.21.15.144:0/2792620819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ed80b5fd0 0x7f4ed8153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 >> 172.21.15.144:0/2792620819 conn(0x7f4ed806bd00 msgr2=0x7f4ed806f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 shutdown_connections 2024-05-30T16:45:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.613+0000 7f4edee00640 1 -- 172.21.15.144:0/2792620819 wait complete. 2024-05-30T16:45:12.634 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:45:12.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.826+0000 7f6d78e00640 1 Processor -- start 2024-05-30T16:45:12.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.826+0000 7f6d78e00640 1 -- start start 2024-05-30T16:45:12.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.827+0000 7f6d78e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d74145f10 0x7f6d740cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.827+0000 7f6d78e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d7406c3d0 0x7f6d74160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.827+0000 7f6d78e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6d741607c0 0x7f6d7415cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.827+0000 7f6d78e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6d74160c50 con 0x7f6d74145f10 2024-05-30T16:45:12.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.827+0000 7f6d78e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6d74161100 con 0x7f6d741607c0 2024-05-30T16:45:12.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.827+0000 7f6d78e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d7406c810 con 0x7f6d7406c3d0 2024-05-30T16:45:12.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.828+0000 7f6d73400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d74145f10 0x7f6d740cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:12.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.828+0000 7f6d73400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d74145f10 0x7f6d740cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40558/0 (socket says 172.21.15.144:40558) 2024-05-30T16:45:12.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.828+0000 7f6d73400640 1 -- 172.21.15.144:0/408524053 learned_addr learned my addr 172.21.15.144:0/408524053 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:12.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.828+0000 7f6d73400640 1 -- 172.21.15.144:0/408524053 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d7406c3d0 msgr2=0x7f6d74160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:12.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.828+0000 7f6d73400640 1 --2- 172.21.15.144:0/408524053 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d7406c3d0 0x7f6d74160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.828+0000 7f6d73400640 1 -- 172.21.15.144:0/408524053 >> v2:172.21.15.149:3300/0 conn(0x7f6d741607c0 msgr2=0x7f6d7415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:12.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.828+0000 7f6d73400640 1 --2- 172.21.15.144:0/408524053 >> v2:172.21.15.149:3300/0 conn(0x7f6d741607c0 0x7f6d7415cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.828+0000 7f6d73400640 1 -- 172.21.15.144:0/408524053 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d740cd3e0 con 0x7f6d74145f10 2024-05-30T16:45:12.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.829+0000 7f6d73400640 1 --2- 172.21.15.144:0/408524053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 0x7f6d740cce00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6d7406dc50 tx=0x7f6d6402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2139cca1ae6c7090 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:12.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.829+0000 7f6d72000640 1 -- 172.21.15.144:0/408524053 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64037070 con 0x7f6d74145f10 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d72000640 1 -- 172.21.15.144:0/408524053 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d64032440 con 0x7f6d74145f10 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d72000640 1 -- 172.21.15.144:0/408524053 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64032810 con 0x7f6d74145f10 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d78e00640 1 -- 172.21.15.144:0/408524053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 msgr2=0x7f6d740cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d78e00640 1 --2- 172.21.15.144:0/408524053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 0x7f6d740cce00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6d7406dc50 tx=0x7f6d6402a210 comp rx=0 tx=0).stop 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d78e00640 1 -- 172.21.15.144:0/408524053 shutdown_connections 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d78e00640 1 --2- 172.21.15.144:0/408524053 >> v2:172.21.15.149:3300/0 conn(0x7f6d741607c0 0x7f6d7415cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d78e00640 1 --2- 172.21.15.144:0/408524053 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d7406c3d0 0x7f6d74160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d78e00640 1 --2- 172.21.15.144:0/408524053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 0x7f6d740cce00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d78e00640 1 -- 172.21.15.144:0/408524053 >> 172.21.15.144:0/408524053 conn(0x7f6d7406b8e0 msgr2=0x7f6d7406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d78e00640 1 -- 172.21.15.144:0/408524053 shutdown_connections 2024-05-30T16:45:12.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.830+0000 7f6d78e00640 1 -- 172.21.15.144:0/408524053 wait complete. 2024-05-30T16:45:12.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.832+0000 7f6d78e00640 1 Processor -- start 2024-05-30T16:45:12.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.832+0000 7f6d78e00640 1 -- start start 2024-05-30T16:45:12.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.833+0000 7f6d78e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d7406c3d0 0x7f6d7413f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.833+0000 7f6d78e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 0x7f6d741f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.833+0000 7f6d78e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d741607c0 0x7f6d741f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.833+0000 7f6d78e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740cdc80 con 0x7f6d74145f10 2024-05-30T16:45:12.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.833+0000 7f6d78e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740cd9a0 con 0x7f6d741607c0 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.833+0000 7f6d78e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d740cdf60 con 0x7f6d7406c3d0 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.833+0000 7f6d72a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 0x7f6d741f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.833+0000 7f6d72a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 0x7f6d741f41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40564/0 (socket says 172.21.15.144:40564) 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.833+0000 7f6d72a00640 1 -- 172.21.15.144:0/2915007193 learned_addr learned my addr 172.21.15.144:0/2915007193 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d72a00640 1 -- 172.21.15.144:0/2915007193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d7406c3d0 msgr2=0x7f6d7413f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d72a00640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d7406c3d0 0x7f6d7413f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d72a00640 1 -- 172.21.15.144:0/2915007193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d741607c0 msgr2=0x7f6d741f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d72a00640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d741607c0 0x7f6d741f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d72a00640 1 -- 172.21.15.144:0/2915007193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d740b4110 con 0x7f6d74145f10 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d72a00640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 0x7f6d741f41f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000b4a0 tx=0x7f6d6000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d6b400640 1 -- 172.21.15.144:0/2915007193 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60014070 con 0x7f6d74145f10 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d6b400640 1 -- 172.21.15.144:0/2915007193 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d60010610 con 0x7f6d74145f10 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d6b400640 1 -- 172.21.15.144:0/2915007193 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60010a00 con 0x7f6d74145f10 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7413f840 con 0x7f6d74145f10 2024-05-30T16:45:12.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.834+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d740b4690 con 0x7f6d74145f10 2024-05-30T16:45:12.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.835+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d740632f0 con 0x7f6d74145f10 2024-05-30T16:45:12.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.836+0000 7f6d6b400640 1 -- 172.21.15.144:0/2915007193 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f6d60017070 con 0x7f6d74145f10 2024-05-30T16:45:12.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.837+0000 7f6d6b400640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d5406cbc0 0x7f6d5406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:12.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.837+0000 7f6d6b400640 1 -- 172.21.15.144:0/2915007193 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f6d6008baf0 con 0x7f6d74145f10 2024-05-30T16:45:12.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.837+0000 7f6d73400640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d5406cbc0 0x7f6d5406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:12.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.838+0000 7f6d73400640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d5406cbc0 0x7f6d5406f080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d64034000 tx=0x7f6d6402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:12.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:12.842+0000 7f6d6b400640 1 -- 172.21.15.144:0/2915007193 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d60059af0 con 0x7f6d74145f10 2024-05-30T16:45:13.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.080+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6d7406be60 con 0x7f6d74145f10 2024-05-30T16:45:13.706 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-05-30T16:45:13.705+0000 7f16b0200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:45:13.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.785+0000 7f6d6b400640 1 -- 172.21.15.144:0/2915007193 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f6d600593f0 con 0x7f6d74145f10 2024-05-30T16:45:13.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d5406cbc0 msgr2=0x7f6d5406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:13.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d5406cbc0 0x7f6d5406f080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d64034000 tx=0x7f6d6402c000 comp rx=0 tx=0).stop 2024-05-30T16:45:13.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 msgr2=0x7f6d741f41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:13.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 0x7f6d741f41f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000b4a0 tx=0x7f6d6000b960 comp rx=0 tx=0).stop 2024-05-30T16:45:13.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 shutdown_connections 2024-05-30T16:45:13.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6d5406cbc0 0x7f6d5406f080 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:13.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d741607c0 0x7f6d741f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:13.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74145f10 0x7f6d741f41f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:13.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 --2- 172.21.15.144:0/2915007193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d7406c3d0 0x7f6d7413f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:13.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 >> 172.21.15.144:0/2915007193 conn(0x7f6d7406b8e0 msgr2=0x7f6d740b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:13.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 shutdown_connections 2024-05-30T16:45:13.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:13.789+0000 7f6d78e00640 1 -- 172.21.15.144:0/2915007193 wait complete. 2024-05-30T16:45:13.812 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:45:13.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:45:14.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.020+0000 7f1fce400640 1 Processor -- start 2024-05-30T16:45:14.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.020+0000 7f1fce400640 1 -- start start 2024-05-30T16:45:14.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.021+0000 7f1fce400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1fc80cec70 0x7f1fc80b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:14.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fce400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc8160730 con 0x7f1fc813f760 2024-05-30T16:45:14.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fce400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc8160a10 con 0x7f1fc80b5e00 2024-05-30T16:45:14.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fce400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc81612b0 con 0x7f1fc80cec70 2024-05-30T16:45:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fc7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1fc813f760 0x7f1fc806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50356/0 (socket says 172.21.15.144:50356) 2024-05-30T16:45:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fc7400640 1 -- 172.21.15.144:0/1323349398 learned_addr learned my addr 172.21.15.144:0/1323349398 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fbfe00640 1 --2- 172.21.15.144:0/1323349398 >> v2:172.21.15.144:3300/0 conn(0x7f1fc80cec70 0x7f1fc80b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fc6a00640 1 -- 172.21.15.144:0/1323349398 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507594928 0 0) 0x7f1fc8160730 con 0x7f1fc813f760 2024-05-30T16:45:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fc6a00640 1 -- 172.21.15.144:0/1323349398 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fac003520 con 0x7f1fc813f760 2024-05-30T16:45:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fbfe00640 1 -- 172.21.15.144:0/1323349398 >> v1:172.21.15.149:6789/0 conn(0x7f1fc80b5e00 legacy=0x7f1fc8142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.022+0000 7f1fbfe00640 1 -- 172.21.15.144:0/1323349398 >> v1:172.21.15.144:6789/0 conn(0x7f1fc813f760 legacy=0x7f1fc806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.023+0000 7f1fbfe00640 1 -- 172.21.15.144:0/1323349398 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc8160cf0 con 0x7f1fc80cec70 2024-05-30T16:45:14.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.024+0000 7f1fbfe00640 1 --2- 172.21.15.144:0/1323349398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80cec70 0x7f1fc80b58c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00097a0 tx=0x7f1fb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ae5991c43c069c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:14.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.024+0000 7f1fc6a00640 1 -- 172.21.15.144:0/1323349398 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0037070 con 0x7f1fc80cec70 2024-05-30T16:45:14.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.024+0000 7f1fc6a00640 1 -- 172.21.15.144:0/1323349398 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb0032440 con 0x7f1fc80cec70 2024-05-30T16:45:14.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.024+0000 7f1fc6a00640 1 -- 172.21.15.144:0/1323349398 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0032810 con 0x7f1fc80cec70 2024-05-30T16:45:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.024+0000 7f1fce400640 1 -- 172.21.15.144:0/1323349398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80cec70 msgr2=0x7f1fc80b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.024+0000 7f1fce400640 1 --2- 172.21.15.144:0/1323349398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80cec70 0x7f1fc80b58c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00097a0 tx=0x7f1fb002a270 comp rx=0 tx=0).stop 2024-05-30T16:45:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.024+0000 7f1fce400640 1 -- 172.21.15.144:0/1323349398 shutdown_connections 2024-05-30T16:45:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.024+0000 7f1fce400640 1 --2- 172.21.15.144:0/1323349398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80cec70 0x7f1fc80b58c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.024+0000 7f1fce400640 1 -- 172.21.15.144:0/1323349398 >> 172.21.15.144:0/1323349398 conn(0x7f1fc806bd00 msgr2=0x7f1fc806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.025+0000 7f1fce400640 1 -- 172.21.15.144:0/1323349398 shutdown_connections 2024-05-30T16:45:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.025+0000 7f1fce400640 1 -- 172.21.15.144:0/1323349398 wait complete. 2024-05-30T16:45:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.026+0000 7f1fce400640 1 Processor -- start 2024-05-30T16:45:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.026+0000 7f1fce400640 1 -- start start 2024-05-30T16:45:14.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.027+0000 7f1fce400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80b5e00 0x7f1fc813ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:14.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.027+0000 7f1fce400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fc80cec70 0x7f1fc8146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:14.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.027+0000 7f1fce400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc813f760 0x7f1fc80a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:14.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.027+0000 7f1fce400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc80cf0d0 con 0x7f1fc80b5e00 2024-05-30T16:45:14.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.027+0000 7f1fce400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc80cf250 con 0x7f1fc813f760 2024-05-30T16:45:14.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.027+0000 7f1fce400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc80ce6a0 con 0x7f1fc80cec70 2024-05-30T16:45:14.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80b5e00 0x7f1fc813ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80b5e00 0x7f1fc813ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40574/0 (socket says 172.21.15.144:40574) 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7400640 1 -- 172.21.15.144:0/3118028928 learned_addr learned my addr 172.21.15.144:0/3118028928 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7400640 1 -- 172.21.15.144:0/3118028928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fc80cec70 msgr2=0x7f1fc8146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fc80cec70 0x7f1fc8146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7e00640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc813f760 0x7f1fc80a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7400640 1 -- 172.21.15.144:0/3118028928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc813f760 msgr2=0x7f1fc80a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc813f760 0x7f1fc80a9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7400640 1 -- 172.21.15.144:0/3118028928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc8158530 con 0x7f1fc80b5e00 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.028+0000 7f1fc7400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80b5e00 0x7f1fc813ceb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800c3c0 tx=0x7f1fb800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.029+0000 7f1fbf400640 1 -- 172.21.15.144:0/3118028928 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8017070 con 0x7f1fc80b5e00 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.029+0000 7f1fbf400640 1 -- 172.21.15.144:0/3118028928 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb8005ce0 con 0x7f1fc80b5e00 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.029+0000 7f1fbf400640 1 -- 172.21.15.144:0/3118028928 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb80072f0 con 0x7f1fc80b5e00 2024-05-30T16:45:14.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.029+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc8158810 con 0x7f1fc80b5e00 2024-05-30T16:45:14.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.029+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc8146b40 con 0x7f1fc80b5e00 2024-05-30T16:45:14.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.030+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc8068b90 con 0x7f1fc80b5e00 2024-05-30T16:45:14.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.031+0000 7f1fbf400640 1 -- 172.21.15.144:0/3118028928 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f1fb801a070 con 0x7f1fc80b5e00 2024-05-30T16:45:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.032+0000 7f1fbf400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fa406cbf0 0x7f1fa406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.032+0000 7f1fbf400640 1 -- 172.21.15.144:0/3118028928 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f1fb808b3b0 con 0x7f1fc80b5e00 2024-05-30T16:45:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.032+0000 7f1fbfe00640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fa406cbf0 0x7f1fa406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.033+0000 7f1fbfe00640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fa406cbf0 0x7f1fa406f0b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0034000 tx=0x7f1fb002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.036+0000 7f1fbf400640 1 -- 172.21.15.144:0/3118028928 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1fb8059400 con 0x7f1fc80b5e00 2024-05-30T16:45:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.272+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1fc806f660 con 0x7f1fc80b5e00 2024-05-30T16:45:14.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.789+0000 7f1fbf400640 1 -- 172.21.15.144:0/3118028928 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f1fb8058d00 con 0x7f1fc80b5e00 2024-05-30T16:45:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.792+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fa406cbf0 msgr2=0x7f1fa406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fa406cbf0 0x7f1fa406f0b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0034000 tx=0x7f1fb002c000 comp rx=0 tx=0).stop 2024-05-30T16:45:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80b5e00 msgr2=0x7f1fc813ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80b5e00 0x7f1fc813ceb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800c3c0 tx=0x7f1fb800c880 comp rx=0 tx=0).stop 2024-05-30T16:45:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 shutdown_connections 2024-05-30T16:45:14.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fa406cbf0 0x7f1fa406f0b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:14.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc813f760 0x7f1fc80a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:14.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fc80cec70 0x7f1fc8146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:14.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 --2- 172.21.15.144:0/3118028928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fc80b5e00 0x7f1fc813ceb0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:14.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 >> 172.21.15.144:0/3118028928 conn(0x7f1fc806bd00 msgr2=0x7f1fc815cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:14.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 shutdown_connections 2024-05-30T16:45:14.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:14.793+0000 7f1fce400640 1 -- 172.21.15.144:0/3118028928 wait complete. 2024-05-30T16:45:14.814 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:45:14.815 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:45:15.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.010+0000 7fd442200640 1 Processor -- start 2024-05-30T16:45:15.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.010+0000 7fd442200640 1 -- start start 2024-05-30T16:45:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd442200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c072210 0x7fd43c072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd442200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd43c0b4140 0x7fd43c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd442200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c06fbf0 con 0x7fd43c14c630 2024-05-30T16:45:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd442200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd43c072ba0 con 0x7fd43c0b4140 2024-05-30T16:45:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd442200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c0cf050 con 0x7fd43c072210 2024-05-30T16:45:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd43be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd43c0b4140 0x7fd43c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd43be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd43c0b4140 0x7fd43c0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46834/0 (socket says 172.21.15.144:46834) 2024-05-30T16:45:15.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd43be00640 1 -- 172.21.15.144:0/538796042 learned_addr learned my addr 172.21.15.144:0/538796042 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:15.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd43be00640 1 -- 172.21.15.144:0/538796042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c072210 msgr2=0x7fd43c072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.012+0000 7fd43be00640 1 --2- 172.21.15.144:0/538796042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c072210 0x7fd43c072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.013+0000 7fd43be00640 1 -- 172.21.15.144:0/538796042 >> v1:172.21.15.149:6789/0 conn(0x7fd43c14c630 legacy=0x7fd43c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.013+0000 7fd43be00640 1 -- 172.21.15.144:0/538796042 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c0cf330 con 0x7fd43c0b4140 2024-05-30T16:45:15.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.014+0000 7fd43be00640 1 --2- 172.21.15.144:0/538796042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 0x7fd43c0b45d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0cda80 tx=0x7fd43402a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b275d380e14cea89 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:15.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.014+0000 7fd43a000640 1 -- 172.21.15.144:0/538796042 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434036070 con 0x7fd43c0b4140 2024-05-30T16:45:15.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.014+0000 7fd43a000640 1 -- 172.21.15.144:0/538796042 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd434031600 con 0x7fd43c0b4140 2024-05-30T16:45:15.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.014+0000 7fd43a000640 1 -- 172.21.15.144:0/538796042 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4340319d0 con 0x7fd43c0b4140 2024-05-30T16:45:15.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.014+0000 7fd442200640 1 -- 172.21.15.144:0/538796042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 msgr2=0x7fd43c0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.015+0000 7fd442200640 1 --2- 172.21.15.144:0/538796042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 0x7fd43c0b45d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0cda80 tx=0x7fd43402a740 comp rx=0 tx=0).stop 2024-05-30T16:45:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.015+0000 7fd442200640 1 -- 172.21.15.144:0/538796042 shutdown_connections 2024-05-30T16:45:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.015+0000 7fd442200640 1 --2- 172.21.15.144:0/538796042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 0x7fd43c0b45d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.015+0000 7fd442200640 1 --2- 172.21.15.144:0/538796042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c072210 0x7fd43c072660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.015+0000 7fd442200640 1 -- 172.21.15.144:0/538796042 >> 172.21.15.144:0/538796042 conn(0x7fd43c06bd00 msgr2=0x7fd43c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.015+0000 7fd442200640 1 -- 172.21.15.144:0/538796042 shutdown_connections 2024-05-30T16:45:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.015+0000 7fd442200640 1 -- 172.21.15.144:0/538796042 wait complete. 2024-05-30T16:45:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.017+0000 7fd442200640 1 Processor -- start 2024-05-30T16:45:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.017+0000 7fd442200640 1 -- start start 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.018+0000 7fd442200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c072210 0x7fd43c1fc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.018+0000 7fd442200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 0x7fd43c1480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.018+0000 7fd442200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c14c630 0x7fd43c148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.018+0000 7fd442200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c0b3c20 con 0x7fd43c0b4140 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.018+0000 7fd442200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c0cf8f0 con 0x7fd43c14c630 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.018+0000 7fd442200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c14ca10 con 0x7fd43c072210 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.018+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 0x7fd43c1480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.018+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 0x7fd43c1480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46844/0 (socket says 172.21.15.144:46844) 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.018+0000 7fd43aa00640 1 -- 172.21.15.144:0/786429517 learned_addr learned my addr 172.21.15.144:0/786429517 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.019+0000 7fd43be00640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c14c630 0x7fd43c148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.019+0000 7fd43b400640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c072210 0x7fd43c1fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.019+0000 7fd43aa00640 1 -- 172.21.15.144:0/786429517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c072210 msgr2=0x7fd43c1fc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.019+0000 7fd43aa00640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c072210 0x7fd43c1fc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.019+0000 7fd43aa00640 1 -- 172.21.15.144:0/786429517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c14c630 msgr2=0x7fd43c148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.019+0000 7fd43aa00640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c14c630 0x7fd43c148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.019+0000 7fd43aa00640 1 -- 172.21.15.144:0/786429517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c148b40 con 0x7fd43c0b4140 2024-05-30T16:45:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.019+0000 7fd43aa00640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 0x7fd43c1480c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd42800b4a0 tx=0x7fd42800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.020+0000 7fd433400640 1 -- 172.21.15.144:0/786429517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428014070 con 0x7fd43c0b4140 2024-05-30T16:45:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.020+0000 7fd433400640 1 -- 172.21.15.144:0/786429517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd428010610 con 0x7fd43c0b4140 2024-05-30T16:45:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.020+0000 7fd433400640 1 -- 172.21.15.144:0/786429517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428010a00 con 0x7fd43c0b4140 2024-05-30T16:45:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.020+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c0c6550 con 0x7fd43c0b4140 2024-05-30T16:45:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.020+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43c0c6b10 con 0x7fd43c0b4140 2024-05-30T16:45:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.021+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43c068b90 con 0x7fd43c0b4140 2024-05-30T16:45:15.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.022+0000 7fd433400640 1 -- 172.21.15.144:0/786429517 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fd428017070 con 0x7fd43c0b4140 2024-05-30T16:45:15.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.023+0000 7fd433400640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd41c06cbc0 0x7fd41c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.024+0000 7fd433400640 1 -- 172.21.15.144:0/786429517 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fd42808b990 con 0x7fd43c0b4140 2024-05-30T16:45:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.024+0000 7fd43b400640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd41c06cbc0 0x7fd41c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.024+0000 7fd43b400640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd41c06cbc0 0x7fd41c06f080 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd42c006fd0 tx=0x7fd42c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:15.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.028+0000 7fd433400640 1 -- 172.21.15.144:0/786429517 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd428059b00 con 0x7fd43c0b4140 2024-05-30T16:45:15.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.324+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd43c0afd50 con 0x7fd43c0b4140 2024-05-30T16:45:15.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.325+0000 7fd433400640 1 -- 172.21.15.144:0/786429517 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5190 (secure 0 0 0) 0x7fd428059400 con 0x7fd43c0b4140 2024-05-30T16:45:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:15.327 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1748821329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":1748821329},{"type":"v1","addr":"172.21.15.149:6835","nonce":1748821329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/498363694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":498363694},{"type":"v1","addr":"172.21.15.149:6834","nonce":498363694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1097253256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1097253256},{"type":"v1","addr":"172.21.15.144:6835","nonce":1097253256}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:45:11.209778+0000","modified":"2024-05-30T16:45:14.274711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5235":{"gid":5235,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4243254164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4243254164},{"type":"v1","addr":"172.21.15.144:6837","nonce":4243254164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5235,"qdb_cluster":[5235]},"id":3}]} 2024-05-30T16:45:15.327 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-05-30T16:45:15.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd41c06cbc0 msgr2=0x7fd41c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd41c06cbc0 0x7fd41c06f080 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd42c006fd0 tx=0x7fd42c008040 comp rx=0 tx=0).stop 2024-05-30T16:45:15.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 msgr2=0x7fd43c1480c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 0x7fd43c1480c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd42800b4a0 tx=0x7fd42800b960 comp rx=0 tx=0).stop 2024-05-30T16:45:15.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 shutdown_connections 2024-05-30T16:45:15.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd41c06cbc0 0x7fd41c06f080 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c14c630 0x7fd43c148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd43c0b4140 0x7fd43c1480c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 --2- 172.21.15.144:0/786429517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c072210 0x7fd43c1fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 >> 172.21.15.144:0/786429517 conn(0x7fd43c06bd00 msgr2=0x7fd43c074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:15.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 shutdown_connections 2024-05-30T16:45:15.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.328+0000 7fd442200640 1 -- 172.21.15.144:0/786429517 wait complete. 2024-05-30T16:45:15.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:45:15.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.543+0000 7fed61800640 1 Processor -- start 2024-05-30T16:45:15.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.544+0000 7fed61800640 1 -- start start 2024-05-30T16:45:15.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.545+0000 7fed61800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed5c15e790 0x7fed5c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.545+0000 7fed61800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c0b4db0 0x7fed5c162ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.545+0000 7fed61800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed5c15eb70 con 0x7fed5c06b8e0 2024-05-30T16:45:15.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.545+0000 7fed61800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fed5c0cea50 con 0x7fed5c15e790 2024-05-30T16:45:15.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.545+0000 7fed61800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c163220 con 0x7fed5c0b4db0 2024-05-30T16:45:15.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.546+0000 7fed60e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fed5c06b8e0 0x7fed5c0b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45414/0 (socket says 172.21.15.144:45414) 2024-05-30T16:45:15.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.546+0000 7fed60e00640 1 -- 172.21.15.144:0/366473775 learned_addr learned my addr 172.21.15.144:0/366473775 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:15.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.546+0000 7fed5be00640 1 --2- 172.21.15.144:0/366473775 >> v2:172.21.15.149:3300/0 conn(0x7fed5c15e790 0x7fed5c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.546+0000 7fed53e00640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c0b4db0 0x7fed5c162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.546+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372392896 0 0) 0x7fed54001490 con 0x7fed5c06b8e0 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.546+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed40003520 con 0x7fed5c06b8e0 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1877530558 0 0) 0x7fed40003520 con 0x7fed5c06b8e0 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c0b4db0 msgr2=0x7fed5c162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c0b4db0 0x7fed5c162ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 >> v2:172.21.15.149:3300/0 conn(0x7fed5c15e790 msgr2=0x7fed5c0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 --2- 172.21.15.144:0/366473775 >> v2:172.21.15.149:3300/0 conn(0x7fed5c15e790 0x7fed5c0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c0cded0 con 0x7fed5c06b8e0 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fed54001bc0 con 0x7fed5c06b8e0 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 >> v1:172.21.15.144:6789/0 conn(0x7fed5c06b8e0 legacy=0x7fed5c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed400039b0 0x7fed40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c0b4db0 0x7fed40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed40004d40 0x7fed400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0cea50 con 0x7fed40004d40 2024-05-30T16:45:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c163220 con 0x7fed400039b0 2024-05-30T16:45:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fed4000b9f0 con 0x7fed5c0b4db0 2024-05-30T16:45:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed60e00640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed40004d40 0x7fed400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed5be00640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed400039b0 0x7fed40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.547+0000 7fed53e00640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c0b4db0 0x7fed40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.548+0000 7fed60e00640 1 -- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c0b4db0 msgr2=0x7fed40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.548+0000 7fed60e00640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c0b4db0 0x7fed40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.548+0000 7fed60e00640 1 -- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed400039b0 msgr2=0x7fed40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.548+0000 7fed60e00640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed400039b0 0x7fed40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.548+0000 7fed60e00640 1 -- 172.21.15.144:0/366473775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed40003520 con 0x7fed40004d40 2024-05-30T16:45:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.549+0000 7fed60e00640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed40004d40 0x7fed400051c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fed5400a950 tx=0x7fed40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883806c40baad9a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.549+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5400a5a0 con 0x7fed40004d40 2024-05-30T16:45:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.549+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed5402f070 con 0x7fed40004d40 2024-05-30T16:45:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.549+0000 7fed5b400640 1 -- 172.21.15.144:0/366473775 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5402bdd0 con 0x7fed40004d40 2024-05-30T16:45:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.549+0000 7fed61800640 1 -- 172.21.15.144:0/366473775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed40004d40 msgr2=0x7fed400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.549+0000 7fed61800640 1 --2- 172.21.15.144:0/366473775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed40004d40 0x7fed400051c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fed5400a950 tx=0x7fed40005830 comp rx=0 tx=0).stop 2024-05-30T16:45:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.549+0000 7fed60e00640 1 -- 172.21.15.144:0/366473775 reap_dead start 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.550+0000 7fed61800640 1 -- 172.21.15.144:0/366473775 shutdown_connections 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.550+0000 7fed61800640 1 -- 172.21.15.144:0/366473775 >> 172.21.15.144:0/366473775 conn(0x7fed5c0b20a0 msgr2=0x7fed5c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.550+0000 7fed61800640 1 -- 172.21.15.144:0/366473775 shutdown_connections 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.550+0000 7fed61800640 1 -- 172.21.15.144:0/366473775 wait complete. 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.551+0000 7fed61800640 1 Processor -- start 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.551+0000 7fed61800640 1 -- start start 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.552+0000 7fed61800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed40004d40 0x7fed5c161710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.552+0000 7fed61800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed5c14a670 0x7fed5c15c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.552+0000 7fed61800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c15ceb0 0x7fed5c14af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.552+0000 7fed61800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0ce770 con 0x7fed5c14a670 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.552+0000 7fed61800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0ce490 con 0x7fed40004d40 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.552+0000 7fed61800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c162ce0 con 0x7fed5c15ceb0 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.552+0000 7fed53e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed5c14a670 0x7fed5c15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed53e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed5c14a670 0x7fed5c15c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46866/0 (socket says 172.21.15.144:46866) 2024-05-30T16:45:15.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed53e00640 1 -- 172.21.15.144:0/550680530 learned_addr learned my addr 172.21.15.144:0/550680530 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:15.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed5be00640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed40004d40 0x7fed5c161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed60e00640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c15ceb0 0x7fed5c14af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed53e00640 1 -- 172.21.15.144:0/550680530 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c15ceb0 msgr2=0x7fed5c14af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed53e00640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c15ceb0 0x7fed5c14af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed53e00640 1 -- 172.21.15.144:0/550680530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed40004d40 msgr2=0x7fed5c161710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed53e00640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed40004d40 0x7fed5c161710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed53e00640 1 -- 172.21.15.144:0/550680530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c157d70 con 0x7fed5c14a670 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed53e00640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed5c14a670 0x7fed5c15c970 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fed44011600 tx=0x7fed44011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed58c00640 1 -- 172.21.15.144:0/550680530 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4400f920 con 0x7fed5c14a670 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed58c00640 1 -- 172.21.15.144:0/550680530 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4400fac0 con 0x7fed5c14a670 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.553+0000 7fed58c00640 1 -- 172.21.15.144:0/550680530 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4400fe70 con 0x7fed5c14a670 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.554+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c0ad770 con 0x7fed5c14a670 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.554+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c0add10 con 0x7fed5c14a670 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.555+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed5c075570 con 0x7fed5c14a670 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.556+0000 7fed58c00640 1 -- 172.21.15.144:0/550680530 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fed44015460 con 0x7fed5c14a670 2024-05-30T16:45:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.557+0000 7fed58c00640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed3806cbc0 0x7fed3806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.557+0000 7fed58c00640 1 -- 172.21.15.144:0/550680530 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fed4408ca90 con 0x7fed5c14a670 2024-05-30T16:45:15.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.557+0000 7fed5be00640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed3806cbc0 0x7fed3806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.558+0000 7fed5be00640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed3806cbc0 0x7fed3806f080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009950 tx=0x7fed4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:15.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.561+0000 7fed58c00640 1 -- 172.21.15.144:0/550680530 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed44019030 con 0x7fed5c14a670 2024-05-30T16:45:15.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.762+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed5c0ca120 con 0x7fed5c14a670 2024-05-30T16:45:15.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.765+0000 7fed58c00640 1 -- 172.21.15.144:0/550680530 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16649 (secure 0 0 0) 0x7fed4405aa50 con 0x7fed5c14a670 2024-05-30T16:45:15.767 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:15.767 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":44,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:45:12.758163+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:45:09.108059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:45:10.167194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:45:15.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed3806cbc0 msgr2=0x7fed3806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed3806cbc0 0x7fed3806f080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009950 tx=0x7fed4c008040 comp rx=0 tx=0).stop 2024-05-30T16:45:15.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed5c14a670 msgr2=0x7fed5c15c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed5c14a670 0x7fed5c15c970 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fed44011600 tx=0x7fed44011ac0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 shutdown_connections 2024-05-30T16:45:15.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed3806cbc0 0x7fed3806f080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed5c15ceb0 0x7fed5c14af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed5c14a670 0x7fed5c15c970 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 --2- 172.21.15.144:0/550680530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed40004d40 0x7fed5c161710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 >> 172.21.15.144:0/550680530 conn(0x7fed5c0b20a0 msgr2=0x7fed5c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:15.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 shutdown_connections 2024-05-30T16:45:15.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.768+0000 7fed61800640 1 -- 172.21.15.144:0/550680530 wait complete. 2024-05-30T16:45:15.790 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:45:15.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:45:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.978+0000 7f78d4e00640 1 Processor -- start 2024-05-30T16:45:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.978+0000 7f78d4e00640 1 -- start start 2024-05-30T16:45:15.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.979+0000 7f78d4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d015ec60 0x7f78d006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.979+0000 7f78d4e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f78d006cc70 0x7f78d006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.979+0000 7f78d4e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d00d08d0 con 0x7f78d0162670 2024-05-30T16:45:15.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.979+0000 7f78d4e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f78d015f5e0 con 0x7f78d006cc70 2024-05-30T16:45:15.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.979+0000 7f78d4e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f78d015f8c0 con 0x7f78d015ec60 2024-05-30T16:45:15.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78ce800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f78d0162670 0x7f78d009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45416/0 (socket says 172.21.15.144:45416) 2024-05-30T16:45:15.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78ce800640 1 -- 172.21.15.144:0/4244273366 learned_addr learned my addr 172.21.15.144:0/4244273366 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cd400640 1 --2- 172.21.15.144:0/4244273366 >> v2:172.21.15.149:3300/0 conn(0x7f78d006cc70 0x7f78d006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cde00640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d015ec60 0x7f78d006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684418707 0 0) 0x7f78d00d08d0 con 0x7f78d0162670 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b4003520 con 0x7f78d0162670 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3896582399 0 0) 0x7f78b4003520 con 0x7f78d0162670 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d015ec60 msgr2=0x7f78d006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d015ec60 0x7f78d006d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 >> v2:172.21.15.149:3300/0 conn(0x7f78d006cc70 msgr2=0x7f78d006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 --2- 172.21.15.144:0/4244273366 >> v2:172.21.15.149:3300/0 conn(0x7f78d006cc70 0x7f78d006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d015fba0 con 0x7f78d0162670 2024-05-30T16:45:15.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f78c80019f0 con 0x7f78d0162670 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.980+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 >> v1:172.21.15.144:6789/0 conn(0x7f78d0162670 legacy=0x7f78d009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cca00640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b40039b0 0x7f78b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cca00640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d015ec60 0x7f78b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cca00640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b4004d40 0x7f78b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f78d015f5e0 con 0x7f78b4004d40 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f78d015f8c0 con 0x7f78b40039b0 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f78b400baf0 con 0x7f78d015ec60 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78ce800640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b4004d40 0x7f78b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cde00640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b40039b0 0x7f78b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cd400640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d015ec60 0x7f78b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78ce800640 1 -- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d015ec60 msgr2=0x7f78b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78ce800640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d015ec60 0x7f78b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78ce800640 1 -- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b40039b0 msgr2=0x7f78b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:15.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78ce800640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b40039b0 0x7f78b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78ce800640 1 -- 172.21.15.144:0/4244273366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b4003520 con 0x7f78b4004d40 2024-05-30T16:45:15.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cd400640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d015ec60 0x7f78b4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:15.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.981+0000 7f78cde00640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b40039b0 0x7f78b4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:15.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.982+0000 7f78ce800640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b4004d40 0x7f78b40051c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f78c800a8a0 tx=0x7f78b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36015ed050162b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:15.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c800a4c0 con 0x7f78b4004d40 2024-05-30T16:45:15.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c802f070 con 0x7f78b4004d40 2024-05-30T16:45:15.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78cca00640 1 -- 172.21.15.144:0/4244273366 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c802bd30 con 0x7f78b4004d40 2024-05-30T16:45:15.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78d4e00640 1 -- 172.21.15.144:0/4244273366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b4004d40 msgr2=0x7f78b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78d4e00640 1 --2- 172.21.15.144:0/4244273366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b4004d40 0x7f78b40051c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f78c800a8a0 tx=0x7f78b4005830 comp rx=0 tx=0).stop 2024-05-30T16:45:15.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78ce800640 1 -- 172.21.15.144:0/4244273366 reap_dead start 2024-05-30T16:45:15.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78d4e00640 1 -- 172.21.15.144:0/4244273366 shutdown_connections 2024-05-30T16:45:15.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78d4e00640 1 -- 172.21.15.144:0/4244273366 >> 172.21.15.144:0/4244273366 conn(0x7f78d00b4180 msgr2=0x7f78d00b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:15.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78d4e00640 1 -- 172.21.15.144:0/4244273366 shutdown_connections 2024-05-30T16:45:15.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.983+0000 7f78d4e00640 1 -- 172.21.15.144:0/4244273366 wait complete. 2024-05-30T16:45:15.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.985+0000 7f78d4e00640 1 Processor -- start 2024-05-30T16:45:15.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.985+0000 7f78d4e00640 1 -- start start 2024-05-30T16:45:15.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.986+0000 7f78d4e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b4004d40 0x7f78d00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.986+0000 7f78d4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d00b7ce0 0x7f78d00cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.986+0000 7f78d4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78d00b8160 0x7f78d00ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.986+0000 7f78d4e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f78d00d1f40 con 0x7f78d00b8160 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.986+0000 7f78d4e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f78d00d1dc0 con 0x7f78b4004d40 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.986+0000 7f78d4e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f78d00d20c0 con 0x7f78d00b7ce0 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.986+0000 7f78ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78d00b8160 0x7f78d00ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.986+0000 7f78ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78d00b8160 0x7f78d00ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46886/0 (socket says 172.21.15.144:46886) 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.986+0000 7f78ce800640 1 -- 172.21.15.144:0/1860039425 learned_addr learned my addr 172.21.15.144:0/1860039425 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78cde00640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b4004d40 0x7f78d00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78ce800640 1 -- 172.21.15.144:0/1860039425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d00b7ce0 msgr2=0x7f78d00cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78ce800640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d00b7ce0 0x7f78d00cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78ce800640 1 -- 172.21.15.144:0/1860039425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b4004d40 msgr2=0x7f78d00b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:15.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78ce800640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b4004d40 0x7f78d00b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:15.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78ce800640 1 -- 172.21.15.144:0/1860039425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d00cbb40 con 0x7f78d00b8160 2024-05-30T16:45:15.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78ce800640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78d00b8160 0x7f78d00ce1a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f78c802b580 tx=0x7f78c8001e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:15.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78c6000640 1 -- 172.21.15.144:0/1860039425 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c800a4c0 con 0x7f78d00b8160 2024-05-30T16:45:15.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78c6000640 1 -- 172.21.15.144:0/1860039425 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c8034470 con 0x7f78d00b8160 2024-05-30T16:45:15.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78c6000640 1 -- 172.21.15.144:0/1860039425 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8002010 con 0x7f78d00b8160 2024-05-30T16:45:15.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.987+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d00cbe20 con 0x7f78d00b8160 2024-05-30T16:45:15.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.988+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d00cc3e0 con 0x7f78d00b8160 2024-05-30T16:45:15.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.989+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d0068b90 con 0x7f78d00b8160 2024-05-30T16:45:15.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.989+0000 7f78c6000640 1 -- 172.21.15.144:0/1860039425 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f78c8034820 con 0x7f78d00b8160 2024-05-30T16:45:15.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.991+0000 7f78c6000640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f78b006cbc0 0x7f78b006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:15.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.991+0000 7f78c6000640 1 -- 172.21.15.144:0/1860039425 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f78c80ac230 con 0x7f78d00b8160 2024-05-30T16:45:15.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.991+0000 7f78cde00640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f78b006cbc0 0x7f78b006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:15.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.992+0000 7f78cde00640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f78b006cbc0 0x7f78b006f080 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006fd0 tx=0x7f78c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:15.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:15.995+0000 7f78c6000640 1 -- 172.21.15.144:0/1860039425 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f78c807a310 con 0x7f78d00b8160 2024-05-30T16:45:16.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:45:16.026 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:45:16.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.195+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78d00c9a60 con 0x7f78b006cbc0 2024-05-30T16:45:16.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.217+0000 7f78c6000640 1 -- 172.21.15.144:0/1860039425 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246640 (secure 0 0 0) 0x7f78d00c9a60 con 0x7f78b006cbc0 2024-05-30T16:45:16.222 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:16.223 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:45:16.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f78b006cbc0 msgr2=0x7f78b006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f78b006cbc0 0x7f78b006f080 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006fd0 tx=0x7f78c0008040 comp rx=0 tx=0).stop 2024-05-30T16:45:16.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78d00b8160 msgr2=0x7f78d00ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78d00b8160 0x7f78d00ce1a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f78c802b580 tx=0x7f78c8001e30 comp rx=0 tx=0).stop 2024-05-30T16:45:16.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 shutdown_connections 2024-05-30T16:45:16.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f78b006cbc0 0x7f78b006f080 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78d00b8160 0x7f78d00ce1a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78d00b7ce0 0x7f78d00cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 --2- 172.21.15.144:0/1860039425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b4004d40 0x7f78d00b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.222+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 >> 172.21.15.144:0/1860039425 conn(0x7f78d00b4180 msgr2=0x7f78d0074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:16.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.223+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 shutdown_connections 2024-05-30T16:45:16.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.223+0000 7f78d4e00640 1 -- 172.21.15.144:0/1860039425 wait complete. 2024-05-30T16:45:16.242 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-05-30T16:45:14.965895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279352,"kb_used_data":4928,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754695368,"statfs":{"total":773094113280,"available":772808056832,"internally_reserved":0,"allocated":5046272,"data_stored":2718462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":280874547},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.248297"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.749149+0000","last_change":"2024-05-30T16:45:10.749149+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.749149+0000","last_undegraded":"2024-05-30T16:45:10.749149+0000","last_fullsized":"2024-05-30T16:45:10.749149+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747293+0000","last_change":"2024-05-30T16:45:10.747293+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747293+0000","last_undegraded":"2024-05-30T16:45:10.747293+0000","last_fullsized":"2024-05-30T16:45:10.747293+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.758668+0000","last_change":"2024-05-30T16:45:10.758668+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.758668+0000","last_undegraded":"2024-05-30T16:45:10.758668+0000","last_fullsized":"2024-05-30T16:45:10.758668+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747687+0000","last_change":"2024-05-30T16:45:10.747687+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747687+0000","last_undegraded":"2024-05-30T16:45:10.747687+0000","last_fullsized":"2024-05-30T16:45:10.747687+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744569+0000","last_change":"2024-05-30T16:45:10.744569+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744569+0000","last_undegraded":"2024-05-30T16:45:10.744569+0000","last_fullsized":"2024-05-30T16:45:10.744569+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747418+0000","last_change":"2024-05-30T16:45:10.747418+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747418+0000","last_undegraded":"2024-05-30T16:45:10.747418+0000","last_fullsized":"2024-05-30T16:45:10.747418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.745120+0000","last_change":"2024-05-30T16:45:10.745120+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.745120+0000","last_undegraded":"2024-05-30T16:45:10.745120+0000","last_fullsized":"2024-05-30T16:45:10.745120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746497+0000","last_change":"2024-05-30T16:45:10.746497+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746497+0000","last_undegraded":"2024-05-30T16:45:10.746497+0000","last_fullsized":"2024-05-30T16:45:10.746497+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.751577+0000","last_change":"2024-05-30T16:45:10.751577+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.751577+0000","last_undegraded":"2024-05-30T16:45:10.751577+0000","last_fullsized":"2024-05-30T16:45:10.751577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.752176+0000","last_change":"2024-05-30T16:45:10.752176+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.752176+0000","last_undegraded":"2024-05-30T16:45:10.752176+0000","last_fullsized":"2024-05-30T16:45:10.752176+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.748101+0000","last_change":"2024-05-30T16:45:10.748101+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.748101+0000","last_undegraded":"2024-05-30T16:45:10.748101+0000","last_fullsized":"2024-05-30T16:45:10.748101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.751426+0000","last_change":"2024-05-30T16:45:10.751426+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.751426+0000","last_undegraded":"2024-05-30T16:45:10.751426+0000","last_fullsized":"2024-05-30T16:45:10.751426+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.742806+0000","last_change":"2024-05-30T16:45:10.742806+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.742806+0000","last_undegraded":"2024-05-30T16:45:10.742806+0000","last_fullsized":"2024-05-30T16:45:10.742806+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747494+0000","last_change":"2024-05-30T16:45:10.747494+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747494+0000","last_undegraded":"2024-05-30T16:45:10.747494+0000","last_fullsized":"2024-05-30T16:45:10.747494+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747052+0000","last_change":"2024-05-30T16:45:10.747052+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747052+0000","last_undegraded":"2024-05-30T16:45:10.747052+0000","last_fullsized":"2024-05-30T16:45:10.747052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746014+0000","last_change":"2024-05-30T16:45:10.746014+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746014+0000","last_undegraded":"2024-05-30T16:45:10.746014+0000","last_fullsized":"2024-05-30T16:45:10.746014+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.758216+0000","last_change":"2024-05-30T16:45:10.758216+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.758216+0000","last_undegraded":"2024-05-30T16:45:10.758216+0000","last_fullsized":"2024-05-30T16:45:10.758216+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.762668+0000","last_change":"2024-05-30T16:45:10.762668+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.762668+0000","last_undegraded":"2024-05-30T16:45:10.762668+0000","last_fullsized":"2024-05-30T16:45:10.762668+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.756683+0000","last_change":"2024-05-30T16:45:10.756683+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.756683+0000","last_undegraded":"2024-05-30T16:45:10.756683+0000","last_fullsized":"2024-05-30T16:45:10.756683+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743895+0000","last_change":"2024-05-30T16:45:10.743895+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743895+0000","last_undegraded":"2024-05-30T16:45:10.743895+0000","last_fullsized":"2024-05-30T16:45:10.743895+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.748807+0000","last_change":"2024-05-30T16:45:10.748807+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.748807+0000","last_undegraded":"2024-05-30T16:45:10.748807+0000","last_fullsized":"2024-05-30T16:45:10.748807+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744801+0000","last_change":"2024-05-30T16:45:10.744801+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744801+0000","last_undegraded":"2024-05-30T16:45:10.744801+0000","last_fullsized":"2024-05-30T16:45:10.744801+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746292+0000","last_change":"2024-05-30T16:45:10.746292+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746292+0000","last_undegraded":"2024-05-30T16:45:10.746292+0000","last_fullsized":"2024-05-30T16:45:10.746292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744848+0000","last_change":"2024-05-30T16:45:10.744848+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744848+0000","last_undegraded":"2024-05-30T16:45:10.744848+0000","last_fullsized":"2024-05-30T16:45:10.744848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.753808+0000","last_change":"2024-05-30T16:45:10.753808+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.753808+0000","last_undegraded":"2024-05-30T16:45:10.753808+0000","last_fullsized":"2024-05-30T16:45:10.753808+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743048+0000","last_change":"2024-05-30T16:45:10.743048+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743048+0000","last_undegraded":"2024-05-30T16:45:10.743048+0000","last_fullsized":"2024-05-30T16:45:10.743048+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.757928+0000","last_change":"2024-05-30T16:45:10.757928+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.757928+0000","last_undegraded":"2024-05-30T16:45:10.757928+0000","last_fullsized":"2024-05-30T16:45:10.757928+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.750506+0000","last_change":"2024-05-30T16:45:10.750506+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.750506+0000","last_undegraded":"2024-05-30T16:45:10.750506+0000","last_fullsized":"2024-05-30T16:45:10.750506+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.755050+0000","last_change":"2024-05-30T16:45:10.755050+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.755050+0000","last_undegraded":"2024-05-30T16:45:10.755050+0000","last_fullsized":"2024-05-30T16:45:10.755050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.759316+0000","last_change":"2024-05-30T16:45:10.759316+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.759316+0000","last_undegraded":"2024-05-30T16:45:10.759316+0000","last_fullsized":"2024-05-30T16:45:10.759316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.745145+0000","last_change":"2024-05-30T16:45:10.745145+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.745145+0000","last_undegraded":"2024-05-30T16:45:10.745145+0000","last_fullsized":"2024-05-30T16:45:10.745145+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.742735+0000","last_change":"2024-05-30T16:45:10.742735+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.742735+0000","last_undegraded":"2024-05-30T16:45:10.742735+0000","last_fullsized":"2024-05-30T16:45:10.742735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.742639+0000","last_change":"2024-05-30T16:45:10.742639+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.742639+0000","last_undegraded":"2024-05-30T16:45:10.742639+0000","last_fullsized":"2024-05-30T16:45:10.742639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768966+0000","last_change":"2024-05-30T16:45:10.766067+0000","last_active":"2024-05-30T16:45:10.768966+0000","last_peered":"2024-05-30T16:45:10.768966+0000","last_clean":"2024-05-30T16:45:10.768966+0000","last_became_active":"2024-05-30T16:45:10.765776+0000","last_became_peered":"2024-05-30T16:45:10.765776+0000","last_unstale":"2024-05-30T16:45:10.768966+0000","last_undegraded":"2024-05-30T16:45:10.768966+0000","last_fullsized":"2024-05-30T16:45:10.768966+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:09.001292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.753381+0000","last_change":"2024-05-30T16:45:10.753381+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.753381+0000","last_undegraded":"2024-05-30T16:45:10.753381+0000","last_fullsized":"2024-05-30T16:45:10.753381+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771049+0000","last_change":"2024-05-30T16:45:10.768779+0000","last_active":"2024-05-30T16:45:10.771049+0000","last_peered":"2024-05-30T16:45:10.771049+0000","last_clean":"2024-05-30T16:45:10.771049+0000","last_became_active":"2024-05-30T16:45:10.768305+0000","last_became_peered":"2024-05-30T16:45:10.768305+0000","last_unstale":"2024-05-30T16:45:10.771049+0000","last_undegraded":"2024-05-30T16:45:10.771049+0000","last_fullsized":"2024-05-30T16:45:10.771049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:47.581705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.749678+0000","last_change":"2024-05-30T16:45:10.749678+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.749678+0000","last_undegraded":"2024-05-30T16:45:10.749678+0000","last_fullsized":"2024-05-30T16:45:10.749678+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.760823+0000","last_change":"2024-05-30T16:45:10.756443+0000","last_active":"2024-05-30T16:45:10.760823+0000","last_peered":"2024-05-30T16:45:10.760823+0000","last_clean":"2024-05-30T16:45:10.760823+0000","last_became_active":"2024-05-30T16:45:10.756083+0000","last_became_peered":"2024-05-30T16:45:10.756083+0000","last_unstale":"2024-05-30T16:45:10.760823+0000","last_undegraded":"2024-05-30T16:45:10.760823+0000","last_fullsized":"2024-05-30T16:45:10.760823+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:35.589177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.740486+0000","last_change":"2024-05-30T16:45:10.740486+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.740486+0000","last_undegraded":"2024-05-30T16:45:10.740486+0000","last_fullsized":"2024-05-30T16:45:10.740486+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.769243+0000","last_change":"2024-05-30T16:45:10.766931+0000","last_active":"2024-05-30T16:45:10.769243+0000","last_peered":"2024-05-30T16:45:10.769243+0000","last_clean":"2024-05-30T16:45:10.769243+0000","last_became_active":"2024-05-30T16:45:10.765374+0000","last_became_peered":"2024-05-30T16:45:10.765374+0000","last_unstale":"2024-05-30T16:45:10.769243+0000","last_undegraded":"2024-05-30T16:45:10.769243+0000","last_fullsized":"2024-05-30T16:45:10.769243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:03.919382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.758785+0000","last_change":"2024-05-30T16:45:10.758785+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.758785+0000","last_undegraded":"2024-05-30T16:45:10.758785+0000","last_fullsized":"2024-05-30T16:45:10.758785+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771627+0000","last_change":"2024-05-30T16:45:10.770495+0000","last_active":"2024-05-30T16:45:10.771627+0000","last_peered":"2024-05-30T16:45:10.771627+0000","last_clean":"2024-05-30T16:45:10.771627+0000","last_became_active":"2024-05-30T16:45:10.770174+0000","last_became_peered":"2024-05-30T16:45:10.770174+0000","last_unstale":"2024-05-30T16:45:10.771627+0000","last_undegraded":"2024-05-30T16:45:10.771627+0000","last_fullsized":"2024-05-30T16:45:10.771627+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:03.919382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747406+0000","last_change":"2024-05-30T16:45:10.747406+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747406+0000","last_undegraded":"2024-05-30T16:45:10.747406+0000","last_fullsized":"2024-05-30T16:45:10.747406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771068+0000","last_change":"2024-05-30T16:45:10.768994+0000","last_active":"2024-05-30T16:45:10.771068+0000","last_peered":"2024-05-30T16:45:10.771068+0000","last_clean":"2024-05-30T16:45:10.771068+0000","last_became_active":"2024-05-30T16:45:10.767942+0000","last_became_peered":"2024-05-30T16:45:10.767942+0000","last_unstale":"2024-05-30T16:45:10.771068+0000","last_undegraded":"2024-05-30T16:45:10.771068+0000","last_fullsized":"2024-05-30T16:45:10.771068+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:35.589177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746061+0000","last_change":"2024-05-30T16:45:10.746061+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746061+0000","last_undegraded":"2024-05-30T16:45:10.746061+0000","last_fullsized":"2024-05-30T16:45:10.746061+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.759366+0000","last_change":"2024-05-30T16:45:10.754920+0000","last_active":"2024-05-30T16:45:10.759366+0000","last_peered":"2024-05-30T16:45:10.759366+0000","last_clean":"2024-05-30T16:45:10.759366+0000","last_became_active":"2024-05-30T16:45:10.754161+0000","last_became_peered":"2024-05-30T16:45:10.754161+0000","last_unstale":"2024-05-30T16:45:10.759366+0000","last_undegraded":"2024-05-30T16:45:10.759366+0000","last_fullsized":"2024-05-30T16:45:10.759366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:30.537707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.750819+0000","last_change":"2024-05-30T16:45:10.750819+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.750819+0000","last_undegraded":"2024-05-30T16:45:10.750819+0000","last_fullsized":"2024-05-30T16:45:10.750819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.762425+0000","last_change":"2024-05-30T16:45:10.758450+0000","last_active":"2024-05-30T16:45:10.762425+0000","last_peered":"2024-05-30T16:45:10.762425+0000","last_clean":"2024-05-30T16:45:10.762425+0000","last_became_active":"2024-05-30T16:45:10.758144+0000","last_became_peered":"2024-05-30T16:45:10.758144+0000","last_unstale":"2024-05-30T16:45:10.762425+0000","last_undegraded":"2024-05-30T16:45:10.762425+0000","last_fullsized":"2024-05-30T16:45:10.762425+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:16:25.547307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.762180+0000","last_change":"2024-05-30T16:45:10.762180+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.762180+0000","last_undegraded":"2024-05-30T16:45:10.762180+0000","last_fullsized":"2024-05-30T16:45:10.762180+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.767438+0000","last_change":"2024-05-30T16:45:10.764291+0000","last_active":"2024-05-30T16:45:10.767438+0000","last_peered":"2024-05-30T16:45:10.767438+0000","last_clean":"2024-05-30T16:45:10.767438+0000","last_became_active":"2024-05-30T16:45:10.763905+0000","last_became_peered":"2024-05-30T16:45:10.763905+0000","last_unstale":"2024-05-30T16:45:10.767438+0000","last_undegraded":"2024-05-30T16:45:10.767438+0000","last_fullsized":"2024-05-30T16:45:10.767438+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:55:33.726746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744527+0000","last_change":"2024-05-30T16:45:10.744527+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744527+0000","last_undegraded":"2024-05-30T16:45:10.744527+0000","last_fullsized":"2024-05-30T16:45:10.744527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768843+0000","last_change":"2024-05-30T16:45:10.764615+0000","last_active":"2024-05-30T16:45:10.768843+0000","last_peered":"2024-05-30T16:45:10.768843+0000","last_clean":"2024-05-30T16:45:10.768843+0000","last_became_active":"2024-05-30T16:45:10.764294+0000","last_became_peered":"2024-05-30T16:45:10.764294+0000","last_unstale":"2024-05-30T16:45:10.768843+0000","last_undegraded":"2024-05-30T16:45:10.768843+0000","last_fullsized":"2024-05-30T16:45:10.768843+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:08.045401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744944+0000","last_change":"2024-05-30T16:45:10.744944+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744944+0000","last_undegraded":"2024-05-30T16:45:10.744944+0000","last_fullsized":"2024-05-30T16:45:10.744944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771990+0000","last_change":"2024-05-30T16:45:10.770383+0000","last_active":"2024-05-30T16:45:10.771990+0000","last_peered":"2024-05-30T16:45:10.771990+0000","last_clean":"2024-05-30T16:45:10.771990+0000","last_became_active":"2024-05-30T16:45:10.769650+0000","last_became_peered":"2024-05-30T16:45:10.769650+0000","last_unstale":"2024-05-30T16:45:10.771990+0000","last_undegraded":"2024-05-30T16:45:10.771990+0000","last_fullsized":"2024-05-30T16:45:10.771990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:18.469583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747364+0000","last_change":"2024-05-30T16:45:10.747364+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747364+0000","last_undegraded":"2024-05-30T16:45:10.747364+0000","last_fullsized":"2024-05-30T16:45:10.747364+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771477+0000","last_change":"2024-05-30T16:45:10.768576+0000","last_active":"2024-05-30T16:45:10.771477+0000","last_peered":"2024-05-30T16:45:10.771477+0000","last_clean":"2024-05-30T16:45:10.771477+0000","last_became_active":"2024-05-30T16:45:10.767860+0000","last_became_peered":"2024-05-30T16:45:10.767860+0000","last_unstale":"2024-05-30T16:45:10.771477+0000","last_undegraded":"2024-05-30T16:45:10.771477+0000","last_fullsized":"2024-05-30T16:45:10.771477+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:10:43.544146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.754602+0000","last_change":"2024-05-30T16:45:10.754602+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.754602+0000","last_undegraded":"2024-05-30T16:45:10.754602+0000","last_fullsized":"2024-05-30T16:45:10.754602+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.760386+0000","last_change":"2024-05-30T16:45:10.758714+0000","last_active":"2024-05-30T16:45:10.760386+0000","last_peered":"2024-05-30T16:45:10.760386+0000","last_clean":"2024-05-30T16:45:10.760386+0000","last_became_active":"2024-05-30T16:45:10.758428+0000","last_became_peered":"2024-05-30T16:45:10.758428+0000","last_unstale":"2024-05-30T16:45:10.760386+0000","last_undegraded":"2024-05-30T16:45:10.760386+0000","last_fullsized":"2024-05-30T16:45:10.760386+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:24.291128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743054+0000","last_change":"2024-05-30T16:45:10.743054+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743054+0000","last_undegraded":"2024-05-30T16:45:10.743054+0000","last_fullsized":"2024-05-30T16:45:10.743054+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.770573+0000","last_change":"2024-05-30T16:45:10.767688+0000","last_active":"2024-05-30T16:45:10.770573+0000","last_peered":"2024-05-30T16:45:10.770573+0000","last_clean":"2024-05-30T16:45:10.770573+0000","last_became_active":"2024-05-30T16:45:10.766674+0000","last_became_peered":"2024-05-30T16:45:10.766674+0000","last_unstale":"2024-05-30T16:45:10.770573+0000","last_undegraded":"2024-05-30T16:45:10.770573+0000","last_fullsized":"2024-05-30T16:45:10.770573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:06:24.849858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743669+0000","last_change":"2024-05-30T16:45:10.743669+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743669+0000","last_undegraded":"2024-05-30T16:45:10.743669+0000","last_fullsized":"2024-05-30T16:45:10.743669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.762728+0000","last_change":"2024-05-30T16:45:10.760697+0000","last_active":"2024-05-30T16:45:10.762728+0000","last_peered":"2024-05-30T16:45:10.762728+0000","last_clean":"2024-05-30T16:45:10.762728+0000","last_became_active":"2024-05-30T16:45:10.759830+0000","last_became_peered":"2024-05-30T16:45:10.759830+0000","last_unstale":"2024-05-30T16:45:10.762728+0000","last_undegraded":"2024-05-30T16:45:10.762728+0000","last_fullsized":"2024-05-30T16:45:10.762728+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:48.106502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743892+0000","last_change":"2024-05-30T16:45:10.743892+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743892+0000","last_undegraded":"2024-05-30T16:45:10.743892+0000","last_fullsized":"2024-05-30T16:45:10.743892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.759955+0000","last_change":"2024-05-30T16:45:10.755304+0000","last_active":"2024-05-30T16:45:10.759955+0000","last_peered":"2024-05-30T16:45:10.759955+0000","last_clean":"2024-05-30T16:45:10.759955+0000","last_became_active":"2024-05-30T16:45:10.754993+0000","last_became_peered":"2024-05-30T16:45:10.754993+0000","last_unstale":"2024-05-30T16:45:10.759955+0000","last_undegraded":"2024-05-30T16:45:10.759955+0000","last_fullsized":"2024-05-30T16:45:10.759955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:49:03.018867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.741113+0000","last_change":"2024-05-30T16:45:10.741113+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.741113+0000","last_undegraded":"2024-05-30T16:45:10.741113+0000","last_fullsized":"2024-05-30T16:45:10.741113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.757517+0000","last_change":"2024-05-30T16:45:10.750358+0000","last_active":"2024-05-30T16:45:10.757517+0000","last_peered":"2024-05-30T16:45:10.757517+0000","last_clean":"2024-05-30T16:45:10.757517+0000","last_became_active":"2024-05-30T16:45:10.750034+0000","last_became_peered":"2024-05-30T16:45:10.750034+0000","last_unstale":"2024-05-30T16:45:10.757517+0000","last_undegraded":"2024-05-30T16:45:10.757517+0000","last_fullsized":"2024-05-30T16:45:10.757517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:18:54.250021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.751101+0000","last_change":"2024-05-30T16:45:10.751101+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.751101+0000","last_undegraded":"2024-05-30T16:45:10.751101+0000","last_fullsized":"2024-05-30T16:45:10.751101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771082+0000","last_change":"2024-05-30T16:45:10.769296+0000","last_active":"2024-05-30T16:45:10.771082+0000","last_peered":"2024-05-30T16:45:10.771082+0000","last_clean":"2024-05-30T16:45:10.771082+0000","last_became_active":"2024-05-30T16:45:10.768709+0000","last_became_peered":"2024-05-30T16:45:10.768709+0000","last_unstale":"2024-05-30T16:45:10.771082+0000","last_undegraded":"2024-05-30T16:45:10.771082+0000","last_fullsized":"2024-05-30T16:45:10.771082+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:12.047260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.756120+0000","last_change":"2024-05-30T16:45:10.756120+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.756120+0000","last_undegraded":"2024-05-30T16:45:10.756120+0000","last_fullsized":"2024-05-30T16:45:10.756120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.759483+0000","last_change":"2024-05-30T16:45:10.754747+0000","last_active":"2024-05-30T16:45:10.759483+0000","last_peered":"2024-05-30T16:45:10.759483+0000","last_clean":"2024-05-30T16:45:10.759483+0000","last_became_active":"2024-05-30T16:45:10.754108+0000","last_became_peered":"2024-05-30T16:45:10.754108+0000","last_unstale":"2024-05-30T16:45:10.759483+0000","last_undegraded":"2024-05-30T16:45:10.759483+0000","last_fullsized":"2024-05-30T16:45:10.759483+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:24.135227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.758234+0000","last_change":"2024-05-30T16:45:10.758234+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.758234+0000","last_undegraded":"2024-05-30T16:45:10.758234+0000","last_fullsized":"2024-05-30T16:45:10.758234+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768955+0000","last_change":"2024-05-30T16:45:10.766144+0000","last_active":"2024-05-30T16:45:10.768955+0000","last_peered":"2024-05-30T16:45:10.768955+0000","last_clean":"2024-05-30T16:45:10.768955+0000","last_became_active":"2024-05-30T16:45:10.765897+0000","last_became_peered":"2024-05-30T16:45:10.765897+0000","last_unstale":"2024-05-30T16:45:10.768955+0000","last_undegraded":"2024-05-30T16:45:10.768955+0000","last_fullsized":"2024-05-30T16:45:10.768955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:07.519898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.745146+0000","last_change":"2024-05-30T16:45:10.745146+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.745146+0000","last_undegraded":"2024-05-30T16:45:10.745146+0000","last_fullsized":"2024-05-30T16:45:10.745146+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768880+0000","last_change":"2024-05-30T16:45:10.764883+0000","last_active":"2024-05-30T16:45:10.768880+0000","last_peered":"2024-05-30T16:45:10.768880+0000","last_clean":"2024-05-30T16:45:10.768880+0000","last_became_active":"2024-05-30T16:45:10.764600+0000","last_became_peered":"2024-05-30T16:45:10.764600+0000","last_unstale":"2024-05-30T16:45:10.768880+0000","last_undegraded":"2024-05-30T16:45:10.768880+0000","last_fullsized":"2024-05-30T16:45:10.768880+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:14.199792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.741150+0000","last_change":"2024-05-30T16:45:10.741150+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.741150+0000","last_undegraded":"2024-05-30T16:45:10.741150+0000","last_fullsized":"2024-05-30T16:45:10.741150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.767016+0000","last_change":"2024-05-30T16:45:10.764986+0000","last_active":"2024-05-30T16:45:10.767016+0000","last_peered":"2024-05-30T16:45:10.767016+0000","last_clean":"2024-05-30T16:45:10.767016+0000","last_became_active":"2024-05-30T16:45:10.764682+0000","last_became_peered":"2024-05-30T16:45:10.764682+0000","last_unstale":"2024-05-30T16:45:10.767016+0000","last_undegraded":"2024-05-30T16:45:10.767016+0000","last_fullsized":"2024-05-30T16:45:10.767016+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:24.291128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.740456+0000","last_change":"2024-05-30T16:45:10.740456+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.740456+0000","last_undegraded":"2024-05-30T16:45:10.740456+0000","last_fullsized":"2024-05-30T16:45:10.740456+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768410+0000","last_change":"2024-05-30T16:45:10.764517+0000","last_active":"2024-05-30T16:45:10.768410+0000","last_peered":"2024-05-30T16:45:10.768410+0000","last_clean":"2024-05-30T16:45:10.768410+0000","last_became_active":"2024-05-30T16:45:10.764215+0000","last_became_peered":"2024-05-30T16:45:10.764215+0000","last_unstale":"2024-05-30T16:45:10.768410+0000","last_undegraded":"2024-05-30T16:45:10.768410+0000","last_fullsized":"2024-05-30T16:45:10.768410+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:20.648427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744187+0000","last_change":"2024-05-30T16:45:10.744187+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744187+0000","last_undegraded":"2024-05-30T16:45:10.744187+0000","last_fullsized":"2024-05-30T16:45:10.744187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.767455+0000","last_change":"2024-05-30T16:45:10.765930+0000","last_active":"2024-05-30T16:45:10.767455+0000","last_peered":"2024-05-30T16:45:10.767455+0000","last_clean":"2024-05-30T16:45:10.767455+0000","last_became_active":"2024-05-30T16:45:10.764672+0000","last_became_peered":"2024-05-30T16:45:10.764672+0000","last_unstale":"2024-05-30T16:45:10.767455+0000","last_undegraded":"2024-05-30T16:45:10.767455+0000","last_fullsized":"2024-05-30T16:45:10.767455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:07.519898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.752949+0000","last_change":"2024-05-30T16:45:10.752949+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.752949+0000","last_undegraded":"2024-05-30T16:45:10.752949+0000","last_fullsized":"2024-05-30T16:45:10.752949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768929+0000","last_change":"2024-05-30T16:45:10.765742+0000","last_active":"2024-05-30T16:45:10.768929+0000","last_peered":"2024-05-30T16:45:10.768929+0000","last_clean":"2024-05-30T16:45:10.768929+0000","last_became_active":"2024-05-30T16:45:10.765420+0000","last_became_peered":"2024-05-30T16:45:10.765420+0000","last_unstale":"2024-05-30T16:45:10.768929+0000","last_undegraded":"2024-05-30T16:45:10.768929+0000","last_fullsized":"2024-05-30T16:45:10.768929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:53.622362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747201+0000","last_change":"2024-05-30T16:45:10.747201+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747201+0000","last_undegraded":"2024-05-30T16:45:10.747201+0000","last_fullsized":"2024-05-30T16:45:10.747201+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.772005+0000","last_change":"2024-05-30T16:45:10.770395+0000","last_active":"2024-05-30T16:45:10.772005+0000","last_peered":"2024-05-30T16:45:10.772005+0000","last_clean":"2024-05-30T16:45:10.772005+0000","last_became_active":"2024-05-30T16:45:10.769101+0000","last_became_peered":"2024-05-30T16:45:10.769101+0000","last_unstale":"2024-05-30T16:45:10.772005+0000","last_undegraded":"2024-05-30T16:45:10.772005+0000","last_fullsized":"2024-05-30T16:45:10.772005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:02.266042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746626+0000","last_change":"2024-05-30T16:45:10.746626+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746626+0000","last_undegraded":"2024-05-30T16:45:10.746626+0000","last_fullsized":"2024-05-30T16:45:10.746626+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.760910+0000","last_change":"2024-05-30T16:45:10.754966+0000","last_active":"2024-05-30T16:45:10.760910+0000","last_peered":"2024-05-30T16:45:10.760910+0000","last_clean":"2024-05-30T16:45:10.760910+0000","last_became_active":"2024-05-30T16:45:10.754676+0000","last_became_peered":"2024-05-30T16:45:10.754676+0000","last_unstale":"2024-05-30T16:45:10.760910+0000","last_undegraded":"2024-05-30T16:45:10.760910+0000","last_fullsized":"2024-05-30T16:45:10.760910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:47.581705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744677+0000","last_change":"2024-05-30T16:45:10.744677+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744677+0000","last_undegraded":"2024-05-30T16:45:10.744677+0000","last_fullsized":"2024-05-30T16:45:10.744677+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771974+0000","last_change":"2024-05-30T16:45:10.770655+0000","last_active":"2024-05-30T16:45:10.771974+0000","last_peered":"2024-05-30T16:45:10.771974+0000","last_clean":"2024-05-30T16:45:10.771974+0000","last_became_active":"2024-05-30T16:45:10.770183+0000","last_became_peered":"2024-05-30T16:45:10.770183+0000","last_unstale":"2024-05-30T16:45:10.771974+0000","last_undegraded":"2024-05-30T16:45:10.771974+0000","last_fullsized":"2024-05-30T16:45:10.771974+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:54.903496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744044+0000","last_change":"2024-05-30T16:45:10.744044+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744044+0000","last_undegraded":"2024-05-30T16:45:10.744044+0000","last_fullsized":"2024-05-30T16:45:10.744044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.769456+0000","last_change":"2024-05-30T16:45:10.766648+0000","last_active":"2024-05-30T16:45:10.769456+0000","last_peered":"2024-05-30T16:45:10.769456+0000","last_clean":"2024-05-30T16:45:10.769456+0000","last_became_active":"2024-05-30T16:45:10.766383+0000","last_became_peered":"2024-05-30T16:45:10.766383+0000","last_unstale":"2024-05-30T16:45:10.769456+0000","last_undegraded":"2024-05-30T16:45:10.769456+0000","last_fullsized":"2024-05-30T16:45:10.769456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:01:19.722735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.748023+0000","last_change":"2024-05-30T16:45:10.748023+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.748023+0000","last_undegraded":"2024-05-30T16:45:10.748023+0000","last_fullsized":"2024-05-30T16:45:10.748023+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768729+0000","last_change":"2024-05-30T16:45:10.762650+0000","last_active":"2024-05-30T16:45:10.768729+0000","last_peered":"2024-05-30T16:45:10.768729+0000","last_clean":"2024-05-30T16:45:10.768729+0000","last_became_active":"2024-05-30T16:45:10.762303+0000","last_became_peered":"2024-05-30T16:45:10.762303+0000","last_unstale":"2024-05-30T16:45:10.768729+0000","last_undegraded":"2024-05-30T16:45:10.768729+0000","last_fullsized":"2024-05-30T16:45:10.768729+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:12.047260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.760763+0000","last_change":"2024-05-30T16:45:10.760763+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.760763+0000","last_undegraded":"2024-05-30T16:45:10.760763+0000","last_fullsized":"2024-05-30T16:45:10.760763+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.759985+0000","last_change":"2024-05-30T16:45:10.756428+0000","last_active":"2024-05-30T16:45:10.759985+0000","last_peered":"2024-05-30T16:45:10.759985+0000","last_clean":"2024-05-30T16:45:10.759985+0000","last_became_active":"2024-05-30T16:45:10.756003+0000","last_became_peered":"2024-05-30T16:45:10.756003+0000","last_unstale":"2024-05-30T16:45:10.759985+0000","last_undegraded":"2024-05-30T16:45:10.759985+0000","last_fullsized":"2024-05-30T16:45:10.759985+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:36:19.995783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.750728+0000","last_change":"2024-05-30T16:45:10.750728+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.750728+0000","last_undegraded":"2024-05-30T16:45:10.750728+0000","last_fullsized":"2024-05-30T16:45:10.750728+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.762931+0000","last_change":"2024-05-30T16:45:10.756823+0000","last_active":"2024-05-30T16:45:10.762931+0000","last_peered":"2024-05-30T16:45:10.762931+0000","last_clean":"2024-05-30T16:45:10.762931+0000","last_became_active":"2024-05-30T16:45:10.755780+0000","last_became_peered":"2024-05-30T16:45:10.755780+0000","last_unstale":"2024-05-30T16:45:10.762931+0000","last_undegraded":"2024-05-30T16:45:10.762931+0000","last_fullsized":"2024-05-30T16:45:10.762931+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:00.958564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.756656+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:45:10.756656+0000","last_peered":"2024-05-30T16:45:10.756656+0000","last_clean":"2024-05-30T16:45:10.756656+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:45:10.756656+0000","last_undegraded":"2024-05-30T16:45:10.756656+0000","last_fullsized":"2024-05-30T16:45:10.756656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335436,"statfs":{"total":96636764160,"available":96599486464,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35808,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336032,"statfs":{"total":96636764160,"available":96600096768,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35808,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336032,"statfs":{"total":96636764160,"available":96600096768,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35812,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1073152,"data_stored":781017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:45:16.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:45:16.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.487+0000 7f2487200640 1 Processor -- start 2024-05-30T16:45:16.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.487+0000 7f2487200640 1 -- start start 2024-05-30T16:45:16.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.488+0000 7f2487200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24880caf10 0x7f248815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.488+0000 7f2487200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f24880cb2f0 0x7f248815c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.488+0000 7f2487200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f248815c780 0x7f24880b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.488+0000 7f2487200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f248815f500 con 0x7f24880caf10 2024-05-30T16:45:16.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.488+0000 7f2487200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f248815f780 con 0x7f24880cb2f0 2024-05-30T16:45:16.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.488+0000 7f2487200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f248815fa60 con 0x7f248815c780 2024-05-30T16:45:16.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f2485e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24880caf10 0x7f248815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f2485e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24880caf10 0x7f248815efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46896/0 (socket says 172.21.15.144:46896) 2024-05-30T16:45:16.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f2485e00640 1 -- 172.21.15.144:0/3341158413 learned_addr learned my addr 172.21.15.144:0/3341158413 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:16.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f247d400640 1 --2- 172.21.15.144:0/3341158413 >> v2:172.21.15.149:3300/0 conn(0x7f24880cb2f0 0x7f248815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f2486800640 1 --2- 172.21.15.144:0/3341158413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f248815c780 0x7f24880b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f2485e00640 1 -- 172.21.15.144:0/3341158413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f248815c780 msgr2=0x7f24880b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:16.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f2485e00640 1 --2- 172.21.15.144:0/3341158413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f248815c780 0x7f24880b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f2485e00640 1 -- 172.21.15.144:0/3341158413 >> v2:172.21.15.149:3300/0 conn(0x7f24880cb2f0 msgr2=0x7f248815c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:16.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f2485e00640 1 --2- 172.21.15.144:0/3341158413 >> v2:172.21.15.149:3300/0 conn(0x7f24880cb2f0 0x7f248815c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.489+0000 7f2485e00640 1 -- 172.21.15.144:0/3341158413 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248815fd40 con 0x7f24880caf10 2024-05-30T16:45:16.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.491+0000 7f2485e00640 1 --2- 172.21.15.144:0/3341158413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 0x7f248815efc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f24880cc440 tx=0x7f247802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad5fc1661dd1e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:16.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.491+0000 7f2485400640 1 -- 172.21.15.144:0/3341158413 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478037070 con 0x7f24880caf10 2024-05-30T16:45:16.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.491+0000 7f2485400640 1 -- 172.21.15.144:0/3341158413 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2478032440 con 0x7f24880caf10 2024-05-30T16:45:16.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.491+0000 7f2485400640 1 -- 172.21.15.144:0/3341158413 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478032810 con 0x7f24880caf10 2024-05-30T16:45:16.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.492+0000 7f2487200640 1 -- 172.21.15.144:0/3341158413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 msgr2=0x7f248815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.492+0000 7f2487200640 1 --2- 172.21.15.144:0/3341158413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 0x7f248815efc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f24880cc440 tx=0x7f247802a1e0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.492+0000 7f2487200640 1 -- 172.21.15.144:0/3341158413 shutdown_connections 2024-05-30T16:45:16.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.492+0000 7f2487200640 1 --2- 172.21.15.144:0/3341158413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f248815c780 0x7f24880b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.492+0000 7f2487200640 1 --2- 172.21.15.144:0/3341158413 >> v2:172.21.15.149:3300/0 conn(0x7f24880cb2f0 0x7f248815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.492+0000 7f2487200640 1 --2- 172.21.15.144:0/3341158413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 0x7f248815efc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.492+0000 7f2487200640 1 -- 172.21.15.144:0/3341158413 >> 172.21.15.144:0/3341158413 conn(0x7f24880b20a0 msgr2=0x7f24880b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:16.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.492+0000 7f2487200640 1 -- 172.21.15.144:0/3341158413 shutdown_connections 2024-05-30T16:45:16.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.492+0000 7f2487200640 1 -- 172.21.15.144:0/3341158413 wait complete. 2024-05-30T16:45:16.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.494+0000 7f2487200640 1 Processor -- start 2024-05-30T16:45:16.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.494+0000 7f2487200640 1 -- start start 2024-05-30T16:45:16.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2487200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 0x7f2488151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2487200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24880cb2f0 0x7f24880aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2487200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f248815c780 0x7f2488151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2487200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24880cfa30 con 0x7f24880caf10 2024-05-30T16:45:16.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2487200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24880cf8b0 con 0x7f248815c780 2024-05-30T16:45:16.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2487200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24880cfbb0 con 0x7f24880cb2f0 2024-05-30T16:45:16.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2485e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 0x7f2488151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2485e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 0x7f2488151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46904/0 (socket says 172.21.15.144:46904) 2024-05-30T16:45:16.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2485e00640 1 -- 172.21.15.144:0/4277135065 learned_addr learned my addr 172.21.15.144:0/4277135065 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2485e00640 1 -- 172.21.15.144:0/4277135065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24880cb2f0 msgr2=0x7f24880aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f247d400640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24880cb2f0 0x7f24880aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2486800640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f248815c780 0x7f2488151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2485e00640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24880cb2f0 0x7f24880aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2485e00640 1 -- 172.21.15.144:0/4277135065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f248815c780 msgr2=0x7f2488151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2485e00640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f248815c780 0x7f2488151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.496+0000 7f2485e00640 1 -- 172.21.15.144:0/4277135065 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24880adc10 con 0x7f24880caf10 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.497+0000 7f2485e00640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 0x7f2488151620 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f247802a220 tx=0x7f24780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.497+0000 7f247ea00640 1 -- 172.21.15.144:0/4277135065 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478037040 con 0x7f24880caf10 2024-05-30T16:45:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.497+0000 7f247ea00640 1 -- 172.21.15.144:0/4277135065 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2478042070 con 0x7f24880caf10 2024-05-30T16:45:16.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.497+0000 7f247ea00640 1 -- 172.21.15.144:0/4277135065 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478030bb0 con 0x7f24880caf10 2024-05-30T16:45:16.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.497+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24880adef0 con 0x7f24880caf10 2024-05-30T16:45:16.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.497+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24880ae4b0 con 0x7f24880caf10 2024-05-30T16:45:16.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.499+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2488075570 con 0x7f24880caf10 2024-05-30T16:45:16.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.500+0000 7f247ea00640 1 -- 172.21.15.144:0/4277135065 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f2478047460 con 0x7f24880caf10 2024-05-30T16:45:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.501+0000 7f247ea00640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f246406cbc0 0x7f246406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.501+0000 7f247ea00640 1 -- 172.21.15.144:0/4277135065 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f24780acbd0 con 0x7f24880caf10 2024-05-30T16:45:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.501+0000 7f247d400640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f246406cbc0 0x7f246406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.502+0000 7f247d400640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f246406cbc0 0x7f246406f080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2488155a00 tx=0x7f2470008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:16.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.508+0000 7f247ea00640 1 -- 172.21.15.144:0/4277135065 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2478045360 con 0x7f24880caf10 2024-05-30T16:45:16.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.706+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24880b5000 con 0x7f246406cbc0 2024-05-30T16:45:16.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.718+0000 7f247ea00640 1 -- 172.21.15.144:0/4277135065 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246640 (secure 0 0 0) 0x7f24880b5000 con 0x7f246406cbc0 2024-05-30T16:45:16.722 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:16.724 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:45:16.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f246406cbc0 msgr2=0x7f246406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f246406cbc0 0x7f246406f080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2488155a00 tx=0x7f2470008040 comp rx=0 tx=0).stop 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 msgr2=0x7f2488151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 0x7f2488151620 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f247802a220 tx=0x7f24780046c0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 shutdown_connections 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f246406cbc0 0x7f246406f080 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f248815c780 0x7f2488151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24880cb2f0 0x7f24880aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 --2- 172.21.15.144:0/4277135065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24880caf10 0x7f2488151620 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 >> 172.21.15.144:0/4277135065 conn(0x7f24880b20a0 msgr2=0x7f24880ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.723+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 shutdown_connections 2024-05-30T16:45:16.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.724+0000 7f2487200640 1 -- 172.21.15.144:0/4277135065 wait complete. 2024-05-30T16:45:16.744 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-05-30T16:45:14.965895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279352,"kb_used_data":4928,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754695368,"statfs":{"total":773094113280,"available":772808056832,"internally_reserved":0,"allocated":5046272,"data_stored":2718462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":280874547},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.248297"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.749149+0000","last_change":"2024-05-30T16:45:10.749149+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.749149+0000","last_undegraded":"2024-05-30T16:45:10.749149+0000","last_fullsized":"2024-05-30T16:45:10.749149+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747293+0000","last_change":"2024-05-30T16:45:10.747293+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747293+0000","last_undegraded":"2024-05-30T16:45:10.747293+0000","last_fullsized":"2024-05-30T16:45:10.747293+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.758668+0000","last_change":"2024-05-30T16:45:10.758668+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.758668+0000","last_undegraded":"2024-05-30T16:45:10.758668+0000","last_fullsized":"2024-05-30T16:45:10.758668+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747687+0000","last_change":"2024-05-30T16:45:10.747687+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747687+0000","last_undegraded":"2024-05-30T16:45:10.747687+0000","last_fullsized":"2024-05-30T16:45:10.747687+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744569+0000","last_change":"2024-05-30T16:45:10.744569+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744569+0000","last_undegraded":"2024-05-30T16:45:10.744569+0000","last_fullsized":"2024-05-30T16:45:10.744569+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747418+0000","last_change":"2024-05-30T16:45:10.747418+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747418+0000","last_undegraded":"2024-05-30T16:45:10.747418+0000","last_fullsized":"2024-05-30T16:45:10.747418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.745120+0000","last_change":"2024-05-30T16:45:10.745120+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.745120+0000","last_undegraded":"2024-05-30T16:45:10.745120+0000","last_fullsized":"2024-05-30T16:45:10.745120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746497+0000","last_change":"2024-05-30T16:45:10.746497+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746497+0000","last_undegraded":"2024-05-30T16:45:10.746497+0000","last_fullsized":"2024-05-30T16:45:10.746497+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.751577+0000","last_change":"2024-05-30T16:45:10.751577+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.751577+0000","last_undegraded":"2024-05-30T16:45:10.751577+0000","last_fullsized":"2024-05-30T16:45:10.751577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.752176+0000","last_change":"2024-05-30T16:45:10.752176+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.752176+0000","last_undegraded":"2024-05-30T16:45:10.752176+0000","last_fullsized":"2024-05-30T16:45:10.752176+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.748101+0000","last_change":"2024-05-30T16:45:10.748101+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.748101+0000","last_undegraded":"2024-05-30T16:45:10.748101+0000","last_fullsized":"2024-05-30T16:45:10.748101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.751426+0000","last_change":"2024-05-30T16:45:10.751426+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.751426+0000","last_undegraded":"2024-05-30T16:45:10.751426+0000","last_fullsized":"2024-05-30T16:45:10.751426+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.742806+0000","last_change":"2024-05-30T16:45:10.742806+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.742806+0000","last_undegraded":"2024-05-30T16:45:10.742806+0000","last_fullsized":"2024-05-30T16:45:10.742806+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747494+0000","last_change":"2024-05-30T16:45:10.747494+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747494+0000","last_undegraded":"2024-05-30T16:45:10.747494+0000","last_fullsized":"2024-05-30T16:45:10.747494+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747052+0000","last_change":"2024-05-30T16:45:10.747052+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747052+0000","last_undegraded":"2024-05-30T16:45:10.747052+0000","last_fullsized":"2024-05-30T16:45:10.747052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746014+0000","last_change":"2024-05-30T16:45:10.746014+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746014+0000","last_undegraded":"2024-05-30T16:45:10.746014+0000","last_fullsized":"2024-05-30T16:45:10.746014+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.758216+0000","last_change":"2024-05-30T16:45:10.758216+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.758216+0000","last_undegraded":"2024-05-30T16:45:10.758216+0000","last_fullsized":"2024-05-30T16:45:10.758216+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.762668+0000","last_change":"2024-05-30T16:45:10.762668+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.762668+0000","last_undegraded":"2024-05-30T16:45:10.762668+0000","last_fullsized":"2024-05-30T16:45:10.762668+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.756683+0000","last_change":"2024-05-30T16:45:10.756683+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.756683+0000","last_undegraded":"2024-05-30T16:45:10.756683+0000","last_fullsized":"2024-05-30T16:45:10.756683+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743895+0000","last_change":"2024-05-30T16:45:10.743895+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743895+0000","last_undegraded":"2024-05-30T16:45:10.743895+0000","last_fullsized":"2024-05-30T16:45:10.743895+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.748807+0000","last_change":"2024-05-30T16:45:10.748807+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.748807+0000","last_undegraded":"2024-05-30T16:45:10.748807+0000","last_fullsized":"2024-05-30T16:45:10.748807+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744801+0000","last_change":"2024-05-30T16:45:10.744801+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744801+0000","last_undegraded":"2024-05-30T16:45:10.744801+0000","last_fullsized":"2024-05-30T16:45:10.744801+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746292+0000","last_change":"2024-05-30T16:45:10.746292+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746292+0000","last_undegraded":"2024-05-30T16:45:10.746292+0000","last_fullsized":"2024-05-30T16:45:10.746292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744848+0000","last_change":"2024-05-30T16:45:10.744848+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744848+0000","last_undegraded":"2024-05-30T16:45:10.744848+0000","last_fullsized":"2024-05-30T16:45:10.744848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.753808+0000","last_change":"2024-05-30T16:45:10.753808+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.753808+0000","last_undegraded":"2024-05-30T16:45:10.753808+0000","last_fullsized":"2024-05-30T16:45:10.753808+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743048+0000","last_change":"2024-05-30T16:45:10.743048+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743048+0000","last_undegraded":"2024-05-30T16:45:10.743048+0000","last_fullsized":"2024-05-30T16:45:10.743048+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.757928+0000","last_change":"2024-05-30T16:45:10.757928+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.757928+0000","last_undegraded":"2024-05-30T16:45:10.757928+0000","last_fullsized":"2024-05-30T16:45:10.757928+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.750506+0000","last_change":"2024-05-30T16:45:10.750506+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.750506+0000","last_undegraded":"2024-05-30T16:45:10.750506+0000","last_fullsized":"2024-05-30T16:45:10.750506+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.755050+0000","last_change":"2024-05-30T16:45:10.755050+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.755050+0000","last_undegraded":"2024-05-30T16:45:10.755050+0000","last_fullsized":"2024-05-30T16:45:10.755050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.759316+0000","last_change":"2024-05-30T16:45:10.759316+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.759316+0000","last_undegraded":"2024-05-30T16:45:10.759316+0000","last_fullsized":"2024-05-30T16:45:10.759316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.745145+0000","last_change":"2024-05-30T16:45:10.745145+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.745145+0000","last_undegraded":"2024-05-30T16:45:10.745145+0000","last_fullsized":"2024-05-30T16:45:10.745145+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.742735+0000","last_change":"2024-05-30T16:45:10.742735+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.742735+0000","last_undegraded":"2024-05-30T16:45:10.742735+0000","last_fullsized":"2024-05-30T16:45:10.742735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.742639+0000","last_change":"2024-05-30T16:45:10.742639+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.742639+0000","last_undegraded":"2024-05-30T16:45:10.742639+0000","last_fullsized":"2024-05-30T16:45:10.742639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768966+0000","last_change":"2024-05-30T16:45:10.766067+0000","last_active":"2024-05-30T16:45:10.768966+0000","last_peered":"2024-05-30T16:45:10.768966+0000","last_clean":"2024-05-30T16:45:10.768966+0000","last_became_active":"2024-05-30T16:45:10.765776+0000","last_became_peered":"2024-05-30T16:45:10.765776+0000","last_unstale":"2024-05-30T16:45:10.768966+0000","last_undegraded":"2024-05-30T16:45:10.768966+0000","last_fullsized":"2024-05-30T16:45:10.768966+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:09.001292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.753381+0000","last_change":"2024-05-30T16:45:10.753381+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.753381+0000","last_undegraded":"2024-05-30T16:45:10.753381+0000","last_fullsized":"2024-05-30T16:45:10.753381+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771049+0000","last_change":"2024-05-30T16:45:10.768779+0000","last_active":"2024-05-30T16:45:10.771049+0000","last_peered":"2024-05-30T16:45:10.771049+0000","last_clean":"2024-05-30T16:45:10.771049+0000","last_became_active":"2024-05-30T16:45:10.768305+0000","last_became_peered":"2024-05-30T16:45:10.768305+0000","last_unstale":"2024-05-30T16:45:10.771049+0000","last_undegraded":"2024-05-30T16:45:10.771049+0000","last_fullsized":"2024-05-30T16:45:10.771049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:47.581705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.749678+0000","last_change":"2024-05-30T16:45:10.749678+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.749678+0000","last_undegraded":"2024-05-30T16:45:10.749678+0000","last_fullsized":"2024-05-30T16:45:10.749678+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.760823+0000","last_change":"2024-05-30T16:45:10.756443+0000","last_active":"2024-05-30T16:45:10.760823+0000","last_peered":"2024-05-30T16:45:10.760823+0000","last_clean":"2024-05-30T16:45:10.760823+0000","last_became_active":"2024-05-30T16:45:10.756083+0000","last_became_peered":"2024-05-30T16:45:10.756083+0000","last_unstale":"2024-05-30T16:45:10.760823+0000","last_undegraded":"2024-05-30T16:45:10.760823+0000","last_fullsized":"2024-05-30T16:45:10.760823+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:35.589177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.740486+0000","last_change":"2024-05-30T16:45:10.740486+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.740486+0000","last_undegraded":"2024-05-30T16:45:10.740486+0000","last_fullsized":"2024-05-30T16:45:10.740486+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.769243+0000","last_change":"2024-05-30T16:45:10.766931+0000","last_active":"2024-05-30T16:45:10.769243+0000","last_peered":"2024-05-30T16:45:10.769243+0000","last_clean":"2024-05-30T16:45:10.769243+0000","last_became_active":"2024-05-30T16:45:10.765374+0000","last_became_peered":"2024-05-30T16:45:10.765374+0000","last_unstale":"2024-05-30T16:45:10.769243+0000","last_undegraded":"2024-05-30T16:45:10.769243+0000","last_fullsized":"2024-05-30T16:45:10.769243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:03.919382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.758785+0000","last_change":"2024-05-30T16:45:10.758785+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.758785+0000","last_undegraded":"2024-05-30T16:45:10.758785+0000","last_fullsized":"2024-05-30T16:45:10.758785+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771627+0000","last_change":"2024-05-30T16:45:10.770495+0000","last_active":"2024-05-30T16:45:10.771627+0000","last_peered":"2024-05-30T16:45:10.771627+0000","last_clean":"2024-05-30T16:45:10.771627+0000","last_became_active":"2024-05-30T16:45:10.770174+0000","last_became_peered":"2024-05-30T16:45:10.770174+0000","last_unstale":"2024-05-30T16:45:10.771627+0000","last_undegraded":"2024-05-30T16:45:10.771627+0000","last_fullsized":"2024-05-30T16:45:10.771627+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:03.919382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747406+0000","last_change":"2024-05-30T16:45:10.747406+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747406+0000","last_undegraded":"2024-05-30T16:45:10.747406+0000","last_fullsized":"2024-05-30T16:45:10.747406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771068+0000","last_change":"2024-05-30T16:45:10.768994+0000","last_active":"2024-05-30T16:45:10.771068+0000","last_peered":"2024-05-30T16:45:10.771068+0000","last_clean":"2024-05-30T16:45:10.771068+0000","last_became_active":"2024-05-30T16:45:10.767942+0000","last_became_peered":"2024-05-30T16:45:10.767942+0000","last_unstale":"2024-05-30T16:45:10.771068+0000","last_undegraded":"2024-05-30T16:45:10.771068+0000","last_fullsized":"2024-05-30T16:45:10.771068+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:35.589177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746061+0000","last_change":"2024-05-30T16:45:10.746061+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746061+0000","last_undegraded":"2024-05-30T16:45:10.746061+0000","last_fullsized":"2024-05-30T16:45:10.746061+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.759366+0000","last_change":"2024-05-30T16:45:10.754920+0000","last_active":"2024-05-30T16:45:10.759366+0000","last_peered":"2024-05-30T16:45:10.759366+0000","last_clean":"2024-05-30T16:45:10.759366+0000","last_became_active":"2024-05-30T16:45:10.754161+0000","last_became_peered":"2024-05-30T16:45:10.754161+0000","last_unstale":"2024-05-30T16:45:10.759366+0000","last_undegraded":"2024-05-30T16:45:10.759366+0000","last_fullsized":"2024-05-30T16:45:10.759366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:30.537707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.750819+0000","last_change":"2024-05-30T16:45:10.750819+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.750819+0000","last_undegraded":"2024-05-30T16:45:10.750819+0000","last_fullsized":"2024-05-30T16:45:10.750819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.762425+0000","last_change":"2024-05-30T16:45:10.758450+0000","last_active":"2024-05-30T16:45:10.762425+0000","last_peered":"2024-05-30T16:45:10.762425+0000","last_clean":"2024-05-30T16:45:10.762425+0000","last_became_active":"2024-05-30T16:45:10.758144+0000","last_became_peered":"2024-05-30T16:45:10.758144+0000","last_unstale":"2024-05-30T16:45:10.762425+0000","last_undegraded":"2024-05-30T16:45:10.762425+0000","last_fullsized":"2024-05-30T16:45:10.762425+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:16:25.547307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.762180+0000","last_change":"2024-05-30T16:45:10.762180+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.762180+0000","last_undegraded":"2024-05-30T16:45:10.762180+0000","last_fullsized":"2024-05-30T16:45:10.762180+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.767438+0000","last_change":"2024-05-30T16:45:10.764291+0000","last_active":"2024-05-30T16:45:10.767438+0000","last_peered":"2024-05-30T16:45:10.767438+0000","last_clean":"2024-05-30T16:45:10.767438+0000","last_became_active":"2024-05-30T16:45:10.763905+0000","last_became_peered":"2024-05-30T16:45:10.763905+0000","last_unstale":"2024-05-30T16:45:10.767438+0000","last_undegraded":"2024-05-30T16:45:10.767438+0000","last_fullsized":"2024-05-30T16:45:10.767438+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:55:33.726746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744527+0000","last_change":"2024-05-30T16:45:10.744527+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744527+0000","last_undegraded":"2024-05-30T16:45:10.744527+0000","last_fullsized":"2024-05-30T16:45:10.744527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768843+0000","last_change":"2024-05-30T16:45:10.764615+0000","last_active":"2024-05-30T16:45:10.768843+0000","last_peered":"2024-05-30T16:45:10.768843+0000","last_clean":"2024-05-30T16:45:10.768843+0000","last_became_active":"2024-05-30T16:45:10.764294+0000","last_became_peered":"2024-05-30T16:45:10.764294+0000","last_unstale":"2024-05-30T16:45:10.768843+0000","last_undegraded":"2024-05-30T16:45:10.768843+0000","last_fullsized":"2024-05-30T16:45:10.768843+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:08.045401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744944+0000","last_change":"2024-05-30T16:45:10.744944+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744944+0000","last_undegraded":"2024-05-30T16:45:10.744944+0000","last_fullsized":"2024-05-30T16:45:10.744944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771990+0000","last_change":"2024-05-30T16:45:10.770383+0000","last_active":"2024-05-30T16:45:10.771990+0000","last_peered":"2024-05-30T16:45:10.771990+0000","last_clean":"2024-05-30T16:45:10.771990+0000","last_became_active":"2024-05-30T16:45:10.769650+0000","last_became_peered":"2024-05-30T16:45:10.769650+0000","last_unstale":"2024-05-30T16:45:10.771990+0000","last_undegraded":"2024-05-30T16:45:10.771990+0000","last_fullsized":"2024-05-30T16:45:10.771990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:18.469583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747364+0000","last_change":"2024-05-30T16:45:10.747364+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747364+0000","last_undegraded":"2024-05-30T16:45:10.747364+0000","last_fullsized":"2024-05-30T16:45:10.747364+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771477+0000","last_change":"2024-05-30T16:45:10.768576+0000","last_active":"2024-05-30T16:45:10.771477+0000","last_peered":"2024-05-30T16:45:10.771477+0000","last_clean":"2024-05-30T16:45:10.771477+0000","last_became_active":"2024-05-30T16:45:10.767860+0000","last_became_peered":"2024-05-30T16:45:10.767860+0000","last_unstale":"2024-05-30T16:45:10.771477+0000","last_undegraded":"2024-05-30T16:45:10.771477+0000","last_fullsized":"2024-05-30T16:45:10.771477+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:10:43.544146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.754602+0000","last_change":"2024-05-30T16:45:10.754602+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.754602+0000","last_undegraded":"2024-05-30T16:45:10.754602+0000","last_fullsized":"2024-05-30T16:45:10.754602+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.760386+0000","last_change":"2024-05-30T16:45:10.758714+0000","last_active":"2024-05-30T16:45:10.760386+0000","last_peered":"2024-05-30T16:45:10.760386+0000","last_clean":"2024-05-30T16:45:10.760386+0000","last_became_active":"2024-05-30T16:45:10.758428+0000","last_became_peered":"2024-05-30T16:45:10.758428+0000","last_unstale":"2024-05-30T16:45:10.760386+0000","last_undegraded":"2024-05-30T16:45:10.760386+0000","last_fullsized":"2024-05-30T16:45:10.760386+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:24.291128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743054+0000","last_change":"2024-05-30T16:45:10.743054+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743054+0000","last_undegraded":"2024-05-30T16:45:10.743054+0000","last_fullsized":"2024-05-30T16:45:10.743054+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.770573+0000","last_change":"2024-05-30T16:45:10.767688+0000","last_active":"2024-05-30T16:45:10.770573+0000","last_peered":"2024-05-30T16:45:10.770573+0000","last_clean":"2024-05-30T16:45:10.770573+0000","last_became_active":"2024-05-30T16:45:10.766674+0000","last_became_peered":"2024-05-30T16:45:10.766674+0000","last_unstale":"2024-05-30T16:45:10.770573+0000","last_undegraded":"2024-05-30T16:45:10.770573+0000","last_fullsized":"2024-05-30T16:45:10.770573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:06:24.849858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743669+0000","last_change":"2024-05-30T16:45:10.743669+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743669+0000","last_undegraded":"2024-05-30T16:45:10.743669+0000","last_fullsized":"2024-05-30T16:45:10.743669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.762728+0000","last_change":"2024-05-30T16:45:10.760697+0000","last_active":"2024-05-30T16:45:10.762728+0000","last_peered":"2024-05-30T16:45:10.762728+0000","last_clean":"2024-05-30T16:45:10.762728+0000","last_became_active":"2024-05-30T16:45:10.759830+0000","last_became_peered":"2024-05-30T16:45:10.759830+0000","last_unstale":"2024-05-30T16:45:10.762728+0000","last_undegraded":"2024-05-30T16:45:10.762728+0000","last_fullsized":"2024-05-30T16:45:10.762728+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:48.106502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.743892+0000","last_change":"2024-05-30T16:45:10.743892+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.743892+0000","last_undegraded":"2024-05-30T16:45:10.743892+0000","last_fullsized":"2024-05-30T16:45:10.743892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.759955+0000","last_change":"2024-05-30T16:45:10.755304+0000","last_active":"2024-05-30T16:45:10.759955+0000","last_peered":"2024-05-30T16:45:10.759955+0000","last_clean":"2024-05-30T16:45:10.759955+0000","last_became_active":"2024-05-30T16:45:10.754993+0000","last_became_peered":"2024-05-30T16:45:10.754993+0000","last_unstale":"2024-05-30T16:45:10.759955+0000","last_undegraded":"2024-05-30T16:45:10.759955+0000","last_fullsized":"2024-05-30T16:45:10.759955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:49:03.018867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.741113+0000","last_change":"2024-05-30T16:45:10.741113+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.741113+0000","last_undegraded":"2024-05-30T16:45:10.741113+0000","last_fullsized":"2024-05-30T16:45:10.741113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.757517+0000","last_change":"2024-05-30T16:45:10.750358+0000","last_active":"2024-05-30T16:45:10.757517+0000","last_peered":"2024-05-30T16:45:10.757517+0000","last_clean":"2024-05-30T16:45:10.757517+0000","last_became_active":"2024-05-30T16:45:10.750034+0000","last_became_peered":"2024-05-30T16:45:10.750034+0000","last_unstale":"2024-05-30T16:45:10.757517+0000","last_undegraded":"2024-05-30T16:45:10.757517+0000","last_fullsized":"2024-05-30T16:45:10.757517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:18:54.250021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.751101+0000","last_change":"2024-05-30T16:45:10.751101+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.751101+0000","last_undegraded":"2024-05-30T16:45:10.751101+0000","last_fullsized":"2024-05-30T16:45:10.751101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771082+0000","last_change":"2024-05-30T16:45:10.769296+0000","last_active":"2024-05-30T16:45:10.771082+0000","last_peered":"2024-05-30T16:45:10.771082+0000","last_clean":"2024-05-30T16:45:10.771082+0000","last_became_active":"2024-05-30T16:45:10.768709+0000","last_became_peered":"2024-05-30T16:45:10.768709+0000","last_unstale":"2024-05-30T16:45:10.771082+0000","last_undegraded":"2024-05-30T16:45:10.771082+0000","last_fullsized":"2024-05-30T16:45:10.771082+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:12.047260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.756120+0000","last_change":"2024-05-30T16:45:10.756120+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.756120+0000","last_undegraded":"2024-05-30T16:45:10.756120+0000","last_fullsized":"2024-05-30T16:45:10.756120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.759483+0000","last_change":"2024-05-30T16:45:10.754747+0000","last_active":"2024-05-30T16:45:10.759483+0000","last_peered":"2024-05-30T16:45:10.759483+0000","last_clean":"2024-05-30T16:45:10.759483+0000","last_became_active":"2024-05-30T16:45:10.754108+0000","last_became_peered":"2024-05-30T16:45:10.754108+0000","last_unstale":"2024-05-30T16:45:10.759483+0000","last_undegraded":"2024-05-30T16:45:10.759483+0000","last_fullsized":"2024-05-30T16:45:10.759483+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:24.135227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.758234+0000","last_change":"2024-05-30T16:45:10.758234+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.758234+0000","last_undegraded":"2024-05-30T16:45:10.758234+0000","last_fullsized":"2024-05-30T16:45:10.758234+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768955+0000","last_change":"2024-05-30T16:45:10.766144+0000","last_active":"2024-05-30T16:45:10.768955+0000","last_peered":"2024-05-30T16:45:10.768955+0000","last_clean":"2024-05-30T16:45:10.768955+0000","last_became_active":"2024-05-30T16:45:10.765897+0000","last_became_peered":"2024-05-30T16:45:10.765897+0000","last_unstale":"2024-05-30T16:45:10.768955+0000","last_undegraded":"2024-05-30T16:45:10.768955+0000","last_fullsized":"2024-05-30T16:45:10.768955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:07.519898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.745146+0000","last_change":"2024-05-30T16:45:10.745146+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.745146+0000","last_undegraded":"2024-05-30T16:45:10.745146+0000","last_fullsized":"2024-05-30T16:45:10.745146+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768880+0000","last_change":"2024-05-30T16:45:10.764883+0000","last_active":"2024-05-30T16:45:10.768880+0000","last_peered":"2024-05-30T16:45:10.768880+0000","last_clean":"2024-05-30T16:45:10.768880+0000","last_became_active":"2024-05-30T16:45:10.764600+0000","last_became_peered":"2024-05-30T16:45:10.764600+0000","last_unstale":"2024-05-30T16:45:10.768880+0000","last_undegraded":"2024-05-30T16:45:10.768880+0000","last_fullsized":"2024-05-30T16:45:10.768880+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:14.199792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.741150+0000","last_change":"2024-05-30T16:45:10.741150+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.741150+0000","last_undegraded":"2024-05-30T16:45:10.741150+0000","last_fullsized":"2024-05-30T16:45:10.741150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.767016+0000","last_change":"2024-05-30T16:45:10.764986+0000","last_active":"2024-05-30T16:45:10.767016+0000","last_peered":"2024-05-30T16:45:10.767016+0000","last_clean":"2024-05-30T16:45:10.767016+0000","last_became_active":"2024-05-30T16:45:10.764682+0000","last_became_peered":"2024-05-30T16:45:10.764682+0000","last_unstale":"2024-05-30T16:45:10.767016+0000","last_undegraded":"2024-05-30T16:45:10.767016+0000","last_fullsized":"2024-05-30T16:45:10.767016+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:24.291128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.740456+0000","last_change":"2024-05-30T16:45:10.740456+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.740456+0000","last_undegraded":"2024-05-30T16:45:10.740456+0000","last_fullsized":"2024-05-30T16:45:10.740456+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768410+0000","last_change":"2024-05-30T16:45:10.764517+0000","last_active":"2024-05-30T16:45:10.768410+0000","last_peered":"2024-05-30T16:45:10.768410+0000","last_clean":"2024-05-30T16:45:10.768410+0000","last_became_active":"2024-05-30T16:45:10.764215+0000","last_became_peered":"2024-05-30T16:45:10.764215+0000","last_unstale":"2024-05-30T16:45:10.768410+0000","last_undegraded":"2024-05-30T16:45:10.768410+0000","last_fullsized":"2024-05-30T16:45:10.768410+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:20.648427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744187+0000","last_change":"2024-05-30T16:45:10.744187+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744187+0000","last_undegraded":"2024-05-30T16:45:10.744187+0000","last_fullsized":"2024-05-30T16:45:10.744187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.767455+0000","last_change":"2024-05-30T16:45:10.765930+0000","last_active":"2024-05-30T16:45:10.767455+0000","last_peered":"2024-05-30T16:45:10.767455+0000","last_clean":"2024-05-30T16:45:10.767455+0000","last_became_active":"2024-05-30T16:45:10.764672+0000","last_became_peered":"2024-05-30T16:45:10.764672+0000","last_unstale":"2024-05-30T16:45:10.767455+0000","last_undegraded":"2024-05-30T16:45:10.767455+0000","last_fullsized":"2024-05-30T16:45:10.767455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:07.519898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.752949+0000","last_change":"2024-05-30T16:45:10.752949+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.752949+0000","last_undegraded":"2024-05-30T16:45:10.752949+0000","last_fullsized":"2024-05-30T16:45:10.752949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768929+0000","last_change":"2024-05-30T16:45:10.765742+0000","last_active":"2024-05-30T16:45:10.768929+0000","last_peered":"2024-05-30T16:45:10.768929+0000","last_clean":"2024-05-30T16:45:10.768929+0000","last_became_active":"2024-05-30T16:45:10.765420+0000","last_became_peered":"2024-05-30T16:45:10.765420+0000","last_unstale":"2024-05-30T16:45:10.768929+0000","last_undegraded":"2024-05-30T16:45:10.768929+0000","last_fullsized":"2024-05-30T16:45:10.768929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:53.622362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.747201+0000","last_change":"2024-05-30T16:45:10.747201+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.747201+0000","last_undegraded":"2024-05-30T16:45:10.747201+0000","last_fullsized":"2024-05-30T16:45:10.747201+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.772005+0000","last_change":"2024-05-30T16:45:10.770395+0000","last_active":"2024-05-30T16:45:10.772005+0000","last_peered":"2024-05-30T16:45:10.772005+0000","last_clean":"2024-05-30T16:45:10.772005+0000","last_became_active":"2024-05-30T16:45:10.769101+0000","last_became_peered":"2024-05-30T16:45:10.769101+0000","last_unstale":"2024-05-30T16:45:10.772005+0000","last_undegraded":"2024-05-30T16:45:10.772005+0000","last_fullsized":"2024-05-30T16:45:10.772005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:02.266042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.746626+0000","last_change":"2024-05-30T16:45:10.746626+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.746626+0000","last_undegraded":"2024-05-30T16:45:10.746626+0000","last_fullsized":"2024-05-30T16:45:10.746626+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.760910+0000","last_change":"2024-05-30T16:45:10.754966+0000","last_active":"2024-05-30T16:45:10.760910+0000","last_peered":"2024-05-30T16:45:10.760910+0000","last_clean":"2024-05-30T16:45:10.760910+0000","last_became_active":"2024-05-30T16:45:10.754676+0000","last_became_peered":"2024-05-30T16:45:10.754676+0000","last_unstale":"2024-05-30T16:45:10.760910+0000","last_undegraded":"2024-05-30T16:45:10.760910+0000","last_fullsized":"2024-05-30T16:45:10.760910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:11:47.581705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744677+0000","last_change":"2024-05-30T16:45:10.744677+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744677+0000","last_undegraded":"2024-05-30T16:45:10.744677+0000","last_fullsized":"2024-05-30T16:45:10.744677+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.771974+0000","last_change":"2024-05-30T16:45:10.770655+0000","last_active":"2024-05-30T16:45:10.771974+0000","last_peered":"2024-05-30T16:45:10.771974+0000","last_clean":"2024-05-30T16:45:10.771974+0000","last_became_active":"2024-05-30T16:45:10.770183+0000","last_became_peered":"2024-05-30T16:45:10.770183+0000","last_unstale":"2024-05-30T16:45:10.771974+0000","last_undegraded":"2024-05-30T16:45:10.771974+0000","last_fullsized":"2024-05-30T16:45:10.771974+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:54.903496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.744044+0000","last_change":"2024-05-30T16:45:10.744044+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.744044+0000","last_undegraded":"2024-05-30T16:45:10.744044+0000","last_fullsized":"2024-05-30T16:45:10.744044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.769456+0000","last_change":"2024-05-30T16:45:10.766648+0000","last_active":"2024-05-30T16:45:10.769456+0000","last_peered":"2024-05-30T16:45:10.769456+0000","last_clean":"2024-05-30T16:45:10.769456+0000","last_became_active":"2024-05-30T16:45:10.766383+0000","last_became_peered":"2024-05-30T16:45:10.766383+0000","last_unstale":"2024-05-30T16:45:10.769456+0000","last_undegraded":"2024-05-30T16:45:10.769456+0000","last_fullsized":"2024-05-30T16:45:10.769456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:01:19.722735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.748023+0000","last_change":"2024-05-30T16:45:10.748023+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.748023+0000","last_undegraded":"2024-05-30T16:45:10.748023+0000","last_fullsized":"2024-05-30T16:45:10.748023+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.768729+0000","last_change":"2024-05-30T16:45:10.762650+0000","last_active":"2024-05-30T16:45:10.768729+0000","last_peered":"2024-05-30T16:45:10.768729+0000","last_clean":"2024-05-30T16:45:10.768729+0000","last_became_active":"2024-05-30T16:45:10.762303+0000","last_became_peered":"2024-05-30T16:45:10.762303+0000","last_unstale":"2024-05-30T16:45:10.768729+0000","last_undegraded":"2024-05-30T16:45:10.768729+0000","last_fullsized":"2024-05-30T16:45:10.768729+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:04:12.047260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.760763+0000","last_change":"2024-05-30T16:45:10.760763+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.760763+0000","last_undegraded":"2024-05-30T16:45:10.760763+0000","last_fullsized":"2024-05-30T16:45:10.760763+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.759985+0000","last_change":"2024-05-30T16:45:10.756428+0000","last_active":"2024-05-30T16:45:10.759985+0000","last_peered":"2024-05-30T16:45:10.759985+0000","last_clean":"2024-05-30T16:45:10.759985+0000","last_became_active":"2024-05-30T16:45:10.756003+0000","last_became_peered":"2024-05-30T16:45:10.756003+0000","last_unstale":"2024-05-30T16:45:10.759985+0000","last_undegraded":"2024-05-30T16:45:10.759985+0000","last_fullsized":"2024-05-30T16:45:10.759985+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:36:19.995783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-05-30T16:45:10.750728+0000","last_change":"2024-05-30T16:45:10.750728+0000","last_active":"2024-05-30T16:45:10.715702+0000","last_peered":"2024-05-30T16:45:10.715702+0000","last_clean":"2024-05-30T16:45:10.715702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:45:10.750728+0000","last_undegraded":"2024-05-30T16:45:10.750728+0000","last_fullsized":"2024-05-30T16:45:10.750728+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.762931+0000","last_change":"2024-05-30T16:45:10.756823+0000","last_active":"2024-05-30T16:45:10.762931+0000","last_peered":"2024-05-30T16:45:10.762931+0000","last_clean":"2024-05-30T16:45:10.762931+0000","last_became_active":"2024-05-30T16:45:10.755780+0000","last_became_peered":"2024-05-30T16:45:10.755780+0000","last_unstale":"2024-05-30T16:45:10.762931+0000","last_undegraded":"2024-05-30T16:45:10.762931+0000","last_fullsized":"2024-05-30T16:45:10.762931+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:00.958564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-05-30T16:45:10.756656+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:45:10.756656+0000","last_peered":"2024-05-30T16:45:10.756656+0000","last_clean":"2024-05-30T16:45:10.756656+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:45:10.756656+0000","last_undegraded":"2024-05-30T16:45:10.756656+0000","last_fullsized":"2024-05-30T16:45:10.756656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335436,"statfs":{"total":96636764160,"available":96599486464,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35808,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336032,"statfs":{"total":96636764160,"available":96600096768,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35808,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336032,"statfs":{"total":96636764160,"available":96600096768,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35812,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":479232,"data_stored":190649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1073152,"data_stored":781017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:45:16.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:45:16.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.987+0000 7fec05800640 1 Processor -- start 2024-05-30T16:45:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.987+0000 7fec05800640 1 -- start start 2024-05-30T16:45:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.989+0000 7fec05800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec000cfc40 0x7fec0006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.989+0000 7fec05800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec000d00f0 con 0x7fec00145150 2024-05-30T16:45:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.989+0000 7fec05800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0015f390 con 0x7fec0006f610 2024-05-30T16:45:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.989+0000 7fec05800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fec0006fa60 con 0x7fec000cfc40 2024-05-30T16:45:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.989+0000 7febfe000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec000cfc40 0x7fec0006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.989+0000 7febfea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fec00145150 0x7fec000cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45426/0 (socket says 172.21.15.144:45426) 2024-05-30T16:45:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.989+0000 7febfea00640 1 -- 172.21.15.144:0/967151570 learned_addr learned my addr 172.21.15.144:0/967151570 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.990+0000 7febfe000640 1 -- 172.21.15.144:0/967151570 >> v1:172.21.15.149:6789/0 conn(0x7fec0006f610 legacy=0x7fec000b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.990+0000 7febfe000640 1 -- 172.21.15.144:0/967151570 >> v1:172.21.15.144:6789/0 conn(0x7fec00145150 legacy=0x7fec000cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.990+0000 7febfe000640 1 -- 172.21.15.144:0/967151570 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0015f670 con 0x7fec000cfc40 2024-05-30T16:45:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.990+0000 7febfd600640 1 -- 172.21.15.144:0/967151570 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975732483 0 0) 0x7fec000d00f0 con 0x7fec00145150 2024-05-30T16:45:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.991+0000 7febfe000640 1 --2- 172.21.15.144:0/967151570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec000cfc40 0x7fec0006f0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7febec0097a0 tx=0x7febec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac19b3dde67b55e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.991+0000 7febfd600640 1 -- 172.21.15.144:0/967151570 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec037070 con 0x7fec000cfc40 2024-05-30T16:45:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.991+0000 7febfd600640 1 -- 172.21.15.144:0/967151570 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febec02ae50 con 0x7fec000cfc40 2024-05-30T16:45:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.991+0000 7febfd600640 1 -- 172.21.15.144:0/967151570 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec032660 con 0x7fec000cfc40 2024-05-30T16:45:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.992+0000 7fec05800640 1 -- 172.21.15.144:0/967151570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec000cfc40 msgr2=0x7fec0006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.992+0000 7fec05800640 1 --2- 172.21.15.144:0/967151570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec000cfc40 0x7fec0006f0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7febec0097a0 tx=0x7febec02a140 comp rx=0 tx=0).stop 2024-05-30T16:45:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.992+0000 7fec05800640 1 -- 172.21.15.144:0/967151570 shutdown_connections 2024-05-30T16:45:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.992+0000 7fec05800640 1 --2- 172.21.15.144:0/967151570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec000cfc40 0x7fec0006f0d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.992+0000 7fec05800640 1 -- 172.21.15.144:0/967151570 >> 172.21.15.144:0/967151570 conn(0x7fec0006bd00 msgr2=0x7fec0006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:16.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.992+0000 7fec05800640 1 -- 172.21.15.144:0/967151570 shutdown_connections 2024-05-30T16:45:16.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.992+0000 7fec05800640 1 -- 172.21.15.144:0/967151570 wait complete. 2024-05-30T16:45:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.994+0000 7fec05800640 1 Processor -- start 2024-05-30T16:45:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.994+0000 7fec05800640 1 -- start start 2024-05-30T16:45:16.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.995+0000 7fec05800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006f610 0x7fec000af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.995+0000 7fec05800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec000cfc40 0x7fec001f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.995+0000 7fec05800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec00145150 0x7fec000b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.995+0000 7fec05800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec000b64f0 con 0x7fec0006f610 2024-05-30T16:45:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.995+0000 7fec05800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec0015f140 con 0x7fec00145150 2024-05-30T16:45:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.995+0000 7fec05800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec0015fe70 con 0x7fec000cfc40 2024-05-30T16:45:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.995+0000 7febfea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006f610 0x7fec000af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.995+0000 7febfea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006f610 0x7fec000af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46920/0 (socket says 172.21.15.144:46920) 2024-05-30T16:45:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.995+0000 7febfea00640 1 -- 172.21.15.144:0/3996111313 learned_addr learned my addr 172.21.15.144:0/3996111313 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febfea00640 1 -- 172.21.15.144:0/3996111313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec000cfc40 msgr2=0x7fec001f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febfea00640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec000cfc40 0x7fec001f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febfea00640 1 -- 172.21.15.144:0/3996111313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec00145150 msgr2=0x7fec000b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febff400640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec00145150 0x7fec000b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febfea00640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec00145150 0x7fec000b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febfea00640 1 -- 172.21.15.144:0/3996111313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec000b1990 con 0x7fec0006f610 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febfea00640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006f610 0x7fec000af030 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7febf000c430 tx=0x7febf000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febf6a00640 1 -- 172.21.15.144:0/3996111313 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00074e0 con 0x7fec0006f610 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febf6a00640 1 -- 172.21.15.144:0/3996111313 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf00047e0 con 0x7fec0006f610 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec000ae270 con 0x7fec0006f610 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.996+0000 7febf6a00640 1 -- 172.21.15.144:0/3996111313 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0004bd0 con 0x7fec0006f610 2024-05-30T16:45:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.997+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec000ae830 con 0x7fec0006f610 2024-05-30T16:45:17.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.998+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0006c550 con 0x7fec0006f610 2024-05-30T16:45:17.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.999+0000 7febf6a00640 1 -- 172.21.15.144:0/3996111313 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7febf0011070 con 0x7fec0006f610 2024-05-30T16:45:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:16.999+0000 7febf6a00640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7febe006cbf0 0x7febe006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.000+0000 7febf6a00640 1 -- 172.21.15.144:0/3996111313 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7febf008bc70 con 0x7fec0006f610 2024-05-30T16:45:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.000+0000 7febfe000640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7febe006cbf0 0x7febe006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.001+0000 7febfe000640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7febe006cbf0 0x7febe006f0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febec034000 tx=0x7febec02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:17.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.004+0000 7febf6a00640 1 -- 172.21.15.144:0/3996111313 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fec0006c550 con 0x7fec0006f610 2024-05-30T16:45:17.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.203+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec00144680 con 0x7febe006cbf0 2024-05-30T16:45:17.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.221+0000 7febf6a00640 1 -- 172.21.15.144:0/3996111313 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251960 (secure 0 0 0) 0x7fec00144680 con 0x7febe006cbf0 2024-05-30T16:45:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:17.227 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:45:17.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7febe006cbf0 msgr2=0x7febe006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:17.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7febe006cbf0 0x7febe006f0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febec034000 tx=0x7febec02c000 comp rx=0 tx=0).stop 2024-05-30T16:45:17.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006f610 msgr2=0x7fec000af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:17.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006f610 0x7fec000af030 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7febf000c430 tx=0x7febf000c8f0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 shutdown_connections 2024-05-30T16:45:17.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7febe006cbf0 0x7febe006f0b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec00145150 0x7fec000b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec000cfc40 0x7fec001f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 --2- 172.21.15.144:0/3996111313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006f610 0x7fec000af030 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.226+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 >> 172.21.15.144:0/3996111313 conn(0x7fec0006bd00 msgr2=0x7fec000b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:17.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.227+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 shutdown_connections 2024-05-30T16:45:17.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.227+0000 7fec05800640 1 -- 172.21.15.144:0/3996111313 wait complete. 2024-05-30T16:45:17.248 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-05-30T16:45:16.966515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279652,"kb_used_data":5244,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754695068,"statfs":{"total":773094113280,"available":772807749632,"internally_reserved":0,"allocated":5369856,"data_stored":2859184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":280874547},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.230639"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781385+0000","last_change":"2024-05-30T16:45:11.768106+0000","last_active":"2024-05-30T16:45:12.781385+0000","last_peered":"2024-05-30T16:45:12.781385+0000","last_clean":"2024-05-30T16:45:12.781385+0000","last_became_active":"2024-05-30T16:45:11.767505+0000","last_became_peered":"2024-05-30T16:45:11.767505+0000","last_unstale":"2024-05-30T16:45:12.781385+0000","last_undegraded":"2024-05-30T16:45:12.781385+0000","last_fullsized":"2024-05-30T16:45:12.781385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:01.134266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.931324+0000","last_change":"2024-05-30T16:45:11.769953+0000","last_active":"2024-05-30T16:45:14.931324+0000","last_peered":"2024-05-30T16:45:14.931324+0000","last_clean":"2024-05-30T16:45:14.931324+0000","last_became_active":"2024-05-30T16:45:11.769517+0000","last_became_peered":"2024-05-30T16:45:11.769517+0000","last_unstale":"2024-05-30T16:45:14.931324+0000","last_undegraded":"2024-05-30T16:45:14.931324+0000","last_fullsized":"2024-05-30T16:45:14.931324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:55:52.454802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779296+0000","last_change":"2024-05-30T16:45:11.773135+0000","last_active":"2024-05-30T16:45:12.779296+0000","last_peered":"2024-05-30T16:45:12.779296+0000","last_clean":"2024-05-30T16:45:12.779296+0000","last_became_active":"2024-05-30T16:45:11.772494+0000","last_became_peered":"2024-05-30T16:45:11.772494+0000","last_unstale":"2024-05-30T16:45:12.779296+0000","last_undegraded":"2024-05-30T16:45:12.779296+0000","last_fullsized":"2024-05-30T16:45:12.779296+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:10.018253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059928+0000","last_change":"2024-05-30T16:45:11.785668+0000","last_active":"2024-05-30T16:45:15.059928+0000","last_peered":"2024-05-30T16:45:15.059928+0000","last_clean":"2024-05-30T16:45:15.059928+0000","last_became_active":"2024-05-30T16:45:11.785347+0000","last_became_peered":"2024-05-30T16:45:11.785347+0000","last_unstale":"2024-05-30T16:45:15.059928+0000","last_undegraded":"2024-05-30T16:45:15.059928+0000","last_fullsized":"2024-05-30T16:45:15.059928+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:54.639322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930381+0000","last_change":"2024-05-30T16:45:11.788227+0000","last_active":"2024-05-30T16:45:14.930381+0000","last_peered":"2024-05-30T16:45:14.930381+0000","last_clean":"2024-05-30T16:45:14.930381+0000","last_became_active":"2024-05-30T16:45:11.787637+0000","last_became_peered":"2024-05-30T16:45:11.787637+0000","last_unstale":"2024-05-30T16:45:14.930381+0000","last_undegraded":"2024-05-30T16:45:14.930381+0000","last_fullsized":"2024-05-30T16:45:14.930381+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:50.106284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532939+0000","last_change":"2024-05-30T16:45:11.778490+0000","last_active":"2024-05-30T16:45:15.532939+0000","last_peered":"2024-05-30T16:45:15.532939+0000","last_clean":"2024-05-30T16:45:15.532939+0000","last_became_active":"2024-05-30T16:45:11.776241+0000","last_became_peered":"2024-05-30T16:45:11.776241+0000","last_unstale":"2024-05-30T16:45:15.532939+0000","last_undegraded":"2024-05-30T16:45:15.532939+0000","last_fullsized":"2024-05-30T16:45:15.532939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:49:23.495537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778674+0000","last_change":"2024-05-30T16:45:11.777655+0000","last_active":"2024-05-30T16:45:12.778674+0000","last_peered":"2024-05-30T16:45:12.778674+0000","last_clean":"2024-05-30T16:45:12.778674+0000","last_became_active":"2024-05-30T16:45:11.777373+0000","last_became_peered":"2024-05-30T16:45:11.777373+0000","last_unstale":"2024-05-30T16:45:12.778674+0000","last_undegraded":"2024-05-30T16:45:12.778674+0000","last_fullsized":"2024-05-30T16:45:12.778674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:05.992912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060109+0000","last_change":"2024-05-30T16:45:11.779281+0000","last_active":"2024-05-30T16:45:15.060109+0000","last_peered":"2024-05-30T16:45:15.060109+0000","last_clean":"2024-05-30T16:45:15.060109+0000","last_became_active":"2024-05-30T16:45:11.779014+0000","last_became_peered":"2024-05-30T16:45:11.779014+0000","last_unstale":"2024-05-30T16:45:15.060109+0000","last_undegraded":"2024-05-30T16:45:15.060109+0000","last_fullsized":"2024-05-30T16:45:15.060109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:10.018253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061303+0000","last_change":"2024-05-30T16:45:11.784152+0000","last_active":"2024-05-30T16:45:15.061303+0000","last_peered":"2024-05-30T16:45:15.061303+0000","last_clean":"2024-05-30T16:45:15.061303+0000","last_became_active":"2024-05-30T16:45:11.782307+0000","last_became_peered":"2024-05-30T16:45:11.782307+0000","last_unstale":"2024-05-30T16:45:15.061303+0000","last_undegraded":"2024-05-30T16:45:15.061303+0000","last_fullsized":"2024-05-30T16:45:15.061303+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:20:40.082290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061248+0000","last_change":"2024-05-30T16:45:11.782161+0000","last_active":"2024-05-30T16:45:15.061248+0000","last_peered":"2024-05-30T16:45:15.061248+0000","last_clean":"2024-05-30T16:45:15.061248+0000","last_became_active":"2024-05-30T16:45:11.778063+0000","last_became_peered":"2024-05-30T16:45:11.778063+0000","last_unstale":"2024-05-30T16:45:15.061248+0000","last_undegraded":"2024-05-30T16:45:15.061248+0000","last_fullsized":"2024-05-30T16:45:15.061248+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:39.375880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060850+0000","last_change":"2024-05-30T16:45:11.784032+0000","last_active":"2024-05-30T16:45:15.060850+0000","last_peered":"2024-05-30T16:45:15.060850+0000","last_clean":"2024-05-30T16:45:15.060850+0000","last_became_active":"2024-05-30T16:45:11.783227+0000","last_became_peered":"2024-05-30T16:45:11.783227+0000","last_unstale":"2024-05-30T16:45:15.060850+0000","last_undegraded":"2024-05-30T16:45:15.060850+0000","last_fullsized":"2024-05-30T16:45:15.060850+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:03.283002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930417+0000","last_change":"2024-05-30T16:45:11.774520+0000","last_active":"2024-05-30T16:45:14.930417+0000","last_peered":"2024-05-30T16:45:14.930417+0000","last_clean":"2024-05-30T16:45:14.930417+0000","last_became_active":"2024-05-30T16:45:11.774226+0000","last_became_peered":"2024-05-30T16:45:11.774226+0000","last_unstale":"2024-05-30T16:45:14.930417+0000","last_undegraded":"2024-05-30T16:45:14.930417+0000","last_fullsized":"2024-05-30T16:45:14.930417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:10.583306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937641+0000","last_change":"2024-05-30T16:45:11.769778+0000","last_active":"2024-05-30T16:45:14.937641+0000","last_peered":"2024-05-30T16:45:14.937641+0000","last_clean":"2024-05-30T16:45:14.937641+0000","last_became_active":"2024-05-30T16:45:11.767992+0000","last_became_peered":"2024-05-30T16:45:11.767992+0000","last_unstale":"2024-05-30T16:45:14.937641+0000","last_undegraded":"2024-05-30T16:45:14.937641+0000","last_fullsized":"2024-05-30T16:45:14.937641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:09.062362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059792+0000","last_change":"2024-05-30T16:45:11.780930+0000","last_active":"2024-05-30T16:45:15.059792+0000","last_peered":"2024-05-30T16:45:15.059792+0000","last_clean":"2024-05-30T16:45:15.059792+0000","last_became_active":"2024-05-30T16:45:11.780622+0000","last_became_peered":"2024-05-30T16:45:11.780622+0000","last_unstale":"2024-05-30T16:45:15.059792+0000","last_undegraded":"2024-05-30T16:45:15.059792+0000","last_fullsized":"2024-05-30T16:45:15.059792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:49.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532846+0000","last_change":"2024-05-30T16:45:11.775855+0000","last_active":"2024-05-30T16:45:15.532846+0000","last_peered":"2024-05-30T16:45:15.532846+0000","last_clean":"2024-05-30T16:45:15.532846+0000","last_became_active":"2024-05-30T16:45:11.775516+0000","last_became_peered":"2024-05-30T16:45:11.775516+0000","last_unstale":"2024-05-30T16:45:15.532846+0000","last_undegraded":"2024-05-30T16:45:15.532846+0000","last_fullsized":"2024-05-30T16:45:15.532846+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:01.134266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.782859+0000","last_change":"2024-05-30T16:45:11.780840+0000","last_active":"2024-05-30T16:45:12.782859+0000","last_peered":"2024-05-30T16:45:12.782859+0000","last_clean":"2024-05-30T16:45:12.782859+0000","last_became_active":"2024-05-30T16:45:11.780478+0000","last_became_peered":"2024-05-30T16:45:11.780478+0000","last_unstale":"2024-05-30T16:45:12.782859+0000","last_undegraded":"2024-05-30T16:45:12.782859+0000","last_fullsized":"2024-05-30T16:45:12.782859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:55.946299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780276+0000","last_change":"2024-05-30T16:45:11.764047+0000","last_active":"2024-05-30T16:45:12.780276+0000","last_peered":"2024-05-30T16:45:12.780276+0000","last_clean":"2024-05-30T16:45:12.780276+0000","last_became_active":"2024-05-30T16:45:11.763608+0000","last_became_peered":"2024-05-30T16:45:11.763608+0000","last_unstale":"2024-05-30T16:45:12.780276+0000","last_undegraded":"2024-05-30T16:45:12.780276+0000","last_fullsized":"2024-05-30T16:45:12.780276+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:19.486543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780175+0000","last_change":"2024-05-30T16:45:11.777212+0000","last_active":"2024-05-30T16:45:12.780175+0000","last_peered":"2024-05-30T16:45:12.780175+0000","last_clean":"2024-05-30T16:45:12.780175+0000","last_became_active":"2024-05-30T16:45:11.776937+0000","last_became_peered":"2024-05-30T16:45:11.776937+0000","last_unstale":"2024-05-30T16:45:12.780175+0000","last_undegraded":"2024-05-30T16:45:12.780175+0000","last_fullsized":"2024-05-30T16:45:12.780175+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:06:25.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.784034+0000","last_change":"2024-05-30T16:45:11.771136+0000","last_active":"2024-05-30T16:45:12.784034+0000","last_peered":"2024-05-30T16:45:12.784034+0000","last_clean":"2024-05-30T16:45:12.784034+0000","last_became_active":"2024-05-30T16:45:11.770211+0000","last_became_peered":"2024-05-30T16:45:11.770211+0000","last_unstale":"2024-05-30T16:45:12.784034+0000","last_undegraded":"2024-05-30T16:45:12.784034+0000","last_fullsized":"2024-05-30T16:45:12.784034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:49.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937923+0000","last_change":"2024-05-30T16:45:11.780305+0000","last_active":"2024-05-30T16:45:14.937923+0000","last_peered":"2024-05-30T16:45:14.937923+0000","last_clean":"2024-05-30T16:45:14.937923+0000","last_became_active":"2024-05-30T16:45:11.780032+0000","last_became_peered":"2024-05-30T16:45:11.780032+0000","last_unstale":"2024-05-30T16:45:14.937923+0000","last_undegraded":"2024-05-30T16:45:14.937923+0000","last_fullsized":"2024-05-30T16:45:14.937923+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:47.514990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533073+0000","last_change":"2024-05-30T16:45:11.773034+0000","last_active":"2024-05-30T16:45:15.533073+0000","last_peered":"2024-05-30T16:45:15.533073+0000","last_clean":"2024-05-30T16:45:15.533073+0000","last_became_active":"2024-05-30T16:45:11.771866+0000","last_became_peered":"2024-05-30T16:45:11.771866+0000","last_unstale":"2024-05-30T16:45:15.533073+0000","last_undegraded":"2024-05-30T16:45:15.533073+0000","last_fullsized":"2024-05-30T16:45:15.533073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:57:15.726673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059890+0000","last_change":"2024-05-30T16:45:11.780307+0000","last_active":"2024-05-30T16:45:15.059890+0000","last_peered":"2024-05-30T16:45:15.059890+0000","last_clean":"2024-05-30T16:45:15.059890+0000","last_became_active":"2024-05-30T16:45:11.780038+0000","last_became_peered":"2024-05-30T16:45:11.780038+0000","last_unstale":"2024-05-30T16:45:15.059890+0000","last_undegraded":"2024-05-30T16:45:15.059890+0000","last_fullsized":"2024-05-30T16:45:15.059890+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:15.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.782877+0000","last_change":"2024-05-30T16:45:11.762458+0000","last_active":"2024-05-30T16:45:12.782877+0000","last_peered":"2024-05-30T16:45:12.782877+0000","last_clean":"2024-05-30T16:45:12.782877+0000","last_became_active":"2024-05-30T16:45:11.762163+0000","last_became_peered":"2024-05-30T16:45:11.762163+0000","last_unstale":"2024-05-30T16:45:12.782877+0000","last_undegraded":"2024-05-30T16:45:12.782877+0000","last_fullsized":"2024-05-30T16:45:12.782877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:37:21.994344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783293+0000","last_change":"2024-05-30T16:45:11.762289+0000","last_active":"2024-05-30T16:45:12.783293+0000","last_peered":"2024-05-30T16:45:12.783293+0000","last_clean":"2024-05-30T16:45:12.783293+0000","last_became_active":"2024-05-30T16:45:11.761972+0000","last_became_peered":"2024-05-30T16:45:11.761972+0000","last_unstale":"2024-05-30T16:45:12.783293+0000","last_undegraded":"2024-05-30T16:45:12.783293+0000","last_fullsized":"2024-05-30T16:45:12.783293+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:59.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783631+0000","last_change":"2024-05-30T16:45:11.773707+0000","last_active":"2024-05-30T16:45:12.783631+0000","last_peered":"2024-05-30T16:45:12.783631+0000","last_clean":"2024-05-30T16:45:12.783631+0000","last_became_active":"2024-05-30T16:45:11.773418+0000","last_became_peered":"2024-05-30T16:45:11.773418+0000","last_unstale":"2024-05-30T16:45:12.783631+0000","last_undegraded":"2024-05-30T16:45:12.783631+0000","last_fullsized":"2024-05-30T16:45:12.783631+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:25.152187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937511+0000","last_change":"2024-05-30T16:45:11.769998+0000","last_active":"2024-05-30T16:45:14.937511+0000","last_peered":"2024-05-30T16:45:14.937511+0000","last_clean":"2024-05-30T16:45:14.937511+0000","last_became_active":"2024-05-30T16:45:11.769749+0000","last_became_peered":"2024-05-30T16:45:11.769749+0000","last_unstale":"2024-05-30T16:45:14.937511+0000","last_undegraded":"2024-05-30T16:45:14.937511+0000","last_fullsized":"2024-05-30T16:45:14.937511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:21.665387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779702+0000","last_change":"2024-05-30T16:45:11.760043+0000","last_active":"2024-05-30T16:45:12.779702+0000","last_peered":"2024-05-30T16:45:12.779702+0000","last_clean":"2024-05-30T16:45:12.779702+0000","last_became_active":"2024-05-30T16:45:11.759749+0000","last_became_peered":"2024-05-30T16:45:11.759749+0000","last_unstale":"2024-05-30T16:45:12.779702+0000","last_undegraded":"2024-05-30T16:45:12.779702+0000","last_fullsized":"2024-05-30T16:45:12.779702+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:08.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930860+0000","last_change":"2024-05-30T16:45:11.774367+0000","last_active":"2024-05-30T16:45:14.930860+0000","last_peered":"2024-05-30T16:45:14.930860+0000","last_clean":"2024-05-30T16:45:14.930860+0000","last_became_active":"2024-05-30T16:45:11.774042+0000","last_became_peered":"2024-05-30T16:45:11.774042+0000","last_unstale":"2024-05-30T16:45:14.930860+0000","last_undegraded":"2024-05-30T16:45:14.930860+0000","last_fullsized":"2024-05-30T16:45:14.930860+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:48.466250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783298+0000","last_change":"2024-05-30T16:45:11.777177+0000","last_active":"2024-05-30T16:45:12.783298+0000","last_peered":"2024-05-30T16:45:12.783298+0000","last_clean":"2024-05-30T16:45:12.783298+0000","last_became_active":"2024-05-30T16:45:11.776863+0000","last_became_peered":"2024-05-30T16:45:11.776863+0000","last_unstale":"2024-05-30T16:45:12.783298+0000","last_undegraded":"2024-05-30T16:45:12.783298+0000","last_fullsized":"2024-05-30T16:45:12.783298+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:40.600928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781026+0000","last_change":"2024-05-30T16:45:11.764941+0000","last_active":"2024-05-30T16:45:12.781026+0000","last_peered":"2024-05-30T16:45:12.781026+0000","last_clean":"2024-05-30T16:45:12.781026+0000","last_became_active":"2024-05-30T16:45:11.764695+0000","last_became_peered":"2024-05-30T16:45:11.764695+0000","last_unstale":"2024-05-30T16:45:12.781026+0000","last_undegraded":"2024-05-30T16:45:12.781026+0000","last_fullsized":"2024-05-30T16:45:12.781026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:03.283002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532810+0000","last_change":"2024-05-30T16:45:11.768793+0000","last_active":"2024-05-30T16:45:15.532810+0000","last_peered":"2024-05-30T16:45:15.532810+0000","last_clean":"2024-05-30T16:45:15.532810+0000","last_became_active":"2024-05-30T16:45:11.768527+0000","last_became_peered":"2024-05-30T16:45:11.768527+0000","last_unstale":"2024-05-30T16:45:15.532810+0000","last_undegraded":"2024-05-30T16:45:15.532810+0000","last_fullsized":"2024-05-30T16:45:15.532810+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:02.656592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.938018+0000","last_change":"2024-05-30T16:45:11.772776+0000","last_active":"2024-05-30T16:45:14.938018+0000","last_peered":"2024-05-30T16:45:14.938018+0000","last_clean":"2024-05-30T16:45:14.938018+0000","last_became_active":"2024-05-30T16:45:11.772471+0000","last_became_peered":"2024-05-30T16:45:11.772471+0000","last_unstale":"2024-05-30T16:45:14.938018+0000","last_undegraded":"2024-05-30T16:45:14.938018+0000","last_fullsized":"2024-05-30T16:45:14.938018+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:25.378572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999374+0000","last_change":"2024-05-30T16:45:11.781045+0000","last_active":"2024-05-30T16:45:13.999374+0000","last_peered":"2024-05-30T16:45:13.999374+0000","last_clean":"2024-05-30T16:45:13.999374+0000","last_became_active":"2024-05-30T16:45:11.780690+0000","last_became_peered":"2024-05-30T16:45:11.780690+0000","last_unstale":"2024-05-30T16:45:13.999374+0000","last_undegraded":"2024-05-30T16:45:13.999374+0000","last_fullsized":"2024-05-30T16:45:13.999374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:16.778711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533775+0000","last_change":"2024-05-30T16:45:10.766067+0000","last_active":"2024-05-30T16:45:15.533775+0000","last_peered":"2024-05-30T16:45:15.533775+0000","last_clean":"2024-05-30T16:45:15.533775+0000","last_became_active":"2024-05-30T16:45:10.765776+0000","last_became_peered":"2024-05-30T16:45:10.765776+0000","last_unstale":"2024-05-30T16:45:15.533775+0000","last_undegraded":"2024-05-30T16:45:15.533775+0000","last_fullsized":"2024-05-30T16:45:15.533775+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:02.386924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783921+0000","last_change":"2024-05-30T16:45:11.765797+0000","last_active":"2024-05-30T16:45:12.783921+0000","last_peered":"2024-05-30T16:45:12.783921+0000","last_clean":"2024-05-30T16:45:12.783921+0000","last_became_active":"2024-05-30T16:45:11.765258+0000","last_became_peered":"2024-05-30T16:45:11.765258+0000","last_unstale":"2024-05-30T16:45:12.783921+0000","last_undegraded":"2024-05-30T16:45:12.783921+0000","last_fullsized":"2024-05-30T16:45:12.783921+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:01.975525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780484+0000","last_change":"2024-05-30T16:45:10.768779+0000","last_active":"2024-05-30T16:45:12.780484+0000","last_peered":"2024-05-30T16:45:12.780484+0000","last_clean":"2024-05-30T16:45:12.780484+0000","last_became_active":"2024-05-30T16:45:10.768305+0000","last_became_peered":"2024-05-30T16:45:10.768305+0000","last_unstale":"2024-05-30T16:45:12.780484+0000","last_undegraded":"2024-05-30T16:45:12.780484+0000","last_fullsized":"2024-05-30T16:45:12.780484+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:37:20.977384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930892+0000","last_change":"2024-05-30T16:45:11.779547+0000","last_active":"2024-05-30T16:45:14.930892+0000","last_peered":"2024-05-30T16:45:14.930892+0000","last_clean":"2024-05-30T16:45:14.930892+0000","last_became_active":"2024-05-30T16:45:11.778569+0000","last_became_peered":"2024-05-30T16:45:11.778569+0000","last_unstale":"2024-05-30T16:45:14.930892+0000","last_undegraded":"2024-05-30T16:45:14.930892+0000","last_fullsized":"2024-05-30T16:45:14.930892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:29.294320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999634+0000","last_change":"2024-05-30T16:45:10.756443+0000","last_active":"2024-05-30T16:45:13.999634+0000","last_peered":"2024-05-30T16:45:13.999634+0000","last_clean":"2024-05-30T16:45:13.999634+0000","last_became_active":"2024-05-30T16:45:10.756083+0000","last_became_peered":"2024-05-30T16:45:10.756083+0000","last_unstale":"2024-05-30T16:45:13.999634+0000","last_undegraded":"2024-05-30T16:45:13.999634+0000","last_fullsized":"2024-05-30T16:45:13.999634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:34.720234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999653+0000","last_change":"2024-05-30T16:45:11.773822+0000","last_active":"2024-05-30T16:45:13.999653+0000","last_peered":"2024-05-30T16:45:13.999653+0000","last_clean":"2024-05-30T16:45:13.999653+0000","last_became_active":"2024-05-30T16:45:11.773471+0000","last_became_peered":"2024-05-30T16:45:11.773471+0000","last_unstale":"2024-05-30T16:45:13.999653+0000","last_undegraded":"2024-05-30T16:45:13.999653+0000","last_fullsized":"2024-05-30T16:45:13.999653+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:25.152187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780001+0000","last_change":"2024-05-30T16:45:10.766931+0000","last_active":"2024-05-30T16:45:12.780001+0000","last_peered":"2024-05-30T16:45:12.780001+0000","last_clean":"2024-05-30T16:45:12.780001+0000","last_became_active":"2024-05-30T16:45:10.765374+0000","last_became_peered":"2024-05-30T16:45:10.765374+0000","last_unstale":"2024-05-30T16:45:12.780001+0000","last_undegraded":"2024-05-30T16:45:12.780001+0000","last_fullsized":"2024-05-30T16:45:12.780001+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:47.449289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781513+0000","last_change":"2024-05-30T16:45:11.765048+0000","last_active":"2024-05-30T16:45:12.781513+0000","last_peered":"2024-05-30T16:45:12.781513+0000","last_clean":"2024-05-30T16:45:12.781513+0000","last_became_active":"2024-05-30T16:45:11.764770+0000","last_became_peered":"2024-05-30T16:45:11.764770+0000","last_unstale":"2024-05-30T16:45:12.781513+0000","last_undegraded":"2024-05-30T16:45:12.781513+0000","last_fullsized":"2024-05-30T16:45:12.781513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:55.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533332+0000","last_change":"2024-05-30T16:45:10.770495+0000","last_active":"2024-05-30T16:45:15.533332+0000","last_peered":"2024-05-30T16:45:15.533332+0000","last_clean":"2024-05-30T16:45:15.533332+0000","last_became_active":"2024-05-30T16:45:10.770174+0000","last_became_peered":"2024-05-30T16:45:10.770174+0000","last_unstale":"2024-05-30T16:45:15.533332+0000","last_undegraded":"2024-05-30T16:45:15.533332+0000","last_fullsized":"2024-05-30T16:45:15.533332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:02.266042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060369+0000","last_change":"2024-05-30T16:45:11.777829+0000","last_active":"2024-05-30T16:45:15.060369+0000","last_peered":"2024-05-30T16:45:15.060369+0000","last_clean":"2024-05-30T16:45:15.060369+0000","last_became_active":"2024-05-30T16:45:11.777549+0000","last_became_peered":"2024-05-30T16:45:11.777549+0000","last_unstale":"2024-05-30T16:45:15.060369+0000","last_undegraded":"2024-05-30T16:45:15.060369+0000","last_fullsized":"2024-05-30T16:45:15.060369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:04.936343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781366+0000","last_change":"2024-05-30T16:45:10.768994+0000","last_active":"2024-05-30T16:45:12.781366+0000","last_peered":"2024-05-30T16:45:12.781366+0000","last_clean":"2024-05-30T16:45:12.781366+0000","last_became_active":"2024-05-30T16:45:10.767942+0000","last_became_peered":"2024-05-30T16:45:10.767942+0000","last_unstale":"2024-05-30T16:45:12.781366+0000","last_undegraded":"2024-05-30T16:45:12.781366+0000","last_fullsized":"2024-05-30T16:45:12.781366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:44.788791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059609+0000","last_change":"2024-05-30T16:45:11.773427+0000","last_active":"2024-05-30T16:45:15.059609+0000","last_peered":"2024-05-30T16:45:15.059609+0000","last_clean":"2024-05-30T16:45:15.059609+0000","last_became_active":"2024-05-30T16:45:11.771075+0000","last_became_peered":"2024-05-30T16:45:11.771075+0000","last_unstale":"2024-05-30T16:45:15.059609+0000","last_undegraded":"2024-05-30T16:45:15.059609+0000","last_fullsized":"2024-05-30T16:45:15.059609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:25.308089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930172+0000","last_change":"2024-05-30T16:45:10.754920+0000","last_active":"2024-05-30T16:45:14.930172+0000","last_peered":"2024-05-30T16:45:14.930172+0000","last_clean":"2024-05-30T16:45:14.930172+0000","last_became_active":"2024-05-30T16:45:10.754161+0000","last_became_peered":"2024-05-30T16:45:10.754161+0000","last_unstale":"2024-05-30T16:45:14.930172+0000","last_undegraded":"2024-05-30T16:45:14.930172+0000","last_fullsized":"2024-05-30T16:45:14.930172+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:14.199792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.782731+0000","last_change":"2024-05-30T16:45:11.768054+0000","last_active":"2024-05-30T16:45:12.782731+0000","last_peered":"2024-05-30T16:45:12.782731+0000","last_clean":"2024-05-30T16:45:12.782731+0000","last_became_active":"2024-05-30T16:45:11.767795+0000","last_became_peered":"2024-05-30T16:45:11.767795+0000","last_unstale":"2024-05-30T16:45:12.782731+0000","last_undegraded":"2024-05-30T16:45:12.782731+0000","last_fullsized":"2024-05-30T16:45:12.782731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:35.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059851+0000","last_change":"2024-05-30T16:45:10.758450+0000","last_active":"2024-05-30T16:45:15.059851+0000","last_peered":"2024-05-30T16:45:15.059851+0000","last_clean":"2024-05-30T16:45:15.059851+0000","last_became_active":"2024-05-30T16:45:10.758144+0000","last_became_peered":"2024-05-30T16:45:10.758144+0000","last_unstale":"2024-05-30T16:45:15.059851+0000","last_undegraded":"2024-05-30T16:45:15.059851+0000","last_fullsized":"2024-05-30T16:45:15.059851+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:24.361612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780174+0000","last_change":"2024-05-30T16:45:11.777246+0000","last_active":"2024-05-30T16:45:12.780174+0000","last_peered":"2024-05-30T16:45:12.780174+0000","last_clean":"2024-05-30T16:45:12.780174+0000","last_became_active":"2024-05-30T16:45:11.776986+0000","last_became_peered":"2024-05-30T16:45:11.776986+0000","last_unstale":"2024-05-30T16:45:12.780174+0000","last_undegraded":"2024-05-30T16:45:12.780174+0000","last_fullsized":"2024-05-30T16:45:12.780174+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:04.936343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780756+0000","last_change":"2024-05-30T16:45:10.764291+0000","last_active":"2024-05-30T16:45:12.780756+0000","last_peered":"2024-05-30T16:45:12.780756+0000","last_clean":"2024-05-30T16:45:12.780756+0000","last_became_active":"2024-05-30T16:45:10.763905+0000","last_became_peered":"2024-05-30T16:45:10.763905+0000","last_unstale":"2024-05-30T16:45:12.780756+0000","last_undegraded":"2024-05-30T16:45:12.780756+0000","last_fullsized":"2024-05-30T16:45:12.780756+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:54.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781500+0000","last_change":"2024-05-30T16:45:11.771292+0000","last_active":"2024-05-30T16:45:12.781500+0000","last_peered":"2024-05-30T16:45:12.781500+0000","last_clean":"2024-05-30T16:45:12.781500+0000","last_became_active":"2024-05-30T16:45:11.770965+0000","last_became_peered":"2024-05-30T16:45:11.770965+0000","last_unstale":"2024-05-30T16:45:12.781500+0000","last_undegraded":"2024-05-30T16:45:12.781500+0000","last_fullsized":"2024-05-30T16:45:12.781500+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:49:23.495537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061356+0000","last_change":"2024-05-30T16:45:10.764615+0000","last_active":"2024-05-30T16:45:15.061356+0000","last_peered":"2024-05-30T16:45:15.061356+0000","last_clean":"2024-05-30T16:45:15.061356+0000","last_became_active":"2024-05-30T16:45:10.764294+0000","last_became_peered":"2024-05-30T16:45:10.764294+0000","last_unstale":"2024-05-30T16:45:15.061356+0000","last_undegraded":"2024-05-30T16:45:15.061356+0000","last_fullsized":"2024-05-30T16:45:15.061356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:46.498029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533172+0000","last_change":"2024-05-30T16:45:11.779478+0000","last_active":"2024-05-30T16:45:15.533172+0000","last_peered":"2024-05-30T16:45:15.533172+0000","last_clean":"2024-05-30T16:45:15.533172+0000","last_became_active":"2024-05-30T16:45:11.779000+0000","last_became_peered":"2024-05-30T16:45:11.779000+0000","last_unstale":"2024-05-30T16:45:15.533172+0000","last_undegraded":"2024-05-30T16:45:15.533172+0000","last_fullsized":"2024-05-30T16:45:15.533172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:01.903297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779413+0000","last_change":"2024-05-30T16:45:10.770383+0000","last_active":"2024-05-30T16:45:12.779413+0000","last_peered":"2024-05-30T16:45:12.779413+0000","last_clean":"2024-05-30T16:45:12.779413+0000","last_became_active":"2024-05-30T16:45:10.769650+0000","last_became_peered":"2024-05-30T16:45:10.769650+0000","last_unstale":"2024-05-30T16:45:12.779413+0000","last_undegraded":"2024-05-30T16:45:12.779413+0000","last_fullsized":"2024-05-30T16:45:12.779413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:09.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778688+0000","last_change":"2024-05-30T16:45:11.777708+0000","last_active":"2024-05-30T16:45:12.778688+0000","last_peered":"2024-05-30T16:45:12.778688+0000","last_clean":"2024-05-30T16:45:12.778688+0000","last_became_active":"2024-05-30T16:45:11.777369+0000","last_became_peered":"2024-05-30T16:45:11.777369+0000","last_unstale":"2024-05-30T16:45:12.778688+0000","last_undegraded":"2024-05-30T16:45:12.778688+0000","last_fullsized":"2024-05-30T16:45:12.778688+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:46.697802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937811+0000","last_change":"2024-05-30T16:45:10.768576+0000","last_active":"2024-05-30T16:45:14.937811+0000","last_peered":"2024-05-30T16:45:14.937811+0000","last_clean":"2024-05-30T16:45:14.937811+0000","last_became_active":"2024-05-30T16:45:10.767860+0000","last_became_peered":"2024-05-30T16:45:10.767860+0000","last_unstale":"2024-05-30T16:45:14.937811+0000","last_undegraded":"2024-05-30T16:45:14.937811+0000","last_fullsized":"2024-05-30T16:45:14.937811+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:54.895555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783354+0000","last_change":"2024-05-30T16:45:11.780806+0000","last_active":"2024-05-30T16:45:12.783354+0000","last_peered":"2024-05-30T16:45:12.783354+0000","last_clean":"2024-05-30T16:45:12.783354+0000","last_became_active":"2024-05-30T16:45:11.780408+0000","last_became_peered":"2024-05-30T16:45:11.780408+0000","last_unstale":"2024-05-30T16:45:12.783354+0000","last_undegraded":"2024-05-30T16:45:12.783354+0000","last_fullsized":"2024-05-30T16:45:12.783354+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:57.709263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533332+0000","last_change":"2024-05-30T16:45:10.758714+0000","last_active":"2024-05-30T16:45:15.533332+0000","last_peered":"2024-05-30T16:45:15.533332+0000","last_clean":"2024-05-30T16:45:15.533332+0000","last_became_active":"2024-05-30T16:45:10.758428+0000","last_became_peered":"2024-05-30T16:45:10.758428+0000","last_unstale":"2024-05-30T16:45:15.533332+0000","last_undegraded":"2024-05-30T16:45:15.533332+0000","last_fullsized":"2024-05-30T16:45:15.533332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:54.903496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060711+0000","last_change":"2024-05-30T16:45:11.777233+0000","last_active":"2024-05-30T16:45:15.060711+0000","last_peered":"2024-05-30T16:45:15.060711+0000","last_clean":"2024-05-30T16:45:15.060711+0000","last_became_active":"2024-05-30T16:45:11.776582+0000","last_became_peered":"2024-05-30T16:45:11.776582+0000","last_unstale":"2024-05-30T16:45:15.060711+0000","last_undegraded":"2024-05-30T16:45:15.060711+0000","last_fullsized":"2024-05-30T16:45:15.060711+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:06:25.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779558+0000","last_change":"2024-05-30T16:45:10.767688+0000","last_active":"2024-05-30T16:45:12.779558+0000","last_peered":"2024-05-30T16:45:12.779558+0000","last_clean":"2024-05-30T16:45:12.779558+0000","last_became_active":"2024-05-30T16:45:10.766674+0000","last_became_peered":"2024-05-30T16:45:10.766674+0000","last_unstale":"2024-05-30T16:45:12.779558+0000","last_undegraded":"2024-05-30T16:45:12.779558+0000","last_fullsized":"2024-05-30T16:45:12.779558+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:20:39.065330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533040+0000","last_change":"2024-05-30T16:45:11.770647+0000","last_active":"2024-05-30T16:45:15.533040+0000","last_peered":"2024-05-30T16:45:15.533040+0000","last_clean":"2024-05-30T16:45:15.533040+0000","last_became_active":"2024-05-30T16:45:11.770375+0000","last_became_peered":"2024-05-30T16:45:11.770375+0000","last_unstale":"2024-05-30T16:45:15.533040+0000","last_undegraded":"2024-05-30T16:45:15.533040+0000","last_fullsized":"2024-05-30T16:45:15.533040+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:03:03.315724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532945+0000","last_change":"2024-05-30T16:45:10.760697+0000","last_active":"2024-05-30T16:45:15.532945+0000","last_peered":"2024-05-30T16:45:15.532945+0000","last_clean":"2024-05-30T16:45:15.532945+0000","last_became_active":"2024-05-30T16:45:10.759830+0000","last_became_peered":"2024-05-30T16:45:10.759830+0000","last_unstale":"2024-05-30T16:45:15.532945+0000","last_undegraded":"2024-05-30T16:45:15.532945+0000","last_fullsized":"2024-05-30T16:45:15.532945+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:18.469583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779140+0000","last_change":"2024-05-30T16:45:11.768127+0000","last_active":"2024-05-30T16:45:12.779140+0000","last_peered":"2024-05-30T16:45:12.779140+0000","last_clean":"2024-05-30T16:45:12.779140+0000","last_became_active":"2024-05-30T16:45:11.767805+0000","last_became_peered":"2024-05-30T16:45:11.767805+0000","last_unstale":"2024-05-30T16:45:12.779140+0000","last_undegraded":"2024-05-30T16:45:12.779140+0000","last_fullsized":"2024-05-30T16:45:12.779140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:02.656592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060090+0000","last_change":"2024-05-30T16:45:10.755304+0000","last_active":"2024-05-30T16:45:15.060090+0000","last_peered":"2024-05-30T16:45:15.060090+0000","last_clean":"2024-05-30T16:45:15.060090+0000","last_became_active":"2024-05-30T16:45:10.754993+0000","last_became_peered":"2024-05-30T16:45:10.754993+0000","last_unstale":"2024-05-30T16:45:15.060090+0000","last_undegraded":"2024-05-30T16:45:15.060090+0000","last_fullsized":"2024-05-30T16:45:15.060090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:55:33.726746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937886+0000","last_change":"2024-05-30T16:45:11.769430+0000","last_active":"2024-05-30T16:45:14.937886+0000","last_peered":"2024-05-30T16:45:14.937886+0000","last_clean":"2024-05-30T16:45:14.937886+0000","last_became_active":"2024-05-30T16:45:11.765941+0000","last_became_peered":"2024-05-30T16:45:11.765941+0000","last_unstale":"2024-05-30T16:45:14.937886+0000","last_undegraded":"2024-05-30T16:45:14.937886+0000","last_fullsized":"2024-05-30T16:45:14.937886+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:30.605060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937678+0000","last_change":"2024-05-30T16:45:10.750358+0000","last_active":"2024-05-30T16:45:14.937678+0000","last_peered":"2024-05-30T16:45:14.937678+0000","last_clean":"2024-05-30T16:45:14.937678+0000","last_became_active":"2024-05-30T16:45:10.750034+0000","last_became_peered":"2024-05-30T16:45:10.750034+0000","last_unstale":"2024-05-30T16:45:14.937678+0000","last_undegraded":"2024-05-30T16:45:14.937678+0000","last_fullsized":"2024-05-30T16:45:14.937678+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:09.854664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061469+0000","last_change":"2024-05-30T16:45:11.790391+0000","last_active":"2024-05-30T16:45:15.061469+0000","last_peered":"2024-05-30T16:45:15.061469+0000","last_clean":"2024-05-30T16:45:15.061469+0000","last_became_active":"2024-05-30T16:45:11.790071+0000","last_became_peered":"2024-05-30T16:45:11.790071+0000","last_unstale":"2024-05-30T16:45:15.061469+0000","last_undegraded":"2024-05-30T16:45:15.061469+0000","last_fullsized":"2024-05-30T16:45:15.061469+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:10.583306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780647+0000","last_change":"2024-05-30T16:45:10.769296+0000","last_active":"2024-05-30T16:45:12.780647+0000","last_peered":"2024-05-30T16:45:12.780647+0000","last_clean":"2024-05-30T16:45:12.780647+0000","last_became_active":"2024-05-30T16:45:10.768709+0000","last_became_peered":"2024-05-30T16:45:10.768709+0000","last_unstale":"2024-05-30T16:45:12.780647+0000","last_undegraded":"2024-05-30T16:45:12.780647+0000","last_fullsized":"2024-05-30T16:45:12.780647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:58.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783385+0000","last_change":"2024-05-30T16:45:11.771998+0000","last_active":"2024-05-30T16:45:12.783385+0000","last_peered":"2024-05-30T16:45:12.783385+0000","last_clean":"2024-05-30T16:45:12.783385+0000","last_became_active":"2024-05-30T16:45:11.771688+0000","last_became_peered":"2024-05-30T16:45:11.771688+0000","last_unstale":"2024-05-30T16:45:12.783385+0000","last_undegraded":"2024-05-30T16:45:12.783385+0000","last_fullsized":"2024-05-30T16:45:12.783385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:16.778711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.931163+0000","last_change":"2024-05-30T16:45:10.754747+0000","last_active":"2024-05-30T16:45:14.931163+0000","last_peered":"2024-05-30T16:45:14.931163+0000","last_clean":"2024-05-30T16:45:14.931163+0000","last_became_active":"2024-05-30T16:45:10.754108+0000","last_became_peered":"2024-05-30T16:45:10.754108+0000","last_unstale":"2024-05-30T16:45:14.931163+0000","last_undegraded":"2024-05-30T16:45:14.931163+0000","last_fullsized":"2024-05-30T16:45:14.931163+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:53.622362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783907+0000","last_change":"2024-05-30T16:45:11.777186+0000","last_active":"2024-05-30T16:45:12.783907+0000","last_peered":"2024-05-30T16:45:12.783907+0000","last_clean":"2024-05-30T16:45:12.783907+0000","last_became_active":"2024-05-30T16:45:11.776882+0000","last_became_peered":"2024-05-30T16:45:11.776882+0000","last_unstale":"2024-05-30T16:45:12.783907+0000","last_undegraded":"2024-05-30T16:45:12.783907+0000","last_fullsized":"2024-05-30T16:45:12.783907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:25.308089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533303+0000","last_change":"2024-05-30T16:45:10.766144+0000","last_active":"2024-05-30T16:45:15.533303+0000","last_peered":"2024-05-30T16:45:15.533303+0000","last_clean":"2024-05-30T16:45:15.533303+0000","last_became_active":"2024-05-30T16:45:10.765897+0000","last_became_peered":"2024-05-30T16:45:10.765897+0000","last_unstale":"2024-05-30T16:45:15.533303+0000","last_undegraded":"2024-05-30T16:45:15.533303+0000","last_fullsized":"2024-05-30T16:45:15.533303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:20:39.065330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532835+0000","last_change":"2024-05-30T16:45:11.778936+0000","last_active":"2024-05-30T16:45:15.532835+0000","last_peered":"2024-05-30T16:45:15.532835+0000","last_clean":"2024-05-30T16:45:15.532835+0000","last_became_active":"2024-05-30T16:45:11.778569+0000","last_became_peered":"2024-05-30T16:45:11.778569+0000","last_unstale":"2024-05-30T16:45:15.532835+0000","last_undegraded":"2024-05-30T16:45:15.532835+0000","last_fullsized":"2024-05-30T16:45:15.532835+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:12.055901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533500+0000","last_change":"2024-05-30T16:45:10.764883+0000","last_active":"2024-05-30T16:45:15.533500+0000","last_peered":"2024-05-30T16:45:15.533500+0000","last_clean":"2024-05-30T16:45:15.533500+0000","last_became_active":"2024-05-30T16:45:10.764600+0000","last_became_peered":"2024-05-30T16:45:10.764600+0000","last_unstale":"2024-05-30T16:45:15.533500+0000","last_undegraded":"2024-05-30T16:45:15.533500+0000","last_fullsized":"2024-05-30T16:45:15.533500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:38.358920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999168+0000","last_change":"2024-05-30T16:45:11.774681+0000","last_active":"2024-05-30T16:45:13.999168+0000","last_peered":"2024-05-30T16:45:13.999168+0000","last_clean":"2024-05-30T16:45:13.999168+0000","last_became_active":"2024-05-30T16:45:11.774353+0000","last_became_peered":"2024-05-30T16:45:11.774353+0000","last_unstale":"2024-05-30T16:45:13.999168+0000","last_undegraded":"2024-05-30T16:45:13.999168+0000","last_fullsized":"2024-05-30T16:45:13.999168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:57.709263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930185+0000","last_change":"2024-05-30T16:45:10.764986+0000","last_active":"2024-05-30T16:45:14.930185+0000","last_peered":"2024-05-30T16:45:14.930185+0000","last_clean":"2024-05-30T16:45:14.930185+0000","last_became_active":"2024-05-30T16:45:10.764682+0000","last_became_peered":"2024-05-30T16:45:10.764682+0000","last_unstale":"2024-05-30T16:45:14.930185+0000","last_undegraded":"2024-05-30T16:45:14.930185+0000","last_fullsized":"2024-05-30T16:45:14.930185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:48.106502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937874+0000","last_change":"2024-05-30T16:45:11.767741+0000","last_active":"2024-05-30T16:45:14.937874+0000","last_peered":"2024-05-30T16:45:14.937874+0000","last_clean":"2024-05-30T16:45:14.937874+0000","last_became_active":"2024-05-30T16:45:11.765009+0000","last_became_peered":"2024-05-30T16:45:11.765009+0000","last_unstale":"2024-05-30T16:45:14.937874+0000","last_undegraded":"2024-05-30T16:45:14.937874+0000","last_fullsized":"2024-05-30T16:45:14.937874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:40.769361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059590+0000","last_change":"2024-05-30T16:45:10.764517+0000","last_active":"2024-05-30T16:45:15.059590+0000","last_peered":"2024-05-30T16:45:15.059590+0000","last_clean":"2024-05-30T16:45:15.059590+0000","last_became_active":"2024-05-30T16:45:10.764215+0000","last_became_peered":"2024-05-30T16:45:10.764215+0000","last_unstale":"2024-05-30T16:45:15.059590+0000","last_undegraded":"2024-05-30T16:45:15.059590+0000","last_fullsized":"2024-05-30T16:45:15.059590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:29.588099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060304+0000","last_change":"2024-05-30T16:45:11.781461+0000","last_active":"2024-05-30T16:45:15.060304+0000","last_peered":"2024-05-30T16:45:15.060304+0000","last_clean":"2024-05-30T16:45:15.060304+0000","last_became_active":"2024-05-30T16:45:11.781167+0000","last_became_peered":"2024-05-30T16:45:11.781167+0000","last_unstale":"2024-05-30T16:45:15.060304+0000","last_undegraded":"2024-05-30T16:45:15.060304+0000","last_fullsized":"2024-05-30T16:45:15.060304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:08.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778347+0000","last_change":"2024-05-30T16:45:10.765930+0000","last_active":"2024-05-30T16:45:12.778347+0000","last_peered":"2024-05-30T16:45:12.778347+0000","last_clean":"2024-05-30T16:45:12.778347+0000","last_became_active":"2024-05-30T16:45:10.764672+0000","last_became_peered":"2024-05-30T16:45:10.764672+0000","last_unstale":"2024-05-30T16:45:12.778347+0000","last_undegraded":"2024-05-30T16:45:12.778347+0000","last_fullsized":"2024-05-30T16:45:12.778347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:38.358920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783920+0000","last_change":"2024-05-30T16:45:11.769154+0000","last_active":"2024-05-30T16:45:12.783920+0000","last_peered":"2024-05-30T16:45:12.783920+0000","last_clean":"2024-05-30T16:45:12.783920+0000","last_became_active":"2024-05-30T16:45:11.768785+0000","last_became_peered":"2024-05-30T16:45:11.768785+0000","last_unstale":"2024-05-30T16:45:12.783920+0000","last_undegraded":"2024-05-30T16:45:12.783920+0000","last_fullsized":"2024-05-30T16:45:12.783920+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:31.554668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533397+0000","last_change":"2024-05-30T16:45:10.765742+0000","last_active":"2024-05-30T16:45:15.533397+0000","last_peered":"2024-05-30T16:45:15.533397+0000","last_clean":"2024-05-30T16:45:15.533397+0000","last_became_active":"2024-05-30T16:45:10.765420+0000","last_became_peered":"2024-05-30T16:45:10.765420+0000","last_unstale":"2024-05-30T16:45:15.533397+0000","last_undegraded":"2024-05-30T16:45:15.533397+0000","last_fullsized":"2024-05-30T16:45:15.533397+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:09.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060803+0000","last_change":"2024-05-30T16:45:11.775048+0000","last_active":"2024-05-30T16:45:15.060803+0000","last_peered":"2024-05-30T16:45:15.060803+0000","last_clean":"2024-05-30T16:45:15.060803+0000","last_became_active":"2024-05-30T16:45:11.774598+0000","last_became_peered":"2024-05-30T16:45:11.774598+0000","last_unstale":"2024-05-30T16:45:15.060803+0000","last_undegraded":"2024-05-30T16:45:15.060803+0000","last_fullsized":"2024-05-30T16:45:15.060803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:19.486543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779694+0000","last_change":"2024-05-30T16:45:10.770395+0000","last_active":"2024-05-30T16:45:12.779694+0000","last_peered":"2024-05-30T16:45:12.779694+0000","last_clean":"2024-05-30T16:45:12.779694+0000","last_became_active":"2024-05-30T16:45:10.769101+0000","last_became_peered":"2024-05-30T16:45:10.769101+0000","last_unstale":"2024-05-30T16:45:12.779694+0000","last_undegraded":"2024-05-30T16:45:12.779694+0000","last_fullsized":"2024-05-30T16:45:12.779694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:02.386924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779141+0000","last_change":"2024-05-30T16:45:11.775726+0000","last_active":"2024-05-30T16:45:12.779141+0000","last_peered":"2024-05-30T16:45:12.779141+0000","last_clean":"2024-05-30T16:45:12.779141+0000","last_became_active":"2024-05-30T16:45:11.775314+0000","last_became_peered":"2024-05-30T16:45:11.775314+0000","last_unstale":"2024-05-30T16:45:12.779141+0000","last_undegraded":"2024-05-30T16:45:12.779141+0000","last_fullsized":"2024-05-30T16:45:12.779141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:12.055901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.998873+0000","last_change":"2024-05-30T16:45:10.754966+0000","last_active":"2024-05-30T16:45:13.998873+0000","last_peered":"2024-05-30T16:45:13.998873+0000","last_clean":"2024-05-30T16:45:13.998873+0000","last_became_active":"2024-05-30T16:45:10.754676+0000","last_became_peered":"2024-05-30T16:45:10.754676+0000","last_unstale":"2024-05-30T16:45:13.998873+0000","last_undegraded":"2024-05-30T16:45:13.998873+0000","last_fullsized":"2024-05-30T16:45:13.998873+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:44.788791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533073+0000","last_change":"2024-05-30T16:45:11.779154+0000","last_active":"2024-05-30T16:45:15.533073+0000","last_peered":"2024-05-30T16:45:15.533073+0000","last_clean":"2024-05-30T16:45:15.533073+0000","last_became_active":"2024-05-30T16:45:11.778847+0000","last_became_peered":"2024-05-30T16:45:11.778847+0000","last_unstale":"2024-05-30T16:45:15.533073+0000","last_undegraded":"2024-05-30T16:45:15.533073+0000","last_fullsized":"2024-05-30T16:45:15.533073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:01:07.816774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781786+0000","last_change":"2024-05-30T16:45:10.770655+0000","last_active":"2024-05-30T16:45:12.781786+0000","last_peered":"2024-05-30T16:45:12.781786+0000","last_clean":"2024-05-30T16:45:12.781786+0000","last_became_active":"2024-05-30T16:45:10.770183+0000","last_became_peered":"2024-05-30T16:45:10.770183+0000","last_unstale":"2024-05-30T16:45:12.781786+0000","last_undegraded":"2024-05-30T16:45:12.781786+0000","last_fullsized":"2024-05-30T16:45:12.781786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:49.089323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533243+0000","last_change":"2024-05-30T16:45:11.777452+0000","last_active":"2024-05-30T16:45:15.533243+0000","last_peered":"2024-05-30T16:45:15.533243+0000","last_clean":"2024-05-30T16:45:15.533243+0000","last_became_active":"2024-05-30T16:45:11.777162+0000","last_became_peered":"2024-05-30T16:45:11.777162+0000","last_unstale":"2024-05-30T16:45:15.533243+0000","last_undegraded":"2024-05-30T16:45:15.533243+0000","last_fullsized":"2024-05-30T16:45:15.533243+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:59.650273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781652+0000","last_change":"2024-05-30T16:45:10.766648+0000","last_active":"2024-05-30T16:45:12.781652+0000","last_peered":"2024-05-30T16:45:12.781652+0000","last_clean":"2024-05-30T16:45:12.781652+0000","last_became_active":"2024-05-30T16:45:10.766383+0000","last_became_peered":"2024-05-30T16:45:10.766383+0000","last_unstale":"2024-05-30T16:45:12.781652+0000","last_undegraded":"2024-05-30T16:45:12.781652+0000","last_fullsized":"2024-05-30T16:45:12.781652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:34.720234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930375+0000","last_change":"2024-05-30T16:45:11.771654+0000","last_active":"2024-05-30T16:45:14.930375+0000","last_peered":"2024-05-30T16:45:14.930375+0000","last_clean":"2024-05-30T16:45:14.930375+0000","last_became_active":"2024-05-30T16:45:11.771176+0000","last_became_peered":"2024-05-30T16:45:11.771176+0000","last_unstale":"2024-05-30T16:45:14.930375+0000","last_undegraded":"2024-05-30T16:45:14.930375+0000","last_fullsized":"2024-05-30T16:45:14.930375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:03.403885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999101+0000","last_change":"2024-05-30T16:45:10.762650+0000","last_active":"2024-05-30T16:45:13.999101+0000","last_peered":"2024-05-30T16:45:13.999101+0000","last_clean":"2024-05-30T16:45:13.999101+0000","last_became_active":"2024-05-30T16:45:10.762303+0000","last_became_peered":"2024-05-30T16:45:10.762303+0000","last_unstale":"2024-05-30T16:45:13.999101+0000","last_undegraded":"2024-05-30T16:45:13.999101+0000","last_fullsized":"2024-05-30T16:45:13.999101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:27:52.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778817+0000","last_change":"2024-05-30T16:45:11.776301+0000","last_active":"2024-05-30T16:45:12.778817+0000","last_peered":"2024-05-30T16:45:12.778817+0000","last_clean":"2024-05-30T16:45:12.778817+0000","last_became_active":"2024-05-30T16:45:11.776032+0000","last_became_peered":"2024-05-30T16:45:11.776032+0000","last_unstale":"2024-05-30T16:45:12.778817+0000","last_undegraded":"2024-05-30T16:45:12.778817+0000","last_fullsized":"2024-05-30T16:45:12.778817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:54.639322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060361+0000","last_change":"2024-05-30T16:45:10.756428+0000","last_active":"2024-05-30T16:45:15.060361+0000","last_peered":"2024-05-30T16:45:15.060361+0000","last_clean":"2024-05-30T16:45:15.060361+0000","last_became_active":"2024-05-30T16:45:10.756003+0000","last_became_peered":"2024-05-30T16:45:10.756003+0000","last_unstale":"2024-05-30T16:45:15.060361+0000","last_undegraded":"2024-05-30T16:45:15.060361+0000","last_fullsized":"2024-05-30T16:45:15.060361+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:01:19.722735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061202+0000","last_change":"2024-05-30T16:45:11.767741+0000","last_active":"2024-05-30T16:45:15.061202+0000","last_peered":"2024-05-30T16:45:15.061202+0000","last_clean":"2024-05-30T16:45:15.061202+0000","last_became_active":"2024-05-30T16:45:11.767467+0000","last_became_peered":"2024-05-30T16:45:11.767467+0000","last_unstale":"2024-05-30T16:45:15.061202+0000","last_undegraded":"2024-05-30T16:45:15.061202+0000","last_fullsized":"2024-05-30T16:45:15.061202+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:55.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.931341+0000","last_change":"2024-05-30T16:45:10.756823+0000","last_active":"2024-05-30T16:45:14.931341+0000","last_peered":"2024-05-30T16:45:14.931341+0000","last_clean":"2024-05-30T16:45:14.931341+0000","last_became_active":"2024-05-30T16:45:10.755780+0000","last_became_peered":"2024-05-30T16:45:10.755780+0000","last_unstale":"2024-05-30T16:45:14.931341+0000","last_undegraded":"2024-05-30T16:45:14.931341+0000","last_fullsized":"2024-05-30T16:45:14.931341+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:09.001292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":212,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778644+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:45:12.778644+0000","last_peered":"2024-05-30T16:45:12.778644+0000","last_clean":"2024-05-30T16:45:12.778644+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:45:12.778644+0000","last_undegraded":"2024-05-30T16:45:12.778644+0000","last_fullsized":"2024-05-30T16:45:12.778644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1114112,"data_stored":800449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":210663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":520192,"data_stored":210061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35856,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335984,"statfs":{"total":96636764160,"available":96600047616,"internally_reserved":0,"allocated":528384,"data_stored":211603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":516096,"data_stored":204329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":211625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":520192,"data_stored":210061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1114112,"data_stored":800393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:45:17.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T16:45:17.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.491+0000 7f75ce000640 1 Processor -- start 2024-05-30T16:45:17.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.491+0000 7f75ce000640 1 -- start start 2024-05-30T16:45:17.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.493+0000 7f75ce000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c813f760 0x7f75c806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:17.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.493+0000 7f75ce000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f75c80b5fd0 0x7f75c8142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:17.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.493+0000 7f75ce000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c806ee80 con 0x7f75c80cec70 2024-05-30T16:45:17.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.493+0000 7f75ce000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f75c81612b0 con 0x7f75c80b5fd0 2024-05-30T16:45:17.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.493+0000 7f75ce000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f75c813fb40 con 0x7f75c813f760 2024-05-30T16:45:17.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.494+0000 7f75c7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c813f760 0x7f75c806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:17.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.494+0000 7f75c7e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f75c80b5fd0 0x7f75c8142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:17.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.494+0000 7f75c7e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f75c80b5fd0 0x7f75c8142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:46580/0 (socket says 172.21.15.144:46580) 2024-05-30T16:45:17.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.494+0000 7f75c7e00640 1 -- 172.21.15.144:0/4090970701 learned_addr learned my addr 172.21.15.144:0/4090970701 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:17.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.495+0000 7f75c7400640 1 -- 172.21.15.144:0/4090970701 >> v2:172.21.15.149:3300/0 conn(0x7f75c80b5fd0 msgr2=0x7f75c8142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:17.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.495+0000 7f75c7400640 1 --2- 172.21.15.144:0/4090970701 >> v2:172.21.15.149:3300/0 conn(0x7f75c80b5fd0 0x7f75c8142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.495+0000 7f75c7400640 1 -- 172.21.15.144:0/4090970701 >> v1:172.21.15.149:6789/0 conn(0x7f75c80cec70 legacy=0x7f75c80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:17.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.495+0000 7f75c7400640 1 -- 172.21.15.144:0/4090970701 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c8160730 con 0x7f75c813f760 2024-05-30T16:45:17.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.496+0000 7f75c7400640 1 --2- 172.21.15.144:0/4090970701 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c813f760 0x7f75c806e940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75b80097a0 tx=0x7f75b802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dd11aeb9f3af9a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:17.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.497+0000 7f75c6a00640 1 -- 172.21.15.144:0/4090970701 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8037070 con 0x7f75c813f760 2024-05-30T16:45:17.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.497+0000 7f75c6a00640 1 -- 172.21.15.144:0/4090970701 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b8032440 con 0x7f75c813f760 2024-05-30T16:45:17.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.497+0000 7f75c6a00640 1 -- 172.21.15.144:0/4090970701 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8032810 con 0x7f75c813f760 2024-05-30T16:45:17.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.497+0000 7f75ce000640 1 -- 172.21.15.144:0/4090970701 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c813f760 msgr2=0x7f75c806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:17.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.497+0000 7f75ce000640 1 --2- 172.21.15.144:0/4090970701 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c813f760 0x7f75c806e940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75b80097a0 tx=0x7f75b802a210 comp rx=0 tx=0).stop 2024-05-30T16:45:17.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.497+0000 7f75ce000640 1 -- 172.21.15.144:0/4090970701 shutdown_connections 2024-05-30T16:45:17.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.497+0000 7f75ce000640 1 --2- 172.21.15.144:0/4090970701 >> v2:172.21.15.149:3300/0 conn(0x7f75c80b5fd0 0x7f75c8142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.497+0000 7f75ce000640 1 --2- 172.21.15.144:0/4090970701 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c813f760 0x7f75c806e940 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.497+0000 7f75ce000640 1 -- 172.21.15.144:0/4090970701 >> 172.21.15.144:0/4090970701 conn(0x7f75c806bd00 msgr2=0x7f75c806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:17.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.498+0000 7f75ce000640 1 -- 172.21.15.144:0/4090970701 shutdown_connections 2024-05-30T16:45:17.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.498+0000 7f75ce000640 1 -- 172.21.15.144:0/4090970701 wait complete. 2024-05-30T16:45:17.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.499+0000 7f75ce000640 1 Processor -- start 2024-05-30T16:45:17.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.499+0000 7f75ce000640 1 -- start start 2024-05-30T16:45:17.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.500+0000 7f75ce000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75c80b5fd0 0x7f75c8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:17.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.500+0000 7f75ce000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c80cec70 0x7f75c813d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:17.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.500+0000 7f75ce000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75c813f760 0x7f75c815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:17.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.500+0000 7f75ce000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8160fd0 con 0x7f75c813f760 2024-05-30T16:45:17.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.500+0000 7f75ce000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8160cf0 con 0x7f75c80b5fd0 2024-05-30T16:45:17.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.500+0000 7f75ce000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f75c80cf0d0 con 0x7f75c80cec70 2024-05-30T16:45:17.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75c813f760 0x7f75c815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:17.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75c813f760 0x7f75c815b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46924/0 (socket says 172.21.15.144:46924) 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7e00640 1 -- 172.21.15.144:0/3381649723 learned_addr learned my addr 172.21.15.144:0/3381649723 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7400640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75c80b5fd0 0x7f75c8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75bfe00640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c80cec70 0x7f75c813d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7e00640 1 -- 172.21.15.144:0/3381649723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c80cec70 msgr2=0x7f75c813d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7e00640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c80cec70 0x7f75c813d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7e00640 1 -- 172.21.15.144:0/3381649723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75c80b5fd0 msgr2=0x7f75c8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7e00640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75c80b5fd0 0x7f75c8156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7e00640 1 -- 172.21.15.144:0/3381649723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c81f7cc0 con 0x7f75c813f760 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.501+0000 7f75c7e00640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75c813f760 0x7f75c815b7c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f75c000efc0 tx=0x7f75c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.502+0000 7f75bf400640 1 -- 172.21.15.144:0/3381649723 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c000cd20 con 0x7f75c813f760 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.502+0000 7f75bf400640 1 -- 172.21.15.144:0/3381649723 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c0003990 con 0x7f75c813f760 2024-05-30T16:45:17.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.502+0000 7f75bf400640 1 -- 172.21.15.144:0/3381649723 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0003d80 con 0x7f75c813f760 2024-05-30T16:45:17.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.502+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c81f7f60 con 0x7f75c813f760 2024-05-30T16:45:17.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.502+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c81f8520 con 0x7f75c813f760 2024-05-30T16:45:17.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.503+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c8068b90 con 0x7f75c813f760 2024-05-30T16:45:17.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.504+0000 7f75bf400640 1 -- 172.21.15.144:0/3381649723 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f75c0005d10 con 0x7f75c813f760 2024-05-30T16:45:17.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.505+0000 7f75bf400640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75a406cbf0 0x7f75a406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:17.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.505+0000 7f75bf400640 1 -- 172.21.15.144:0/3381649723 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f75c008c5b0 con 0x7f75c813f760 2024-05-30T16:45:17.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.505+0000 7f75c7400640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75a406cbf0 0x7f75a406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:17.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.506+0000 7f75c7400640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75a406cbf0 0x7f75a406f0b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f75b8034000 tx=0x7f75b802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:17.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.509+0000 7f75bf400640 1 -- 172.21.15.144:0/3381649723 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f75c0022020 con 0x7f75c813f760 2024-05-30T16:45:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.783+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f75c806e560 con 0x7f75c813f760 2024-05-30T16:45:17.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.784+0000 7f75bf400640 1 -- 172.21.15.144:0/3381649723 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1034 (secure 0 0 0) 0x7f75c0010040 con 0x7f75c813f760 2024-05-30T16:45:17.785 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:17.786 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":229,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1717087300,"num_in_osds":8,"osd_in_since":1717087291,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":286056448,"bytes_avail":772808056832,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5235}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-05-30T16:43:46.935941+0000","services":{}},"progress_events":{}} 2024-05-30T16:45:17.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75a406cbf0 msgr2=0x7f75a406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:17.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75a406cbf0 0x7f75a406f0b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f75b8034000 tx=0x7f75b802e000 comp rx=0 tx=0).stop 2024-05-30T16:45:17.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75c813f760 msgr2=0x7f75c815b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:17.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75c813f760 0x7f75c815b7c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f75c000efc0 tx=0x7f75c000c490 comp rx=0 tx=0).stop 2024-05-30T16:45:17.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 shutdown_connections 2024-05-30T16:45:17.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75a406cbf0 0x7f75a406f0b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75c813f760 0x7f75c815b7c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75c80cec70 0x7f75c813d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 --2- 172.21.15.144:0/3381649723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75c80b5fd0 0x7f75c8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:17.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 >> 172.21.15.144:0/3381649723 conn(0x7f75c806bd00 msgr2=0x7f75c813fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:17.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 shutdown_connections 2024-05-30T16:45:17.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:17.787+0000 7f75ce000640 1 -- 172.21.15.144:0/3381649723 wait complete. 2024-05-30T16:45:17.808 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-30T16:45:17.808 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:45:18.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.005+0000 7f4fc1200640 1 Processor -- start 2024-05-30T16:45:18.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.005+0000 7f4fc1200640 1 -- start start 2024-05-30T16:45:18.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.007+0000 7f4fc1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc0cf8b0 0x7f4fbc0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:18.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.007+0000 7f4fc1200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fbc15f780 con 0x7f4fbc0cb2f0 2024-05-30T16:45:18.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.007+0000 7f4fc1200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fbc15fa60 con 0x7f4fbc0caf10 2024-05-30T16:45:18.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.007+0000 7f4fc1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4fbc15fd40 con 0x7f4fbc0cf8b0 2024-05-30T16:45:18.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.007+0000 7f4fb3e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4fbc0cb2f0 0x7f4fbc15c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45438/0 (socket says 172.21.15.144:45438) 2024-05-30T16:45:18.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.007+0000 7f4fb3e00640 1 -- 172.21.15.144:0/2990275411 learned_addr learned my addr 172.21.15.144:0/2990275411 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:18.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.007+0000 7f4fbbe00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc0cf8b0 0x7f4fbc0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266662936 0 0) 0x7f4fbc15f780 con 0x7f4fbc0cb2f0 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa0003520 con 0x7f4fbc0cb2f0 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2211227274 0 0) 0x7f4fa0003520 con 0x7f4fbc0cb2f0 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc0cf8b0 msgr2=0x7f4fbc0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc0cf8b0 0x7f4fbc0b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 >> v1:172.21.15.149:6789/0 conn(0x7f4fbc0caf10 legacy=0x7f4fbc15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc15c950 con 0x7f4fbc0cb2f0 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f4fa4001670 con 0x7f4fbc0cb2f0 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 >> v1:172.21.15.144:6789/0 conn(0x7f4fbc0cb2f0 legacy=0x7f4fbc15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc0cf8b0 0x7f4fa00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa0003fb0 0x7f4fa0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0004d40 0x7f4fa00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc15fd40 con 0x7f4fa0003fb0 2024-05-30T16:45:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa000bb00 con 0x7f4fa0004d40 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa000bd00 con 0x7f4fbc0cf8b0 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.008+0000 7f4fb3e00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa0003fb0 0x7f4fa0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.009+0000 7f4fbbe00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0004d40 0x7f4fa00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.009+0000 7f4fbb400640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc0cf8b0 0x7f4fa00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.009+0000 7f4fb3e00640 1 -- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc0cf8b0 msgr2=0x7f4fa00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.009+0000 7f4fb3e00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc0cf8b0 0x7f4fa00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.009+0000 7f4fb3e00640 1 -- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0004d40 msgr2=0x7f4fa00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.009+0000 7f4fb3e00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0004d40 0x7f4fa00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.009+0000 7f4fb3e00640 1 -- 172.21.15.144:0/2990275411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa0003520 con 0x7f4fa0003fb0 2024-05-30T16:45:18.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.009+0000 7f4fbbe00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0004d40 0x7f4fa00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:18.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.010+0000 7f4fb3e00640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa0003fb0 0x7f4fa0004800 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4007fd0 tx=0x7f4fa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b08baea882dcdbb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:18.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.010+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4007c20 con 0x7f4fa0003fb0 2024-05-30T16:45:18.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.010+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa4005af0 con 0x7f4fa0003fb0 2024-05-30T16:45:18.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.010+0000 7f4fbaa00640 1 -- 172.21.15.144:0/2990275411 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4007070 con 0x7f4fa0003fb0 2024-05-30T16:45:18.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.011+0000 7f4fc1200640 1 -- 172.21.15.144:0/2990275411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa0003fb0 msgr2=0x7f4fa0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:18.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.011+0000 7f4fc1200640 1 --2- 172.21.15.144:0/2990275411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa0003fb0 0x7f4fa0004800 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4007fd0 tx=0x7f4fa0005830 comp rx=0 tx=0).stop 2024-05-30T16:45:18.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.011+0000 7f4fbbe00640 1 -- 172.21.15.144:0/2990275411 reap_dead start 2024-05-30T16:45:18.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.011+0000 7f4fc1200640 1 -- 172.21.15.144:0/2990275411 shutdown_connections 2024-05-30T16:45:18.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.011+0000 7f4fc1200640 1 -- 172.21.15.144:0/2990275411 >> 172.21.15.144:0/2990275411 conn(0x7f4fbc0b20a0 msgr2=0x7f4fbc0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:18.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.011+0000 7f4fc1200640 1 -- 172.21.15.144:0/2990275411 shutdown_connections 2024-05-30T16:45:18.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.011+0000 7f4fc1200640 1 -- 172.21.15.144:0/2990275411 wait complete. 2024-05-30T16:45:18.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.013+0000 7f4fc1200640 1 Processor -- start 2024-05-30T16:45:18.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.013+0000 7f4fc1200640 1 -- start start 2024-05-30T16:45:18.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.014+0000 7f4fc1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0003fb0 0x7f4fbc09a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:18.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.014+0000 7f4fc1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fbc146610 0x7f4fbc09abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:18.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.014+0000 7f4fc1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc09b100 0x7f4fbc1f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:18.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.014+0000 7f4fc1200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc0b3340 con 0x7f4fbc146610 2024-05-30T16:45:18.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.014+0000 7f4fc1200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc0b31c0 con 0x7f4fa0003fb0 2024-05-30T16:45:18.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.014+0000 7f4fc1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4fbc0b34c0 con 0x7f4fbc09b100 2024-05-30T16:45:18.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.014+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fbc146610 0x7f4fbc09abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:18.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.014+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fbc146610 0x7f4fbc09abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46948/0 (socket says 172.21.15.144:46948) 2024-05-30T16:45:18.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.014+0000 7f4fb3e00640 1 -- 172.21.15.144:0/1722423407 learned_addr learned my addr 172.21.15.144:0/1722423407 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fbbe00640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc09b100 0x7f4fbc1f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fbb400640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0003fb0 0x7f4fbc09a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fb3e00640 1 -- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc09b100 msgr2=0x7f4fbc1f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fb3e00640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc09b100 0x7f4fbc1f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fb3e00640 1 -- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0003fb0 msgr2=0x7f4fbc09a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fb3e00640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0003fb0 0x7f4fbc09a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fb3e00640 1 -- 172.21.15.144:0/1722423407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc09a860 con 0x7f4fbc146610 2024-05-30T16:45:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fbbe00640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc09b100 0x7f4fbc1f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fbb400640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0003fb0 0x7f4fbc09a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fb3e00640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fbc146610 0x7f4fbc09abc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400c0e0 tx=0x7f4fbc15cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fb3400640 1 -- 172.21.15.144:0/1722423407 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4042070 con 0x7f4fbc146610 2024-05-30T16:45:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fb3400640 1 -- 172.21.15.144:0/1722423407 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa4001630 con 0x7f4fbc146610 2024-05-30T16:45:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fb3400640 1 -- 172.21.15.144:0/1722423407 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4037040 con 0x7f4fbc146610 2024-05-30T16:45:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.015+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fbc09d100 con 0x7f4fbc146610 2024-05-30T16:45:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.016+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fbc09d6c0 con 0x7f4fbc146610 2024-05-30T16:45:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.017+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fbc075570 con 0x7f4fbc146610 2024-05-30T16:45:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.018+0000 7f4fb3400640 1 -- 172.21.15.144:0/1722423407 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f4fa4045070 con 0x7f4fbc146610 2024-05-30T16:45:18.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.018+0000 7f4fb3400640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4f9806cbf0 0x7f4f9806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:18.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.019+0000 7f4fb3400640 1 -- 172.21.15.144:0/1722423407 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f4fa40ab780 con 0x7f4fbc146610 2024-05-30T16:45:18.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.019+0000 7f4fbb400640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4f9806cbf0 0x7f4f9806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:18.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.020+0000 7f4fbb400640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4f9806cbf0 0x7f4f9806f0b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4fac001630 tx=0x7f4fac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:18.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.024+0000 7f4fb3400640 1 -- 172.21.15.144:0/1722423407 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4fa4079830 con 0x7f4fbc146610 2024-05-30T16:45:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.222+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4fbc0cf340 con 0x7f4f9806cbf0 2024-05-30T16:45:18.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.240+0000 7f4fb3400640 1 -- 172.21.15.144:0/1722423407 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251960 (secure 0 0 0) 0x7f4fbc0cf340 con 0x7f4f9806cbf0 2024-05-30T16:45:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:18.245 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:45:18.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4f9806cbf0 msgr2=0x7f4f9806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:18.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4f9806cbf0 0x7f4f9806f0b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4fac001630 tx=0x7f4fac009040 comp rx=0 tx=0).stop 2024-05-30T16:45:18.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fbc146610 msgr2=0x7f4fbc09abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:18.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fbc146610 0x7f4fbc09abc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400c0e0 tx=0x7f4fbc15cb20 comp rx=0 tx=0).stop 2024-05-30T16:45:18.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 shutdown_connections 2024-05-30T16:45:18.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4f9806cbf0 0x7f4f9806f0b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:18.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fbc09b100 0x7f4fbc1f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:18.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fbc146610 0x7f4fbc09abc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:18.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 --2- 172.21.15.144:0/1722423407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fa0003fb0 0x7f4fbc09a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:18.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 >> 172.21.15.144:0/1722423407 conn(0x7f4fbc0b20a0 msgr2=0x7f4fbc15d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:18.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 shutdown_connections 2024-05-30T16:45:18.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:18.246+0000 7f4fc1200640 1 -- 172.21.15.144:0/1722423407 wait complete. 2024-05-30T16:45:18.266 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-05-30T16:45:16.966515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279652,"kb_used_data":5244,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754695068,"statfs":{"total":773094113280,"available":772807749632,"internally_reserved":0,"allocated":5369856,"data_stored":2859184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":280874547},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.230639"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781385+0000","last_change":"2024-05-30T16:45:11.768106+0000","last_active":"2024-05-30T16:45:12.781385+0000","last_peered":"2024-05-30T16:45:12.781385+0000","last_clean":"2024-05-30T16:45:12.781385+0000","last_became_active":"2024-05-30T16:45:11.767505+0000","last_became_peered":"2024-05-30T16:45:11.767505+0000","last_unstale":"2024-05-30T16:45:12.781385+0000","last_undegraded":"2024-05-30T16:45:12.781385+0000","last_fullsized":"2024-05-30T16:45:12.781385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:01.134266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.931324+0000","last_change":"2024-05-30T16:45:11.769953+0000","last_active":"2024-05-30T16:45:14.931324+0000","last_peered":"2024-05-30T16:45:14.931324+0000","last_clean":"2024-05-30T16:45:14.931324+0000","last_became_active":"2024-05-30T16:45:11.769517+0000","last_became_peered":"2024-05-30T16:45:11.769517+0000","last_unstale":"2024-05-30T16:45:14.931324+0000","last_undegraded":"2024-05-30T16:45:14.931324+0000","last_fullsized":"2024-05-30T16:45:14.931324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:55:52.454802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779296+0000","last_change":"2024-05-30T16:45:11.773135+0000","last_active":"2024-05-30T16:45:12.779296+0000","last_peered":"2024-05-30T16:45:12.779296+0000","last_clean":"2024-05-30T16:45:12.779296+0000","last_became_active":"2024-05-30T16:45:11.772494+0000","last_became_peered":"2024-05-30T16:45:11.772494+0000","last_unstale":"2024-05-30T16:45:12.779296+0000","last_undegraded":"2024-05-30T16:45:12.779296+0000","last_fullsized":"2024-05-30T16:45:12.779296+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:10.018253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059928+0000","last_change":"2024-05-30T16:45:11.785668+0000","last_active":"2024-05-30T16:45:15.059928+0000","last_peered":"2024-05-30T16:45:15.059928+0000","last_clean":"2024-05-30T16:45:15.059928+0000","last_became_active":"2024-05-30T16:45:11.785347+0000","last_became_peered":"2024-05-30T16:45:11.785347+0000","last_unstale":"2024-05-30T16:45:15.059928+0000","last_undegraded":"2024-05-30T16:45:15.059928+0000","last_fullsized":"2024-05-30T16:45:15.059928+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:54.639322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930381+0000","last_change":"2024-05-30T16:45:11.788227+0000","last_active":"2024-05-30T16:45:14.930381+0000","last_peered":"2024-05-30T16:45:14.930381+0000","last_clean":"2024-05-30T16:45:14.930381+0000","last_became_active":"2024-05-30T16:45:11.787637+0000","last_became_peered":"2024-05-30T16:45:11.787637+0000","last_unstale":"2024-05-30T16:45:14.930381+0000","last_undegraded":"2024-05-30T16:45:14.930381+0000","last_fullsized":"2024-05-30T16:45:14.930381+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:50.106284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532939+0000","last_change":"2024-05-30T16:45:11.778490+0000","last_active":"2024-05-30T16:45:15.532939+0000","last_peered":"2024-05-30T16:45:15.532939+0000","last_clean":"2024-05-30T16:45:15.532939+0000","last_became_active":"2024-05-30T16:45:11.776241+0000","last_became_peered":"2024-05-30T16:45:11.776241+0000","last_unstale":"2024-05-30T16:45:15.532939+0000","last_undegraded":"2024-05-30T16:45:15.532939+0000","last_fullsized":"2024-05-30T16:45:15.532939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:49:23.495537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778674+0000","last_change":"2024-05-30T16:45:11.777655+0000","last_active":"2024-05-30T16:45:12.778674+0000","last_peered":"2024-05-30T16:45:12.778674+0000","last_clean":"2024-05-30T16:45:12.778674+0000","last_became_active":"2024-05-30T16:45:11.777373+0000","last_became_peered":"2024-05-30T16:45:11.777373+0000","last_unstale":"2024-05-30T16:45:12.778674+0000","last_undegraded":"2024-05-30T16:45:12.778674+0000","last_fullsized":"2024-05-30T16:45:12.778674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:05.992912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060109+0000","last_change":"2024-05-30T16:45:11.779281+0000","last_active":"2024-05-30T16:45:15.060109+0000","last_peered":"2024-05-30T16:45:15.060109+0000","last_clean":"2024-05-30T16:45:15.060109+0000","last_became_active":"2024-05-30T16:45:11.779014+0000","last_became_peered":"2024-05-30T16:45:11.779014+0000","last_unstale":"2024-05-30T16:45:15.060109+0000","last_undegraded":"2024-05-30T16:45:15.060109+0000","last_fullsized":"2024-05-30T16:45:15.060109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:10.018253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061303+0000","last_change":"2024-05-30T16:45:11.784152+0000","last_active":"2024-05-30T16:45:15.061303+0000","last_peered":"2024-05-30T16:45:15.061303+0000","last_clean":"2024-05-30T16:45:15.061303+0000","last_became_active":"2024-05-30T16:45:11.782307+0000","last_became_peered":"2024-05-30T16:45:11.782307+0000","last_unstale":"2024-05-30T16:45:15.061303+0000","last_undegraded":"2024-05-30T16:45:15.061303+0000","last_fullsized":"2024-05-30T16:45:15.061303+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:20:40.082290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061248+0000","last_change":"2024-05-30T16:45:11.782161+0000","last_active":"2024-05-30T16:45:15.061248+0000","last_peered":"2024-05-30T16:45:15.061248+0000","last_clean":"2024-05-30T16:45:15.061248+0000","last_became_active":"2024-05-30T16:45:11.778063+0000","last_became_peered":"2024-05-30T16:45:11.778063+0000","last_unstale":"2024-05-30T16:45:15.061248+0000","last_undegraded":"2024-05-30T16:45:15.061248+0000","last_fullsized":"2024-05-30T16:45:15.061248+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:39.375880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060850+0000","last_change":"2024-05-30T16:45:11.784032+0000","last_active":"2024-05-30T16:45:15.060850+0000","last_peered":"2024-05-30T16:45:15.060850+0000","last_clean":"2024-05-30T16:45:15.060850+0000","last_became_active":"2024-05-30T16:45:11.783227+0000","last_became_peered":"2024-05-30T16:45:11.783227+0000","last_unstale":"2024-05-30T16:45:15.060850+0000","last_undegraded":"2024-05-30T16:45:15.060850+0000","last_fullsized":"2024-05-30T16:45:15.060850+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:03.283002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930417+0000","last_change":"2024-05-30T16:45:11.774520+0000","last_active":"2024-05-30T16:45:14.930417+0000","last_peered":"2024-05-30T16:45:14.930417+0000","last_clean":"2024-05-30T16:45:14.930417+0000","last_became_active":"2024-05-30T16:45:11.774226+0000","last_became_peered":"2024-05-30T16:45:11.774226+0000","last_unstale":"2024-05-30T16:45:14.930417+0000","last_undegraded":"2024-05-30T16:45:14.930417+0000","last_fullsized":"2024-05-30T16:45:14.930417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:10.583306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937641+0000","last_change":"2024-05-30T16:45:11.769778+0000","last_active":"2024-05-30T16:45:14.937641+0000","last_peered":"2024-05-30T16:45:14.937641+0000","last_clean":"2024-05-30T16:45:14.937641+0000","last_became_active":"2024-05-30T16:45:11.767992+0000","last_became_peered":"2024-05-30T16:45:11.767992+0000","last_unstale":"2024-05-30T16:45:14.937641+0000","last_undegraded":"2024-05-30T16:45:14.937641+0000","last_fullsized":"2024-05-30T16:45:14.937641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:09.062362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059792+0000","last_change":"2024-05-30T16:45:11.780930+0000","last_active":"2024-05-30T16:45:15.059792+0000","last_peered":"2024-05-30T16:45:15.059792+0000","last_clean":"2024-05-30T16:45:15.059792+0000","last_became_active":"2024-05-30T16:45:11.780622+0000","last_became_peered":"2024-05-30T16:45:11.780622+0000","last_unstale":"2024-05-30T16:45:15.059792+0000","last_undegraded":"2024-05-30T16:45:15.059792+0000","last_fullsized":"2024-05-30T16:45:15.059792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:49.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532846+0000","last_change":"2024-05-30T16:45:11.775855+0000","last_active":"2024-05-30T16:45:15.532846+0000","last_peered":"2024-05-30T16:45:15.532846+0000","last_clean":"2024-05-30T16:45:15.532846+0000","last_became_active":"2024-05-30T16:45:11.775516+0000","last_became_peered":"2024-05-30T16:45:11.775516+0000","last_unstale":"2024-05-30T16:45:15.532846+0000","last_undegraded":"2024-05-30T16:45:15.532846+0000","last_fullsized":"2024-05-30T16:45:15.532846+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:01.134266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.782859+0000","last_change":"2024-05-30T16:45:11.780840+0000","last_active":"2024-05-30T16:45:12.782859+0000","last_peered":"2024-05-30T16:45:12.782859+0000","last_clean":"2024-05-30T16:45:12.782859+0000","last_became_active":"2024-05-30T16:45:11.780478+0000","last_became_peered":"2024-05-30T16:45:11.780478+0000","last_unstale":"2024-05-30T16:45:12.782859+0000","last_undegraded":"2024-05-30T16:45:12.782859+0000","last_fullsized":"2024-05-30T16:45:12.782859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:55.946299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780276+0000","last_change":"2024-05-30T16:45:11.764047+0000","last_active":"2024-05-30T16:45:12.780276+0000","last_peered":"2024-05-30T16:45:12.780276+0000","last_clean":"2024-05-30T16:45:12.780276+0000","last_became_active":"2024-05-30T16:45:11.763608+0000","last_became_peered":"2024-05-30T16:45:11.763608+0000","last_unstale":"2024-05-30T16:45:12.780276+0000","last_undegraded":"2024-05-30T16:45:12.780276+0000","last_fullsized":"2024-05-30T16:45:12.780276+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:19.486543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780175+0000","last_change":"2024-05-30T16:45:11.777212+0000","last_active":"2024-05-30T16:45:12.780175+0000","last_peered":"2024-05-30T16:45:12.780175+0000","last_clean":"2024-05-30T16:45:12.780175+0000","last_became_active":"2024-05-30T16:45:11.776937+0000","last_became_peered":"2024-05-30T16:45:11.776937+0000","last_unstale":"2024-05-30T16:45:12.780175+0000","last_undegraded":"2024-05-30T16:45:12.780175+0000","last_fullsized":"2024-05-30T16:45:12.780175+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:06:25.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.784034+0000","last_change":"2024-05-30T16:45:11.771136+0000","last_active":"2024-05-30T16:45:12.784034+0000","last_peered":"2024-05-30T16:45:12.784034+0000","last_clean":"2024-05-30T16:45:12.784034+0000","last_became_active":"2024-05-30T16:45:11.770211+0000","last_became_peered":"2024-05-30T16:45:11.770211+0000","last_unstale":"2024-05-30T16:45:12.784034+0000","last_undegraded":"2024-05-30T16:45:12.784034+0000","last_fullsized":"2024-05-30T16:45:12.784034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:49.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937923+0000","last_change":"2024-05-30T16:45:11.780305+0000","last_active":"2024-05-30T16:45:14.937923+0000","last_peered":"2024-05-30T16:45:14.937923+0000","last_clean":"2024-05-30T16:45:14.937923+0000","last_became_active":"2024-05-30T16:45:11.780032+0000","last_became_peered":"2024-05-30T16:45:11.780032+0000","last_unstale":"2024-05-30T16:45:14.937923+0000","last_undegraded":"2024-05-30T16:45:14.937923+0000","last_fullsized":"2024-05-30T16:45:14.937923+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:47.514990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533073+0000","last_change":"2024-05-30T16:45:11.773034+0000","last_active":"2024-05-30T16:45:15.533073+0000","last_peered":"2024-05-30T16:45:15.533073+0000","last_clean":"2024-05-30T16:45:15.533073+0000","last_became_active":"2024-05-30T16:45:11.771866+0000","last_became_peered":"2024-05-30T16:45:11.771866+0000","last_unstale":"2024-05-30T16:45:15.533073+0000","last_undegraded":"2024-05-30T16:45:15.533073+0000","last_fullsized":"2024-05-30T16:45:15.533073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:57:15.726673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059890+0000","last_change":"2024-05-30T16:45:11.780307+0000","last_active":"2024-05-30T16:45:15.059890+0000","last_peered":"2024-05-30T16:45:15.059890+0000","last_clean":"2024-05-30T16:45:15.059890+0000","last_became_active":"2024-05-30T16:45:11.780038+0000","last_became_peered":"2024-05-30T16:45:11.780038+0000","last_unstale":"2024-05-30T16:45:15.059890+0000","last_undegraded":"2024-05-30T16:45:15.059890+0000","last_fullsized":"2024-05-30T16:45:15.059890+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:15.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.782877+0000","last_change":"2024-05-30T16:45:11.762458+0000","last_active":"2024-05-30T16:45:12.782877+0000","last_peered":"2024-05-30T16:45:12.782877+0000","last_clean":"2024-05-30T16:45:12.782877+0000","last_became_active":"2024-05-30T16:45:11.762163+0000","last_became_peered":"2024-05-30T16:45:11.762163+0000","last_unstale":"2024-05-30T16:45:12.782877+0000","last_undegraded":"2024-05-30T16:45:12.782877+0000","last_fullsized":"2024-05-30T16:45:12.782877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:37:21.994344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783293+0000","last_change":"2024-05-30T16:45:11.762289+0000","last_active":"2024-05-30T16:45:12.783293+0000","last_peered":"2024-05-30T16:45:12.783293+0000","last_clean":"2024-05-30T16:45:12.783293+0000","last_became_active":"2024-05-30T16:45:11.761972+0000","last_became_peered":"2024-05-30T16:45:11.761972+0000","last_unstale":"2024-05-30T16:45:12.783293+0000","last_undegraded":"2024-05-30T16:45:12.783293+0000","last_fullsized":"2024-05-30T16:45:12.783293+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:59.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783631+0000","last_change":"2024-05-30T16:45:11.773707+0000","last_active":"2024-05-30T16:45:12.783631+0000","last_peered":"2024-05-30T16:45:12.783631+0000","last_clean":"2024-05-30T16:45:12.783631+0000","last_became_active":"2024-05-30T16:45:11.773418+0000","last_became_peered":"2024-05-30T16:45:11.773418+0000","last_unstale":"2024-05-30T16:45:12.783631+0000","last_undegraded":"2024-05-30T16:45:12.783631+0000","last_fullsized":"2024-05-30T16:45:12.783631+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:25.152187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937511+0000","last_change":"2024-05-30T16:45:11.769998+0000","last_active":"2024-05-30T16:45:14.937511+0000","last_peered":"2024-05-30T16:45:14.937511+0000","last_clean":"2024-05-30T16:45:14.937511+0000","last_became_active":"2024-05-30T16:45:11.769749+0000","last_became_peered":"2024-05-30T16:45:11.769749+0000","last_unstale":"2024-05-30T16:45:14.937511+0000","last_undegraded":"2024-05-30T16:45:14.937511+0000","last_fullsized":"2024-05-30T16:45:14.937511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:21.665387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779702+0000","last_change":"2024-05-30T16:45:11.760043+0000","last_active":"2024-05-30T16:45:12.779702+0000","last_peered":"2024-05-30T16:45:12.779702+0000","last_clean":"2024-05-30T16:45:12.779702+0000","last_became_active":"2024-05-30T16:45:11.759749+0000","last_became_peered":"2024-05-30T16:45:11.759749+0000","last_unstale":"2024-05-30T16:45:12.779702+0000","last_undegraded":"2024-05-30T16:45:12.779702+0000","last_fullsized":"2024-05-30T16:45:12.779702+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:08.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930860+0000","last_change":"2024-05-30T16:45:11.774367+0000","last_active":"2024-05-30T16:45:14.930860+0000","last_peered":"2024-05-30T16:45:14.930860+0000","last_clean":"2024-05-30T16:45:14.930860+0000","last_became_active":"2024-05-30T16:45:11.774042+0000","last_became_peered":"2024-05-30T16:45:11.774042+0000","last_unstale":"2024-05-30T16:45:14.930860+0000","last_undegraded":"2024-05-30T16:45:14.930860+0000","last_fullsized":"2024-05-30T16:45:14.930860+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:48.466250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783298+0000","last_change":"2024-05-30T16:45:11.777177+0000","last_active":"2024-05-30T16:45:12.783298+0000","last_peered":"2024-05-30T16:45:12.783298+0000","last_clean":"2024-05-30T16:45:12.783298+0000","last_became_active":"2024-05-30T16:45:11.776863+0000","last_became_peered":"2024-05-30T16:45:11.776863+0000","last_unstale":"2024-05-30T16:45:12.783298+0000","last_undegraded":"2024-05-30T16:45:12.783298+0000","last_fullsized":"2024-05-30T16:45:12.783298+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:40.600928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781026+0000","last_change":"2024-05-30T16:45:11.764941+0000","last_active":"2024-05-30T16:45:12.781026+0000","last_peered":"2024-05-30T16:45:12.781026+0000","last_clean":"2024-05-30T16:45:12.781026+0000","last_became_active":"2024-05-30T16:45:11.764695+0000","last_became_peered":"2024-05-30T16:45:11.764695+0000","last_unstale":"2024-05-30T16:45:12.781026+0000","last_undegraded":"2024-05-30T16:45:12.781026+0000","last_fullsized":"2024-05-30T16:45:12.781026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:03.283002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532810+0000","last_change":"2024-05-30T16:45:11.768793+0000","last_active":"2024-05-30T16:45:15.532810+0000","last_peered":"2024-05-30T16:45:15.532810+0000","last_clean":"2024-05-30T16:45:15.532810+0000","last_became_active":"2024-05-30T16:45:11.768527+0000","last_became_peered":"2024-05-30T16:45:11.768527+0000","last_unstale":"2024-05-30T16:45:15.532810+0000","last_undegraded":"2024-05-30T16:45:15.532810+0000","last_fullsized":"2024-05-30T16:45:15.532810+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:02.656592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.938018+0000","last_change":"2024-05-30T16:45:11.772776+0000","last_active":"2024-05-30T16:45:14.938018+0000","last_peered":"2024-05-30T16:45:14.938018+0000","last_clean":"2024-05-30T16:45:14.938018+0000","last_became_active":"2024-05-30T16:45:11.772471+0000","last_became_peered":"2024-05-30T16:45:11.772471+0000","last_unstale":"2024-05-30T16:45:14.938018+0000","last_undegraded":"2024-05-30T16:45:14.938018+0000","last_fullsized":"2024-05-30T16:45:14.938018+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:25.378572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999374+0000","last_change":"2024-05-30T16:45:11.781045+0000","last_active":"2024-05-30T16:45:13.999374+0000","last_peered":"2024-05-30T16:45:13.999374+0000","last_clean":"2024-05-30T16:45:13.999374+0000","last_became_active":"2024-05-30T16:45:11.780690+0000","last_became_peered":"2024-05-30T16:45:11.780690+0000","last_unstale":"2024-05-30T16:45:13.999374+0000","last_undegraded":"2024-05-30T16:45:13.999374+0000","last_fullsized":"2024-05-30T16:45:13.999374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:16.778711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533775+0000","last_change":"2024-05-30T16:45:10.766067+0000","last_active":"2024-05-30T16:45:15.533775+0000","last_peered":"2024-05-30T16:45:15.533775+0000","last_clean":"2024-05-30T16:45:15.533775+0000","last_became_active":"2024-05-30T16:45:10.765776+0000","last_became_peered":"2024-05-30T16:45:10.765776+0000","last_unstale":"2024-05-30T16:45:15.533775+0000","last_undegraded":"2024-05-30T16:45:15.533775+0000","last_fullsized":"2024-05-30T16:45:15.533775+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:02.386924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783921+0000","last_change":"2024-05-30T16:45:11.765797+0000","last_active":"2024-05-30T16:45:12.783921+0000","last_peered":"2024-05-30T16:45:12.783921+0000","last_clean":"2024-05-30T16:45:12.783921+0000","last_became_active":"2024-05-30T16:45:11.765258+0000","last_became_peered":"2024-05-30T16:45:11.765258+0000","last_unstale":"2024-05-30T16:45:12.783921+0000","last_undegraded":"2024-05-30T16:45:12.783921+0000","last_fullsized":"2024-05-30T16:45:12.783921+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:01.975525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780484+0000","last_change":"2024-05-30T16:45:10.768779+0000","last_active":"2024-05-30T16:45:12.780484+0000","last_peered":"2024-05-30T16:45:12.780484+0000","last_clean":"2024-05-30T16:45:12.780484+0000","last_became_active":"2024-05-30T16:45:10.768305+0000","last_became_peered":"2024-05-30T16:45:10.768305+0000","last_unstale":"2024-05-30T16:45:12.780484+0000","last_undegraded":"2024-05-30T16:45:12.780484+0000","last_fullsized":"2024-05-30T16:45:12.780484+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:37:20.977384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930892+0000","last_change":"2024-05-30T16:45:11.779547+0000","last_active":"2024-05-30T16:45:14.930892+0000","last_peered":"2024-05-30T16:45:14.930892+0000","last_clean":"2024-05-30T16:45:14.930892+0000","last_became_active":"2024-05-30T16:45:11.778569+0000","last_became_peered":"2024-05-30T16:45:11.778569+0000","last_unstale":"2024-05-30T16:45:14.930892+0000","last_undegraded":"2024-05-30T16:45:14.930892+0000","last_fullsized":"2024-05-30T16:45:14.930892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:29.294320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999634+0000","last_change":"2024-05-30T16:45:10.756443+0000","last_active":"2024-05-30T16:45:13.999634+0000","last_peered":"2024-05-30T16:45:13.999634+0000","last_clean":"2024-05-30T16:45:13.999634+0000","last_became_active":"2024-05-30T16:45:10.756083+0000","last_became_peered":"2024-05-30T16:45:10.756083+0000","last_unstale":"2024-05-30T16:45:13.999634+0000","last_undegraded":"2024-05-30T16:45:13.999634+0000","last_fullsized":"2024-05-30T16:45:13.999634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:34.720234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999653+0000","last_change":"2024-05-30T16:45:11.773822+0000","last_active":"2024-05-30T16:45:13.999653+0000","last_peered":"2024-05-30T16:45:13.999653+0000","last_clean":"2024-05-30T16:45:13.999653+0000","last_became_active":"2024-05-30T16:45:11.773471+0000","last_became_peered":"2024-05-30T16:45:11.773471+0000","last_unstale":"2024-05-30T16:45:13.999653+0000","last_undegraded":"2024-05-30T16:45:13.999653+0000","last_fullsized":"2024-05-30T16:45:13.999653+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:25.152187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780001+0000","last_change":"2024-05-30T16:45:10.766931+0000","last_active":"2024-05-30T16:45:12.780001+0000","last_peered":"2024-05-30T16:45:12.780001+0000","last_clean":"2024-05-30T16:45:12.780001+0000","last_became_active":"2024-05-30T16:45:10.765374+0000","last_became_peered":"2024-05-30T16:45:10.765374+0000","last_unstale":"2024-05-30T16:45:12.780001+0000","last_undegraded":"2024-05-30T16:45:12.780001+0000","last_fullsized":"2024-05-30T16:45:12.780001+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:47.449289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781513+0000","last_change":"2024-05-30T16:45:11.765048+0000","last_active":"2024-05-30T16:45:12.781513+0000","last_peered":"2024-05-30T16:45:12.781513+0000","last_clean":"2024-05-30T16:45:12.781513+0000","last_became_active":"2024-05-30T16:45:11.764770+0000","last_became_peered":"2024-05-30T16:45:11.764770+0000","last_unstale":"2024-05-30T16:45:12.781513+0000","last_undegraded":"2024-05-30T16:45:12.781513+0000","last_fullsized":"2024-05-30T16:45:12.781513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:55.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533332+0000","last_change":"2024-05-30T16:45:10.770495+0000","last_active":"2024-05-30T16:45:15.533332+0000","last_peered":"2024-05-30T16:45:15.533332+0000","last_clean":"2024-05-30T16:45:15.533332+0000","last_became_active":"2024-05-30T16:45:10.770174+0000","last_became_peered":"2024-05-30T16:45:10.770174+0000","last_unstale":"2024-05-30T16:45:15.533332+0000","last_undegraded":"2024-05-30T16:45:15.533332+0000","last_fullsized":"2024-05-30T16:45:15.533332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:02.266042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060369+0000","last_change":"2024-05-30T16:45:11.777829+0000","last_active":"2024-05-30T16:45:15.060369+0000","last_peered":"2024-05-30T16:45:15.060369+0000","last_clean":"2024-05-30T16:45:15.060369+0000","last_became_active":"2024-05-30T16:45:11.777549+0000","last_became_peered":"2024-05-30T16:45:11.777549+0000","last_unstale":"2024-05-30T16:45:15.060369+0000","last_undegraded":"2024-05-30T16:45:15.060369+0000","last_fullsized":"2024-05-30T16:45:15.060369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:04.936343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781366+0000","last_change":"2024-05-30T16:45:10.768994+0000","last_active":"2024-05-30T16:45:12.781366+0000","last_peered":"2024-05-30T16:45:12.781366+0000","last_clean":"2024-05-30T16:45:12.781366+0000","last_became_active":"2024-05-30T16:45:10.767942+0000","last_became_peered":"2024-05-30T16:45:10.767942+0000","last_unstale":"2024-05-30T16:45:12.781366+0000","last_undegraded":"2024-05-30T16:45:12.781366+0000","last_fullsized":"2024-05-30T16:45:12.781366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:44.788791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059609+0000","last_change":"2024-05-30T16:45:11.773427+0000","last_active":"2024-05-30T16:45:15.059609+0000","last_peered":"2024-05-30T16:45:15.059609+0000","last_clean":"2024-05-30T16:45:15.059609+0000","last_became_active":"2024-05-30T16:45:11.771075+0000","last_became_peered":"2024-05-30T16:45:11.771075+0000","last_unstale":"2024-05-30T16:45:15.059609+0000","last_undegraded":"2024-05-30T16:45:15.059609+0000","last_fullsized":"2024-05-30T16:45:15.059609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:25.308089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930172+0000","last_change":"2024-05-30T16:45:10.754920+0000","last_active":"2024-05-30T16:45:14.930172+0000","last_peered":"2024-05-30T16:45:14.930172+0000","last_clean":"2024-05-30T16:45:14.930172+0000","last_became_active":"2024-05-30T16:45:10.754161+0000","last_became_peered":"2024-05-30T16:45:10.754161+0000","last_unstale":"2024-05-30T16:45:14.930172+0000","last_undegraded":"2024-05-30T16:45:14.930172+0000","last_fullsized":"2024-05-30T16:45:14.930172+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:14.199792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.782731+0000","last_change":"2024-05-30T16:45:11.768054+0000","last_active":"2024-05-30T16:45:12.782731+0000","last_peered":"2024-05-30T16:45:12.782731+0000","last_clean":"2024-05-30T16:45:12.782731+0000","last_became_active":"2024-05-30T16:45:11.767795+0000","last_became_peered":"2024-05-30T16:45:11.767795+0000","last_unstale":"2024-05-30T16:45:12.782731+0000","last_undegraded":"2024-05-30T16:45:12.782731+0000","last_fullsized":"2024-05-30T16:45:12.782731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:35.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059851+0000","last_change":"2024-05-30T16:45:10.758450+0000","last_active":"2024-05-30T16:45:15.059851+0000","last_peered":"2024-05-30T16:45:15.059851+0000","last_clean":"2024-05-30T16:45:15.059851+0000","last_became_active":"2024-05-30T16:45:10.758144+0000","last_became_peered":"2024-05-30T16:45:10.758144+0000","last_unstale":"2024-05-30T16:45:15.059851+0000","last_undegraded":"2024-05-30T16:45:15.059851+0000","last_fullsized":"2024-05-30T16:45:15.059851+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:24.361612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780174+0000","last_change":"2024-05-30T16:45:11.777246+0000","last_active":"2024-05-30T16:45:12.780174+0000","last_peered":"2024-05-30T16:45:12.780174+0000","last_clean":"2024-05-30T16:45:12.780174+0000","last_became_active":"2024-05-30T16:45:11.776986+0000","last_became_peered":"2024-05-30T16:45:11.776986+0000","last_unstale":"2024-05-30T16:45:12.780174+0000","last_undegraded":"2024-05-30T16:45:12.780174+0000","last_fullsized":"2024-05-30T16:45:12.780174+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:04.936343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780756+0000","last_change":"2024-05-30T16:45:10.764291+0000","last_active":"2024-05-30T16:45:12.780756+0000","last_peered":"2024-05-30T16:45:12.780756+0000","last_clean":"2024-05-30T16:45:12.780756+0000","last_became_active":"2024-05-30T16:45:10.763905+0000","last_became_peered":"2024-05-30T16:45:10.763905+0000","last_unstale":"2024-05-30T16:45:12.780756+0000","last_undegraded":"2024-05-30T16:45:12.780756+0000","last_fullsized":"2024-05-30T16:45:12.780756+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:54.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781500+0000","last_change":"2024-05-30T16:45:11.771292+0000","last_active":"2024-05-30T16:45:12.781500+0000","last_peered":"2024-05-30T16:45:12.781500+0000","last_clean":"2024-05-30T16:45:12.781500+0000","last_became_active":"2024-05-30T16:45:11.770965+0000","last_became_peered":"2024-05-30T16:45:11.770965+0000","last_unstale":"2024-05-30T16:45:12.781500+0000","last_undegraded":"2024-05-30T16:45:12.781500+0000","last_fullsized":"2024-05-30T16:45:12.781500+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:49:23.495537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061356+0000","last_change":"2024-05-30T16:45:10.764615+0000","last_active":"2024-05-30T16:45:15.061356+0000","last_peered":"2024-05-30T16:45:15.061356+0000","last_clean":"2024-05-30T16:45:15.061356+0000","last_became_active":"2024-05-30T16:45:10.764294+0000","last_became_peered":"2024-05-30T16:45:10.764294+0000","last_unstale":"2024-05-30T16:45:15.061356+0000","last_undegraded":"2024-05-30T16:45:15.061356+0000","last_fullsized":"2024-05-30T16:45:15.061356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:46.498029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533172+0000","last_change":"2024-05-30T16:45:11.779478+0000","last_active":"2024-05-30T16:45:15.533172+0000","last_peered":"2024-05-30T16:45:15.533172+0000","last_clean":"2024-05-30T16:45:15.533172+0000","last_became_active":"2024-05-30T16:45:11.779000+0000","last_became_peered":"2024-05-30T16:45:11.779000+0000","last_unstale":"2024-05-30T16:45:15.533172+0000","last_undegraded":"2024-05-30T16:45:15.533172+0000","last_fullsized":"2024-05-30T16:45:15.533172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:01.903297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779413+0000","last_change":"2024-05-30T16:45:10.770383+0000","last_active":"2024-05-30T16:45:12.779413+0000","last_peered":"2024-05-30T16:45:12.779413+0000","last_clean":"2024-05-30T16:45:12.779413+0000","last_became_active":"2024-05-30T16:45:10.769650+0000","last_became_peered":"2024-05-30T16:45:10.769650+0000","last_unstale":"2024-05-30T16:45:12.779413+0000","last_undegraded":"2024-05-30T16:45:12.779413+0000","last_fullsized":"2024-05-30T16:45:12.779413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:09.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778688+0000","last_change":"2024-05-30T16:45:11.777708+0000","last_active":"2024-05-30T16:45:12.778688+0000","last_peered":"2024-05-30T16:45:12.778688+0000","last_clean":"2024-05-30T16:45:12.778688+0000","last_became_active":"2024-05-30T16:45:11.777369+0000","last_became_peered":"2024-05-30T16:45:11.777369+0000","last_unstale":"2024-05-30T16:45:12.778688+0000","last_undegraded":"2024-05-30T16:45:12.778688+0000","last_fullsized":"2024-05-30T16:45:12.778688+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:46.697802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937811+0000","last_change":"2024-05-30T16:45:10.768576+0000","last_active":"2024-05-30T16:45:14.937811+0000","last_peered":"2024-05-30T16:45:14.937811+0000","last_clean":"2024-05-30T16:45:14.937811+0000","last_became_active":"2024-05-30T16:45:10.767860+0000","last_became_peered":"2024-05-30T16:45:10.767860+0000","last_unstale":"2024-05-30T16:45:14.937811+0000","last_undegraded":"2024-05-30T16:45:14.937811+0000","last_fullsized":"2024-05-30T16:45:14.937811+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:54.895555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783354+0000","last_change":"2024-05-30T16:45:11.780806+0000","last_active":"2024-05-30T16:45:12.783354+0000","last_peered":"2024-05-30T16:45:12.783354+0000","last_clean":"2024-05-30T16:45:12.783354+0000","last_became_active":"2024-05-30T16:45:11.780408+0000","last_became_peered":"2024-05-30T16:45:11.780408+0000","last_unstale":"2024-05-30T16:45:12.783354+0000","last_undegraded":"2024-05-30T16:45:12.783354+0000","last_fullsized":"2024-05-30T16:45:12.783354+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:57.709263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533332+0000","last_change":"2024-05-30T16:45:10.758714+0000","last_active":"2024-05-30T16:45:15.533332+0000","last_peered":"2024-05-30T16:45:15.533332+0000","last_clean":"2024-05-30T16:45:15.533332+0000","last_became_active":"2024-05-30T16:45:10.758428+0000","last_became_peered":"2024-05-30T16:45:10.758428+0000","last_unstale":"2024-05-30T16:45:15.533332+0000","last_undegraded":"2024-05-30T16:45:15.533332+0000","last_fullsized":"2024-05-30T16:45:15.533332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:54.903496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060711+0000","last_change":"2024-05-30T16:45:11.777233+0000","last_active":"2024-05-30T16:45:15.060711+0000","last_peered":"2024-05-30T16:45:15.060711+0000","last_clean":"2024-05-30T16:45:15.060711+0000","last_became_active":"2024-05-30T16:45:11.776582+0000","last_became_peered":"2024-05-30T16:45:11.776582+0000","last_unstale":"2024-05-30T16:45:15.060711+0000","last_undegraded":"2024-05-30T16:45:15.060711+0000","last_fullsized":"2024-05-30T16:45:15.060711+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:06:25.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779558+0000","last_change":"2024-05-30T16:45:10.767688+0000","last_active":"2024-05-30T16:45:12.779558+0000","last_peered":"2024-05-30T16:45:12.779558+0000","last_clean":"2024-05-30T16:45:12.779558+0000","last_became_active":"2024-05-30T16:45:10.766674+0000","last_became_peered":"2024-05-30T16:45:10.766674+0000","last_unstale":"2024-05-30T16:45:12.779558+0000","last_undegraded":"2024-05-30T16:45:12.779558+0000","last_fullsized":"2024-05-30T16:45:12.779558+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:20:39.065330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533040+0000","last_change":"2024-05-30T16:45:11.770647+0000","last_active":"2024-05-30T16:45:15.533040+0000","last_peered":"2024-05-30T16:45:15.533040+0000","last_clean":"2024-05-30T16:45:15.533040+0000","last_became_active":"2024-05-30T16:45:11.770375+0000","last_became_peered":"2024-05-30T16:45:11.770375+0000","last_unstale":"2024-05-30T16:45:15.533040+0000","last_undegraded":"2024-05-30T16:45:15.533040+0000","last_fullsized":"2024-05-30T16:45:15.533040+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:03:03.315724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532945+0000","last_change":"2024-05-30T16:45:10.760697+0000","last_active":"2024-05-30T16:45:15.532945+0000","last_peered":"2024-05-30T16:45:15.532945+0000","last_clean":"2024-05-30T16:45:15.532945+0000","last_became_active":"2024-05-30T16:45:10.759830+0000","last_became_peered":"2024-05-30T16:45:10.759830+0000","last_unstale":"2024-05-30T16:45:15.532945+0000","last_undegraded":"2024-05-30T16:45:15.532945+0000","last_fullsized":"2024-05-30T16:45:15.532945+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:18.469583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779140+0000","last_change":"2024-05-30T16:45:11.768127+0000","last_active":"2024-05-30T16:45:12.779140+0000","last_peered":"2024-05-30T16:45:12.779140+0000","last_clean":"2024-05-30T16:45:12.779140+0000","last_became_active":"2024-05-30T16:45:11.767805+0000","last_became_peered":"2024-05-30T16:45:11.767805+0000","last_unstale":"2024-05-30T16:45:12.779140+0000","last_undegraded":"2024-05-30T16:45:12.779140+0000","last_fullsized":"2024-05-30T16:45:12.779140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:02.656592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060090+0000","last_change":"2024-05-30T16:45:10.755304+0000","last_active":"2024-05-30T16:45:15.060090+0000","last_peered":"2024-05-30T16:45:15.060090+0000","last_clean":"2024-05-30T16:45:15.060090+0000","last_became_active":"2024-05-30T16:45:10.754993+0000","last_became_peered":"2024-05-30T16:45:10.754993+0000","last_unstale":"2024-05-30T16:45:15.060090+0000","last_undegraded":"2024-05-30T16:45:15.060090+0000","last_fullsized":"2024-05-30T16:45:15.060090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:55:33.726746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937886+0000","last_change":"2024-05-30T16:45:11.769430+0000","last_active":"2024-05-30T16:45:14.937886+0000","last_peered":"2024-05-30T16:45:14.937886+0000","last_clean":"2024-05-30T16:45:14.937886+0000","last_became_active":"2024-05-30T16:45:11.765941+0000","last_became_peered":"2024-05-30T16:45:11.765941+0000","last_unstale":"2024-05-30T16:45:14.937886+0000","last_undegraded":"2024-05-30T16:45:14.937886+0000","last_fullsized":"2024-05-30T16:45:14.937886+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:30.605060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937678+0000","last_change":"2024-05-30T16:45:10.750358+0000","last_active":"2024-05-30T16:45:14.937678+0000","last_peered":"2024-05-30T16:45:14.937678+0000","last_clean":"2024-05-30T16:45:14.937678+0000","last_became_active":"2024-05-30T16:45:10.750034+0000","last_became_peered":"2024-05-30T16:45:10.750034+0000","last_unstale":"2024-05-30T16:45:14.937678+0000","last_undegraded":"2024-05-30T16:45:14.937678+0000","last_fullsized":"2024-05-30T16:45:14.937678+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:09.854664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061469+0000","last_change":"2024-05-30T16:45:11.790391+0000","last_active":"2024-05-30T16:45:15.061469+0000","last_peered":"2024-05-30T16:45:15.061469+0000","last_clean":"2024-05-30T16:45:15.061469+0000","last_became_active":"2024-05-30T16:45:11.790071+0000","last_became_peered":"2024-05-30T16:45:11.790071+0000","last_unstale":"2024-05-30T16:45:15.061469+0000","last_undegraded":"2024-05-30T16:45:15.061469+0000","last_fullsized":"2024-05-30T16:45:15.061469+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:10.583306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780647+0000","last_change":"2024-05-30T16:45:10.769296+0000","last_active":"2024-05-30T16:45:12.780647+0000","last_peered":"2024-05-30T16:45:12.780647+0000","last_clean":"2024-05-30T16:45:12.780647+0000","last_became_active":"2024-05-30T16:45:10.768709+0000","last_became_peered":"2024-05-30T16:45:10.768709+0000","last_unstale":"2024-05-30T16:45:12.780647+0000","last_undegraded":"2024-05-30T16:45:12.780647+0000","last_fullsized":"2024-05-30T16:45:12.780647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:58.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783385+0000","last_change":"2024-05-30T16:45:11.771998+0000","last_active":"2024-05-30T16:45:12.783385+0000","last_peered":"2024-05-30T16:45:12.783385+0000","last_clean":"2024-05-30T16:45:12.783385+0000","last_became_active":"2024-05-30T16:45:11.771688+0000","last_became_peered":"2024-05-30T16:45:11.771688+0000","last_unstale":"2024-05-30T16:45:12.783385+0000","last_undegraded":"2024-05-30T16:45:12.783385+0000","last_fullsized":"2024-05-30T16:45:12.783385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:16.778711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.931163+0000","last_change":"2024-05-30T16:45:10.754747+0000","last_active":"2024-05-30T16:45:14.931163+0000","last_peered":"2024-05-30T16:45:14.931163+0000","last_clean":"2024-05-30T16:45:14.931163+0000","last_became_active":"2024-05-30T16:45:10.754108+0000","last_became_peered":"2024-05-30T16:45:10.754108+0000","last_unstale":"2024-05-30T16:45:14.931163+0000","last_undegraded":"2024-05-30T16:45:14.931163+0000","last_fullsized":"2024-05-30T16:45:14.931163+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:53.622362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783907+0000","last_change":"2024-05-30T16:45:11.777186+0000","last_active":"2024-05-30T16:45:12.783907+0000","last_peered":"2024-05-30T16:45:12.783907+0000","last_clean":"2024-05-30T16:45:12.783907+0000","last_became_active":"2024-05-30T16:45:11.776882+0000","last_became_peered":"2024-05-30T16:45:11.776882+0000","last_unstale":"2024-05-30T16:45:12.783907+0000","last_undegraded":"2024-05-30T16:45:12.783907+0000","last_fullsized":"2024-05-30T16:45:12.783907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:25.308089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533303+0000","last_change":"2024-05-30T16:45:10.766144+0000","last_active":"2024-05-30T16:45:15.533303+0000","last_peered":"2024-05-30T16:45:15.533303+0000","last_clean":"2024-05-30T16:45:15.533303+0000","last_became_active":"2024-05-30T16:45:10.765897+0000","last_became_peered":"2024-05-30T16:45:10.765897+0000","last_unstale":"2024-05-30T16:45:15.533303+0000","last_undegraded":"2024-05-30T16:45:15.533303+0000","last_fullsized":"2024-05-30T16:45:15.533303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:20:39.065330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532835+0000","last_change":"2024-05-30T16:45:11.778936+0000","last_active":"2024-05-30T16:45:15.532835+0000","last_peered":"2024-05-30T16:45:15.532835+0000","last_clean":"2024-05-30T16:45:15.532835+0000","last_became_active":"2024-05-30T16:45:11.778569+0000","last_became_peered":"2024-05-30T16:45:11.778569+0000","last_unstale":"2024-05-30T16:45:15.532835+0000","last_undegraded":"2024-05-30T16:45:15.532835+0000","last_fullsized":"2024-05-30T16:45:15.532835+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:12.055901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533500+0000","last_change":"2024-05-30T16:45:10.764883+0000","last_active":"2024-05-30T16:45:15.533500+0000","last_peered":"2024-05-30T16:45:15.533500+0000","last_clean":"2024-05-30T16:45:15.533500+0000","last_became_active":"2024-05-30T16:45:10.764600+0000","last_became_peered":"2024-05-30T16:45:10.764600+0000","last_unstale":"2024-05-30T16:45:15.533500+0000","last_undegraded":"2024-05-30T16:45:15.533500+0000","last_fullsized":"2024-05-30T16:45:15.533500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:38.358920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999168+0000","last_change":"2024-05-30T16:45:11.774681+0000","last_active":"2024-05-30T16:45:13.999168+0000","last_peered":"2024-05-30T16:45:13.999168+0000","last_clean":"2024-05-30T16:45:13.999168+0000","last_became_active":"2024-05-30T16:45:11.774353+0000","last_became_peered":"2024-05-30T16:45:11.774353+0000","last_unstale":"2024-05-30T16:45:13.999168+0000","last_undegraded":"2024-05-30T16:45:13.999168+0000","last_fullsized":"2024-05-30T16:45:13.999168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:57.709263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930185+0000","last_change":"2024-05-30T16:45:10.764986+0000","last_active":"2024-05-30T16:45:14.930185+0000","last_peered":"2024-05-30T16:45:14.930185+0000","last_clean":"2024-05-30T16:45:14.930185+0000","last_became_active":"2024-05-30T16:45:10.764682+0000","last_became_peered":"2024-05-30T16:45:10.764682+0000","last_unstale":"2024-05-30T16:45:14.930185+0000","last_undegraded":"2024-05-30T16:45:14.930185+0000","last_fullsized":"2024-05-30T16:45:14.930185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:48.106502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937874+0000","last_change":"2024-05-30T16:45:11.767741+0000","last_active":"2024-05-30T16:45:14.937874+0000","last_peered":"2024-05-30T16:45:14.937874+0000","last_clean":"2024-05-30T16:45:14.937874+0000","last_became_active":"2024-05-30T16:45:11.765009+0000","last_became_peered":"2024-05-30T16:45:11.765009+0000","last_unstale":"2024-05-30T16:45:14.937874+0000","last_undegraded":"2024-05-30T16:45:14.937874+0000","last_fullsized":"2024-05-30T16:45:14.937874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:40.769361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059590+0000","last_change":"2024-05-30T16:45:10.764517+0000","last_active":"2024-05-30T16:45:15.059590+0000","last_peered":"2024-05-30T16:45:15.059590+0000","last_clean":"2024-05-30T16:45:15.059590+0000","last_became_active":"2024-05-30T16:45:10.764215+0000","last_became_peered":"2024-05-30T16:45:10.764215+0000","last_unstale":"2024-05-30T16:45:15.059590+0000","last_undegraded":"2024-05-30T16:45:15.059590+0000","last_fullsized":"2024-05-30T16:45:15.059590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:29.588099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060304+0000","last_change":"2024-05-30T16:45:11.781461+0000","last_active":"2024-05-30T16:45:15.060304+0000","last_peered":"2024-05-30T16:45:15.060304+0000","last_clean":"2024-05-30T16:45:15.060304+0000","last_became_active":"2024-05-30T16:45:11.781167+0000","last_became_peered":"2024-05-30T16:45:11.781167+0000","last_unstale":"2024-05-30T16:45:15.060304+0000","last_undegraded":"2024-05-30T16:45:15.060304+0000","last_fullsized":"2024-05-30T16:45:15.060304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:08.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778347+0000","last_change":"2024-05-30T16:45:10.765930+0000","last_active":"2024-05-30T16:45:12.778347+0000","last_peered":"2024-05-30T16:45:12.778347+0000","last_clean":"2024-05-30T16:45:12.778347+0000","last_became_active":"2024-05-30T16:45:10.764672+0000","last_became_peered":"2024-05-30T16:45:10.764672+0000","last_unstale":"2024-05-30T16:45:12.778347+0000","last_undegraded":"2024-05-30T16:45:12.778347+0000","last_fullsized":"2024-05-30T16:45:12.778347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:38.358920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783920+0000","last_change":"2024-05-30T16:45:11.769154+0000","last_active":"2024-05-30T16:45:12.783920+0000","last_peered":"2024-05-30T16:45:12.783920+0000","last_clean":"2024-05-30T16:45:12.783920+0000","last_became_active":"2024-05-30T16:45:11.768785+0000","last_became_peered":"2024-05-30T16:45:11.768785+0000","last_unstale":"2024-05-30T16:45:12.783920+0000","last_undegraded":"2024-05-30T16:45:12.783920+0000","last_fullsized":"2024-05-30T16:45:12.783920+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:31.554668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533397+0000","last_change":"2024-05-30T16:45:10.765742+0000","last_active":"2024-05-30T16:45:15.533397+0000","last_peered":"2024-05-30T16:45:15.533397+0000","last_clean":"2024-05-30T16:45:15.533397+0000","last_became_active":"2024-05-30T16:45:10.765420+0000","last_became_peered":"2024-05-30T16:45:10.765420+0000","last_unstale":"2024-05-30T16:45:15.533397+0000","last_undegraded":"2024-05-30T16:45:15.533397+0000","last_fullsized":"2024-05-30T16:45:15.533397+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:09.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060803+0000","last_change":"2024-05-30T16:45:11.775048+0000","last_active":"2024-05-30T16:45:15.060803+0000","last_peered":"2024-05-30T16:45:15.060803+0000","last_clean":"2024-05-30T16:45:15.060803+0000","last_became_active":"2024-05-30T16:45:11.774598+0000","last_became_peered":"2024-05-30T16:45:11.774598+0000","last_unstale":"2024-05-30T16:45:15.060803+0000","last_undegraded":"2024-05-30T16:45:15.060803+0000","last_fullsized":"2024-05-30T16:45:15.060803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:19.486543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779694+0000","last_change":"2024-05-30T16:45:10.770395+0000","last_active":"2024-05-30T16:45:12.779694+0000","last_peered":"2024-05-30T16:45:12.779694+0000","last_clean":"2024-05-30T16:45:12.779694+0000","last_became_active":"2024-05-30T16:45:10.769101+0000","last_became_peered":"2024-05-30T16:45:10.769101+0000","last_unstale":"2024-05-30T16:45:12.779694+0000","last_undegraded":"2024-05-30T16:45:12.779694+0000","last_fullsized":"2024-05-30T16:45:12.779694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:02.386924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779141+0000","last_change":"2024-05-30T16:45:11.775726+0000","last_active":"2024-05-30T16:45:12.779141+0000","last_peered":"2024-05-30T16:45:12.779141+0000","last_clean":"2024-05-30T16:45:12.779141+0000","last_became_active":"2024-05-30T16:45:11.775314+0000","last_became_peered":"2024-05-30T16:45:11.775314+0000","last_unstale":"2024-05-30T16:45:12.779141+0000","last_undegraded":"2024-05-30T16:45:12.779141+0000","last_fullsized":"2024-05-30T16:45:12.779141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:12.055901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.998873+0000","last_change":"2024-05-30T16:45:10.754966+0000","last_active":"2024-05-30T16:45:13.998873+0000","last_peered":"2024-05-30T16:45:13.998873+0000","last_clean":"2024-05-30T16:45:13.998873+0000","last_became_active":"2024-05-30T16:45:10.754676+0000","last_became_peered":"2024-05-30T16:45:10.754676+0000","last_unstale":"2024-05-30T16:45:13.998873+0000","last_undegraded":"2024-05-30T16:45:13.998873+0000","last_fullsized":"2024-05-30T16:45:13.998873+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:44.788791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533073+0000","last_change":"2024-05-30T16:45:11.779154+0000","last_active":"2024-05-30T16:45:15.533073+0000","last_peered":"2024-05-30T16:45:15.533073+0000","last_clean":"2024-05-30T16:45:15.533073+0000","last_became_active":"2024-05-30T16:45:11.778847+0000","last_became_peered":"2024-05-30T16:45:11.778847+0000","last_unstale":"2024-05-30T16:45:15.533073+0000","last_undegraded":"2024-05-30T16:45:15.533073+0000","last_fullsized":"2024-05-30T16:45:15.533073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:01:07.816774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781786+0000","last_change":"2024-05-30T16:45:10.770655+0000","last_active":"2024-05-30T16:45:12.781786+0000","last_peered":"2024-05-30T16:45:12.781786+0000","last_clean":"2024-05-30T16:45:12.781786+0000","last_became_active":"2024-05-30T16:45:10.770183+0000","last_became_peered":"2024-05-30T16:45:10.770183+0000","last_unstale":"2024-05-30T16:45:12.781786+0000","last_undegraded":"2024-05-30T16:45:12.781786+0000","last_fullsized":"2024-05-30T16:45:12.781786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:49.089323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533243+0000","last_change":"2024-05-30T16:45:11.777452+0000","last_active":"2024-05-30T16:45:15.533243+0000","last_peered":"2024-05-30T16:45:15.533243+0000","last_clean":"2024-05-30T16:45:15.533243+0000","last_became_active":"2024-05-30T16:45:11.777162+0000","last_became_peered":"2024-05-30T16:45:11.777162+0000","last_unstale":"2024-05-30T16:45:15.533243+0000","last_undegraded":"2024-05-30T16:45:15.533243+0000","last_fullsized":"2024-05-30T16:45:15.533243+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:59.650273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781652+0000","last_change":"2024-05-30T16:45:10.766648+0000","last_active":"2024-05-30T16:45:12.781652+0000","last_peered":"2024-05-30T16:45:12.781652+0000","last_clean":"2024-05-30T16:45:12.781652+0000","last_became_active":"2024-05-30T16:45:10.766383+0000","last_became_peered":"2024-05-30T16:45:10.766383+0000","last_unstale":"2024-05-30T16:45:12.781652+0000","last_undegraded":"2024-05-30T16:45:12.781652+0000","last_fullsized":"2024-05-30T16:45:12.781652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:34.720234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930375+0000","last_change":"2024-05-30T16:45:11.771654+0000","last_active":"2024-05-30T16:45:14.930375+0000","last_peered":"2024-05-30T16:45:14.930375+0000","last_clean":"2024-05-30T16:45:14.930375+0000","last_became_active":"2024-05-30T16:45:11.771176+0000","last_became_peered":"2024-05-30T16:45:11.771176+0000","last_unstale":"2024-05-30T16:45:14.930375+0000","last_undegraded":"2024-05-30T16:45:14.930375+0000","last_fullsized":"2024-05-30T16:45:14.930375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:03.403885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999101+0000","last_change":"2024-05-30T16:45:10.762650+0000","last_active":"2024-05-30T16:45:13.999101+0000","last_peered":"2024-05-30T16:45:13.999101+0000","last_clean":"2024-05-30T16:45:13.999101+0000","last_became_active":"2024-05-30T16:45:10.762303+0000","last_became_peered":"2024-05-30T16:45:10.762303+0000","last_unstale":"2024-05-30T16:45:13.999101+0000","last_undegraded":"2024-05-30T16:45:13.999101+0000","last_fullsized":"2024-05-30T16:45:13.999101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:27:52.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778817+0000","last_change":"2024-05-30T16:45:11.776301+0000","last_active":"2024-05-30T16:45:12.778817+0000","last_peered":"2024-05-30T16:45:12.778817+0000","last_clean":"2024-05-30T16:45:12.778817+0000","last_became_active":"2024-05-30T16:45:11.776032+0000","last_became_peered":"2024-05-30T16:45:11.776032+0000","last_unstale":"2024-05-30T16:45:12.778817+0000","last_undegraded":"2024-05-30T16:45:12.778817+0000","last_fullsized":"2024-05-30T16:45:12.778817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:54.639322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060361+0000","last_change":"2024-05-30T16:45:10.756428+0000","last_active":"2024-05-30T16:45:15.060361+0000","last_peered":"2024-05-30T16:45:15.060361+0000","last_clean":"2024-05-30T16:45:15.060361+0000","last_became_active":"2024-05-30T16:45:10.756003+0000","last_became_peered":"2024-05-30T16:45:10.756003+0000","last_unstale":"2024-05-30T16:45:15.060361+0000","last_undegraded":"2024-05-30T16:45:15.060361+0000","last_fullsized":"2024-05-30T16:45:15.060361+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:01:19.722735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061202+0000","last_change":"2024-05-30T16:45:11.767741+0000","last_active":"2024-05-30T16:45:15.061202+0000","last_peered":"2024-05-30T16:45:15.061202+0000","last_clean":"2024-05-30T16:45:15.061202+0000","last_became_active":"2024-05-30T16:45:11.767467+0000","last_became_peered":"2024-05-30T16:45:11.767467+0000","last_unstale":"2024-05-30T16:45:15.061202+0000","last_undegraded":"2024-05-30T16:45:15.061202+0000","last_fullsized":"2024-05-30T16:45:15.061202+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:55.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.931341+0000","last_change":"2024-05-30T16:45:10.756823+0000","last_active":"2024-05-30T16:45:14.931341+0000","last_peered":"2024-05-30T16:45:14.931341+0000","last_clean":"2024-05-30T16:45:14.931341+0000","last_became_active":"2024-05-30T16:45:10.755780+0000","last_became_peered":"2024-05-30T16:45:10.755780+0000","last_unstale":"2024-05-30T16:45:14.931341+0000","last_undegraded":"2024-05-30T16:45:14.931341+0000","last_fullsized":"2024-05-30T16:45:14.931341+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:09.001292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":212,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778644+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:45:12.778644+0000","last_peered":"2024-05-30T16:45:12.778644+0000","last_clean":"2024-05-30T16:45:12.778644+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:45:12.778644+0000","last_undegraded":"2024-05-30T16:45:12.778644+0000","last_fullsized":"2024-05-30T16:45:12.778644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1114112,"data_stored":800449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":210663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":520192,"data_stored":210061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35856,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335984,"statfs":{"total":96636764160,"available":96600047616,"internally_reserved":0,"allocated":528384,"data_stored":211603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":516096,"data_stored":204329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":211625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":520192,"data_stored":210061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1114112,"data_stored":800393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:45:21.271 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:45:21.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.474+0000 7faeb9000640 1 Processor -- start 2024-05-30T16:45:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.474+0000 7faeb9000640 1 -- start start 2024-05-30T16:45:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.475+0000 7faeb9000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faeb413f760 0x7faeb406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.475+0000 7faeb9000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40b5fd0 0x7faeb4142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.475+0000 7faeb9000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb406ee80 con 0x7faeb40cec70 2024-05-30T16:45:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.475+0000 7faeb9000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faeb41612b0 con 0x7faeb413f760 2024-05-30T16:45:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.475+0000 7faeb9000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faeb413fb40 con 0x7faeb40b5fd0 2024-05-30T16:45:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.476+0000 7faeb1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faeb413f760 0x7faeb406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.476+0000 7faeb1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faeb413f760 0x7faeb406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46952/0 (socket says 172.21.15.144:46952) 2024-05-30T16:45:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.476+0000 7faeb1e00640 1 -- 172.21.15.144:0/94608350 learned_addr learned my addr 172.21.15.144:0/94608350 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.476+0000 7faeb2800640 1 --2- 172.21.15.144:0/94608350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40b5fd0 0x7faeb4142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.476+0000 7faeb1e00640 1 -- 172.21.15.144:0/94608350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40b5fd0 msgr2=0x7faeb4142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.476+0000 7faeb1e00640 1 --2- 172.21.15.144:0/94608350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40b5fd0 0x7faeb4142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.476+0000 7faeb1e00640 1 -- 172.21.15.144:0/94608350 >> v1:172.21.15.149:6789/0 conn(0x7faeb40cec70 legacy=0x7faeb40b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.476+0000 7faeb1e00640 1 -- 172.21.15.144:0/94608350 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb4160730 con 0x7faeb413f760 2024-05-30T16:45:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.476+0000 7faeb2800640 1 --2- 172.21.15.144:0/94608350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40b5fd0 0x7faeb4142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.477+0000 7faeb1e00640 1 --2- 172.21.15.144:0/94608350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb413f760 0x7faeb406e940 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faeb406e8a0 tx=0x7faea402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5443a0caf6d5b8b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.478+0000 7faeb0a00640 1 -- 172.21.15.144:0/94608350 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4037070 con 0x7faeb413f760 2024-05-30T16:45:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.478+0000 7faeb0a00640 1 -- 172.21.15.144:0/94608350 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea4032440 con 0x7faeb413f760 2024-05-30T16:45:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.478+0000 7faeb0a00640 1 -- 172.21.15.144:0/94608350 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4032810 con 0x7faeb413f760 2024-05-30T16:45:21.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.478+0000 7faeb9000640 1 -- 172.21.15.144:0/94608350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb413f760 msgr2=0x7faeb406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:21.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.478+0000 7faeb9000640 1 --2- 172.21.15.144:0/94608350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb413f760 0x7faeb406e940 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faeb406e8a0 tx=0x7faea402a270 comp rx=0 tx=0).stop 2024-05-30T16:45:21.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.478+0000 7faeb9000640 1 -- 172.21.15.144:0/94608350 shutdown_connections 2024-05-30T16:45:21.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.478+0000 7faeb9000640 1 --2- 172.21.15.144:0/94608350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40b5fd0 0x7faeb4142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.478+0000 7faeb9000640 1 --2- 172.21.15.144:0/94608350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb413f760 0x7faeb406e940 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.478+0000 7faeb9000640 1 -- 172.21.15.144:0/94608350 >> 172.21.15.144:0/94608350 conn(0x7faeb406bd00 msgr2=0x7faeb406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:21.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.479+0000 7faeb9000640 1 -- 172.21.15.144:0/94608350 shutdown_connections 2024-05-30T16:45:21.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.479+0000 7faeb9000640 1 -- 172.21.15.144:0/94608350 wait complete. 2024-05-30T16:45:21.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.480+0000 7faeb9000640 1 Processor -- start 2024-05-30T16:45:21.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.480+0000 7faeb9000640 1 -- start start 2024-05-30T16:45:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.481+0000 7faeb9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb40b5fd0 0x7faeb413e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.481+0000 7faeb9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40cec70 0x7faeb4140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.481+0000 7faeb9000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb413f760 0x7faeb4140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.481+0000 7faeb9000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4160fd0 con 0x7faeb40b5fd0 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.481+0000 7faeb9000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4160cf0 con 0x7faeb40cec70 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.481+0000 7faeb9000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faeb40cf0d0 con 0x7faeb413f760 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb40b5fd0 0x7faeb413e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb40b5fd0 0x7faeb413e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46956/0 (socket says 172.21.15.144:46956) 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1e00640 1 -- 172.21.15.144:0/489706275 learned_addr learned my addr 172.21.15.144:0/489706275 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb2800640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb413f760 0x7faeb4140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1e00640 1 -- 172.21.15.144:0/489706275 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb413f760 msgr2=0x7faeb4140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1400640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40cec70 0x7faeb4140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1e00640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb413f760 0x7faeb4140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1e00640 1 -- 172.21.15.144:0/489706275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40cec70 msgr2=0x7faeb4140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1e00640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40cec70 0x7faeb4140530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1e00640 1 -- 172.21.15.144:0/489706275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb4155640 con 0x7faeb40b5fd0 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1400640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40cec70 0x7faeb4140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.482+0000 7faeb1e00640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb40b5fd0 0x7faeb413e980 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faea4000c00 tx=0x7faea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.483+0000 7faeaa000640 1 -- 172.21.15.144:0/489706275 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4041070 con 0x7faeb40b5fd0 2024-05-30T16:45:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.483+0000 7faeaa000640 1 -- 172.21.15.144:0/489706275 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea403c870 con 0x7faeb40b5fd0 2024-05-30T16:45:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.483+0000 7faeaa000640 1 -- 172.21.15.144:0/489706275 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4037040 con 0x7faeb40b5fd0 2024-05-30T16:45:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.483+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb4155920 con 0x7faeb40b5fd0 2024-05-30T16:45:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.483+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb4155ee0 con 0x7faeb40b5fd0 2024-05-30T16:45:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.484+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb4068b90 con 0x7faeb40b5fd0 2024-05-30T16:45:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.485+0000 7faeaa000640 1 -- 172.21.15.144:0/489706275 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7faea4044070 con 0x7faeb40b5fd0 2024-05-30T16:45:21.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.486+0000 7faeaa000640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fae9406cbc0 0x7fae9406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.486+0000 7faeaa000640 1 -- 172.21.15.144:0/489706275 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7faea40acb00 con 0x7faeb40b5fd0 2024-05-30T16:45:21.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.486+0000 7faeb1400640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fae9406cbc0 0x7fae9406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.487+0000 7faeb1400640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fae9406cbc0 0x7fae9406f080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faeb413f4c0 tx=0x7faea0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:21.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.491+0000 7faeaa000640 1 -- 172.21.15.144:0/489706275 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faea407ad50 con 0x7faeb40b5fd0 2024-05-30T16:45:21.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.686+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faeb4075f70 con 0x7fae9406cbc0 2024-05-30T16:45:21.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.702+0000 7faeaa000640 1 -- 172.21.15.144:0/489706275 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251960 (secure 0 0 0) 0x7faea0055850 con 0x7fae9406cbc0 2024-05-30T16:45:21.707 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:45:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fae9406cbc0 msgr2=0x7fae9406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fae9406cbc0 0x7fae9406f080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faeb413f4c0 tx=0x7faea0009040 comp rx=0 tx=0).stop 2024-05-30T16:45:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb40b5fd0 msgr2=0x7faeb413e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb40b5fd0 0x7faeb413e980 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faea4000c00 tx=0x7faea40046c0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 shutdown_connections 2024-05-30T16:45:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fae9406cbc0 0x7fae9406f080 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb413f760 0x7faeb4140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40cec70 0x7faeb4140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 --2- 172.21.15.144:0/489706275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb40b5fd0 0x7faeb413e980 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.707+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 >> 172.21.15.144:0/489706275 conn(0x7faeb406bd00 msgr2=0x7faeb415f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:21.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.708+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 shutdown_connections 2024-05-30T16:45:21.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.708+0000 7faeb9000640 1 -- 172.21.15.144:0/489706275 wait complete. 2024-05-30T16:45:21.727 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-05-30T16:45:20.968306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279652,"kb_used_data":5244,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754695068,"statfs":{"total":773094113280,"available":772807749632,"internally_reserved":0,"allocated":5369856,"data_stored":2859184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":280874547},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.228894"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781385+0000","last_change":"2024-05-30T16:45:11.768106+0000","last_active":"2024-05-30T16:45:12.781385+0000","last_peered":"2024-05-30T16:45:12.781385+0000","last_clean":"2024-05-30T16:45:12.781385+0000","last_became_active":"2024-05-30T16:45:11.767505+0000","last_became_peered":"2024-05-30T16:45:11.767505+0000","last_unstale":"2024-05-30T16:45:12.781385+0000","last_undegraded":"2024-05-30T16:45:12.781385+0000","last_fullsized":"2024-05-30T16:45:12.781385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:01.134266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.931324+0000","last_change":"2024-05-30T16:45:11.769953+0000","last_active":"2024-05-30T16:45:14.931324+0000","last_peered":"2024-05-30T16:45:14.931324+0000","last_clean":"2024-05-30T16:45:14.931324+0000","last_became_active":"2024-05-30T16:45:11.769517+0000","last_became_peered":"2024-05-30T16:45:11.769517+0000","last_unstale":"2024-05-30T16:45:14.931324+0000","last_undegraded":"2024-05-30T16:45:14.931324+0000","last_fullsized":"2024-05-30T16:45:14.931324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:55:52.454802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779296+0000","last_change":"2024-05-30T16:45:11.773135+0000","last_active":"2024-05-30T16:45:12.779296+0000","last_peered":"2024-05-30T16:45:12.779296+0000","last_clean":"2024-05-30T16:45:12.779296+0000","last_became_active":"2024-05-30T16:45:11.772494+0000","last_became_peered":"2024-05-30T16:45:11.772494+0000","last_unstale":"2024-05-30T16:45:12.779296+0000","last_undegraded":"2024-05-30T16:45:12.779296+0000","last_fullsized":"2024-05-30T16:45:12.779296+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:10.018253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059928+0000","last_change":"2024-05-30T16:45:11.785668+0000","last_active":"2024-05-30T16:45:15.059928+0000","last_peered":"2024-05-30T16:45:15.059928+0000","last_clean":"2024-05-30T16:45:15.059928+0000","last_became_active":"2024-05-30T16:45:11.785347+0000","last_became_peered":"2024-05-30T16:45:11.785347+0000","last_unstale":"2024-05-30T16:45:15.059928+0000","last_undegraded":"2024-05-30T16:45:15.059928+0000","last_fullsized":"2024-05-30T16:45:15.059928+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:54.639322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930381+0000","last_change":"2024-05-30T16:45:11.788227+0000","last_active":"2024-05-30T16:45:14.930381+0000","last_peered":"2024-05-30T16:45:14.930381+0000","last_clean":"2024-05-30T16:45:14.930381+0000","last_became_active":"2024-05-30T16:45:11.787637+0000","last_became_peered":"2024-05-30T16:45:11.787637+0000","last_unstale":"2024-05-30T16:45:14.930381+0000","last_undegraded":"2024-05-30T16:45:14.930381+0000","last_fullsized":"2024-05-30T16:45:14.930381+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:50.106284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532939+0000","last_change":"2024-05-30T16:45:11.778490+0000","last_active":"2024-05-30T16:45:15.532939+0000","last_peered":"2024-05-30T16:45:15.532939+0000","last_clean":"2024-05-30T16:45:15.532939+0000","last_became_active":"2024-05-30T16:45:11.776241+0000","last_became_peered":"2024-05-30T16:45:11.776241+0000","last_unstale":"2024-05-30T16:45:15.532939+0000","last_undegraded":"2024-05-30T16:45:15.532939+0000","last_fullsized":"2024-05-30T16:45:15.532939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:49:23.495537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778674+0000","last_change":"2024-05-30T16:45:11.777655+0000","last_active":"2024-05-30T16:45:12.778674+0000","last_peered":"2024-05-30T16:45:12.778674+0000","last_clean":"2024-05-30T16:45:12.778674+0000","last_became_active":"2024-05-30T16:45:11.777373+0000","last_became_peered":"2024-05-30T16:45:11.777373+0000","last_unstale":"2024-05-30T16:45:12.778674+0000","last_undegraded":"2024-05-30T16:45:12.778674+0000","last_fullsized":"2024-05-30T16:45:12.778674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:35:05.992912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060109+0000","last_change":"2024-05-30T16:45:11.779281+0000","last_active":"2024-05-30T16:45:15.060109+0000","last_peered":"2024-05-30T16:45:15.060109+0000","last_clean":"2024-05-30T16:45:15.060109+0000","last_became_active":"2024-05-30T16:45:11.779014+0000","last_became_peered":"2024-05-30T16:45:11.779014+0000","last_unstale":"2024-05-30T16:45:15.060109+0000","last_undegraded":"2024-05-30T16:45:15.060109+0000","last_fullsized":"2024-05-30T16:45:15.060109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:10.018253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061303+0000","last_change":"2024-05-30T16:45:11.784152+0000","last_active":"2024-05-30T16:45:15.061303+0000","last_peered":"2024-05-30T16:45:15.061303+0000","last_clean":"2024-05-30T16:45:15.061303+0000","last_became_active":"2024-05-30T16:45:11.782307+0000","last_became_peered":"2024-05-30T16:45:11.782307+0000","last_unstale":"2024-05-30T16:45:15.061303+0000","last_undegraded":"2024-05-30T16:45:15.061303+0000","last_fullsized":"2024-05-30T16:45:15.061303+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:20:40.082290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061248+0000","last_change":"2024-05-30T16:45:11.782161+0000","last_active":"2024-05-30T16:45:15.061248+0000","last_peered":"2024-05-30T16:45:15.061248+0000","last_clean":"2024-05-30T16:45:15.061248+0000","last_became_active":"2024-05-30T16:45:11.778063+0000","last_became_peered":"2024-05-30T16:45:11.778063+0000","last_unstale":"2024-05-30T16:45:15.061248+0000","last_undegraded":"2024-05-30T16:45:15.061248+0000","last_fullsized":"2024-05-30T16:45:15.061248+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:39.375880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060850+0000","last_change":"2024-05-30T16:45:11.784032+0000","last_active":"2024-05-30T16:45:15.060850+0000","last_peered":"2024-05-30T16:45:15.060850+0000","last_clean":"2024-05-30T16:45:15.060850+0000","last_became_active":"2024-05-30T16:45:11.783227+0000","last_became_peered":"2024-05-30T16:45:11.783227+0000","last_unstale":"2024-05-30T16:45:15.060850+0000","last_undegraded":"2024-05-30T16:45:15.060850+0000","last_fullsized":"2024-05-30T16:45:15.060850+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:03.283002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930417+0000","last_change":"2024-05-30T16:45:11.774520+0000","last_active":"2024-05-30T16:45:14.930417+0000","last_peered":"2024-05-30T16:45:14.930417+0000","last_clean":"2024-05-30T16:45:14.930417+0000","last_became_active":"2024-05-30T16:45:11.774226+0000","last_became_peered":"2024-05-30T16:45:11.774226+0000","last_unstale":"2024-05-30T16:45:14.930417+0000","last_undegraded":"2024-05-30T16:45:14.930417+0000","last_fullsized":"2024-05-30T16:45:14.930417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:10.583306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937641+0000","last_change":"2024-05-30T16:45:11.769778+0000","last_active":"2024-05-30T16:45:14.937641+0000","last_peered":"2024-05-30T16:45:14.937641+0000","last_clean":"2024-05-30T16:45:14.937641+0000","last_became_active":"2024-05-30T16:45:11.767992+0000","last_became_peered":"2024-05-30T16:45:11.767992+0000","last_unstale":"2024-05-30T16:45:14.937641+0000","last_undegraded":"2024-05-30T16:45:14.937641+0000","last_fullsized":"2024-05-30T16:45:14.937641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:09.062362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059792+0000","last_change":"2024-05-30T16:45:11.780930+0000","last_active":"2024-05-30T16:45:15.059792+0000","last_peered":"2024-05-30T16:45:15.059792+0000","last_clean":"2024-05-30T16:45:15.059792+0000","last_became_active":"2024-05-30T16:45:11.780622+0000","last_became_peered":"2024-05-30T16:45:11.780622+0000","last_unstale":"2024-05-30T16:45:15.059792+0000","last_undegraded":"2024-05-30T16:45:15.059792+0000","last_fullsized":"2024-05-30T16:45:15.059792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:49.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532846+0000","last_change":"2024-05-30T16:45:11.775855+0000","last_active":"2024-05-30T16:45:15.532846+0000","last_peered":"2024-05-30T16:45:15.532846+0000","last_clean":"2024-05-30T16:45:15.532846+0000","last_became_active":"2024-05-30T16:45:11.775516+0000","last_became_peered":"2024-05-30T16:45:11.775516+0000","last_unstale":"2024-05-30T16:45:15.532846+0000","last_undegraded":"2024-05-30T16:45:15.532846+0000","last_fullsized":"2024-05-30T16:45:15.532846+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:01.134266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.782859+0000","last_change":"2024-05-30T16:45:11.780840+0000","last_active":"2024-05-30T16:45:12.782859+0000","last_peered":"2024-05-30T16:45:12.782859+0000","last_clean":"2024-05-30T16:45:12.782859+0000","last_became_active":"2024-05-30T16:45:11.780478+0000","last_became_peered":"2024-05-30T16:45:11.780478+0000","last_unstale":"2024-05-30T16:45:12.782859+0000","last_undegraded":"2024-05-30T16:45:12.782859+0000","last_fullsized":"2024-05-30T16:45:12.782859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:55.946299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780276+0000","last_change":"2024-05-30T16:45:11.764047+0000","last_active":"2024-05-30T16:45:12.780276+0000","last_peered":"2024-05-30T16:45:12.780276+0000","last_clean":"2024-05-30T16:45:12.780276+0000","last_became_active":"2024-05-30T16:45:11.763608+0000","last_became_peered":"2024-05-30T16:45:11.763608+0000","last_unstale":"2024-05-30T16:45:12.780276+0000","last_undegraded":"2024-05-30T16:45:12.780276+0000","last_fullsized":"2024-05-30T16:45:12.780276+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:19.486543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780175+0000","last_change":"2024-05-30T16:45:11.777212+0000","last_active":"2024-05-30T16:45:12.780175+0000","last_peered":"2024-05-30T16:45:12.780175+0000","last_clean":"2024-05-30T16:45:12.780175+0000","last_became_active":"2024-05-30T16:45:11.776937+0000","last_became_peered":"2024-05-30T16:45:11.776937+0000","last_unstale":"2024-05-30T16:45:12.780175+0000","last_undegraded":"2024-05-30T16:45:12.780175+0000","last_fullsized":"2024-05-30T16:45:12.780175+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:06:25.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.784034+0000","last_change":"2024-05-30T16:45:11.771136+0000","last_active":"2024-05-30T16:45:12.784034+0000","last_peered":"2024-05-30T16:45:12.784034+0000","last_clean":"2024-05-30T16:45:12.784034+0000","last_became_active":"2024-05-30T16:45:11.770211+0000","last_became_peered":"2024-05-30T16:45:11.770211+0000","last_unstale":"2024-05-30T16:45:12.784034+0000","last_undegraded":"2024-05-30T16:45:12.784034+0000","last_fullsized":"2024-05-30T16:45:12.784034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:49.123462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937923+0000","last_change":"2024-05-30T16:45:11.780305+0000","last_active":"2024-05-30T16:45:14.937923+0000","last_peered":"2024-05-30T16:45:14.937923+0000","last_clean":"2024-05-30T16:45:14.937923+0000","last_became_active":"2024-05-30T16:45:11.780032+0000","last_became_peered":"2024-05-30T16:45:11.780032+0000","last_unstale":"2024-05-30T16:45:14.937923+0000","last_undegraded":"2024-05-30T16:45:14.937923+0000","last_fullsized":"2024-05-30T16:45:14.937923+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:47.514990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533073+0000","last_change":"2024-05-30T16:45:11.773034+0000","last_active":"2024-05-30T16:45:15.533073+0000","last_peered":"2024-05-30T16:45:15.533073+0000","last_clean":"2024-05-30T16:45:15.533073+0000","last_became_active":"2024-05-30T16:45:11.771866+0000","last_became_peered":"2024-05-30T16:45:11.771866+0000","last_unstale":"2024-05-30T16:45:15.533073+0000","last_undegraded":"2024-05-30T16:45:15.533073+0000","last_fullsized":"2024-05-30T16:45:15.533073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:57:15.726673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059890+0000","last_change":"2024-05-30T16:45:11.780307+0000","last_active":"2024-05-30T16:45:15.059890+0000","last_peered":"2024-05-30T16:45:15.059890+0000","last_clean":"2024-05-30T16:45:15.059890+0000","last_became_active":"2024-05-30T16:45:11.780038+0000","last_became_peered":"2024-05-30T16:45:11.780038+0000","last_unstale":"2024-05-30T16:45:15.059890+0000","last_undegraded":"2024-05-30T16:45:15.059890+0000","last_fullsized":"2024-05-30T16:45:15.059890+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:15.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.782877+0000","last_change":"2024-05-30T16:45:11.762458+0000","last_active":"2024-05-30T16:45:12.782877+0000","last_peered":"2024-05-30T16:45:12.782877+0000","last_clean":"2024-05-30T16:45:12.782877+0000","last_became_active":"2024-05-30T16:45:11.762163+0000","last_became_peered":"2024-05-30T16:45:11.762163+0000","last_unstale":"2024-05-30T16:45:12.782877+0000","last_undegraded":"2024-05-30T16:45:12.782877+0000","last_fullsized":"2024-05-30T16:45:12.782877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:37:21.994344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783293+0000","last_change":"2024-05-30T16:45:11.762289+0000","last_active":"2024-05-30T16:45:12.783293+0000","last_peered":"2024-05-30T16:45:12.783293+0000","last_clean":"2024-05-30T16:45:12.783293+0000","last_became_active":"2024-05-30T16:45:11.761972+0000","last_became_peered":"2024-05-30T16:45:11.761972+0000","last_unstale":"2024-05-30T16:45:12.783293+0000","last_undegraded":"2024-05-30T16:45:12.783293+0000","last_fullsized":"2024-05-30T16:45:12.783293+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:59.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783631+0000","last_change":"2024-05-30T16:45:11.773707+0000","last_active":"2024-05-30T16:45:12.783631+0000","last_peered":"2024-05-30T16:45:12.783631+0000","last_clean":"2024-05-30T16:45:12.783631+0000","last_became_active":"2024-05-30T16:45:11.773418+0000","last_became_peered":"2024-05-30T16:45:11.773418+0000","last_unstale":"2024-05-30T16:45:12.783631+0000","last_undegraded":"2024-05-30T16:45:12.783631+0000","last_fullsized":"2024-05-30T16:45:12.783631+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:25.152187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937511+0000","last_change":"2024-05-30T16:45:11.769998+0000","last_active":"2024-05-30T16:45:14.937511+0000","last_peered":"2024-05-30T16:45:14.937511+0000","last_clean":"2024-05-30T16:45:14.937511+0000","last_became_active":"2024-05-30T16:45:11.769749+0000","last_became_peered":"2024-05-30T16:45:11.769749+0000","last_unstale":"2024-05-30T16:45:14.937511+0000","last_undegraded":"2024-05-30T16:45:14.937511+0000","last_fullsized":"2024-05-30T16:45:14.937511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:23:21.665387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779702+0000","last_change":"2024-05-30T16:45:11.760043+0000","last_active":"2024-05-30T16:45:12.779702+0000","last_peered":"2024-05-30T16:45:12.779702+0000","last_clean":"2024-05-30T16:45:12.779702+0000","last_became_active":"2024-05-30T16:45:11.759749+0000","last_became_peered":"2024-05-30T16:45:11.759749+0000","last_unstale":"2024-05-30T16:45:12.779702+0000","last_undegraded":"2024-05-30T16:45:12.779702+0000","last_fullsized":"2024-05-30T16:45:12.779702+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:08.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930860+0000","last_change":"2024-05-30T16:45:11.774367+0000","last_active":"2024-05-30T16:45:14.930860+0000","last_peered":"2024-05-30T16:45:14.930860+0000","last_clean":"2024-05-30T16:45:14.930860+0000","last_became_active":"2024-05-30T16:45:11.774042+0000","last_became_peered":"2024-05-30T16:45:11.774042+0000","last_unstale":"2024-05-30T16:45:14.930860+0000","last_undegraded":"2024-05-30T16:45:14.930860+0000","last_fullsized":"2024-05-30T16:45:14.930860+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:48.466250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783298+0000","last_change":"2024-05-30T16:45:11.777177+0000","last_active":"2024-05-30T16:45:12.783298+0000","last_peered":"2024-05-30T16:45:12.783298+0000","last_clean":"2024-05-30T16:45:12.783298+0000","last_became_active":"2024-05-30T16:45:11.776863+0000","last_became_peered":"2024-05-30T16:45:11.776863+0000","last_unstale":"2024-05-30T16:45:12.783298+0000","last_undegraded":"2024-05-30T16:45:12.783298+0000","last_fullsized":"2024-05-30T16:45:12.783298+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:05:40.600928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781026+0000","last_change":"2024-05-30T16:45:11.764941+0000","last_active":"2024-05-30T16:45:12.781026+0000","last_peered":"2024-05-30T16:45:12.781026+0000","last_clean":"2024-05-30T16:45:12.781026+0000","last_became_active":"2024-05-30T16:45:11.764695+0000","last_became_peered":"2024-05-30T16:45:11.764695+0000","last_unstale":"2024-05-30T16:45:12.781026+0000","last_undegraded":"2024-05-30T16:45:12.781026+0000","last_fullsized":"2024-05-30T16:45:12.781026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:03.283002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532810+0000","last_change":"2024-05-30T16:45:11.768793+0000","last_active":"2024-05-30T16:45:15.532810+0000","last_peered":"2024-05-30T16:45:15.532810+0000","last_clean":"2024-05-30T16:45:15.532810+0000","last_became_active":"2024-05-30T16:45:11.768527+0000","last_became_peered":"2024-05-30T16:45:11.768527+0000","last_unstale":"2024-05-30T16:45:15.532810+0000","last_undegraded":"2024-05-30T16:45:15.532810+0000","last_fullsized":"2024-05-30T16:45:15.532810+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:02.656592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.938018+0000","last_change":"2024-05-30T16:45:11.772776+0000","last_active":"2024-05-30T16:45:14.938018+0000","last_peered":"2024-05-30T16:45:14.938018+0000","last_clean":"2024-05-30T16:45:14.938018+0000","last_became_active":"2024-05-30T16:45:11.772471+0000","last_became_peered":"2024-05-30T16:45:11.772471+0000","last_unstale":"2024-05-30T16:45:14.938018+0000","last_undegraded":"2024-05-30T16:45:14.938018+0000","last_fullsized":"2024-05-30T16:45:14.938018+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:25.378572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999374+0000","last_change":"2024-05-30T16:45:11.781045+0000","last_active":"2024-05-30T16:45:13.999374+0000","last_peered":"2024-05-30T16:45:13.999374+0000","last_clean":"2024-05-30T16:45:13.999374+0000","last_became_active":"2024-05-30T16:45:11.780690+0000","last_became_peered":"2024-05-30T16:45:11.780690+0000","last_unstale":"2024-05-30T16:45:13.999374+0000","last_undegraded":"2024-05-30T16:45:13.999374+0000","last_fullsized":"2024-05-30T16:45:13.999374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:16.778711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533775+0000","last_change":"2024-05-30T16:45:10.766067+0000","last_active":"2024-05-30T16:45:15.533775+0000","last_peered":"2024-05-30T16:45:15.533775+0000","last_clean":"2024-05-30T16:45:15.533775+0000","last_became_active":"2024-05-30T16:45:10.765776+0000","last_became_peered":"2024-05-30T16:45:10.765776+0000","last_unstale":"2024-05-30T16:45:15.533775+0000","last_undegraded":"2024-05-30T16:45:15.533775+0000","last_fullsized":"2024-05-30T16:45:15.533775+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:02.386924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783921+0000","last_change":"2024-05-30T16:45:11.765797+0000","last_active":"2024-05-30T16:45:12.783921+0000","last_peered":"2024-05-30T16:45:12.783921+0000","last_clean":"2024-05-30T16:45:12.783921+0000","last_became_active":"2024-05-30T16:45:11.765258+0000","last_became_peered":"2024-05-30T16:45:11.765258+0000","last_unstale":"2024-05-30T16:45:12.783921+0000","last_undegraded":"2024-05-30T16:45:12.783921+0000","last_fullsized":"2024-05-30T16:45:12.783921+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:37:01.975525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780484+0000","last_change":"2024-05-30T16:45:10.768779+0000","last_active":"2024-05-30T16:45:12.780484+0000","last_peered":"2024-05-30T16:45:12.780484+0000","last_clean":"2024-05-30T16:45:12.780484+0000","last_became_active":"2024-05-30T16:45:10.768305+0000","last_became_peered":"2024-05-30T16:45:10.768305+0000","last_unstale":"2024-05-30T16:45:12.780484+0000","last_undegraded":"2024-05-30T16:45:12.780484+0000","last_fullsized":"2024-05-30T16:45:12.780484+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:37:20.977384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930892+0000","last_change":"2024-05-30T16:45:11.779547+0000","last_active":"2024-05-30T16:45:14.930892+0000","last_peered":"2024-05-30T16:45:14.930892+0000","last_clean":"2024-05-30T16:45:14.930892+0000","last_became_active":"2024-05-30T16:45:11.778569+0000","last_became_peered":"2024-05-30T16:45:11.778569+0000","last_unstale":"2024-05-30T16:45:14.930892+0000","last_undegraded":"2024-05-30T16:45:14.930892+0000","last_fullsized":"2024-05-30T16:45:14.930892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:29.294320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999634+0000","last_change":"2024-05-30T16:45:10.756443+0000","last_active":"2024-05-30T16:45:13.999634+0000","last_peered":"2024-05-30T16:45:13.999634+0000","last_clean":"2024-05-30T16:45:13.999634+0000","last_became_active":"2024-05-30T16:45:10.756083+0000","last_became_peered":"2024-05-30T16:45:10.756083+0000","last_unstale":"2024-05-30T16:45:13.999634+0000","last_undegraded":"2024-05-30T16:45:13.999634+0000","last_fullsized":"2024-05-30T16:45:13.999634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:34.720234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999653+0000","last_change":"2024-05-30T16:45:11.773822+0000","last_active":"2024-05-30T16:45:13.999653+0000","last_peered":"2024-05-30T16:45:13.999653+0000","last_clean":"2024-05-30T16:45:13.999653+0000","last_became_active":"2024-05-30T16:45:11.773471+0000","last_became_peered":"2024-05-30T16:45:11.773471+0000","last_unstale":"2024-05-30T16:45:13.999653+0000","last_undegraded":"2024-05-30T16:45:13.999653+0000","last_fullsized":"2024-05-30T16:45:13.999653+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:39:25.152187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780001+0000","last_change":"2024-05-30T16:45:10.766931+0000","last_active":"2024-05-30T16:45:12.780001+0000","last_peered":"2024-05-30T16:45:12.780001+0000","last_clean":"2024-05-30T16:45:12.780001+0000","last_became_active":"2024-05-30T16:45:10.765374+0000","last_became_peered":"2024-05-30T16:45:10.765374+0000","last_unstale":"2024-05-30T16:45:12.780001+0000","last_undegraded":"2024-05-30T16:45:12.780001+0000","last_fullsized":"2024-05-30T16:45:12.780001+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:22:47.449289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781513+0000","last_change":"2024-05-30T16:45:11.765048+0000","last_active":"2024-05-30T16:45:12.781513+0000","last_peered":"2024-05-30T16:45:12.781513+0000","last_clean":"2024-05-30T16:45:12.781513+0000","last_became_active":"2024-05-30T16:45:11.764770+0000","last_became_peered":"2024-05-30T16:45:11.764770+0000","last_unstale":"2024-05-30T16:45:12.781513+0000","last_undegraded":"2024-05-30T16:45:12.781513+0000","last_fullsized":"2024-05-30T16:45:12.781513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:55.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533332+0000","last_change":"2024-05-30T16:45:10.770495+0000","last_active":"2024-05-30T16:45:15.533332+0000","last_peered":"2024-05-30T16:45:15.533332+0000","last_clean":"2024-05-30T16:45:15.533332+0000","last_became_active":"2024-05-30T16:45:10.770174+0000","last_became_peered":"2024-05-30T16:45:10.770174+0000","last_unstale":"2024-05-30T16:45:15.533332+0000","last_undegraded":"2024-05-30T16:45:15.533332+0000","last_fullsized":"2024-05-30T16:45:15.533332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:46:02.266042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060369+0000","last_change":"2024-05-30T16:45:11.777829+0000","last_active":"2024-05-30T16:45:15.060369+0000","last_peered":"2024-05-30T16:45:15.060369+0000","last_clean":"2024-05-30T16:45:15.060369+0000","last_became_active":"2024-05-30T16:45:11.777549+0000","last_became_peered":"2024-05-30T16:45:11.777549+0000","last_unstale":"2024-05-30T16:45:15.060369+0000","last_undegraded":"2024-05-30T16:45:15.060369+0000","last_fullsized":"2024-05-30T16:45:15.060369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:04.936343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781366+0000","last_change":"2024-05-30T16:45:10.768994+0000","last_active":"2024-05-30T16:45:12.781366+0000","last_peered":"2024-05-30T16:45:12.781366+0000","last_clean":"2024-05-30T16:45:12.781366+0000","last_became_active":"2024-05-30T16:45:10.767942+0000","last_became_peered":"2024-05-30T16:45:10.767942+0000","last_unstale":"2024-05-30T16:45:12.781366+0000","last_undegraded":"2024-05-30T16:45:12.781366+0000","last_fullsized":"2024-05-30T16:45:12.781366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:44.788791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059609+0000","last_change":"2024-05-30T16:45:11.773427+0000","last_active":"2024-05-30T16:45:15.059609+0000","last_peered":"2024-05-30T16:45:15.059609+0000","last_clean":"2024-05-30T16:45:15.059609+0000","last_became_active":"2024-05-30T16:45:11.771075+0000","last_became_peered":"2024-05-30T16:45:11.771075+0000","last_unstale":"2024-05-30T16:45:15.059609+0000","last_undegraded":"2024-05-30T16:45:15.059609+0000","last_fullsized":"2024-05-30T16:45:15.059609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:25.308089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930172+0000","last_change":"2024-05-30T16:45:10.754920+0000","last_active":"2024-05-30T16:45:14.930172+0000","last_peered":"2024-05-30T16:45:14.930172+0000","last_clean":"2024-05-30T16:45:14.930172+0000","last_became_active":"2024-05-30T16:45:10.754161+0000","last_became_peered":"2024-05-30T16:45:10.754161+0000","last_unstale":"2024-05-30T16:45:14.930172+0000","last_undegraded":"2024-05-30T16:45:14.930172+0000","last_fullsized":"2024-05-30T16:45:14.930172+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:43:14.199792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.782731+0000","last_change":"2024-05-30T16:45:11.768054+0000","last_active":"2024-05-30T16:45:12.782731+0000","last_peered":"2024-05-30T16:45:12.782731+0000","last_clean":"2024-05-30T16:45:12.782731+0000","last_became_active":"2024-05-30T16:45:11.767795+0000","last_became_peered":"2024-05-30T16:45:11.767795+0000","last_unstale":"2024-05-30T16:45:12.782731+0000","last_undegraded":"2024-05-30T16:45:12.782731+0000","last_fullsized":"2024-05-30T16:45:12.782731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:35.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059851+0000","last_change":"2024-05-30T16:45:10.758450+0000","last_active":"2024-05-30T16:45:15.059851+0000","last_peered":"2024-05-30T16:45:15.059851+0000","last_clean":"2024-05-30T16:45:15.059851+0000","last_became_active":"2024-05-30T16:45:10.758144+0000","last_became_peered":"2024-05-30T16:45:10.758144+0000","last_unstale":"2024-05-30T16:45:15.059851+0000","last_undegraded":"2024-05-30T16:45:15.059851+0000","last_fullsized":"2024-05-30T16:45:15.059851+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:56:24.361612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780174+0000","last_change":"2024-05-30T16:45:11.777246+0000","last_active":"2024-05-30T16:45:12.780174+0000","last_peered":"2024-05-30T16:45:12.780174+0000","last_clean":"2024-05-30T16:45:12.780174+0000","last_became_active":"2024-05-30T16:45:11.776986+0000","last_became_peered":"2024-05-30T16:45:11.776986+0000","last_unstale":"2024-05-30T16:45:12.780174+0000","last_undegraded":"2024-05-30T16:45:12.780174+0000","last_fullsized":"2024-05-30T16:45:12.780174+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:55:04.936343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780756+0000","last_change":"2024-05-30T16:45:10.764291+0000","last_active":"2024-05-30T16:45:12.780756+0000","last_peered":"2024-05-30T16:45:12.780756+0000","last_clean":"2024-05-30T16:45:12.780756+0000","last_became_active":"2024-05-30T16:45:10.763905+0000","last_became_peered":"2024-05-30T16:45:10.763905+0000","last_unstale":"2024-05-30T16:45:12.780756+0000","last_undegraded":"2024-05-30T16:45:12.780756+0000","last_fullsized":"2024-05-30T16:45:12.780756+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:27:54.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781500+0000","last_change":"2024-05-30T16:45:11.771292+0000","last_active":"2024-05-30T16:45:12.781500+0000","last_peered":"2024-05-30T16:45:12.781500+0000","last_clean":"2024-05-30T16:45:12.781500+0000","last_became_active":"2024-05-30T16:45:11.770965+0000","last_became_peered":"2024-05-30T16:45:11.770965+0000","last_unstale":"2024-05-30T16:45:12.781500+0000","last_undegraded":"2024-05-30T16:45:12.781500+0000","last_fullsized":"2024-05-30T16:45:12.781500+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:49:23.495537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061356+0000","last_change":"2024-05-30T16:45:10.764615+0000","last_active":"2024-05-30T16:45:15.061356+0000","last_peered":"2024-05-30T16:45:15.061356+0000","last_clean":"2024-05-30T16:45:15.061356+0000","last_became_active":"2024-05-30T16:45:10.764294+0000","last_became_peered":"2024-05-30T16:45:10.764294+0000","last_unstale":"2024-05-30T16:45:15.061356+0000","last_undegraded":"2024-05-30T16:45:15.061356+0000","last_fullsized":"2024-05-30T16:45:15.061356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:46.498029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533172+0000","last_change":"2024-05-30T16:45:11.779478+0000","last_active":"2024-05-30T16:45:15.533172+0000","last_peered":"2024-05-30T16:45:15.533172+0000","last_clean":"2024-05-30T16:45:15.533172+0000","last_became_active":"2024-05-30T16:45:11.779000+0000","last_became_peered":"2024-05-30T16:45:11.779000+0000","last_unstale":"2024-05-30T16:45:15.533172+0000","last_undegraded":"2024-05-30T16:45:15.533172+0000","last_fullsized":"2024-05-30T16:45:15.533172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:01.903297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779413+0000","last_change":"2024-05-30T16:45:10.770383+0000","last_active":"2024-05-30T16:45:12.779413+0000","last_peered":"2024-05-30T16:45:12.779413+0000","last_clean":"2024-05-30T16:45:12.779413+0000","last_became_active":"2024-05-30T16:45:10.769650+0000","last_became_peered":"2024-05-30T16:45:10.769650+0000","last_unstale":"2024-05-30T16:45:12.779413+0000","last_undegraded":"2024-05-30T16:45:12.779413+0000","last_fullsized":"2024-05-30T16:45:12.779413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:09.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778688+0000","last_change":"2024-05-30T16:45:11.777708+0000","last_active":"2024-05-30T16:45:12.778688+0000","last_peered":"2024-05-30T16:45:12.778688+0000","last_clean":"2024-05-30T16:45:12.778688+0000","last_became_active":"2024-05-30T16:45:11.777369+0000","last_became_peered":"2024-05-30T16:45:11.777369+0000","last_unstale":"2024-05-30T16:45:12.778688+0000","last_undegraded":"2024-05-30T16:45:12.778688+0000","last_fullsized":"2024-05-30T16:45:12.778688+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:46.697802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937811+0000","last_change":"2024-05-30T16:45:10.768576+0000","last_active":"2024-05-30T16:45:14.937811+0000","last_peered":"2024-05-30T16:45:14.937811+0000","last_clean":"2024-05-30T16:45:14.937811+0000","last_became_active":"2024-05-30T16:45:10.767860+0000","last_became_peered":"2024-05-30T16:45:10.767860+0000","last_unstale":"2024-05-30T16:45:14.937811+0000","last_undegraded":"2024-05-30T16:45:14.937811+0000","last_fullsized":"2024-05-30T16:45:14.937811+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:54.895555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783354+0000","last_change":"2024-05-30T16:45:11.780806+0000","last_active":"2024-05-30T16:45:12.783354+0000","last_peered":"2024-05-30T16:45:12.783354+0000","last_clean":"2024-05-30T16:45:12.783354+0000","last_became_active":"2024-05-30T16:45:11.780408+0000","last_became_peered":"2024-05-30T16:45:11.780408+0000","last_unstale":"2024-05-30T16:45:12.783354+0000","last_undegraded":"2024-05-30T16:45:12.783354+0000","last_fullsized":"2024-05-30T16:45:12.783354+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:57.709263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533332+0000","last_change":"2024-05-30T16:45:10.758714+0000","last_active":"2024-05-30T16:45:15.533332+0000","last_peered":"2024-05-30T16:45:15.533332+0000","last_clean":"2024-05-30T16:45:15.533332+0000","last_became_active":"2024-05-30T16:45:10.758428+0000","last_became_peered":"2024-05-30T16:45:10.758428+0000","last_unstale":"2024-05-30T16:45:15.533332+0000","last_undegraded":"2024-05-30T16:45:15.533332+0000","last_fullsized":"2024-05-30T16:45:15.533332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:54.903496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060711+0000","last_change":"2024-05-30T16:45:11.777233+0000","last_active":"2024-05-30T16:45:15.060711+0000","last_peered":"2024-05-30T16:45:15.060711+0000","last_clean":"2024-05-30T16:45:15.060711+0000","last_became_active":"2024-05-30T16:45:11.776582+0000","last_became_peered":"2024-05-30T16:45:11.776582+0000","last_unstale":"2024-05-30T16:45:15.060711+0000","last_undegraded":"2024-05-30T16:45:15.060711+0000","last_fullsized":"2024-05-30T16:45:15.060711+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:06:25.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779558+0000","last_change":"2024-05-30T16:45:10.767688+0000","last_active":"2024-05-30T16:45:12.779558+0000","last_peered":"2024-05-30T16:45:12.779558+0000","last_clean":"2024-05-30T16:45:12.779558+0000","last_became_active":"2024-05-30T16:45:10.766674+0000","last_became_peered":"2024-05-30T16:45:10.766674+0000","last_unstale":"2024-05-30T16:45:12.779558+0000","last_undegraded":"2024-05-30T16:45:12.779558+0000","last_fullsized":"2024-05-30T16:45:12.779558+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:20:39.065330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533040+0000","last_change":"2024-05-30T16:45:11.770647+0000","last_active":"2024-05-30T16:45:15.533040+0000","last_peered":"2024-05-30T16:45:15.533040+0000","last_clean":"2024-05-30T16:45:15.533040+0000","last_became_active":"2024-05-30T16:45:11.770375+0000","last_became_peered":"2024-05-30T16:45:11.770375+0000","last_unstale":"2024-05-30T16:45:15.533040+0000","last_undegraded":"2024-05-30T16:45:15.533040+0000","last_fullsized":"2024-05-30T16:45:15.533040+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:03:03.315724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532945+0000","last_change":"2024-05-30T16:45:10.760697+0000","last_active":"2024-05-30T16:45:15.532945+0000","last_peered":"2024-05-30T16:45:15.532945+0000","last_clean":"2024-05-30T16:45:15.532945+0000","last_became_active":"2024-05-30T16:45:10.759830+0000","last_became_peered":"2024-05-30T16:45:10.759830+0000","last_unstale":"2024-05-30T16:45:15.532945+0000","last_undegraded":"2024-05-30T16:45:15.532945+0000","last_fullsized":"2024-05-30T16:45:15.532945+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:18.469583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779140+0000","last_change":"2024-05-30T16:45:11.768127+0000","last_active":"2024-05-30T16:45:12.779140+0000","last_peered":"2024-05-30T16:45:12.779140+0000","last_clean":"2024-05-30T16:45:12.779140+0000","last_became_active":"2024-05-30T16:45:11.767805+0000","last_became_peered":"2024-05-30T16:45:11.767805+0000","last_unstale":"2024-05-30T16:45:12.779140+0000","last_undegraded":"2024-05-30T16:45:12.779140+0000","last_fullsized":"2024-05-30T16:45:12.779140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:02.656592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060090+0000","last_change":"2024-05-30T16:45:10.755304+0000","last_active":"2024-05-30T16:45:15.060090+0000","last_peered":"2024-05-30T16:45:15.060090+0000","last_clean":"2024-05-30T16:45:15.060090+0000","last_became_active":"2024-05-30T16:45:10.754993+0000","last_became_peered":"2024-05-30T16:45:10.754993+0000","last_unstale":"2024-05-30T16:45:15.060090+0000","last_undegraded":"2024-05-30T16:45:15.060090+0000","last_fullsized":"2024-05-30T16:45:15.060090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:55:33.726746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937886+0000","last_change":"2024-05-30T16:45:11.769430+0000","last_active":"2024-05-30T16:45:14.937886+0000","last_peered":"2024-05-30T16:45:14.937886+0000","last_clean":"2024-05-30T16:45:14.937886+0000","last_became_active":"2024-05-30T16:45:11.765941+0000","last_became_peered":"2024-05-30T16:45:11.765941+0000","last_unstale":"2024-05-30T16:45:14.937886+0000","last_undegraded":"2024-05-30T16:45:14.937886+0000","last_fullsized":"2024-05-30T16:45:14.937886+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:30.605060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937678+0000","last_change":"2024-05-30T16:45:10.750358+0000","last_active":"2024-05-30T16:45:14.937678+0000","last_peered":"2024-05-30T16:45:14.937678+0000","last_clean":"2024-05-30T16:45:14.937678+0000","last_became_active":"2024-05-30T16:45:10.750034+0000","last_became_peered":"2024-05-30T16:45:10.750034+0000","last_unstale":"2024-05-30T16:45:14.937678+0000","last_undegraded":"2024-05-30T16:45:14.937678+0000","last_fullsized":"2024-05-30T16:45:14.937678+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:09.854664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061469+0000","last_change":"2024-05-30T16:45:11.790391+0000","last_active":"2024-05-30T16:45:15.061469+0000","last_peered":"2024-05-30T16:45:15.061469+0000","last_clean":"2024-05-30T16:45:15.061469+0000","last_became_active":"2024-05-30T16:45:11.790071+0000","last_became_peered":"2024-05-30T16:45:11.790071+0000","last_unstale":"2024-05-30T16:45:15.061469+0000","last_undegraded":"2024-05-30T16:45:15.061469+0000","last_fullsized":"2024-05-30T16:45:15.061469+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:10.583306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.780647+0000","last_change":"2024-05-30T16:45:10.769296+0000","last_active":"2024-05-30T16:45:12.780647+0000","last_peered":"2024-05-30T16:45:12.780647+0000","last_clean":"2024-05-30T16:45:12.780647+0000","last_became_active":"2024-05-30T16:45:10.768709+0000","last_became_peered":"2024-05-30T16:45:10.768709+0000","last_unstale":"2024-05-30T16:45:12.780647+0000","last_undegraded":"2024-05-30T16:45:12.780647+0000","last_fullsized":"2024-05-30T16:45:12.780647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:58.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783385+0000","last_change":"2024-05-30T16:45:11.771998+0000","last_active":"2024-05-30T16:45:12.783385+0000","last_peered":"2024-05-30T16:45:12.783385+0000","last_clean":"2024-05-30T16:45:12.783385+0000","last_became_active":"2024-05-30T16:45:11.771688+0000","last_became_peered":"2024-05-30T16:45:11.771688+0000","last_unstale":"2024-05-30T16:45:12.783385+0000","last_undegraded":"2024-05-30T16:45:12.783385+0000","last_fullsized":"2024-05-30T16:45:12.783385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:21:16.778711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.931163+0000","last_change":"2024-05-30T16:45:10.754747+0000","last_active":"2024-05-30T16:45:14.931163+0000","last_peered":"2024-05-30T16:45:14.931163+0000","last_clean":"2024-05-30T16:45:14.931163+0000","last_became_active":"2024-05-30T16:45:10.754108+0000","last_became_peered":"2024-05-30T16:45:10.754108+0000","last_unstale":"2024-05-30T16:45:14.931163+0000","last_undegraded":"2024-05-30T16:45:14.931163+0000","last_fullsized":"2024-05-30T16:45:14.931163+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:53.622362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783907+0000","last_change":"2024-05-30T16:45:11.777186+0000","last_active":"2024-05-30T16:45:12.783907+0000","last_peered":"2024-05-30T16:45:12.783907+0000","last_clean":"2024-05-30T16:45:12.783907+0000","last_became_active":"2024-05-30T16:45:11.776882+0000","last_became_peered":"2024-05-30T16:45:11.776882+0000","last_unstale":"2024-05-30T16:45:12.783907+0000","last_undegraded":"2024-05-30T16:45:12.783907+0000","last_fullsized":"2024-05-30T16:45:12.783907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:25.308089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533303+0000","last_change":"2024-05-30T16:45:10.766144+0000","last_active":"2024-05-30T16:45:15.533303+0000","last_peered":"2024-05-30T16:45:15.533303+0000","last_clean":"2024-05-30T16:45:15.533303+0000","last_became_active":"2024-05-30T16:45:10.765897+0000","last_became_peered":"2024-05-30T16:45:10.765897+0000","last_unstale":"2024-05-30T16:45:15.533303+0000","last_undegraded":"2024-05-30T16:45:15.533303+0000","last_fullsized":"2024-05-30T16:45:15.533303+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:20:39.065330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.532835+0000","last_change":"2024-05-30T16:45:11.778936+0000","last_active":"2024-05-30T16:45:15.532835+0000","last_peered":"2024-05-30T16:45:15.532835+0000","last_clean":"2024-05-30T16:45:15.532835+0000","last_became_active":"2024-05-30T16:45:11.778569+0000","last_became_peered":"2024-05-30T16:45:11.778569+0000","last_unstale":"2024-05-30T16:45:15.532835+0000","last_undegraded":"2024-05-30T16:45:15.532835+0000","last_fullsized":"2024-05-30T16:45:15.532835+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:12.055901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533500+0000","last_change":"2024-05-30T16:45:10.764883+0000","last_active":"2024-05-30T16:45:15.533500+0000","last_peered":"2024-05-30T16:45:15.533500+0000","last_clean":"2024-05-30T16:45:15.533500+0000","last_became_active":"2024-05-30T16:45:10.764600+0000","last_became_peered":"2024-05-30T16:45:10.764600+0000","last_unstale":"2024-05-30T16:45:15.533500+0000","last_undegraded":"2024-05-30T16:45:15.533500+0000","last_fullsized":"2024-05-30T16:45:15.533500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:38.358920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999168+0000","last_change":"2024-05-30T16:45:11.774681+0000","last_active":"2024-05-30T16:45:13.999168+0000","last_peered":"2024-05-30T16:45:13.999168+0000","last_clean":"2024-05-30T16:45:13.999168+0000","last_became_active":"2024-05-30T16:45:11.774353+0000","last_became_peered":"2024-05-30T16:45:11.774353+0000","last_unstale":"2024-05-30T16:45:13.999168+0000","last_undegraded":"2024-05-30T16:45:13.999168+0000","last_fullsized":"2024-05-30T16:45:13.999168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:57.709263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930185+0000","last_change":"2024-05-30T16:45:10.764986+0000","last_active":"2024-05-30T16:45:14.930185+0000","last_peered":"2024-05-30T16:45:14.930185+0000","last_clean":"2024-05-30T16:45:14.930185+0000","last_became_active":"2024-05-30T16:45:10.764682+0000","last_became_peered":"2024-05-30T16:45:10.764682+0000","last_unstale":"2024-05-30T16:45:14.930185+0000","last_undegraded":"2024-05-30T16:45:14.930185+0000","last_fullsized":"2024-05-30T16:45:14.930185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:48.106502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.937874+0000","last_change":"2024-05-30T16:45:11.767741+0000","last_active":"2024-05-30T16:45:14.937874+0000","last_peered":"2024-05-30T16:45:14.937874+0000","last_clean":"2024-05-30T16:45:14.937874+0000","last_became_active":"2024-05-30T16:45:11.765009+0000","last_became_peered":"2024-05-30T16:45:11.765009+0000","last_unstale":"2024-05-30T16:45:14.937874+0000","last_undegraded":"2024-05-30T16:45:14.937874+0000","last_fullsized":"2024-05-30T16:45:14.937874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:23:40.769361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.059590+0000","last_change":"2024-05-30T16:45:10.764517+0000","last_active":"2024-05-30T16:45:15.059590+0000","last_peered":"2024-05-30T16:45:15.059590+0000","last_clean":"2024-05-30T16:45:15.059590+0000","last_became_active":"2024-05-30T16:45:10.764215+0000","last_became_peered":"2024-05-30T16:45:10.764215+0000","last_unstale":"2024-05-30T16:45:15.059590+0000","last_undegraded":"2024-05-30T16:45:15.059590+0000","last_fullsized":"2024-05-30T16:45:15.059590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:29.588099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060304+0000","last_change":"2024-05-30T16:45:11.781461+0000","last_active":"2024-05-30T16:45:15.060304+0000","last_peered":"2024-05-30T16:45:15.060304+0000","last_clean":"2024-05-30T16:45:15.060304+0000","last_became_active":"2024-05-30T16:45:11.781167+0000","last_became_peered":"2024-05-30T16:45:11.781167+0000","last_unstale":"2024-05-30T16:45:15.060304+0000","last_undegraded":"2024-05-30T16:45:15.060304+0000","last_fullsized":"2024-05-30T16:45:15.060304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:08.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778347+0000","last_change":"2024-05-30T16:45:10.765930+0000","last_active":"2024-05-30T16:45:12.778347+0000","last_peered":"2024-05-30T16:45:12.778347+0000","last_clean":"2024-05-30T16:45:12.778347+0000","last_became_active":"2024-05-30T16:45:10.764672+0000","last_became_peered":"2024-05-30T16:45:10.764672+0000","last_unstale":"2024-05-30T16:45:12.778347+0000","last_undegraded":"2024-05-30T16:45:12.778347+0000","last_fullsized":"2024-05-30T16:45:12.778347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:38.358920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.783920+0000","last_change":"2024-05-30T16:45:11.769154+0000","last_active":"2024-05-30T16:45:12.783920+0000","last_peered":"2024-05-30T16:45:12.783920+0000","last_clean":"2024-05-30T16:45:12.783920+0000","last_became_active":"2024-05-30T16:45:11.768785+0000","last_became_peered":"2024-05-30T16:45:11.768785+0000","last_unstale":"2024-05-30T16:45:12.783920+0000","last_undegraded":"2024-05-30T16:45:12.783920+0000","last_fullsized":"2024-05-30T16:45:12.783920+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:19:31.554668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533397+0000","last_change":"2024-05-30T16:45:10.765742+0000","last_active":"2024-05-30T16:45:15.533397+0000","last_peered":"2024-05-30T16:45:15.533397+0000","last_clean":"2024-05-30T16:45:15.533397+0000","last_became_active":"2024-05-30T16:45:10.765420+0000","last_became_peered":"2024-05-30T16:45:10.765420+0000","last_unstale":"2024-05-30T16:45:15.533397+0000","last_undegraded":"2024-05-30T16:45:15.533397+0000","last_fullsized":"2024-05-30T16:45:15.533397+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:56:09.566346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060803+0000","last_change":"2024-05-30T16:45:11.775048+0000","last_active":"2024-05-30T16:45:15.060803+0000","last_peered":"2024-05-30T16:45:15.060803+0000","last_clean":"2024-05-30T16:45:15.060803+0000","last_became_active":"2024-05-30T16:45:11.774598+0000","last_became_peered":"2024-05-30T16:45:11.774598+0000","last_unstale":"2024-05-30T16:45:15.060803+0000","last_undegraded":"2024-05-30T16:45:15.060803+0000","last_fullsized":"2024-05-30T16:45:15.060803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:25:19.486543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779694+0000","last_change":"2024-05-30T16:45:10.770395+0000","last_active":"2024-05-30T16:45:12.779694+0000","last_peered":"2024-05-30T16:45:12.779694+0000","last_clean":"2024-05-30T16:45:12.779694+0000","last_became_active":"2024-05-30T16:45:10.769101+0000","last_became_peered":"2024-05-30T16:45:10.769101+0000","last_unstale":"2024-05-30T16:45:12.779694+0000","last_undegraded":"2024-05-30T16:45:12.779694+0000","last_fullsized":"2024-05-30T16:45:12.779694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:02.386924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.779141+0000","last_change":"2024-05-30T16:45:11.775726+0000","last_active":"2024-05-30T16:45:12.779141+0000","last_peered":"2024-05-30T16:45:12.779141+0000","last_clean":"2024-05-30T16:45:12.779141+0000","last_became_active":"2024-05-30T16:45:11.775314+0000","last_became_peered":"2024-05-30T16:45:11.775314+0000","last_unstale":"2024-05-30T16:45:12.779141+0000","last_undegraded":"2024-05-30T16:45:12.779141+0000","last_fullsized":"2024-05-30T16:45:12.779141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:11:12.055901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.998873+0000","last_change":"2024-05-30T16:45:10.754966+0000","last_active":"2024-05-30T16:45:13.998873+0000","last_peered":"2024-05-30T16:45:13.998873+0000","last_clean":"2024-05-30T16:45:13.998873+0000","last_became_active":"2024-05-30T16:45:10.754676+0000","last_became_peered":"2024-05-30T16:45:10.754676+0000","last_unstale":"2024-05-30T16:45:13.998873+0000","last_undegraded":"2024-05-30T16:45:13.998873+0000","last_fullsized":"2024-05-30T16:45:13.998873+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:33:44.788791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533073+0000","last_change":"2024-05-30T16:45:11.779154+0000","last_active":"2024-05-30T16:45:15.533073+0000","last_peered":"2024-05-30T16:45:15.533073+0000","last_clean":"2024-05-30T16:45:15.533073+0000","last_became_active":"2024-05-30T16:45:11.778847+0000","last_became_peered":"2024-05-30T16:45:11.778847+0000","last_unstale":"2024-05-30T16:45:15.533073+0000","last_undegraded":"2024-05-30T16:45:15.533073+0000","last_fullsized":"2024-05-30T16:45:15.533073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:01:07.816774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781786+0000","last_change":"2024-05-30T16:45:10.770655+0000","last_active":"2024-05-30T16:45:12.781786+0000","last_peered":"2024-05-30T16:45:12.781786+0000","last_clean":"2024-05-30T16:45:12.781786+0000","last_became_active":"2024-05-30T16:45:10.770183+0000","last_became_peered":"2024-05-30T16:45:10.770183+0000","last_unstale":"2024-05-30T16:45:12.781786+0000","last_undegraded":"2024-05-30T16:45:12.781786+0000","last_fullsized":"2024-05-30T16:45:12.781786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:49.089323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.533243+0000","last_change":"2024-05-30T16:45:11.777452+0000","last_active":"2024-05-30T16:45:15.533243+0000","last_peered":"2024-05-30T16:45:15.533243+0000","last_clean":"2024-05-30T16:45:15.533243+0000","last_became_active":"2024-05-30T16:45:11.777162+0000","last_became_peered":"2024-05-30T16:45:11.777162+0000","last_unstale":"2024-05-30T16:45:15.533243+0000","last_undegraded":"2024-05-30T16:45:15.533243+0000","last_fullsized":"2024-05-30T16:45:15.533243+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:15:59.650273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.781652+0000","last_change":"2024-05-30T16:45:10.766648+0000","last_active":"2024-05-30T16:45:12.781652+0000","last_peered":"2024-05-30T16:45:12.781652+0000","last_clean":"2024-05-30T16:45:12.781652+0000","last_became_active":"2024-05-30T16:45:10.766383+0000","last_became_peered":"2024-05-30T16:45:10.766383+0000","last_unstale":"2024-05-30T16:45:12.781652+0000","last_undegraded":"2024-05-30T16:45:12.781652+0000","last_fullsized":"2024-05-30T16:45:12.781652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:25:34.720234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.930375+0000","last_change":"2024-05-30T16:45:11.771654+0000","last_active":"2024-05-30T16:45:14.930375+0000","last_peered":"2024-05-30T16:45:14.930375+0000","last_clean":"2024-05-30T16:45:14.930375+0000","last_became_active":"2024-05-30T16:45:11.771176+0000","last_became_peered":"2024-05-30T16:45:11.771176+0000","last_unstale":"2024-05-30T16:45:14.930375+0000","last_undegraded":"2024-05-30T16:45:14.930375+0000","last_fullsized":"2024-05-30T16:45:14.930375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:54:03.403885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:13.999101+0000","last_change":"2024-05-30T16:45:10.762650+0000","last_active":"2024-05-30T16:45:13.999101+0000","last_peered":"2024-05-30T16:45:13.999101+0000","last_clean":"2024-05-30T16:45:13.999101+0000","last_became_active":"2024-05-30T16:45:10.762303+0000","last_became_peered":"2024-05-30T16:45:10.762303+0000","last_unstale":"2024-05-30T16:45:13.999101+0000","last_undegraded":"2024-05-30T16:45:13.999101+0000","last_fullsized":"2024-05-30T16:45:13.999101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:27:52.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778817+0000","last_change":"2024-05-30T16:45:11.776301+0000","last_active":"2024-05-30T16:45:12.778817+0000","last_peered":"2024-05-30T16:45:12.778817+0000","last_clean":"2024-05-30T16:45:12.778817+0000","last_became_active":"2024-05-30T16:45:11.776032+0000","last_became_peered":"2024-05-30T16:45:11.776032+0000","last_unstale":"2024-05-30T16:45:12.778817+0000","last_undegraded":"2024-05-30T16:45:12.778817+0000","last_fullsized":"2024-05-30T16:45:12.778817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:03:54.639322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.060361+0000","last_change":"2024-05-30T16:45:10.756428+0000","last_active":"2024-05-30T16:45:15.060361+0000","last_peered":"2024-05-30T16:45:15.060361+0000","last_clean":"2024-05-30T16:45:15.060361+0000","last_became_active":"2024-05-30T16:45:10.756003+0000","last_became_peered":"2024-05-30T16:45:10.756003+0000","last_unstale":"2024-05-30T16:45:15.060361+0000","last_undegraded":"2024-05-30T16:45:15.060361+0000","last_fullsized":"2024-05-30T16:45:15.060361+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:01:19.722735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:15.061202+0000","last_change":"2024-05-30T16:45:11.767741+0000","last_active":"2024-05-30T16:45:15.061202+0000","last_peered":"2024-05-30T16:45:15.061202+0000","last_clean":"2024-05-30T16:45:15.061202+0000","last_became_active":"2024-05-30T16:45:11.767467+0000","last_became_peered":"2024-05-30T16:45:11.767467+0000","last_unstale":"2024-05-30T16:45:15.061202+0000","last_undegraded":"2024-05-30T16:45:15.061202+0000","last_fullsized":"2024-05-30T16:45:15.061202+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:10.715702+0000","last_clean_scrub_stamp":"2024-05-30T16:45:10.715702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:44:55.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:14.931341+0000","last_change":"2024-05-30T16:45:10.756823+0000","last_active":"2024-05-30T16:45:14.931341+0000","last_peered":"2024-05-30T16:45:14.931341+0000","last_clean":"2024-05-30T16:45:14.931341+0000","last_became_active":"2024-05-30T16:45:10.755780+0000","last_became_peered":"2024-05-30T16:45:10.755780+0000","last_unstale":"2024-05-30T16:45:14.931341+0000","last_undegraded":"2024-05-30T16:45:14.931341+0000","last_fullsized":"2024-05-30T16:45:14.931341+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:45:09.698742+0000","last_clean_scrub_stamp":"2024-05-30T16:45:09.698742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:09.001292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":212,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-30T16:45:12.778644+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:45:12.778644+0000","last_peered":"2024-05-30T16:45:12.778644+0000","last_clean":"2024-05-30T16:45:12.778644+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:45:12.778644+0000","last_undegraded":"2024-05-30T16:45:12.778644+0000","last_fullsized":"2024-05-30T16:45:12.778644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1114112,"data_stored":800449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":210663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":520192,"data_stored":210061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35856,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335984,"statfs":{"total":96636764160,"available":96600047616,"internally_reserved":0,"allocated":528384,"data_stored":211603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":516096,"data_stored":204329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":211625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":520192,"data_stored":210061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1114112,"data_stored":800393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:45:21.731 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:45:21.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T16:45:21.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.982+0000 7f613e400640 1 Processor -- start 2024-05-30T16:45:21.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.982+0000 7f613e400640 1 -- start start 2024-05-30T16:45:21.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.984+0000 7f613e400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6138145150 0x7f61380cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.984+0000 7f613e400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f61380cfa70 0x7f613806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.984+0000 7f613e400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61380d00f0 con 0x7f613806f610 2024-05-30T16:45:21.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.984+0000 7f613e400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f613806fa80 con 0x7f61380cfa70 2024-05-30T16:45:21.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.984+0000 7f613e400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f61380cfeb0 con 0x7f6138145150 2024-05-30T16:45:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.984+0000 7f612fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f61380cfa70 0x7f613806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.984+0000 7f6137e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f613806f610 0x7f6138072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45440/0 (socket says 172.21.15.144:45440) 2024-05-30T16:45:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.984+0000 7f6137e00640 1 -- 172.21.15.144:0/226367383 learned_addr learned my addr 172.21.15.144:0/226367383 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.984+0000 7f6137400640 1 --2- 172.21.15.144:0/226367383 >> v2:172.21.15.149:3300/0 conn(0x7f6138145150 0x7f61380cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.985+0000 7f612fe00640 1 -- 172.21.15.144:0/226367383 >> v2:172.21.15.149:3300/0 conn(0x7f6138145150 msgr2=0x7f61380cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.985+0000 7f612fe00640 1 --2- 172.21.15.144:0/226367383 >> v2:172.21.15.149:3300/0 conn(0x7f6138145150 0x7f61380cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.985+0000 7f612fe00640 1 -- 172.21.15.144:0/226367383 >> v1:172.21.15.144:6789/0 conn(0x7f613806f610 legacy=0x7f6138072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.985+0000 7f612fe00640 1 -- 172.21.15.144:0/226367383 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613815f390 con 0x7f61380cfa70 2024-05-30T16:45:21.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.986+0000 7f612fe00640 1 --2- 172.21.15.144:0/226367383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 0x7f613806f0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f61380b3db0 tx=0x7f612002c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7f142be21023be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:21.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.986+0000 7f6136a00640 1 -- 172.21.15.144:0/226367383 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120039070 con 0x7f61380cfa70 2024-05-30T16:45:21.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.986+0000 7f6136a00640 1 -- 172.21.15.144:0/226367383 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6120034640 con 0x7f61380cfa70 2024-05-30T16:45:21.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.986+0000 7f6136a00640 1 -- 172.21.15.144:0/226367383 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120034a10 con 0x7f61380cfa70 2024-05-30T16:45:21.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.986+0000 7f613e400640 1 -- 172.21.15.144:0/226367383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 msgr2=0x7f613806f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:21.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.986+0000 7f613e400640 1 --2- 172.21.15.144:0/226367383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 0x7f613806f0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f61380b3db0 tx=0x7f612002c320 comp rx=0 tx=0).stop 2024-05-30T16:45:21.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.987+0000 7f613e400640 1 -- 172.21.15.144:0/226367383 shutdown_connections 2024-05-30T16:45:21.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.987+0000 7f613e400640 1 --2- 172.21.15.144:0/226367383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 0x7f613806f0d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.987+0000 7f613e400640 1 --2- 172.21.15.144:0/226367383 >> v2:172.21.15.149:3300/0 conn(0x7f6138145150 0x7f61380cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.987+0000 7f613e400640 1 -- 172.21.15.144:0/226367383 >> 172.21.15.144:0/226367383 conn(0x7f613806bd00 msgr2=0x7f613806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:21.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.987+0000 7f613e400640 1 -- 172.21.15.144:0/226367383 shutdown_connections 2024-05-30T16:45:21.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.987+0000 7f613e400640 1 -- 172.21.15.144:0/226367383 wait complete. 2024-05-30T16:45:21.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.989+0000 7f613e400640 1 Processor -- start 2024-05-30T16:45:21.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.989+0000 7f613e400640 1 -- start start 2024-05-30T16:45:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f613e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613806f610 0x7f613813f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f613e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 0x7f61381e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f613e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6138145150 0x7f61380adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f613e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f613815f950 con 0x7f61380cfa70 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f613e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f613815f140 con 0x7f6138145150 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f613e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61380b64f0 con 0x7f613806f610 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f612fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 0x7f61381e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f612fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 0x7f61381e4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46968/0 (socket says 172.21.15.144:46968) 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f612fe00640 1 -- 172.21.15.144:0/1766071481 learned_addr learned my addr 172.21.15.144:0/1766071481 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f6137400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613806f610 0x7f613813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f6137e00640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6138145150 0x7f61380adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f612fe00640 1 -- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613806f610 msgr2=0x7f613813f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f612fe00640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613806f610 0x7f613813f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f612fe00640 1 -- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6138145150 msgr2=0x7f61380adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f612fe00640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6138145150 0x7f61380adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f612fe00640 1 -- 172.21.15.144:0/1766071481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613813f960 con 0x7f61380cfa70 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f6137400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613806f610 0x7f613813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.990+0000 7f6137e00640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6138145150 0x7f61380adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.991+0000 7f612fe00640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 0x7f61381e4f80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6120000c00 tx=0x7f61200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.991+0000 7f612f400640 1 -- 172.21.15.144:0/1766071481 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120039070 con 0x7f61380cfa70 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.991+0000 7f612f400640 1 -- 172.21.15.144:0/1766071481 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6120032980 con 0x7f61380cfa70 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.991+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613815bf60 con 0x7f61380cfa70 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.991+0000 7f612f400640 1 -- 172.21.15.144:0/1766071481 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120032d50 con 0x7f61380cfa70 2024-05-30T16:45:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.991+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613815c520 con 0x7f61380cfa70 2024-05-30T16:45:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.992+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6138068b90 con 0x7f61380cfa70 2024-05-30T16:45:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.993+0000 7f612f400640 1 -- 172.21.15.144:0/1766071481 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f612003f440 con 0x7f61380cfa70 2024-05-30T16:45:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.994+0000 7f612f400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f611406cbc0 0x7f611406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.994+0000 7f612f400640 1 -- 172.21.15.144:0/1766071481 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f61200acb70 con 0x7f61380cfa70 2024-05-30T16:45:21.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.995+0000 7f6137400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f611406cbc0 0x7f611406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:21.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.995+0000 7f6137400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f611406cbc0 0x7f611406f080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6128008890 tx=0x7f6128008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:22.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:21.999+0000 7f612f400640 1 -- 172.21.15.144:0/1766071481 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f612007ace0 con 0x7f61380cfa70 2024-05-30T16:45:22.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.267+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f613806c330 con 0x7f61380cfa70 2024-05-30T16:45:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.272+0000 7f612f400640 1 -- 172.21.15.144:0/1766071481 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f612007a5e0 con 0x7f61380cfa70 2024-05-30T16:45:22.274 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-05-30T16:45:22.274 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA== 2024-05-30T16:45:22.274 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-05-30T16:45:22.274 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-05-30T16:45:22.274 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T16:45:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-05-30T16:45:22.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f611406cbc0 msgr2=0x7f611406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:22.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f611406cbc0 0x7f611406f080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6128008890 tx=0x7f6128008040 comp rx=0 tx=0).stop 2024-05-30T16:45:22.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 msgr2=0x7f61381e4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:22.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 0x7f61381e4f80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6120000c00 tx=0x7f61200046c0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 shutdown_connections 2024-05-30T16:45:22.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f611406cbc0 0x7f611406f080 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6138145150 0x7f61380adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61380cfa70 0x7f61381e4f80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 --2- 172.21.15.144:0/1766071481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613806f610 0x7f613813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 >> 172.21.15.144:0/1766071481 conn(0x7f613806bd00 msgr2=0x7f6138143c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:22.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 shutdown_connections 2024-05-30T16:45:22.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.275+0000 7f613e400640 1 -- 172.21.15.144:0/1766071481 wait complete. 2024-05-30T16:45:22.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:45:22.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.493+0000 7f5509a00640 1 Processor -- start 2024-05-30T16:45:22.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.493+0000 7f5509a00640 1 -- start start 2024-05-30T16:45:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.495+0000 7f5509a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55040cec70 0x7f55040b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.495+0000 7f5509a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f55040b5e00 0x7f5504142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.495+0000 7f5509a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5504160730 con 0x7f550413f760 2024-05-30T16:45:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.495+0000 7f5509a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f55041612b0 con 0x7f55040cec70 2024-05-30T16:45:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.495+0000 7f5509a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f550413fb40 con 0x7f55040b5e00 2024-05-30T16:45:22.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.495+0000 7f54fa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55040cec70 0x7f55040b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:22.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.495+0000 7f5502a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f550413f760 0x7f550406e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45448/0 (socket says 172.21.15.144:45448) 2024-05-30T16:45:22.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.495+0000 7f5502a00640 1 -- 172.21.15.144:0/4258823358 learned_addr learned my addr 172.21.15.144:0/4258823358 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:22.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.496+0000 7f5503400640 1 --2- 172.21.15.144:0/4258823358 >> v2:172.21.15.149:3300/0 conn(0x7f55040b5e00 0x7f5504142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.496+0000 7f54fa000640 1 -- 172.21.15.144:0/4258823358 >> v2:172.21.15.149:3300/0 conn(0x7f55040b5e00 msgr2=0x7f5504142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.496+0000 7f54fa000640 1 --2- 172.21.15.144:0/4258823358 >> v2:172.21.15.149:3300/0 conn(0x7f55040b5e00 0x7f5504142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.496+0000 7f54fa000640 1 -- 172.21.15.144:0/4258823358 >> v1:172.21.15.144:6789/0 conn(0x7f550413f760 legacy=0x7f550406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.496+0000 7f54fa000640 1 -- 172.21.15.144:0/4258823358 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5504160a10 con 0x7f55040cec70 2024-05-30T16:45:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.497+0000 7f54fa000640 1 --2- 172.21.15.144:0/4258823358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55040cec70 0x7f55040b58c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f550415de30 tx=0x7f54ec02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc795779d2fb804 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.497+0000 7f5502000640 1 -- 172.21.15.144:0/4258823358 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec037070 con 0x7f55040cec70 2024-05-30T16:45:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.497+0000 7f5502000640 1 -- 172.21.15.144:0/4258823358 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec032440 con 0x7f55040cec70 2024-05-30T16:45:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.497+0000 7f5502000640 1 -- 172.21.15.144:0/4258823358 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec032810 con 0x7f55040cec70 2024-05-30T16:45:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.498+0000 7f5509a00640 1 -- 172.21.15.144:0/4258823358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55040cec70 msgr2=0x7f55040b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.498+0000 7f5509a00640 1 --2- 172.21.15.144:0/4258823358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55040cec70 0x7f55040b58c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f550415de30 tx=0x7f54ec02a250 comp rx=0 tx=0).stop 2024-05-30T16:45:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.498+0000 7f5509a00640 1 -- 172.21.15.144:0/4258823358 shutdown_connections 2024-05-30T16:45:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.498+0000 7f5509a00640 1 --2- 172.21.15.144:0/4258823358 >> v2:172.21.15.149:3300/0 conn(0x7f55040b5e00 0x7f5504142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.498+0000 7f5509a00640 1 --2- 172.21.15.144:0/4258823358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55040cec70 0x7f55040b58c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.498+0000 7f5509a00640 1 -- 172.21.15.144:0/4258823358 >> 172.21.15.144:0/4258823358 conn(0x7f550406bd00 msgr2=0x7f550406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.498+0000 7f5509a00640 1 -- 172.21.15.144:0/4258823358 shutdown_connections 2024-05-30T16:45:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.498+0000 7f5509a00640 1 -- 172.21.15.144:0/4258823358 wait complete. 2024-05-30T16:45:22.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.500+0000 7f5509a00640 1 Processor -- start 2024-05-30T16:45:22.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.501+0000 7f5509a00640 1 -- start start 2024-05-30T16:45:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5509a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55040b5e00 0x7f55041547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5509a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55040cec70 0x7f550413e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5509a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f550413f760 0x7f550413ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5509a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f55040cf0d0 con 0x7f550413f760 2024-05-30T16:45:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5509a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5504160fd0 con 0x7f55040b5e00 2024-05-30T16:45:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5509a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f55040cf250 con 0x7f55040cec70 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5503400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f550413f760 0x7f550413ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5503400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f550413f760 0x7f550413ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47000/0 (socket says 172.21.15.144:47000) 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5503400640 1 -- 172.21.15.144:0/3373486480 learned_addr learned my addr 172.21.15.144:0/3373486480 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f54fa000640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55040cec70 0x7f550413e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5503400640 1 -- 172.21.15.144:0/3373486480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55040cec70 msgr2=0x7f550413e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.502+0000 7f5503400640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55040cec70 0x7f550413e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.503+0000 7f5503400640 1 -- 172.21.15.144:0/3373486480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55040b5e00 msgr2=0x7f55041547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.503+0000 7f5503400640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55040b5e00 0x7f55041547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.503+0000 7f5503400640 1 -- 172.21.15.144:0/3373486480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5504154d90 con 0x7f550413f760 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.503+0000 7f5503400640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f550413f760 0x7f550413ea20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00d800 tx=0x7f54fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.503+0000 7f54fb400640 1 -- 172.21.15.144:0/3373486480 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00b6c0 con 0x7f550413f760 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.503+0000 7f54fb400640 1 -- 172.21.15.144:0/3373486480 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54fc019070 con 0x7f550413f760 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.503+0000 7f54fb400640 1 -- 172.21.15.144:0/3373486480 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00bac0 con 0x7f550413f760 2024-05-30T16:45:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.503+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5504155070 con 0x7f550413f760 2024-05-30T16:45:22.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.503+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55040b1a10 con 0x7f550413f760 2024-05-30T16:45:22.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.504+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5504069270 con 0x7f550413f760 2024-05-30T16:45:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.506+0000 7f54fb400640 1 -- 172.21.15.144:0/3373486480 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f54fc00bc60 con 0x7f550413f760 2024-05-30T16:45:22.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.507+0000 7f54fb400640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f54e006cbc0 0x7f54e006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:22.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.507+0000 7f54fb400640 1 -- 172.21.15.144:0/3373486480 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f54fc08c3b0 con 0x7f550413f760 2024-05-30T16:45:22.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.507+0000 7f5502a00640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f54e006cbc0 0x7f54e006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:22.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.508+0000 7f5502a00640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f54e006cbc0 0x7f54e006f080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f54f40012e0 tx=0x7f54f4001590 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.511+0000 7f54fb400640 1 -- 172.21.15.144:0/3373486480 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5504069270 con 0x7f550413f760 2024-05-30T16:45:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.754+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55040cf6b0 con 0x7f550413f760 2024-05-30T16:45:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.754+0000 7f54fb400640 1 -- 172.21.15.144:0/3373486480 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5190 (secure 0 0 0) 0x7f55040cf6b0 con 0x7f550413f760 2024-05-30T16:45:22.756 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:45:22.756 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1748821329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":1748821329},{"type":"v1","addr":"172.21.15.149:6835","nonce":1748821329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/498363694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":498363694},{"type":"v1","addr":"172.21.15.149:6834","nonce":498363694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1097253256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1097253256},{"type":"v1","addr":"172.21.15.144:6835","nonce":1097253256}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:45:11.209778+0000","modified":"2024-05-30T16:45:14.274711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5235":{"gid":5235,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4243254164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4243254164},{"type":"v1","addr":"172.21.15.144:6837","nonce":4243254164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5235,"qdb_cluster":[5235]},"id":3}]} 2024-05-30T16:45:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-05-30T16:45:22.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f54e006cbc0 msgr2=0x7f54e006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f54e006cbc0 0x7f54e006f080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f54f40012e0 tx=0x7f54f4001590 comp rx=0 tx=0).stop 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f550413f760 msgr2=0x7f550413ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f550413f760 0x7f550413ea20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00d800 tx=0x7f54fc00dcc0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 shutdown_connections 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f54e006cbc0 0x7f54e006f080 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f550413f760 0x7f550413ea20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55040cec70 0x7f550413e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 --2- 172.21.15.144:0/3373486480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55040b5e00 0x7f55041547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 >> 172.21.15.144:0/3373486480 conn(0x7f550406bd00 msgr2=0x7f550415c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.757+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 shutdown_connections 2024-05-30T16:45:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:22.758+0000 7f5509a00640 1 -- 172.21.15.144:0/3373486480 wait complete. 2024-05-30T16:45:23.181 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:45:11.209778+0000', 'modified': '2024-05-30T16:45:14.274711+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5235}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5235': {'gid': 5235, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/4243254164', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 4243254164}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 4243254164}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5235, 'qdb_cluster': [5235]} 2024-05-30T16:45:23.181 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:45:23.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-30T16:45:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.388+0000 7f153d000640 1 Processor -- start 2024-05-30T16:45:23.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.388+0000 7f153d000640 1 -- start start 2024-05-30T16:45:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.390+0000 7f153d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b2de0 0x7f15380b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.390+0000 7f153d000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15380b4c70 0x7f15380c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.390+0000 7f153d000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1538140bf0 con 0x7f15380c5b40 2024-05-30T16:45:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.390+0000 7f153d000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f15380b50d0 con 0x7f15380b4c70 2024-05-30T16:45:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.390+0000 7f153d000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f153813e810 con 0x7f15380b2de0 2024-05-30T16:45:23.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.390+0000 7f1537400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b2de0 0x7f15380b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.391+0000 7f1536a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15380b4c70 0x7f15380c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.391+0000 7f1537400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b2de0 0x7f15380b4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:43802/0 (socket says 172.21.15.144:43802) 2024-05-30T16:45:23.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.391+0000 7f1537400640 1 -- 172.21.15.144:0/570595822 learned_addr learned my addr 172.21.15.144:0/570595822 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:23.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.391+0000 7f1536000640 1 -- 172.21.15.144:0/570595822 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609025802 0 0) 0x7f1538140bf0 con 0x7f15380c5b40 2024-05-30T16:45:23.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.391+0000 7f1536000640 1 -- 172.21.15.144:0/570595822 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f151c003520 con 0x7f15380c5b40 2024-05-30T16:45:23.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.392+0000 7f1537400640 1 -- 172.21.15.144:0/570595822 >> v2:172.21.15.149:3300/0 conn(0x7f15380b4c70 msgr2=0x7f15380c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:23.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.392+0000 7f1537400640 1 --2- 172.21.15.144:0/570595822 >> v2:172.21.15.149:3300/0 conn(0x7f15380b4c70 0x7f15380c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.392+0000 7f1537400640 1 -- 172.21.15.144:0/570595822 >> v1:172.21.15.149:6789/0 conn(0x7f15380c5b40 legacy=0x7f153815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.392+0000 7f1537400640 1 -- 172.21.15.144:0/570595822 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1538140ed0 con 0x7f15380b2de0 2024-05-30T16:45:23.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.392+0000 7f1536a00640 1 --2- 172.21.15.144:0/570595822 >> v2:172.21.15.149:3300/0 conn(0x7f15380b4c70 0x7f15380c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:45:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.393+0000 7f1537400640 1 --2- 172.21.15.144:0/570595822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b2de0 0x7f15380b4730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1528009870 tx=0x7f152802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6f10fad7ccbffe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.393+0000 7f1536000640 1 -- 172.21.15.144:0/570595822 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1528037070 con 0x7f15380b2de0 2024-05-30T16:45:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.393+0000 7f1536000640 1 -- 172.21.15.144:0/570595822 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1528032440 con 0x7f15380b2de0 2024-05-30T16:45:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.393+0000 7f1536000640 1 -- 172.21.15.144:0/570595822 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1528032810 con 0x7f15380b2de0 2024-05-30T16:45:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.394+0000 7f153d000640 1 -- 172.21.15.144:0/570595822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b2de0 msgr2=0x7f15380b4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.394+0000 7f153d000640 1 --2- 172.21.15.144:0/570595822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b2de0 0x7f15380b4730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1528009870 tx=0x7f152802a250 comp rx=0 tx=0).stop 2024-05-30T16:45:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.394+0000 7f153d000640 1 -- 172.21.15.144:0/570595822 shutdown_connections 2024-05-30T16:45:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.394+0000 7f153d000640 1 --2- 172.21.15.144:0/570595822 >> v2:172.21.15.149:3300/0 conn(0x7f15380b4c70 0x7f15380c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.394+0000 7f153d000640 1 --2- 172.21.15.144:0/570595822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b2de0 0x7f15380b4730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.394+0000 7f153d000640 1 -- 172.21.15.144:0/570595822 >> 172.21.15.144:0/570595822 conn(0x7f15380627b0 msgr2=0x7f153806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.394+0000 7f153d000640 1 -- 172.21.15.144:0/570595822 shutdown_connections 2024-05-30T16:45:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.394+0000 7f153d000640 1 -- 172.21.15.144:0/570595822 wait complete. 2024-05-30T16:45:23.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.396+0000 7f153d000640 1 Processor -- start 2024-05-30T16:45:23.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.396+0000 7f153d000640 1 -- start start 2024-05-30T16:45:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f153d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15380b2de0 0x7f1538072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f153d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b4c70 0x7f1538072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f153d000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15380c5b40 0x7f15381595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f153d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1538141770 con 0x7f15380b2de0 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f153d000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1538141490 con 0x7f15380c5b40 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f153d000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f15380c5fd0 con 0x7f15380b4c70 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f1537400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15380b2de0 0x7f1538072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f1537400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15380b2de0 0x7f1538072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47014/0 (socket says 172.21.15.144:47014) 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f1537400640 1 -- 172.21.15.144:0/316588951 learned_addr learned my addr 172.21.15.144:0/316588951 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f1537400640 1 -- 172.21.15.144:0/316588951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b4c70 msgr2=0x7f1538072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.397+0000 7f1537400640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b4c70 0x7f1538072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f1537400640 1 -- 172.21.15.144:0/316588951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15380c5b40 msgr2=0x7f15381595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f1537e00640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15380c5b40 0x7f15381595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f1537400640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15380c5b40 0x7f15381595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f1537400640 1 -- 172.21.15.144:0/316588951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153813b190 con 0x7f15380b2de0 2024-05-30T16:45:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f1537e00640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15380c5b40 0x7f15381595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f1537400640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15380b2de0 0x7f1538072560 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f152802a290 tx=0x7f15280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f152f400640 1 -- 172.21.15.144:0/316588951 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1528041020 con 0x7f15380b2de0 2024-05-30T16:45:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f152f400640 1 -- 172.21.15.144:0/316588951 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152803d620 con 0x7f15380b2de0 2024-05-30T16:45:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f152f400640 1 -- 172.21.15.144:0/316588951 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1528037040 con 0x7f15380b2de0 2024-05-30T16:45:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f153d000640 1 -- 172.21.15.144:0/316588951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153813b470 con 0x7f15380b2de0 2024-05-30T16:45:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.398+0000 7f153d000640 1 -- 172.21.15.144:0/316588951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f153813ba30 con 0x7f15380b2de0 2024-05-30T16:45:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.401+0000 7f152f400640 1 -- 172.21.15.144:0/316588951 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f1528044020 con 0x7f15380b2de0 2024-05-30T16:45:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.402+0000 7f152f400640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f151406cbc0 0x7f151406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.402+0000 7f152f400640 1 -- 172.21.15.144:0/316588951 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f15280ac750 con 0x7f15380b2de0 2024-05-30T16:45:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.403+0000 7f1536a00640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f151406cbc0 0x7f151406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.403+0000 7f1541467740 1 Processor -- start 2024-05-30T16:45:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.403+0000 7f1541467740 1 -- start start 2024-05-30T16:45:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.403+0000 7f1536a00640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f151406cbc0 0x7f151406f080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1520006e80 tx=0x7f1520006dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.404+0000 7f1541467740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e520450 0x555a3e568720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.404+0000 7f1541467740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e51f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.404+0000 7f1541467740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e51f740 0x555a3e56b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.404+0000 7f1541467740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555a3e488b10 con 0x555a3e520450 2024-05-30T16:45:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.404+0000 7f1541467740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555a3e42f2b0 con 0x555a3e51f740 2024-05-30T16:45:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.404+0000 7f1541467740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x555a3e484ad0 con 0x555a3e56a4e0 2024-05-30T16:45:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.404+0000 7f1537400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e520450 0x555a3e568720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.404+0000 7f1537400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e520450 0x555a3e568720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47022/0 (socket says 172.21.15.144:47022) 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.404+0000 7f1537400640 1 -- 172.21.15.144:0/405875091 learned_addr learned my addr 172.21.15.144:0/405875091 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1537e00640 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e51f740 0x555a3e56b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1536a00640 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e51f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1537400640 1 -- 172.21.15.144:0/405875091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 msgr2=0x555a3e51f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1537400640 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e51f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1537400640 1 -- 172.21.15.144:0/405875091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e51f740 msgr2=0x555a3e56b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1537400640 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e51f740 0x555a3e56b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1537400640 1 -- 172.21.15.144:0/405875091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a3e19b2d0 con 0x555a3e520450 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1537e00640 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e51f740 0x555a3e56b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1537400640 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e520450 0x555a3e568720 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f15280aa970 tx=0x7f1528079a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8634257f7a456a8f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1527e00640 1 -- 172.21.15.144:0/405875091 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152807e420 con 0x555a3e520450 2024-05-30T16:45:23.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1527e00640 1 -- 172.21.15.144:0/405875091 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1528082c50 con 0x555a3e520450 2024-05-30T16:45:23.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.405+0000 7f1527e00640 1 -- 172.21.15.144:0/405875091 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15280766e0 con 0x555a3e520450 2024-05-30T16:45:23.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.406+0000 7f1541467740 1 -- 172.21.15.144:0/405875091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e520450 msgr2=0x555a3e568720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.406+0000 7f1541467740 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e520450 0x555a3e568720 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f15280aa970 tx=0x7f1528079a90 comp rx=0 tx=0).stop 2024-05-30T16:45:23.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.406+0000 7f1541467740 1 -- 172.21.15.144:0/405875091 shutdown_connections 2024-05-30T16:45:23.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.406+0000 7f1541467740 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e51f740 0x555a3e56b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.406+0000 7f1541467740 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e51f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.406+0000 7f1541467740 1 --2- 172.21.15.144:0/405875091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e520450 0x555a3e568720 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.406+0000 7f1541467740 1 -- 172.21.15.144:0/405875091 >> 172.21.15.144:0/405875091 conn(0x555a3e521470 msgr2=0x555a3e522470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.406+0000 7f1541467740 1 -- 172.21.15.144:0/405875091 shutdown_connections 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.406+0000 7f1541467740 1 -- 172.21.15.144:0/405875091 wait complete. 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.407+0000 7f1541467740 1 -- start start 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.407+0000 7f1541467740 1 Processor -- start 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.408+0000 7f1541467740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e520450 0x555a3e543a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.408+0000 7f1541467740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e56a4e0 0x555a3e545670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.408+0000 7f1541467740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e545bb0 0x555a3e56d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.408+0000 7f1541467740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555a3e520830 con 0x555a3e56a4e0 2024-05-30T16:45:23.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.408+0000 7f1541467740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555a3e442570 con 0x555a3e545bb0 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.408+0000 7f1541467740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x555a3e5697b0 con 0x555a3e520450 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.408+0000 7f1541467740 10 client.0 _ll_register_callbacks cb 0x555a3e410fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.408+0000 7f1536a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e56a4e0 0x555a3e545670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1536a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e56a4e0 0x555a3e545670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47034/0 (socket says 172.21.15.144:47034) 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1536a00640 1 -- 172.21.15.144:0/2898974539 learned_addr learned my addr 172.21.15.144:0/2898974539 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1537e00640 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e545bb0 0x555a3e56d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1537400640 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e520450 0x555a3e543a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1536a00640 1 -- 172.21.15.144:0/2898974539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e520450 msgr2=0x555a3e543a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1536a00640 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e520450 0x555a3e543a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1536a00640 1 -- 172.21.15.144:0/2898974539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e545bb0 msgr2=0x555a3e56d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1536a00640 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e545bb0 0x555a3e56d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1536a00640 1 -- 172.21.15.144:0/2898974539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a3e2656b0 con 0x555a3e56a4e0 2024-05-30T16:45:23.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1537e00640 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e545bb0 0x555a3e56d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:45:23.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1536a00640 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e56a4e0 0x555a3e545670 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f15380cf8c0 tx=0x7f1520009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68701108091db7af server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.409+0000 7f1524c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1524c00640 1 -- 172.21.15.144:0/2898974539 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15200138a0 con 0x555a3e56a4e0 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1524c00640 1 -- 172.21.15.144:0/2898974539 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f1520013a40 con 0x555a3e56a4e0 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1541467740 1 -- 172.21.15.144:0/2898974539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1528082c50 con 0x555a3e56a4e0 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1524c00640 1 -- 172.21.15.144:0/2898974539 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f152002e050 con 0x555a3e56a4e0 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1541467740 10 client.5385 fetch_fsmap learned FSMap version 26 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1541467740 1 -- 172.21.15.144:0/2898974539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x555a3e523890 con 0x555a3e56a4e0 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1524c00640 1 -- 172.21.15.144:0/2898974539 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1528082c50 con 0x555a3e56a4e0 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1524c00640 1 -- 172.21.15.144:0/2898974539 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f1520031020 con 0x555a3e56a4e0 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1541467740 10 client.5385 fetch_fsmap finished waiting for FSMap version 26 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1541467740 10 client.5385 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T16:45:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1541467740 20 client.5385 populate_metadata read hostname 'smithi144' 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1541467740 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] conn(0x555a3e581b40 0x555a3e524bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1541467740 4 client.5385 mds_command: new command op to 5235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.410+0000 7f1541467740 1 -- 172.21.15.144:0/2898974539 --> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a3e496530 con 0x555a3e581b40 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.411+0000 7f1537400640 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] conn(0x555a3e581b40 0x555a3e524bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.411+0000 7f1537400640 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] conn(0x555a3e581b40 0x555a3e524bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21747ff449277e25 server_cookie=bb0b828c75246f2a in_seq=0 out_seq=0 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.411+0000 7f1524c00640 10 client.5385 ms_handle_connect on v2:172.21.15.144:6836/4243254164 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1524c00640 1 -- 172.21.15.144:0/2898974539 <== mds.0 v2:172.21.15.144:6836/4243254164 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555a3e496530 con 0x555a3e581b40 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1524c00640 10 client.5385 handle_command_reply: tid=0 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1541467740 1 client.5385 shutdown 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1541467740 1 -- 172.21.15.144:0/2898974539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e56a4e0 msgr2=0x555a3e545670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1541467740 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e56a4e0 0x555a3e545670 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f15380cf8c0 tx=0x7f1520009190 comp rx=0 tx=0).stop 2024-05-30T16:45:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1541467740 1 -- 172.21.15.144:0/2898974539 shutdown_connections 2024-05-30T16:45:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1541467740 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] conn(0x555a3e581b40 0x555a3e524bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1541467740 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e545bb0 0x555a3e56d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1541467740 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e56a4e0 0x555a3e545670 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1541467740 1 --2- 172.21.15.144:0/2898974539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e520450 0x555a3e543a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1541467740 1 -- 172.21.15.144:0/2898974539 >> 172.21.15.144:0/2898974539 conn(0x555a3e51f740 msgr2=0x555a3e5699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.412+0000 7f1524c00640 0 client.5385 ms_handle_reset on v2:172.21.15.144:6836/4243254164 2024-05-30T16:45:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.413+0000 7f1541467740 1 -- 172.21.15.144:0/2898974539 shutdown_connections 2024-05-30T16:45:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.413+0000 7f1541467740 1 -- 172.21.15.144:0/2898974539 wait complete. 2024-05-30T16:45:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.413+0000 7f1541467740 20 client.5385 trim_cache size 0 max 16384 2024-05-30T16:45:23.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.432+0000 7f1541467740 1 Processor -- start 2024-05-30T16:45:23.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.433+0000 7f1541467740 1 -- start start 2024-05-30T16:45:23.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1541467740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 0x555a3e54a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1541467740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e5444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1541467740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e544a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1541467740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1538156d00 con 0x555a3e545bb0 2024-05-30T16:45:23.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1541467740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1538156060 con 0x555a3e520450 2024-05-30T16:45:23.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1541467740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f15381566b0 con 0x555a3e56a4e0 2024-05-30T16:45:23.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1536a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e5444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1536a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e5444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47048/0 (socket says 172.21.15.144:47048) 2024-05-30T16:45:23.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1536a00640 1 -- 172.21.15.144:0/3192465876 learned_addr learned my addr 172.21.15.144:0/3192465876 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:23.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1537400640 1 --2- 172.21.15.144:0/3192465876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 0x555a3e54a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1536a00640 1 -- 172.21.15.144:0/3192465876 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 msgr2=0x555a3e544a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1537e00640 1 --2- 172.21.15.144:0/3192465876 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e544a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1536a00640 1 --2- 172.21.15.144:0/3192465876 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e544a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1536a00640 1 -- 172.21.15.144:0/3192465876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 msgr2=0x555a3e54a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1536a00640 1 --2- 172.21.15.144:0/3192465876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 0x555a3e54a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.434+0000 7f1536a00640 1 -- 172.21.15.144:0/3192465876 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a3e56ded0 con 0x555a3e545bb0 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.435+0000 7f1536a00640 1 --2- 172.21.15.144:0/3192465876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e5444d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f152000efa0 tx=0x7f152001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92d5caa1d8b8875 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.435+0000 7f1527400640 1 -- 172.21.15.144:0/3192465876 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520004020 con 0x555a3e545bb0 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.435+0000 7f1527400640 1 -- 172.21.15.144:0/3192465876 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1520026070 con 0x555a3e545bb0 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.435+0000 7f1527400640 1 -- 172.21.15.144:0/3192465876 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520004400 con 0x555a3e545bb0 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 -- 172.21.15.144:0/3192465876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 msgr2=0x555a3e5444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 --2- 172.21.15.144:0/3192465876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e5444d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f152000efa0 tx=0x7f152001e000 comp rx=0 tx=0).stop 2024-05-30T16:45:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 -- 172.21.15.144:0/3192465876 shutdown_connections 2024-05-30T16:45:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 --2- 172.21.15.144:0/3192465876 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e544a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 --2- 172.21.15.144:0/3192465876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e5444d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 --2- 172.21.15.144:0/3192465876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 0x555a3e54a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 -- 172.21.15.144:0/3192465876 >> 172.21.15.144:0/3192465876 conn(0x555a3e51f740 msgr2=0x555a3e543880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 -- 172.21.15.144:0/3192465876 shutdown_connections 2024-05-30T16:45:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 -- 172.21.15.144:0/3192465876 wait complete. 2024-05-30T16:45:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.436+0000 7f1541467740 1 -- start start 2024-05-30T16:45:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.437+0000 7f1541467740 1 Processor -- start 2024-05-30T16:45:23.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1541467740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 0x555a3e580360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1541467740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e522620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1541467740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e522b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1541467740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555a3e5819c0 con 0x555a3e545bb0 2024-05-30T16:45:23.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1541467740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555a3e523bd0 con 0x555a3e520450 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1541467740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x555a3e582010 con 0x555a3e56a4e0 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1541467740 10 client.0 _ll_register_callbacks cb 0x7f1520009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1536a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e522620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1536a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e522620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47064/0 (socket says 172.21.15.144:47064) 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1536a00640 1 -- 172.21.15.144:0/3790018707 learned_addr learned my addr 172.21.15.144:0/3790018707 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1537400640 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 0x555a3e580360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1537e00640 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e522b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1536a00640 1 -- 172.21.15.144:0/3790018707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 msgr2=0x555a3e522b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1536a00640 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e522b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1536a00640 1 -- 172.21.15.144:0/3790018707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 msgr2=0x555a3e580360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1536a00640 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 0x555a3e580360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1536a00640 1 -- 172.21.15.144:0/3790018707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a3e5808a0 con 0x555a3e545bb0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.438+0000 7f1537e00640 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e522b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.439+0000 7f1536a00640 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e522620 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1520009880 tx=0x7f1520016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd894509c805869f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.439+0000 7f1524c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.439+0000 7f1524c00640 1 -- 172.21.15.144:0/3790018707 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520005b90 con 0x555a3e545bb0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.439+0000 7f1524c00640 1 -- 172.21.15.144:0/3790018707 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f1520005d30 con 0x555a3e545bb0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.439+0000 7f1541467740 1 -- 172.21.15.144:0/3790018707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1520026070 con 0x555a3e545bb0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.439+0000 7f1524c00640 1 -- 172.21.15.144:0/3790018707 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f152004c050 con 0x555a3e545bb0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.439+0000 7f1541467740 10 client.5391 fetch_fsmap learned FSMap version 26 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.439+0000 7f1541467740 1 -- 172.21.15.144:0/3790018707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x555a3e5696a0 con 0x555a3e545bb0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1524c00640 1 -- 172.21.15.144:0/3790018707 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1520026070 con 0x555a3e545bb0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1524c00640 1 -- 172.21.15.144:0/3790018707 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f152004f020 con 0x555a3e545bb0 2024-05-30T16:45:23.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1541467740 10 client.5391 fetch_fsmap finished waiting for FSMap version 26 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1541467740 10 client.5391 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1541467740 20 client.5391 populate_metadata read hostname 'smithi144' 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1541467740 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] conn(0x555a3e591020 0x555a3e5ead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1541467740 4 client.5391 mds_command: new command op to 5235 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1541467740 1 -- 172.21.15.144:0/3790018707 --> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] -- command(tid 0: {"prefix": "status"}) -- 0x555a3e4903a0 con 0x555a3e591020 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1537400640 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] conn(0x555a3e591020 0x555a3e5ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1537400640 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] conn(0x555a3e591020 0x555a3e5ead00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d323745aaccd5ab9 server_cookie=b97cdcc98315ba33 in_seq=0 out_seq=0 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.440+0000 7f1524c00640 10 client.5391 ms_handle_connect on v2:172.21.15.144:6836/4243254164 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1524c00640 1 -- 172.21.15.144:0/3790018707 <== mds.0 v2:172.21.15.144:6836/4243254164 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x555a3e4903a0 con 0x555a3e591020 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1524c00640 10 client.5391 handle_command_reply: tid=0 2024-05-30T16:45:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 client.5391 shutdown 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 -- 172.21.15.144:0/3790018707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 msgr2=0x555a3e522620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e522620 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1520009880 tx=0x7f1520016000 comp rx=0 tx=0).stop 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 -- 172.21.15.144:0/3790018707 shutdown_connections 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x555a3e56a4e0 0x555a3e522b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555a3e545bb0 0x555a3e522620 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.144:6836/4243254164,v1:172.21.15.144:6837/4243254164] conn(0x555a3e591020 0x555a3e5ead00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 --2- 172.21.15.144:0/3790018707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a3e520450 0x555a3e580360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1524c00640 0 client.5391 ms_handle_reset on v2:172.21.15.144:6836/4243254164 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 -- 172.21.15.144:0/3790018707 >> 172.21.15.144:0/3790018707 conn(0x555a3e51f740 msgr2=0x555a3e525e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 -- 172.21.15.144:0/3790018707 shutdown_connections 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 1 -- 172.21.15.144:0/3790018707 wait complete. 2024-05-30T16:45:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.441+0000 7f1541467740 20 client.5391 trim_cache size 0 max 16384 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5235, 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 11.680066983, 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 26, 2024-05-30T16:45:23.448 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 44, 2024-05-30T16:45:23.449 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 44, 2024-05-30T16:45:23.449 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 16.156008519 2024-05-30T16:45:23.449 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:45:23.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 -- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f151406cbc0 msgr2=0x7f151406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f151406cbc0 0x7f151406f080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1520006e80 tx=0x7f1520006dd0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 -- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15380b2de0 msgr2=0x7f1538072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15380b2de0 0x7f1538072560 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f152802a290 tx=0x7f15280046c0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 -- 172.21.15.144:0/316588951 shutdown_connections 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f151406cbc0 0x7f151406f080 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15380c5b40 0x7f15381595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f15380b4c70 0x7f1538072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 --2- 172.21.15.144:0/316588951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15380b2de0 0x7f1538072560 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 -- 172.21.15.144:0/316588951 >> 172.21.15.144:0/316588951 conn(0x7f15380627b0 msgr2=0x7f1538071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 -- 172.21.15.144:0/316588951 shutdown_connections 2024-05-30T16:45:23.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.442+0000 7f153d000640 1 -- 172.21.15.144:0/316588951 wait complete. 2024-05-30T16:45:23.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:45:23.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.651+0000 7f7c82e00640 1 Processor -- start 2024-05-30T16:45:23.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.651+0000 7f7c82e00640 1 -- start start 2024-05-30T16:45:23.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.653+0000 7f7c82e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c072210 0x7f7c7c072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.653+0000 7f7c82e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c7c06fbf0 con 0x7f7c7c0b4140 2024-05-30T16:45:23.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.653+0000 7f7c82e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c7c0cf050 con 0x7f7c7c14c630 2024-05-30T16:45:23.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.653+0000 7f7c82e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7c072ba0 con 0x7f7c7c072210 2024-05-30T16:45:23.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.653+0000 7f7c80e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7c7c0b4140 0x7f7c7c0b45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45450/0 (socket says 172.21.15.144:45450) 2024-05-30T16:45:23.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.653+0000 7f7c80e00640 1 -- 172.21.15.144:0/3249788869 learned_addr learned my addr 172.21.15.144:0/3249788869 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:23.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.653+0000 7f7c73400640 1 --2- 172.21.15.144:0/3249788869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c072210 0x7f7c7c072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.654+0000 7f7c7b400640 1 -- 172.21.15.144:0/3249788869 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790139338 0 0) 0x7f7c7c06fbf0 con 0x7f7c7c0b4140 2024-05-30T16:45:23.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.654+0000 7f7c7b400640 1 -- 172.21.15.144:0/3249788869 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c60003520 con 0x7f7c7c0b4140 2024-05-30T16:45:23.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.654+0000 7f7c73400640 1 -- 172.21.15.144:0/3249788869 >> v1:172.21.15.149:6789/0 conn(0x7f7c7c14c630 legacy=0x7f7c7c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.654+0000 7f7c7b400640 1 -- 172.21.15.144:0/3249788869 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2452351915 0 0) 0x7f7c60003520 con 0x7f7c7c0b4140 2024-05-30T16:45:23.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.654+0000 7f7c73400640 1 -- 172.21.15.144:0/3249788869 >> v1:172.21.15.144:6789/0 conn(0x7f7c7c0b4140 legacy=0x7f7c7c0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.654+0000 7f7c73400640 1 -- 172.21.15.144:0/3249788869 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c0cf330 con 0x7f7c7c072210 2024-05-30T16:45:23.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.655+0000 7f7c73400640 1 --2- 172.21.15.144:0/3249788869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c072210 0x7f7c7c072660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7c640097d0 tx=0x7f7c6402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bff71f5f727fc234 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.656+0000 7f7c7b400640 1 -- 172.21.15.144:0/3249788869 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64037070 con 0x7f7c7c072210 2024-05-30T16:45:23.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.656+0000 7f7c7b400640 1 -- 172.21.15.144:0/3249788869 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6402acc0 con 0x7f7c7c072210 2024-05-30T16:45:23.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.656+0000 7f7c7b400640 1 -- 172.21.15.144:0/3249788869 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74001a10 con 0x7f7c7c072210 2024-05-30T16:45:23.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.656+0000 7f7c82e00640 1 -- 172.21.15.144:0/3249788869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c072210 msgr2=0x7f7c7c072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.656+0000 7f7c82e00640 1 --2- 172.21.15.144:0/3249788869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c072210 0x7f7c7c072660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7c640097d0 tx=0x7f7c6402a230 comp rx=0 tx=0).stop 2024-05-30T16:45:23.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.656+0000 7f7c82e00640 1 -- 172.21.15.144:0/3249788869 shutdown_connections 2024-05-30T16:45:23.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.656+0000 7f7c82e00640 1 --2- 172.21.15.144:0/3249788869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c072210 0x7f7c7c072660 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.656+0000 7f7c82e00640 1 -- 172.21.15.144:0/3249788869 >> 172.21.15.144:0/3249788869 conn(0x7f7c7c06bd00 msgr2=0x7f7c7c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:23.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.657+0000 7f7c82e00640 1 -- 172.21.15.144:0/3249788869 shutdown_connections 2024-05-30T16:45:23.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.657+0000 7f7c82e00640 1 -- 172.21.15.144:0/3249788869 wait complete. 2024-05-30T16:45:23.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.658+0000 7f7c82e00640 1 Processor -- start 2024-05-30T16:45:23.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.659+0000 7f7c82e00640 1 -- start start 2024-05-30T16:45:23.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.659+0000 7f7c82e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c7c072210 0x7f7c7c1fc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.659+0000 7f7c82e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c0b4140 0x7f7c7c1e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c82e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c14c630 0x7f7c7c0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c82e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c0b3c20 con 0x7f7c7c072210 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c82e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c0cf8f0 con 0x7f7c7c0b4140 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c82e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7c14ca10 con 0x7f7c7c14c630 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c7be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c7c072210 0x7f7c7c1fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c7be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c7c072210 0x7f7c7c1fc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47068/0 (socket says 172.21.15.144:47068) 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c7be00640 1 -- 172.21.15.144:0/819769783 learned_addr learned my addr 172.21.15.144:0/819769783 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c80e00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c14c630 0x7f7c7c0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c73400640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c0b4140 0x7f7c7c1e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c7be00640 1 -- 172.21.15.144:0/819769783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c14c630 msgr2=0x7f7c7c0a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c7be00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c14c630 0x7f7c7c0a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c7be00640 1 -- 172.21.15.144:0/819769783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c0b4140 msgr2=0x7f7c7c1e8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c7be00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c0b4140 0x7f7c7c1e8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.660+0000 7f7c7be00640 1 -- 172.21.15.144:0/819769783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c1fc8b0 con 0x7f7c7c072210 2024-05-30T16:45:23.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.661+0000 7f7c7be00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c7c072210 0x7f7c7c1fc370 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00c400 tx=0x7f7c6c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.661+0000 7f7c78c00640 1 -- 172.21.15.144:0/819769783 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c017070 con 0x7f7c7c072210 2024-05-30T16:45:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.661+0000 7f7c78c00640 1 -- 172.21.15.144:0/819769783 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6c0052d0 con 0x7f7c7c072210 2024-05-30T16:45:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.661+0000 7f7c78c00640 1 -- 172.21.15.144:0/819769783 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c003830 con 0x7f7c7c072210 2024-05-30T16:45:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.661+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7c1fcb50 con 0x7f7c7c072210 2024-05-30T16:45:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.661+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7c1fd110 con 0x7f7c7c072210 2024-05-30T16:45:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.662+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7c068b90 con 0x7f7c7c072210 2024-05-30T16:45:23.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.663+0000 7f7c78c00640 1 -- 172.21.15.144:0/819769783 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f7c6c01a070 con 0x7f7c7c072210 2024-05-30T16:45:23.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.664+0000 7f7c78c00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7c5806cbc0 0x7f7c5806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:23.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.664+0000 7f7c78c00640 1 -- 172.21.15.144:0/819769783 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f7c6c08b350 con 0x7f7c7c072210 2024-05-30T16:45:23.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.664+0000 7f7c73400640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7c5806cbc0 0x7f7c5806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:23.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.665+0000 7f7c73400640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7c5806cbc0 0x7f7c5806f080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c64034000 tx=0x7f7c6402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:23.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.669+0000 7f7c78c00640 1 -- 172.21.15.144:0/819769783 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c6c0593f0 con 0x7f7c7c072210 2024-05-30T16:45:23.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.915+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7c7c0b06d0 con 0x7f7c7c072210 2024-05-30T16:45:23.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.916+0000 7f7c78c00640 1 -- 172.21.15.144:0/819769783 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f7c6c058cf0 con 0x7f7c7c072210 2024-05-30T16:45:23.917 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:45:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.918+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7c5806cbc0 msgr2=0x7f7c5806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.918+0000 7f7c82e00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7c5806cbc0 0x7f7c5806f080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c64034000 tx=0x7f7c6402e000 comp rx=0 tx=0).stop 2024-05-30T16:45:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.918+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c7c072210 msgr2=0x7f7c7c1fc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.918+0000 7f7c82e00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c7c072210 0x7f7c7c1fc370 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00c400 tx=0x7f7c6c00c8c0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.919+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 shutdown_connections 2024-05-30T16:45:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.919+0000 7f7c82e00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7c5806cbc0 0x7f7c5806f080 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.919+0000 7f7c82e00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c7c14c630 0x7f7c7c0a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.919+0000 7f7c82e00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c0b4140 0x7f7c7c1e8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.919+0000 7f7c82e00640 1 --2- 172.21.15.144:0/819769783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c7c072210 0x7f7c7c1fc370 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:23.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.919+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 >> 172.21.15.144:0/819769783 conn(0x7f7c7c06bd00 msgr2=0x7f7c7c074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:23.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.919+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 shutdown_connections 2024-05-30T16:45:23.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:23.919+0000 7f7c82e00640 1 -- 172.21.15.144:0/819769783 wait complete. 2024-05-30T16:45:23.938 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T16:45:23.938 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:45:23.938 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-05-30T16:45:23.938 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:45:23.938 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:45:23.938 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T16:45:23.938 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T16:45:23.938 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:45:23.938 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:45:23.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:23.939 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-05-30T16:45:23.986 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:45:23.986 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:45:23.986 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:45:23.986 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:45:23.986 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-05-30T16:45:23.986 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:45:23.986 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42363sec preferred_lft 42363sec 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:45:23.987 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9019:bbff:fe7f:ed10/64 scope link 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9c4d:5aff:fe40:b9d1/64 scope link 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:dc:91:e3:69:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9cdc:91ff:fee3:6906/64 scope link 2024-05-30T16:45:23.988 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:45:23.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:23.989 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:45:24.105 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-05-30T16:45:24.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:24.109 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-05-30T16:45:24.155 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-05-30T16:45:24.155 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:45:24.155 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:45:24.155 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:45:24.155 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:45:24.155 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:45:24.156 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:45:24.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:45:24.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:45:24.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:45:24.156 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:45:24.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:45:24.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:45:24.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:24.407 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:45:24.453 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:45:24.453 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:45:24.454 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:45:24.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:24.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-05-30T16:45:24.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:45:24.585 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:45:24.639 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:45:24.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:45:24.641 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:45:24.692 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T16:45:24.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:24.692 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:45:24.812 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:45:24.812 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:45:24.847 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:45:24.847 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:45:24.847 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-05-30T16:45:24.847 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@865cdc9a-e28b-4870-8751-0312b261bc38.cephfs=/ 2024-05-30T16:45:24.847 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-05-30T16:45:24.849 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-30T16:45:24.849 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-05-30T16:45:24.849 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-30T16:45:24.849 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-05-30T16:45:24.849 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-30T16:45:24.852 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T16:45:24.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:24.853 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:45:24.921 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:45:25.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:45:25.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:45:25.054 INFO:teuthology.orchestra.run.smithi144.stdout:client4748 2024-05-30T16:45:25.054 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:45:25.054 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:25.100 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T16:45:25.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.348+0000 7f9dc1200640 1 Processor -- start 2024-05-30T16:45:25.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.348+0000 7f9dc1200640 1 -- start start 2024-05-30T16:45:25.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.350+0000 7f9dc1200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9dbc13f760 0x7f9dbc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:25.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.350+0000 7f9dc1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc0b5fd0 0x7f9dbc142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:25.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.350+0000 7f9dc1200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dbc06ee80 con 0x7f9dbc0cec70 2024-05-30T16:45:25.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.350+0000 7f9dc1200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9dbc1612b0 con 0x7f9dbc13f760 2024-05-30T16:45:25.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.350+0000 7f9dc1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9dbc13fb40 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.350+0000 7f9db9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9dbc13f760 0x7f9dbc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:25.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.350+0000 7f9db1400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9dbc0cec70 0x7f9dbc0b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60622/0 (socket says 172.21.15.144:60622) 2024-05-30T16:45:25.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.350+0000 7f9db1400640 1 -- 172.21.15.144:0/481741535 learned_addr learned my addr 172.21.15.144:0/481741535 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:25.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.351+0000 7f9dba800640 1 --2- 172.21.15.144:0/481741535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc0b5fd0 0x7f9dbc142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:25.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.351+0000 7f9db9e00640 1 -- 172.21.15.144:0/481741535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc0b5fd0 msgr2=0x7f9dbc142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:25.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.351+0000 7f9db9e00640 1 --2- 172.21.15.144:0/481741535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc0b5fd0 0x7f9dbc142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.351+0000 7f9db9e00640 1 -- 172.21.15.144:0/481741535 >> v1:172.21.15.144:6789/0 conn(0x7f9dbc0cec70 legacy=0x7f9dbc0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:25.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.351+0000 7f9db9e00640 1 -- 172.21.15.144:0/481741535 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dbc160730 con 0x7f9dbc13f760 2024-05-30T16:45:25.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.352+0000 7f9db9e00640 1 --2- 172.21.15.144:0/481741535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc13f760 0x7f9dbc06e940 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009d90 tx=0x7f9dac02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7b5d8dd08a0c26 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:25.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.352+0000 7f9db9400640 1 -- 172.21.15.144:0/481741535 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007740 con 0x7f9dbc13f760 2024-05-30T16:45:25.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.352+0000 7f9db9400640 1 -- 172.21.15.144:0/481741535 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dac0078e0 con 0x7f9dbc13f760 2024-05-30T16:45:25.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.352+0000 7f9db9400640 1 -- 172.21.15.144:0/481741535 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007cb0 con 0x7f9dbc13f760 2024-05-30T16:45:25.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.353+0000 7f9dc1200640 1 -- 172.21.15.144:0/481741535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc13f760 msgr2=0x7f9dbc06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:25.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.353+0000 7f9dc1200640 1 --2- 172.21.15.144:0/481741535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc13f760 0x7f9dbc06e940 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009d90 tx=0x7f9dac02a6f0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.353+0000 7f9dc1200640 1 -- 172.21.15.144:0/481741535 shutdown_connections 2024-05-30T16:45:25.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.353+0000 7f9dc1200640 1 --2- 172.21.15.144:0/481741535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc0b5fd0 0x7f9dbc142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.353+0000 7f9dc1200640 1 --2- 172.21.15.144:0/481741535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc13f760 0x7f9dbc06e940 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.353+0000 7f9dc1200640 1 -- 172.21.15.144:0/481741535 >> 172.21.15.144:0/481741535 conn(0x7f9dbc06bd00 msgr2=0x7f9dbc06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:25.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.353+0000 7f9dc1200640 1 -- 172.21.15.144:0/481741535 shutdown_connections 2024-05-30T16:45:25.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.353+0000 7f9dc1200640 1 -- 172.21.15.144:0/481741535 wait complete. 2024-05-30T16:45:25.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.355+0000 7f9dc1200640 1 Processor -- start 2024-05-30T16:45:25.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.355+0000 7f9dc1200640 1 -- start start 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9dc1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc0b5fd0 0x7f9dbc152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9dc1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dbc0cec70 0x7f9dbc13fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9dc1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc13f760 0x7f9dbc140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9dc1200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc160fd0 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9dc1200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc160cf0 con 0x7f9dbc0cec70 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9dc1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9dbc0cf0d0 con 0x7f9dbc13f760 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9db9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc0b5fd0 0x7f9dbc152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9db9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc0b5fd0 0x7f9dbc152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47930/0 (socket says 172.21.15.144:47930) 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9db9e00640 1 -- 172.21.15.144:0/2651654718 learned_addr learned my addr 172.21.15.144:0/2651654718 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9dba800640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc13f760 0x7f9dbc140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9db1400640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dbc0cec70 0x7f9dbc13fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9db9e00640 1 -- 172.21.15.144:0/2651654718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc13f760 msgr2=0x7f9dbc140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:25.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9db9e00640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc13f760 0x7f9dbc140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9db9e00640 1 -- 172.21.15.144:0/2651654718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dbc0cec70 msgr2=0x7f9dbc13fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:25.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9db9e00640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dbc0cec70 0x7f9dbc13fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9db9e00640 1 -- 172.21.15.144:0/2651654718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dbc155e00 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.356+0000 7f9dba800640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc13f760 0x7f9dbc140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:25.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.357+0000 7f9db9e00640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc0b5fd0 0x7f9dbc152e10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009d90 tx=0x7f9dac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:25.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.357+0000 7f9db2a00640 1 -- 172.21.15.144:0/2651654718 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac03f070 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.357+0000 7f9db2a00640 1 -- 172.21.15.144:0/2651654718 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dac031c40 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.357+0000 7f9db2a00640 1 -- 172.21.15.144:0/2651654718 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac044460 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.357+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dbc1560e0 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.357+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dbc1566a0 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.358+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dbc068b90 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.359+0000 7f9db2a00640 1 -- 172.21.15.144:0/2651654718 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f9dac044600 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.360+0000 7f9db2a00640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d9806cbc0 0x7f9d9806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:25.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.360+0000 7f9db2a00640 1 -- 172.21.15.144:0/2651654718 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f9dac0ada90 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.361+0000 7f9db1400640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d9806cbc0 0x7f9d9806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:25.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.361+0000 7f9db1400640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d9806cbc0 0x7f9d9806f080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc06c490 tx=0x7f9da4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:25.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.365+0000 7f9db2a00640 1 -- 172.21.15.144:0/2651654718 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9dac07b940 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.604+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f9dbc13e600 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.853+0000 7f9db2a00640 1 -- 172.21.15.144:0/2651654718 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v27) ==== 136+0+0 (secure 0 0 0) 0x7f9dac07b240 con 0x7f9dbc0b5fd0 2024-05-30T16:45:25.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.856+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d9806cbc0 msgr2=0x7f9d9806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:25.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.856+0000 7f9dc1200640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d9806cbc0 0x7f9d9806f080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc06c490 tx=0x7f9da4009040 comp rx=0 tx=0).stop 2024-05-30T16:45:25.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.856+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc0b5fd0 msgr2=0x7f9dbc152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:25.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.856+0000 7f9dc1200640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc0b5fd0 0x7f9dbc152e10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009d90 tx=0x7f9dac004a40 comp rx=0 tx=0).stop 2024-05-30T16:45:25.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.857+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 shutdown_connections 2024-05-30T16:45:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.857+0000 7f9dc1200640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d9806cbc0 0x7f9d9806f080 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.857+0000 7f9dc1200640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9dbc13f760 0x7f9dbc140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.857+0000 7f9dc1200640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9dbc0cec70 0x7f9dbc13fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.857+0000 7f9dc1200640 1 --2- 172.21.15.144:0/2651654718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dbc0b5fd0 0x7f9dbc152e10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.857+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 >> 172.21.15.144:0/2651654718 conn(0x7f9dbc06bd00 msgr2=0x7f9dbc06f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.857+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 shutdown_connections 2024-05-30T16:45:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:25.857+0000 7f9dc1200640 1 -- 172.21.15.144:0/2651654718 wait complete. 2024-05-30T16:45:25.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:45:26.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.085+0000 7fbf46c00640 1 Processor -- start 2024-05-30T16:45:26.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.086+0000 7fbf46c00640 1 -- start start 2024-05-30T16:45:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.087+0000 7fbf46c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf40162680 0x7fbf400b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.087+0000 7fbf46c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf400b41f0 0x7fbf4006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.087+0000 7fbf46c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf40163570 con 0x7fbf40163190 2024-05-30T16:45:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.087+0000 7fbf46c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4006bb10 con 0x7fbf400b41f0 2024-05-30T16:45:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.087+0000 7fbf46c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fbf400d1850 con 0x7fbf40162680 2024-05-30T16:45:26.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.087+0000 7fbf44c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf400b41f0 0x7fbf4006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.088+0000 7fbf44c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf400b41f0 0x7fbf4006bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47942/0 (socket says 172.21.15.144:47942) 2024-05-30T16:45:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.088+0000 7fbf44c00640 1 -- 172.21.15.144:0/3547436709 learned_addr learned my addr 172.21.15.144:0/3547436709 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.088+0000 7fbf37400640 1 --2- 172.21.15.144:0/3547436709 >> v2:172.21.15.149:3300/0 conn(0x7fbf40162680 0x7fbf400b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.088+0000 7fbf44c00640 1 -- 172.21.15.144:0/3547436709 >> v2:172.21.15.149:3300/0 conn(0x7fbf40162680 msgr2=0x7fbf400b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.088+0000 7fbf44c00640 1 --2- 172.21.15.144:0/3547436709 >> v2:172.21.15.149:3300/0 conn(0x7fbf40162680 0x7fbf400b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.088+0000 7fbf44c00640 1 -- 172.21.15.144:0/3547436709 >> v1:172.21.15.149:6789/0 conn(0x7fbf40163190 legacy=0x7fbf4015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.088+0000 7fbf44c00640 1 -- 172.21.15.144:0/3547436709 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4015f800 con 0x7fbf400b41f0 2024-05-30T16:45:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.089+0000 7fbf44c00640 1 --2- 172.21.15.144:0/3547436709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf400b41f0 0x7fbf4006bfa0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbf40160200 tx=0x7fbf3802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676271cac2b13653 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:26.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.090+0000 7fbf3f400640 1 -- 172.21.15.144:0/3547436709 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38036070 con 0x7fbf400b41f0 2024-05-30T16:45:26.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.090+0000 7fbf3f400640 1 -- 172.21.15.144:0/3547436709 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf38031600 con 0x7fbf400b41f0 2024-05-30T16:45:26.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.090+0000 7fbf3f400640 1 -- 172.21.15.144:0/3547436709 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf380319d0 con 0x7fbf400b41f0 2024-05-30T16:45:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.090+0000 7fbf46c00640 1 -- 172.21.15.144:0/3547436709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf400b41f0 msgr2=0x7fbf4006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.090+0000 7fbf46c00640 1 --2- 172.21.15.144:0/3547436709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf400b41f0 0x7fbf4006bfa0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbf40160200 tx=0x7fbf3802a6f0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.091+0000 7fbf46c00640 1 -- 172.21.15.144:0/3547436709 shutdown_connections 2024-05-30T16:45:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.091+0000 7fbf46c00640 1 --2- 172.21.15.144:0/3547436709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf400b41f0 0x7fbf4006bfa0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.091+0000 7fbf46c00640 1 --2- 172.21.15.144:0/3547436709 >> v2:172.21.15.149:3300/0 conn(0x7fbf40162680 0x7fbf400b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.091+0000 7fbf46c00640 1 -- 172.21.15.144:0/3547436709 >> 172.21.15.144:0/3547436709 conn(0x7fbf400b3070 msgr2=0x7fbf400d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.091+0000 7fbf46c00640 1 -- 172.21.15.144:0/3547436709 shutdown_connections 2024-05-30T16:45:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.091+0000 7fbf46c00640 1 -- 172.21.15.144:0/3547436709 wait complete. 2024-05-30T16:45:26.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.092+0000 7fbf46c00640 1 Processor -- start 2024-05-30T16:45:26.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.093+0000 7fbf46c00640 1 -- start start 2024-05-30T16:45:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.093+0000 7fbf46c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf400b41f0 0x7fbf401561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.093+0000 7fbf46c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf40162680 0x7fbf40157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.093+0000 7fbf46c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf40163190 0x7fbf40152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.093+0000 7fbf46c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4015fdc0 con 0x7fbf40162680 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.093+0000 7fbf46c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbf400b4620 con 0x7fbf400b41f0 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.093+0000 7fbf46c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4006c4e0 con 0x7fbf40163190 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf40162680 0x7fbf40157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf40162680 0x7fbf40157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47948/0 (socket says 172.21.15.144:47948) 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf37400640 1 -- 172.21.15.144:0/2488449905 learned_addr learned my addr 172.21.15.144:0/2488449905 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf44c00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf40163190 0x7fbf40152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf3fe00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf400b41f0 0x7fbf401561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf37400640 1 -- 172.21.15.144:0/2488449905 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf40163190 msgr2=0x7fbf40152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf37400640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf40163190 0x7fbf40152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf37400640 1 -- 172.21.15.144:0/2488449905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf400b41f0 msgr2=0x7fbf401561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf37400640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf400b41f0 0x7fbf401561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.094+0000 7fbf37400640 1 -- 172.21.15.144:0/2488449905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf40156b10 con 0x7fbf40162680 2024-05-30T16:45:26.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.095+0000 7fbf37400640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf40162680 0x7fbf40157bb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800d800 tx=0x7fbf2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:26.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.095+0000 7fbf3cc00640 1 -- 172.21.15.144:0/2488449905 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800b6c0 con 0x7fbf40162680 2024-05-30T16:45:26.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.095+0000 7fbf3cc00640 1 -- 172.21.15.144:0/2488449905 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf28019070 con 0x7fbf40162680 2024-05-30T16:45:26.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.095+0000 7fbf3cc00640 1 -- 172.21.15.144:0/2488449905 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800ba80 con 0x7fbf40162680 2024-05-30T16:45:26.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.095+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf40156df0 con 0x7fbf40162680 2024-05-30T16:45:26.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.095+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf401573b0 con 0x7fbf40162680 2024-05-30T16:45:26.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.096+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf40068b20 con 0x7fbf40162680 2024-05-30T16:45:26.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.097+0000 7fbf3cc00640 1 -- 172.21.15.144:0/2488449905 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fbf2800bc20 con 0x7fbf40162680 2024-05-30T16:45:26.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.098+0000 7fbf3cc00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf1c06cbc0 0x7fbf1c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.098+0000 7fbf3cc00640 1 -- 172.21.15.144:0/2488449905 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fbf2808c4a0 con 0x7fbf40162680 2024-05-30T16:45:26.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.098+0000 7fbf3fe00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf1c06cbc0 0x7fbf1c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.099+0000 7fbf3fe00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf1c06cbc0 0x7fbf1c06f080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006fd0 tx=0x7fbf30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:26.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.103+0000 7fbf3cc00640 1 -- 172.21.15.144:0/2488449905 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf2805a580 con 0x7fbf40162680 2024-05-30T16:45:26.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.325+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fbf40075830 con 0x7fbf1c06cbc0 2024-05-30T16:45:26.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.327+0000 7fbf3cc00640 1 -- 172.21.15.144:0/2488449905 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fbf40075830 con 0x7fbf1c06cbc0 2024-05-30T16:45:26.328 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:45:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:45:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-05-30T16:45:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:45:26.328 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:45:26.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf1c06cbc0 msgr2=0x7fbf1c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf1c06cbc0 0x7fbf1c06f080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006fd0 tx=0x7fbf30008040 comp rx=0 tx=0).stop 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf40162680 msgr2=0x7fbf40157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf40162680 0x7fbf40157bb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800d800 tx=0x7fbf2800dcc0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 shutdown_connections 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbf1c06cbc0 0x7fbf1c06f080 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf40163190 0x7fbf40152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf40162680 0x7fbf40157bb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 --2- 172.21.15.144:0/2488449905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf400b41f0 0x7fbf401561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 >> 172.21.15.144:0/2488449905 conn(0x7fbf400b3070 msgr2=0x7fbf400b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 shutdown_connections 2024-05-30T16:45:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.329+0000 7fbf46c00640 1 -- 172.21.15.144:0/2488449905 wait complete. 2024-05-30T16:45:26.349 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:45:26.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.550+0000 7f87dee00640 1 Processor -- start 2024-05-30T16:45:26.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.550+0000 7f87dee00640 1 -- start start 2024-05-30T16:45:26.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.551+0000 7f87dee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87d815c950 0x7f87d81602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.551+0000 7f87dee00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87d80cd0a0 con 0x7f87d80d1120 2024-05-30T16:45:26.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.551+0000 7f87dee00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87d80cd380 con 0x7f87d80ce140 2024-05-30T16:45:26.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.551+0000 7f87dee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f87d8161120 con 0x7f87d815c950 2024-05-30T16:45:26.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.551+0000 7f87de400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f87d80d1120 0x7f87d80b5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60626/0 (socket says 172.21.15.144:60626) 2024-05-30T16:45:26.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.551+0000 7f87de400640 1 -- 172.21.15.144:0/1068454509 learned_addr learned my addr 172.21.15.144:0/1068454509 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:45:26.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87dda00640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87d815c950 0x7f87d81602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671548605 0 0) 0x7f87d80cd0a0 con 0x7f87d80d1120 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87bc003520 con 0x7f87d80d1120 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3144366502 0 0) 0x7f87bc003520 con 0x7f87d80d1120 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87d815c950 msgr2=0x7f87d81602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87d815c950 0x7f87d81602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 >> v1:172.21.15.149:6789/0 conn(0x7f87d80ce140 legacy=0x7f87d80d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d80cd660 con 0x7f87d80d1120 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f87d00019f0 con 0x7f87d80d1120 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 >> v1:172.21.15.144:6789/0 conn(0x7f87d80d1120 legacy=0x7f87d80b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87bc0039e0 0x7f87bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87d815c950 0x7f87bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87bc004d40 0x7f87bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc00ba70 con 0x7f87bc004d40 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc00bbf0 con 0x7f87bc0039e0 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.552+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f87bc00bdf0 con 0x7f87d815c950 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.553+0000 7f87de400640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87bc004d40 0x7f87bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.553+0000 7f87dda00640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87bc0039e0 0x7f87bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.553+0000 7f87dd000640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87d815c950 0x7f87bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.553+0000 7f87de400640 1 -- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87d815c950 msgr2=0x7f87bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.553+0000 7f87de400640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87d815c950 0x7f87bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.553+0000 7f87de400640 1 -- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87bc0039e0 msgr2=0x7f87bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.553+0000 7f87de400640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87bc0039e0 0x7f87bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.553+0000 7f87de400640 1 -- 172.21.15.144:0/1068454509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87bc003520 con 0x7f87bc004d40 2024-05-30T16:45:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.553+0000 7f87dda00640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87bc0039e0 0x7f87bc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:45:26.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.554+0000 7f87de400640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87bc004d40 0x7f87bc0051c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f87d0002230 tx=0x7f87bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695edd3780a10cdf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:26.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d000a4a0 con 0x7f87bc004d40 2024-05-30T16:45:26.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d002f070 con 0x7f87bc004d40 2024-05-30T16:45:26.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87d7e00640 1 -- 172.21.15.144:0/1068454509 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d002bcb0 con 0x7f87bc004d40 2024-05-30T16:45:26.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87dee00640 1 -- 172.21.15.144:0/1068454509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87bc004d40 msgr2=0x7f87bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87dee00640 1 --2- 172.21.15.144:0/1068454509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87bc004d40 0x7f87bc0051c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f87d0002230 tx=0x7f87bc005830 comp rx=0 tx=0).stop 2024-05-30T16:45:26.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87de400640 1 -- 172.21.15.144:0/1068454509 reap_dead start 2024-05-30T16:45:26.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87dee00640 1 -- 172.21.15.144:0/1068454509 shutdown_connections 2024-05-30T16:45:26.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87dee00640 1 -- 172.21.15.144:0/1068454509 >> 172.21.15.144:0/1068454509 conn(0x7f87d80d2430 msgr2=0x7f87d80d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:26.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87dee00640 1 -- 172.21.15.144:0/1068454509 shutdown_connections 2024-05-30T16:45:26.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.555+0000 7f87dee00640 1 -- 172.21.15.144:0/1068454509 wait complete. 2024-05-30T16:45:26.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.557+0000 7f87dee00640 1 Processor -- start 2024-05-30T16:45:26.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.557+0000 7f87dee00640 1 -- start start 2024-05-30T16:45:26.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.558+0000 7f87dee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87bc004d40 0x7f87d815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.558+0000 7f87dee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d80ca0a0 0x7f87d80cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.558+0000 7f87dee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d815f2f0 0x7f87d815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.558+0000 7f87dee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f87d80b5990 con 0x7f87d80ca0a0 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.558+0000 7f87dee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f87d80cdc20 con 0x7f87d815f2f0 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.558+0000 7f87dee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f87d80b5b10 con 0x7f87bc004d40 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d80ca0a0 0x7f87d80cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d80ca0a0 0x7f87d80cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47962/0 (socket says 172.21.15.144:47962) 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dd000640 1 -- 172.21.15.144:0/4225448546 learned_addr learned my addr 172.21.15.144:0/4225448546 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dda00640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87bc004d40 0x7f87d815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87de400640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d815f2f0 0x7f87d815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dd000640 1 -- 172.21.15.144:0/4225448546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87bc004d40 msgr2=0x7f87d815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dd000640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87bc004d40 0x7f87d815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dd000640 1 -- 172.21.15.144:0/4225448546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d815f2f0 msgr2=0x7f87d815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dd000640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d815f2f0 0x7f87d815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dd000640 1 -- 172.21.15.144:0/4225448546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d815dab0 con 0x7f87d80ca0a0 2024-05-30T16:45:26.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.559+0000 7f87dd000640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d80ca0a0 0x7f87d80cbb70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f87c400e4d0 tx=0x7f87c400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:26.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.560+0000 7f87d5600640 1 -- 172.21.15.144:0/4225448546 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c40053a0 con 0x7f87d80ca0a0 2024-05-30T16:45:26.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.560+0000 7f87d5600640 1 -- 172.21.15.144:0/4225448546 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c4018070 con 0x7f87d80ca0a0 2024-05-30T16:45:26.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.560+0000 7f87d5600640 1 -- 172.21.15.144:0/4225448546 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c4003830 con 0x7f87d80ca0a0 2024-05-30T16:45:26.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.560+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d815dd90 con 0x7f87d80ca0a0 2024-05-30T16:45:26.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.560+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d815e350 con 0x7f87d80ca0a0 2024-05-30T16:45:26.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.561+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d80d17a0 con 0x7f87d80ca0a0 2024-05-30T16:45:26.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.562+0000 7f87d5600640 1 -- 172.21.15.144:0/4225448546 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f87c40039d0 con 0x7f87d80ca0a0 2024-05-30T16:45:26.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.563+0000 7f87d5600640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f87b806cbc0 0x7f87b806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:26.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.563+0000 7f87d5600640 1 -- 172.21.15.144:0/4225448546 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f87c408bcc0 con 0x7f87d80ca0a0 2024-05-30T16:45:26.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.563+0000 7f87dda00640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f87b806cbc0 0x7f87b806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:26.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.564+0000 7f87dda00640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f87b806cbc0 0x7f87b806f080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87d815d690 tx=0x7f87c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:26.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.567+0000 7f87d5600640 1 -- 172.21.15.144:0/4225448546 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f87c4092080 con 0x7f87d80ca0a0 2024-05-30T16:45:26.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.769+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f87d80d3020 con 0x7f87d80ca0a0 2024-05-30T16:45:26.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.770+0000 7f87d5600640 1 -- 172.21.15.144:0/4225448546 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f87c4059d60 con 0x7f87d80ca0a0 2024-05-30T16:45:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f87b806cbc0 msgr2=0x7f87b806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f87b806cbc0 0x7f87b806f080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87d815d690 tx=0x7f87c8008040 comp rx=0 tx=0).stop 2024-05-30T16:45:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d80ca0a0 msgr2=0x7f87d80cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d80ca0a0 0x7f87d80cbb70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f87c400e4d0 tx=0x7f87c400e990 comp rx=0 tx=0).stop 2024-05-30T16:45:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 shutdown_connections 2024-05-30T16:45:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f87b806cbc0 0x7f87b806f080 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d815f2f0 0x7f87d815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d80ca0a0 0x7f87d80cbb70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 --2- 172.21.15.144:0/4225448546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87bc004d40 0x7f87d815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 >> 172.21.15.144:0/4225448546 conn(0x7f87d80d2430 msgr2=0x7f87d80b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 shutdown_connections 2024-05-30T16:45:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:26.773+0000 7f87dee00640 1 -- 172.21.15.144:0/4225448546 wait complete. 2024-05-30T16:45:26.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T16:45:27.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.004+0000 7fc5cfe00640 1 Processor -- start 2024-05-30T16:45:27.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.005+0000 7fc5cfe00640 1 -- start start 2024-05-30T16:45:27.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.006+0000 7fc5cfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00d1640 0x7fc5d00b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.006+0000 7fc5cfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5d00cf3c0 0x7fc5d00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.006+0000 7fc5cfe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5d00d2a90 con 0x7fc5d00d1260 2024-05-30T16:45:27.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.006+0000 7fc5cfe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc5d00d36a0 con 0x7fc5d00cf3c0 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.006+0000 7fc5cfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d00d2d70 con 0x7fc5d00d1640 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.007+0000 7fc5cf400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5d00cf3c0 0x7fc5d00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.007+0000 7fc5cf400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5d00cf3c0 0x7fc5d00cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47978/0 (socket says 172.21.15.144:47978) 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.007+0000 7fc5cf400640 1 -- 172.21.15.144:0/3086530870 learned_addr learned my addr 172.21.15.144:0/3086530870 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.007+0000 7fc5c6000640 1 --2- 172.21.15.144:0/3086530870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00d1640 0x7fc5d00b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.007+0000 7fc5cf400640 1 -- 172.21.15.144:0/3086530870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00d1640 msgr2=0x7fc5d00b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.007+0000 7fc5cf400640 1 --2- 172.21.15.144:0/3086530870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00d1640 0x7fc5d00b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.007+0000 7fc5cf400640 1 -- 172.21.15.144:0/3086530870 >> v1:172.21.15.149:6789/0 conn(0x7fc5d00d1260 legacy=0x7fc5d00d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.007+0000 7fc5cf400640 1 -- 172.21.15.144:0/3086530870 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d00d3050 con 0x7fc5d00cf3c0 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.007+0000 7fc5c6000640 1 --2- 172.21.15.144:0/3086530870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00d1640 0x7fc5d00b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.008+0000 7fc5cf400640 1 --2- 172.21.15.144:0/3086530870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00cf3c0 0x7fc5d00cf810 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009870 tx=0x7fc5c802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373e24e744d9dd62 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.009+0000 7fc5ce000640 1 -- 172.21.15.144:0/3086530870 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8037070 con 0x7fc5d00cf3c0 2024-05-30T16:45:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.009+0000 7fc5ce000640 1 -- 172.21.15.144:0/3086530870 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c8032440 con 0x7fc5d00cf3c0 2024-05-30T16:45:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.009+0000 7fc5ce000640 1 -- 172.21.15.144:0/3086530870 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8032810 con 0x7fc5d00cf3c0 2024-05-30T16:45:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.009+0000 7fc5cfe00640 1 -- 172.21.15.144:0/3086530870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00cf3c0 msgr2=0x7fc5d00cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.009+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/3086530870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00cf3c0 0x7fc5d00cf810 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009870 tx=0x7fc5c802a200 comp rx=0 tx=0).stop 2024-05-30T16:45:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.009+0000 7fc5cfe00640 1 -- 172.21.15.144:0/3086530870 shutdown_connections 2024-05-30T16:45:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.009+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/3086530870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00cf3c0 0x7fc5d00cf810 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.009+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/3086530870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00d1640 0x7fc5d00b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.009+0000 7fc5cfe00640 1 -- 172.21.15.144:0/3086530870 >> 172.21.15.144:0/3086530870 conn(0x7fc5d008bfc0 msgr2=0x7fc5d00d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.010+0000 7fc5cfe00640 1 -- 172.21.15.144:0/3086530870 shutdown_connections 2024-05-30T16:45:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.010+0000 7fc5cfe00640 1 -- 172.21.15.144:0/3086530870 wait complete. 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.012+0000 7fc5cfe00640 1 Processor -- start 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.012+0000 7fc5cfe00640 1 -- start start 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.013+0000 7fc5cfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00cf3c0 0x7fc5d00ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.013+0000 7fc5cfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00d1260 0x7fc5d00cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.013+0000 7fc5cfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00d1640 0x7fc5d00c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.013+0000 7fc5cfe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d00cfed0 con 0x7fc5d00d1640 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.013+0000 7fc5cfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d00cfd50 con 0x7fc5d00d1260 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.013+0000 7fc5cfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d00d0050 con 0x7fc5d00cf3c0 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.013+0000 7fc5cf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00d1640 0x7fc5d00c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.013+0000 7fc5cf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00d1640 0x7fc5d00c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47984/0 (socket says 172.21.15.144:47984) 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.013+0000 7fc5cf400640 1 -- 172.21.15.144:0/2629486903 learned_addr learned my addr 172.21.15.144:0/2629486903 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.014+0000 7fc5cea00640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00cf3c0 0x7fc5d00ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.014+0000 7fc5c6000640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00d1260 0x7fc5d00cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.014+0000 7fc5cf400640 1 -- 172.21.15.144:0/2629486903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00cf3c0 msgr2=0x7fc5d00ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.014+0000 7fc5cf400640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00cf3c0 0x7fc5d00ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.014+0000 7fc5cf400640 1 -- 172.21.15.144:0/2629486903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00d1260 msgr2=0x7fc5d00cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.014+0000 7fc5cf400640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00d1260 0x7fc5d00cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.014+0000 7fc5cf400640 1 -- 172.21.15.144:0/2629486903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d00c9d60 con 0x7fc5d00d1640 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.014+0000 7fc5c6000640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00d1260 0x7fc5d00cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.014+0000 7fc5cf400640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00d1640 0x7fc5d00c9820 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc5c802a240 tx=0x7fc5c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.015+0000 7fc5c7400640 1 -- 172.21.15.144:0/2629486903 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8041030 con 0x7fc5d00d1640 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.015+0000 7fc5c7400640 1 -- 172.21.15.144:0/2629486903 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c8030600 con 0x7fc5d00d1640 2024-05-30T16:45:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.015+0000 7fc5c7400640 1 -- 172.21.15.144:0/2629486903 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8037040 con 0x7fc5d00d1640 2024-05-30T16:45:27.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.015+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d00ca000 con 0x7fc5d00d1640 2024-05-30T16:45:27.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.015+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d00ca5c0 con 0x7fc5d00d1640 2024-05-30T16:45:27.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.016+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d01584f0 con 0x7fc5d00d1640 2024-05-30T16:45:27.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.017+0000 7fc5c7400640 1 -- 172.21.15.144:0/2629486903 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7fc5c8044070 con 0x7fc5d00d1640 2024-05-30T16:45:27.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.018+0000 7fc5c7400640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ac06cbc0 0x7fc5ac06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.018+0000 7fc5c7400640 1 -- 172.21.15.144:0/2629486903 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fc5c80ac7a0 con 0x7fc5d00d1640 2024-05-30T16:45:27.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.018+0000 7fc5cea00640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ac06cbc0 0x7fc5ac06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.019+0000 7fc5cea00640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ac06cbc0 0x7fc5ac06f080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005520 tx=0x7fc5c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:27.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.023+0000 7fc5c7400640 1 -- 172.21.15.144:0/2629486903 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5d01584f0 con 0x7fc5d00d1640 2024-05-30T16:45:27.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.250+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fc5d0075570 con 0x7fc5ac06cbc0 2024-05-30T16:45:27.264 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:45:27.263+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:45:27.264 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:45:27.263+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:45:27.264 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:45:27.263+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:45:27.264 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:45:27.263+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:45:27.264 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:45:27.263+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:45:27.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.312+0000 7fc5c7400640 1 -- 172.21.15.144:0/2629486903 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc5d0075570 con 0x7fc5ac06cbc0 2024-05-30T16:45:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ac06cbc0 msgr2=0x7fc5ac06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ac06cbc0 0x7fc5ac06f080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005520 tx=0x7fc5c0009040 comp rx=0 tx=0).stop 2024-05-30T16:45:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00d1640 msgr2=0x7fc5d00c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00d1640 0x7fc5d00c9820 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc5c802a240 tx=0x7fc5c80046c0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 shutdown_connections 2024-05-30T16:45:27.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ac06cbc0 0x7fc5ac06f080 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d00d1640 0x7fc5d00c9820 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00d1260 0x7fc5d00cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 --2- 172.21.15.144:0/2629486903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5d00cf3c0 0x7fc5d00ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 >> 172.21.15.144:0/2629486903 conn(0x7fc5d008bfc0 msgr2=0x7fc5d00b90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:27.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 shutdown_connections 2024-05-30T16:45:27.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.315+0000 7fc5cfe00640 1 -- 172.21.15.144:0/2629486903 wait complete. 2024-05-30T16:45:27.335 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:45:27.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.510+0000 7f0abf800640 1 Processor -- start 2024-05-30T16:45:27.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.510+0000 7f0abf800640 1 -- start start 2024-05-30T16:45:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.512+0000 7f0abf800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 0x7f0ab81418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.512+0000 7f0abf800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0ab815f8f0 0x7f0ab8144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.512+0000 7f0abf800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ab80b5440 0x7f0ab80b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.512+0000 7f0abf800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0ab8144560 con 0x7f0ab80b5440 2024-05-30T16:45:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.512+0000 7f0abf800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f0ab806dfc0 con 0x7f0ab815f8f0 2024-05-30T16:45:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.512+0000 7f0abf800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab80b3fd0 con 0x7f0ab8141510 2024-05-30T16:45:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.512+0000 7f0abd800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ab80b5440 0x7f0ab80b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.512+0000 7f0abd800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ab80b5440 0x7f0ab80b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48012/0 (socket says 172.21.15.144:48012) 2024-05-30T16:45:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.512+0000 7f0abd800640 1 -- 172.21.15.144:0/3182213730 learned_addr learned my addr 172.21.15.144:0/3182213730 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.513+0000 7f0abce00640 1 --2- 172.21.15.144:0/3182213730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 0x7f0ab81418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.513+0000 7f0ab7e00640 1 --2- 172.21.15.144:0/3182213730 >> v2:172.21.15.149:3300/0 conn(0x7f0ab815f8f0 0x7f0ab8144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.513+0000 7f0abd800640 1 -- 172.21.15.144:0/3182213730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 msgr2=0x7f0ab81418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.513+0000 7f0abd800640 1 --2- 172.21.15.144:0/3182213730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 0x7f0ab81418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.513+0000 7f0abd800640 1 -- 172.21.15.144:0/3182213730 >> v2:172.21.15.149:3300/0 conn(0x7f0ab815f8f0 msgr2=0x7f0ab8144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:45:27.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.513+0000 7f0abd800640 1 --2- 172.21.15.144:0/3182213730 >> v2:172.21.15.149:3300/0 conn(0x7f0ab815f8f0 0x7f0ab8144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.513+0000 7f0abd800640 1 -- 172.21.15.144:0/3182213730 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab815fd80 con 0x7f0ab80b5440 2024-05-30T16:45:27.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.513+0000 7f0ab7e00640 1 --2- 172.21.15.144:0/3182213730 >> v2:172.21.15.149:3300/0 conn(0x7f0ab815f8f0 0x7f0ab8144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:45:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.514+0000 7f0abd800640 1 --2- 172.21.15.144:0/3182213730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab80b5440 0x7f0ab80b5870 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80701b0 tx=0x7f0ab002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c0e3521c156937 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.514+0000 7f0ab7400640 1 -- 172.21.15.144:0/3182213730 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0036070 con 0x7f0ab80b5440 2024-05-30T16:45:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.514+0000 7f0ab7400640 1 -- 172.21.15.144:0/3182213730 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab0031600 con 0x7f0ab80b5440 2024-05-30T16:45:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.514+0000 7f0ab7400640 1 -- 172.21.15.144:0/3182213730 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab00319d0 con 0x7f0ab80b5440 2024-05-30T16:45:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.515+0000 7f0abf800640 1 -- 172.21.15.144:0/3182213730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab80b5440 msgr2=0x7f0ab80b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.515+0000 7f0abf800640 1 --2- 172.21.15.144:0/3182213730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab80b5440 0x7f0ab80b5870 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80701b0 tx=0x7f0ab002a570 comp rx=0 tx=0).stop 2024-05-30T16:45:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.515+0000 7f0abf800640 1 -- 172.21.15.144:0/3182213730 shutdown_connections 2024-05-30T16:45:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.515+0000 7f0abf800640 1 --2- 172.21.15.144:0/3182213730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab80b5440 0x7f0ab80b5870 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.515+0000 7f0abf800640 1 --2- 172.21.15.144:0/3182213730 >> v2:172.21.15.149:3300/0 conn(0x7f0ab815f8f0 0x7f0ab8144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.515+0000 7f0abf800640 1 --2- 172.21.15.144:0/3182213730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 0x7f0ab81418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.515+0000 7f0abf800640 1 -- 172.21.15.144:0/3182213730 >> 172.21.15.144:0/3182213730 conn(0x7f0ab806bd00 msgr2=0x7f0ab806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:27.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.515+0000 7f0abf800640 1 -- 172.21.15.144:0/3182213730 shutdown_connections 2024-05-30T16:45:27.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.515+0000 7f0abf800640 1 -- 172.21.15.144:0/3182213730 wait complete. 2024-05-30T16:45:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.517+0000 7f0abf800640 1 Processor -- start 2024-05-30T16:45:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.517+0000 7f0abf800640 1 -- start start 2024-05-30T16:45:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.518+0000 7f0abf800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ab80b5440 0x7f0ab8158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.518+0000 7f0abf800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 0x7f0ab8147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.518+0000 7f0abf800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab815f8f0 0x7f0ab81477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.518+0000 7f0abf800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8144d50 con 0x7f0ab815f8f0 2024-05-30T16:45:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.518+0000 7f0abf800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8144a70 con 0x7f0ab80b5440 2024-05-30T16:45:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.518+0000 7f0abf800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab806e210 con 0x7f0ab8141510 2024-05-30T16:45:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab815f8f0 0x7f0ab81477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab815f8f0 0x7f0ab81477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48028/0 (socket says 172.21.15.144:48028) 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abd800640 1 -- 172.21.15.144:0/1562696336 learned_addr learned my addr 172.21.15.144:0/1562696336 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abce00640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ab80b5440 0x7f0ab8158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0ab7e00640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 0x7f0ab8147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abd800640 1 -- 172.21.15.144:0/1562696336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 msgr2=0x7f0ab8147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abd800640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 0x7f0ab8147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abd800640 1 -- 172.21.15.144:0/1562696336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ab80b5440 msgr2=0x7f0ab8158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abd800640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ab80b5440 0x7f0ab8158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abd800640 1 -- 172.21.15.144:0/1562696336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab8161050 con 0x7f0ab815f8f0 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.519+0000 7f0abd800640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab815f8f0 0x7f0ab81477d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0034040 tx=0x7f0ab0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.520+0000 7f0ab4c00640 1 -- 172.21.15.144:0/1562696336 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0036050 con 0x7f0ab815f8f0 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.520+0000 7f0ab4c00640 1 -- 172.21.15.144:0/1562696336 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab0042070 con 0x7f0ab815f8f0 2024-05-30T16:45:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.520+0000 7f0ab4c00640 1 -- 172.21.15.144:0/1562696336 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0007bd0 con 0x7f0ab815f8f0 2024-05-30T16:45:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.520+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab8161330 con 0x7f0ab815f8f0 2024-05-30T16:45:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.520+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab8158e60 con 0x7f0ab815f8f0 2024-05-30T16:45:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.521+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab8068b90 con 0x7f0ab815f8f0 2024-05-30T16:45:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.522+0000 7f0ab4c00640 1 -- 172.21.15.144:0/1562696336 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 91295+0+0 (secure 0 0 0) 0x7f0ab0047460 con 0x7f0ab815f8f0 2024-05-30T16:45:27.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.523+0000 7f0ab4c00640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0a9806cbf0 0x7f0a9806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:45:27.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.524+0000 7f0ab4c00640 1 -- 172.21.15.144:0/1562696336 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f0ab00acfc0 con 0x7f0ab815f8f0 2024-05-30T16:45:27.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.524+0000 7f0abce00640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0a9806cbf0 0x7f0a9806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:45:27.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.524+0000 7f0abce00640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0a9806cbf0 0x7f0a9806f0b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0aac006fd0 tx=0x7f0aac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:45:27.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.528+0000 7f0ab4c00640 1 -- 172.21.15.144:0/1562696336 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ab007afe0 con 0x7f0ab815f8f0 2024-05-30T16:45:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.752+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f0ab8075f70 con 0x7f0a9806cbf0 2024-05-30T16:45:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.759+0000 7f0ab4c00640 1 -- 172.21.15.144:0/1562696336 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f0aac00b200 con 0x7f0a9806cbf0 2024-05-30T16:45:27.760 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04 2024-05-30T16:45:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0a9806cbf0 msgr2=0x7f0a9806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0a9806cbf0 0x7f0a9806f0b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0aac006fd0 tx=0x7f0aac008040 comp rx=0 tx=0).stop 2024-05-30T16:45:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab815f8f0 msgr2=0x7f0ab81477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:45:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab815f8f0 0x7f0ab81477d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0034040 tx=0x7f0ab0004a40 comp rx=0 tx=0).stop 2024-05-30T16:45:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 shutdown_connections 2024-05-30T16:45:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0a9806cbf0 0x7f0a9806f0b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ab815f8f0 0x7f0ab81477d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ab8141510 0x7f0ab8147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 --2- 172.21.15.144:0/1562696336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ab80b5440 0x7f0ab8158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:45:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 >> 172.21.15.144:0/1562696336 conn(0x7f0ab806bd00 msgr2=0x7f0ab8161810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:45:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 shutdown_connections 2024-05-30T16:45:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:45:27.761+0000 7f0abf800640 1 -- 172.21.15.144:0/1562696336 wait complete. 2024-05-30T16:45:27.782 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04 2024-05-30T16:45:27.782 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:45:27.782 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:27.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:27.831 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:45:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:45:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:45:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.42348 s, 145 MB/s 2024-05-30T16:45:35.353 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:45:35.353 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:35.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:35.391 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:45:42.818 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:45:42.819 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:45:42.819 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.33999 s, 146 MB/s 2024-05-30T16:45:42.820 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:45:42.820 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:42.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:42.859 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:45:46.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:45:46.157 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:45:50.056 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:45:50.057 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:45:50.057 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.10671 s, 151 MB/s 2024-05-30T16:45:50.058 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:45:50.058 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:50.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:50.099 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:45:57.241 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:45:57.242 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:45:57.242 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.05309 s, 152 MB/s 2024-05-30T16:45:57.243 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:45:57.243 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:45:57.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:45:57.284 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:46:04.700 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:46:04.700 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:46:04.700 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.32865 s, 147 MB/s 2024-05-30T16:46:04.701 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:46:04.701 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:46:04.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:46:04.739 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:46:12.009 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:46:12.009 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:46:12.009 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.18098 s, 150 MB/s 2024-05-30T16:46:12.010 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:46:12.011 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:46:12.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:46:12.047 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:46:16.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:46:16.300 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:46:19.528 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:46:19.529 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:46:19.529 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.39333 s, 145 MB/s 2024-05-30T16:46:19.530 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:46:19.530 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:46:19.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:46:19.572 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:46:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:46:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:46:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.31022 s, 147 MB/s 2024-05-30T16:46:26.965 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:46:26.966 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:46:27.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:46:27.005 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:46:34.501 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:46:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:46:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.40698 s, 145 MB/s 2024-05-30T16:46:34.503 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:46:34.503 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:46:34.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:46:34.541 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:46:41.795 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:46:41.795 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:46:41.795 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.16419 s, 150 MB/s 2024-05-30T16:46:41.796 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T16:46:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.965+0000 7f922ae00640 1 Processor -- start 2024-05-30T16:46:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.965+0000 7f922ae00640 1 -- start start 2024-05-30T16:46:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.966+0000 7f922ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9224141780 0x7f9224071df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.966+0000 7f922ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9224072330 0x7f9224144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.966+0000 7f922ae00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9224144790 0x7f922406dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.966+0000 7f922ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9224072770 con 0x7f9224141780 2024-05-30T16:46:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f922ae00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f92240cff40 con 0x7f9224144790 2024-05-30T16:46:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f922ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9224162600 con 0x7f9224072330 2024-05-30T16:46:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f9223e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9224141780 0x7f9224071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f9223e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9224141780 0x7f9224071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42854/0 (socket says 172.21.15.144:42854) 2024-05-30T16:46:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f9223e00640 1 -- 172.21.15.144:0/1062191269 learned_addr learned my addr 172.21.15.144:0/1062191269 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f9223e00640 1 -- 172.21.15.144:0/1062191269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9224072330 msgr2=0x7f9224144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f9223e00640 1 --2- 172.21.15.144:0/1062191269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9224072330 0x7f9224144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f9223e00640 1 -- 172.21.15.144:0/1062191269 >> v2:172.21.15.149:3300/0 conn(0x7f9224144790 msgr2=0x7f922406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f9223e00640 1 --2- 172.21.15.144:0/1062191269 >> v2:172.21.15.149:3300/0 conn(0x7f9224144790 0x7f922406dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.967+0000 7f9223e00640 1 -- 172.21.15.144:0/1062191269 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92241628e0 con 0x7f9224141780 2024-05-30T16:46:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.968+0000 7f9223e00640 1 --2- 172.21.15.144:0/1062191269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 0x7f9224071df0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9224162810 tx=0x7f921402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4190334dc128b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.968+0000 7f9223400640 1 -- 172.21.15.144:0/1062191269 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214037070 con 0x7f9224141780 2024-05-30T16:46:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.968+0000 7f9223400640 1 -- 172.21.15.144:0/1062191269 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9214032440 con 0x7f9224141780 2024-05-30T16:46:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.968+0000 7f9223400640 1 -- 172.21.15.144:0/1062191269 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214032810 con 0x7f9224141780 2024-05-30T16:46:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.969+0000 7f922ae00640 1 -- 172.21.15.144:0/1062191269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 msgr2=0x7f9224071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.969+0000 7f922ae00640 1 --2- 172.21.15.144:0/1062191269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 0x7f9224071df0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9224162810 tx=0x7f921402a1c0 comp rx=0 tx=0).stop 2024-05-30T16:46:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.969+0000 7f922ae00640 1 -- 172.21.15.144:0/1062191269 shutdown_connections 2024-05-30T16:46:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.969+0000 7f922ae00640 1 --2- 172.21.15.144:0/1062191269 >> v2:172.21.15.149:3300/0 conn(0x7f9224144790 0x7f922406dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.969+0000 7f922ae00640 1 --2- 172.21.15.144:0/1062191269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9224072330 0x7f9224144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.969+0000 7f922ae00640 1 --2- 172.21.15.144:0/1062191269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 0x7f9224071df0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.969+0000 7f922ae00640 1 -- 172.21.15.144:0/1062191269 >> 172.21.15.144:0/1062191269 conn(0x7f9224070050 msgr2=0x7f922406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.969+0000 7f922ae00640 1 -- 172.21.15.144:0/1062191269 shutdown_connections 2024-05-30T16:46:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.969+0000 7f922ae00640 1 -- 172.21.15.144:0/1062191269 wait complete. 2024-05-30T16:46:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.971+0000 7f922ae00640 1 Processor -- start 2024-05-30T16:46:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.971+0000 7f922ae00640 1 -- start start 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.972+0000 7f922ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9224072330 0x7f922415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.972+0000 7f922ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 0x7f9224142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.972+0000 7f922ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9224144790 0x7f9224160210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.972+0000 7f922ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9224141b60 con 0x7f9224141780 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.972+0000 7f922ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9224162ea0 con 0x7f9224072330 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.972+0000 7f922ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f92240b5390 con 0x7f9224144790 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.972+0000 7f921be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 0x7f9224142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.972+0000 7f921be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 0x7f9224142fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42860/0 (socket says 172.21.15.144:42860) 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.972+0000 7f921be00640 1 -- 172.21.15.144:0/978584825 learned_addr learned my addr 172.21.15.144:0/978584825 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f9223e00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9224072330 0x7f922415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f921be00640 1 -- 172.21.15.144:0/978584825 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9224144790 msgr2=0x7f9224160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f9228e00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9224144790 0x7f9224160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f921be00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9224144790 0x7f9224160210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f921be00640 1 -- 172.21.15.144:0/978584825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9224072330 msgr2=0x7f922415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f921be00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9224072330 0x7f922415eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f921be00640 1 -- 172.21.15.144:0/978584825 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922415f170 con 0x7f9224141780 2024-05-30T16:46:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f921be00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 0x7f9224142fa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f920c00b4a0 tx=0x7f920c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f9220c00640 1 -- 172.21.15.144:0/978584825 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c014070 con 0x7f9224141780 2024-05-30T16:46:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f9220c00640 1 -- 172.21.15.144:0/978584825 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c010610 con 0x7f9224141780 2024-05-30T16:46:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f9220c00640 1 -- 172.21.15.144:0/978584825 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c010a00 con 0x7f9224141780 2024-05-30T16:46:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922415f450 con 0x7f9224141780 2024-05-30T16:46:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.973+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92241434e0 con 0x7f9224141780 2024-05-30T16:46:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.974+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922406ee20 con 0x7f9224141780 2024-05-30T16:46:41.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.975+0000 7f9220c00640 1 -- 172.21.15.144:0/978584825 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 12) ==== 91295+0+0 (secure 0 0 0) 0x7f920c017070 con 0x7f9224141780 2024-05-30T16:46:41.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.976+0000 7f9220c00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f920006cbc0 0x7f920006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:41.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.976+0000 7f9220c00640 1 -- 172.21.15.144:0/978584825 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f920c08bb10 con 0x7f9224141780 2024-05-30T16:46:41.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.977+0000 7f9223e00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f920006cbc0 0x7f920006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:41.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.977+0000 7f9223e00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f920006cbc0 0x7f920006f080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9214034000 tx=0x7f921402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:41.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:41.981+0000 7f9220c00640 1 -- 172.21.15.144:0/978584825 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f922406ee20 con 0x7f9224141780 2024-05-30T16:46:42.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.196+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f922415fee0 con 0x7f920006cbc0 2024-05-30T16:46:42.203 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:42.202+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:42.204 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:42.202+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:42.204 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:42.202+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:42.204 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:42.202+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:42.204 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:42.202+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:42.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.229+0000 7f9220c00640 1 -- 172.21.15.144:0/978584825 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f922415fee0 con 0x7f920006cbc0 2024-05-30T16:46:42.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f920006cbc0 msgr2=0x7f920006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f920006cbc0 0x7f920006f080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9214034000 tx=0x7f921402e000 comp rx=0 tx=0).stop 2024-05-30T16:46:42.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 msgr2=0x7f9224142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 0x7f9224142fa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f920c00b4a0 tx=0x7f920c00b960 comp rx=0 tx=0).stop 2024-05-30T16:46:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 shutdown_connections 2024-05-30T16:46:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f920006cbc0 0x7f920006f080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9224144790 0x7f9224160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9224141780 0x7f9224142fa0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 --2- 172.21.15.144:0/978584825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9224072330 0x7f922415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 >> 172.21.15.144:0/978584825 conn(0x7f9224070050 msgr2=0x7f9224074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 shutdown_connections 2024-05-30T16:46:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.231+0000 7f922ae00640 1 -- 172.21.15.144:0/978584825 wait complete. 2024-05-30T16:46:42.249 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:46:42.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.421+0000 7f96b6000640 1 Processor -- start 2024-05-30T16:46:42.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.422+0000 7f96b6000640 1 -- start start 2024-05-30T16:46:42.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.423+0000 7f96b6000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f96b0147cc0 0x7f96b00b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.423+0000 7f96b6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96b00b4800 0x7f96b0162480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.423+0000 7f96b6000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b006e440 con 0x7f96b0144e70 2024-05-30T16:46:42.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.423+0000 7f96b6000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f96b0145250 con 0x7f96b00b4800 2024-05-30T16:46:42.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.423+0000 7f96b6000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f96b00b3e30 con 0x7f96b0147cc0 2024-05-30T16:46:42.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.424+0000 7f96b5600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96b00b4800 0x7f96b0162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.424+0000 7f96b5600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96b00b4800 0x7f96b0162480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42900/0 (socket says 172.21.15.144:42900) 2024-05-30T16:46:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.424+0000 7f96b5600640 1 -- 172.21.15.144:0/295304070 learned_addr learned my addr 172.21.15.144:0/295304070 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.424+0000 7f96a7e00640 1 --2- 172.21.15.144:0/295304070 >> v2:172.21.15.149:3300/0 conn(0x7f96b0147cc0 0x7f96b00b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.424+0000 7f96b5600640 1 -- 172.21.15.144:0/295304070 >> v2:172.21.15.149:3300/0 conn(0x7f96b0147cc0 msgr2=0x7f96b00b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.424+0000 7f96b5600640 1 --2- 172.21.15.144:0/295304070 >> v2:172.21.15.149:3300/0 conn(0x7f96b0147cc0 0x7f96b00b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.424+0000 7f96b5600640 1 -- 172.21.15.144:0/295304070 >> v1:172.21.15.149:6789/0 conn(0x7f96b0144e70 legacy=0x7f96b006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.424+0000 7f96b5600640 1 -- 172.21.15.144:0/295304070 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b00b4c70 con 0x7f96b00b4800 2024-05-30T16:46:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.425+0000 7f96b5600640 1 --2- 172.21.15.144:0/295304070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b00b4800 0x7f96b0162480 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f96b0071c80 tx=0x7f96a802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2318e31ce169e309 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:42.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96afe00640 1 -- 172.21.15.144:0/295304070 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8036070 con 0x7f96b00b4800 2024-05-30T16:46:42.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96afe00640 1 -- 172.21.15.144:0/295304070 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a8031600 con 0x7f96b00b4800 2024-05-30T16:46:42.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96afe00640 1 -- 172.21.15.144:0/295304070 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80319d0 con 0x7f96b00b4800 2024-05-30T16:46:42.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96b6000640 1 -- 172.21.15.144:0/295304070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b00b4800 msgr2=0x7f96b0162480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96b6000640 1 --2- 172.21.15.144:0/295304070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b00b4800 0x7f96b0162480 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f96b0071c80 tx=0x7f96a802a6f0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96b6000640 1 -- 172.21.15.144:0/295304070 shutdown_connections 2024-05-30T16:46:42.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96b6000640 1 --2- 172.21.15.144:0/295304070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b00b4800 0x7f96b0162480 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96b6000640 1 --2- 172.21.15.144:0/295304070 >> v2:172.21.15.149:3300/0 conn(0x7f96b0147cc0 0x7f96b00b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96b6000640 1 -- 172.21.15.144:0/295304070 >> 172.21.15.144:0/295304070 conn(0x7f96b006b8e0 msgr2=0x7f96b006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:42.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96b6000640 1 -- 172.21.15.144:0/295304070 shutdown_connections 2024-05-30T16:46:42.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.426+0000 7f96b6000640 1 -- 172.21.15.144:0/295304070 wait complete. 2024-05-30T16:46:42.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.428+0000 7f96b6000640 1 Processor -- start 2024-05-30T16:46:42.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.428+0000 7f96b6000640 1 -- start start 2024-05-30T16:46:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.429+0000 7f96b6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96b00b4800 0x7f96b00cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.429+0000 7f96b6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b0144e70 0x7f96b00cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.429+0000 7f96b6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96b0147cc0 0x7f96b015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.429+0000 7f96b6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f96b00b3ac0 con 0x7f96b0144e70 2024-05-30T16:46:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.429+0000 7f96b6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f96b00b37e0 con 0x7f96b00b4800 2024-05-30T16:46:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.429+0000 7f96b6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f96b006c3d0 con 0x7f96b0147cc0 2024-05-30T16:46:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.429+0000 7f96a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b0144e70 0x7f96b00cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.429+0000 7f96a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b0144e70 0x7f96b00cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42914/0 (socket says 172.21.15.144:42914) 2024-05-30T16:46:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.429+0000 7f96a7e00640 1 -- 172.21.15.144:0/802872023 learned_addr learned my addr 172.21.15.144:0/802872023 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:42.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96a7e00640 1 -- 172.21.15.144:0/802872023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96b0147cc0 msgr2=0x7f96b015e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96a7e00640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96b0147cc0 0x7f96b015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96a7e00640 1 -- 172.21.15.144:0/802872023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96b00b4800 msgr2=0x7f96b00cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96b4c00640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96b00b4800 0x7f96b00cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96a7e00640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96b00b4800 0x7f96b00cf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96a7e00640 1 -- 172.21.15.144:0/802872023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b00ce4d0 con 0x7f96b0144e70 2024-05-30T16:46:42.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96a7e00640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b0144e70 0x7f96b00cccc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f96a000d5f0 tx=0x7f96a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:42.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96ad600640 1 -- 172.21.15.144:0/802872023 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a00125f0 con 0x7f96b0144e70 2024-05-30T16:46:42.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96ad600640 1 -- 172.21.15.144:0/802872023 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a0019070 con 0x7f96b0144e70 2024-05-30T16:46:42.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96ad600640 1 -- 172.21.15.144:0/802872023 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a00129d0 con 0x7f96b0144e70 2024-05-30T16:46:42.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b00cd430 con 0x7f96b0144e70 2024-05-30T16:46:42.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.430+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b00cd9f0 con 0x7f96b0144e70 2024-05-30T16:46:42.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.431+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b00632f0 con 0x7f96b0144e70 2024-05-30T16:46:42.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.432+0000 7f96ad600640 1 -- 172.21.15.144:0/802872023 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 12) ==== 91295+0+0 (secure 0 0 0) 0x7f96a0012b70 con 0x7f96b0144e70 2024-05-30T16:46:42.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.433+0000 7f96ad600640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f968c06cbc0 0x7f968c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.433+0000 7f96ad600640 1 -- 172.21.15.144:0/802872023 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f96a008c480 con 0x7f96b0144e70 2024-05-30T16:46:42.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.433+0000 7f96b4c00640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f968c06cbc0 0x7f968c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.434+0000 7f96b4c00640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f968c06cbc0 0x7f968c06f080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f96b01475a0 tx=0x7f9698009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:42.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.437+0000 7f96ad600640 1 -- 172.21.15.144:0/802872023 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f96a005a4e0 con 0x7f96b0144e70 2024-05-30T16:46:42.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.649+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f96b0072ec0 con 0x7f968c06cbc0 2024-05-30T16:46:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.660+0000 7f96ad600640 1 -- 172.21.15.144:0/802872023 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f96b0072ec0 con 0x7f968c06cbc0 2024-05-30T16:46:42.661 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f968c06cbc0 msgr2=0x7f968c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f968c06cbc0 0x7f968c06f080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f96b01475a0 tx=0x7f9698009040 comp rx=0 tx=0).stop 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b0144e70 msgr2=0x7f96b00cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b0144e70 0x7f96b00cccc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f96a000d5f0 tx=0x7f96a000dab0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 shutdown_connections 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f968c06cbc0 0x7f968c06f080 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96b0147cc0 0x7f96b015e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96b0144e70 0x7f96b00cccc0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 --2- 172.21.15.144:0/802872023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96b00b4800 0x7f96b00cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.662+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 >> 172.21.15.144:0/802872023 conn(0x7f96b006b8e0 msgr2=0x7f96b00b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:42.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.663+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 shutdown_connections 2024-05-30T16:46:42.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.663+0000 7f96b6000640 1 -- 172.21.15.144:0/802872023 wait complete. 2024-05-30T16:46:42.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:46:42.683 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04 2024-05-30T16:46:42.683 DEBUG:teuthology.orchestra.run.smithi144:> ) 2024-05-30T16:46:42.730 INFO:teuthology.orchestra.run.smithi144.stdout:# file: volumes/_nogroup/sv1/6b7a37da-5e0f-4320-9695-f6008efb0c04 2024-05-30T16:46:42.730 INFO:teuthology.orchestra.run.smithi144.stdout:ceph.dir.rbytes="10737418240" 2024-05-30T16:46:42.730 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:46:42.731 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-05-30T16:46:42.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone79571 2024-05-30T16:46:42.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.936+0000 7fb3c6400640 1 Processor -- start 2024-05-30T16:46:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.936+0000 7fb3c6400640 1 -- start start 2024-05-30T16:46:42.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.937+0000 7fb3c6400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c0142f50 0x7fb3c00cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.938+0000 7fb3c6400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c00cf080 con 0x7fb3c006ed40 2024-05-30T16:46:42.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.938+0000 7fb3c6400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c00ce500 con 0x7fb3c00cdd10 2024-05-30T16:46:42.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.938+0000 7fb3c6400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c00ce7e0 con 0x7fb3c0142f50 2024-05-30T16:46:42.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.938+0000 7fb3c5a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb3c006ed40 0x7fb3c0143fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:59968/0 (socket says 172.21.15.144:59968) 2024-05-30T16:46:42.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.938+0000 7fb3c5a00640 1 -- 172.21.15.144:0/3531116884 learned_addr learned my addr 172.21.15.144:0/3531116884 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.938+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646015122 0 0) 0x7fb3c00cf080 con 0x7fb3c006ed40 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.938+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3a8003520 con 0x7fb3c006ed40 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.938+0000 7fb3c5000640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c0142f50 0x7fb3c00cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2179127260 0 0) 0x7fb3a8003520 con 0x7fb3c006ed40 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c0142f50 msgr2=0x7fb3c00cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c0142f50 0x7fb3c00cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 >> v1:172.21.15.149:6789/0 conn(0x7fb3c00cdd10 legacy=0x7fb3c01438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c00ceac0 con 0x7fb3c006ed40 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fb3b80019f0 con 0x7fb3c006ed40 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 >> v1:172.21.15.144:6789/0 conn(0x7fb3c006ed40 legacy=0x7fb3c0143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a80039e0 0x7fb3a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c0142f50 0x7fb3a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c00ce7e0 con 0x7fb3a8004d40 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a800bba0 con 0x7fb3a80039e0 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a800bda0 con 0x7fb3c0142f50 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3c5a00640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3c5000640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a80039e0 0x7fb3a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3bfe00640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c0142f50 0x7fb3a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.939+0000 7fb3c5a00640 1 -- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c0142f50 msgr2=0x7fb3a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.940+0000 7fb3c5a00640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c0142f50 0x7fb3a8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.940+0000 7fb3c5a00640 1 -- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a80039e0 msgr2=0x7fb3a8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.940+0000 7fb3c5a00640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a80039e0 0x7fb3a8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.940+0000 7fb3c5a00640 1 -- 172.21.15.144:0/3531116884 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a8003520 con 0x7fb3a8004d40 2024-05-30T16:46:42.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.940+0000 7fb3c5000640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a80039e0 0x7fb3a8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:46:42.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.940+0000 7fb3c5a00640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3a80051c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800a790 tx=0x7fb3a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e8b286dea176c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:42.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800a3b0 con 0x7fb3a8004d40 2024-05-30T16:46:42.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b802f070 con 0x7fb3a8004d40 2024-05-30T16:46:42.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3bf400640 1 -- 172.21.15.144:0/3531116884 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b802bc00 con 0x7fb3a8004d40 2024-05-30T16:46:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3c6400640 1 -- 172.21.15.144:0/3531116884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 msgr2=0x7fb3a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3c6400640 1 --2- 172.21.15.144:0/3531116884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3a80051c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800a790 tx=0x7fb3a8005830 comp rx=0 tx=0).stop 2024-05-30T16:46:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3c5a00640 1 -- 172.21.15.144:0/3531116884 reap_dead start 2024-05-30T16:46:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3c6400640 1 -- 172.21.15.144:0/3531116884 shutdown_connections 2024-05-30T16:46:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3c6400640 1 -- 172.21.15.144:0/3531116884 >> 172.21.15.144:0/3531116884 conn(0x7fb3c006b8e0 msgr2=0x7fb3c006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3c6400640 1 -- 172.21.15.144:0/3531116884 shutdown_connections 2024-05-30T16:46:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.941+0000 7fb3c6400640 1 -- 172.21.15.144:0/3531116884 wait complete. 2024-05-30T16:46:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.943+0000 7fb3c6400640 1 Processor -- start 2024-05-30T16:46:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.943+0000 7fb3c6400640 1 -- start start 2024-05-30T16:46:42.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.944+0000 7fb3c6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3c00cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.944+0000 7fb3c6400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c00cc760 0x7fb3c01f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.944+0000 7fb3c6400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c01f7ef0 0x7fb3c00b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.944+0000 7fb3c6400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c00ce150 con 0x7fb3a8004d40 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.944+0000 7fb3c6400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c00cd7d0 con 0x7fb3c01f7ef0 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.944+0000 7fb3c6400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c00ca660 con 0x7fb3c00cc760 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3c00cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3c00cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42940/0 (socket says 172.21.15.144:42940) 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5000640 1 -- 172.21.15.144:0/3336984544 learned_addr learned my addr 172.21.15.144:0/3336984544 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3bfe00640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c00cc760 0x7fb3c01f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5000640 1 -- 172.21.15.144:0/3336984544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c00cc760 msgr2=0x7fb3c01f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5000640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c00cc760 0x7fb3c01f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5a00640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c01f7ef0 0x7fb3c00b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5000640 1 -- 172.21.15.144:0/3336984544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c01f7ef0 msgr2=0x7fb3c00b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:42.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5000640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c01f7ef0 0x7fb3c00b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:42.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5000640 1 -- 172.21.15.144:0/3336984544 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c00ca940 con 0x7fb3a8004d40 2024-05-30T16:46:42.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3bfe00640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c00cc760 0x7fb3c01f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:46:42.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.945+0000 7fb3c5000640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3c00cc220 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400e810 tx=0x7fb3b400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:42.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.946+0000 7fb3bcc00640 1 -- 172.21.15.144:0/3336984544 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4017070 con 0x7fb3a8004d40 2024-05-30T16:46:42.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.946+0000 7fb3bcc00640 1 -- 172.21.15.144:0/3336984544 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b400c6d0 con 0x7fb3a8004d40 2024-05-30T16:46:42.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.946+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c00cac20 con 0x7fb3a8004d40 2024-05-30T16:46:42.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.946+0000 7fb3bcc00640 1 -- 172.21.15.144:0/3336984544 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400f040 con 0x7fb3a8004d40 2024-05-30T16:46:42.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.946+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c00ac180 con 0x7fb3a8004d40 2024-05-30T16:46:42.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.947+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c01f8300 con 0x7fb3a8004d40 2024-05-30T16:46:42.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.948+0000 7fb3bcc00640 1 -- 172.21.15.144:0/3336984544 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 12) ==== 91295+0+0 (secure 0 0 0) 0x7fb3b401a070 con 0x7fb3a8004d40 2024-05-30T16:46:42.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.949+0000 7fb3bcc00640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb3a006cbf0 0x7fb3a006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:42.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.949+0000 7fb3bcc00640 1 -- 172.21.15.144:0/3336984544 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fb3b408be40 con 0x7fb3a8004d40 2024-05-30T16:46:42.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.949+0000 7fb3bfe00640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb3a006cbf0 0x7fb3a006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:42.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.950+0000 7fb3bfe00640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb3a006cbf0 0x7fb3a006f0b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0138e30 tx=0x7fb3ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:42.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:42.953+0000 7fb3bcc00640 1 -- 172.21.15.144:0/3336984544 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb3c01f8300 con 0x7fb3a8004d40 2024-05-30T16:46:43.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.173+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone79571", "target": ["mon-mgr", ""]}) -- 0x7fb3c0075570 con 0x7fb3a006cbf0 2024-05-30T16:46:43.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.324+0000 7fb3bcc00640 1 -- 172.21.15.144:0/3336984544 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb3c0075570 con 0x7fb3a006cbf0 2024-05-30T16:46:43.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb3a006cbf0 msgr2=0x7fb3a006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:43.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb3a006cbf0 0x7fb3a006f0b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0138e30 tx=0x7fb3ac009040 comp rx=0 tx=0).stop 2024-05-30T16:46:43.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 msgr2=0x7fb3c00cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:43.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3c00cc220 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400e810 tx=0x7fb3b400ecd0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 shutdown_connections 2024-05-30T16:46:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb3a006cbf0 0x7fb3a006f0b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c01f7ef0 0x7fb3c00b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c00cc760 0x7fb3c01f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 --2- 172.21.15.144:0/3336984544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3a8004d40 0x7fb3c00cc220 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 >> 172.21.15.144:0/3336984544 conn(0x7fb3c006b8e0 msgr2=0x7fb3c00b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 shutdown_connections 2024-05-30T16:46:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.327+0000 7fb3c6400640 1 -- 172.21.15.144:0/3336984544 wait complete. 2024-05-30T16:46:43.331 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.329+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.331 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.329+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.331 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.329+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.331 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.329+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.331 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.329+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone79572 2024-05-30T16:46:43.356 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.351+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.356 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.351+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.356 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.351+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.356 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.351+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.356 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:43.351+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:43.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.539+0000 7f1b95a00640 1 Processor -- start 2024-05-30T16:46:43.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.539+0000 7f1b95a00640 1 -- start start 2024-05-30T16:46:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b95a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b90145150 0x7f1b900cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b95a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 0x7f1b9006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b95a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1b9006f610 0x7f1b90072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b95a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1b900cfeb0 con 0x7f1b90145150 2024-05-30T16:46:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b95a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f1b9015f140 con 0x7f1b9006f610 2024-05-30T16:46:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b95a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b900d00f0 con 0x7f1b900cfa70 2024-05-30T16:46:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b8ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b90145150 0x7f1b900cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b8ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b90145150 0x7f1b900cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42976/0 (socket says 172.21.15.144:42976) 2024-05-30T16:46:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b8ea00640 1 -- 172.21.15.144:0/114985561 learned_addr learned my addr 172.21.15.144:0/114985561 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b8f400640 1 --2- 172.21.15.144:0/114985561 >> v2:172.21.15.149:3300/0 conn(0x7f1b9006f610 0x7f1b90072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.541+0000 7f1b87e00640 1 --2- 172.21.15.144:0/114985561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 0x7f1b9006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.542+0000 7f1b8ea00640 1 -- 172.21.15.144:0/114985561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 msgr2=0x7f1b9006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.542+0000 7f1b8ea00640 1 --2- 172.21.15.144:0/114985561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 0x7f1b9006f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.542+0000 7f1b8ea00640 1 -- 172.21.15.144:0/114985561 >> v2:172.21.15.149:3300/0 conn(0x7f1b9006f610 msgr2=0x7f1b90072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.542+0000 7f1b8ea00640 1 --2- 172.21.15.144:0/114985561 >> v2:172.21.15.149:3300/0 conn(0x7f1b9006f610 0x7f1b90072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.542+0000 7f1b8ea00640 1 -- 172.21.15.144:0/114985561 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9015f390 con 0x7f1b90145150 2024-05-30T16:46:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.542+0000 7f1b87e00640 1 --2- 172.21.15.144:0/114985561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 0x7f1b9006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:46:43.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.543+0000 7f1b8ea00640 1 --2- 172.21.15.144:0/114985561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 0x7f1b900cf530 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b900b37d0 tx=0x7f1b8002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a73e36512de1fa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:43.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.543+0000 7f1b8e000640 1 -- 172.21.15.144:0/114985561 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80037070 con 0x7f1b90145150 2024-05-30T16:46:43.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.543+0000 7f1b8e000640 1 -- 172.21.15.144:0/114985561 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b80032440 con 0x7f1b90145150 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.543+0000 7f1b8e000640 1 -- 172.21.15.144:0/114985561 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80032810 con 0x7f1b90145150 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.544+0000 7f1b95a00640 1 -- 172.21.15.144:0/114985561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 msgr2=0x7f1b900cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.544+0000 7f1b95a00640 1 --2- 172.21.15.144:0/114985561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 0x7f1b900cf530 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b900b37d0 tx=0x7f1b8002a140 comp rx=0 tx=0).stop 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.544+0000 7f1b95a00640 1 -- 172.21.15.144:0/114985561 shutdown_connections 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.544+0000 7f1b95a00640 1 --2- 172.21.15.144:0/114985561 >> v2:172.21.15.149:3300/0 conn(0x7f1b9006f610 0x7f1b90072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.544+0000 7f1b95a00640 1 --2- 172.21.15.144:0/114985561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 0x7f1b9006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.544+0000 7f1b95a00640 1 --2- 172.21.15.144:0/114985561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 0x7f1b900cf530 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.544+0000 7f1b95a00640 1 -- 172.21.15.144:0/114985561 >> 172.21.15.144:0/114985561 conn(0x7f1b9006bd00 msgr2=0x7f1b9006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.544+0000 7f1b95a00640 1 -- 172.21.15.144:0/114985561 shutdown_connections 2024-05-30T16:46:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.544+0000 7f1b95a00640 1 -- 172.21.15.144:0/114985561 wait complete. 2024-05-30T16:46:43.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.546+0000 7f1b95a00640 1 Processor -- start 2024-05-30T16:46:43.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.546+0000 7f1b95a00640 1 -- start start 2024-05-30T16:46:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.547+0000 7f1b95a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b9006f610 0x7f1b901363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.547+0000 7f1b95a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 0x7f1b90138320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.547+0000 7f1b95a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 0x7f1b9013e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.547+0000 7f1b95a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b900b64f0 con 0x7f1b90145150 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.547+0000 7f1b95a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9015f950 con 0x7f1b9006f610 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.547+0000 7f1b95a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9015fe70 con 0x7f1b900cfa70 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.547+0000 7f1b8f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 0x7f1b9013e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.547+0000 7f1b8f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 0x7f1b9013e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42986/0 (socket says 172.21.15.144:42986) 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.547+0000 7f1b8f400640 1 -- 172.21.15.144:0/2338942635 learned_addr learned my addr 172.21.15.144:0/2338942635 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.548+0000 7f1b8ea00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b9006f610 0x7f1b901363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.548+0000 7f1b87e00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 0x7f1b90138320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.548+0000 7f1b8f400640 1 -- 172.21.15.144:0/2338942635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 msgr2=0x7f1b90138320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.548+0000 7f1b8f400640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 0x7f1b90138320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.548+0000 7f1b8f400640 1 -- 172.21.15.144:0/2338942635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b9006f610 msgr2=0x7f1b901363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.548+0000 7f1b8f400640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b9006f610 0x7f1b901363b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.548+0000 7f1b8f400640 1 -- 172.21.15.144:0/2338942635 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b900ae2b0 con 0x7f1b90145150 2024-05-30T16:46:43.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.548+0000 7f1b8f400640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 0x7f1b9013e930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1b88007d50 tx=0x7f1b8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:43.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.548+0000 7f1b86a00640 1 -- 172.21.15.144:0/2338942635 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88014420 con 0x7f1b90145150 2024-05-30T16:46:43.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.549+0000 7f1b86a00640 1 -- 172.21.15.144:0/2338942635 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b88019070 con 0x7f1b90145150 2024-05-30T16:46:43.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.549+0000 7f1b86a00640 1 -- 172.21.15.144:0/2338942635 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88014820 con 0x7f1b90145150 2024-05-30T16:46:43.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.549+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b900ae590 con 0x7f1b90145150 2024-05-30T16:46:43.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.549+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b900aeb50 con 0x7f1b90145150 2024-05-30T16:46:43.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.550+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b90068b90 con 0x7f1b90145150 2024-05-30T16:46:43.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.551+0000 7f1b86a00640 1 -- 172.21.15.144:0/2338942635 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 91346+0+0 (secure 0 0 0) 0x7f1b880149c0 con 0x7f1b90145150 2024-05-30T16:46:43.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.552+0000 7f1b86a00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b6c06cc50 0x7f1b6c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:43.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.552+0000 7f1b86a00640 1 -- 172.21.15.144:0/2338942635 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f1b8808c990 con 0x7f1b90145150 2024-05-30T16:46:43.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.552+0000 7f1b8ea00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b6c06cc50 0x7f1b6c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:43.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.553+0000 7f1b8ea00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b6c06cc50 0x7f1b6c06f110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b80034000 tx=0x7f1b8002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:43.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.557+0000 7f1b86a00640 1 -- 172.21.15.144:0/2338942635 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b8805a930 con 0x7f1b90145150 2024-05-30T16:46:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:43.794+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone79572", "target": ["mon-mgr", ""]}) -- 0x7f1b90143d60 con 0x7f1b6c06cc50 2024-05-30T16:46:44.332 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.331+0000 7fe1b6600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.332 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.331+0000 7fe1b6600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.332 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.331+0000 7fe1b6600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.332 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.331+0000 7fe1b6600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.332 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.331+0000 7fe1b6600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.505+0000 7f1b86a00640 1 -- 172.21.15.144:0/2338942635 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1b90143d60 con 0x7f1b6c06cc50 2024-05-30T16:46:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b6c06cc50 msgr2=0x7f1b6c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b6c06cc50 0x7f1b6c06f110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b80034000 tx=0x7f1b8002e000 comp rx=0 tx=0).stop 2024-05-30T16:46:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 msgr2=0x7f1b9013e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 0x7f1b9013e930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1b88007d50 tx=0x7f1b8800e4b0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 shutdown_connections 2024-05-30T16:46:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b6c06cc50 0x7f1b6c06f110 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90145150 0x7f1b9013e930 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b900cfa70 0x7f1b90138320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 --2- 172.21.15.144:0/2338942635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b9006f610 0x7f1b901363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.508+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 >> 172.21.15.144:0/2338942635 conn(0x7f1b9006bd00 msgr2=0x7f1b9006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:44.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.509+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 shutdown_connections 2024-05-30T16:46:44.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.509+0000 7f1b95a00640 1 -- 172.21.15.144:0/2338942635 wait complete. 2024-05-30T16:46:44.531 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.524+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.531 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.524+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.531 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.524+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.531 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.524+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.531 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:44.524+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:44.545 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone79573 2024-05-30T16:46:44.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.899+0000 7fc945400640 1 Processor -- start 2024-05-30T16:46:44.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.899+0000 7fc945400640 1 -- start start 2024-05-30T16:46:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.901+0000 7fc945400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc940140c80 0x7fc940165c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.901+0000 7fc945400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9400cd030 con 0x7fc9400afa00 2024-05-30T16:46:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.901+0000 7fc945400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9400ceca0 con 0x7fc9400cc7a0 2024-05-30T16:46:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.901+0000 7fc945400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9401413f0 con 0x7fc940140c80 2024-05-30T16:46:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.901+0000 7fc93e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc9400afa00 0x7fc94015bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48990/0 (socket says 172.21.15.144:48990) 2024-05-30T16:46:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.901+0000 7fc93e800640 1 -- 172.21.15.144:0/497653199 learned_addr learned my addr 172.21.15.144:0/497653199 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358308938 0 0) 0x7fc9400cd030 con 0x7fc9400afa00 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc924003440 con 0x7fc9400afa00 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3441195236 0 0) 0x7fc924003440 con 0x7fc9400afa00 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc940140c80 msgr2=0x7fc940165c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 --2- 172.21.15.144:0/497653199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc940140c80 0x7fc940165c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 >> v1:172.21.15.149:6789/0 conn(0x7fc9400cc7a0 legacy=0x7fc940140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9400cd2a0 con 0x7fc9400afa00 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fc930001670 con 0x7fc9400afa00 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 >> v1:172.21.15.144:6789/0 conn(0x7fc9400afa00 legacy=0x7fc94015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 --2- 172.21.15.144:0/497653199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc940140c80 0x7fc924003ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:44.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 --2- 172.21.15.144:0/497653199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc924008850 0x7fc92400ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:44.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 --2- 172.21.15.144:0/497653199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc92400d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:44.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc92400dea0 con 0x7fc92400b180 2024-05-30T16:46:44.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc92400e050 con 0x7fc924008850 2024-05-30T16:46:44.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.902+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc924004630 con 0x7fc940140c80 2024-05-30T16:46:44.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.903+0000 7fc93f200640 1 --2- 172.21.15.144:0/497653199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc92400d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:44.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.903+0000 7fc93f200640 1 -- 172.21.15.144:0/497653199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc940140c80 msgr2=0x7fc924003ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:44.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.903+0000 7fc93f200640 1 --2- 172.21.15.144:0/497653199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc940140c80 0x7fc924003ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.903+0000 7fc93f200640 1 -- 172.21.15.144:0/497653199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc924008850 msgr2=0x7fc92400ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:44.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.903+0000 7fc93f200640 1 --2- 172.21.15.144:0/497653199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc924008850 0x7fc92400ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.903+0000 7fc93f200640 1 -- 172.21.15.144:0/497653199 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc924003440 con 0x7fc92400b180 2024-05-30T16:46:44.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.904+0000 7fc93f200640 1 --2- 172.21.15.144:0/497653199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc92400d5f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc938009e40 tx=0x7fc924003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27ce61b81dd5ab9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:44.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.905+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938033070 con 0x7fc92400b180 2024-05-30T16:46:44.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.905+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc938006e50 con 0x7fc92400b180 2024-05-30T16:46:44.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.905+0000 7fc93de00640 1 -- 172.21.15.144:0/497653199 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938009a10 con 0x7fc92400b180 2024-05-30T16:46:44.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.906+0000 7fc945400640 1 -- 172.21.15.144:0/497653199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 msgr2=0x7fc92400d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:44.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.906+0000 7fc945400640 1 --2- 172.21.15.144:0/497653199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc92400d5f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc938009e40 tx=0x7fc924003730 comp rx=0 tx=0).stop 2024-05-30T16:46:44.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.906+0000 7fc93f200640 1 -- 172.21.15.144:0/497653199 reap_dead start 2024-05-30T16:46:44.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.906+0000 7fc945400640 1 -- 172.21.15.144:0/497653199 shutdown_connections 2024-05-30T16:46:44.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.906+0000 7fc945400640 1 -- 172.21.15.144:0/497653199 >> 172.21.15.144:0/497653199 conn(0x7fc94006bd00 msgr2=0x7fc94006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:44.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.906+0000 7fc945400640 1 -- 172.21.15.144:0/497653199 shutdown_connections 2024-05-30T16:46:44.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.906+0000 7fc945400640 1 -- 172.21.15.144:0/497653199 wait complete. 2024-05-30T16:46:44.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.908+0000 7fc945400640 1 Processor -- start 2024-05-30T16:46:44.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.908+0000 7fc945400640 1 -- start start 2024-05-30T16:46:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.910+0000 7fc945400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc94015db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.910+0000 7fc945400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94013e490 0x7fc94013e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.910+0000 7fc945400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc94013b480 0x7fc94013b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.910+0000 7fc945400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc9400ccc60 con 0x7fc92400b180 2024-05-30T16:46:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.910+0000 7fc945400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9400cd860 con 0x7fc94013b480 2024-05-30T16:46:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.910+0000 7fc945400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9400afde0 con 0x7fc94013e490 2024-05-30T16:46:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.910+0000 7fc93e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc94015db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.910+0000 7fc93e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc94015db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58768/0 (socket says 172.21.15.144:58768) 2024-05-30T16:46:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.910+0000 7fc93e800640 1 -- 172.21.15.144:0/2037779020 learned_addr learned my addr 172.21.15.144:0/2037779020 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:44.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.911+0000 7fc93f200640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc94013b480 0x7fc94013b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:44.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.911+0000 7fc93e800640 1 -- 172.21.15.144:0/2037779020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94013e490 msgr2=0x7fc94013e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:44.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.911+0000 7fc93e800640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94013e490 0x7fc94013e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.911+0000 7fc93e800640 1 -- 172.21.15.144:0/2037779020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc94013b480 msgr2=0x7fc94013b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:44.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.911+0000 7fc93e800640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc94013b480 0x7fc94013b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:44.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.911+0000 7fc93e800640 1 -- 172.21.15.144:0/2037779020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94015e090 con 0x7fc92400b180 2024-05-30T16:46:44.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.912+0000 7fc93e800640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc94015db50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc93000c7a0 tx=0x7fc93000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:44.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.913+0000 7fc936a00640 1 -- 172.21.15.144:0/2037779020 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc930018070 con 0x7fc92400b180 2024-05-30T16:46:44.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.913+0000 7fc936a00640 1 -- 172.21.15.144:0/2037779020 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc930007560 con 0x7fc92400b180 2024-05-30T16:46:44.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.913+0000 7fc936a00640 1 -- 172.21.15.144:0/2037779020 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc930004a20 con 0x7fc92400b180 2024-05-30T16:46:44.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.913+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94013be40 con 0x7fc92400b180 2024-05-30T16:46:44.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.913+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9401f9f50 con 0x7fc92400b180 2024-05-30T16:46:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.915+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc940068b90 con 0x7fc92400b180 2024-05-30T16:46:44.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.917+0000 7fc936a00640 1 -- 172.21.15.144:0/2037779020 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 91346+0+0 (secure 0 0 0) 0x7fc93001b070 con 0x7fc92400b180 2024-05-30T16:46:44.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.919+0000 7fc936a00640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc91c06cd20 0x7fc91c06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:44.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.919+0000 7fc936a00640 1 -- 172.21.15.144:0/2037779020 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fc93008b7e0 con 0x7fc92400b180 2024-05-30T16:46:44.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.921+0000 7fc937e00640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc91c06cd20 0x7fc91c06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:44.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.925+0000 7fc937e00640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc91c06cd20 0x7fc91c06f1e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc9400b14f0 tx=0x7fc928007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:44.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:44.926+0000 7fc936a00640 1 -- 172.21.15.144:0/2037779020 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc93004fb80 con 0x7fc92400b180 2024-05-30T16:46:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:45.362+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone79573", "target": ["mon-mgr", ""]}) -- 0x7fc9401f9a20 con 0x7fc91c06cd20 2024-05-30T16:46:45.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:45.456+0000 7fc936a00640 1 -- 172.21.15.144:0/2037779020 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 14) ==== 91550+0+0 (secure 0 0 0) 0x7fc930055800 con 0x7fc92400b180 2024-05-30T16:46:46.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.000+0000 7fc936a00640 1 -- 172.21.15.144:0/2037779020 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc9401f9a20 con 0x7fc91c06cd20 2024-05-30T16:46:46.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.003+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc91c06cd20 msgr2=0x7fc91c06f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:46.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.003+0000 7fc945400640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc91c06cd20 0x7fc91c06f1e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc9400b14f0 tx=0x7fc928007990 comp rx=0 tx=0).stop 2024-05-30T16:46:46.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.003+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 msgr2=0x7fc94015db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:46.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.003+0000 7fc945400640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc94015db50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc93000c7a0 tx=0x7fc93000cc60 comp rx=0 tx=0).stop 2024-05-30T16:46:46.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.004+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 shutdown_connections 2024-05-30T16:46:46.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.004+0000 7fc945400640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc91c06cd20 0x7fc91c06f1e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:46.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.004+0000 7fc945400640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc94013b480 0x7fc94013b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:46.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.004+0000 7fc945400640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94013e490 0x7fc94013e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:46.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.004+0000 7fc945400640 1 --2- 172.21.15.144:0/2037779020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92400b180 0x7fc94015db50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:46.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.004+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 >> 172.21.15.144:0/2037779020 conn(0x7fc94006bd00 msgr2=0x7fc94006e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:46.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.004+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 shutdown_connections 2024-05-30T16:46:46.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.005+0000 7fc945400640 1 -- 172.21.15.144:0/2037779020 wait complete. 2024-05-30T16:46:46.062 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone79574 2024-05-30T16:46:46.082 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:46.080+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:46.082 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:46.080+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:46.082 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:46.080+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:46.082 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:46.080+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:46.082 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:46.080+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:46.416 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:46:46.426 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:46:46.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.467+0000 7f808b200640 1 Processor -- start 2024-05-30T16:46:46.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.467+0000 7f808b200640 1 -- start start 2024-05-30T16:46:46.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.469+0000 7f808b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80840b6380 0x7f8084169810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:46.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.469+0000 7f808b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808415c850 con 0x7f8084163040 2024-05-30T16:46:46.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.469+0000 7f808b200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808415f030 con 0x7f808415c470 2024-05-30T16:46:46.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.469+0000 7f808b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f808415fdf0 con 0x7f80840b6380 2024-05-30T16:46:46.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.470+0000 7f8089200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80840b6380 0x7f8084169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:46.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.470+0000 7f8083400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8084163040 0x7f808406dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48994/0 (socket says 172.21.15.144:48994) 2024-05-30T16:46:46.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.470+0000 7f8083400640 1 -- 172.21.15.144:0/1834644691 learned_addr learned my addr 172.21.15.144:0/1834644691 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:46:46.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.474+0000 7f8089200640 1 -- 172.21.15.144:0/1834644691 >> v1:172.21.15.149:6789/0 conn(0x7f808415c470 legacy=0x7f80840b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.474+0000 7f8089200640 1 -- 172.21.15.144:0/1834644691 >> v1:172.21.15.144:6789/0 conn(0x7f8084163040 legacy=0x7f808406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.474+0000 7f8089200640 1 -- 172.21.15.144:0/1834644691 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808415f310 con 0x7f80840b6380 2024-05-30T16:46:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.476+0000 7f8089200640 1 --2- 172.21.15.144:0/1834644691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80840b6380 0x7f8084169810 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f80700097a0 tx=0x7f807002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105d77178ef5c5bb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:46.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.479+0000 7f8082a00640 1 -- 172.21.15.144:0/1834644691 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070037070 con 0x7f80840b6380 2024-05-30T16:46:46.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.479+0000 7f8082a00640 1 -- 172.21.15.144:0/1834644691 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8070032440 con 0x7f80840b6380 2024-05-30T16:46:46.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.479+0000 7f8082a00640 1 -- 172.21.15.144:0/1834644691 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070032810 con 0x7f80840b6380 2024-05-30T16:46:46.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.480+0000 7f808b200640 1 -- 172.21.15.144:0/1834644691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80840b6380 msgr2=0x7f8084169810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:46.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.480+0000 7f808b200640 1 --2- 172.21.15.144:0/1834644691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80840b6380 0x7f8084169810 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f80700097a0 tx=0x7f807002a230 comp rx=0 tx=0).stop 2024-05-30T16:46:46.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.481+0000 7f808b200640 1 -- 172.21.15.144:0/1834644691 shutdown_connections 2024-05-30T16:46:46.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.481+0000 7f808b200640 1 --2- 172.21.15.144:0/1834644691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80840b6380 0x7f8084169810 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:46.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.481+0000 7f808b200640 1 -- 172.21.15.144:0/1834644691 >> 172.21.15.144:0/1834644691 conn(0x7f8084070050 msgr2=0x7f808406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.482+0000 7f808b200640 1 -- 172.21.15.144:0/1834644691 shutdown_connections 2024-05-30T16:46:46.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.482+0000 7f808b200640 1 -- 172.21.15.144:0/1834644691 wait complete. 2024-05-30T16:46:46.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.486+0000 7f808b200640 1 Processor -- start 2024-05-30T16:46:46.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.486+0000 7f808b200640 1 -- start start 2024-05-30T16:46:46.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.491+0000 7f808b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80840b6380 0x7f808415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:46.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.492+0000 7f808b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f808415c470 0x7f80841445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:46.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.492+0000 7f808b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8084163040 0x7f80840aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:46.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.492+0000 7f808b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f808415f960 con 0x7f8084163040 2024-05-30T16:46:46.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.492+0000 7f808b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80840b3e50 con 0x7f808415c470 2024-05-30T16:46:46.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.492+0000 7f808b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f808406e6d0 con 0x7f80840b6380 2024-05-30T16:46:46.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.493+0000 7f8083e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80840b6380 0x7f808415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:46.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.493+0000 7f8083e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80840b6380 0x7f808415b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:41892/0 (socket says 172.21.15.144:41892) 2024-05-30T16:46:46.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.493+0000 7f8083e00640 1 -- 172.21.15.144:0/3269291202 learned_addr learned my addr 172.21.15.144:0/3269291202 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:46.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.493+0000 7f8083400640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f808415c470 0x7f80841445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:46.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.493+0000 7f8089200640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8084163040 0x7f80840aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.495+0000 7f8083e00640 1 -- 172.21.15.144:0/3269291202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f808415c470 msgr2=0x7f80841445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.495+0000 7f8083e00640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f808415c470 0x7f80841445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.495+0000 7f8083e00640 1 -- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8084163040 msgr2=0x7f80840aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.495+0000 7f8083e00640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8084163040 0x7f80840aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.495+0000 7f8083e00640 1 -- 172.21.15.144:0/3269291202 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8084144af0 con 0x7f80840b6380 2024-05-30T16:46:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.495+0000 7f8089200640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8084163040 0x7f80840aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:46:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.497+0000 7f8083e00640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80840b6380 0x7f808415b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f807c00c7c0 tx=0x7f807c00cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.498+0000 7f807be00640 1 -- 172.21.15.144:0/3269291202 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c016020 con 0x7f80840b6380 2024-05-30T16:46:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.498+0000 7f807be00640 1 -- 172.21.15.144:0/3269291202 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c006d50 con 0x7f80840b6380 2024-05-30T16:46:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.499+0000 7f807be00640 1 -- 172.21.15.144:0/3269291202 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c003bb0 con 0x7f80840b6380 2024-05-30T16:46:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.500+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8084204570 con 0x7f80840b6380 2024-05-30T16:46:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.500+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8084204b30 con 0x7f80840b6380 2024-05-30T16:46:46.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.507+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f808406c870 con 0x7f80840b6380 2024-05-30T16:46:46.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.512+0000 7f807be00640 1 -- 172.21.15.144:0/3269291202 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 14) ==== 91550+0+0 (secure 0 0 0) 0x7f807c00a850 con 0x7f80840b6380 2024-05-30T16:46:46.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.513+0000 7f807be00640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f806406cf60 0x7f806406f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:46.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.513+0000 7f807be00640 1 -- 172.21.15.144:0/3269291202 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f807c08c3b0 con 0x7f80840b6380 2024-05-30T16:46:46.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.517+0000 7f807be00640 1 -- 172.21.15.144:0/3269291202 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f807c020020 con 0x7f80840b6380 2024-05-30T16:46:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.519+0000 7f8083400640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f806406cf60 0x7f806406f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:46.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:46.524+0000 7f8083400640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f806406cf60 0x7f806406f420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f80841456b0 tx=0x7f8074009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:47.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:47.015+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone79574", "target": ["mon-mgr", ""]}) -- 0x7f8084075f70 con 0x7f806406cf60 2024-05-30T16:46:47.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:47.496+0000 7f807be00640 1 -- 172.21.15.144:0/3269291202 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mgrmap(e 15) ==== 91601+0+0 (secure 0 0 0) 0x7f807c056020 con 0x7f80840b6380 2024-05-30T16:46:48.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.764+0000 7f807be00640 1 -- 172.21.15.144:0/3269291202 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f80740014e0 con 0x7f806406cf60 2024-05-30T16:46:48.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f806406cf60 msgr2=0x7f806406f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:48.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f806406cf60 0x7f806406f420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f80841456b0 tx=0x7f8074009040 comp rx=0 tx=0).stop 2024-05-30T16:46:48.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80840b6380 msgr2=0x7f808415b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80840b6380 0x7f808415b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f807c00c7c0 tx=0x7f807c00cc80 comp rx=0 tx=0).stop 2024-05-30T16:46:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 shutdown_connections 2024-05-30T16:46:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f806406cf60 0x7f806406f420 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8084163040 0x7f80840aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f808415c470 0x7f80841445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 --2- 172.21.15.144:0/3269291202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80840b6380 0x7f808415b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 >> 172.21.15.144:0/3269291202 conn(0x7f8084070050 msgr2=0x7f808415cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 shutdown_connections 2024-05-30T16:46:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:48.770+0000 7f808b200640 1 -- 172.21.15.144:0/3269291202 wait complete. 2024-05-30T16:46:48.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:46:49.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.185+0000 7ff560e00640 1 Processor -- start 2024-05-30T16:46:49.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.185+0000 7ff560e00640 1 -- start start 2024-05-30T16:46:49.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.188+0000 7ff560e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff55c162ea0 0x7ff55c1673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:49.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.188+0000 7ff560e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff55c0b6180 0x7ff55c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:49.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.188+0000 7ff560e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55c0b69d0 con 0x7ff55c162ac0 2024-05-30T16:46:49.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.188+0000 7ff560e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff55c0d22d0 con 0x7ff55c162ea0 2024-05-30T16:46:49.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.188+0000 7ff560e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff55c0d2520 con 0x7ff55c0b6180 2024-05-30T16:46:49.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.190+0000 7ff55aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff55c162ea0 0x7ff55c1673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:49.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.190+0000 7ff55aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff55c162ea0 0x7ff55c1673d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58800/0 (socket says 172.21.15.144:58800) 2024-05-30T16:46:49.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.190+0000 7ff55aa00640 1 -- 172.21.15.144:0/1640916255 learned_addr learned my addr 172.21.15.144:0/1640916255 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:49.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.191+0000 7ff55aa00640 1 -- 172.21.15.144:0/1640916255 >> v2:172.21.15.149:3300/0 conn(0x7ff55c0b6180 msgr2=0x7ff55c0ced50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:46:49.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.191+0000 7ff55aa00640 1 --2- 172.21.15.144:0/1640916255 >> v2:172.21.15.149:3300/0 conn(0x7ff55c0b6180 0x7ff55c0ced50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:49.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.191+0000 7ff55aa00640 1 -- 172.21.15.144:0/1640916255 >> v1:172.21.15.149:6789/0 conn(0x7ff55c162ac0 legacy=0x7ff55c0d3000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:46:49.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.191+0000 7ff55aa00640 1 -- 172.21.15.144:0/1640916255 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c0d2800 con 0x7ff55c162ea0 2024-05-30T16:46:49.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.199+0000 7ff55aa00640 1 --2- 172.21.15.144:0/1640916255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 0x7ff55c1673d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0c81d0 tx=0x7ff54c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb232bc41794080b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:49.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.202+0000 7ff55a000640 1 -- 172.21.15.144:0/1640916255 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c036070 con 0x7ff55c162ea0 2024-05-30T16:46:49.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.203+0000 7ff55a000640 1 -- 172.21.15.144:0/1640916255 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c031600 con 0x7ff55c162ea0 2024-05-30T16:46:49.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.203+0000 7ff55a000640 1 -- 172.21.15.144:0/1640916255 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0319d0 con 0x7ff55c162ea0 2024-05-30T16:46:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.209+0000 7ff560e00640 1 -- 172.21.15.144:0/1640916255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 msgr2=0x7ff55c1673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:49.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.209+0000 7ff560e00640 1 --2- 172.21.15.144:0/1640916255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 0x7ff55c1673d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0c81d0 tx=0x7ff54c02a420 comp rx=0 tx=0).stop 2024-05-30T16:46:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.210+0000 7ff560e00640 1 -- 172.21.15.144:0/1640916255 shutdown_connections 2024-05-30T16:46:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.211+0000 7ff560e00640 1 --2- 172.21.15.144:0/1640916255 >> v2:172.21.15.149:3300/0 conn(0x7ff55c0b6180 0x7ff55c0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.211+0000 7ff560e00640 1 --2- 172.21.15.144:0/1640916255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 0x7ff55c1673d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.211+0000 7ff560e00640 1 -- 172.21.15.144:0/1640916255 >> 172.21.15.144:0/1640916255 conn(0x7ff55c0d1360 msgr2=0x7ff55c0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.212+0000 7ff560e00640 1 -- 172.21.15.144:0/1640916255 shutdown_connections 2024-05-30T16:46:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.212+0000 7ff560e00640 1 -- 172.21.15.144:0/1640916255 wait complete. 2024-05-30T16:46:49.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.221+0000 7ff560e00640 1 Processor -- start 2024-05-30T16:46:49.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.222+0000 7ff560e00640 1 -- start start 2024-05-30T16:46:49.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.227+0000 7ff560e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0b6180 0x7ff55c1664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:49.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.228+0000 7ff560e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff55c162ac0 0x7ff55c152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:49.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.228+0000 7ff560e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 0x7ff55c1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:49.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.228+0000 7ff560e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c0b6720 con 0x7ff55c162ea0 2024-05-30T16:46:49.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.229+0000 7ff560e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c0b65a0 con 0x7ff55c0b6180 2024-05-30T16:46:49.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.229+0000 7ff560e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff55c0cf290 con 0x7ff55c162ac0 2024-05-30T16:46:49.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.229+0000 7ff55aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff55c162ac0 0x7ff55c152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:49.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.230+0000 7ff55aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff55c162ac0 0x7ff55c152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:41906/0 (socket says 172.21.15.144:41906) 2024-05-30T16:46:49.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.230+0000 7ff55aa00640 1 -- 172.21.15.144:0/1164647581 learned_addr learned my addr 172.21.15.144:0/1164647581 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:49.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.232+0000 7ff55be00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 0x7ff55c1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:49.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.236+0000 7ff55b400640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0b6180 0x7ff55c1664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:49.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.238+0000 7ff55be00640 1 -- 172.21.15.144:0/1164647581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff55c162ac0 msgr2=0x7ff55c152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.238+0000 7ff55be00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff55c162ac0 0x7ff55c152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.239+0000 7ff55be00640 1 -- 172.21.15.144:0/1164647581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0b6180 msgr2=0x7ff55c1664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.239+0000 7ff55be00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0b6180 0x7ff55c1664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.239+0000 7ff55be00640 1 -- 172.21.15.144:0/1164647581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c14d370 con 0x7ff55c162ea0 2024-05-30T16:46:49.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.241+0000 7ff55be00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 0x7ff55c1532c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff54800b3e0 tx=0x7ff54800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:49.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.245+0000 7ff553400640 1 -- 172.21.15.144:0/1164647581 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548015020 con 0x7ff55c162ea0 2024-05-30T16:46:49.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.245+0000 7ff553400640 1 -- 172.21.15.144:0/1164647581 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548011850 con 0x7ff55c162ea0 2024-05-30T16:46:49.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.247+0000 7ff553400640 1 -- 172.21.15.144:0/1164647581 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548011c40 con 0x7ff55c162ea0 2024-05-30T16:46:49.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.247+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55c14d650 con 0x7ff55c162ea0 2024-05-30T16:46:49.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.247+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55c14dc10 con 0x7ff55c162ea0 2024-05-30T16:46:49.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.250+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55c075570 con 0x7ff55c162ea0 2024-05-30T16:46:49.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.261+0000 7ff553400640 1 -- 172.21.15.144:0/1164647581 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) ==== 91601+0+0 (secure 0 0 0) 0x7ff548018020 con 0x7ff55c162ea0 2024-05-30T16:46:49.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.271+0000 7ff553400640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff53c06cf20 0x7ff53c06f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:49.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.271+0000 7ff553400640 1 -- 172.21.15.144:0/1164647581 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7ff54808caa0 con 0x7ff55c162ea0 2024-05-30T16:46:49.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.274+0000 7ff553400640 1 -- 172.21.15.144:0/1164647581 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff54801f020 con 0x7ff55c162ea0 2024-05-30T16:46:49.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.298+0000 7ff55b400640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff53c06cf20 0x7ff53c06f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:49.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.375+0000 7ff55b400640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff53c06cf20 0x7ff53c06f3e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff554009fd0 tx=0x7ff55400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.940+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff55c0ba590 con 0x7ff55c162ea0 2024-05-30T16:46:49.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.944+0000 7ff553400640 1 -- 172.21.15.144:0/1164647581 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2139 (secure 0 0 0) 0x7ff548059f40 con 0x7ff55c162ea0 2024-05-30T16:46:49.951 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:46:49.951 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:46:49.951 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:46:49.951 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:46:49.951 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:46:49.951 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:46:49.952 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 322, 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:49.953 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:46:49.954 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:46:49.954 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:46:49.954 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:46:49.954 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:46:49.954 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:46:49.954 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:46:49.955 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:46:49.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:49.955 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:46:49.955 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:46:49.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:46:49.955 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:46:49.955 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:46:49.955 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:46:49.955 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:49.956 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:46:49.956 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:46:49.956 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2778, 2024-05-30T16:46:49.956 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 11514702636, 2024-05-30T16:46:49.956 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 22765604864, 2024-05-30T16:46:49.956 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 750328508416, 2024-05-30T16:46:49.956 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 71233773, 2024-05-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 154012102, 2024-05-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 17, 2024-05-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 43 2024-05-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 27, 2024-05-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3, 2024-05-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:46:49.958 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:46:49.958 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:46:49.958 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:46:49.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:46:49.958 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 3, 2024-05-30T16:46:49.958 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:46:49.958 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "a", 2024-05-30T16:46:49.958 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5235 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:46:49.959 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:46:49.960 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:46:49.960 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:46:49.960 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:49.960 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:46:49.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:49.960 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:46:49.960 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:46:49.960 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout: "d2a1d40d-0ffc-4f05-a6e6-4980d0148787": { 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "3 ongoing clones; Avg progress is 5.208% (3s)\n [=...........................] (remaining: 72s)", 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.052080001682043076, 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:46:49.961 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.952+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff53c06cf20 msgr2=0x7ff53c06f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.952+0000 7ff560e00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff53c06cf20 0x7ff53c06f3e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff554009fd0 tx=0x7ff55400d040 comp rx=0 tx=0).stop 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.952+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 msgr2=0x7ff55c1532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.952+0000 7ff560e00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 0x7ff55c1532c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff54800b3e0 tx=0x7ff54800b8a0 comp rx=0 tx=0).stop 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.953+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 shutdown_connections 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.953+0000 7ff560e00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff53c06cf20 0x7ff53c06f3e0 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff554009fd0 tx=0x7ff55400d040 comp rx=0 tx=0).stop 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.953+0000 7ff560e00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55c162ea0 0x7ff55c1532c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.953+0000 7ff560e00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff55c162ac0 0x7ff55c152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.953+0000 7ff560e00640 1 --2- 172.21.15.144:0/1164647581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0b6180 0x7ff55c1664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.953+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 >> 172.21.15.144:0/1164647581 conn(0x7ff55c0d1360 msgr2=0x7ff55c0b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:49.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.954+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 shutdown_connections 2024-05-30T16:46:49.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:49.954+0000 7ff560e00640 1 -- 172.21.15.144:0/1164647581 wait complete. 2024-05-30T16:46:50.013 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone79571 2024-05-30T16:46:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.464+0000 7fe67ac00640 1 Processor -- start 2024-05-30T16:46:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.464+0000 7fe67ac00640 1 -- start start 2024-05-30T16:46:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.465+0000 7fe67ac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6740b64a0 0x7fe6740cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.465+0000 7fe67ac00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67416f2f0 con 0x7fe6740cfeb0 2024-05-30T16:46:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.465+0000 7fe67ac00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67416f5d0 con 0x7fe674072500 2024-05-30T16:46:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.465+0000 7fe67ac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe67416f8b0 con 0x7fe6740b64a0 2024-05-30T16:46:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.466+0000 7fe673e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6740b64a0 0x7fe6740cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.466+0000 7fe673400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe6740cfeb0 0x7fe674071df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49008/0 (socket says 172.21.15.144:49008) 2024-05-30T16:46:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.466+0000 7fe673400640 1 -- 172.21.15.144:0/1053790149 learned_addr learned my addr 172.21.15.144:0/1053790149 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:46:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.467+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442769876 0 0) 0x7fe67416f2f0 con 0x7fe6740cfeb0 2024-05-30T16:46:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.467+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe658003520 con 0x7fe6740cfeb0 2024-05-30T16:46:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.468+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874077800 0 0) 0x7fe67416f5d0 con 0x7fe674072500 2024-05-30T16:46:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.468+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe67416f2f0 con 0x7fe674072500 2024-05-30T16:46:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.468+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 26372280 0 0) 0x7fe658003520 con 0x7fe6740cfeb0 2024-05-30T16:46:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.468+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6740b64a0 msgr2=0x7fe6740cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.468+0000 7fe672a00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6740b64a0 0x7fe6740cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 >> v1:172.21.15.149:6789/0 conn(0x7fe674072500 legacy=0x7fe674176480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67416fb90 con 0x7fe6740cfeb0 2024-05-30T16:46:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fe6600015f0 con 0x7fe6740cfeb0 2024-05-30T16:46:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 >> v1:172.21.15.144:6789/0 conn(0x7fe6740cfeb0 legacy=0x7fe674071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe658003b70 0x7fe658003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe658004800 0x7fe658004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6580051c0 0x7fe65800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe67416f8b0 con 0x7fe658004800 2024-05-30T16:46:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe65800bfb0 con 0x7fe6580051c0 2024-05-30T16:46:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe65800c1b0 con 0x7fe658003b70 2024-05-30T16:46:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.469+0000 7fe673e00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6740b64a0 0x7fe6740cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:46:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.470+0000 7fe673e00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe658003b70 0x7fe658003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.470+0000 7fe678c00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6580051c0 0x7fe65800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:50.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.470+0000 7fe673e00640 1 -- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6580051c0 msgr2=0x7fe65800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.470+0000 7fe673e00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6580051c0 0x7fe65800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.470+0000 7fe673e00640 1 -- 172.21.15.144:0/1053790149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe658004800 msgr2=0x7fe658004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:46:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.471+0000 7fe673400640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe658004800 0x7fe658004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.471+0000 7fe673e00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe658004800 0x7fe658004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.471+0000 7fe673e00640 1 -- 172.21.15.144:0/1053790149 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67416fb90 con 0x7fe658003b70 2024-05-30T16:46:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.473+0000 7fe673e00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe658003b70 0x7fe658003f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe67406bff0 tx=0x7fe658005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96056f3fa5820c48 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:50.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.475+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664036070 con 0x7fe658003b70 2024-05-30T16:46:50.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.475+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe664004030 con 0x7fe658003b70 2024-05-30T16:46:50.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.475+0000 7fe672a00640 1 -- 172.21.15.144:0/1053790149 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6640097f0 con 0x7fe658003b70 2024-05-30T16:46:50.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.476+0000 7fe67ac00640 1 -- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe658003b70 msgr2=0x7fe658003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:50.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.476+0000 7fe67ac00640 1 --2- 172.21.15.144:0/1053790149 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe658003b70 0x7fe658003f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe67406bff0 tx=0x7fe658005830 comp rx=0 tx=0).stop 2024-05-30T16:46:50.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.476+0000 7fe678c00640 1 -- 172.21.15.144:0/1053790149 reap_dead start 2024-05-30T16:46:50.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.478+0000 7fe67ac00640 1 -- 172.21.15.144:0/1053790149 shutdown_connections 2024-05-30T16:46:50.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.478+0000 7fe67ac00640 1 -- 172.21.15.144:0/1053790149 >> 172.21.15.144:0/1053790149 conn(0x7fe674070050 msgr2=0x7fe67406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:50.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.479+0000 7fe67ac00640 1 -- 172.21.15.144:0/1053790149 shutdown_connections 2024-05-30T16:46:50.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.479+0000 7fe67ac00640 1 -- 172.21.15.144:0/1053790149 wait complete. 2024-05-30T16:46:50.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.484+0000 7fe67ac00640 1 Processor -- start 2024-05-30T16:46:50.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.485+0000 7fe67ac00640 1 -- start start 2024-05-30T16:46:50.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.486+0000 7fe67ac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe658003b70 0x7fe674213440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:50.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.486+0000 7fe67ac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67416bb90 0x7fe6740ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:50.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.486+0000 7fe67ac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6740ad380 0x7fe67416df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:50.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.486+0000 7fe67ac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe6740cc7a0 con 0x7fe67416bb90 2024-05-30T16:46:50.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.486+0000 7fe67ac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe67416b960 con 0x7fe6740ad380 2024-05-30T16:46:50.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.486+0000 7fe67ac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe6740cc920 con 0x7fe658003b70 2024-05-30T16:46:50.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.488+0000 7fe673400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67416bb90 0x7fe6740ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:50.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.488+0000 7fe673400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67416bb90 0x7fe6740ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58834/0 (socket says 172.21.15.144:58834) 2024-05-30T16:46:50.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.488+0000 7fe673400640 1 -- 172.21.15.144:0/1132722769 learned_addr learned my addr 172.21.15.144:0/1132722769 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:50.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.490+0000 7fe673400640 1 -- 172.21.15.144:0/1132722769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe658003b70 msgr2=0x7fe674213440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:46:50.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.490+0000 7fe673400640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe658003b70 0x7fe674213440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:50.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.490+0000 7fe673400640 1 -- 172.21.15.144:0/1132722769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6740ad380 msgr2=0x7fe67416df60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:46:50.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.490+0000 7fe673400640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6740ad380 0x7fe67416df60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:50.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.490+0000 7fe673400640 1 -- 172.21.15.144:0/1132722769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67416c310 con 0x7fe67416bb90 2024-05-30T16:46:50.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.494+0000 7fe673400640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67416bb90 0x7fe6740ace40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe660001eb0 tx=0x7fe66000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:50.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.495+0000 7fe66be00640 1 -- 172.21.15.144:0/1132722769 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660019070 con 0x7fe67416bb90 2024-05-30T16:46:50.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.495+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67416c5f0 con 0x7fe67416bb90 2024-05-30T16:46:50.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.495+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67416cbb0 con 0x7fe67416bb90 2024-05-30T16:46:50.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.496+0000 7fe66be00640 1 -- 172.21.15.144:0/1132722769 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6600074e0 con 0x7fe67416bb90 2024-05-30T16:46:50.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.500+0000 7fe66be00640 1 -- 172.21.15.144:0/1132722769 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660019070 con 0x7fe67416bb90 2024-05-30T16:46:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.503+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64c005290 con 0x7fe67416bb90 2024-05-30T16:46:50.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.517+0000 7fe66be00640 1 -- 172.21.15.144:0/1132722769 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) ==== 91601+0+0 (secure 0 0 0) 0x7fe6600047e0 con 0x7fe67416bb90 2024-05-30T16:46:50.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.529+0000 7fe66be00640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65406d120 0x7fe65406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:50.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.530+0000 7fe66be00640 1 -- 172.21.15.144:0/1132722769 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fe66008bf30 con 0x7fe67416bb90 2024-05-30T16:46:50.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.544+0000 7fe66be00640 1 -- 172.21.15.144:0/1132722769 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe660059810 con 0x7fe67416bb90 2024-05-30T16:46:50.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.583+0000 7fe673e00640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65406d120 0x7fe65406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:50.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:50.615+0000 7fe673e00640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65406d120 0x7fe65406f5e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe664033000 tx=0x7fe664008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:51.088+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone79571", "target": ["mon-mgr", ""]}) -- 0x7fe64c000bc0 con 0x7fe65406d120 2024-05-30T16:46:51.165 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:51.162+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:51.165 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:51.162+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:51.165 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:51.162+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:51.165 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:51.162+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:51.165 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:46:51.162+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:46:52.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.881+0000 7fe66be00640 1 -- 172.21.15.144:0/1132722769 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe64c000bc0 con 0x7fe65406d120 2024-05-30T16:46:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.889+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65406d120 msgr2=0x7fe65406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.889+0000 7fe67ac00640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65406d120 0x7fe65406f5e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe664033000 tx=0x7fe664008030 comp rx=0 tx=0).stop 2024-05-30T16:46:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.889+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67416bb90 msgr2=0x7fe6740ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.889+0000 7fe67ac00640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67416bb90 0x7fe6740ace40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe660001eb0 tx=0x7fe66000dcc0 comp rx=0 tx=0).stop 2024-05-30T16:46:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.890+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 shutdown_connections 2024-05-30T16:46:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.890+0000 7fe67ac00640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65406d120 0x7fe65406f5e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.890+0000 7fe67ac00640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6740ad380 0x7fe67416df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.890+0000 7fe67ac00640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67416bb90 0x7fe6740ace40 secure :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe660001eb0 tx=0x7fe66000dcc0 comp rx=0 tx=0).stop 2024-05-30T16:46:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.890+0000 7fe67ac00640 1 --2- 172.21.15.144:0/1132722769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe658003b70 0x7fe674213440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.890+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 >> 172.21.15.144:0/1132722769 conn(0x7fe674070050 msgr2=0x7fe6740b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.891+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 shutdown_connections 2024-05-30T16:46:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:52.891+0000 7fe67ac00640 1 -- 172.21.15.144:0/1132722769 wait complete. 2024-05-30T16:46:52.946 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone79572 2024-05-30T16:46:53.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.429+0000 7ff306000640 1 Processor -- start 2024-05-30T16:46:53.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.431+0000 7ff306000640 1 -- start start 2024-05-30T16:46:53.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.434+0000 7ff306000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff3000b5150 0x7ff30016d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:53.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.434+0000 7ff306000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30006fbf0 con 0x7ff300072210 2024-05-30T16:46:53.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.434+0000 7ff306000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3000cf050 con 0x7ff30014c630 2024-05-30T16:46:53.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.434+0000 7ff306000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff3000cf330 con 0x7ff3000b5150 2024-05-30T16:46:53.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.435+0000 7ff2ffe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff3000b5150 0x7ff30016d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:53.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.435+0000 7ff2ffe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff3000b5150 0x7ff30016d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:40444/0 (socket says 172.21.15.144:40444) 2024-05-30T16:46:53.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.435+0000 7ff2ffe00640 1 -- 172.21.15.144:0/1118352898 learned_addr learned my addr 172.21.15.144:0/1118352898 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:53.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.436+0000 7ff2ffe00640 1 -- 172.21.15.144:0/1118352898 >> v1:172.21.15.149:6789/0 conn(0x7ff30014c630 legacy=0x7ff3000ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:53.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.436+0000 7ff2ffe00640 1 -- 172.21.15.144:0/1118352898 >> v1:172.21.15.144:6789/0 conn(0x7ff300072210 legacy=0x7ff300072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:53.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.436+0000 7ff2ffe00640 1 -- 172.21.15.144:0/1118352898 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3000cf610 con 0x7ff3000b5150 2024-05-30T16:46:53.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.438+0000 7ff2ffe00640 1 --2- 172.21.15.144:0/1118352898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3000b5150 0x7ff30016d9f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80098a0 tx=0x7ff2f802a390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d800209c80bcf0ca server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.439+0000 7ff2fea00640 1 -- 172.21.15.144:0/1118352898 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8037070 con 0x7ff3000b5150 2024-05-30T16:46:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.440+0000 7ff2fea00640 1 -- 172.21.15.144:0/1118352898 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f8032640 con 0x7ff3000b5150 2024-05-30T16:46:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.440+0000 7ff2fea00640 1 -- 172.21.15.144:0/1118352898 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8032a10 con 0x7ff3000b5150 2024-05-30T16:46:53.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.442+0000 7ff306000640 1 -- 172.21.15.144:0/1118352898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3000b5150 msgr2=0x7ff30016d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:53.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.442+0000 7ff306000640 1 --2- 172.21.15.144:0/1118352898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3000b5150 0x7ff30016d9f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80098a0 tx=0x7ff2f802a390 comp rx=0 tx=0).stop 2024-05-30T16:46:53.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.442+0000 7ff306000640 1 -- 172.21.15.144:0/1118352898 shutdown_connections 2024-05-30T16:46:53.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.442+0000 7ff306000640 1 --2- 172.21.15.144:0/1118352898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3000b5150 0x7ff30016d9f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:53.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.442+0000 7ff306000640 1 -- 172.21.15.144:0/1118352898 >> 172.21.15.144:0/1118352898 conn(0x7ff30006bd00 msgr2=0x7ff30006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:53.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.442+0000 7ff306000640 1 -- 172.21.15.144:0/1118352898 shutdown_connections 2024-05-30T16:46:53.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.443+0000 7ff306000640 1 -- 172.21.15.144:0/1118352898 wait complete. 2024-05-30T16:46:53.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.446+0000 7ff306000640 1 Processor -- start 2024-05-30T16:46:53.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.447+0000 7ff306000640 1 -- start start 2024-05-30T16:46:53.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.451+0000 7ff306000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff300072210 0x7ff300165780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:53.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.451+0000 7ff306000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3000b5150 0x7ff3000ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:53.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.451+0000 7ff306000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff30014c630 0x7ff3001f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:53.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.451+0000 7ff306000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff30014ca10 con 0x7ff3000b5150 2024-05-30T16:46:53.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.451+0000 7ff306000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff3000b3c20 con 0x7ff30014c630 2024-05-30T16:46:53.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.451+0000 7ff306000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff30014cb90 con 0x7ff300072210 2024-05-30T16:46:53.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.452+0000 7ff2ff400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff300072210 0x7ff300165780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:53.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.452+0000 7ff2ff400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff300072210 0x7ff300165780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:41958/0 (socket says 172.21.15.144:41958) 2024-05-30T16:46:53.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.452+0000 7ff2ff400640 1 -- 172.21.15.144:0/2764685906 learned_addr learned my addr 172.21.15.144:0/2764685906 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:53.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.453+0000 7ff2f6a00640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3000b5150 0x7ff3000ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:53.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.454+0000 7ff2ff400640 1 -- 172.21.15.144:0/2764685906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff30014c630 msgr2=0x7ff3001f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:53.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.454+0000 7ff2ff400640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff30014c630 0x7ff3001f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:53.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.454+0000 7ff2ff400640 1 -- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3000b5150 msgr2=0x7ff3000ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:53.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.455+0000 7ff2ff400640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3000b5150 0x7ff3000ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:53.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.455+0000 7ff2ff400640 1 -- 172.21.15.144:0/2764685906 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3000abaf0 con 0x7ff300072210 2024-05-30T16:46:53.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.455+0000 7ff2f6a00640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3000b5150 0x7ff3000ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:46:53.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.457+0000 7ff2ff400640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff300072210 0x7ff300165780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000ba50 tx=0x7ff2f000bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:53.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.460+0000 7ff2f7e00640 1 -- 172.21.15.144:0/2764685906 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0019070 con 0x7ff300072210 2024-05-30T16:46:53.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.463+0000 7ff2f7e00640 1 -- 172.21.15.144:0/2764685906 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f000cc20 con 0x7ff300072210 2024-05-30T16:46:53.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.463+0000 7ff2f7e00640 1 -- 172.21.15.144:0/2764685906 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0014680 con 0x7ff300072210 2024-05-30T16:46:53.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.467+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3000abdd0 con 0x7ff300072210 2024-05-30T16:46:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.470+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3000ac390 con 0x7ff300072210 2024-05-30T16:46:53.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.475+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300068b90 con 0x7ff300072210 2024-05-30T16:46:53.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.484+0000 7ff2f7e00640 1 -- 172.21.15.144:0/2764685906 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 15) ==== 91601+0+0 (secure 0 0 0) 0x7ff2f001c070 con 0x7ff300072210 2024-05-30T16:46:53.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.487+0000 7ff2f7e00640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff2dc06cf50 0x7ff2dc06f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:53.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.488+0000 7ff2f7e00640 1 -- 172.21.15.144:0/2764685906 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7ff2f008c3c0 con 0x7ff300072210 2024-05-30T16:46:53.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.504+0000 7ff2f7e00640 1 -- 172.21.15.144:0/2764685906 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2f0059820 con 0x7ff300072210 2024-05-30T16:46:53.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.510+0000 7ff2f6a00640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff2dc06cf50 0x7ff2dc06f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:53.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.518+0000 7ff2f6a00640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff2dc06cf50 0x7ff2dc06f410 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3000ab240 tx=0x7ff2e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:53.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:53.646+0000 7ff2f7e00640 1 -- 172.21.15.144:0/2764685906 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7ff2f0055e90 con 0x7ff300072210 2024-05-30T16:46:54.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.095+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone79572", "target": ["mon-mgr", ""]}) -- 0x7ff300075f70 con 0x7ff2dc06cf50 2024-05-30T16:46:54.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.944+0000 7ff2f7e00640 1 -- 172.21.15.144:0/2764685906 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff2e8001890 con 0x7ff2dc06cf50 2024-05-30T16:46:54.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.955+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff2dc06cf50 msgr2=0x7ff2dc06f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:54.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.955+0000 7ff306000640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff2dc06cf50 0x7ff2dc06f410 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3000ab240 tx=0x7ff2e8009040 comp rx=0 tx=0).stop 2024-05-30T16:46:54.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.955+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff300072210 msgr2=0x7ff300165780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:54.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.955+0000 7ff306000640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff300072210 0x7ff300165780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000ba50 tx=0x7ff2f000bf10 comp rx=0 tx=0).stop 2024-05-30T16:46:54.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.960+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 shutdown_connections 2024-05-30T16:46:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.960+0000 7ff306000640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff2dc06cf50 0x7ff2dc06f410 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.960+0000 7ff306000640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff30014c630 0x7ff3001f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.960+0000 7ff306000640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3000b5150 0x7ff3000ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.960+0000 7ff306000640 1 --2- 172.21.15.144:0/2764685906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff300072210 0x7ff300165780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.960+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 >> 172.21.15.144:0/2764685906 conn(0x7ff30006bd00 msgr2=0x7ff30006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:54.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.962+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 shutdown_connections 2024-05-30T16:46:54.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:54.964+0000 7ff306000640 1 -- 172.21.15.144:0/2764685906 wait complete. 2024-05-30T16:46:55.007 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone79573 2024-05-30T16:46:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.429+0000 7f7789800640 1 Processor -- start 2024-05-30T16:46:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.429+0000 7f7789800640 1 -- start start 2024-05-30T16:46:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.431+0000 7f7789800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f77840cec70 0x7f77840b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.431+0000 7f7789800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840b5e00 0x7f7784142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.431+0000 7f7789800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7784160730 con 0x7f778413f760 2024-05-30T16:46:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.431+0000 7f7789800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f77841612b0 con 0x7f77840cec70 2024-05-30T16:46:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.431+0000 7f7789800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f778413fb40 con 0x7f77840b5e00 2024-05-30T16:46:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.432+0000 7f7782000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f77840cec70 0x7f77840b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.432+0000 7f7782000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f77840cec70 0x7f77840b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:42454/0 (socket says 172.21.15.144:42454) 2024-05-30T16:46:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.432+0000 7f7782000640 1 -- 172.21.15.144:0/1852428223 learned_addr learned my addr 172.21.15.144:0/1852428223 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.432+0000 7f7783400640 1 --2- 172.21.15.144:0/1852428223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840b5e00 0x7f7784142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:55.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.433+0000 7f7782000640 1 -- 172.21.15.144:0/1852428223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840b5e00 msgr2=0x7f7784142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.433+0000 7f7782000640 1 --2- 172.21.15.144:0/1852428223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840b5e00 0x7f7784142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.433+0000 7f7782000640 1 -- 172.21.15.144:0/1852428223 >> v1:172.21.15.144:6789/0 conn(0x7f778413f760 legacy=0x7f778406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.433+0000 7f7782000640 1 -- 172.21.15.144:0/1852428223 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7784160a10 con 0x7f77840cec70 2024-05-30T16:46:55.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.435+0000 7f7782000640 1 --2- 172.21.15.144:0/1852428223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77840cec70 0x7f77840b58c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7770009870 tx=0x7f777002a320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2358f7a1be6fe0bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.437+0000 7f7781600640 1 -- 172.21.15.144:0/1852428223 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7770037070 con 0x7f77840cec70 2024-05-30T16:46:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.437+0000 7f7781600640 1 -- 172.21.15.144:0/1852428223 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7770032640 con 0x7f77840cec70 2024-05-30T16:46:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.437+0000 7f7781600640 1 -- 172.21.15.144:0/1852428223 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7770032a50 con 0x7f77840cec70 2024-05-30T16:46:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.438+0000 7f7789800640 1 -- 172.21.15.144:0/1852428223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77840cec70 msgr2=0x7f77840b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.438+0000 7f7789800640 1 --2- 172.21.15.144:0/1852428223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77840cec70 0x7f77840b58c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7770009870 tx=0x7f777002a320 comp rx=0 tx=0).stop 2024-05-30T16:46:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.439+0000 7f7789800640 1 -- 172.21.15.144:0/1852428223 shutdown_connections 2024-05-30T16:46:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.439+0000 7f7789800640 1 --2- 172.21.15.144:0/1852428223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840b5e00 0x7f7784142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.439+0000 7f7789800640 1 --2- 172.21.15.144:0/1852428223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77840cec70 0x7f77840b58c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.439+0000 7f7789800640 1 -- 172.21.15.144:0/1852428223 >> 172.21.15.144:0/1852428223 conn(0x7f778406bd00 msgr2=0x7f778406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.439+0000 7f7789800640 1 -- 172.21.15.144:0/1852428223 shutdown_connections 2024-05-30T16:46:55.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.439+0000 7f7789800640 1 -- 172.21.15.144:0/1852428223 wait complete. 2024-05-30T16:46:55.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.443+0000 7f7789800640 1 Processor -- start 2024-05-30T16:46:55.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.444+0000 7f7789800640 1 -- start start 2024-05-30T16:46:55.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.446+0000 7f7789800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77840b5e00 0x7f7784152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.446+0000 7f7789800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840cec70 0x7f7784155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.446+0000 7f7789800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778413f760 0x7f778415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.446+0000 7f7789800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f77840cf0d0 con 0x7f77840b5e00 2024-05-30T16:46:55.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.447+0000 7f7782000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840cec70 0x7f7784155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:55.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.446+0000 7f7782a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77840b5e00 0x7f7784152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:55.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.447+0000 7f7789800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7784160fd0 con 0x7f778413f760 2024-05-30T16:46:55.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.447+0000 7f7789800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f77840cf250 con 0x7f77840cec70 2024-05-30T16:46:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.447+0000 7f7782a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77840b5e00 0x7f7784152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49478/0 (socket says 172.21.15.144:49478) 2024-05-30T16:46:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.447+0000 7f7782a00640 1 -- 172.21.15.144:0/2182427287 learned_addr learned my addr 172.21.15.144:0/2182427287 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.447+0000 7f7783400640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778413f760 0x7f778415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.448+0000 7f7782a00640 1 -- 172.21.15.144:0/2182427287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840cec70 msgr2=0x7f7784155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.448+0000 7f7782a00640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840cec70 0x7f7784155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.448+0000 7f7782a00640 1 -- 172.21.15.144:0/2182427287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778413f760 msgr2=0x7f778415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.448+0000 7f7782a00640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778413f760 0x7f778415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.448+0000 7f7782a00640 1 -- 172.21.15.144:0/2182427287 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77841560a0 con 0x7f77840b5e00 2024-05-30T16:46:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.448+0000 7f7782a00640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77840b5e00 0x7f7784152af0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7774001610 tx=0x7f7774001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.449+0000 7f777aa00640 1 -- 172.21.15.144:0/2182427287 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7774001d20 con 0x7f77840b5e00 2024-05-30T16:46:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.449+0000 7f777aa00640 1 -- 172.21.15.144:0/2182427287 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77740050d0 con 0x7f77840b5e00 2024-05-30T16:46:55.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.449+0000 7f777aa00640 1 -- 172.21.15.144:0/2182427287 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77740054a0 con 0x7f77840b5e00 2024-05-30T16:46:55.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.449+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7784156380 con 0x7f77840b5e00 2024-05-30T16:46:55.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.449+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7784155db0 con 0x7f77840b5e00 2024-05-30T16:46:55.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.451+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7784068b90 con 0x7f77840b5e00 2024-05-30T16:46:55.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.454+0000 7f777aa00640 1 -- 172.21.15.144:0/2182427287 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f7774010630 con 0x7f77840b5e00 2024-05-30T16:46:55.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.456+0000 7f777aa00640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f776406d150 0x7f776406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:55.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.456+0000 7f777aa00640 1 -- 172.21.15.144:0/2182427287 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f77740901b0 con 0x7f77840b5e00 2024-05-30T16:46:55.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.464+0000 7f7782000640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f776406d150 0x7f776406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:55.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.465+0000 7f777aa00640 1 -- 172.21.15.144:0/2182427287 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f777405dc00 con 0x7f77840b5e00 2024-05-30T16:46:55.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.466+0000 7f7782000640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f776406d150 0x7f776406f610 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7770034000 tx=0x7f777002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:55.967+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone79573", "target": ["mon-mgr", ""]}) -- 0x7f7784075f70 con 0x7f776406d150 2024-05-30T16:46:56.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.434+0000 7f777aa00640 1 -- 172.21.15.144:0/2182427287 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f77700326f0 con 0x7f776406d150 2024-05-30T16:46:56.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f776406d150 msgr2=0x7f776406f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:56.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f776406d150 0x7f776406f610 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7770034000 tx=0x7f777002e000 comp rx=0 tx=0).stop 2024-05-30T16:46:56.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77840b5e00 msgr2=0x7f7784152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:56.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77840b5e00 0x7f7784152af0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7774001610 tx=0x7f7774001ad0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 shutdown_connections 2024-05-30T16:46:56.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f776406d150 0x7f776406f610 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778413f760 0x7f778415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77840cec70 0x7f7784155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 --2- 172.21.15.144:0/2182427287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77840b5e00 0x7f7784152af0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.439+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 >> 172.21.15.144:0/2182427287 conn(0x7f778406bd00 msgr2=0x7f778415f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:56.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.440+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 shutdown_connections 2024-05-30T16:46:56.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.440+0000 7f7789800640 1 -- 172.21.15.144:0/2182427287 wait complete. 2024-05-30T16:46:56.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone79574 2024-05-30T16:46:56.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.821+0000 7fc578a00640 1 Processor -- start 2024-05-30T16:46:56.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.821+0000 7fc578a00640 1 -- start start 2024-05-30T16:46:56.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.823+0000 7fc578a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc57415eb80 0x7fc574162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:56.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.823+0000 7fc578a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5740ba2b0 0x7fc5740cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:56.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.823+0000 7fc578a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc5740cfaa0 0x7fc5740b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:56.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.823+0000 7fc578a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc57415ef60 con 0x7fc57415eb80 2024-05-30T16:46:56.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.823+0000 7fc578a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc574163550 con 0x7fc5740cfaa0 2024-05-30T16:46:56.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.823+0000 7fc578a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc574162f90 con 0x7fc5740ba2b0 2024-05-30T16:46:56.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.823+0000 7fc571e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc57415eb80 0x7fc574162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:56.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.823+0000 7fc571e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc57415eb80 0x7fc574162640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49484/0 (socket says 172.21.15.144:49484) 2024-05-30T16:46:56.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.823+0000 7fc571e00640 1 -- 172.21.15.144:0/1504968418 learned_addr learned my addr 172.21.15.144:0/1504968418 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:56.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.824+0000 7fc571e00640 1 -- 172.21.15.144:0/1504968418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5740ba2b0 msgr2=0x7fc5740cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:56.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.824+0000 7fc571e00640 1 --2- 172.21.15.144:0/1504968418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5740ba2b0 0x7fc5740cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.824+0000 7fc571e00640 1 -- 172.21.15.144:0/1504968418 >> v2:172.21.15.149:3300/0 conn(0x7fc5740cfaa0 msgr2=0x7fc5740b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:56.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.824+0000 7fc571e00640 1 --2- 172.21.15.144:0/1504968418 >> v2:172.21.15.149:3300/0 conn(0x7fc5740cfaa0 0x7fc5740b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.824+0000 7fc571e00640 1 -- 172.21.15.144:0/1504968418 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc574163270 con 0x7fc57415eb80 2024-05-30T16:46:56.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.825+0000 7fc571e00640 1 --2- 172.21.15.144:0/1504968418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57415eb80 0x7fc574162640 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc57406e010 tx=0x7fc55c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f9510e7a8d887c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:56.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.826+0000 7fc570a00640 1 -- 172.21.15.144:0/1504968418 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c037070 con 0x7fc57415eb80 2024-05-30T16:46:56.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.826+0000 7fc570a00640 1 -- 172.21.15.144:0/1504968418 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c032440 con 0x7fc57415eb80 2024-05-30T16:46:56.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.826+0000 7fc570a00640 1 -- 172.21.15.144:0/1504968418 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c032810 con 0x7fc57415eb80 2024-05-30T16:46:56.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.827+0000 7fc578a00640 1 -- 172.21.15.144:0/1504968418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57415eb80 msgr2=0x7fc574162640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:56.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.827+0000 7fc578a00640 1 --2- 172.21.15.144:0/1504968418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57415eb80 0x7fc574162640 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc57406e010 tx=0x7fc55c02a1e0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.827+0000 7fc578a00640 1 -- 172.21.15.144:0/1504968418 shutdown_connections 2024-05-30T16:46:56.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.827+0000 7fc578a00640 1 --2- 172.21.15.144:0/1504968418 >> v2:172.21.15.149:3300/0 conn(0x7fc5740cfaa0 0x7fc5740b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.827+0000 7fc578a00640 1 --2- 172.21.15.144:0/1504968418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5740ba2b0 0x7fc5740cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.827+0000 7fc578a00640 1 --2- 172.21.15.144:0/1504968418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57415eb80 0x7fc574162640 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.828+0000 7fc578a00640 1 -- 172.21.15.144:0/1504968418 >> 172.21.15.144:0/1504968418 conn(0x7fc57406cf40 msgr2=0x7fc57406d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:56.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.828+0000 7fc578a00640 1 -- 172.21.15.144:0/1504968418 shutdown_connections 2024-05-30T16:46:56.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.828+0000 7fc578a00640 1 -- 172.21.15.144:0/1504968418 wait complete. 2024-05-30T16:46:56.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.830+0000 7fc578a00640 1 Processor -- start 2024-05-30T16:46:56.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.831+0000 7fc578a00640 1 -- start start 2024-05-30T16:46:56.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.832+0000 7fc578a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5740ba2b0 0x7fc5741521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:56.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.832+0000 7fc578a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5740cfaa0 0x7fc574152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:56.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.832+0000 7fc578a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc57415eb80 0x7fc57414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:56.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.832+0000 7fc578a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc574162b80 con 0x7fc5740ba2b0 2024-05-30T16:46:56.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.832+0000 7fc578a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740d3050 con 0x7fc57415eb80 2024-05-30T16:46:56.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.832+0000 7fc578a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc574162d00 con 0x7fc5740cfaa0 2024-05-30T16:46:56.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.833+0000 7fc571e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5740ba2b0 0x7fc5741521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:56.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.833+0000 7fc571e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5740ba2b0 0x7fc5741521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49496/0 (socket says 172.21.15.144:49496) 2024-05-30T16:46:56.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.833+0000 7fc571e00640 1 -- 172.21.15.144:0/3908820160 learned_addr learned my addr 172.21.15.144:0/3908820160 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:56.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.833+0000 7fc571e00640 1 -- 172.21.15.144:0/3908820160 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5740cfaa0 msgr2=0x7fc574152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:56.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.833+0000 7fc571e00640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5740cfaa0 0x7fc574152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.833+0000 7fc571e00640 1 -- 172.21.15.144:0/3908820160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc57415eb80 msgr2=0x7fc57414ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:56.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.833+0000 7fc571e00640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc57415eb80 0x7fc57414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:56.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.833+0000 7fc571e00640 1 -- 172.21.15.144:0/3908820160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc574150e90 con 0x7fc5740ba2b0 2024-05-30T16:46:56.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.833+0000 7fc571e00640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5740ba2b0 0x7fc5741521d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc55c000c00 tx=0x7fc55c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:56.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.834+0000 7fc56a000640 1 -- 172.21.15.144:0/3908820160 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c041070 con 0x7fc5740ba2b0 2024-05-30T16:46:56.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.834+0000 7fc56a000640 1 -- 172.21.15.144:0/3908820160 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c03c870 con 0x7fc5740ba2b0 2024-05-30T16:46:56.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.834+0000 7fc56a000640 1 -- 172.21.15.144:0/3908820160 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c037040 con 0x7fc5740ba2b0 2024-05-30T16:46:56.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.834+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc574151170 con 0x7fc5740ba2b0 2024-05-30T16:46:56.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.835+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc574151730 con 0x7fc5740ba2b0 2024-05-30T16:46:56.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.838+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc574068b90 con 0x7fc5740ba2b0 2024-05-30T16:46:56.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.838+0000 7fc56a000640 1 -- 172.21.15.144:0/3908820160 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7fc55c044070 con 0x7fc5740ba2b0 2024-05-30T16:46:56.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.840+0000 7fc56a000640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55006d000 0x7fc55006f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:56.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.840+0000 7fc56a000640 1 -- 172.21.15.144:0/3908820160 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fc55c0ad220 con 0x7fc5740ba2b0 2024-05-30T16:46:56.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.849+0000 7fc56a000640 1 -- 172.21.15.144:0/3908820160 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc55c07b030 con 0x7fc5740ba2b0 2024-05-30T16:46:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.856+0000 7fc571400640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55006d000 0x7fc55006f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:56.858+0000 7fc571400640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55006d000 0x7fc55006f4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc57406d6a0 tx=0x7fc564006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:57.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.256+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone79574", "target": ["mon-mgr", ""]}) -- 0x7fc574072df0 con 0x7fc55006d000 2024-05-30T16:46:57.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.462+0000 7fc56a000640 1 -- 172.21.15.144:0/3908820160 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc574072df0 con 0x7fc55006d000 2024-05-30T16:46:57.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55006d000 msgr2=0x7fc55006f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:57.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55006d000 0x7fc55006f4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc57406d6a0 tx=0x7fc564006c90 comp rx=0 tx=0).stop 2024-05-30T16:46:57.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5740ba2b0 msgr2=0x7fc5741521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:57.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5740ba2b0 0x7fc5741521d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc55c000c00 tx=0x7fc55c0046c0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 shutdown_connections 2024-05-30T16:46:57.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55006d000 0x7fc55006f4c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc57415eb80 0x7fc57414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5740cfaa0 0x7fc574152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 --2- 172.21.15.144:0/3908820160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5740ba2b0 0x7fc5741521d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.465+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 >> 172.21.15.144:0/3908820160 conn(0x7fc57406cf40 msgr2=0x7fc57415fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:57.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.466+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 shutdown_connections 2024-05-30T16:46:57.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.466+0000 7fc578a00640 1 -- 172.21.15.144:0/3908820160 wait complete. 2024-05-30T16:46:57.491 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:46:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.660+0000 7ff157e00640 1 Processor -- start 2024-05-30T16:46:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.660+0000 7ff157e00640 1 -- start start 2024-05-30T16:46:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.662+0000 7ff157e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff1580cf480 0x7ff1580cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.662+0000 7ff157e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff1580d3160 0x7ff1580d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.662+0000 7ff157e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff15815ed80 con 0x7ff15815e9a0 2024-05-30T16:46:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.662+0000 7ff157e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff1580d1a40 con 0x7ff1580d3160 2024-05-30T16:46:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.662+0000 7ff157e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff1580d1d20 con 0x7ff1580cf480 2024-05-30T16:46:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.662+0000 7ff156a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff15815e9a0 0x7ff1580d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60482/0 (socket says 172.21.15.144:60482) 2024-05-30T16:46:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.662+0000 7ff156a00640 1 -- 172.21.15.144:0/1490525199 learned_addr learned my addr 172.21.15.144:0/1490525199 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:46:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.662+0000 7ff157400640 1 --2- 172.21.15.144:0/1490525199 >> v2:172.21.15.144:3300/0 conn(0x7ff1580d3160 0x7ff1580d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.662+0000 7ff156000640 1 -- 172.21.15.144:0/1490525199 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010896513 0 0) 0x7ff15815ed80 con 0x7ff15815e9a0 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.663+0000 7ff156000640 1 -- 172.21.15.144:0/1490525199 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff13c003520 con 0x7ff15815e9a0 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.663+0000 7ff14e000640 1 --2- 172.21.15.144:0/1490525199 >> v2:172.21.15.149:3300/0 conn(0x7ff1580cf480 0x7ff1580cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.663+0000 7ff157400640 1 -- 172.21.15.144:0/1490525199 >> v2:172.21.15.149:3300/0 conn(0x7ff1580cf480 msgr2=0x7ff1580cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.663+0000 7ff157400640 1 --2- 172.21.15.144:0/1490525199 >> v2:172.21.15.149:3300/0 conn(0x7ff1580cf480 0x7ff1580cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.663+0000 7ff157400640 1 -- 172.21.15.144:0/1490525199 >> v1:172.21.15.144:6789/0 conn(0x7ff15815e9a0 legacy=0x7ff1580d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.663+0000 7ff157400640 1 -- 172.21.15.144:0/1490525199 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1580d2960 con 0x7ff1580d3160 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.663+0000 7ff14e000640 1 --2- 172.21.15.144:0/1490525199 >> v2:172.21.15.149:3300/0 conn(0x7ff1580cf480 0x7ff1580cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.664+0000 7ff157400640 1 --2- 172.21.15.144:0/1490525199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 0x7ff1580d35d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff15808cf00 tx=0x7ff15002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381ce4ee8180f54c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.664+0000 7ff156000640 1 -- 172.21.15.144:0/1490525199 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150007740 con 0x7ff1580d3160 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.664+0000 7ff156000640 1 -- 172.21.15.144:0/1490525199 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1500078e0 con 0x7ff1580d3160 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.664+0000 7ff156000640 1 -- 172.21.15.144:0/1490525199 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150007c90 con 0x7ff1580d3160 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.664+0000 7ff157e00640 1 -- 172.21.15.144:0/1490525199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 msgr2=0x7ff1580d35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.664+0000 7ff157e00640 1 --2- 172.21.15.144:0/1490525199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 0x7ff1580d35d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff15808cf00 tx=0x7ff15002a680 comp rx=0 tx=0).stop 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.665+0000 7ff157e00640 1 -- 172.21.15.144:0/1490525199 shutdown_connections 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.665+0000 7ff157e00640 1 --2- 172.21.15.144:0/1490525199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 0x7ff1580d35d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.665+0000 7ff157e00640 1 --2- 172.21.15.144:0/1490525199 >> v2:172.21.15.149:3300/0 conn(0x7ff1580cf480 0x7ff1580cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.665+0000 7ff157e00640 1 -- 172.21.15.144:0/1490525199 >> 172.21.15.144:0/1490525199 conn(0x7ff15806cbd0 msgr2=0x7ff15806cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.665+0000 7ff157e00640 1 -- 172.21.15.144:0/1490525199 shutdown_connections 2024-05-30T16:46:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.665+0000 7ff157e00640 1 -- 172.21.15.144:0/1490525199 wait complete. 2024-05-30T16:46:57.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.666+0000 7ff157e00640 1 Processor -- start 2024-05-30T16:46:57.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.666+0000 7ff157e00640 1 -- start start 2024-05-30T16:46:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.667+0000 7ff157e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1580cf480 0x7ff1581519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.667+0000 7ff157e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 0x7ff1581570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.667+0000 7ff157e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15815e9a0 0x7ff158159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.667+0000 7ff157e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff1580d1670 con 0x7ff1580d3160 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.667+0000 7ff157e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1580ba200 con 0x7ff15815e9a0 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.667+0000 7ff157e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff1580d17f0 con 0x7ff1580cf480 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.667+0000 7ff14e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 0x7ff1581570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.667+0000 7ff14e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 0x7ff1581570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49514/0 (socket says 172.21.15.144:49514) 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.667+0000 7ff14e000640 1 -- 172.21.15.144:0/1447742845 learned_addr learned my addr 172.21.15.144:0/1447742845 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff14e000640 1 -- 172.21.15.144:0/1447742845 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1580cf480 msgr2=0x7ff1581519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff14e000640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1580cf480 0x7ff1581519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff14e000640 1 -- 172.21.15.144:0/1447742845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15815e9a0 msgr2=0x7ff158159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff14e000640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15815e9a0 0x7ff158159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff14e000640 1 -- 172.21.15.144:0/1447742845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff158155830 con 0x7ff1580d3160 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff14e000640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 0x7ff1581570c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c7f0 tx=0x7ff14000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff14f400640 1 -- 172.21.15.144:0/1447742845 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140015070 con 0x7ff1580d3160 2024-05-30T16:46:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff14f400640 1 -- 172.21.15.144:0/1447742845 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff140007a30 con 0x7ff1580d3160 2024-05-30T16:46:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff158155b10 con 0x7ff1580d3160 2024-05-30T16:46:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff14f400640 1 -- 172.21.15.144:0/1447742845 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140007e00 con 0x7ff1580d3160 2024-05-30T16:46:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.668+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1581560d0 con 0x7ff1580d3160 2024-05-30T16:46:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.670+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff158075570 con 0x7ff1580d3160 2024-05-30T16:46:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.670+0000 7ff14f400640 1 -- 172.21.15.144:0/1447742845 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7ff140018070 con 0x7ff1580d3160 2024-05-30T16:46:57.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.671+0000 7ff14f400640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff13406cfb0 0x7ff13406f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:57.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.671+0000 7ff14f400640 1 -- 172.21.15.144:0/1447742845 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7ff14008c8c0 con 0x7ff1580d3160 2024-05-30T16:46:57.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.672+0000 7ff156a00640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff13406cfb0 0x7ff13406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:57.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.672+0000 7ff156a00640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff13406cfb0 0x7ff13406f470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f60 tx=0x7ff1480078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:57.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.676+0000 7ff14f400640 1 -- 172.21.15.144:0/1447742845 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff14005a1d0 con 0x7ff1580d3160 2024-05-30T16:46:57.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.888+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7ff1580b9ba0 con 0x7ff13406cfb0 2024-05-30T16:46:57.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.891+0000 7ff14f400640 1 -- 172.21.15.144:0/1447742845 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7ff1580b9ba0 con 0x7ff13406cfb0 2024-05-30T16:46:57.893 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:46:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:46:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-05-30T16:46:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:46:57.893 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:46:57.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff13406cfb0 msgr2=0x7ff13406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:57.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff13406cfb0 0x7ff13406f470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f60 tx=0x7ff1480078f0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 msgr2=0x7ff1581570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 0x7ff1581570c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c7f0 tx=0x7ff14000cbf0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 shutdown_connections 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff13406cfb0 0x7ff13406f470 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15815e9a0 0x7ff158159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1580d3160 0x7ff1581570c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 --2- 172.21.15.144:0/1447742845 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1580cf480 0x7ff1581519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 >> 172.21.15.144:0/1447742845 conn(0x7ff15806cbd0 msgr2=0x7ff15815c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 shutdown_connections 2024-05-30T16:46:57.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:57.894+0000 7ff157e00640 1 -- 172.21.15.144:0/1447742845 wait complete. 2024-05-30T16:46:57.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:46:58.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.094+0000 7fce40e00640 1 Processor -- start 2024-05-30T16:46:58.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.095+0000 7fce40e00640 1 -- start start 2024-05-30T16:46:58.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.096+0000 7fce40e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce3c162990 0x7fce3c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:58.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.096+0000 7fce40e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce3c06bff0 0x7fce3c0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:58.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.096+0000 7fce40e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce3c166930 con 0x7fce3c162d70 2024-05-30T16:46:58.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.096+0000 7fce40e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fce3c1666e0 con 0x7fce3c06bff0 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.096+0000 7fce40e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c167540 con 0x7fce3c162990 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.096+0000 7fce3be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce3c06bff0 0x7fce3c0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.097+0000 7fce3be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce3c06bff0 0x7fce3c0b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49528/0 (socket says 172.21.15.144:49528) 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.097+0000 7fce3be00640 1 -- 172.21.15.144:0/2622425854 learned_addr learned my addr 172.21.15.144:0/2622425854 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.097+0000 7fce3aa00640 1 --1- 172.21.15.144:0/2622425854 >> v1:172.21.15.144:6789/0 conn(0x7fce3c162d70 0x7fce3c06b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60486/0 (socket says 172.21.15.144:60486) 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.097+0000 7fce3b400640 1 --2- 172.21.15.144:0/2622425854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce3c162990 0x7fce3c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.097+0000 7fce3be00640 1 -- 172.21.15.144:0/2622425854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce3c162990 msgr2=0x7fce3c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.097+0000 7fce3be00640 1 --2- 172.21.15.144:0/2622425854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce3c162990 0x7fce3c0cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.097+0000 7fce3be00640 1 -- 172.21.15.144:0/2622425854 >> v1:172.21.15.144:6789/0 conn(0x7fce3c162d70 legacy=0x7fce3c06b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.097+0000 7fce3be00640 1 -- 172.21.15.144:0/2622425854 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c166c10 con 0x7fce3c06bff0 2024-05-30T16:46:58.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.097+0000 7fce3a000640 1 -- 172.21.15.144:0/2622425854 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2070015931 0 0) 0x7fce3c166930 con 0x7fce3c162d70 2024-05-30T16:46:58.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.098+0000 7fce3be00640 1 --2- 172.21.15.144:0/2622425854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 0x7fce3c0b3df0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fce34009870 tx=0x7fce3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407f6a9a5862e745 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.098+0000 7fce3a000640 1 -- 172.21.15.144:0/2622425854 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34037070 con 0x7fce3c06bff0 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.098+0000 7fce3a000640 1 -- 172.21.15.144:0/2622425854 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce34032440 con 0x7fce3c06bff0 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.098+0000 7fce3a000640 1 -- 172.21.15.144:0/2622425854 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34032810 con 0x7fce3c06bff0 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.099+0000 7fce40e00640 1 -- 172.21.15.144:0/2622425854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 msgr2=0x7fce3c0b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.099+0000 7fce40e00640 1 --2- 172.21.15.144:0/2622425854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 0x7fce3c0b3df0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fce34009870 tx=0x7fce3402a270 comp rx=0 tx=0).stop 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.099+0000 7fce40e00640 1 -- 172.21.15.144:0/2622425854 shutdown_connections 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.099+0000 7fce40e00640 1 --2- 172.21.15.144:0/2622425854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 0x7fce3c0b3df0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.099+0000 7fce40e00640 1 --2- 172.21.15.144:0/2622425854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce3c162990 0x7fce3c0cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.099+0000 7fce40e00640 1 -- 172.21.15.144:0/2622425854 >> 172.21.15.144:0/2622425854 conn(0x7fce3c0b20a0 msgr2=0x7fce3c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.099+0000 7fce40e00640 1 -- 172.21.15.144:0/2622425854 shutdown_connections 2024-05-30T16:46:58.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.099+0000 7fce40e00640 1 -- 172.21.15.144:0/2622425854 wait complete. 2024-05-30T16:46:58.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.101+0000 7fce40e00640 1 Processor -- start 2024-05-30T16:46:58.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.101+0000 7fce40e00640 1 -- start start 2024-05-30T16:46:58.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce40e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 0x7fce3c148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:58.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce40e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce3c162990 0x7fce3c161800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:58.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce40e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce3c161d40 0x7fce3c148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:58.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce40e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c0cfbd0 con 0x7fce3c06bff0 2024-05-30T16:46:58.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce40e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1671d0 con 0x7fce3c161d40 2024-05-30T16:46:58.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce40e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c0cf140 con 0x7fce3c162990 2024-05-30T16:46:58.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce3b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 0x7fce3c148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce3b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 0x7fce3c148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49538/0 (socket says 172.21.15.144:49538) 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce3b400640 1 -- 172.21.15.144:0/3888283798 learned_addr learned my addr 172.21.15.144:0/3888283798 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce3b400640 1 -- 172.21.15.144:0/3888283798 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce3c162990 msgr2=0x7fce3c161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce3b400640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce3c162990 0x7fce3c161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce3b400640 1 -- 172.21.15.144:0/3888283798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce3c161d40 msgr2=0x7fce3c148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce3b400640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce3c161d40 0x7fce3c148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.102+0000 7fce3b400640 1 -- 172.21.15.144:0/3888283798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c160ab0 con 0x7fce3c06bff0 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.103+0000 7fce3b400640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 0x7fce3c148040 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007f20 tx=0x7fce2c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.103+0000 7fce33400640 1 -- 172.21.15.144:0/3888283798 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c014620 con 0x7fce3c06bff0 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.103+0000 7fce33400640 1 -- 172.21.15.144:0/3888283798 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2c019070 con 0x7fce3c06bff0 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.103+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c160d20 con 0x7fce3c06bff0 2024-05-30T16:46:58.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.103+0000 7fce33400640 1 -- 172.21.15.144:0/3888283798 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c014a00 con 0x7fce3c06bff0 2024-05-30T16:46:58.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.103+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c15b460 con 0x7fce3c06bff0 2024-05-30T16:46:58.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.104+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c075570 con 0x7fce3c06bff0 2024-05-30T16:46:58.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.105+0000 7fce33400640 1 -- 172.21.15.144:0/3888283798 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7fce2c014ba0 con 0x7fce3c06bff0 2024-05-30T16:46:58.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.106+0000 7fce33400640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce1c06cfb0 0x7fce1c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:46:58.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.106+0000 7fce33400640 1 -- 172.21.15.144:0/3888283798 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fce2c08d030 con 0x7fce3c06bff0 2024-05-30T16:46:58.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.106+0000 7fce3aa00640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce1c06cfb0 0x7fce1c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:46:58.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.107+0000 7fce3aa00640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce1c06cfb0 0x7fce1c06f470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fce28007fd0 tx=0x7fce28007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:46:58.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.110+0000 7fce33400640 1 -- 172.21.15.144:0/3888283798 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce2c05ab90 con 0x7fce3c06bff0 2024-05-30T16:46:58.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.365+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fce3c073f60 con 0x7fce3c06bff0 2024-05-30T16:46:58.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.366+0000 7fce33400640 1 -- 172.21.15.144:0/3888283798 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2143 (secure 0 0 0) 0x7fce2c05a490 con 0x7fce3c06bff0 2024-05-30T16:46:58.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:46:58.367 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:46:58.367 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:46:58.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 330, 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:46:58.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:46:58.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4225, 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 17575884664, 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 35011698688, 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 738082414592, 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 581085859, 2024-05-30T16:46:58.371 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 603827598, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 141, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 162 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 27, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 3, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:46:58.372 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "a", 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5235 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:46:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "d2a1d40d-0ffc-4f05-a6e6-4980d0148787": { 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "2 ongoing clones; Avg progress is 13.594% (11s)\n [===.........................] (remaining: 76s)", 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.13594000041484833, 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:46:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:46:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:46:58.375 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.369+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce1c06cfb0 msgr2=0x7fce1c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.369+0000 7fce40e00640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce1c06cfb0 0x7fce1c06f470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fce28007fd0 tx=0x7fce28007960 comp rx=0 tx=0).stop 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.369+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 msgr2=0x7fce3c148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.369+0000 7fce40e00640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 0x7fce3c148040 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007f20 tx=0x7fce2c00e570 comp rx=0 tx=0).stop 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.370+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 shutdown_connections 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.370+0000 7fce40e00640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce1c06cfb0 0x7fce1c06f470 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.370+0000 7fce40e00640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce3c161d40 0x7fce3c148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.370+0000 7fce40e00640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce3c162990 0x7fce3c161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.370+0000 7fce40e00640 1 --2- 172.21.15.144:0/3888283798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c06bff0 0x7fce3c148040 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:46:58.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.370+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 >> 172.21.15.144:0/3888283798 conn(0x7fce3c0b20a0 msgr2=0x7fce3c15c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:46:58.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.370+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 shutdown_connections 2024-05-30T16:46:58.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:46:58.370+0000 7fce40e00640 1 -- 172.21.15.144:0/3888283798 wait complete. 2024-05-30T16:47:03.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:47:03.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.599+0000 7fb1e6000640 1 Processor -- start 2024-05-30T16:47:03.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.599+0000 7fb1e6000640 1 -- start start 2024-05-30T16:47:03.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.600+0000 7fb1e6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1e013f760 0x7fb1e006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:03.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.600+0000 7fb1e6000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb1e00cec70 0x7fb1e00b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:03.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.600+0000 7fb1e6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e00b5e00 0x7fb1e0142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:03.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.600+0000 7fb1e6000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e01612b0 con 0x7fb1e013f760 2024-05-30T16:47:03.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.600+0000 7fb1e6000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e013fb40 con 0x7fb1e00cec70 2024-05-30T16:47:03.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.600+0000 7fb1e6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e006ee80 con 0x7fb1e00b5e00 2024-05-30T16:47:03.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.601+0000 7fb1df400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1e013f760 0x7fb1e006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:03.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.601+0000 7fb1df400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1e013f760 0x7fb1e006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49546/0 (socket says 172.21.15.144:49546) 2024-05-30T16:47:03.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.601+0000 7fb1df400640 1 -- 172.21.15.144:0/2131664137 learned_addr learned my addr 172.21.15.144:0/2131664137 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:03.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.601+0000 7fb1dfe00640 1 --2- 172.21.15.144:0/2131664137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e00b5e00 0x7fb1e0142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:03.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.601+0000 7fb1df400640 1 -- 172.21.15.144:0/2131664137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e00b5e00 msgr2=0x7fb1e0142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:03.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.601+0000 7fb1df400640 1 --2- 172.21.15.144:0/2131664137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e00b5e00 0x7fb1e0142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.601+0000 7fb1df400640 1 -- 172.21.15.144:0/2131664137 >> v2:172.21.15.149:3300/0 conn(0x7fb1e00cec70 msgr2=0x7fb1e00b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:03.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.601+0000 7fb1df400640 1 --2- 172.21.15.144:0/2131664137 >> v2:172.21.15.149:3300/0 conn(0x7fb1e00cec70 0x7fb1e00b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.601+0000 7fb1df400640 1 -- 172.21.15.144:0/2131664137 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e0160730 con 0x7fb1e013f760 2024-05-30T16:47:03.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.602+0000 7fb1df400640 1 --2- 172.21.15.144:0/2131664137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e013f760 0x7fb1e006e940 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00700f0 tx=0x7fb1d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0efdffb453e2d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:03.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.602+0000 7fb1dea00640 1 -- 172.21.15.144:0/2131664137 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0037070 con 0x7fb1e013f760 2024-05-30T16:47:03.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1dea00640 1 -- 172.21.15.144:0/2131664137 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d0032440 con 0x7fb1e013f760 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1dea00640 1 -- 172.21.15.144:0/2131664137 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0032810 con 0x7fb1e013f760 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1e6000640 1 -- 172.21.15.144:0/2131664137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e013f760 msgr2=0x7fb1e006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1e6000640 1 --2- 172.21.15.144:0/2131664137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e013f760 0x7fb1e006e940 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00700f0 tx=0x7fb1d002a270 comp rx=0 tx=0).stop 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1e6000640 1 -- 172.21.15.144:0/2131664137 shutdown_connections 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1e6000640 1 --2- 172.21.15.144:0/2131664137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e00b5e00 0x7fb1e0142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1e6000640 1 --2- 172.21.15.144:0/2131664137 >> v2:172.21.15.149:3300/0 conn(0x7fb1e00cec70 0x7fb1e00b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1e6000640 1 --2- 172.21.15.144:0/2131664137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e013f760 0x7fb1e006e940 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1e6000640 1 -- 172.21.15.144:0/2131664137 >> 172.21.15.144:0/2131664137 conn(0x7fb1e006bd00 msgr2=0x7fb1e006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1e6000640 1 -- 172.21.15.144:0/2131664137 shutdown_connections 2024-05-30T16:47:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.603+0000 7fb1e6000640 1 -- 172.21.15.144:0/2131664137 wait complete. 2024-05-30T16:47:03.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.605+0000 7fb1e6000640 1 Processor -- start 2024-05-30T16:47:03.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.605+0000 7fb1e6000640 1 -- start start 2024-05-30T16:47:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.606+0000 7fb1e6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e00b5e00 0x7fb1e01552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.606+0000 7fb1e6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e00cec70 0x7fb1e01f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.606+0000 7fb1e6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e013f760 0x7fb1e015cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.606+0000 7fb1e6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e0160fd0 con 0x7fb1e00b5e00 2024-05-30T16:47:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.606+0000 7fb1e6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e0160cf0 con 0x7fb1e00cec70 2024-05-30T16:47:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.606+0000 7fb1e6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e00cf0d0 con 0x7fb1e013f760 2024-05-30T16:47:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.606+0000 7fb1df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e00b5e00 0x7fb1e01552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.606+0000 7fb1df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e00b5e00 0x7fb1e01552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49554/0 (socket says 172.21.15.144:49554) 2024-05-30T16:47:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.606+0000 7fb1df400640 1 -- 172.21.15.144:0/1536315424 learned_addr learned my addr 172.21.15.144:0/1536315424 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.607+0000 7fb1df400640 1 -- 172.21.15.144:0/1536315424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e013f760 msgr2=0x7fb1e015cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.607+0000 7fb1df400640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e013f760 0x7fb1e015cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.607+0000 7fb1df400640 1 -- 172.21.15.144:0/1536315424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e00cec70 msgr2=0x7fb1e01f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.607+0000 7fb1df400640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e00cec70 0x7fb1e01f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.607+0000 7fb1df400640 1 -- 172.21.15.144:0/1536315424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e01f5130 con 0x7fb1e00b5e00 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.607+0000 7fb1df400640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e00b5e00 0x7fb1e01552b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb1d002a2b0 tx=0x7fb1d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.607+0000 7fb1d7e00640 1 -- 172.21.15.144:0/1536315424 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0037040 con 0x7fb1e00b5e00 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.608+0000 7fb1d7e00640 1 -- 172.21.15.144:0/1536315424 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d0042070 con 0x7fb1e00b5e00 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.608+0000 7fb1d7e00640 1 -- 172.21.15.144:0/1536315424 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0030bb0 con 0x7fb1e00b5e00 2024-05-30T16:47:03.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.608+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e00b3ed0 con 0x7fb1e00b5e00 2024-05-30T16:47:03.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.608+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e00b4490 con 0x7fb1e00b5e00 2024-05-30T16:47:03.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.609+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e0068b90 con 0x7fb1e00b5e00 2024-05-30T16:47:03.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.610+0000 7fb1d7e00640 1 -- 172.21.15.144:0/1536315424 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7fb1d0047460 con 0x7fb1e00b5e00 2024-05-30T16:47:03.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.611+0000 7fb1d7e00640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1bc06cfb0 0x7fb1bc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:03.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.611+0000 7fb1d7e00640 1 -- 172.21.15.144:0/1536315424 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fb1d00ad2e0 con 0x7fb1e00b5e00 2024-05-30T16:47:03.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.611+0000 7fb1d6a00640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1bc06cfb0 0x7fb1bc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:03.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.612+0000 7fb1d6a00640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1bc06cfb0 0x7fb1bc06f470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0154240 tx=0x7fb1c8006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:03.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.615+0000 7fb1d7e00640 1 -- 172.21.15.144:0/1536315424 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1d007ae90 con 0x7fb1e00b5e00 2024-05-30T16:47:03.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.896+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb1e006f850 con 0x7fb1e00b5e00 2024-05-30T16:47:03.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.896+0000 7fb1d7e00640 1 -- 172.21.15.144:0/1536315424 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2143 (secure 0 0 0) 0x7fb1d007a790 con 0x7fb1e00b5e00 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:47:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 336, 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4398, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 18314218055, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 37011873792, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 736082239488, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 565706116, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 566105530, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 138, 2024-05-30T16:47:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 153 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 27, 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3, 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 3, 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "a", 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:47:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5235 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "d2a1d40d-0ffc-4f05-a6e6-4980d0148787": { 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "1 ongoing clones; Avg progress is 16.172% (17s)\n [====........................] (remaining: 93s)", 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.16171999275684357, 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:03.904 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:47:03.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1bc06cfb0 msgr2=0x7fb1bc06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:03.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1bc06cfb0 0x7fb1bc06f470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0154240 tx=0x7fb1c8006c90 comp rx=0 tx=0).stop 2024-05-30T16:47:03.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e00b5e00 msgr2=0x7fb1e01552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:03.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e00b5e00 0x7fb1e01552b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb1d002a2b0 tx=0x7fb1d00046c0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 shutdown_connections 2024-05-30T16:47:03.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1bc06cfb0 0x7fb1bc06f470 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1e013f760 0x7fb1e015cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e00cec70 0x7fb1e01f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 --2- 172.21.15.144:0/1536315424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e00b5e00 0x7fb1e01552b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:03.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 >> 172.21.15.144:0/1536315424 conn(0x7fb1e006bd00 msgr2=0x7fb1e006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:03.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 shutdown_connections 2024-05-30T16:47:03.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:03.899+0000 7fb1e6000640 1 -- 172.21.15.144:0/1536315424 wait complete. 2024-05-30T16:47:08.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:47:09.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.130+0000 7f6f2b600640 1 Processor -- start 2024-05-30T16:47:09.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.130+0000 7f6f2b600640 1 -- start start 2024-05-30T16:47:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.132+0000 7f6f2b600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f2406f7e0 0x7f6f241662c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.132+0000 7f6f2b600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240d00f0 con 0x7f6f24145150 2024-05-30T16:47:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.132+0000 7f6f2b600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2415f390 con 0x7f6f240cfc40 2024-05-30T16:47:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.132+0000 7f6f2b600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6f2415f140 con 0x7f6f2406f7e0 2024-05-30T16:47:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.132+0000 7f6f28c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6f24145150 0x7f6f240cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:38626/0 (socket says 172.21.15.144:38626) 2024-05-30T16:47:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.132+0000 7f6f28c00640 1 -- 172.21.15.144:0/1873573767 learned_addr learned my addr 172.21.15.144:0/1873573767 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:09.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.132+0000 7f6f29600640 1 --2- 172.21.15.144:0/1873573767 >> v2:172.21.15.149:3300/0 conn(0x7f6f2406f7e0 0x7f6f241662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:09.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.132+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3554589587 0 0) 0x7f6f240d00f0 con 0x7f6f24145150 2024-05-30T16:47:09.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.132+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f08003520 con 0x7f6f24145150 2024-05-30T16:47:09.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 608355057 0 0) 0x7f6f08003520 con 0x7f6f24145150 2024-05-30T16:47:09.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 >> v2:172.21.15.149:3300/0 conn(0x7f6f2406f7e0 msgr2=0x7f6f241662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:09.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 --2- 172.21.15.144:0/1873573767 >> v2:172.21.15.149:3300/0 conn(0x7f6f2406f7e0 0x7f6f241662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 >> v1:172.21.15.149:6789/0 conn(0x7f6f240cfc40 legacy=0x7f6f2406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2415f670 con 0x7f6f24145150 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f6f14001670 con 0x7f6f24145150 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 >> v1:172.21.15.144:6789/0 conn(0x7f6f24145150 legacy=0x7f6f240cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f08003a00 0x7f6f08003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f080052e0 0x7f6f0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2415f140 con 0x7f6f08004800 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0800c200 con 0x7f6f08003a00 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0800c400 con 0x7f6f080052e0 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.133+0000 7f6f1be00640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.134+0000 7f6f29600640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f080052e0 0x7f6f0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.134+0000 7f6f28c00640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f08003a00 0x7f6f08003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:09.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.134+0000 7f6f1be00640 1 -- 172.21.15.144:0/1873573767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f080052e0 msgr2=0x7f6f0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.134+0000 7f6f1be00640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f080052e0 0x7f6f0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.134+0000 7f6f1be00640 1 -- 172.21.15.144:0/1873573767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f08003a00 msgr2=0x7f6f08003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.134+0000 7f6f1be00640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f08003a00 0x7f6f08003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.134+0000 7f6f1be00640 1 -- 172.21.15.144:0/1873573767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f08003520 con 0x7f6f08004800 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.134+0000 7f6f29600640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f080052e0 0x7f6f0800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.134+0000 7f6f29600640 1 -- 172.21.15.144:0/1873573767 reap_dead start 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.135+0000 7f6f1be00640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c003d80 tx=0x7f6f08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd73378538bb3334 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.135+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c037070 con 0x7f6f08004800 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.135+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c02a9c0 con 0x7f6f08004800 2024-05-30T16:47:09.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.135+0000 7f6f23e00640 1 -- 172.21.15.144:0/1873573767 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c003980 con 0x7f6f08004800 2024-05-30T16:47:09.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.136+0000 7f6f2b600640 1 -- 172.21.15.144:0/1873573767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f08004800 msgr2=0x7f6f08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:09.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.136+0000 7f6f2b600640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c003d80 tx=0x7f6f08005830 comp rx=0 tx=0).stop 2024-05-30T16:47:09.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.136+0000 7f6f2b600640 1 -- 172.21.15.144:0/1873573767 shutdown_connections 2024-05-30T16:47:09.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.136+0000 7f6f2b600640 1 --2- 172.21.15.144:0/1873573767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f08004800 0x7f6f08004c80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.136+0000 7f6f2b600640 1 -- 172.21.15.144:0/1873573767 >> 172.21.15.144:0/1873573767 conn(0x7f6f2406bd00 msgr2=0x7f6f2406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:09.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.136+0000 7f6f2b600640 1 -- 172.21.15.144:0/1873573767 shutdown_connections 2024-05-30T16:47:09.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.136+0000 7f6f2b600640 1 -- 172.21.15.144:0/1873573767 wait complete. 2024-05-30T16:47:09.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.138+0000 7f6f2b600640 1 Processor -- start 2024-05-30T16:47:09.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.138+0000 7f6f2b600640 1 -- start start 2024-05-30T16:47:09.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f2b600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f08004800 0x7f6f240b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:09.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f2b600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f240aaa90 0x7f6f241441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:09.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f2b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f2413e010 0x7f6f2413e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:09.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f2b600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2415fe70 con 0x7f6f240aaa90 2024-05-30T16:47:09.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f2b600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f240b64f0 con 0x7f6f08004800 2024-05-30T16:47:09.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f2b600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2415fff0 con 0x7f6f2413e010 2024-05-30T16:47:09.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f240aaa90 0x7f6f241441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f240aaa90 0x7f6f241441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60744/0 (socket says 172.21.15.144:60744) 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f1be00640 1 -- 172.21.15.144:0/477752267 learned_addr learned my addr 172.21.15.144:0/477752267 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f28c00640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f08004800 0x7f6f240b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f1be00640 1 -- 172.21.15.144:0/477752267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f2413e010 msgr2=0x7f6f2413e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f1be00640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f2413e010 0x7f6f2413e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f1be00640 1 -- 172.21.15.144:0/477752267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f08004800 msgr2=0x7f6f240b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f1be00640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f08004800 0x7f6f240b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.139+0000 7f6f1be00640 1 -- 172.21.15.144:0/477752267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2413e9d0 con 0x7f6f240aaa90 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.140+0000 7f6f1be00640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f240aaa90 0x7f6f241441f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c003d80 tx=0x7f6f0c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.140+0000 7f6f21600640 1 -- 172.21.15.144:0/477752267 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c042020 con 0x7f6f240aaa90 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.140+0000 7f6f21600640 1 -- 172.21.15.144:0/477752267 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c006e50 con 0x7f6f240aaa90 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.140+0000 7f6f21600640 1 -- 172.21.15.144:0/477752267 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c037040 con 0x7f6f240aaa90 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.140+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f240b3090 con 0x7f6f240aaa90 2024-05-30T16:47:09.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.140+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f240b22d0 con 0x7f6f240aaa90 2024-05-30T16:47:09.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.141+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f24068b90 con 0x7f6f240aaa90 2024-05-30T16:47:09.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.142+0000 7f6f21600640 1 -- 172.21.15.144:0/477752267 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f6f0c045020 con 0x7f6f240aaa90 2024-05-30T16:47:09.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.144+0000 7f6f21600640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6f0006cfe0 0x7f6f0006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:09.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.144+0000 7f6f21600640 1 -- 172.21.15.144:0/477752267 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f6f0c0ac990 con 0x7f6f240aaa90 2024-05-30T16:47:09.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.144+0000 7f6f28c00640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6f0006cfe0 0x7f6f0006f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:09.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.145+0000 7f6f28c00640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6f0006cfe0 0x7f6f0006f4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6f241424b0 tx=0x7f6f14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:09.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.149+0000 7f6f21600640 1 -- 172.21.15.144:0/477752267 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f0c04c030 con 0x7f6f240aaa90 2024-05-30T16:47:09.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.424+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6f240b3f20 con 0x7f6f240aaa90 2024-05-30T16:47:09.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.425+0000 7f6f21600640 1 -- 172.21.15.144:0/477752267 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2123 (secure 0 0 0) 0x7f6f0c07a4f0 con 0x7f6f240aaa90 2024-05-30T16:47:09.426 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:09.426 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:09.427 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 341, 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:47:09.428 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:09.429 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4398, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 18314264126, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 37011963904, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 736082149376, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 303189778, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 316148557, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 74, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 87 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 27, 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3, 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 3, 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "a", 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5235 2024-05-30T16:47:09.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:09.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: "d2a1d40d-0ffc-4f05-a6e6-4980d0148787": { 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (21s)\n [============================] ", 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:09.433 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:47:09.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6f0006cfe0 msgr2=0x7f6f0006f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:09.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6f0006cfe0 0x7f6f0006f4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6f241424b0 tx=0x7f6f14009040 comp rx=0 tx=0).stop 2024-05-30T16:47:09.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f240aaa90 msgr2=0x7f6f241441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:09.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f240aaa90 0x7f6f241441f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c003d80 tx=0x7f6f0c0036f0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 shutdown_connections 2024-05-30T16:47:09.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6f0006cfe0 0x7f6f0006f4a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f2413e010 0x7f6f2413e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f240aaa90 0x7f6f241441f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 --2- 172.21.15.144:0/477752267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f08004800 0x7f6f240b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:09.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.427+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 >> 172.21.15.144:0/477752267 conn(0x7f6f2406bd00 msgr2=0x7f6f2406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:09.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.428+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 shutdown_connections 2024-05-30T16:47:09.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:09.428+0000 7f6f2b600640 1 -- 172.21.15.144:0/477752267 wait complete. 2024-05-30T16:47:14.449 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:47:14.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.655+0000 7f9d88000640 1 Processor -- start 2024-05-30T16:47:14.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.655+0000 7f9d88000640 1 -- start start 2024-05-30T16:47:14.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.656+0000 7f9d88000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d800cfc40 0x7f9d8006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:14.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.656+0000 7f9d88000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d800d00f0 con 0x7f9d80145150 2024-05-30T16:47:14.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.656+0000 7f9d88000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8015f390 con 0x7f9d8006f610 2024-05-30T16:47:14.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.656+0000 7f9d88000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8006fa60 con 0x7f9d800cfc40 2024-05-30T16:47:14.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.657+0000 7f9d85600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9d80145150 0x7f9d800cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:38632/0 (socket says 172.21.15.144:38632) 2024-05-30T16:47:14.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.657+0000 7f9d85600640 1 -- 172.21.15.144:0/1292737390 learned_addr learned my addr 172.21.15.144:0/1292737390 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:14.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.657+0000 7f9d84c00640 1 --2- 172.21.15.144:0/1292737390 >> v2:172.21.15.144:3300/0 conn(0x7f9d800cfc40 0x7f9d8006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:14.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.657+0000 7f9d84c00640 1 -- 172.21.15.144:0/1292737390 >> v1:172.21.15.149:6789/0 conn(0x7f9d8006f610 legacy=0x7f9d800b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:14.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.657+0000 7f9d7fe00640 1 -- 172.21.15.144:0/1292737390 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4205722390 0 0) 0x7f9d800d00f0 con 0x7f9d80145150 2024-05-30T16:47:14.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.657+0000 7f9d84c00640 1 -- 172.21.15.144:0/1292737390 >> v1:172.21.15.144:6789/0 conn(0x7f9d80145150 legacy=0x7f9d800cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:14.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.657+0000 7f9d84c00640 1 -- 172.21.15.144:0/1292737390 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8015f670 con 0x7f9d800cfc40 2024-05-30T16:47:14.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.658+0000 7f9d84c00640 1 --2- 172.21.15.144:0/1292737390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d800cfc40 0x7f9d8006f0d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0097a0 tx=0x7f9d6c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5563caf6c1210a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:14.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.659+0000 7f9d7fe00640 1 -- 172.21.15.144:0/1292737390 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c037070 con 0x7f9d800cfc40 2024-05-30T16:47:14.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.659+0000 7f9d7fe00640 1 -- 172.21.15.144:0/1292737390 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6c02ae50 con 0x7f9d800cfc40 2024-05-30T16:47:14.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.659+0000 7f9d7fe00640 1 -- 172.21.15.144:0/1292737390 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c032660 con 0x7f9d800cfc40 2024-05-30T16:47:14.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.659+0000 7f9d88000640 1 -- 172.21.15.144:0/1292737390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d800cfc40 msgr2=0x7f9d8006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:14.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.659+0000 7f9d88000640 1 --2- 172.21.15.144:0/1292737390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d800cfc40 0x7f9d8006f0d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0097a0 tx=0x7f9d6c02a140 comp rx=0 tx=0).stop 2024-05-30T16:47:14.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.659+0000 7f9d88000640 1 -- 172.21.15.144:0/1292737390 shutdown_connections 2024-05-30T16:47:14.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.659+0000 7f9d88000640 1 --2- 172.21.15.144:0/1292737390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d800cfc40 0x7f9d8006f0d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:14.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.659+0000 7f9d88000640 1 -- 172.21.15.144:0/1292737390 >> 172.21.15.144:0/1292737390 conn(0x7f9d8006bd00 msgr2=0x7f9d8006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:14.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.660+0000 7f9d88000640 1 -- 172.21.15.144:0/1292737390 shutdown_connections 2024-05-30T16:47:14.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.660+0000 7f9d88000640 1 -- 172.21.15.144:0/1292737390 wait complete. 2024-05-30T16:47:14.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.661+0000 7f9d88000640 1 Processor -- start 2024-05-30T16:47:14.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.661+0000 7f9d88000640 1 -- start start 2024-05-30T16:47:14.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.662+0000 7f9d88000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d8006f610 0x7f9d8014b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:14.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.662+0000 7f9d88000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d800cfc40 0x7f9d8013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:14.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.662+0000 7f9d88000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d80145150 0x7f9d8013bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:14.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.662+0000 7f9d88000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d800b64f0 con 0x7f9d80145150 2024-05-30T16:47:14.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.662+0000 7f9d88000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8015f140 con 0x7f9d8006f610 2024-05-30T16:47:14.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.662+0000 7f9d88000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8015fe70 con 0x7f9d800cfc40 2024-05-30T16:47:14.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.662+0000 7f9d86000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d80145150 0x7f9d8013bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:14.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d86000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d80145150 0x7f9d8013bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60760/0 (socket says 172.21.15.144:60760) 2024-05-30T16:47:14.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d86000640 1 -- 172.21.15.144:0/1707848811 learned_addr learned my addr 172.21.15.144:0/1707848811 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:14.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d85600640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d8006f610 0x7f9d8014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:14.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d84c00640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d800cfc40 0x7f9d8013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:14.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d86000640 1 -- 172.21.15.144:0/1707848811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d800cfc40 msgr2=0x7f9d8013ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:14.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d86000640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d800cfc40 0x7f9d8013ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:14.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d86000640 1 -- 172.21.15.144:0/1707848811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d8006f610 msgr2=0x7f9d8014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d86000640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d8006f610 0x7f9d8014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d86000640 1 -- 172.21.15.144:0/1707848811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8014b560 con 0x7f9d80145150 2024-05-30T16:47:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d86000640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d80145150 0x7f9d8013bc50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c780 tx=0x7f9d7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.663+0000 7f9d7d600640 1 -- 172.21.15.144:0/1707848811 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78017070 con 0x7f9d80145150 2024-05-30T16:47:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.664+0000 7f9d7d600640 1 -- 172.21.15.144:0/1707848811 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d78003da0 con 0x7f9d80145150 2024-05-30T16:47:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.664+0000 7f9d7d600640 1 -- 172.21.15.144:0/1707848811 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d780052b0 con 0x7f9d80145150 2024-05-30T16:47:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.664+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8014bda0 con 0x7f9d80145150 2024-05-30T16:47:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.664+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d8014c360 con 0x7f9d80145150 2024-05-30T16:47:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.665+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8014cb30 con 0x7f9d80145150 2024-05-30T16:47:14.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.666+0000 7f9d7d600640 1 -- 172.21.15.144:0/1707848811 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f9d78005450 con 0x7f9d80145150 2024-05-30T16:47:14.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.667+0000 7f9d7d600640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d6006cfb0 0x7f9d6006f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:14.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.667+0000 7f9d7d600640 1 -- 172.21.15.144:0/1707848811 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f9d7808be50 con 0x7f9d80145150 2024-05-30T16:47:14.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.667+0000 7f9d85600640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d6006cfb0 0x7f9d6006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.668+0000 7f9d85600640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d6006cfb0 0x7f9d6006f470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d74000f60 tx=0x7f9d74007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:14.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.672+0000 7f9d7d600640 1 -- 172.21.15.144:0/1707848811 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d8014b560 con 0x7f9d80145150 2024-05-30T16:47:14.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.948+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9d80068b90 con 0x7f9d80145150 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.950+0000 7f9d7d600640 1 -- 172.21.15.144:0/1707848811 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2121 (secure 0 0 0) 0x7f9d780597e0 con 0x7f9d80145150 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:47:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 347, 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:47:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:47:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4398, 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 18314296344, 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 37012029440, 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 736082083840, 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:47:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 48566000, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 48236311, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 11, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 17 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 27, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 3, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:47:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "a", 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5235 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "d2a1d40d-0ffc-4f05-a6e6-4980d0148787": { 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (28s)\n [============================] ", 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:14.957 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:47:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d6006cfb0 msgr2=0x7f9d6006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d6006cfb0 0x7f9d6006f470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d74000f60 tx=0x7f9d74007c00 comp rx=0 tx=0).stop 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d80145150 msgr2=0x7f9d8013bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d80145150 0x7f9d8013bc50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c780 tx=0x7f9d7800cc40 comp rx=0 tx=0).stop 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 shutdown_connections 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d6006cfb0 0x7f9d6006f470 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d80145150 0x7f9d8013bc50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d800cfc40 0x7f9d8013ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 --2- 172.21.15.144:0/1707848811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d8006f610 0x7f9d8014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 >> 172.21.15.144:0/1707848811 conn(0x7f9d8006bd00 msgr2=0x7f9d800b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 shutdown_connections 2024-05-30T16:47:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:14.952+0000 7f9d88000640 1 -- 172.21.15.144:0/1707848811 wait complete. 2024-05-30T16:47:16.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:47:16.619 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:47:19.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:47:20.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.177+0000 7f1058a00640 1 Processor -- start 2024-05-30T16:47:20.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.177+0000 7f1058a00640 1 -- start start 2024-05-30T16:47:20.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.179+0000 7f1058a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10540ba090 0x7f10540cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:20.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.179+0000 7f1058a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f105415ed40 con 0x7f105415e960 2024-05-30T16:47:20.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.179+0000 7f1058a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1054162ca0 con 0x7f10540cfa10 2024-05-30T16:47:20.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.179+0000 7f1058a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f10540cfe80 con 0x7f10540ba090 2024-05-30T16:47:20.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.179+0000 7f1051e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10540ba090 0x7f10540cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:20.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.179+0000 7f1051e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10540ba090 0x7f10540cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44978/0 (socket says 172.21.15.144:44978) 2024-05-30T16:47:20.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.179+0000 7f1051e00640 1 -- 172.21.15.144:0/1789409446 learned_addr learned my addr 172.21.15.144:0/1789409446 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:20.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.179+0000 7f1052800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f105415e960 0x7f1054162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48998/0 (socket says 172.21.15.144:48998) 2024-05-30T16:47:20.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.180+0000 7f1051e00640 1 -- 172.21.15.144:0/1789409446 >> v1:172.21.15.149:6789/0 conn(0x7f10540cfa10 legacy=0x7f10540d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:20.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.180+0000 7f1051e00640 1 -- 172.21.15.144:0/1789409446 >> v1:172.21.15.144:6789/0 conn(0x7f105415e960 legacy=0x7f1054162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:20.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.180+0000 7f1051e00640 1 -- 172.21.15.144:0/1789409446 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1054162f80 con 0x7f10540ba090 2024-05-30T16:47:20.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.181+0000 7f1051e00640 1 --2- 172.21.15.144:0/1789409446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 0x7f10540cf4d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1040009870 tx=0x7f104002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f3ee73758967ad server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:20.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.181+0000 7f1051400640 1 -- 172.21.15.144:0/1789409446 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040037070 con 0x7f10540ba090 2024-05-30T16:47:20.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.181+0000 7f1051400640 1 -- 172.21.15.144:0/1789409446 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1040032440 con 0x7f10540ba090 2024-05-30T16:47:20.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.181+0000 7f1051400640 1 -- 172.21.15.144:0/1789409446 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040032810 con 0x7f10540ba090 2024-05-30T16:47:20.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.182+0000 7f1058a00640 1 -- 172.21.15.144:0/1789409446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 msgr2=0x7f10540cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:20.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.182+0000 7f1058a00640 1 --2- 172.21.15.144:0/1789409446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 0x7f10540cf4d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1040009870 tx=0x7f104002a2a0 comp rx=0 tx=0).stop 2024-05-30T16:47:20.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.182+0000 7f1058a00640 1 -- 172.21.15.144:0/1789409446 shutdown_connections 2024-05-30T16:47:20.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.182+0000 7f1058a00640 1 --2- 172.21.15.144:0/1789409446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 0x7f10540cf4d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:20.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.182+0000 7f1058a00640 1 -- 172.21.15.144:0/1789409446 >> 172.21.15.144:0/1789409446 conn(0x7f10540d1360 msgr2=0x7f10540d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:20.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.182+0000 7f1058a00640 1 -- 172.21.15.144:0/1789409446 shutdown_connections 2024-05-30T16:47:20.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.182+0000 7f1058a00640 1 -- 172.21.15.144:0/1789409446 wait complete. 2024-05-30T16:47:20.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.184+0000 7f1058a00640 1 Processor -- start 2024-05-30T16:47:20.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.184+0000 7f1058a00640 1 -- start start 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.185+0000 7f1058a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 0x7f105415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.185+0000 7f1058a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10540cfa10 0x7f105415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.185+0000 7f1058a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105415e960 0x7f1054160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.185+0000 7f1058a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10540d2d90 con 0x7f10540ba090 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.185+0000 7f1058a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10540d2b40 con 0x7f105415e960 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.185+0000 7f1058a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f10540b78a0 con 0x7f10540cfa10 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.185+0000 7f1052800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 0x7f105415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.185+0000 7f1052800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 0x7f105415cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44992/0 (socket says 172.21.15.144:44992) 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.185+0000 7f1052800640 1 -- 172.21.15.144:0/328890651 learned_addr learned my addr 172.21.15.144:0/328890651 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f1052800640 1 -- 172.21.15.144:0/328890651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10540cfa10 msgr2=0x7f105415d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f1052800640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10540cfa10 0x7f105415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:20.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f1052800640 1 -- 172.21.15.144:0/328890651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105415e960 msgr2=0x7f1054160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:20.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f1053200640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105415e960 0x7f1054160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:20.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f1052800640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105415e960 0x7f1054160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:20.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f1052800640 1 -- 172.21.15.144:0/328890651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10541e8360 con 0x7f10540ba090 2024-05-30T16:47:20.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f1052800640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 0x7f105415cfa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f104400c400 tx=0x7f104400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:20.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f104aa00640 1 -- 172.21.15.144:0/328890651 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10440074e0 con 0x7f10540ba090 2024-05-30T16:47:20.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f104aa00640 1 -- 172.21.15.144:0/328890651 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1044007680 con 0x7f10540ba090 2024-05-30T16:47:20.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f104aa00640 1 -- 172.21.15.144:0/328890651 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044004a20 con 0x7f10540ba090 2024-05-30T16:47:20.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541e8600 con 0x7f10540ba090 2024-05-30T16:47:20.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.186+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10541e8bc0 con 0x7f10540ba090 2024-05-30T16:47:20.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.188+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1054075570 con 0x7f10540ba090 2024-05-30T16:47:20.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.189+0000 7f104aa00640 1 -- 172.21.15.144:0/328890651 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f104401a020 con 0x7f10540ba090 2024-05-30T16:47:20.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.189+0000 7f104aa00640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f103406cfb0 0x7f103406f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:20.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.190+0000 7f104aa00640 1 -- 172.21.15.144:0/328890651 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f104408c0a0 con 0x7f10540ba090 2024-05-30T16:47:20.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.190+0000 7f1051e00640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f103406cfb0 0x7f103406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:20.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.190+0000 7f1051e00640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f103406cfb0 0x7f103406f470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1040034000 tx=0x7f104002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:20.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.194+0000 7f104aa00640 1 -- 172.21.15.144:0/328890651 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1044010300 con 0x7f10540ba090 2024-05-30T16:47:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.460+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f10540d1ac0 con 0x7f10540ba090 2024-05-30T16:47:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.461+0000 7f104aa00640 1 -- 172.21.15.144:0/328890651 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2079 (secure 0 0 0) 0x7f1044059a70 con 0x7f10540ba090 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:47:20.463 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 352, 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:47:20.464 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:47:20.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4398, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 18314296344, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 37012029440, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 736082083840, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 2985, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 27, 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3, 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 3, 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "a", 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5235 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:47:20.468 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: "d2a1d40d-0ffc-4f05-a6e6-4980d0148787": { 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 15.0 seconds before exiting (34s)\n [============================] ", 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:20.469 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:47:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f103406cfb0 msgr2=0x7f103406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f103406cfb0 0x7f103406f470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1040034000 tx=0x7f104002c000 comp rx=0 tx=0).stop 2024-05-30T16:47:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 msgr2=0x7f105415cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 0x7f105415cfa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f104400c400 tx=0x7f104400c8c0 comp rx=0 tx=0).stop 2024-05-30T16:47:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 shutdown_connections 2024-05-30T16:47:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f103406cfb0 0x7f103406f470 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105415e960 0x7f1054160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10540cfa10 0x7f105415d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 --2- 172.21.15.144:0/328890651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10540ba090 0x7f105415cfa0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 >> 172.21.15.144:0/328890651 conn(0x7f10540d1360 msgr2=0x7f10540b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 shutdown_connections 2024-05-30T16:47:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:20.464+0000 7f1058a00640 1 -- 172.21.15.144:0/328890651 wait complete. 2024-05-30T16:47:25.485 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:47:25.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.696+0000 7f0cde200640 1 Processor -- start 2024-05-30T16:47:25.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.696+0000 7f0cde200640 1 -- start start 2024-05-30T16:47:25.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.697+0000 7f0cde200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd806f7e0 0x7f0cd81662c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:25.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.697+0000 7f0cde200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd80d00f0 con 0x7f0cd8145150 2024-05-30T16:47:25.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.697+0000 7f0cde200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd815f390 con 0x7f0cd80cfc40 2024-05-30T16:47:25.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.697+0000 7f0cde200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd815f140 con 0x7f0cd806f7e0 2024-05-30T16:47:25.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.697+0000 7f0cd7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0cd8145150 0x7f0cd80cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34418/0 (socket says 172.21.15.144:34418) 2024-05-30T16:47:25.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.697+0000 7f0cd7400640 1 -- 172.21.15.144:0/2637818991 learned_addr learned my addr 172.21.15.144:0/2637818991 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:25.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802578235 0 0) 0x7f0cd80d00f0 con 0x7f0cd8145150 2024-05-30T16:47:25.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cbc003520 con 0x7f0cd8145150 2024-05-30T16:47:25.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd7e00640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd806f7e0 0x7f0cd81662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:25.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3872494487 0 0) 0x7f0cbc003520 con 0x7f0cd8145150 2024-05-30T16:47:25.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd806f7e0 msgr2=0x7f0cd81662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:25.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd806f7e0 0x7f0cd81662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 >> v1:172.21.15.149:6789/0 conn(0x7f0cd80cfc40 legacy=0x7f0cd806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd815f670 con 0x7f0cd8145150 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f0cc8001670 con 0x7f0cd8145150 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 >> v1:172.21.15.144:6789/0 conn(0x7f0cd8145150 legacy=0x7f0cd80cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cbc0039e0 0x7f0cbc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd806f7e0 0x7f0cbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cbc004d40 0x7f0cbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd815f140 con 0x7f0cbc004d40 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc00bbd0 con 0x7f0cbc0039e0 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.698+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc00dfe0 con 0x7f0cd806f7e0 2024-05-30T16:47:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd7e00640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cbc004d40 0x7f0cbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd7400640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cbc0039e0 0x7f0cbc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd6a00640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd806f7e0 0x7f0cbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd7e00640 1 -- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd806f7e0 msgr2=0x7f0cbc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd7e00640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd806f7e0 0x7f0cbc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd7e00640 1 -- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cbc0039e0 msgr2=0x7f0cbc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd7e00640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cbc0039e0 0x7f0cbc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd7e00640 1 -- 172.21.15.144:0/2637818991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc003520 con 0x7f0cbc004d40 2024-05-30T16:47:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd6a00640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd806f7e0 0x7f0cbc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.699+0000 7f0cd7400640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cbc0039e0 0x7f0cbc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:25.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.700+0000 7f0cd7e00640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cbc004d40 0x7f0cbc0051c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0cd806fd70 tx=0x7f0cbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe1d32e265afb05 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:25.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0033070 con 0x7f0cbc004d40 2024-05-30T16:47:25.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd002f630 con 0x7f0cbc004d40 2024-05-30T16:47:25.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cd6000640 1 -- 172.21.15.144:0/2637818991 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0009be0 con 0x7f0cbc004d40 2024-05-30T16:47:25.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cde200640 1 -- 172.21.15.144:0/2637818991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cbc004d40 msgr2=0x7f0cbc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:25.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cde200640 1 --2- 172.21.15.144:0/2637818991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cbc004d40 0x7f0cbc0051c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0cd806fd70 tx=0x7f0cbc005830 comp rx=0 tx=0).stop 2024-05-30T16:47:25.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cd7e00640 1 -- 172.21.15.144:0/2637818991 reap_dead start 2024-05-30T16:47:25.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cde200640 1 -- 172.21.15.144:0/2637818991 shutdown_connections 2024-05-30T16:47:25.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cde200640 1 -- 172.21.15.144:0/2637818991 >> 172.21.15.144:0/2637818991 conn(0x7f0cd806bd00 msgr2=0x7f0cd806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cde200640 1 -- 172.21.15.144:0/2637818991 shutdown_connections 2024-05-30T16:47:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.701+0000 7f0cde200640 1 -- 172.21.15.144:0/2637818991 wait complete. 2024-05-30T16:47:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.703+0000 7f0cde200640 1 Processor -- start 2024-05-30T16:47:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.703+0000 7f0cde200640 1 -- start start 2024-05-30T16:47:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.704+0000 7f0cde200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cd815a910 0x7f0cd815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.704+0000 7f0cde200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd815ce70 0x7f0cd80b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.704+0000 7f0cde200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd80b1d60 0x7f0cd80ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.704+0000 7f0cde200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd815fe70 con 0x7f0cd815a910 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.704+0000 7f0cde200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd80b64f0 con 0x7f0cd815ce70 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.704+0000 7f0cde200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd815fff0 con 0x7f0cd80b1d60 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.704+0000 7f0cd7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cd815a910 0x7f0cd815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.705+0000 7f0cd7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cd815a910 0x7f0cd815e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45794/0 (socket says 172.21.15.144:45794) 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.705+0000 7f0cd7400640 1 -- 172.21.15.144:0/638866086 learned_addr learned my addr 172.21.15.144:0/638866086 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.705+0000 7f0cd7400640 1 -- 172.21.15.144:0/638866086 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd80b1d60 msgr2=0x7f0cd80ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.705+0000 7f0cd7400640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd80b1d60 0x7f0cd80ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.705+0000 7f0cd7400640 1 -- 172.21.15.144:0/638866086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd815ce70 msgr2=0x7f0cd80b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.705+0000 7f0cd7400640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd815ce70 0x7f0cd80b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.705+0000 7f0cd7400640 1 -- 172.21.15.144:0/638866086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd815bdd0 con 0x7f0cd815a910 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.705+0000 7f0cd7400640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cd815a910 0x7f0cd815e450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800db10 tx=0x7f0cc800df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.705+0000 7f0ccf400640 1 -- 172.21.15.144:0/638866086 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8019070 con 0x7f0cd815a910 2024-05-30T16:47:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.706+0000 7f0ccf400640 1 -- 172.21.15.144:0/638866086 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc8004cb0 con 0x7f0cd815a910 2024-05-30T16:47:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.706+0000 7f0ccf400640 1 -- 172.21.15.144:0/638866086 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8004e60 con 0x7f0cd815a910 2024-05-30T16:47:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.706+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd815c0b0 con 0x7f0cd815a910 2024-05-30T16:47:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.706+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd815c670 con 0x7f0cd815a910 2024-05-30T16:47:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.707+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd8068b90 con 0x7f0cd815a910 2024-05-30T16:47:25.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.708+0000 7f0ccf400640 1 -- 172.21.15.144:0/638866086 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f0cc80072d0 con 0x7f0cd815a910 2024-05-30T16:47:25.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.709+0000 7f0ccf400640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0cb806cfe0 0x7f0cb806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:25.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.709+0000 7f0ccf400640 1 -- 172.21.15.144:0/638866086 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f0cc808c400 con 0x7f0cd815a910 2024-05-30T16:47:25.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.709+0000 7f0cd6a00640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0cb806cfe0 0x7f0cb806f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:25.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.710+0000 7f0cd6a00640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0cb806cfe0 0x7f0cb806f4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0cd81f8080 tx=0x7f0cc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:25.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.714+0000 7f0ccf400640 1 -- 172.21.15.144:0/638866086 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0cc8059c80 con 0x7f0cd815a910 2024-05-30T16:47:25.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.982+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0cd815ee70 con 0x7f0cd815a910 2024-05-30T16:47:25.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.983+0000 7f0ccf400640 1 -- 172.21.15.144:0/638866086 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2077 (secure 0 0 0) 0x7f0cc8059580 con 0x7f0cd815a910 2024-05-30T16:47:25.984 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:25.984 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:47:25.984 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:47:25.984 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:47:25.984 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:47:25.984 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:47:25.984 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:25.985 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 358, 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:47:25.986 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:25.987 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4398, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 18314297959, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 37012029440, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 736082083840, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 255, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:47:25.988 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 27, 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3, 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 3, 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "a", 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5235 2024-05-30T16:47:25.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:25.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: "d2a1d40d-0ffc-4f05-a6e6-4980d0148787": { 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 9.0 seconds before exiting (40s)\n [============================] ", 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:47:25.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:25.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:25.992 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0cb806cfe0 msgr2=0x7f0cb806f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0cb806cfe0 0x7f0cb806f4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0cd81f8080 tx=0x7f0cc4009040 comp rx=0 tx=0).stop 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cd815a910 msgr2=0x7f0cd815e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cd815a910 0x7f0cd815e450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800db10 tx=0x7f0cc800df10 comp rx=0 tx=0).stop 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 shutdown_connections 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0cb806cfe0 0x7f0cb806f4a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cd80b1d60 0x7f0cd80ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd815ce70 0x7f0cd80b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 --2- 172.21.15.144:0/638866086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cd815a910 0x7f0cd815e450 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 >> 172.21.15.144:0/638866086 conn(0x7f0cd806bd00 msgr2=0x7f0cd8142b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:25.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 shutdown_connections 2024-05-30T16:47:25.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:25.986+0000 7f0cde200640 1 -- 172.21.15.144:0/638866086 wait complete. 2024-05-30T16:47:31.006 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:47:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.220+0000 7f813be00640 1 Processor -- start 2024-05-30T16:47:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.220+0000 7f813be00640 1 -- start start 2024-05-30T16:47:31.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.221+0000 7f813be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f813c0cc0b0 0x7f813c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:31.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.221+0000 7f813be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813c15da70 con 0x7f813c06b8e0 2024-05-30T16:47:31.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.221+0000 7f813be00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813c160ec0 con 0x7f813c06fcf0 2024-05-30T16:47:31.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.221+0000 7f813be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f813c0ccd20 con 0x7f813c0cc0b0 2024-05-30T16:47:31.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.222+0000 7f813aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f813c0cc0b0 0x7f813c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:31.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.222+0000 7f8133e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f813c06b8e0 0x7f813c1600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34422/0 (socket says 172.21.15.144:34422) 2024-05-30T16:47:31.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.222+0000 7f8133e00640 1 -- 172.21.15.144:0/2972131408 learned_addr learned my addr 172.21.15.144:0/2972131408 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:31.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.222+0000 7f813aa00640 1 -- 172.21.15.144:0/2972131408 >> v1:172.21.15.149:6789/0 conn(0x7f813c06fcf0 legacy=0x7f813c1607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:31.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.222+0000 7f813a000640 1 -- 172.21.15.144:0/2972131408 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013106830 0 0) 0x7f8124001110 con 0x7f813c06b8e0 2024-05-30T16:47:31.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.222+0000 7f813aa00640 1 -- 172.21.15.144:0/2972131408 >> v1:172.21.15.144:6789/0 conn(0x7f813c06b8e0 legacy=0x7f813c1600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:31.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.222+0000 7f813aa00640 1 -- 172.21.15.144:0/2972131408 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c0cd000 con 0x7f813c0cc0b0 2024-05-30T16:47:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.224+0000 7f813aa00640 1 --2- 172.21.15.144:0/2972131408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c0cc0b0 0x7f813c15d530 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f812c0097a0 tx=0x7f812c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1625a007a7ffef8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.224+0000 7f813a000640 1 -- 172.21.15.144:0/2972131408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c037070 con 0x7f813c0cc0b0 2024-05-30T16:47:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.224+0000 7f813a000640 1 -- 172.21.15.144:0/2972131408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c032440 con 0x7f813c0cc0b0 2024-05-30T16:47:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.224+0000 7f813a000640 1 -- 172.21.15.144:0/2972131408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c032810 con 0x7f813c0cc0b0 2024-05-30T16:47:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.225+0000 7f813be00640 1 -- 172.21.15.144:0/2972131408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c0cc0b0 msgr2=0x7f813c15d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.225+0000 7f813be00640 1 --2- 172.21.15.144:0/2972131408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c0cc0b0 0x7f813c15d530 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f812c0097a0 tx=0x7f812c02a1a0 comp rx=0 tx=0).stop 2024-05-30T16:47:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.225+0000 7f813be00640 1 -- 172.21.15.144:0/2972131408 shutdown_connections 2024-05-30T16:47:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.225+0000 7f813be00640 1 --2- 172.21.15.144:0/2972131408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c0cc0b0 0x7f813c15d530 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.225+0000 7f813be00640 1 -- 172.21.15.144:0/2972131408 >> 172.21.15.144:0/2972131408 conn(0x7f813c0b20a0 msgr2=0x7f813c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.225+0000 7f813be00640 1 -- 172.21.15.144:0/2972131408 shutdown_connections 2024-05-30T16:47:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.225+0000 7f813be00640 1 -- 172.21.15.144:0/2972131408 wait complete. 2024-05-30T16:47:31.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.226+0000 7f813be00640 1 Processor -- start 2024-05-30T16:47:31.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.227+0000 7f813be00640 1 -- start start 2024-05-30T16:47:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.227+0000 7f813be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c06b8e0 0x7f813c15f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.227+0000 7f813be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c06fcf0 0x7f813c14b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.227+0000 7f813be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0cc0b0 0x7f813c15de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.227+0000 7f813be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0cc9e0 con 0x7f813c06b8e0 2024-05-30T16:47:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.227+0000 7f813be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0cd5c0 con 0x7f813c0cc0b0 2024-05-30T16:47:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.227+0000 7f813be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f813c0cc490 con 0x7f813c06fcf0 2024-05-30T16:47:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f813aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c06b8e0 0x7f813c15f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f813aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c06b8e0 0x7f813c15f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45810/0 (socket says 172.21.15.144:45810) 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f813aa00640 1 -- 172.21.15.144:0/2444756391 learned_addr learned my addr 172.21.15.144:0/2444756391 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f8133e00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c06fcf0 0x7f813c14b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f813aa00640 1 -- 172.21.15.144:0/2444756391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c06fcf0 msgr2=0x7f813c14b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f813b400640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0cc0b0 0x7f813c15de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f813aa00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c06fcf0 0x7f813c14b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f813aa00640 1 -- 172.21.15.144:0/2444756391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0cc0b0 msgr2=0x7f813c15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f813aa00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0cc0b0 0x7f813c15de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.228+0000 7f813aa00640 1 -- 172.21.15.144:0/2444756391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c15e930 con 0x7f813c06b8e0 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.229+0000 7f813aa00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c06b8e0 0x7f813c15f9d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f812c000c00 tx=0x7f812c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.229+0000 7f8132a00640 1 -- 172.21.15.144:0/2444756391 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c037040 con 0x7f813c06b8e0 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.229+0000 7f8132a00640 1 -- 172.21.15.144:0/2444756391 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c042070 con 0x7f813c06b8e0 2024-05-30T16:47:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.229+0000 7f8132a00640 1 -- 172.21.15.144:0/2444756391 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c030a70 con 0x7f813c06b8e0 2024-05-30T16:47:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.229+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c15ec10 con 0x7f813c06b8e0 2024-05-30T16:47:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.229+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c15f1d0 con 0x7f813c06b8e0 2024-05-30T16:47:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.230+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c075570 con 0x7f813c06b8e0 2024-05-30T16:47:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.231+0000 7f8132a00640 1 -- 172.21.15.144:0/2444756391 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f812c030c10 con 0x7f813c06b8e0 2024-05-30T16:47:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.233+0000 7f8132a00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811806cfb0 0x7f811806f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.233+0000 7f8132a00640 1 -- 172.21.15.144:0/2444756391 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f812c0ad0e0 con 0x7f813c06b8e0 2024-05-30T16:47:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.233+0000 7f8133e00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811806cfb0 0x7f811806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.234+0000 7f8133e00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811806cfb0 0x7f811806f470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f813c15bf50 tx=0x7f8124009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.238+0000 7f8132a00640 1 -- 172.21.15.144:0/2444756391 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f812c07ac90 con 0x7f813c06b8e0 2024-05-30T16:47:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.516+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f813c0b4100 con 0x7f813c06b8e0 2024-05-30T16:47:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.517+0000 7f8132a00640 1 -- 172.21.15.144:0/2444756391 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2077 (secure 0 0 0) 0x7f812c07a590 con 0x7f813c06b8e0 2024-05-30T16:47:31.517 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:31.517 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:47:31.517 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:47:31.517 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:47:31.517 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:47:31.517 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:47:31.517 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:47:31.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 363, 2024-05-30T16:47:31.518 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:47:31.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4398, 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 18314297959, 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 37012029440, 2024-05-30T16:47:31.520 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 736082083840, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 255, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 27, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:31.521 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 3, 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "a", 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5235 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:47:31.522 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "d2a1d40d-0ffc-4f05-a6e6-4980d0148787": { 2024-05-30T16:47:31.523 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 5.0 seconds before exiting (44s)\n [============================] ", 2024-05-30T16:47:31.524 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:47:31.524 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:47:31.524 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:31.524 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:31.524 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811806cfb0 msgr2=0x7f811806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811806cfb0 0x7f811806f470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f813c15bf50 tx=0x7f8124009040 comp rx=0 tx=0).stop 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c06b8e0 msgr2=0x7f813c15f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c06b8e0 0x7f813c15f9d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f812c000c00 tx=0x7f812c0046c0 comp rx=0 tx=0).stop 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 shutdown_connections 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f811806cfb0 0x7f811806f470 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0cc0b0 0x7f813c15de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c06fcf0 0x7f813c14b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 --2- 172.21.15.144:0/2444756391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813c06b8e0 0x7f813c15f9d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 >> 172.21.15.144:0/2444756391 conn(0x7f813c0b20a0 msgr2=0x7f813c156720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 shutdown_connections 2024-05-30T16:47:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:31.519+0000 7f813be00640 1 -- 172.21.15.144:0/2444756391 wait complete. 2024-05-30T16:47:36.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:47:36.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.747+0000 7f45b7e00640 1 Processor -- start 2024-05-30T16:47:36.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.748+0000 7f45b7e00640 1 -- start start 2024-05-30T16:47:36.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.749+0000 7f45b7e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f45b806bd60 0x7f45b806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:36.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.749+0000 7f45b7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b80ccd20 con 0x7f45b806b8e0 2024-05-30T16:47:36.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.749+0000 7f45b7e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b80cd000 con 0x7f45b80cc0b0 2024-05-30T16:47:36.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.749+0000 7f45b7e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f45b80cd2e0 con 0x7f45b806bd60 2024-05-30T16:47:36.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.749+0000 7f45ae000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f45b806b8e0 0x7f45b806ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48586/0 (socket says 172.21.15.144:48586) 2024-05-30T16:47:36.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.749+0000 7f45ae000640 1 -- 172.21.15.144:0/2463702243 learned_addr learned my addr 172.21.15.144:0/2463702243 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b7400640 1 --2- 172.21.15.144:0/2463702243 >> v2:172.21.15.149:3300/0 conn(0x7f45b806bd60 0x7f45b806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291090206 0 0) 0x7f45b80ccd20 con 0x7f45b806b8e0 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f459c003520 con 0x7f45b806b8e0 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3106749759 0 0) 0x7f459c003520 con 0x7f45b806b8e0 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 >> v2:172.21.15.149:3300/0 conn(0x7f45b806bd60 msgr2=0x7f45b806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 --2- 172.21.15.144:0/2463702243 >> v2:172.21.15.149:3300/0 conn(0x7f45b806bd60 0x7f45b806f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 >> v1:172.21.15.149:6789/0 conn(0x7f45b80cc0b0 legacy=0x7f45b815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b80cd5c0 con 0x7f45b806b8e0 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f45a0001670 con 0x7f45b806b8e0 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 >> v1:172.21.15.144:6789/0 conn(0x7f45b806b8e0 legacy=0x7f45b806ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f459c003a00 0x7f459c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f459c004800 0x7f459c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f459c005210 0x7f459c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80cd2e0 con 0x7f459c004800 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f459c00c160 con 0x7f459c003a00 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.750+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f459c00c360 con 0x7f459c005210 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.751+0000 7f45ae000640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f459c004800 0x7f459c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.751+0000 7f45b6a00640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f459c003a00 0x7f459c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.751+0000 7f45ae000640 1 -- 172.21.15.144:0/2463702243 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f459c005210 msgr2=0x7f459c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.751+0000 7f45ae000640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f459c005210 0x7f459c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.751+0000 7f45ae000640 1 -- 172.21.15.144:0/2463702243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f459c003a00 msgr2=0x7f459c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.751+0000 7f45ae000640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f459c003a00 0x7f459c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.751+0000 7f45ae000640 1 -- 172.21.15.144:0/2463702243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c003520 con 0x7f459c004800 2024-05-30T16:47:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.751+0000 7f45b7400640 1 -- 172.21.15.144:0/2463702243 reap_dead start 2024-05-30T16:47:36.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.752+0000 7f45ae000640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f459c004800 0x7f459c004c80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007fd0 tx=0x7f459c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482d374d805ff589 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.752+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0007c20 con 0x7f459c004800 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.752+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a0005af0 con 0x7f459c004800 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.752+0000 7f45b6000640 1 -- 172.21.15.144:0/2463702243 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0007070 con 0x7f459c004800 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.753+0000 7f45b7e00640 1 -- 172.21.15.144:0/2463702243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f459c004800 msgr2=0x7f459c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.753+0000 7f45b7e00640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f459c004800 0x7f459c004c80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007fd0 tx=0x7f459c005830 comp rx=0 tx=0).stop 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.753+0000 7f45b7e00640 1 -- 172.21.15.144:0/2463702243 shutdown_connections 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.753+0000 7f45b7e00640 1 --2- 172.21.15.144:0/2463702243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f459c004800 0x7f459c004c80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.753+0000 7f45b7e00640 1 -- 172.21.15.144:0/2463702243 >> 172.21.15.144:0/2463702243 conn(0x7f45b80b20a0 msgr2=0x7f45b80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.753+0000 7f45b7e00640 1 -- 172.21.15.144:0/2463702243 shutdown_connections 2024-05-30T16:47:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.753+0000 7f45b7e00640 1 -- 172.21.15.144:0/2463702243 wait complete. 2024-05-30T16:47:36.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.755+0000 7f45b7e00640 1 Processor -- start 2024-05-30T16:47:36.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.755+0000 7f45b7e00640 1 -- start start 2024-05-30T16:47:36.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.756+0000 7f45b7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f459c004800 0x7f45b814b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:36.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.756+0000 7f45b7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45b80c9540 0x7f45b80c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:36.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.756+0000 7f45b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b80aee10 0x7f45b80af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:36.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.756+0000 7f45b7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80cc490 con 0x7f45b80aee10 2024-05-30T16:47:36.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.756+0000 7f45b7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80cc9e0 con 0x7f459c004800 2024-05-30T16:47:36.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.756+0000 7f45b7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45b80cdef0 con 0x7f45b80c9540 2024-05-30T16:47:36.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.756+0000 7f45b7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b80aee10 0x7f45b80af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:36.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.756+0000 7f45b7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b80aee10 0x7f45b80af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39616/0 (socket says 172.21.15.144:39616) 2024-05-30T16:47:36.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.756+0000 7f45b7400640 1 -- 172.21.15.144:0/3829037207 learned_addr learned my addr 172.21.15.144:0/3829037207 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:36.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.757+0000 7f45ae000640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45b80c9540 0x7f45b80c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:36.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.757+0000 7f45b6a00640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f459c004800 0x7f45b814b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.757+0000 7f45b7400640 1 -- 172.21.15.144:0/3829037207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45b80c9540 msgr2=0x7f45b80c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.757+0000 7f45b7400640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45b80c9540 0x7f45b80c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.757+0000 7f45b7400640 1 -- 172.21.15.144:0/3829037207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f459c004800 msgr2=0x7f45b814b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.757+0000 7f45b7400640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f459c004800 0x7f45b814b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.757+0000 7f45b7400640 1 -- 172.21.15.144:0/3829037207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b80ce1d0 con 0x7f45b80aee10 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.757+0000 7f45b7400640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b80aee10 0x7f45b80af290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f45b80ca7d0 tx=0x7f45b000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.757+0000 7f45af400640 1 -- 172.21.15.144:0/3829037207 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b000bcb0 con 0x7f45b80aee10 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.758+0000 7f45af400640 1 -- 172.21.15.144:0/3829037207 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b001a070 con 0x7f45b80aee10 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.758+0000 7f45af400640 1 -- 172.21.15.144:0/3829037207 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0014640 con 0x7f45b80aee10 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.758+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b80ce4b0 con 0x7f45b80aee10 2024-05-30T16:47:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.758+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b80cea70 con 0x7f45b80aee10 2024-05-30T16:47:36.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.759+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b80c9f00 con 0x7f45b80aee10 2024-05-30T16:47:36.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.760+0000 7f45af400640 1 -- 172.21.15.144:0/3829037207 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f45b0013070 con 0x7f45b80aee10 2024-05-30T16:47:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.761+0000 7f45af400640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f459406cfe0 0x7f459406f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.761+0000 7f45af400640 1 -- 172.21.15.144:0/3829037207 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f45b008c9e0 con 0x7f45b80aee10 2024-05-30T16:47:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.761+0000 7f45b6a00640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f459406cfe0 0x7f459406f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:36.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.762+0000 7f45b6a00640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f459406cfe0 0x7f459406f4a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f45a8005490 tx=0x7f45a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:36.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:36.766+0000 7f45af400640 1 -- 172.21.15.144:0/3829037207 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45b005a480 con 0x7f45b80aee10 2024-05-30T16:47:37.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.040+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f45b8075570 con 0x7f45b80aee10 2024-05-30T16:47:37.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.041+0000 7f45af400640 1 -- 172.21.15.144:0/3829037207 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1730 (secure 0 0 0) 0x7f45b0059d80 con 0x7f45b80aee10 2024-05-30T16:47:37.041 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:37.041 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:47:37.041 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:47:37.041 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:47:37.041 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:47:37.041 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:47:37.041 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 369, 2024-05-30T16:47:37.042 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:47:37.043 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4398, 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 18314297959, 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 37012029440, 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 736082083840, 2024-05-30T16:47:37.044 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 27, 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3, 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 3, 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "a", 2024-05-30T16:47:37.045 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5235 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:47:37.046 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:47:37.047 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:37.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.047 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:47:37.047 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:47:37.047 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:47:37.047 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:47:37.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.047 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": {} 2024-05-30T16:47:37.047 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:47:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f459406cfe0 msgr2=0x7f459406f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f459406cfe0 0x7f459406f4a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f45a8005490 tx=0x7f45a8009040 comp rx=0 tx=0).stop 2024-05-30T16:47:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b80aee10 msgr2=0x7f45b80af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b80aee10 0x7f45b80af290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f45b80ca7d0 tx=0x7f45b000b480 comp rx=0 tx=0).stop 2024-05-30T16:47:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 shutdown_connections 2024-05-30T16:47:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f459406cfe0 0x7f459406f4a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b80aee10 0x7f45b80af290 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45b80c9540 0x7f45b80c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 --2- 172.21.15.144:0/3829037207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f459c004800 0x7f45b814b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 >> 172.21.15.144:0/3829037207 conn(0x7f45b80b20a0 msgr2=0x7f45b815b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.043+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 shutdown_connections 2024-05-30T16:47:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.044+0000 7f45b7e00640 1 -- 172.21.15.144:0/3829037207 wait complete. 2024-05-30T16:47:37.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T16:47:37.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.265+0000 7f29c6800640 1 Processor -- start 2024-05-30T16:47:37.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.265+0000 7f29c6800640 1 -- start start 2024-05-30T16:47:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.266+0000 7f29c6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c00cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.266+0000 7f29c6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f29c006f7d0 0x7f29c00cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.266+0000 7f29c6800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c006e3f0 con 0x7f29c006c3d0 2024-05-30T16:47:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.267+0000 7f29c6800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f29c006e110 con 0x7f29c006f7d0 2024-05-30T16:47:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.267+0000 7f29c6800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29c00cd6c0 con 0x7f29c015eaa0 2024-05-30T16:47:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.267+0000 7f29c5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f29c006c3d0 0x7f29c015f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48602/0 (socket says 172.21.15.144:48602) 2024-05-30T16:47:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.267+0000 7f29c5e00640 1 -- 172.21.15.144:0/2640011684 learned_addr learned my addr 172.21.15.144:0/2640011684 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.267+0000 7f29c4a00640 1 --2- 172.21.15.144:0/2640011684 >> v2:172.21.15.144:3300/0 conn(0x7f29c006f7d0 0x7f29c00cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.267+0000 7f29c5400640 1 --2- 172.21.15.144:0/2640011684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c00cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.267+0000 7f29bfe00640 1 -- 172.21.15.144:0/2640011684 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113475303 0 0) 0x7f29c006e3f0 con 0x7f29c006c3d0 2024-05-30T16:47:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.267+0000 7f29bfe00640 1 -- 172.21.15.144:0/2640011684 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a8003520 con 0x7f29c006c3d0 2024-05-30T16:47:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.268+0000 7f29c4a00640 1 -- 172.21.15.144:0/2640011684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 msgr2=0x7f29c00cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:37.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.268+0000 7f29c4a00640 1 --2- 172.21.15.144:0/2640011684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c00cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.268+0000 7f29c4a00640 1 -- 172.21.15.144:0/2640011684 >> v1:172.21.15.144:6789/0 conn(0x7f29c006c3d0 legacy=0x7f29c015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.268+0000 7f29c4a00640 1 -- 172.21.15.144:0/2640011684 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c00cd9a0 con 0x7f29c006f7d0 2024-05-30T16:47:37.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.268+0000 7f29c5400640 1 --2- 172.21.15.144:0/2640011684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c00cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:47:37.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.269+0000 7f29c4a00640 1 --2- 172.21.15.144:0/2640011684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 0x7f29c00cf890 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0097a0 tx=0x7f29ac02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31523a5d55da8fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:37.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.269+0000 7f29bfe00640 1 -- 172.21.15.144:0/2640011684 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac037070 con 0x7f29c006f7d0 2024-05-30T16:47:37.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.269+0000 7f29bfe00640 1 -- 172.21.15.144:0/2640011684 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac02ae50 con 0x7f29c006f7d0 2024-05-30T16:47:37.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.269+0000 7f29bfe00640 1 -- 172.21.15.144:0/2640011684 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac032660 con 0x7f29c006f7d0 2024-05-30T16:47:37.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.270+0000 7f29c6800640 1 -- 172.21.15.144:0/2640011684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 msgr2=0x7f29c00cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.270+0000 7f29c6800640 1 --2- 172.21.15.144:0/2640011684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 0x7f29c00cf890 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0097a0 tx=0x7f29ac02a100 comp rx=0 tx=0).stop 2024-05-30T16:47:37.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.270+0000 7f29c6800640 1 -- 172.21.15.144:0/2640011684 shutdown_connections 2024-05-30T16:47:37.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.270+0000 7f29c6800640 1 --2- 172.21.15.144:0/2640011684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 0x7f29c00cf890 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.270+0000 7f29c6800640 1 --2- 172.21.15.144:0/2640011684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c00cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.270+0000 7f29c6800640 1 -- 172.21.15.144:0/2640011684 >> 172.21.15.144:0/2640011684 conn(0x7f29c006b8e0 msgr2=0x7f29c006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:37.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.270+0000 7f29c6800640 1 -- 172.21.15.144:0/2640011684 shutdown_connections 2024-05-30T16:47:37.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.270+0000 7f29c6800640 1 -- 172.21.15.144:0/2640011684 wait complete. 2024-05-30T16:47:37.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.271+0000 7f29c6800640 1 Processor -- start 2024-05-30T16:47:37.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.272+0000 7f29c6800640 1 -- start start 2024-05-30T16:47:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.272+0000 7f29c6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c006c3d0 0x7f29c014c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.272+0000 7f29c6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 0x7f29c00b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.272+0000 7f29c6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c0142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.272+0000 7f29c6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f29c006dd30 con 0x7f29c006f7d0 2024-05-30T16:47:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.272+0000 7f29c6800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29c015ee80 con 0x7f29c006c3d0 2024-05-30T16:47:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.272+0000 7f29c6800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29c006deb0 con 0x7f29c015eaa0 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 0x7f29c00b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 0x7f29c00b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39628/0 (socket says 172.21.15.144:39628) 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c4a00640 1 -- 172.21.15.144:0/1762345943 learned_addr learned my addr 172.21.15.144:0/1762345943 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c5e00640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c0142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c5400640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c006c3d0 0x7f29c014c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c4a00640 1 -- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 msgr2=0x7f29c0142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c4a00640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c0142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c4a00640 1 -- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c006c3d0 msgr2=0x7f29c014c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c4a00640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c006c3d0 0x7f29c014c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c4a00640 1 -- 172.21.15.144:0/1762345943 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c01f2c40 con 0x7f29c006f7d0 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c5400640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c006c3d0 0x7f29c014c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.273+0000 7f29c5e00640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c0142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.274+0000 7f29c4a00640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 0x7f29c00b35a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0098c0 tx=0x7f29ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.274+0000 7f29bd600640 1 -- 172.21.15.144:0/1762345943 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac042020 con 0x7f29c006f7d0 2024-05-30T16:47:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.274+0000 7f29bd600640 1 -- 172.21.15.144:0/1762345943 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac03d470 con 0x7f29c006f7d0 2024-05-30T16:47:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.274+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c01f2f20 con 0x7f29c006f7d0 2024-05-30T16:47:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.274+0000 7f29bd600640 1 -- 172.21.15.144:0/1762345943 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac037040 con 0x7f29c006f7d0 2024-05-30T16:47:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.274+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c01f34e0 con 0x7f29c006f7d0 2024-05-30T16:47:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.275+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c00632f0 con 0x7f29c006f7d0 2024-05-30T16:47:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.276+0000 7f29bd600640 1 -- 172.21.15.144:0/1762345943 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f29ac045020 con 0x7f29c006f7d0 2024-05-30T16:47:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.277+0000 7f29bd600640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29a006cfb0 0x7f29a006f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.277+0000 7f29bd600640 1 -- 172.21.15.144:0/1762345943 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f29ac0acda0 con 0x7f29c006f7d0 2024-05-30T16:47:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.277+0000 7f29c5400640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29a006cfb0 0x7f29a006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.278+0000 7f29c5400640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29a006cfb0 0x7f29a006f470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f29b4006fd0 tx=0x7f29b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:37.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.282+0000 7f29bd600640 1 -- 172.21.15.144:0/1762345943 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f29ac04c070 con 0x7f29c006f7d0 2024-05-30T16:47:37.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.512+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29c0072ec0 con 0x7f29a006cfb0 2024-05-30T16:47:37.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.523+0000 7f29bd600640 1 -- 172.21.15.144:0/1762345943 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+234 (secure 0 0 0) 0x7f29c0072ec0 con 0x7f29a006cfb0 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sv1" 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone79573" 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone79571" 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone79572" 2024-05-30T16:47:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone79574" 2024-05-30T16:47:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:37.525 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:47:37.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29a006cfb0 msgr2=0x7f29a006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29a006cfb0 0x7f29a006f470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f29b4006fd0 tx=0x7f29b4008040 comp rx=0 tx=0).stop 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 msgr2=0x7f29c00b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 0x7f29c00b35a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0098c0 tx=0x7f29ac0046c0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 shutdown_connections 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f29a006cfb0 0x7f29a006f470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c015eaa0 0x7f29c0142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29c006f7d0 0x7f29c00b35a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 --2- 172.21.15.144:0/1762345943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c006c3d0 0x7f29c014c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 >> 172.21.15.144:0/1762345943 conn(0x7f29c006b8e0 msgr2=0x7f29c00cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 shutdown_connections 2024-05-30T16:47:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.526+0000 7f29c6800640 1 -- 172.21.15.144:0/1762345943 wait complete. 2024-05-30T16:47:37.546 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T16:47:37.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.746+0000 7f73b3600640 1 Processor -- start 2024-05-30T16:47:37.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.747+0000 7f73b3600640 1 -- start start 2024-05-30T16:47:37.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.748+0000 7f73b3600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f73ac15ea90 0x7f73ac0ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.748+0000 7f73b3600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73ac0b6300 0x7f73ac0b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.748+0000 7f73b3600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac0b91c0 con 0x7f73ac0d2b60 2024-05-30T16:47:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.748+0000 7f73b3600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0b9dd0 con 0x7f73ac0b6300 2024-05-30T16:47:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.748+0000 7f73b3600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0b94a0 con 0x7f73ac15ea90 2024-05-30T16:47:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.748+0000 7f73a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73ac0b6300 0x7f73ac0b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.748+0000 7f73b1600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f73ac0d2b60 0x7f73ac0d2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48618/0 (socket says 172.21.15.144:48618) 2024-05-30T16:47:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.748+0000 7f73b1600640 1 -- 172.21.15.144:0/2902664683 learned_addr learned my addr 172.21.15.144:0/2902664683 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.748+0000 7f73a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73ac0b6300 0x7f73ac0b67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39632/0 (socket says 172.21.15.144:39632) 2024-05-30T16:47:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.749+0000 7f73b0c00640 1 --2- 172.21.15.144:0/2902664683 >> v2:172.21.15.149:3300/0 conn(0x7f73ac15ea90 0x7f73ac0ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.749+0000 7f73a3e00640 1 -- 172.21.15.144:0/2902664683 >> v2:172.21.15.149:3300/0 conn(0x7f73ac15ea90 msgr2=0x7f73ac0ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:37.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.749+0000 7f73a3e00640 1 --2- 172.21.15.144:0/2902664683 >> v2:172.21.15.149:3300/0 conn(0x7f73ac15ea90 0x7f73ac0ba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.749+0000 7f73a3e00640 1 -- 172.21.15.144:0/2902664683 >> v1:172.21.15.144:6789/0 conn(0x7f73ac0d2b60 legacy=0x7f73ac0d2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.749+0000 7f73a3e00640 1 -- 172.21.15.144:0/2902664683 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0b9780 con 0x7f73ac0b6300 2024-05-30T16:47:37.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.749+0000 7f73abe00640 1 -- 172.21.15.144:0/2902664683 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104155082 0 0) 0x7f73ac0b91c0 con 0x7f73ac0d2b60 2024-05-30T16:47:37.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.750+0000 7f73a3e00640 1 --2- 172.21.15.144:0/2902664683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac0b6300 0x7f73ac0b67b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0d2110 tx=0x7f739c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6988b23af4b96a8d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:37.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.750+0000 7f73abe00640 1 -- 172.21.15.144:0/2902664683 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c037070 con 0x7f73ac0b6300 2024-05-30T16:47:37.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.750+0000 7f73abe00640 1 -- 172.21.15.144:0/2902664683 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c032440 con 0x7f73ac0b6300 2024-05-30T16:47:37.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.750+0000 7f73abe00640 1 -- 172.21.15.144:0/2902664683 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c032810 con 0x7f73ac0b6300 2024-05-30T16:47:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.751+0000 7f73b3600640 1 -- 172.21.15.144:0/2902664683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac0b6300 msgr2=0x7f73ac0b67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.751+0000 7f73b3600640 1 --2- 172.21.15.144:0/2902664683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac0b6300 0x7f73ac0b67b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0d2110 tx=0x7f739c02a1a0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.751+0000 7f73b3600640 1 -- 172.21.15.144:0/2902664683 shutdown_connections 2024-05-30T16:47:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.751+0000 7f73b3600640 1 --2- 172.21.15.144:0/2902664683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac0b6300 0x7f73ac0b67b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.751+0000 7f73b3600640 1 --2- 172.21.15.144:0/2902664683 >> v2:172.21.15.149:3300/0 conn(0x7f73ac15ea90 0x7f73ac0ba330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.751+0000 7f73b3600640 1 -- 172.21.15.144:0/2902664683 >> 172.21.15.144:0/2902664683 conn(0x7f73ac0627b0 msgr2=0x7f73ac062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.751+0000 7f73b3600640 1 -- 172.21.15.144:0/2902664683 shutdown_connections 2024-05-30T16:47:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.751+0000 7f73b3600640 1 -- 172.21.15.144:0/2902664683 wait complete. 2024-05-30T16:47:37.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.753+0000 7f73b3600640 1 Processor -- start 2024-05-30T16:47:37.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.753+0000 7f73b3600640 1 -- start start 2024-05-30T16:47:37.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.754+0000 7f73b3600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac0b6300 0x7f73ac15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.754+0000 7f73b3600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73ac0d2b60 0x7f73ac157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.754+0000 7f73b3600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac15ea90 0x7f73ac0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.754+0000 7f73b3600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0b89c0 con 0x7f73ac15ea90 2024-05-30T16:47:37.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.754+0000 7f73b3600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac15ee70 con 0x7f73ac0b6300 2024-05-30T16:47:37.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.754+0000 7f73b3600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac0b8b40 con 0x7f73ac0d2b60 2024-05-30T16:47:37.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.754+0000 7f73b1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac15ea90 0x7f73ac0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.754+0000 7f73b1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac15ea90 0x7f73ac0c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39648/0 (socket says 172.21.15.144:39648) 2024-05-30T16:47:37.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.754+0000 7f73b1600640 1 -- 172.21.15.144:0/1478068236 learned_addr learned my addr 172.21.15.144:0/1478068236 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73b0c00640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac0b6300 0x7f73ac15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73a3e00640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73ac0d2b60 0x7f73ac157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73b1600640 1 -- 172.21.15.144:0/1478068236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73ac0d2b60 msgr2=0x7f73ac157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73b1600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73ac0d2b60 0x7f73ac157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73b1600640 1 -- 172.21.15.144:0/1478068236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac0b6300 msgr2=0x7f73ac15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73b1600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac0b6300 0x7f73ac15c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73b1600640 1 -- 172.21.15.144:0/1478068236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac156aa0 con 0x7f73ac15ea90 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73b1600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac15ea90 0x7f73ac0c9410 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f73a400c7a0 tx=0x7f73a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73a9600640 1 -- 172.21.15.144:0/1478068236 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4018070 con 0x7f73ac15ea90 2024-05-30T16:47:37.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73a9600640 1 -- 172.21.15.144:0/1478068236 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a400a640 con 0x7f73ac15ea90 2024-05-30T16:47:37.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73a9600640 1 -- 172.21.15.144:0/1478068236 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a400aa70 con 0x7f73ac15ea90 2024-05-30T16:47:37.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac156d80 con 0x7f73ac15ea90 2024-05-30T16:47:37.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.755+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac15cd20 con 0x7f73ac15ea90 2024-05-30T16:47:37.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.757+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac15cef0 con 0x7f73ac15ea90 2024-05-30T16:47:37.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.758+0000 7f73a9600640 1 -- 172.21.15.144:0/1478068236 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f73a400ac10 con 0x7f73ac15ea90 2024-05-30T16:47:37.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.758+0000 7f73a9600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f738806cfb0 0x7f738806f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:37.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.759+0000 7f73a9600640 1 -- 172.21.15.144:0/1478068236 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f73a408bea0 con 0x7f73ac15ea90 2024-05-30T16:47:37.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.759+0000 7f73b0c00640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f738806cfb0 0x7f738806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:37.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.759+0000 7f73b0c00640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f738806cfb0 0x7f738806f470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7394006fd0 tx=0x7f7394008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:37.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.763+0000 7f73a9600640 1 -- 172.21.15.144:0/1478068236 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f73ac15cef0 con 0x7f73ac15ea90 2024-05-30T16:47:37.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:37.997+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73ac068b90 con 0x7f738806cfb0 2024-05-30T16:47:38.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.011+0000 7f73a9600640 1 -- 172.21.15.144:0/1478068236 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f73ac068b90 con 0x7f738806cfb0 2024-05-30T16:47:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:47:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ss1" 2024-05-30T16:47:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:47:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f738806cfb0 msgr2=0x7f738806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f738806cfb0 0x7f738806f470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7394006fd0 tx=0x7f7394008040 comp rx=0 tx=0).stop 2024-05-30T16:47:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac15ea90 msgr2=0x7f73ac0c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac15ea90 0x7f73ac0c9410 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f73a400c7a0 tx=0x7f73a400cc60 comp rx=0 tx=0).stop 2024-05-30T16:47:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 shutdown_connections 2024-05-30T16:47:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f738806cfb0 0x7f738806f470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73ac15ea90 0x7f73ac0c9410 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73ac0d2b60 0x7f73ac157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 --2- 172.21.15.144:0/1478068236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac0b6300 0x7f73ac15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 >> 172.21.15.144:0/1478068236 conn(0x7f73ac0627b0 msgr2=0x7f73ac0d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 shutdown_connections 2024-05-30T16:47:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.014+0000 7f73b3600640 1 -- 172.21.15.144:0/1478068236 wait complete. 2024-05-30T16:47:38.034 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T16:47:38.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.235+0000 7fcd12600640 1 Processor -- start 2024-05-30T16:47:38.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.235+0000 7fcd12600640 1 -- start start 2024-05-30T16:47:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.236+0000 7fcd12600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0c0cd780 0x7fcd0c06ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.236+0000 7fcd12600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd0c0cdb60 0x7fcd0c06f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.236+0000 7fcd12600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd0c15bbc0 0x7fcd0c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.236+0000 7fcd12600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0c0d01e0 con 0x7fcd0c0cdb60 2024-05-30T16:47:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.236+0000 7fcd12600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0c0b3a70 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.236+0000 7fcd12600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0c15c8f0 con 0x7fcd0c0cd780 2024-05-30T16:47:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.237+0000 7fcd0be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd0c0cdb60 0x7fcd0c06f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.237+0000 7fcd0be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd0c0cdb60 0x7fcd0c06f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39652/0 (socket says 172.21.15.144:39652) 2024-05-30T16:47:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.237+0000 7fcd0be00640 1 -- 172.21.15.144:0/1913961245 learned_addr learned my addr 172.21.15.144:0/1913961245 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:38.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.237+0000 7fcd0be00640 1 -- 172.21.15.144:0/1913961245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0c0cd780 msgr2=0x7fcd0c06ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.237+0000 7fcd0be00640 1 --2- 172.21.15.144:0/1913961245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0c0cd780 0x7fcd0c06ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.237+0000 7fcd0be00640 1 -- 172.21.15.144:0/1913961245 >> v2:172.21.15.149:3300/0 conn(0x7fcd0c15bbc0 msgr2=0x7fcd0c15c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.237+0000 7fcd0be00640 1 --2- 172.21.15.144:0/1913961245 >> v2:172.21.15.149:3300/0 conn(0x7fcd0c15bbc0 0x7fcd0c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.237+0000 7fcd0be00640 1 -- 172.21.15.144:0/1913961245 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c0cf420 con 0x7fcd0c0cdb60 2024-05-30T16:47:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.238+0000 7fcd0be00640 1 --2- 172.21.15.144:0/1913961245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c0cdb60 0x7fcd0c06f3d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0b5900 tx=0x7fccf802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe9fe9db6f03f20 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.238+0000 7fcd0b400640 1 -- 172.21.15.144:0/1913961245 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf8037070 con 0x7fcd0c0cdb60 2024-05-30T16:47:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.238+0000 7fcd0b400640 1 -- 172.21.15.144:0/1913961245 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf8032440 con 0x7fcd0c0cdb60 2024-05-30T16:47:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.238+0000 7fcd0b400640 1 -- 172.21.15.144:0/1913961245 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf8032810 con 0x7fcd0c0cdb60 2024-05-30T16:47:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.239+0000 7fcd12600640 1 -- 172.21.15.144:0/1913961245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c0cdb60 msgr2=0x7fcd0c06f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.239+0000 7fcd12600640 1 --2- 172.21.15.144:0/1913961245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c0cdb60 0x7fcd0c06f3d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0b5900 tx=0x7fccf802a1e0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.239+0000 7fcd12600640 1 -- 172.21.15.144:0/1913961245 shutdown_connections 2024-05-30T16:47:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.239+0000 7fcd12600640 1 --2- 172.21.15.144:0/1913961245 >> v2:172.21.15.149:3300/0 conn(0x7fcd0c15bbc0 0x7fcd0c15c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.239+0000 7fcd12600640 1 --2- 172.21.15.144:0/1913961245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c0cdb60 0x7fcd0c06f3d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.239+0000 7fcd12600640 1 --2- 172.21.15.144:0/1913961245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0c0cd780 0x7fcd0c06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.239+0000 7fcd12600640 1 -- 172.21.15.144:0/1913961245 >> 172.21.15.144:0/1913961245 conn(0x7fcd0c0b2160 msgr2=0x7fcd0c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.239+0000 7fcd12600640 1 -- 172.21.15.144:0/1913961245 shutdown_connections 2024-05-30T16:47:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.239+0000 7fcd12600640 1 -- 172.21.15.144:0/1913961245 wait complete. 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.241+0000 7fcd12600640 1 Processor -- start 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.241+0000 7fcd12600640 1 -- start start 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd12600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0c0cd780 0x7fcd0c0aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd12600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0c0cdb60 0x7fcd0c0ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd12600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c15bbc0 0x7fcd0c0ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd12600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c0cfcc0 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd12600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c0cf9e0 con 0x7fcd0c0cd780 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd12600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0c15c560 con 0x7fcd0c0cdb60 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd11c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c15bbc0 0x7fcd0c0ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd11c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c15bbc0 0x7fcd0c0ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39660/0 (socket says 172.21.15.144:39660) 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd11c00640 1 -- 172.21.15.144:0/4181304223 learned_addr learned my addr 172.21.15.144:0/4181304223 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.242+0000 7fcd0be00640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0c0cdb60 0x7fcd0c0ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd11200640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0c0cd780 0x7fcd0c0aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd11c00640 1 -- 172.21.15.144:0/4181304223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0c0cdb60 msgr2=0x7fcd0c0ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd11c00640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0c0cdb60 0x7fcd0c0ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd11c00640 1 -- 172.21.15.144:0/4181304223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0c0cd780 msgr2=0x7fcd0c0aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd11c00640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0c0cd780 0x7fcd0c0aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd11c00640 1 -- 172.21.15.144:0/4181304223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c152390 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd11200640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0c0cd780 0x7fcd0c0aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd11c00640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c15bbc0 0x7fcd0c0ae910 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400b970 tx=0x7fcd0400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:38.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd08c00640 1 -- 172.21.15.144:0/4181304223 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04019070 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd08c00640 1 -- 172.21.15.144:0/4181304223 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0400cb60 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd08c00640 1 -- 172.21.15.144:0/4181304223 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04014440 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0c0aef90 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.243+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0c152ed0 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.244+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd0c0b4f70 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.245+0000 7fcd08c00640 1 -- 172.21.15.144:0/4181304223 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7fcd0401c070 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.246+0000 7fcd08c00640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fccec06cfb0 0x7fccec06f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.246+0000 7fcd08c00640 1 -- 172.21.15.144:0/4181304223 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fcd0408c430 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.247+0000 7fcd11200640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fccec06cfb0 0x7fccec06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.247+0000 7fcd11200640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fccec06cfb0 0x7fccec06f470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcd00006fd0 tx=0x7fcd00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:38.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.251+0000 7fcd08c00640 1 -- 172.21.15.144:0/4181304223 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcd0c0b4f70 con 0x7fcd0c15bbc0 2024-05-30T16:47:38.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.485+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd0c075570 con 0x7fccec06cfb0 2024-05-30T16:47:38.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.532+0000 7fcd08c00640 1 -- 172.21.15.144:0/4181304223 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcd0c075570 con 0x7fccec06cfb0 2024-05-30T16:47:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fccec06cfb0 msgr2=0x7fccec06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fccec06cfb0 0x7fccec06f470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcd00006fd0 tx=0x7fcd00008040 comp rx=0 tx=0).stop 2024-05-30T16:47:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c15bbc0 msgr2=0x7fcd0c0ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c15bbc0 0x7fcd0c0ae910 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400b970 tx=0x7fcd0400be30 comp rx=0 tx=0).stop 2024-05-30T16:47:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 shutdown_connections 2024-05-30T16:47:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fccec06cfb0 0x7fccec06f470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0c15bbc0 0x7fcd0c0ae910 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0c0cdb60 0x7fcd0c0ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 --2- 172.21.15.144:0/4181304223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0c0cd780 0x7fcd0c0aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.535+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 >> 172.21.15.144:0/4181304223 conn(0x7fcd0c0b2160 msgr2=0x7fcd0c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:38.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.536+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 shutdown_connections 2024-05-30T16:47:38.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.536+0000 7fcd12600640 1 -- 172.21.15.144:0/4181304223 wait complete. 2024-05-30T16:47:38.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T16:47:38.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.744+0000 7f3665c00640 1 Processor -- start 2024-05-30T16:47:38.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.744+0000 7f3665c00640 1 -- start start 2024-05-30T16:47:38.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.745+0000 7f3665c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3660145f10 0x7f36600cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.745+0000 7f3665c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660160990 0x7f366006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.746+0000 7f3665c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36600cd3e0 con 0x7f366006c3d0 2024-05-30T16:47:38.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.746+0000 7f3665c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f366006c840 con 0x7f3660145f10 2024-05-30T16:47:38.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.746+0000 7f3665c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3660161100 con 0x7f3660160990 2024-05-30T16:47:38.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.746+0000 7f365fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3660145f10 0x7f36600cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.746+0000 7f3665200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660160990 0x7f366006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.746+0000 7f3665200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660160990 0x7f366006dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:55990/0 (socket says 172.21.15.144:55990) 2024-05-30T16:47:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.746+0000 7f3665200640 1 -- 172.21.15.144:0/2464364991 learned_addr learned my addr 172.21.15.144:0/2464364991 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.747+0000 7f3665200640 1 -- 172.21.15.144:0/2464364991 >> v2:172.21.15.149:3300/0 conn(0x7f3660145f10 msgr2=0x7f36600cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.747+0000 7f3665200640 1 --2- 172.21.15.144:0/2464364991 >> v2:172.21.15.149:3300/0 conn(0x7f3660145f10 0x7f36600cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.747+0000 7f3665200640 1 -- 172.21.15.144:0/2464364991 >> v1:172.21.15.149:6789/0 conn(0x7f366006c3d0 legacy=0x7f3660160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.747+0000 7f3665200640 1 -- 172.21.15.144:0/2464364991 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36600cd6c0 con 0x7f3660160990 2024-05-30T16:47:38.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.749+0000 7f3665200640 1 --2- 172.21.15.144:0/2464364991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660160990 0x7f366006dd30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3658009e50 tx=0x7f365802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50f6f678478441fb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:38.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.749+0000 7f365f400640 1 -- 172.21.15.144:0/2464364991 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658036070 con 0x7f3660160990 2024-05-30T16:47:38.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.749+0000 7f365f400640 1 -- 172.21.15.144:0/2464364991 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3658031600 con 0x7f3660160990 2024-05-30T16:47:38.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.749+0000 7f365f400640 1 -- 172.21.15.144:0/2464364991 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36580319d0 con 0x7f3660160990 2024-05-30T16:47:38.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.750+0000 7f3665c00640 1 -- 172.21.15.144:0/2464364991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660160990 msgr2=0x7f366006dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.750+0000 7f3665c00640 1 --2- 172.21.15.144:0/2464364991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660160990 0x7f366006dd30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3658009e50 tx=0x7f365802a710 comp rx=0 tx=0).stop 2024-05-30T16:47:38.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.750+0000 7f3665c00640 1 -- 172.21.15.144:0/2464364991 shutdown_connections 2024-05-30T16:47:38.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.750+0000 7f3665c00640 1 --2- 172.21.15.144:0/2464364991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660160990 0x7f366006dd30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.750+0000 7f3665c00640 1 --2- 172.21.15.144:0/2464364991 >> v2:172.21.15.149:3300/0 conn(0x7f3660145f10 0x7f36600cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.750+0000 7f3665c00640 1 -- 172.21.15.144:0/2464364991 >> 172.21.15.144:0/2464364991 conn(0x7f366006b8e0 msgr2=0x7f366006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:38.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.750+0000 7f3665c00640 1 -- 172.21.15.144:0/2464364991 shutdown_connections 2024-05-30T16:47:38.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.750+0000 7f3665c00640 1 -- 172.21.15.144:0/2464364991 wait complete. 2024-05-30T16:47:38.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.751+0000 7f3665c00640 1 Processor -- start 2024-05-30T16:47:38.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.752+0000 7f3665c00640 1 -- start start 2024-05-30T16:47:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.752+0000 7f3665c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f366006c3d0 0x7f36600b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.752+0000 7f3665c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660145f10 0x7f366013ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.752+0000 7f3665c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3660160990 0x7f366013f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.752+0000 7f3665c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36600cdf60 con 0x7f3660160990 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.752+0000 7f3665c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36600cdc80 con 0x7f366006c3d0 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.752+0000 7f3665c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f36601462f0 con 0x7f3660145f10 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3665200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3660160990 0x7f366013f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3665200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3660160990 0x7f366013f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39670/0 (socket says 172.21.15.144:39670) 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3665200640 1 -- 172.21.15.144:0/3691645973 learned_addr learned my addr 172.21.15.144:0/3691645973 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f365fe00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f366006c3d0 0x7f36600b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3657e00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660145f10 0x7f366013ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3665200640 1 -- 172.21.15.144:0/3691645973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660145f10 msgr2=0x7f366013ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3665200640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660145f10 0x7f366013ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3665200640 1 -- 172.21.15.144:0/3691645973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f366006c3d0 msgr2=0x7f36600b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3665200640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f366006c3d0 0x7f36600b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3665200640 1 -- 172.21.15.144:0/3691645973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36600b5030 con 0x7f3660160990 2024-05-30T16:47:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.753+0000 7f3665200640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3660160990 0x7f366013f160 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f365802ad00 tx=0x7f3658004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:38.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.754+0000 7f365cc00640 1 -- 172.21.15.144:0/3691645973 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658041030 con 0x7f3660160990 2024-05-30T16:47:38.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.754+0000 7f365cc00640 1 -- 172.21.15.144:0/3691645973 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3658031400 con 0x7f3660160990 2024-05-30T16:47:38.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.754+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36600b5310 con 0x7f3660160990 2024-05-30T16:47:38.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.754+0000 7f365cc00640 1 -- 172.21.15.144:0/3691645973 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658036040 con 0x7f3660160990 2024-05-30T16:47:38.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.754+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36600aded0 con 0x7f3660160990 2024-05-30T16:47:38.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.755+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36600632f0 con 0x7f3660160990 2024-05-30T16:47:38.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.756+0000 7f365cc00640 1 -- 172.21.15.144:0/3691645973 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f3658044070 con 0x7f3660160990 2024-05-30T16:47:38.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.757+0000 7f365cc00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f363c06cfb0 0x7f363c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:38.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.757+0000 7f365cc00640 1 -- 172.21.15.144:0/3691645973 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f36580ad1d0 con 0x7f3660160990 2024-05-30T16:47:38.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.757+0000 7f365fe00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f363c06cfb0 0x7f363c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:38.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.758+0000 7f365fe00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f363c06cfb0 0x7f363c06f470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f366006fb20 tx=0x7f3650008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:38.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.761+0000 7f365cc00640 1 -- 172.21.15.144:0/3691645973 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f365807ab20 con 0x7f3660160990 2024-05-30T16:47:38.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:38.974+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f3660075570 con 0x7f363c06cfb0 2024-05-30T16:47:39.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.003+0000 7f365cc00640 1 -- 172.21.15.144:0/3691645973 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3660075570 con 0x7f363c06cfb0 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f363c06cfb0 msgr2=0x7f363c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f363c06cfb0 0x7f363c06f470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f366006fb20 tx=0x7f3650008040 comp rx=0 tx=0).stop 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3660160990 msgr2=0x7f366013f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3660160990 0x7f366013f160 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f365802ad00 tx=0x7f3658004a40 comp rx=0 tx=0).stop 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 shutdown_connections 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f363c06cfb0 0x7f363c06f470 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3660160990 0x7f366013f160 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3660145f10 0x7f366013ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 --2- 172.21.15.144:0/3691645973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f366006c3d0 0x7f36600b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 >> 172.21.15.144:0/3691645973 conn(0x7f366006b8e0 msgr2=0x7f36601443c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 shutdown_connections 2024-05-30T16:47:39.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.006+0000 7f3665c00640 1 -- 172.21.15.144:0/3691645973 wait complete. 2024-05-30T16:47:39.010 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.009+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.010 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.009+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.010 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.009+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.010 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.009+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.011 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.009+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone79573 2024-05-30T16:47:39.032 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.029+0000 7fe1cce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.032 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.029+0000 7fe1cce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.032 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.029+0000 7fe1cce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.032 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.029+0000 7fe1cce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.032 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:47:39.029+0000 7fe1cce00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:47:39.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.205+0000 7f49b5200640 1 Processor -- start 2024-05-30T16:47:39.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.205+0000 7f49b5200640 1 -- start start 2024-05-30T16:47:39.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49b5200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b00b51e0 0x7f49b00af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49b5200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49b0072470 0x7f49b006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49b5200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49b00b40e0 con 0x7f49b00afc50 2024-05-30T16:47:39.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49b5200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f49b00af280 con 0x7f49b0072470 2024-05-30T16:47:39.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49b5200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49b00b43c0 con 0x7f49b00b51e0 2024-05-30T16:47:39.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49afe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49b0072470 0x7f49b006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:39.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49afe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49b0072470 0x7f49b006dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39714/0 (socket says 172.21.15.144:39714) 2024-05-30T16:47:39.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49afe00640 1 -- 172.21.15.144:0/2571526352 learned_addr learned my addr 172.21.15.144:0/2571526352 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:39.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49afe00640 1 -- 172.21.15.144:0/2571526352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b00b51e0 msgr2=0x7f49b00af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:39.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.207+0000 7f49af400640 1 --2- 172.21.15.144:0/2571526352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b00b51e0 0x7f49b00af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:39.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.208+0000 7f49afe00640 1 --2- 172.21.15.144:0/2571526352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b00b51e0 0x7f49b00af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.208+0000 7f49afe00640 1 -- 172.21.15.144:0/2571526352 >> v1:172.21.15.144:6789/0 conn(0x7f49b00afc50 legacy=0x7f49b0071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.208+0000 7f49afe00640 1 -- 172.21.15.144:0/2571526352 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b00aec30 con 0x7f49b0072470 2024-05-30T16:47:39.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.208+0000 7f49af400640 1 --2- 172.21.15.144:0/2571526352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b00b51e0 0x7f49b00af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:39.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.209+0000 7f49afe00640 1 --2- 172.21.15.144:0/2571526352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 0x7f49b006dd80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009e50 tx=0x7f49a802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7a2cf08c52689b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:39.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.209+0000 7f49aea00640 1 -- 172.21.15.144:0/2571526352 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8036070 con 0x7f49b0072470 2024-05-30T16:47:39.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.209+0000 7f49aea00640 1 -- 172.21.15.144:0/2571526352 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a8031600 con 0x7f49b0072470 2024-05-30T16:47:39.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.209+0000 7f49aea00640 1 -- 172.21.15.144:0/2571526352 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a80319d0 con 0x7f49b0072470 2024-05-30T16:47:39.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.209+0000 7f49b5200640 1 -- 172.21.15.144:0/2571526352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 msgr2=0x7f49b006dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.209+0000 7f49b5200640 1 --2- 172.21.15.144:0/2571526352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 0x7f49b006dd80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009e50 tx=0x7f49a802a710 comp rx=0 tx=0).stop 2024-05-30T16:47:39.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.210+0000 7f49b5200640 1 -- 172.21.15.144:0/2571526352 shutdown_connections 2024-05-30T16:47:39.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.210+0000 7f49b5200640 1 --2- 172.21.15.144:0/2571526352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 0x7f49b006dd80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.210+0000 7f49b5200640 1 --2- 172.21.15.144:0/2571526352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b00b51e0 0x7f49b00af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.210+0000 7f49b5200640 1 -- 172.21.15.144:0/2571526352 >> 172.21.15.144:0/2571526352 conn(0x7f49b00b2160 msgr2=0x7f49b00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:39.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.210+0000 7f49b5200640 1 -- 172.21.15.144:0/2571526352 shutdown_connections 2024-05-30T16:47:39.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.210+0000 7f49b5200640 1 -- 172.21.15.144:0/2571526352 wait complete. 2024-05-30T16:47:39.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.212+0000 7f49b5200640 1 Processor -- start 2024-05-30T16:47:39.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.213+0000 7f49b5200640 1 -- start start 2024-05-30T16:47:39.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.214+0000 7f49b5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 0x7f49b01f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.214+0000 7f49b5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49b00b51e0 0x7f49b006b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.214+0000 7f49b5200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b006be20 0x7f49b00c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.214+0000 7f49b5200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49b006e2c0 con 0x7f49b0072470 2024-05-30T16:47:39.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.214+0000 7f49b5200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f49b00b55c0 con 0x7f49b00b51e0 2024-05-30T16:47:39.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.214+0000 7f49b5200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49b006e440 con 0x7f49b006be20 2024-05-30T16:47:39.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.214+0000 7f49af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 0x7f49b01f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:39.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.214+0000 7f49af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 0x7f49b01f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39728/0 (socket says 172.21.15.144:39728) 2024-05-30T16:47:39.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.214+0000 7f49af400640 1 -- 172.21.15.144:0/482685147 learned_addr learned my addr 172.21.15.144:0/482685147 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:39.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49af400640 1 -- 172.21.15.144:0/482685147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b006be20 msgr2=0x7f49b00c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49af400640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b006be20 0x7f49b00c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49af400640 1 -- 172.21.15.144:0/482685147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49b00b51e0 msgr2=0x7f49b006b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49af400640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49b00b51e0 0x7f49b006b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49af400640 1 -- 172.21.15.144:0/482685147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b00c86d0 con 0x7f49b0072470 2024-05-30T16:47:39.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49af400640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 0x7f49b01f3760 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c7f0 tx=0x7f49a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:39.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49a7400640 1 -- 172.21.15.144:0/482685147 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0015070 con 0x7f49b0072470 2024-05-30T16:47:39.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49a7400640 1 -- 172.21.15.144:0/482685147 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a0007820 con 0x7f49b0072470 2024-05-30T16:47:39.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49a7400640 1 -- 172.21.15.144:0/482685147 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0007bd0 con 0x7f49b0072470 2024-05-30T16:47:39.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b00c89b0 con 0x7f49b0072470 2024-05-30T16:47:39.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.215+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b00c8f70 con 0x7f49b0072470 2024-05-30T16:47:39.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.216+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b0075570 con 0x7f49b0072470 2024-05-30T16:47:39.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.217+0000 7f49a7400640 1 -- 172.21.15.144:0/482685147 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f49a0018070 con 0x7f49b0072470 2024-05-30T16:47:39.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.219+0000 7f49a7400640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f498c06cfb0 0x7f498c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.219+0000 7f49a7400640 1 -- 172.21.15.144:0/482685147 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f49a008ca80 con 0x7f49b0072470 2024-05-30T16:47:39.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.219+0000 7f49a7e00640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f498c06cfb0 0x7f498c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:39.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.220+0000 7f49a7e00640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f498c06cfb0 0x7f498c06f470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4998000f60 tx=0x7f49980079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:39.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.223+0000 7f49a7400640 1 -- 172.21.15.144:0/482685147 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49a005a300 con 0x7f49b0072470 2024-05-30T16:47:39.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.450+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone79573", "target": ["mon-mgr", ""]}) -- 0x7f49b006c250 con 0x7f498c06cfb0 2024-05-30T16:47:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.494+0000 7f49a7400640 1 -- 172.21.15.144:0/482685147 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4998005080 con 0x7f498c06cfb0 2024-05-30T16:47:39.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f498c06cfb0 msgr2=0x7f498c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f498c06cfb0 0x7f498c06f470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4998000f60 tx=0x7f49980079d0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 msgr2=0x7f49b01f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 0x7f49b01f3760 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c7f0 tx=0x7f49a000ccb0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 shutdown_connections 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f498c06cfb0 0x7f498c06f470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b006be20 0x7f49b00c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49b00b51e0 0x7f49b006b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 --2- 172.21.15.144:0/482685147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0072470 0x7f49b01f3760 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 >> 172.21.15.144:0/482685147 conn(0x7f49b00b2160 msgr2=0x7f49b0147140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 shutdown_connections 2024-05-30T16:47:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.497+0000 7f49b5200640 1 -- 172.21.15.144:0/482685147 wait complete. 2024-05-30T16:47:39.522 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone79571 2024-05-30T16:47:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.707+0000 7f4d94200640 1 Processor -- start 2024-05-30T16:47:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.707+0000 7f4d94200640 1 -- start start 2024-05-30T16:47:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.709+0000 7f4d94200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d8c0afa00 0x7f4d8c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.709+0000 7f4d94200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d8c140c80 0x7f4d8c0cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.709+0000 7f4d94200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c0cd030 con 0x7f4d8c0cc7a0 2024-05-30T16:47:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.709+0000 7f4d94200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4d8c1413f0 con 0x7f4d8c0afa00 2024-05-30T16:47:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.709+0000 7f4d94200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8c0cd860 con 0x7f4d8c140c80 2024-05-30T16:47:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.709+0000 7f4d91800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d8c0afa00 0x7f4d8c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.709+0000 7f4d90e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4d8c0cc7a0 0x7f4d8c140570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48628/0 (socket says 172.21.15.144:48628) 2024-05-30T16:47:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.709+0000 7f4d90e00640 1 -- 172.21.15.144:0/170405933 learned_addr learned my addr 172.21.15.144:0/170405933 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.710+0000 7f4d92200640 1 --2- 172.21.15.144:0/170405933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d8c140c80 0x7f4d8c0cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.710+0000 7f4d91800640 1 -- 172.21.15.144:0/170405933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d8c140c80 msgr2=0x7f4d8c0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.710+0000 7f4d91800640 1 --2- 172.21.15.144:0/170405933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d8c140c80 0x7f4d8c0cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.710+0000 7f4d91800640 1 -- 172.21.15.144:0/170405933 >> v1:172.21.15.144:6789/0 conn(0x7f4d8c0cc7a0 legacy=0x7f4d8c140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.710+0000 7f4d91800640 1 -- 172.21.15.144:0/170405933 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c15c2d0 con 0x7f4d8c0afa00 2024-05-30T16:47:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.710+0000 7f4d8be00640 1 -- 172.21.15.144:0/170405933 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452759595 0 0) 0x7f4d8c0cd030 con 0x7f4d8c0cc7a0 2024-05-30T16:47:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.711+0000 7f4d91800640 1 --2- 172.21.15.144:0/170405933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 0x7f4d8c15bd90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000a970 tx=0x7f4d8002b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12ee77718037fec server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:39.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.711+0000 7f4d8be00640 1 -- 172.21.15.144:0/170405933 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000b040 con 0x7f4d8c0afa00 2024-05-30T16:47:39.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.711+0000 7f4d8be00640 1 -- 172.21.15.144:0/170405933 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d80030710 con 0x7f4d8c0afa00 2024-05-30T16:47:39.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.711+0000 7f4d8be00640 1 -- 172.21.15.144:0/170405933 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80030ae0 con 0x7f4d8c0afa00 2024-05-30T16:47:39.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.712+0000 7f4d94200640 1 -- 172.21.15.144:0/170405933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 msgr2=0x7f4d8c15bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.712+0000 7f4d94200640 1 --2- 172.21.15.144:0/170405933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 0x7f4d8c15bd90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000a970 tx=0x7f4d8002b580 comp rx=0 tx=0).stop 2024-05-30T16:47:39.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.712+0000 7f4d94200640 1 -- 172.21.15.144:0/170405933 shutdown_connections 2024-05-30T16:47:39.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.712+0000 7f4d94200640 1 --2- 172.21.15.144:0/170405933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d8c140c80 0x7f4d8c0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.712+0000 7f4d94200640 1 --2- 172.21.15.144:0/170405933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 0x7f4d8c15bd90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.712+0000 7f4d94200640 1 -- 172.21.15.144:0/170405933 >> 172.21.15.144:0/170405933 conn(0x7f4d8c06bd00 msgr2=0x7f4d8c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:39.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.712+0000 7f4d94200640 1 -- 172.21.15.144:0/170405933 shutdown_connections 2024-05-30T16:47:39.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.712+0000 7f4d94200640 1 -- 172.21.15.144:0/170405933 wait complete. 2024-05-30T16:47:39.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.714+0000 7f4d94200640 1 Processor -- start 2024-05-30T16:47:39.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.714+0000 7f4d94200640 1 -- start start 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d94200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 0x7f4d8c154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d94200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d8c0cc7a0 0x7f4d8c15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d94200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d8c140c80 0x7f4d8c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d94200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c0ccc60 con 0x7f4d8c0afa00 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d94200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c0cd580 con 0x7f4d8c140c80 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d94200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8c0afde0 con 0x7f4d8c0cc7a0 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d91800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 0x7f4d8c154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d91800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 0x7f4d8c154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39744/0 (socket says 172.21.15.144:39744) 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d91800640 1 -- 172.21.15.144:0/3000463309 learned_addr learned my addr 172.21.15.144:0/3000463309 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d91800640 1 -- 172.21.15.144:0/3000463309 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d8c0cc7a0 msgr2=0x7f4d8c15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d91800640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d8c0cc7a0 0x7f4d8c15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d91800640 1 -- 172.21.15.144:0/3000463309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d8c140c80 msgr2=0x7f4d8c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d91800640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d8c140c80 0x7f4d8c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.715+0000 7f4d91800640 1 -- 172.21.15.144:0/3000463309 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c156c30 con 0x7f4d8c0afa00 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.716+0000 7f4d91800640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 0x7f4d8c154100 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4d80000c00 tx=0x7f4d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.716+0000 7f4d89600640 1 -- 172.21.15.144:0/3000463309 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8003f070 con 0x7f4d8c0afa00 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.716+0000 7f4d89600640 1 -- 172.21.15.144:0/3000463309 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d80033d50 con 0x7f4d8c0afa00 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.716+0000 7f4d89600640 1 -- 172.21.15.144:0/3000463309 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80006e10 con 0x7f4d8c0afa00 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.716+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8c156ed0 con 0x7f4d8c0afa00 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.716+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8c157490 con 0x7f4d8c0afa00 2024-05-30T16:47:39.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.717+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d8c068b90 con 0x7f4d8c0afa00 2024-05-30T16:47:39.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.718+0000 7f4d89600640 1 -- 172.21.15.144:0/3000463309 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 91652+0+0 (secure 0 0 0) 0x7f4d80042070 con 0x7f4d8c0afa00 2024-05-30T16:47:39.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.719+0000 7f4d89600640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d6c06cfb0 0x7f4d6c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:39.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.719+0000 7f4d89600640 1 -- 172.21.15.144:0/3000463309 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f4d800ad3e0 con 0x7f4d8c0afa00 2024-05-30T16:47:39.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.719+0000 7f4d90e00640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d6c06cfb0 0x7f4d6c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:39.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.720+0000 7f4d90e00640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d6c06cfb0 0x7f4d6c06f470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0b5f10 tx=0x7f4d78007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:39.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.724+0000 7f4d89600640 1 -- 172.21.15.144:0/3000463309 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d8c15c2d0 con 0x7f4d8c0afa00 2024-05-30T16:47:39.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.881+0000 7f4d89600640 1 -- 172.21.15.144:0/3000463309 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f4d80076cd0 con 0x7f4d8c0afa00 2024-05-30T16:47:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.944+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone79571", "target": ["mon-mgr", ""]}) -- 0x7f4d8c075f70 con 0x7f4d6c06cfb0 2024-05-30T16:47:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.981+0000 7f4d89600640 1 -- 172.21.15.144:0/3000463309 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4d780070d0 con 0x7f4d6c06cfb0 2024-05-30T16:47:39.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d6c06cfb0 msgr2=0x7f4d6c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d6c06cfb0 0x7f4d6c06f470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0b5f10 tx=0x7f4d78007920 comp rx=0 tx=0).stop 2024-05-30T16:47:39.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 msgr2=0x7f4d8c154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:39.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 0x7f4d8c154100 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4d80000c00 tx=0x7f4d800046c0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 shutdown_connections 2024-05-30T16:47:39.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d6c06cfb0 0x7f4d6c06f470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d8c140c80 0x7f4d8c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d8c0cc7a0 0x7f4d8c15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 --2- 172.21.15.144:0/3000463309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0afa00 0x7f4d8c154100 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:39.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 >> 172.21.15.144:0/3000463309 conn(0x7f4d8c06bd00 msgr2=0x7f4d8c15da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:39.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 shutdown_connections 2024-05-30T16:47:39.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:39.984+0000 7f4d94200640 1 -- 172.21.15.144:0/3000463309 wait complete. 2024-05-30T16:47:40.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone79572 2024-05-30T16:47:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.190+0000 7f341c000640 1 Processor -- start 2024-05-30T16:47:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.190+0000 7f341c000640 1 -- start start 2024-05-30T16:47:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.192+0000 7f341c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f341414c630 0x7f34140ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.192+0000 7f341c000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34140cea10 0x7f3414072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.192+0000 7f341c000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f341406fbf0 con 0x7f3414072750 2024-05-30T16:47:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.192+0000 7f341c000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f34140cf050 con 0x7f34140cea10 2024-05-30T16:47:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.192+0000 7f341c000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34140cf330 con 0x7f341414c630 2024-05-30T16:47:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.192+0000 7f3418c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34140cea10 0x7f3414072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.192+0000 7f3418c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34140cea10 0x7f3414072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39752/0 (socket says 172.21.15.144:39752) 2024-05-30T16:47:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.192+0000 7f3418c00640 1 -- 172.21.15.144:0/691519464 learned_addr learned my addr 172.21.15.144:0/691519464 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:40.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.193+0000 7f3419600640 1 --2- 172.21.15.144:0/691519464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f341414c630 0x7f34140ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.193+0000 7f3418c00640 1 -- 172.21.15.144:0/691519464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f341414c630 msgr2=0x7f34140ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:40.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.193+0000 7f3418c00640 1 --2- 172.21.15.144:0/691519464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f341414c630 0x7f34140ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.193+0000 7f3418c00640 1 -- 172.21.15.144:0/691519464 >> v1:172.21.15.149:6789/0 conn(0x7f3414072750 legacy=0x7f341406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:40.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.193+0000 7f3418c00640 1 -- 172.21.15.144:0/691519464 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34140cf610 con 0x7f34140cea10 2024-05-30T16:47:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.194+0000 7f3418c00640 1 --2- 172.21.15.144:0/691519464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 0x7f3414072210 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f34140701b0 tx=0x7f340002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7beb4b2eb97e8ff1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.194+0000 7f3413e00640 1 -- 172.21.15.144:0/691519464 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400037070 con 0x7f34140cea10 2024-05-30T16:47:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.194+0000 7f3413e00640 1 -- 172.21.15.144:0/691519464 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3400032440 con 0x7f34140cea10 2024-05-30T16:47:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.194+0000 7f3413e00640 1 -- 172.21.15.144:0/691519464 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400032810 con 0x7f34140cea10 2024-05-30T16:47:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.195+0000 7f341c000640 1 -- 172.21.15.144:0/691519464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 msgr2=0x7f3414072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.195+0000 7f341c000640 1 --2- 172.21.15.144:0/691519464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 0x7f3414072210 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f34140701b0 tx=0x7f340002a270 comp rx=0 tx=0).stop 2024-05-30T16:47:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.195+0000 7f341c000640 1 -- 172.21.15.144:0/691519464 shutdown_connections 2024-05-30T16:47:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.195+0000 7f341c000640 1 --2- 172.21.15.144:0/691519464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 0x7f3414072210 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.195+0000 7f341c000640 1 --2- 172.21.15.144:0/691519464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f341414c630 0x7f34140ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.195+0000 7f341c000640 1 -- 172.21.15.144:0/691519464 >> 172.21.15.144:0/691519464 conn(0x7f341406bd00 msgr2=0x7f341406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.195+0000 7f341c000640 1 -- 172.21.15.144:0/691519464 shutdown_connections 2024-05-30T16:47:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.195+0000 7f341c000640 1 -- 172.21.15.144:0/691519464 wait complete. 2024-05-30T16:47:40.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.197+0000 7f341c000640 1 Processor -- start 2024-05-30T16:47:40.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.197+0000 7f341c000640 1 -- start start 2024-05-30T16:47:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.198+0000 7f341c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3414072750 0x7f3414166340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.198+0000 7f341c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 0x7f34140aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.198+0000 7f341c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f341414c630 0x7f34140c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.198+0000 7f341c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f341414ca10 con 0x7f34140cea10 2024-05-30T16:47:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.198+0000 7f341c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34140b3c20 con 0x7f3414072750 2024-05-30T16:47:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.198+0000 7f341c000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f341414cb90 con 0x7f341414c630 2024-05-30T16:47:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.198+0000 7f3418c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 0x7f34140aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.198+0000 7f3418c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 0x7f34140aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39758/0 (socket says 172.21.15.144:39758) 2024-05-30T16:47:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.198+0000 7f3418c00640 1 -- 172.21.15.144:0/4055836485 learned_addr learned my addr 172.21.15.144:0/4055836485 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f3418c00640 1 -- 172.21.15.144:0/4055836485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f341414c630 msgr2=0x7f34140c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f3418c00640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f341414c630 0x7f34140c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f3418c00640 1 -- 172.21.15.144:0/4055836485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3414072750 msgr2=0x7f3414166340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f3418c00640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3414072750 0x7f3414166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f3418c00640 1 -- 172.21.15.144:0/4055836485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34140ab940 con 0x7f34140cea10 2024-05-30T16:47:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f3418c00640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 0x7f34140aaef0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3400000c00 tx=0x7f34000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f3411600640 1 -- 172.21.15.144:0/4055836485 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400041020 con 0x7f34140cea10 2024-05-30T16:47:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f3411600640 1 -- 172.21.15.144:0/4055836485 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3400030970 con 0x7f34140cea10 2024-05-30T16:47:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f3411600640 1 -- 172.21.15.144:0/4055836485 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400037040 con 0x7f34140cea10 2024-05-30T16:47:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34140abc20 con 0x7f34140cea10 2024-05-30T16:47:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.199+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341413e7f0 con 0x7f34140cea10 2024-05-30T16:47:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.200+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341406f7b0 con 0x7f34140cea10 2024-05-30T16:47:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.201+0000 7f3411600640 1 -- 172.21.15.144:0/4055836485 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f3400044020 con 0x7f34140cea10 2024-05-30T16:47:40.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.203+0000 7f3411600640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f33f406d0d0 0x7f33f406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.203+0000 7f3411600640 1 -- 172.21.15.144:0/4055836485 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f34000ad870 con 0x7f34140cea10 2024-05-30T16:47:40.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.203+0000 7f3419600640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f33f406d0d0 0x7f33f406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.204+0000 7f3419600640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f33f406d0d0 0x7f33f406f590 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f340800a810 tx=0x7f3408008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:40.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.207+0000 7f3411600640 1 -- 172.21.15.144:0/4055836485 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f341406f7b0 con 0x7f34140cea10 2024-05-30T16:47:40.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.443+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone79572", "target": ["mon-mgr", ""]}) -- 0x7f3414075f70 con 0x7f33f406d0d0 2024-05-30T16:47:40.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.476+0000 7f3411600640 1 -- 172.21.15.144:0/4055836485 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f340800a400 con 0x7f33f406d0d0 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f33f406d0d0 msgr2=0x7f33f406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f33f406d0d0 0x7f33f406f590 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f340800a810 tx=0x7f3408008040 comp rx=0 tx=0).stop 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 msgr2=0x7f34140aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 0x7f34140aaef0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3400000c00 tx=0x7f34000046c0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 shutdown_connections 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f33f406d0d0 0x7f33f406f590 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f341414c630 0x7f34140c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34140cea10 0x7f34140aaef0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 --2- 172.21.15.144:0/4055836485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3414072750 0x7f3414166340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.479+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 >> 172.21.15.144:0/4055836485 conn(0x7f341406bd00 msgr2=0x7f34140b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.480+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 shutdown_connections 2024-05-30T16:47:40.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.480+0000 7f341c000640 1 -- 172.21.15.144:0/4055836485 wait complete. 2024-05-30T16:47:40.503 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone79574 2024-05-30T16:47:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.687+0000 7f9424600640 1 Processor -- start 2024-05-30T16:47:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.687+0000 7f9424600640 1 -- start start 2024-05-30T16:47:40.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.688+0000 7f9424600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f941c145150 0x7f941c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.688+0000 7f9424600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c0cfa70 0x7f941c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.688+0000 7f9424600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f941c0d00f0 con 0x7f941c06f610 2024-05-30T16:47:40.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.688+0000 7f9424600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f941c0cfeb0 con 0x7f941c145150 2024-05-30T16:47:40.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.688+0000 7f9424600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f941c15f140 con 0x7f941c0cfa70 2024-05-30T16:47:40.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.689+0000 7f9421c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f941c145150 0x7f941c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.689+0000 7f9421c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f941c145150 0x7f941c0cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:47724/0 (socket says 172.21.15.144:47724) 2024-05-30T16:47:40.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.689+0000 7f9421c00640 1 -- 172.21.15.144:0/505840686 learned_addr learned my addr 172.21.15.144:0/505840686 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:40.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.689+0000 7f9421200640 1 --2- 172.21.15.144:0/505840686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c0cfa70 0x7f941c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.690+0000 7f9421c00640 1 -- 172.21.15.144:0/505840686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c0cfa70 msgr2=0x7f941c06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:40.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.690+0000 7f9421c00640 1 --2- 172.21.15.144:0/505840686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c0cfa70 0x7f941c06f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.690+0000 7f9421c00640 1 -- 172.21.15.144:0/505840686 >> v1:172.21.15.149:6789/0 conn(0x7f941c06f610 legacy=0x7f941c072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.690+0000 7f9421c00640 1 -- 172.21.15.144:0/505840686 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c15f390 con 0x7f941c145150 2024-05-30T16:47:40.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.691+0000 7f9421c00640 1 --2- 172.21.15.144:0/505840686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c145150 0x7f941c0cf530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9410009870 tx=0x7f941002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ed9f729947d6872 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f941be00640 1 -- 172.21.15.144:0/505840686 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410037070 con 0x7f941c145150 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f941be00640 1 -- 172.21.15.144:0/505840686 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9410032440 con 0x7f941c145150 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f941be00640 1 -- 172.21.15.144:0/505840686 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410032810 con 0x7f941c145150 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f9424600640 1 -- 172.21.15.144:0/505840686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c145150 msgr2=0x7f941c0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f9424600640 1 --2- 172.21.15.144:0/505840686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c145150 0x7f941c0cf530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9410009870 tx=0x7f941002a1c0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f9424600640 1 -- 172.21.15.144:0/505840686 shutdown_connections 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f9424600640 1 --2- 172.21.15.144:0/505840686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c0cfa70 0x7f941c06f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f9424600640 1 --2- 172.21.15.144:0/505840686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c145150 0x7f941c0cf530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f9424600640 1 -- 172.21.15.144:0/505840686 >> 172.21.15.144:0/505840686 conn(0x7f941c06bd00 msgr2=0x7f941c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f9424600640 1 -- 172.21.15.144:0/505840686 shutdown_connections 2024-05-30T16:47:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.692+0000 7f9424600640 1 -- 172.21.15.144:0/505840686 wait complete. 2024-05-30T16:47:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.694+0000 7f9424600640 1 Processor -- start 2024-05-30T16:47:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.694+0000 7f9424600640 1 -- start start 2024-05-30T16:47:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.695+0000 7f9424600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c06f610 0x7f941c1f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.695+0000 7f9424600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f941c0cfa70 0x7f941c136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.695+0000 7f9424600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c145150 0x7f941c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.695+0000 7f9424600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f941c0b64f0 con 0x7f941c0cfa70 2024-05-30T16:47:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.695+0000 7f9424600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f941c15f950 con 0x7f941c06f610 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.695+0000 7f9424600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f941c15fe70 con 0x7f941c145150 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.695+0000 7f9421200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f941c0cfa70 0x7f941c136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.695+0000 7f9421200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f941c0cfa70 0x7f941c136dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39770/0 (socket says 172.21.15.144:39770) 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.695+0000 7f9421200640 1 -- 172.21.15.144:0/3750279593 learned_addr learned my addr 172.21.15.144:0/3750279593 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9421c00640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c06f610 0x7f941c1f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9422600640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c145150 0x7f941c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9421200640 1 -- 172.21.15.144:0/3750279593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c145150 msgr2=0x7f941c15c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9421200640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c145150 0x7f941c15c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9421200640 1 -- 172.21.15.144:0/3750279593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c06f610 msgr2=0x7f941c1f8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9421200640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c06f610 0x7f941c1f8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9421200640 1 -- 172.21.15.144:0/3750279593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c1334a0 con 0x7f941c0cfa70 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9421c00640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c06f610 0x7f941c1f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9421200640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f941c0cfa70 0x7f941c136dc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f940800e9b0 tx=0x7f940800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9419600640 1 -- 172.21.15.144:0/3750279593 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9408017070 con 0x7f941c0cfa70 2024-05-30T16:47:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9419600640 1 -- 172.21.15.144:0/3750279593 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940800c9a0 con 0x7f941c0cfa70 2024-05-30T16:47:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9419600640 1 -- 172.21.15.144:0/3750279593 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940800cd90 con 0x7f941c0cfa70 2024-05-30T16:47:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.696+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941c137750 con 0x7f941c0cfa70 2024-05-30T16:47:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.697+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941c15e6a0 con 0x7f941c0cfa70 2024-05-30T16:47:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.697+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f941c06f370 con 0x7f941c0cfa70 2024-05-30T16:47:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.699+0000 7f9419600640 1 -- 172.21.15.144:0/3750279593 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f940801a070 con 0x7f941c0cfa70 2024-05-30T16:47:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.700+0000 7f9419600640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f93fc06d0d0 0x7f93fc06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.700+0000 7f9419600640 1 -- 172.21.15.144:0/3750279593 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f940808a630 con 0x7f941c0cfa70 2024-05-30T16:47:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.700+0000 7f9421c00640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f93fc06d0d0 0x7f93fc06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.701+0000 7f9421c00640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f93fc06d0d0 0x7f93fc06f590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9410034000 tx=0x7f941002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:40.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.704+0000 7f9419600640 1 -- 172.21.15.144:0/3750279593 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f941c06f370 con 0x7f941c0cfa70 2024-05-30T16:47:40.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.934+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone79574", "target": ["mon-mgr", ""]}) -- 0x7f941c075f70 con 0x7f93fc06d0d0 2024-05-30T16:47:40.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.970+0000 7f9419600640 1 -- 172.21.15.144:0/3750279593 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9410032760 con 0x7f93fc06d0d0 2024-05-30T16:47:40.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f93fc06d0d0 msgr2=0x7f93fc06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f93fc06d0d0 0x7f93fc06f590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9410034000 tx=0x7f941002e000 comp rx=0 tx=0).stop 2024-05-30T16:47:40.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f941c0cfa70 msgr2=0x7f941c136dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:40.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f941c0cfa70 0x7f941c136dc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f940800e9b0 tx=0x7f940800ee70 comp rx=0 tx=0).stop 2024-05-30T16:47:40.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 shutdown_connections 2024-05-30T16:47:40.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f93fc06d0d0 0x7f93fc06f590 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f941c145150 0x7f941c15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f941c0cfa70 0x7f941c136dc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 --2- 172.21.15.144:0/3750279593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941c06f610 0x7f941c1f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:40.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.973+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 >> 172.21.15.144:0/3750279593 conn(0x7f941c06bd00 msgr2=0x7f941c074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:40.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.974+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 shutdown_connections 2024-05-30T16:47:40.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:40.974+0000 7f9424600640 1 -- 172.21.15.144:0/3750279593 wait complete. 2024-05-30T16:47:40.998 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T16:47:41.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:47:41.093 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-05-30T16:47:41.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:47:41.103 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:47:41.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:47:41.195 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:47:41.301 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:47:41.301 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:47:41.302 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:47:41.302 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:47:41.357 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:47:41.357 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:47:41.409 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:47:41.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.658+0000 7f993ae00640 1 Processor -- start 2024-05-30T16:47:41.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.658+0000 7f993ae00640 1 -- start start 2024-05-30T16:47:41.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.660+0000 7f993ae00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f99340ce390 0x7f993415e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:41.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.660+0000 7f993ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99341604c0 0x7f993406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:41.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.660+0000 7f993ae00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9934160c40 con 0x7f993415da50 2024-05-30T16:47:41.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.660+0000 7f993ae00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f993415dee0 con 0x7f99340ce390 2024-05-30T16:47:41.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.660+0000 7f993ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9934160f20 con 0x7f99341604c0 2024-05-30T16:47:41.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.661+0000 7f9933e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f99340ce390 0x7f993415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:41.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.661+0000 7f9933e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f99340ce390 0x7f993415e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:47738/0 (socket says 172.21.15.144:47738) 2024-05-30T16:47:41.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.661+0000 7f9933e00640 1 -- 172.21.15.144:0/728768008 learned_addr learned my addr 172.21.15.144:0/728768008 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:41.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.661+0000 7f9933400640 1 --1- 172.21.15.144:0/728768008 >> v1:172.21.15.149:6789/0 conn(0x7f993415da50 0x7f99340ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:36834/0 (socket says 172.21.15.144:36834) 2024-05-30T16:47:41.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.661+0000 7f9938e00640 1 --2- 172.21.15.144:0/728768008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99341604c0 0x7f993406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:41.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.662+0000 7f9933e00640 1 -- 172.21.15.144:0/728768008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99341604c0 msgr2=0x7f993406ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:41.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.662+0000 7f9933e00640 1 --2- 172.21.15.144:0/728768008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99341604c0 0x7f993406ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.662+0000 7f9933e00640 1 -- 172.21.15.144:0/728768008 >> v1:172.21.15.149:6789/0 conn(0x7f993415da50 legacy=0x7f99340ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:41.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.662+0000 7f9933e00640 1 -- 172.21.15.144:0/728768008 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9934161200 con 0x7f99340ce390 2024-05-30T16:47:41.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.662+0000 7f9938e00640 1 --2- 172.21.15.144:0/728768008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99341604c0 0x7f993406ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:47:41.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.663+0000 7f9933e00640 1 --2- 172.21.15.144:0/728768008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99340ce390 0x7f993415e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9924009870 tx=0x7f992402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25d7d1006059ab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:41.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.663+0000 7f9932a00640 1 -- 172.21.15.144:0/728768008 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924037070 con 0x7f99340ce390 2024-05-30T16:47:41.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f9932a00640 1 -- 172.21.15.144:0/728768008 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9924032440 con 0x7f99340ce390 2024-05-30T16:47:41.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f9932a00640 1 -- 172.21.15.144:0/728768008 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924032810 con 0x7f99340ce390 2024-05-30T16:47:41.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f993ae00640 1 -- 172.21.15.144:0/728768008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99340ce390 msgr2=0x7f993415e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:41.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f993ae00640 1 --2- 172.21.15.144:0/728768008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99340ce390 0x7f993415e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9924009870 tx=0x7f992402a250 comp rx=0 tx=0).stop 2024-05-30T16:47:41.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f993ae00640 1 -- 172.21.15.144:0/728768008 shutdown_connections 2024-05-30T16:47:41.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f993ae00640 1 --2- 172.21.15.144:0/728768008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99341604c0 0x7f993406ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f993ae00640 1 --2- 172.21.15.144:0/728768008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99340ce390 0x7f993415e090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f993ae00640 1 -- 172.21.15.144:0/728768008 >> 172.21.15.144:0/728768008 conn(0x7f99340629c0 msgr2=0x7f993406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:41.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f993ae00640 1 -- 172.21.15.144:0/728768008 shutdown_connections 2024-05-30T16:47:41.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.664+0000 7f993ae00640 1 -- 172.21.15.144:0/728768008 wait complete. 2024-05-30T16:47:41.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.666+0000 7f993ae00640 1 Processor -- start 2024-05-30T16:47:41.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.666+0000 7f993ae00640 1 -- start start 2024-05-30T16:47:41.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.667+0000 7f993ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99340ce390 0x7f993415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:41.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.667+0000 7f993ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f993415da50 0x7f99340ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.667+0000 7f993ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99341604c0 0x7f99341f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.667+0000 7f993ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9934143130 con 0x7f99341604c0 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.667+0000 7f993ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f99341608d0 con 0x7f99340ce390 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.667+0000 7f993ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f99341432b0 con 0x7f993415da50 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.667+0000 7f9938e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99341604c0 0x7f99341f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.667+0000 7f9938e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99341604c0 0x7f99341f8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39782/0 (socket says 172.21.15.144:39782) 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.667+0000 7f9938e00640 1 -- 172.21.15.144:0/2170101976 learned_addr learned my addr 172.21.15.144:0/2170101976 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.668+0000 7f9933400640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f993415da50 0x7f99340ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.668+0000 7f9933e00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99340ce390 0x7f993415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.668+0000 7f9938e00640 1 -- 172.21.15.144:0/2170101976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f993415da50 msgr2=0x7f99340ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:41.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.668+0000 7f9938e00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f993415da50 0x7f99340ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.668+0000 7f9938e00640 1 -- 172.21.15.144:0/2170101976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99340ce390 msgr2=0x7f993415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.668+0000 7f9938e00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99340ce390 0x7f993415b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.668+0000 7f9938e00640 1 -- 172.21.15.144:0/2170101976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99341f8d30 con 0x7f99341604c0 2024-05-30T16:47:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.668+0000 7f9938e00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99341604c0 0x7f99341f8150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f992c00e930 tx=0x7f992c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.669+0000 7f992be00640 1 -- 172.21.15.144:0/2170101976 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c017070 con 0x7f99341604c0 2024-05-30T16:47:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.669+0000 7f992be00640 1 -- 172.21.15.144:0/2170101976 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992c00ca00 con 0x7f99341604c0 2024-05-30T16:47:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.669+0000 7f992be00640 1 -- 172.21.15.144:0/2170101976 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c00cdd0 con 0x7f99341604c0 2024-05-30T16:47:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.669+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99341f9010 con 0x7f99341604c0 2024-05-30T16:47:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.669+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f993415ae70 con 0x7f99341604c0 2024-05-30T16:47:41.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.670+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9934068b20 con 0x7f99341604c0 2024-05-30T16:47:41.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.671+0000 7f992be00640 1 -- 172.21.15.144:0/2170101976 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f992c013470 con 0x7f99341604c0 2024-05-30T16:47:41.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.672+0000 7f992be00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f991006d0d0 0x7f991006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:41.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.672+0000 7f992be00640 1 -- 172.21.15.144:0/2170101976 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f992c08ce30 con 0x7f99341604c0 2024-05-30T16:47:41.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.672+0000 7f9933e00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f991006d0d0 0x7f991006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:41.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.673+0000 7f9933e00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f991006d0d0 0x7f991006f590 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9924034000 tx=0x7f992402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:41.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.676+0000 7f992be00640 1 -- 172.21.15.144:0/2170101976 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f992c05a240 con 0x7f99341604c0 2024-05-30T16:47:41.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.890+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f99340756b0 con 0x7f99341604c0 2024-05-30T16:47:41.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.891+0000 7f992be00640 1 -- 172.21.15.144:0/2170101976 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7f992c059b40 con 0x7f99341604c0 2024-05-30T16:47:41.892 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-05-30T16:47:41.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.893+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f991006d0d0 msgr2=0x7f991006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:41.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.893+0000 7f993ae00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f991006d0d0 0x7f991006f590 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9924034000 tx=0x7f992402e000 comp rx=0 tx=0).stop 2024-05-30T16:47:41.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.893+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99341604c0 msgr2=0x7f99341f8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:41.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.893+0000 7f993ae00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99341604c0 0x7f99341f8150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f992c00e930 tx=0x7f992c00edf0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.894+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 shutdown_connections 2024-05-30T16:47:41.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.894+0000 7f993ae00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f991006d0d0 0x7f991006f590 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.894+0000 7f993ae00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99341604c0 0x7f99341f8150 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.894+0000 7f993ae00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f993415da50 0x7f99340ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.894+0000 7f993ae00640 1 --2- 172.21.15.144:0/2170101976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99340ce390 0x7f993415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:41.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.894+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 >> 172.21.15.144:0/2170101976 conn(0x7f99340629c0 msgr2=0x7f993415e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:41.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.894+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 shutdown_connections 2024-05-30T16:47:41.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:41.894+0000 7f993ae00640 1 -- 172.21.15.144:0/2170101976 wait complete. 2024-05-30T16:47:41.916 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T16:47:41.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:47:41.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T16:47:42.039 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:47:42.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:47:42.039 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:47:42.114 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:47:42.114 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:47:42.114 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:47:42.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:47:42.175 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:47:42.175 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:47:42.175 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:47:42.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:47:42.236 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:47:42.236 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:47:42.236 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:47:42.294 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:47:42.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:47:42.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.537+0000 7efce6e00640 1 Processor -- start 2024-05-30T16:47:42.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.537+0000 7efce6e00640 1 -- start start 2024-05-30T16:47:42.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.539+0000 7efce6e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efce0141510 0x7efce0071df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:42.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.540+0000 7efce6e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce0162420 con 0x7efce00b5390 2024-05-30T16:47:42.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.540+0000 7efce6e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce0162700 con 0x7efce01418f0 2024-05-30T16:47:42.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.540+0000 7efce6e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efce01629e0 con 0x7efce0141510 2024-05-30T16:47:42.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.540+0000 7efcdf400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efce00b5390 0x7efce01442f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48644/0 (socket says 172.21.15.144:48644) 2024-05-30T16:47:42.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.540+0000 7efcdf400640 1 -- 172.21.15.144:0/300864345 learned_addr learned my addr 172.21.15.144:0/300864345 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:42.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.540+0000 7efcdfe00640 1 --2- 172.21.15.144:0/300864345 >> v2:172.21.15.144:3300/0 conn(0x7efce0141510 0x7efce0071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:42.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.541+0000 7efcdea00640 1 -- 172.21.15.144:0/300864345 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968646021 0 0) 0x7efce0162420 con 0x7efce00b5390 2024-05-30T16:47:42.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.541+0000 7efcdea00640 1 -- 172.21.15.144:0/300864345 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc4003520 con 0x7efce00b5390 2024-05-30T16:47:42.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.541+0000 7efcdea00640 1 -- 172.21.15.144:0/300864345 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957259191 0 0) 0x7efce0162700 con 0x7efce01418f0 2024-05-30T16:47:42.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.541+0000 7efcdfe00640 1 -- 172.21.15.144:0/300864345 >> v1:172.21.15.149:6789/0 conn(0x7efce01418f0 legacy=0x7efce015ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:42.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.541+0000 7efcdfe00640 1 -- 172.21.15.144:0/300864345 >> v1:172.21.15.144:6789/0 conn(0x7efce00b5390 legacy=0x7efce01442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:42.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.541+0000 7efcdfe00640 1 -- 172.21.15.144:0/300864345 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce0162cc0 con 0x7efce0141510 2024-05-30T16:47:42.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.543+0000 7efcdfe00640 1 --2- 172.21.15.144:0/300864345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 0x7efce0071df0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efccc0097a0 tx=0x7efccc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773513f19e8e1ad4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:42.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.543+0000 7efcdea00640 1 -- 172.21.15.144:0/300864345 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc037070 con 0x7efce0141510 2024-05-30T16:47:42.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.543+0000 7efcdea00640 1 -- 172.21.15.144:0/300864345 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efccc032440 con 0x7efce0141510 2024-05-30T16:47:42.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.543+0000 7efcdea00640 1 -- 172.21.15.144:0/300864345 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc032810 con 0x7efce0141510 2024-05-30T16:47:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.544+0000 7efce6e00640 1 -- 172.21.15.144:0/300864345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 msgr2=0x7efce0071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.544+0000 7efce6e00640 1 --2- 172.21.15.144:0/300864345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 0x7efce0071df0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efccc0097a0 tx=0x7efccc02a1a0 comp rx=0 tx=0).stop 2024-05-30T16:47:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.544+0000 7efce6e00640 1 -- 172.21.15.144:0/300864345 shutdown_connections 2024-05-30T16:47:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.544+0000 7efce6e00640 1 --2- 172.21.15.144:0/300864345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 0x7efce0071df0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.544+0000 7efce6e00640 1 -- 172.21.15.144:0/300864345 >> 172.21.15.144:0/300864345 conn(0x7efce0070050 msgr2=0x7efce006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.545+0000 7efce6e00640 1 -- 172.21.15.144:0/300864345 shutdown_connections 2024-05-30T16:47:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.545+0000 7efce6e00640 1 -- 172.21.15.144:0/300864345 wait complete. 2024-05-30T16:47:42.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.548+0000 7efce6e00640 1 Processor -- start 2024-05-30T16:47:42.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.548+0000 7efce6e00640 1 -- start start 2024-05-30T16:47:42.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.550+0000 7efce6e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce00b5390 0x7efce0153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:42.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.550+0000 7efce6e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 0x7efce013c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:42.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.550+0000 7efce6e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efce01418f0 0x7efce013c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:42.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.550+0000 7efce6e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efce00724b0 con 0x7efce0141510 2024-05-30T16:47:42.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.550+0000 7efce6e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efce0072330 con 0x7efce01418f0 2024-05-30T16:47:42.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.550+0000 7efce6e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efce0072630 con 0x7efce00b5390 2024-05-30T16:47:42.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.551+0000 7efcdf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 0x7efce013c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:42.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.551+0000 7efcdf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 0x7efce013c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39796/0 (socket says 172.21.15.144:39796) 2024-05-30T16:47:42.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.551+0000 7efcdf400640 1 -- 172.21.15.144:0/3307714807 learned_addr learned my addr 172.21.15.144:0/3307714807 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:42.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.551+0000 7efcdfe00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce00b5390 0x7efce0153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:42.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.552+0000 7efcdf400640 1 -- 172.21.15.144:0/3307714807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce00b5390 msgr2=0x7efce0153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:42.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.552+0000 7efcdf400640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce00b5390 0x7efce0153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:42.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.552+0000 7efcdf400640 1 -- 172.21.15.144:0/3307714807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efce01418f0 msgr2=0x7efce013c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:42.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.552+0000 7efcdf400640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efce01418f0 0x7efce013c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:42.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.552+0000 7efcdf400640 1 -- 172.21.15.144:0/3307714807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce0139b40 con 0x7efce0141510 2024-05-30T16:47:42.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.552+0000 7efcdf400640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 0x7efce013c180 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efcd000c4d0 tx=0x7efcd000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:42.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.553+0000 7efcd7e00640 1 -- 172.21.15.144:0/3307714807 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0017070 con 0x7efce0141510 2024-05-30T16:47:42.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.553+0000 7efcd7e00640 1 -- 172.21.15.144:0/3307714807 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd0005ce0 con 0x7efce0141510 2024-05-30T16:47:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.553+0000 7efcd7e00640 1 -- 172.21.15.144:0/3307714807 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0017070 con 0x7efce0141510 2024-05-30T16:47:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.553+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce0139e20 con 0x7efce0141510 2024-05-30T16:47:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.554+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce013a3e0 con 0x7efce0141510 2024-05-30T16:47:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.556+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb8005290 con 0x7efce0141510 2024-05-30T16:47:42.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.558+0000 7efcd7e00640 1 -- 172.21.15.144:0/3307714807 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7efcd001a070 con 0x7efce0141510 2024-05-30T16:47:42.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.560+0000 7efcd7e00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcc006d2d0 0x7efcc006f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:42.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.560+0000 7efcd7e00640 1 -- 172.21.15.144:0/3307714807 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7efcd008bd40 con 0x7efce0141510 2024-05-30T16:47:42.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.561+0000 7efcdfe00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcc006d2d0 0x7efcc006f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.564+0000 7efcdfe00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcc006d2d0 0x7efcc006f790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efccc034000 tx=0x7efccc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.568+0000 7efcd7e00640 1 -- 172.21.15.144:0/3307714807 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efcd0058ac0 con 0x7efce0141510 2024-05-30T16:47:42.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.980+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcb8005850 con 0x7efce0141510 2024-05-30T16:47:42.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.981+0000 7efcd7e00640 1 -- 172.21.15.144:0/3307714807 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5190 (secure 0 0 0) 0x7efcd005cdc0 con 0x7efce0141510 2024-05-30T16:47:42.982 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:42.982 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1748821329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":1748821329},{"type":"v1","addr":"172.21.15.149:6835","nonce":1748821329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/498363694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":498363694},{"type":"v1","addr":"172.21.15.149:6834","nonce":498363694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1097253256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1097253256},{"type":"v1","addr":"172.21.15.144:6835","nonce":1097253256}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:45:11.209778+0000","modified":"2024-05-30T16:45:14.274711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5235":{"gid":5235,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4243254164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4243254164},{"type":"v1","addr":"172.21.15.144:6837","nonce":4243254164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5235,"qdb_cluster":[5235]},"id":3}]} 2024-05-30T16:47:42.983 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 27 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcc006d2d0 msgr2=0x7efcc006f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcc006d2d0 0x7efcc006f790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efccc034000 tx=0x7efccc02e000 comp rx=0 tx=0).stop 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 msgr2=0x7efce013c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 0x7efce013c180 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efcd000c4d0 tx=0x7efcd000c990 comp rx=0 tx=0).stop 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 shutdown_connections 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcc006d2d0 0x7efcc006f790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efce01418f0 0x7efce013c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efce0141510 0x7efce013c180 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 --2- 172.21.15.144:0/3307714807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce00b5390 0x7efce0153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 >> 172.21.15.144:0/3307714807 conn(0x7efce0070050 msgr2=0x7efce01441d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.983+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 shutdown_connections 2024-05-30T16:47:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:42.984+0000 7efce6e00640 1 -- 172.21.15.144:0/3307714807 wait complete. 2024-05-30T16:47:43.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:47:43.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.247+0000 7f94d3a00640 1 Processor -- start 2024-05-30T16:47:43.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.247+0000 7f94d3a00640 1 -- start start 2024-05-30T16:47:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.250+0000 7f94d3a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f94cc14c630 0x7f94cc0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.250+0000 7f94d3a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94cc06fbf0 con 0x7f94cc072920 2024-05-30T16:47:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.250+0000 7f94d3a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94cc0cf050 con 0x7f94cc0cea10 2024-05-30T16:47:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.250+0000 7f94d3a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f94cc0cee30 con 0x7f94cc14c630 2024-05-30T16:47:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.250+0000 7f94cbe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f94cc0cea10 0x7f94cc072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:36848/0 (socket says 172.21.15.144:36848) 2024-05-30T16:47:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.250+0000 7f94cbe00640 1 -- 172.21.15.144:0/2533684027 learned_addr learned my addr 172.21.15.144:0/2533684027 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.251+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480139912 0 0) 0x7f94cc0cf050 con 0x7f94cc0cea10 2024-05-30T16:47:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.251+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94b0003520 con 0x7f94cc0cea10 2024-05-30T16:47:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.251+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1737115021 0 0) 0x7f94cc06fbf0 con 0x7f94cc072920 2024-05-30T16:47:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.251+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94cc0cf050 con 0x7f94cc072920 2024-05-30T16:47:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.251+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 372150948 0 0) 0x7f94b0003520 con 0x7f94cc0cea10 2024-05-30T16:47:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 >> v2:172.21.15.149:3300/0 conn(0x7f94cc14c630 msgr2=0x7f94cc0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94d1000640 1 --2- 172.21.15.144:0/2533684027 >> v2:172.21.15.149:3300/0 conn(0x7f94cc14c630 0x7f94cc0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 --2- 172.21.15.144:0/2533684027 >> v2:172.21.15.149:3300/0 conn(0x7f94cc14c630 0x7f94cc0ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 >> v1:172.21.15.144:6789/0 conn(0x7f94cc072920 legacy=0x7f94cc0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc0cf330 con 0x7f94cc0cea10 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f94b4001690 con 0x7f94cc0cea10 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 >> v1:172.21.15.149:6789/0 conn(0x7f94cc0cea10 legacy=0x7f94cc072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94b0004ba0 0x7f94b0004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b00037a0 0x7f94b0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b00041b0 0x7f94b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc0cee30 con 0x7f94b0004ba0 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94b000c160 con 0x7f94b00041b0 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94b000c360 con 0x7f94b00037a0 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94d1000640 1 --2- 172.21.15.144:0/2533684027 >> v2:172.21.15.149:3300/0 conn(0x7f94cc14c630 0x7f94cc0ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.252+0000 7f94d1a00640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b00041b0 0x7f94b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94d1000640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94b0004ba0 0x7f94b0004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94cbe00640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b00037a0 0x7f94b0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94d1000640 1 -- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b00037a0 msgr2=0x7f94b0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94d1000640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b00037a0 0x7f94b0003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94d1000640 1 -- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b00041b0 msgr2=0x7f94b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94d1000640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b00041b0 0x7f94b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94d1000640 1 -- 172.21.15.144:0/2533684027 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc0cf330 con 0x7f94b0004ba0 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94cbe00640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b00037a0 0x7f94b0003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94d1a00640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b00041b0 0x7f94b000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:47:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.253+0000 7f94d1a00640 1 -- 172.21.15.144:0/2533684027 reap_dead start 2024-05-30T16:47:43.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.256+0000 7f94d1000640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94b0004ba0 0x7f94b0004f80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f94c400aa70 tx=0x7f94b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08167dafd907cab server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:43.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.256+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c400a640 con 0x7f94b0004ba0 2024-05-30T16:47:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.256+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c402abf0 con 0x7f94b0004ba0 2024-05-30T16:47:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.256+0000 7f94cb400640 1 -- 172.21.15.144:0/2533684027 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c402ae60 con 0x7f94b0004ba0 2024-05-30T16:47:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.258+0000 7f94d3a00640 1 -- 172.21.15.144:0/2533684027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94b0004ba0 msgr2=0x7f94b0004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.258+0000 7f94d3a00640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94b0004ba0 0x7f94b0004f80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f94c400aa70 tx=0x7f94b0005830 comp rx=0 tx=0).stop 2024-05-30T16:47:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.258+0000 7f94d3a00640 1 -- 172.21.15.144:0/2533684027 shutdown_connections 2024-05-30T16:47:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.258+0000 7f94d3a00640 1 --2- 172.21.15.144:0/2533684027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94b0004ba0 0x7f94b0004f80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.258+0000 7f94d3a00640 1 -- 172.21.15.144:0/2533684027 >> 172.21.15.144:0/2533684027 conn(0x7f94cc06bd00 msgr2=0x7f94cc06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.259+0000 7f94d3a00640 1 -- 172.21.15.144:0/2533684027 shutdown_connections 2024-05-30T16:47:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.259+0000 7f94d3a00640 1 -- 172.21.15.144:0/2533684027 wait complete. 2024-05-30T16:47:43.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.262+0000 7f94d3a00640 1 Processor -- start 2024-05-30T16:47:43.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.262+0000 7f94d3a00640 1 -- start start 2024-05-30T16:47:43.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.263+0000 7f94d3a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b0004ba0 0x7f94cc0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.263+0000 7f94d3a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94cc1fbe50 0x7f94cc1fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.263+0000 7f94d3a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94cc162780 0x7f94cc162c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.263+0000 7f94d3a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc0b3c20 con 0x7f94cc162780 2024-05-30T16:47:43.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.263+0000 7f94d3a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc0cf8f0 con 0x7f94b0004ba0 2024-05-30T16:47:43.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.263+0000 7f94d3a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94cc14ca10 con 0x7f94cc1fbe50 2024-05-30T16:47:43.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.263+0000 7f94cbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94cc1fbe50 0x7f94cc1fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94cbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94cc1fbe50 0x7f94cc1fc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:56186/0 (socket says 172.21.15.144:56186) 2024-05-30T16:47:43.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94cbe00640 1 -- 172.21.15.144:0/2207854434 learned_addr learned my addr 172.21.15.144:0/2207854434 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:43.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94d1000640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b0004ba0 0x7f94cc0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94d1a00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94cc162780 0x7f94cc162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94cbe00640 1 -- 172.21.15.144:0/2207854434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b0004ba0 msgr2=0x7f94cc0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94cbe00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b0004ba0 0x7f94cc0af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94cbe00640 1 -- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94cc162780 msgr2=0x7f94cc162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94cbe00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94cc162780 0x7f94cc162c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94cbe00640 1 -- 172.21.15.144:0/2207854434 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc0af5f0 con 0x7f94cc1fbe50 2024-05-30T16:47:43.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.264+0000 7f94d1a00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94cc162780 0x7f94cc162c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:43.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.265+0000 7f94cbe00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94cc1fbe50 0x7f94cc1fc2d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f94b400d940 tx=0x7f94b400de00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:43.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.265+0000 7f94c8c00640 1 -- 172.21.15.144:0/2207854434 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4019070 con 0x7f94cc1fbe50 2024-05-30T16:47:43.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.265+0000 7f94c8c00640 1 -- 172.21.15.144:0/2207854434 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b40075a0 con 0x7f94cc1fbe50 2024-05-30T16:47:43.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.265+0000 7f94c8c00640 1 -- 172.21.15.144:0/2207854434 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4004a00 con 0x7f94cc1fbe50 2024-05-30T16:47:43.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.265+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94cc1634f0 con 0x7f94cc1fbe50 2024-05-30T16:47:43.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.265+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94cc163ab0 con 0x7f94cc1fbe50 2024-05-30T16:47:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.268+0000 7f94c8c00640 1 -- 172.21.15.144:0/2207854434 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f94b4004ba0 con 0x7f94cc1fbe50 2024-05-30T16:47:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.268+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94cc068b90 con 0x7f94cc1fbe50 2024-05-30T16:47:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.270+0000 7f94c8c00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94a806d100 0x7f94a806f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.270+0000 7f94c8c00640 1 -- 172.21.15.144:0/2207854434 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(47..47 src has 1..47) ==== 5823+0+0 (secure 0 0 0) 0x7f94b408ca60 con 0x7f94cc1fbe50 2024-05-30T16:47:43.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.270+0000 7f94d1000640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94a806d100 0x7f94a806f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.272+0000 7f94d1000640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94a806d100 0x7f94a806f5c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f94c4033000 tx=0x7f94c402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:43.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.279+0000 7f94c8c00640 1 -- 172.21.15.144:0/2207854434 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94b4059d80 con 0x7f94cc1fbe50 2024-05-30T16:47:43.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.702+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94cc06f780 con 0x7f94cc1fbe50 2024-05-30T16:47:43.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.704+0000 7f94c8c00640 1 -- 172.21.15.144:0/2207854434 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5190 (secure 0 0 0) 0x7f94b4059680 con 0x7f94cc1fbe50 2024-05-30T16:47:43.705 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:43.705 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1748821329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":1748821329},{"type":"v1","addr":"172.21.15.149:6835","nonce":1748821329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/498363694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":498363694},{"type":"v1","addr":"172.21.15.149:6834","nonce":498363694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1097253256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1097253256},{"type":"v1","addr":"172.21.15.144:6835","nonce":1097253256}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:45:11.209778+0000","modified":"2024-05-30T16:45:14.274711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5235":{"gid":5235,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4243254164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4243254164},{"type":"v1","addr":"172.21.15.144:6837","nonce":4243254164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5235,"qdb_cluster":[5235]},"id":3}]} 2024-05-30T16:47:43.705 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 27 2024-05-30T16:47:43.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94a806d100 msgr2=0x7f94a806f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94a806d100 0x7f94a806f5c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f94c4033000 tx=0x7f94c402e000 comp rx=0 tx=0).stop 2024-05-30T16:47:43.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94cc1fbe50 msgr2=0x7f94cc1fc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94cc1fbe50 0x7f94cc1fc2d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f94b400d940 tx=0x7f94b400de00 comp rx=0 tx=0).stop 2024-05-30T16:47:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 shutdown_connections 2024-05-30T16:47:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f94a806d100 0x7f94a806f5c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94cc162780 0x7f94cc162c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94cc1fbe50 0x7f94cc1fc2d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 --2- 172.21.15.144:0/2207854434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b0004ba0 0x7f94cc0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 >> 172.21.15.144:0/2207854434 conn(0x7f94cc06bd00 msgr2=0x7f94cc14b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.707+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 shutdown_connections 2024-05-30T16:47:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.708+0000 7f94d3a00640 1 -- 172.21.15.144:0/2207854434 wait complete. 2024-05-30T16:47:43.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:47:43.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.974+0000 7f5707e00640 1 Processor -- start 2024-05-30T16:47:43.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.975+0000 7f5707e00640 1 -- start start 2024-05-30T16:47:43.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.976+0000 7f5707e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f570815e960 0x7f5708162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.976+0000 7f5707e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57080cfbe0 0x7f57080d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.976+0000 7f5707e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f570815ed40 con 0x7f57080ba090 2024-05-30T16:47:43.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.976+0000 7f5707e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f57080d2b40 con 0x7f570815e960 2024-05-30T16:47:43.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.976+0000 7f5707e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f57081629d0 con 0x7f57080cfbe0 2024-05-30T16:47:43.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.976+0000 7f5706000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f57080ba090 0x7f57080cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48654/0 (socket says 172.21.15.144:48654) 2024-05-30T16:47:43.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.976+0000 7f5706000640 1 -- 172.21.15.144:0/3205800039 learned_addr learned my addr 172.21.15.144:0/3205800039 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:43.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.977+0000 7f5707400640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57080cfbe0 0x7f57080d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.977+0000 7f5706a00640 1 --2- 172.21.15.144:0/3205800039 >> v2:172.21.15.144:3300/0 conn(0x7f570815e960 0x7f5708162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.977+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391753356 0 0) 0x7f570815ed40 con 0x7f57080ba090 2024-05-30T16:47:43.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.977+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56ec003520 con 0x7f57080ba090 2024-05-30T16:47:43.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3749885750 0 0) 0x7f56ec003520 con 0x7f57080ba090 2024-05-30T16:47:43.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57080cfbe0 msgr2=0x7f57080d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:43.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57080cfbe0 0x7f57080d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 >> v2:172.21.15.144:3300/0 conn(0x7f570815e960 msgr2=0x7f5708162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:43.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 --2- 172.21.15.144:0/3205800039 >> v2:172.21.15.144:3300/0 conn(0x7f570815e960 0x7f5708162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5708162ca0 con 0x7f57080ba090 2024-05-30T16:47:43.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f56f4001670 con 0x7f57080ba090 2024-05-30T16:47:43.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 >> v1:172.21.15.144:6789/0 conn(0x7f57080ba090 legacy=0x7f57080cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec0039b0 0x7f56ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56ec004800 0x7f56ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 0x7f56ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f57080d2b40 con 0x7f56ec0039b0 2024-05-30T16:47:43.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f57081629d0 con 0x7f56ec0051c0 2024-05-30T16:47:43.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec00bf00 con 0x7f56ec004800 2024-05-30T16:47:43.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5707400640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57080cfbe0 0x7f57080d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:47:43.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.978+0000 7f5706a00640 1 --2- 172.21.15.144:0/3205800039 >> v2:172.21.15.144:3300/0 conn(0x7f570815e960 0x7f5708162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:47:43.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.979+0000 7f5706000640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56ec004800 0x7f56ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.979+0000 7f5707400640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 0x7f56ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.979+0000 7f5707400640 1 -- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56ec004800 msgr2=0x7f56ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:43.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.979+0000 7f5707400640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56ec004800 0x7f56ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.979+0000 7f5707400640 1 -- 172.21.15.144:0/3205800039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec0039b0 msgr2=0x7f56ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:43.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.979+0000 7f5707400640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec0039b0 0x7f56ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.979+0000 7f5707400640 1 -- 172.21.15.144:0/3205800039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5708162ca0 con 0x7f56ec0051c0 2024-05-30T16:47:43.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.981+0000 7f5707400640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 0x7f56ec00b9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f570000e1f0 tx=0x7f56ec005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=413ce7a686267325 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:43.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.982+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700009d60 con 0x7f56ec0051c0 2024-05-30T16:47:43.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.982+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5700003b90 con 0x7f56ec0051c0 2024-05-30T16:47:43.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.982+0000 7f5705600640 1 -- 172.21.15.144:0/3205800039 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700004030 con 0x7f56ec0051c0 2024-05-30T16:47:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.983+0000 7f5707e00640 1 -- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 msgr2=0x7f56ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.983+0000 7f5707e00640 1 --2- 172.21.15.144:0/3205800039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 0x7f56ec00b9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f570000e1f0 tx=0x7f56ec005830 comp rx=0 tx=0).stop 2024-05-30T16:47:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.983+0000 7f5707400640 1 -- 172.21.15.144:0/3205800039 reap_dead start 2024-05-30T16:47:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.983+0000 7f5707e00640 1 -- 172.21.15.144:0/3205800039 shutdown_connections 2024-05-30T16:47:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.983+0000 7f5707e00640 1 -- 172.21.15.144:0/3205800039 >> 172.21.15.144:0/3205800039 conn(0x7f57080d1360 msgr2=0x7f57080d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:43.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.985+0000 7f5707e00640 1 -- 172.21.15.144:0/3205800039 shutdown_connections 2024-05-30T16:47:43.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.985+0000 7f5707e00640 1 -- 172.21.15.144:0/3205800039 wait complete. 2024-05-30T16:47:43.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.987+0000 7f5707e00640 1 Processor -- start 2024-05-30T16:47:43.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.988+0000 7f5707e00640 1 -- start start 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5707e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 0x7f570815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5707e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57081f3c60 0x7f57080ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5707e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f570815ca60 0x7f570815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5707e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f57080d2d90 con 0x7f57081f3c60 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5707e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5708163260 con 0x7f56ec0051c0 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5707e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f57080b78a0 con 0x7f570815ca60 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5707400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f570815ca60 0x7f570815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5707400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f570815ca60 0x7f570815cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:56226/0 (socket says 172.21.15.144:56226) 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5707400640 1 -- 172.21.15.144:0/1825864565 learned_addr learned my addr 172.21.15.144:0/1825864565 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.989+0000 7f5706000640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57081f3c60 0x7f57080ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.990+0000 7f5706a00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 0x7f570815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:43.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.990+0000 7f5707400640 1 -- 172.21.15.144:0/1825864565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 msgr2=0x7f570815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.990+0000 7f5707400640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 0x7f570815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.990+0000 7f5707400640 1 -- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57081f3c60 msgr2=0x7f57080ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:43.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.990+0000 7f5707400640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57081f3c60 0x7f57080ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:43.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.990+0000 7f5707400640 1 -- 172.21.15.144:0/1825864565 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57081f40c0 con 0x7f570815ca60 2024-05-30T16:47:43.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.990+0000 7f5706a00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 0x7f570815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:43.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.991+0000 7f5707400640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f570815ca60 0x7f570815cee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f570000e2e0 tx=0x7f5700009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:43.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.994+0000 7f56fea00640 1 -- 172.21.15.144:0/1825864565 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700009d60 con 0x7f570815ca60 2024-05-30T16:47:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.994+0000 7f56fea00640 1 -- 172.21.15.144:0/1825864565 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570003f020 con 0x7f570815ca60 2024-05-30T16:47:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.994+0000 7f56fea00640 1 -- 172.21.15.144:0/1825864565 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000045a0 con 0x7f570815ca60 2024-05-30T16:47:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.994+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570815b600 con 0x7f570815ca60 2024-05-30T16:47:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.995+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f570815bbc0 con 0x7f570815ca60 2024-05-30T16:47:43.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.996+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5708075570 con 0x7f570815ca60 2024-05-30T16:47:43.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.998+0000 7f56fea00640 1 -- 172.21.15.144:0/1825864565 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f5700005d10 con 0x7f570815ca60 2024-05-30T16:47:44.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.999+0000 7f56fea00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f56e806d1a0 0x7f56e806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:44.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.999+0000 7f56fea00640 1 -- 172.21.15.144:0/1825864565 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(47..47 src has 1..47) ==== 5823+0+0 (secure 0 0 0) 0x7f57000ad8b0 con 0x7f570815ca60 2024-05-30T16:47:44.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:43.999+0000 7f5706a00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f56e806d1a0 0x7f56e806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:44.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.001+0000 7f5706a00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f56e806d1a0 0x7f56e806f660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f56f8004790 tx=0x7f56f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:44.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.006+0000 7f56fea00640 1 -- 172.21.15.144:0/1825864565 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5700049030 con 0x7f570815ca60 2024-05-30T16:47:44.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.353+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57081f4290 con 0x7f570815ca60 2024-05-30T16:47:44.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.355+0000 7f56fea00640 1 -- 172.21.15.144:0/1825864565 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16849 (secure 0 0 0) 0x7f570007b170 con 0x7f570815ca60 2024-05-30T16:47:44.360 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:44.360 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":47,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:47:42.882719+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:45:09.108059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:45:10.167194+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:47:44.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f56e806d1a0 msgr2=0x7f56e806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:44.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f56e806d1a0 0x7f56e806f660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f56f8004790 tx=0x7f56f8008040 comp rx=0 tx=0).stop 2024-05-30T16:47:44.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f570815ca60 msgr2=0x7f570815cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:44.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f570815ca60 0x7f570815cee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f570000e2e0 tx=0x7f5700009750 comp rx=0 tx=0).stop 2024-05-30T16:47:44.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 shutdown_connections 2024-05-30T16:47:44.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f56e806d1a0 0x7f56e806f660 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f570815ca60 0x7f570815cee0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57081f3c60 0x7f57080ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 --2- 172.21.15.144:0/1825864565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0051c0 0x7f570815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 >> 172.21.15.144:0/1825864565 conn(0x7f57080d1360 msgr2=0x7f570815f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:44.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 shutdown_connections 2024-05-30T16:47:44.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.360+0000 7f5707e00640 1 -- 172.21.15.144:0/1825864565 wait complete. 2024-05-30T16:47:44.392 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:47:44.393 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:47:44.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.635+0000 7f7e45e00640 1 Processor -- start 2024-05-30T16:47:44.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.635+0000 7f7e45e00640 1 -- start start 2024-05-30T16:47:44.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.636+0000 7f7e45e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7e4015eb80 0x7f7e40162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:44.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.636+0000 7f7e45e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e400cfc70 0x7f7e400d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:44.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.636+0000 7f7e45e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e40163550 con 0x7f7e400ba2b0 2024-05-30T16:47:44.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.636+0000 7f7e45e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4015ef60 con 0x7f7e4015eb80 2024-05-30T16:47:44.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.636+0000 7f7e45e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f7e40162f90 con 0x7f7e400cfc70 2024-05-30T16:47:44.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.637+0000 7f7e3f400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e400cfc70 0x7f7e400d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:44.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.637+0000 7f7e3f400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e400cfc70 0x7f7e400d3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:47806/0 (socket says 172.21.15.144:47806) 2024-05-30T16:47:44.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.637+0000 7f7e3f400640 1 -- 172.21.15.144:0/3740445654 learned_addr learned my addr 172.21.15.144:0/3740445654 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:44.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.637+0000 7f7e3ea00640 1 --2- 172.21.15.144:0/3740445654 >> v2:172.21.15.144:3300/0 conn(0x7f7e4015eb80 0x7f7e40162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:44.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.638+0000 7f7e3f400640 1 -- 172.21.15.144:0/3740445654 >> v2:172.21.15.144:3300/0 conn(0x7f7e4015eb80 msgr2=0x7f7e40162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:44.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.638+0000 7f7e3f400640 1 --2- 172.21.15.144:0/3740445654 >> v2:172.21.15.144:3300/0 conn(0x7f7e4015eb80 0x7f7e40162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.638+0000 7f7e3f400640 1 -- 172.21.15.144:0/3740445654 >> v1:172.21.15.144:6789/0 conn(0x7f7e400ba2b0 legacy=0x7f7e400cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:44.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.638+0000 7f7e3f400640 1 -- 172.21.15.144:0/3740445654 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e40163270 con 0x7f7e400cfc70 2024-05-30T16:47:44.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.639+0000 7f7e3f400640 1 --2- 172.21.15.144:0/3740445654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 0x7f7e400d3570 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7e40162570 tx=0x7f7e3802a740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3efb3b45c3f4b823 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:44.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.640+0000 7f7e3d600640 1 -- 172.21.15.144:0/3740445654 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38036070 con 0x7f7e400cfc70 2024-05-30T16:47:44.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.640+0000 7f7e3d600640 1 -- 172.21.15.144:0/3740445654 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e38031600 con 0x7f7e400cfc70 2024-05-30T16:47:44.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.640+0000 7f7e3d600640 1 -- 172.21.15.144:0/3740445654 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e380319d0 con 0x7f7e400cfc70 2024-05-30T16:47:44.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.642+0000 7f7e45e00640 1 -- 172.21.15.144:0/3740445654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 msgr2=0x7f7e400d3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:44.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.642+0000 7f7e45e00640 1 --2- 172.21.15.144:0/3740445654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 0x7f7e400d3570 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7e40162570 tx=0x7f7e3802a740 comp rx=0 tx=0).stop 2024-05-30T16:47:44.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.642+0000 7f7e45e00640 1 -- 172.21.15.144:0/3740445654 shutdown_connections 2024-05-30T16:47:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.642+0000 7f7e45e00640 1 --2- 172.21.15.144:0/3740445654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 0x7f7e400d3570 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.642+0000 7f7e45e00640 1 --2- 172.21.15.144:0/3740445654 >> v2:172.21.15.144:3300/0 conn(0x7f7e4015eb80 0x7f7e40162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.642+0000 7f7e45e00640 1 -- 172.21.15.144:0/3740445654 >> 172.21.15.144:0/3740445654 conn(0x7f7e4006cf40 msgr2=0x7f7e4006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.642+0000 7f7e45e00640 1 -- 172.21.15.144:0/3740445654 shutdown_connections 2024-05-30T16:47:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.643+0000 7f7e45e00640 1 -- 172.21.15.144:0/3740445654 wait complete. 2024-05-30T16:47:44.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.645+0000 7f7e45e00640 1 Processor -- start 2024-05-30T16:47:44.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.646+0000 7f7e45e00640 1 -- start start 2024-05-30T16:47:44.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.649+0000 7f7e45e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400ba2b0 0x7f7e401593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:44.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.650+0000 7f7e45e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 0x7f7e40149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:44.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.650+0000 7f7e45e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015eb80 0x7f7e400c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:44.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.650+0000 7f7e3ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400ba2b0 0x7f7e401593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:44.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.650+0000 7f7e45e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40162b80 con 0x7f7e4015eb80 2024-05-30T16:47:44.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.650+0000 7f7e45e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e400d3050 con 0x7f7e400cfc70 2024-05-30T16:47:44.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.650+0000 7f7e45e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e40162d00 con 0x7f7e400ba2b0 2024-05-30T16:47:44.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.650+0000 7f7e3ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400ba2b0 0x7f7e401593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:56238/0 (socket says 172.21.15.144:56238) 2024-05-30T16:47:44.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.650+0000 7f7e3ea00640 1 -- 172.21.15.144:0/3170583323 learned_addr learned my addr 172.21.15.144:0/3170583323 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:44.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.650+0000 7f7e3e000640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 0x7f7e40149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:44.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.651+0000 7f7e3ea00640 1 -- 172.21.15.144:0/3170583323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 msgr2=0x7f7e40149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:44.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.651+0000 7f7e3ea00640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 0x7f7e40149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.651+0000 7f7e3ea00640 1 -- 172.21.15.144:0/3170583323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015eb80 msgr2=0x7f7e400c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:44.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.651+0000 7f7e3ea00640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015eb80 0x7f7e400c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.651+0000 7f7e3ea00640 1 -- 172.21.15.144:0/3170583323 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e40160f00 con 0x7f7e400ba2b0 2024-05-30T16:47:44.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.651+0000 7f7e3e000640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 0x7f7e40149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:47:44.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.651+0000 7f7e3ea00640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400ba2b0 0x7f7e401593c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000d5f0 tx=0x7f7e3000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:44.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.652+0000 7f7e37400640 1 -- 172.21.15.144:0/3170583323 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e300125f0 con 0x7f7e400ba2b0 2024-05-30T16:47:44.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.652+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e400b8650 con 0x7f7e400ba2b0 2024-05-30T16:47:44.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.652+0000 7f7e37400640 1 -- 172.21.15.144:0/3170583323 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e30019070 con 0x7f7e400ba2b0 2024-05-30T16:47:44.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.652+0000 7f7e37400640 1 -- 172.21.15.144:0/3170583323 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e300129d0 con 0x7f7e400ba2b0 2024-05-30T16:47:44.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.652+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e40149d70 con 0x7f7e400ba2b0 2024-05-30T16:47:44.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.655+0000 7f7e37400640 1 -- 172.21.15.144:0/3170583323 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f7e30012b70 con 0x7f7e400ba2b0 2024-05-30T16:47:44.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.655+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e400b8440 con 0x7f7e400ba2b0 2024-05-30T16:47:44.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.657+0000 7f7e37400640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e2006d120 0x7f7e2006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:44.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.657+0000 7f7e37400640 1 -- 172.21.15.144:0/3170583323 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(47..47 src has 1..47) ==== 5823+0+0 (secure 0 0 0) 0x7f7e3008d260 con 0x7f7e400ba2b0 2024-05-30T16:47:44.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.658+0000 7f7e3e000640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e2006d120 0x7f7e2006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:44.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.659+0000 7f7e3e000640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e2006d120 0x7f7e2006f5e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7e4015d3f0 tx=0x7f7e2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:44.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.664+0000 7f7e37400640 1 -- 172.21.15.144:0/3170583323 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e3005a680 con 0x7f7e400ba2b0 2024-05-30T16:47:44.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.905+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e40068b90 con 0x7f7e400ba2b0 2024-05-30T16:47:44.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.907+0000 7f7e37400640 1 -- 172.21.15.144:0/3170583323 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5190 (secure 0 0 0) 0x7f7e30059f80 con 0x7f7e400ba2b0 2024-05-30T16:47:44.909 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:44.909 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1748821329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":1748821329},{"type":"v1","addr":"172.21.15.149:6835","nonce":1748821329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/498363694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":498363694},{"type":"v1","addr":"172.21.15.149:6834","nonce":498363694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1097253256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1097253256},{"type":"v1","addr":"172.21.15.144:6835","nonce":1097253256}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:45:11.209778+0000","modified":"2024-05-30T16:45:14.274711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5235":{"gid":5235,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4243254164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4243254164},{"type":"v1","addr":"172.21.15.144:6837","nonce":4243254164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5235,"qdb_cluster":[5235]},"id":3}]} 2024-05-30T16:47:44.909 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 27 2024-05-30T16:47:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.909+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e2006d120 msgr2=0x7f7e2006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.909+0000 7f7e45e00640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e2006d120 0x7f7e2006f5e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7e4015d3f0 tx=0x7f7e2c009040 comp rx=0 tx=0).stop 2024-05-30T16:47:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400ba2b0 msgr2=0x7f7e401593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400ba2b0 0x7f7e401593c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000d5f0 tx=0x7f7e3000dab0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 shutdown_connections 2024-05-30T16:47:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7e2006d120 0x7f7e2006f5e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015eb80 0x7f7e400c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e400cfc70 0x7f7e40149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 --2- 172.21.15.144:0/3170583323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400ba2b0 0x7f7e401593c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 >> 172.21.15.144:0/3170583323 conn(0x7f7e4006cf40 msgr2=0x7f7e40158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 shutdown_connections 2024-05-30T16:47:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:44.910+0000 7f7e45e00640 1 -- 172.21.15.144:0/3170583323 wait complete. 2024-05-30T16:47:44.928 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:47:45.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.112+0000 7fcc71600640 1 Processor -- start 2024-05-30T16:47:45.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.112+0000 7fcc71600640 1 -- start start 2024-05-30T16:47:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.113+0000 7fcc71600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcc6c13f760 0x7fcc6c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.113+0000 7fcc71600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc6c0cec70 0x7fcc6c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.114+0000 7fcc71600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc6c06ee80 con 0x7fcc6c0b5e00 2024-05-30T16:47:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.114+0000 7fcc71600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fcc6c1612b0 con 0x7fcc6c13f760 2024-05-30T16:47:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.114+0000 7fcc71600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6c13fb40 con 0x7fcc6c0cec70 2024-05-30T16:47:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.114+0000 7fcc6b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcc6c0b5e00 0x7fcc6c142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34858/0 (socket says 172.21.15.144:34858) 2024-05-30T16:47:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.114+0000 7fcc6b400640 1 -- 172.21.15.144:0/2583769559 learned_addr learned my addr 172.21.15.144:0/2583769559 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.114+0000 7fcc63e00640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc6c0cec70 0x7fcc6c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.114+0000 7fcc6aa00640 1 --2- 172.21.15.144:0/2583769559 >> v2:172.21.15.149:3300/0 conn(0x7fcc6c13f760 0x7fcc6c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.114+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940731532 0 0) 0x7fcc6c06ee80 con 0x7fcc6c0b5e00 2024-05-30T16:47:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc50003520 con 0x7fcc6c0b5e00 2024-05-30T16:47:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1262199106 0 0) 0x7fcc50003520 con 0x7fcc6c0b5e00 2024-05-30T16:47:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc6c0cec70 msgr2=0x7fcc6c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc6c0cec70 0x7fcc6c0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 >> v2:172.21.15.149:3300/0 conn(0x7fcc6c13f760 msgr2=0x7fcc6c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 --2- 172.21.15.144:0/2583769559 >> v2:172.21.15.149:3300/0 conn(0x7fcc6c13f760 0x7fcc6c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c160730 con 0x7fcc6c0b5e00 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fcc640019f0 con 0x7fcc6c0b5e00 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 >> v1:172.21.15.144:6789/0 conn(0x7fcc6c0b5e00 legacy=0x7fcc6c142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc500039b0 0x7fcc50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc6c0cec70 0x7fcc50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc50004d40 0x7fcc500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c1612b0 con 0x7fcc500039b0 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5000b9c0 con 0x7fcc50004d40 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5000bb40 con 0x7fcc6c0cec70 2024-05-30T16:47:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.115+0000 7fcc6aa00640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc500039b0 0x7fcc50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.116+0000 7fcc6aa00640 1 -- 172.21.15.144:0/2583769559 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc6c0cec70 msgr2=0x7fcc50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:45.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.116+0000 7fcc6aa00640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc6c0cec70 0x7fcc50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.116+0000 7fcc6aa00640 1 -- 172.21.15.144:0/2583769559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc50004d40 msgr2=0x7fcc500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:45.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.116+0000 7fcc6aa00640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc50004d40 0x7fcc500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.116+0000 7fcc6aa00640 1 -- 172.21.15.144:0/2583769559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc50003520 con 0x7fcc500039b0 2024-05-30T16:47:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.116+0000 7fcc6aa00640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc500039b0 0x7fcc50003dd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009ac0 tx=0x7fcc50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db74e60e419b1c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.117+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c036070 con 0x7fcc500039b0 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.117+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c031400 con 0x7fcc500039b0 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.117+0000 7fcc6a000640 1 -- 172.21.15.144:0/2583769559 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c009690 con 0x7fcc500039b0 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.117+0000 7fcc71600640 1 -- 172.21.15.144:0/2583769559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc500039b0 msgr2=0x7fcc50003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.117+0000 7fcc71600640 1 --2- 172.21.15.144:0/2583769559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc500039b0 0x7fcc50003dd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009ac0 tx=0x7fcc50005830 comp rx=0 tx=0).stop 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.117+0000 7fcc6b400640 1 -- 172.21.15.144:0/2583769559 reap_dead start 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.117+0000 7fcc71600640 1 -- 172.21.15.144:0/2583769559 shutdown_connections 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.117+0000 7fcc71600640 1 -- 172.21.15.144:0/2583769559 >> 172.21.15.144:0/2583769559 conn(0x7fcc6c06bd00 msgr2=0x7fcc6c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.117+0000 7fcc71600640 1 -- 172.21.15.144:0/2583769559 shutdown_connections 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.118+0000 7fcc71600640 1 -- 172.21.15.144:0/2583769559 wait complete. 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.119+0000 7fcc71600640 1 Processor -- start 2024-05-30T16:47:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.119+0000 7fcc71600640 1 -- start start 2024-05-30T16:47:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.120+0000 7fcc71600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc500039b0 0x7fcc6c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.120+0000 7fcc71600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc6c0b4cb0 0x7fcc6c140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.120+0000 7fcc71600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc6c1f4610 0x7fcc6c1f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.120+0000 7fcc71600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c160fd0 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.120+0000 7fcc71600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c160cf0 con 0x7fcc6c1f4610 2024-05-30T16:47:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.120+0000 7fcc71600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6c0cf0d0 con 0x7fcc500039b0 2024-05-30T16:47:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.120+0000 7fcc63e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc6c0b4cb0 0x7fcc6c140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.120+0000 7fcc63e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc6c0b4cb0 0x7fcc6c140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52744/0 (socket says 172.21.15.144:52744) 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.120+0000 7fcc63e00640 1 -- 172.21.15.144:0/1705650427 learned_addr learned my addr 172.21.15.144:0/1705650427 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc6aa00640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc500039b0 0x7fcc6c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc6b400640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc6c1f4610 0x7fcc6c1f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc63e00640 1 -- 172.21.15.144:0/1705650427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc500039b0 msgr2=0x7fcc6c0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc63e00640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc500039b0 0x7fcc6c0b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc63e00640 1 -- 172.21.15.144:0/1705650427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc6c1f4610 msgr2=0x7fcc6c1f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc63e00640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc6c1f4610 0x7fcc6c1f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc63e00640 1 -- 172.21.15.144:0/1705650427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c0b3bf0 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc63e00640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc6c0b4cb0 0x7fcc6c140370 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400e820 tx=0x7fcc5400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc62a00640 1 -- 172.21.15.144:0/1705650427 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54017070 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc62a00640 1 -- 172.21.15.144:0/1705650427 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5400c940 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c0b3e90 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.121+0000 7fcc62a00640 1 -- 172.21.15.144:0/1705650427 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400cd10 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.122+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c0b4450 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.122+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c068b90 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.124+0000 7fcc62a00640 1 -- 172.21.15.144:0/1705650427 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fcc5401a070 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.124+0000 7fcc62a00640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcc4806d0d0 0x7fcc4806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.125+0000 7fcc62a00640 1 -- 172.21.15.144:0/1705650427 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5823+0+0 (secure 0 0 0) 0x7fcc5408cce0 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.125+0000 7fcc6aa00640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcc4806d0d0 0x7fcc4806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.125+0000 7fcc6aa00640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcc4806d0d0 0x7fcc4806f590 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c033000 tx=0x7fcc5c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:45.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.130+0000 7fcc62a00640 1 -- 172.21.15.144:0/1705650427 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc5405a110 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.351+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc6c15e210 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.352+0000 7fcc62a00640 1 -- 172.21.15.144:0/1705650427 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5190 (secure 0 0 0) 0x7fcc54059a10 con 0x7fcc6c0b4cb0 2024-05-30T16:47:45.353 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:45.353 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1748821329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":1748821329},{"type":"v1","addr":"172.21.15.149:6835","nonce":1748821329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/498363694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":498363694},{"type":"v1","addr":"172.21.15.149:6834","nonce":498363694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1097253256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1097253256},{"type":"v1","addr":"172.21.15.144:6835","nonce":1097253256}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:45:11.209778+0000","modified":"2024-05-30T16:45:14.274711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5235":{"gid":5235,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4243254164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4243254164},{"type":"v1","addr":"172.21.15.144:6837","nonce":4243254164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5235,"qdb_cluster":[5235]},"id":3}]} 2024-05-30T16:47:45.353 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 27 2024-05-30T16:47:45.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcc4806d0d0 msgr2=0x7fcc4806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcc4806d0d0 0x7fcc4806f590 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c033000 tx=0x7fcc5c008030 comp rx=0 tx=0).stop 2024-05-30T16:47:45.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc6c0b4cb0 msgr2=0x7fcc6c140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc6c0b4cb0 0x7fcc6c140370 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400e820 tx=0x7fcc5400ece0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 shutdown_connections 2024-05-30T16:47:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcc4806d0d0 0x7fcc4806f590 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc6c1f4610 0x7fcc6c1f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc6c0b4cb0 0x7fcc6c140370 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 --2- 172.21.15.144:0/1705650427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc500039b0 0x7fcc6c0b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 >> 172.21.15.144:0/1705650427 conn(0x7fcc6c06bd00 msgr2=0x7fcc6c13ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 shutdown_connections 2024-05-30T16:47:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.355+0000 7fcc71600640 1 -- 172.21.15.144:0/1705650427 wait complete. 2024-05-30T16:47:45.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:47:45.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.566+0000 7fa567200640 1 Processor -- start 2024-05-30T16:47:45.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.567+0000 7fa567200640 1 -- start start 2024-05-30T16:47:45.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.568+0000 7fa567200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5680d0fe0 0x7fa56806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.568+0000 7fa567200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56806cde0 con 0x7fa56815e8e0 2024-05-30T16:47:45.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.568+0000 7fa567200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56815ecc0 con 0x7fa56809b8b0 2024-05-30T16:47:45.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.568+0000 7fa567200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa56806d060 con 0x7fa5680d0fe0 2024-05-30T16:47:45.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.568+0000 7fa565e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa56815e8e0 0x7fa5680d0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34874/0 (socket says 172.21.15.144:34874) 2024-05-30T16:47:45.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.568+0000 7fa565e00640 1 -- 172.21.15.144:0/437506646 learned_addr learned my addr 172.21.15.144:0/437506646 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:45.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.569+0000 7fa566800640 1 --2- 172.21.15.144:0/437506646 >> v2:172.21.15.144:3300/0 conn(0x7fa5680d0fe0 0x7fa56806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.569+0000 7fa565400640 1 -- 172.21.15.144:0/437506646 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387023803 0 0) 0x7fa558001110 con 0x7fa56815e8e0 2024-05-30T16:47:45.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.569+0000 7fa565400640 1 -- 172.21.15.144:0/437506646 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa54c003520 con 0x7fa56815e8e0 2024-05-30T16:47:45.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.569+0000 7fa566800640 1 -- 172.21.15.144:0/437506646 >> v1:172.21.15.149:6789/0 conn(0x7fa56809b8b0 legacy=0x7fa5680d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.569+0000 7fa566800640 1 -- 172.21.15.144:0/437506646 >> v1:172.21.15.144:6789/0 conn(0x7fa56815e8e0 legacy=0x7fa5680d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.569+0000 7fa566800640 1 -- 172.21.15.144:0/437506646 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56806d300 con 0x7fa5680d0fe0 2024-05-30T16:47:45.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.570+0000 7fa566800640 1 --2- 172.21.15.144:0/437506646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 0x7fa56806dde0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa560009d90 tx=0x7fa56002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8534206b2daa741b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:45.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.571+0000 7fa565400640 1 -- 172.21.15.144:0/437506646 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560007740 con 0x7fa5680d0fe0 2024-05-30T16:47:45.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.571+0000 7fa565400640 1 -- 172.21.15.144:0/437506646 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5600078e0 con 0x7fa5680d0fe0 2024-05-30T16:47:45.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.571+0000 7fa565400640 1 -- 172.21.15.144:0/437506646 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560007cb0 con 0x7fa5680d0fe0 2024-05-30T16:47:45.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.571+0000 7fa567200640 1 -- 172.21.15.144:0/437506646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 msgr2=0x7fa56806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.571+0000 7fa567200640 1 --2- 172.21.15.144:0/437506646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 0x7fa56806dde0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa560009d90 tx=0x7fa56002a660 comp rx=0 tx=0).stop 2024-05-30T16:47:45.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.571+0000 7fa567200640 1 -- 172.21.15.144:0/437506646 shutdown_connections 2024-05-30T16:47:45.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.571+0000 7fa567200640 1 --2- 172.21.15.144:0/437506646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 0x7fa56806dde0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.571+0000 7fa567200640 1 -- 172.21.15.144:0/437506646 >> 172.21.15.144:0/437506646 conn(0x7fa5680d24b0 msgr2=0x7fa5680d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:45.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.572+0000 7fa567200640 1 -- 172.21.15.144:0/437506646 shutdown_connections 2024-05-30T16:47:45.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.572+0000 7fa567200640 1 -- 172.21.15.144:0/437506646 wait complete. 2024-05-30T16:47:45.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.573+0000 7fa567200640 1 Processor -- start 2024-05-30T16:47:45.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.573+0000 7fa567200640 1 -- start start 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.574+0000 7fa567200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56809b8b0 0x7fa568161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.574+0000 7fa567200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 0x7fa56814d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.574+0000 7fa567200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56815e8e0 0x7fa5680708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.574+0000 7fa567200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5680ccb00 con 0x7fa5680d0fe0 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.574+0000 7fa567200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa56806d8c0 con 0x7fa56809b8b0 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.574+0000 7fa567200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa5680ccc80 con 0x7fa56815e8e0 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.574+0000 7fa55fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 0x7fa56814d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 0x7fa56814d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52760/0 (socket says 172.21.15.144:52760) 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55fe00640 1 -- 172.21.15.144:0/2032555437 learned_addr learned my addr 172.21.15.144:0/2032555437 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55fe00640 1 -- 172.21.15.144:0/2032555437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56815e8e0 msgr2=0x7fa5680708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa566800640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56815e8e0 0x7fa5680708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55fe00640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56815e8e0 0x7fa5680708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa565e00640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56809b8b0 0x7fa568161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55fe00640 1 -- 172.21.15.144:0/2032555437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56809b8b0 msgr2=0x7fa568161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55fe00640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56809b8b0 0x7fa568161320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55fe00640 1 -- 172.21.15.144:0/2032555437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa568161860 con 0x7fa5680d0fe0 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55fe00640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 0x7fa56814d890 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c400 tx=0x7fa55000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55e000640 1 -- 172.21.15.144:0/2032555437 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5500052d0 con 0x7fa5680d0fe0 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55e000640 1 -- 172.21.15.144:0/2032555437 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa550005490 con 0x7fa5680d0fe0 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.575+0000 7fa55e000640 1 -- 172.21.15.144:0/2032555437 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550007260 con 0x7fa5680d0fe0 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.576+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56815fe80 con 0x7fa5680d0fe0 2024-05-30T16:47:45.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.576+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa568160840 con 0x7fa5680d0fe0 2024-05-30T16:47:45.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.577+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa568075570 con 0x7fa5680d0fe0 2024-05-30T16:47:45.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.578+0000 7fa55e000640 1 -- 172.21.15.144:0/2032555437 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fa550007400 con 0x7fa5680d0fe0 2024-05-30T16:47:45.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.579+0000 7fa55e000640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa54406d0d0 0x7fa54406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.579+0000 7fa55e000640 1 -- 172.21.15.144:0/2032555437 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5823+0+0 (secure 0 0 0) 0x7fa55008c3d0 con 0x7fa5680d0fe0 2024-05-30T16:47:45.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.579+0000 7fa565e00640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa54406d0d0 0x7fa54406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.579+0000 7fa565e00640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa54406d0d0 0x7fa54406f590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5580012b0 tx=0x7fa558009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.583+0000 7fa55e000640 1 -- 172.21.15.144:0/2032555437 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa550059800 con 0x7fa5680d0fe0 2024-05-30T16:47:45.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.768+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5680d32e0 con 0x7fa5680d0fe0 2024-05-30T16:47:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.770+0000 7fa55e000640 1 -- 172.21.15.144:0/2032555437 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16849 (secure 0 0 0) 0x7fa550059100 con 0x7fa5680d0fe0 2024-05-30T16:47:45.772 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:45.772 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":47,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:47:42.882719+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:45:09.108059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T16:45:10.167194+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:47:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.772+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa54406d0d0 msgr2=0x7fa54406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.772+0000 7fa567200640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa54406d0d0 0x7fa54406f590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5580012b0 tx=0x7fa558009040 comp rx=0 tx=0).stop 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.772+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 msgr2=0x7fa56814d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.772+0000 7fa567200640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 0x7fa56814d890 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c400 tx=0x7fa55000c8c0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.773+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 shutdown_connections 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.773+0000 7fa567200640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa54406d0d0 0x7fa54406f590 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.773+0000 7fa567200640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56815e8e0 0x7fa5680708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.773+0000 7fa567200640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5680d0fe0 0x7fa56814d890 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.773+0000 7fa567200640 1 --2- 172.21.15.144:0/2032555437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56809b8b0 0x7fa568161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.773+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 >> 172.21.15.144:0/2032555437 conn(0x7fa5680d24b0 msgr2=0x7fa5680d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.773+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 shutdown_connections 2024-05-30T16:47:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.773+0000 7fa567200640 1 -- 172.21.15.144:0/2032555437 wait complete. 2024-05-30T16:47:45.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T16:47:45.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.983+0000 7f62ac600640 1 Processor -- start 2024-05-30T16:47:45.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.983+0000 7f62ac600640 1 -- start start 2024-05-30T16:47:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.985+0000 7f62ac600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f62a40ce390 0x7f62a415e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.985+0000 7f62ac600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a415da50 0x7f62a41604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.985+0000 7f62ac600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62a40ce770 0x7f62a406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.985+0000 7f62ac600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f62a415dee0 con 0x7f62a40ce770 2024-05-30T16:47:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.985+0000 7f62ac600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f62a4160a00 con 0x7f62a40ce390 2024-05-30T16:47:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.985+0000 7f62ac600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62a4160c40 con 0x7f62a415da50 2024-05-30T16:47:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.985+0000 7f62aa600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62a40ce770 0x7f62a406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.985+0000 7f62aa600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62a40ce770 0x7f62a406ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52770/0 (socket says 172.21.15.144:52770) 2024-05-30T16:47:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.985+0000 7f62aa600640 1 -- 172.21.15.144:0/1444396060 learned_addr learned my addr 172.21.15.144:0/1444396060 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.986+0000 7f62aa600640 1 -- 172.21.15.144:0/1444396060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a415da50 msgr2=0x7f62a41604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.986+0000 7f62a9200640 1 --2- 172.21.15.144:0/1444396060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a415da50 0x7f62a41604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.986+0000 7f62aa600640 1 --2- 172.21.15.144:0/1444396060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a415da50 0x7f62a41604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.986+0000 7f62aa600640 1 -- 172.21.15.144:0/1444396060 >> v2:172.21.15.149:3300/0 conn(0x7f62a40ce390 msgr2=0x7f62a415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.986+0000 7f62aa600640 1 --2- 172.21.15.144:0/1444396060 >> v2:172.21.15.149:3300/0 conn(0x7f62a40ce390 0x7f62a415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.986+0000 7f62aa600640 1 -- 172.21.15.144:0/1444396060 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a4160f20 con 0x7f62a40ce770 2024-05-30T16:47:45.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.987+0000 7f62aa600640 1 --2- 172.21.15.144:0/1444396060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 0x7f62a406ea70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f62a4074320 tx=0x7f629c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537ef9af9c7a5779 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.987+0000 7f62a3e00640 1 -- 172.21.15.144:0/1444396060 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c036070 con 0x7f62a40ce770 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.987+0000 7f62a3e00640 1 -- 172.21.15.144:0/1444396060 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629c031600 con 0x7f62a40ce770 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.987+0000 7f62a3e00640 1 -- 172.21.15.144:0/1444396060 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c0319d0 con 0x7f62a40ce770 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.988+0000 7f62ac600640 1 -- 172.21.15.144:0/1444396060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 msgr2=0x7f62a406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.988+0000 7f62ac600640 1 --2- 172.21.15.144:0/1444396060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 0x7f62a406ea70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f62a4074320 tx=0x7f629c02a6a0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.988+0000 7f62ac600640 1 -- 172.21.15.144:0/1444396060 shutdown_connections 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.988+0000 7f62ac600640 1 --2- 172.21.15.144:0/1444396060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 0x7f62a406ea70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.988+0000 7f62ac600640 1 --2- 172.21.15.144:0/1444396060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a415da50 0x7f62a41604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.988+0000 7f62ac600640 1 --2- 172.21.15.144:0/1444396060 >> v2:172.21.15.149:3300/0 conn(0x7f62a40ce390 0x7f62a415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.988+0000 7f62ac600640 1 -- 172.21.15.144:0/1444396060 >> 172.21.15.144:0/1444396060 conn(0x7f62a40629c0 msgr2=0x7f62a406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.988+0000 7f62ac600640 1 -- 172.21.15.144:0/1444396060 shutdown_connections 2024-05-30T16:47:45.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.988+0000 7f62ac600640 1 -- 172.21.15.144:0/1444396060 wait complete. 2024-05-30T16:47:45.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.989+0000 7f62ac600640 1 Processor -- start 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.989+0000 7f62ac600640 1 -- start start 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.990+0000 7f62ac600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a40ce390 0x7f62a413ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.990+0000 7f62ac600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 0x7f62a41f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.990+0000 7f62ac600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a415da50 0x7f62a413f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.990+0000 7f62ac600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f62a40ceba0 con 0x7f62a40ce770 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.990+0000 7f62ac600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f62a406e550 con 0x7f62a40ce390 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.990+0000 7f62ac600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62a40ced20 con 0x7f62a415da50 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 0x7f62a41f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 0x7f62a41f7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52774/0 (socket says 172.21.15.144:52774) 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a9200640 1 -- 172.21.15.144:0/898976157 learned_addr learned my addr 172.21.15.144:0/898976157 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a9200640 1 -- 172.21.15.144:0/898976157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a415da50 msgr2=0x7f62a413f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a9200640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a415da50 0x7f62a413f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a9200640 1 -- 172.21.15.144:0/898976157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a40ce390 msgr2=0x7f62a413ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a9200640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a40ce390 0x7f62a413ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a9200640 1 -- 172.21.15.144:0/898976157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a41f8cc0 con 0x7f62a40ce770 2024-05-30T16:47:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a9200640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 0x7f62a41f7d60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f629400c7f0 tx=0x7f629400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a1600640 1 -- 172.21.15.144:0/898976157 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294015070 con 0x7f62a40ce770 2024-05-30T16:47:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a1600640 1 -- 172.21.15.144:0/898976157 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6294004220 con 0x7f62a40ce770 2024-05-30T16:47:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.991+0000 7f62a1600640 1 -- 172.21.15.144:0/898976157 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294007620 con 0x7f62a40ce770 2024-05-30T16:47:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.992+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a41f8700 con 0x7f62a40ce770 2024-05-30T16:47:45.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.992+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a4140da0 con 0x7f62a40ce770 2024-05-30T16:47:45.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.993+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a40ceea0 con 0x7f62a40ce770 2024-05-30T16:47:45.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.993+0000 7f62a1600640 1 -- 172.21.15.144:0/898976157 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f62940079d0 con 0x7f62a40ce770 2024-05-30T16:47:45.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.994+0000 7f62a1600640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f628806d0d0 0x7f628806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:45.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.994+0000 7f62a1600640 1 -- 172.21.15.144:0/898976157 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5823+0+0 (secure 0 0 0) 0x7f629408d3b0 con 0x7f62a40ce770 2024-05-30T16:47:45.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.995+0000 7f62a9c00640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f628806d0d0 0x7f628806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:45.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.995+0000 7f62a9c00640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f628806d0d0 0x7f628806f590 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6298009710 tx=0x7f6298006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:46.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:45.999+0000 7f62a1600640 1 -- 172.21.15.144:0/898976157 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62a40ceea0 con 0x7f62a40ce770 2024-05-30T16:47:46.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.232+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f62a40cddd0 con 0x7f62a40ce770 2024-05-30T16:47:46.235 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-05-30T16:47:46.234+0000 7fd91d600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T16:47:46.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.237+0000 7f62a1600640 1 -- 172.21.15.144:0/898976157 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f629405a640 con 0x7f62a40ce770 2024-05-30T16:47:46.239 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T16:47:46.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.241+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f628806d0d0 msgr2=0x7f628806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:46.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.241+0000 7f62ac600640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f628806d0d0 0x7f628806f590 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6298009710 tx=0x7f6298006c90 comp rx=0 tx=0).stop 2024-05-30T16:47:46.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.241+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 msgr2=0x7f62a41f7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:46.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.241+0000 7f62ac600640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 0x7f62a41f7d60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f629400c7f0 tx=0x7f629400ccb0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.242+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 shutdown_connections 2024-05-30T16:47:46.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.242+0000 7f62ac600640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f628806d0d0 0x7f628806f590 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.242+0000 7f62ac600640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a415da50 0x7f62a413f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.242+0000 7f62ac600640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a40ce770 0x7f62a41f7d60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.242+0000 7f62ac600640 1 --2- 172.21.15.144:0/898976157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a40ce390 0x7f62a413ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.242+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 >> 172.21.15.144:0/898976157 conn(0x7f62a40629c0 msgr2=0x7f62a406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:46.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.242+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 shutdown_connections 2024-05-30T16:47:46.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.242+0000 7f62ac600640 1 -- 172.21.15.144:0/898976157 wait complete. 2024-05-30T16:47:46.262 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T16:47:46.342 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-05-30T16:47:46.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.444+0000 7f6af4200640 1 Processor -- start 2024-05-30T16:47:46.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.444+0000 7f6af4200640 1 -- start start 2024-05-30T16:47:46.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.446+0000 7f6af4200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6aec13f760 0x7f6aec06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:46.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.446+0000 7f6af4200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6aec0b5fd0 0x7f6aec142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:46.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.446+0000 7f6af4200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aec06ee80 con 0x7f6aec0cec70 2024-05-30T16:47:46.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.446+0000 7f6af4200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6aec1612b0 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.446+0000 7f6af4200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6aec13fb40 con 0x7f6aec13f760 2024-05-30T16:47:46.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.446+0000 7f6af2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6aec0b5fd0 0x7f6aec142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:46.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.446+0000 7f6af2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6aec0b5fd0 0x7f6aec142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52800/0 (socket says 172.21.15.144:52800) 2024-05-30T16:47:46.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.446+0000 7f6af2200640 1 -- 172.21.15.144:0/1781915870 learned_addr learned my addr 172.21.15.144:0/1781915870 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:46.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.446+0000 7f6af0e00640 1 --1- 172.21.15.144:0/1781915870 >> v1:172.21.15.144:6789/0 conn(0x7f6aec0cec70 0x7f6aec0b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34892/0 (socket says 172.21.15.144:34892) 2024-05-30T16:47:46.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.447+0000 7f6af2200640 1 -- 172.21.15.144:0/1781915870 >> v2:172.21.15.149:3300/0 conn(0x7f6aec13f760 msgr2=0x7f6aec06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:46.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.447+0000 7f6af2200640 1 --2- 172.21.15.144:0/1781915870 >> v2:172.21.15.149:3300/0 conn(0x7f6aec13f760 0x7f6aec06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.447+0000 7f6af2200640 1 -- 172.21.15.144:0/1781915870 >> v1:172.21.15.144:6789/0 conn(0x7f6aec0cec70 legacy=0x7f6aec0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:46.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.447+0000 7f6af2200640 1 -- 172.21.15.144:0/1781915870 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec160730 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6af2200640 1 --2- 172.21.15.144:0/1781915870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 0x7f6aec142200 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6aec06e8a0 tx=0x7f6ae402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f68df46fe92a3dd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6aebe00640 1 -- 172.21.15.144:0/1781915870 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4037070 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6aebe00640 1 -- 172.21.15.144:0/1781915870 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae4032440 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6aebe00640 1 -- 172.21.15.144:0/1781915870 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4032810 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6af4200640 1 -- 172.21.15.144:0/1781915870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 msgr2=0x7f6aec142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6af4200640 1 --2- 172.21.15.144:0/1781915870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 0x7f6aec142200 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6aec06e8a0 tx=0x7f6ae402a270 comp rx=0 tx=0).stop 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6af4200640 1 -- 172.21.15.144:0/1781915870 shutdown_connections 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6af4200640 1 --2- 172.21.15.144:0/1781915870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 0x7f6aec142200 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6af4200640 1 --2- 172.21.15.144:0/1781915870 >> v2:172.21.15.149:3300/0 conn(0x7f6aec13f760 0x7f6aec06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.448+0000 7f6af4200640 1 -- 172.21.15.144:0/1781915870 >> 172.21.15.144:0/1781915870 conn(0x7f6aec06bd00 msgr2=0x7f6aec06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:46.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.449+0000 7f6af4200640 1 -- 172.21.15.144:0/1781915870 shutdown_connections 2024-05-30T16:47:46.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.449+0000 7f6af4200640 1 -- 172.21.15.144:0/1781915870 wait complete. 2024-05-30T16:47:46.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.450+0000 7f6af4200640 1 Processor -- start 2024-05-30T16:47:46.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.450+0000 7f6af4200640 1 -- start start 2024-05-30T16:47:46.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.451+0000 7f6af4200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 0x7f6aec166d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:46.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.451+0000 7f6af4200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6aec0cec70 0x7f6aec156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:46.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.451+0000 7f6af4200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6aec13f760 0x7f6aec156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:46.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.451+0000 7f6af4200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec160fd0 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.451+0000 7f6af4200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec160cf0 con 0x7f6aec13f760 2024-05-30T16:47:46.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.451+0000 7f6af4200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6aec0ce6a0 con 0x7f6aec0cec70 2024-05-30T16:47:46.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.451+0000 7f6af1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 0x7f6aec166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:46.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.451+0000 7f6af1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 0x7f6aec166d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52802/0 (socket says 172.21.15.144:52802) 2024-05-30T16:47:46.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.451+0000 7f6af1800640 1 -- 172.21.15.144:0/1116132552 learned_addr learned my addr 172.21.15.144:0/1116132552 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af2200640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6aec13f760 0x7f6aec156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af1800640 1 -- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6aec0cec70 msgr2=0x7f6aec156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af0e00640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6aec0cec70 0x7f6aec156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af1800640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6aec0cec70 0x7f6aec156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af1800640 1 -- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6aec13f760 msgr2=0x7f6aec156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af1800640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6aec13f760 0x7f6aec156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af1800640 1 -- 172.21.15.144:0/1116132552 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec13ee10 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af2200640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6aec13f760 0x7f6aec156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af0e00640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6aec0cec70 0x7f6aec156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6af1800640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 0x7f6aec166d00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000ba50 tx=0x7f6ae000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.452+0000 7f6ae9600640 1 -- 172.21.15.144:0/1116132552 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0019070 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.453+0000 7f6ae9600640 1 -- 172.21.15.144:0/1116132552 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae000cc00 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.453+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aec13f0f0 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.453+0000 7f6ae9600640 1 -- 172.21.15.144:0/1116132552 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0014440 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.453+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aec15b6b0 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.454+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aec068b90 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.455+0000 7f6ae9600640 1 -- 172.21.15.144:0/1116132552 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f6ae001c070 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.456+0000 7f6ae9600640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6acc06d0d0 0x7f6acc06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:46.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.456+0000 7f6ae9600640 1 -- 172.21.15.144:0/1116132552 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5881+0+0 (secure 0 0 0) 0x7f6ae008ccc0 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.456+0000 7f6af0e00640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6acc06d0d0 0x7f6acc06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:46.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.457+0000 7f6af0e00640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6acc06d0d0 0x7f6acc06f590 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6aec15ade0 tx=0x7f6ad8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:46.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.460+0000 7f6ae9600640 1 -- 172.21.15.144:0/1116132552 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6ae005a020 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:46.684+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6aec15e900 con 0x7f6aec0b5fd0 2024-05-30T16:47:46.740 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:47:46.788 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:47:47.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.241+0000 7f6ae9600640 1 -- 172.21.15.144:0/1116132552 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f6ae0059920 con 0x7f6aec0b5fd0 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6acc06d0d0 msgr2=0x7f6acc06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6acc06d0d0 0x7f6acc06f590 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6aec15ade0 tx=0x7f6ad8009040 comp rx=0 tx=0).stop 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 msgr2=0x7f6aec166d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 0x7f6aec166d00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000ba50 tx=0x7f6ae000bf10 comp rx=0 tx=0).stop 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 shutdown_connections 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6acc06d0d0 0x7f6acc06f590 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6aec13f760 0x7f6aec156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6aec0cec70 0x7f6aec156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 --2- 172.21.15.144:0/1116132552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aec0b5fd0 0x7f6aec166d00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:47.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 >> 172.21.15.144:0/1116132552 conn(0x7f6aec06bd00 msgr2=0x7f6aec15cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:47.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 shutdown_connections 2024-05-30T16:47:47.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.245+0000 7f6af4200640 1 -- 172.21.15.144:0/1116132552 wait complete. 2024-05-30T16:47:47.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T16:47:47.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.473+0000 7fb63bc00640 1 Processor -- start 2024-05-30T16:47:47.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.473+0000 7fb63bc00640 1 -- start start 2024-05-30T16:47:47.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.475+0000 7fb63bc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb63413f760 0x7fb63406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:47.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.475+0000 7fb63bc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340cec70 0x7fb6340b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:47.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.475+0000 7fb63bc00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63406ee80 con 0x7fb6340b5e00 2024-05-30T16:47:47.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.475+0000 7fb63bc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb6341612b0 con 0x7fb63413f760 2024-05-30T16:47:47.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.475+0000 7fb63bc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb63413fb40 con 0x7fb6340cec70 2024-05-30T16:47:47.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.476+0000 7fb633e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340cec70 0x7fb6340b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:47.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.476+0000 7fb639200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb63413f760 0x7fb63406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:47.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.476+0000 7fb639200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb63413f760 0x7fb63406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:56472/0 (socket says 172.21.15.144:56472) 2024-05-30T16:47:47.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.476+0000 7fb639200640 1 -- 172.21.15.144:0/1937021499 learned_addr learned my addr 172.21.15.144:0/1937021499 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:47.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.477+0000 7fb639200640 1 -- 172.21.15.144:0/1937021499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340cec70 msgr2=0x7fb6340b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:47.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.477+0000 7fb639200640 1 --2- 172.21.15.144:0/1937021499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340cec70 0x7fb6340b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:47.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.477+0000 7fb639200640 1 -- 172.21.15.144:0/1937021499 >> v1:172.21.15.149:6789/0 conn(0x7fb6340b5e00 legacy=0x7fb634142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:47.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.477+0000 7fb639200640 1 -- 172.21.15.144:0/1937021499 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb634160730 con 0x7fb63413f760 2024-05-30T16:47:47.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.478+0000 7fb639200640 1 --2- 172.21.15.144:0/1937021499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 0x7fb63406e940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb62802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=505db2acad854465 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:47.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.478+0000 7fb633400640 1 -- 172.21.15.144:0/1937021499 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628037070 con 0x7fb63413f760 2024-05-30T16:47:47.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.478+0000 7fb633400640 1 -- 172.21.15.144:0/1937021499 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62802ae50 con 0x7fb63413f760 2024-05-30T16:47:47.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.478+0000 7fb633400640 1 -- 172.21.15.144:0/1937021499 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628032860 con 0x7fb63413f760 2024-05-30T16:47:47.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.479+0000 7fb63bc00640 1 -- 172.21.15.144:0/1937021499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 msgr2=0x7fb63406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:47.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.479+0000 7fb63bc00640 1 --2- 172.21.15.144:0/1937021499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 0x7fb63406e940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb62802a300 comp rx=0 tx=0).stop 2024-05-30T16:47:47.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.479+0000 7fb63bc00640 1 -- 172.21.15.144:0/1937021499 shutdown_connections 2024-05-30T16:47:47.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.479+0000 7fb63bc00640 1 --2- 172.21.15.144:0/1937021499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340cec70 0x7fb6340b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:47.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.479+0000 7fb63bc00640 1 --2- 172.21.15.144:0/1937021499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 0x7fb63406e940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:47.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.479+0000 7fb63bc00640 1 -- 172.21.15.144:0/1937021499 >> 172.21.15.144:0/1937021499 conn(0x7fb63406bd00 msgr2=0x7fb63406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:47.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.479+0000 7fb63bc00640 1 -- 172.21.15.144:0/1937021499 shutdown_connections 2024-05-30T16:47:47.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.479+0000 7fb63bc00640 1 -- 172.21.15.144:0/1937021499 wait complete. 2024-05-30T16:47:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.481+0000 7fb63bc00640 1 Processor -- start 2024-05-30T16:47:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.481+0000 7fb63bc00640 1 -- start start 2024-05-30T16:47:47.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.482+0000 7fb63bc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340b5e00 0x7fb634130a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:47.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.482+0000 7fb63bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6340cec70 0x7fb63413c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:47.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.482+0000 7fb63bc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 0x7fb6340ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:47.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.482+0000 7fb63bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb634160fd0 con 0x7fb6340cec70 2024-05-30T16:47:47.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.482+0000 7fb63bc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb634160cf0 con 0x7fb63413f760 2024-05-30T16:47:47.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.482+0000 7fb63bc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340cf0d0 con 0x7fb6340b5e00 2024-05-30T16:47:47.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.482+0000 7fb633e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6340cec70 0x7fb63413c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.482+0000 7fb633e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6340cec70 0x7fb63413c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52806/0 (socket says 172.21.15.144:52806) 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.482+0000 7fb633e00640 1 -- 172.21.15.144:0/680686399 learned_addr learned my addr 172.21.15.144:0/680686399 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb639200640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340b5e00 0x7fb634130a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb639c00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 0x7fb6340ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb633e00640 1 -- 172.21.15.144:0/680686399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340b5e00 msgr2=0x7fb634130a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb633e00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340b5e00 0x7fb634130a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb633e00640 1 -- 172.21.15.144:0/680686399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 msgr2=0x7fb6340ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb633e00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 0x7fb6340ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb633e00640 1 -- 172.21.15.144:0/680686399 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63413b7e0 con 0x7fb6340cec70 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb639c00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 0x7fb6340ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb633e00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6340cec70 0x7fb63413c280 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb62000e9b0 tx=0x7fb62000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb630c00640 1 -- 172.21.15.144:0/680686399 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620017070 con 0x7fb6340cec70 2024-05-30T16:47:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb630c00640 1 -- 172.21.15.144:0/680686399 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62000c9a0 con 0x7fb6340cec70 2024-05-30T16:47:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6340b10e0 con 0x7fb6340cec70 2024-05-30T16:47:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.483+0000 7fb630c00640 1 -- 172.21.15.144:0/680686399 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62000cd90 con 0x7fb6340cec70 2024-05-30T16:47:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.484+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63413bd60 con 0x7fb6340cec70 2024-05-30T16:47:47.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.485+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb634068b90 con 0x7fb6340cec70 2024-05-30T16:47:47.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.486+0000 7fb630c00640 1 -- 172.21.15.144:0/680686399 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fb62001a070 con 0x7fb6340cec70 2024-05-30T16:47:47.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.487+0000 7fb630c00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61406d0d0 0x7fb61406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:47.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.487+0000 7fb630c00640 1 -- 172.21.15.144:0/680686399 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5881+0+0 (secure 0 0 0) 0x7fb62008a560 con 0x7fb6340cec70 2024-05-30T16:47:47.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.487+0000 7fb639200640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61406d0d0 0x7fb61406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:47.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.488+0000 7fb639200640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61406d0d0 0x7fb61406f590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb628034000 tx=0x7fb62802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:47.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.491+0000 7fb630c00640 1 -- 172.21.15.144:0/680686399 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb620092020 con 0x7fb6340cec70 2024-05-30T16:47:47.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:47.694+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb63413ff20 con 0x7fb6340cec70 2024-05-30T16:47:48.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.245+0000 7fb630c00640 1 -- 172.21.15.144:0/680686399 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) ==== 181+0+0 (secure 0 0 0) 0x7fb62005a280 con 0x7fb6340cec70 2024-05-30T16:47:48.246 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-05-30T16:47:48.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.249+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61406d0d0 msgr2=0x7fb61406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:48.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.249+0000 7fb63bc00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61406d0d0 0x7fb61406f590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb628034000 tx=0x7fb62802e000 comp rx=0 tx=0).stop 2024-05-30T16:47:48.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.249+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6340cec70 msgr2=0x7fb63413c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:48.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.249+0000 7fb63bc00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6340cec70 0x7fb63413c280 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb62000e9b0 tx=0x7fb62000ee70 comp rx=0 tx=0).stop 2024-05-30T16:47:48.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.251+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 shutdown_connections 2024-05-30T16:47:48.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.251+0000 7fb63bc00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61406d0d0 0x7fb61406f590 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:48.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.251+0000 7fb63bc00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63413f760 0x7fb6340ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:48.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.251+0000 7fb63bc00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6340cec70 0x7fb63413c280 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:48.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.251+0000 7fb63bc00640 1 --2- 172.21.15.144:0/680686399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6340b5e00 0x7fb634130a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:48.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.251+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 >> 172.21.15.144:0/680686399 conn(0x7fb63406bd00 msgr2=0x7fb63406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:48.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.252+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 shutdown_connections 2024-05-30T16:47:48.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.252+0000 7fb63bc00640 1 -- 172.21.15.144:0/680686399 wait complete. 2024-05-30T16:47:48.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T16:47:48.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.472+0000 7f49c9600640 1 Processor -- start 2024-05-30T16:47:48.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.473+0000 7f49c9600640 1 -- start start 2024-05-30T16:47:48.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.474+0000 7f49c9600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49c4163310 0x7f49c40b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:48.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.474+0000 7f49c9600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f49c406c980 0x7f49c416c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:48.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.474+0000 7f49c9600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c40b4e80 con 0x7f49c40af2d0 2024-05-30T16:47:48.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.474+0000 7f49c9600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f49c40b5160 con 0x7f49c4163310 2024-05-30T16:47:48.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.474+0000 7f49c9600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f49c40b5440 con 0x7f49c406c980 2024-05-30T16:47:48.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.474+0000 7f49c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49c4163310 0x7f49c40b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:48.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.474+0000 7f49c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49c4163310 0x7f49c40b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52816/0 (socket says 172.21.15.144:52816) 2024-05-30T16:47:48.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.474+0000 7f49c2a00640 1 -- 172.21.15.144:0/691300245 learned_addr learned my addr 172.21.15.144:0/691300245 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:48.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.474+0000 7f49c3400640 1 --2- 172.21.15.144:0/691300245 >> v2:172.21.15.149:3300/0 conn(0x7f49c406c980 0x7f49c416c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:48.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.475+0000 7f49c2a00640 1 -- 172.21.15.144:0/691300245 >> v2:172.21.15.149:3300/0 conn(0x7f49c406c980 msgr2=0x7f49c416c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:48.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.475+0000 7f49c2a00640 1 --2- 172.21.15.144:0/691300245 >> v2:172.21.15.149:3300/0 conn(0x7f49c406c980 0x7f49c416c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:48.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.475+0000 7f49c2a00640 1 -- 172.21.15.144:0/691300245 >> v1:172.21.15.149:6789/0 conn(0x7f49c40af2d0 legacy=0x7f49c41636f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:48.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.475+0000 7f49c2a00640 1 -- 172.21.15.144:0/691300245 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c40b5720 con 0x7f49c4163310 2024-05-30T16:47:48.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.476+0000 7f49c2a00640 1 --2- 172.21.15.144:0/691300245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c4163310 0x7f49c40b4510 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009870 tx=0x7f49b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37651566bd58bc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:48.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.476+0000 7f49c1600640 1 -- 172.21.15.144:0/691300245 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4037070 con 0x7f49c4163310 2024-05-30T16:47:48.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.476+0000 7f49c1600640 1 -- 172.21.15.144:0/691300245 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b4032440 con 0x7f49c4163310 2024-05-30T16:47:48.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.476+0000 7f49c1600640 1 -- 172.21.15.144:0/691300245 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4032810 con 0x7f49c4163310 2024-05-30T16:47:48.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.477+0000 7f49c9600640 1 -- 172.21.15.144:0/691300245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c4163310 msgr2=0x7f49c40b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:48.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.477+0000 7f49c9600640 1 --2- 172.21.15.144:0/691300245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c4163310 0x7f49c40b4510 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009870 tx=0x7f49b402a270 comp rx=0 tx=0).stop 2024-05-30T16:47:48.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.477+0000 7f49c9600640 1 -- 172.21.15.144:0/691300245 shutdown_connections 2024-05-30T16:47:48.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.477+0000 7f49c9600640 1 --2- 172.21.15.144:0/691300245 >> v2:172.21.15.149:3300/0 conn(0x7f49c406c980 0x7f49c416c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:48.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.477+0000 7f49c9600640 1 --2- 172.21.15.144:0/691300245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c4163310 0x7f49c40b4510 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:48.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.477+0000 7f49c9600640 1 -- 172.21.15.144:0/691300245 >> 172.21.15.144:0/691300245 conn(0x7f49c40d10a0 msgr2=0x7f49c40d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:48.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.477+0000 7f49c9600640 1 -- 172.21.15.144:0/691300245 shutdown_connections 2024-05-30T16:47:48.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.477+0000 7f49c9600640 1 -- 172.21.15.144:0/691300245 wait complete. 2024-05-30T16:47:48.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.479+0000 7f49c9600640 1 Processor -- start 2024-05-30T16:47:48.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.479+0000 7f49c9600640 1 -- start start 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.480+0000 7f49c9600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49c406c980 0x7f49c414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.480+0000 7f49c9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c40af2d0 0x7f49c41509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.480+0000 7f49c9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49c4163310 0x7f49c4151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.480+0000 7f49c9600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49c40b4bd0 con 0x7f49c40af2d0 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.480+0000 7f49c9600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f49c40b4a50 con 0x7f49c406c980 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.480+0000 7f49c9600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49c4163e00 con 0x7f49c4163310 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.480+0000 7f49c2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c40af2d0 0x7f49c41509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.480+0000 7f49c2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c40af2d0 0x7f49c41509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52820/0 (socket says 172.21.15.144:52820) 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.480+0000 7f49c2000640 1 -- 172.21.15.144:0/1242756942 learned_addr learned my addr 172.21.15.144:0/1242756942 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:48.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49c2a00640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49c406c980 0x7f49c414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:48.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49c3400640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49c4163310 0x7f49c4151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:48.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49c2000640 1 -- 172.21.15.144:0/1242756942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49c4163310 msgr2=0x7f49c4151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:48.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49c2000640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49c4163310 0x7f49c4151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:48.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49c2000640 1 -- 172.21.15.144:0/1242756942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49c406c980 msgr2=0x7f49c414d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:48.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49c2000640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49c406c980 0x7f49c414d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:48.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49c2000640 1 -- 172.21.15.144:0/1242756942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c4150ef0 con 0x7f49c40af2d0 2024-05-30T16:47:48.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49c2000640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c40af2d0 0x7f49c41509b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00c7c0 tx=0x7f49ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:48.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49baa00640 1 -- 172.21.15.144:0/1242756942 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac016020 con 0x7f49c40af2d0 2024-05-30T16:47:48.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49baa00640 1 -- 172.21.15.144:0/1242756942 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac00aa50 con 0x7f49c40af2d0 2024-05-30T16:47:48.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49baa00640 1 -- 172.21.15.144:0/1242756942 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac012420 con 0x7f49c40af2d0 2024-05-30T16:47:48.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.481+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c414df10 con 0x7f49c40af2d0 2024-05-30T16:47:48.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.482+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c414e490 con 0x7f49c40af2d0 2024-05-30T16:47:48.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.483+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c4068b90 con 0x7f49c40af2d0 2024-05-30T16:47:48.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.484+0000 7f49baa00640 1 -- 172.21.15.144:0/1242756942 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f49ac019020 con 0x7f49c40af2d0 2024-05-30T16:47:48.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.485+0000 7f49baa00640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49a006d100 0x7f49a006f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:48.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.485+0000 7f49baa00640 1 -- 172.21.15.144:0/1242756942 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5443+0+0 (secure 0 0 0) 0x7f49ac08ca50 con 0x7f49c40af2d0 2024-05-30T16:47:48.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.485+0000 7f49c2a00640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49a006d100 0x7f49a006f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:48.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.486+0000 7f49c2a00640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49a006d100 0x7f49a006f5c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f49b4034000 tx=0x7f49b402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:48.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.489+0000 7f49baa00640 1 -- 172.21.15.144:0/1242756942 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49ac020070 con 0x7f49c40af2d0 2024-05-30T16:47:48.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:48.690+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f49c4070890 con 0x7f49c40af2d0 2024-05-30T16:47:49.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.248+0000 7f49baa00640 1 -- 172.21.15.144:0/1242756942 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) ==== 169+0+0 (secure 0 0 0) 0x7f49c4150ef0 con 0x7f49c40af2d0 2024-05-30T16:47:49.250 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-05-30T16:47:49.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49a006d100 msgr2=0x7f49a006f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49a006d100 0x7f49a006f5c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f49b4034000 tx=0x7f49b402e000 comp rx=0 tx=0).stop 2024-05-30T16:47:49.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c40af2d0 msgr2=0x7f49c41509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c40af2d0 0x7f49c41509b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00c7c0 tx=0x7f49ac00cc80 comp rx=0 tx=0).stop 2024-05-30T16:47:49.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 shutdown_connections 2024-05-30T16:47:49.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f49a006d100 0x7f49a006f5c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49c4163310 0x7f49c4151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c40af2d0 0x7f49c41509b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 --2- 172.21.15.144:0/1242756942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49c406c980 0x7f49c414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 >> 172.21.15.144:0/1242756942 conn(0x7f49c40d10a0 msgr2=0x7f49c4161030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:49.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 shutdown_connections 2024-05-30T16:47:49.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.252+0000 7f49c9600640 1 -- 172.21.15.144:0/1242756942 wait complete. 2024-05-30T16:47:49.284 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T16:47:49.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.487+0000 7f071c600640 1 Processor -- start 2024-05-30T16:47:49.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.487+0000 7f071c600640 1 -- start start 2024-05-30T16:47:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f071c600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f071406ee20 0x7f071415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f071c600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07140b3fd0 con 0x7f07141418f0 2024-05-30T16:47:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f071c600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0714144790 con 0x7f0714141510 2024-05-30T16:47:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f071c600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f071406dfc0 con 0x7f071406ee20 2024-05-30T16:47:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f071a600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f071406ee20 0x7f071415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f0719200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f07141418f0 0x7f071406e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34902/0 (socket says 172.21.15.144:34902) 2024-05-30T16:47:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f0719200640 1 -- 172.21.15.144:0/2756113004 learned_addr learned my addr 172.21.15.144:0/2756113004 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f071a600640 1 -- 172.21.15.144:0/2756113004 >> v1:172.21.15.149:6789/0 conn(0x7f0714141510 legacy=0x7f07140b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f071a600640 1 -- 172.21.15.144:0/2756113004 >> v1:172.21.15.144:6789/0 conn(0x7f07141418f0 legacy=0x7f071406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f071a600640 1 -- 172.21.15.144:0/2756113004 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0714144a70 con 0x7f071406ee20 2024-05-30T16:47:49.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.489+0000 7f0713e00640 1 -- 172.21.15.144:0/2756113004 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1177755603 0 0) 0x7f07140b3fd0 con 0x7f07141418f0 2024-05-30T16:47:49.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.490+0000 7f071a600640 1 --2- 172.21.15.144:0/2756113004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 0x7f071415f8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c02a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b764f0bf2a625f2a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:49.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.491+0000 7f0713e00640 1 -- 172.21.15.144:0/2756113004 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c007740 con 0x7f071406ee20 2024-05-30T16:47:49.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.491+0000 7f0713e00640 1 -- 172.21.15.144:0/2756113004 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c0078e0 con 0x7f071406ee20 2024-05-30T16:47:49.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.491+0000 7f0713e00640 1 -- 172.21.15.144:0/2756113004 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c007cb0 con 0x7f071406ee20 2024-05-30T16:47:49.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.491+0000 7f071c600640 1 -- 172.21.15.144:0/2756113004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 msgr2=0x7f071415f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.491+0000 7f071c600640 1 --2- 172.21.15.144:0/2756113004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 0x7f071415f8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c02a580 comp rx=0 tx=0).stop 2024-05-30T16:47:49.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.491+0000 7f071c600640 1 -- 172.21.15.144:0/2756113004 shutdown_connections 2024-05-30T16:47:49.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.491+0000 7f071c600640 1 --2- 172.21.15.144:0/2756113004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 0x7f071415f8f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.491+0000 7f071c600640 1 -- 172.21.15.144:0/2756113004 >> 172.21.15.144:0/2756113004 conn(0x7f071406bd00 msgr2=0x7f071406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:49.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.492+0000 7f071c600640 1 -- 172.21.15.144:0/2756113004 shutdown_connections 2024-05-30T16:47:49.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.492+0000 7f071c600640 1 -- 172.21.15.144:0/2756113004 wait complete. 2024-05-30T16:47:49.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.493+0000 7f071c600640 1 Processor -- start 2024-05-30T16:47:49.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.493+0000 7f071c600640 1 -- start start 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.494+0000 7f071c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 0x7f07140b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.494+0000 7f071c600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0714141510 0x7f0714145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.494+0000 7f071c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07141418f0 0x7f07141579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.494+0000 7f071c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f07140b5b50 con 0x7f071406ee20 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.494+0000 7f071c600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f071406e210 con 0x7f0714141510 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.494+0000 7f071c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f07140b5cd0 con 0x7f07141418f0 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 0x7f07140b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 0x7f07140b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52850/0 (socket says 172.21.15.144:52850) 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719c00640 1 -- 172.21.15.144:0/312085935 learned_addr learned my addr 172.21.15.144:0/312085935 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719200640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0714141510 0x7f0714145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f071a600640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07141418f0 0x7f07141579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719c00640 1 -- 172.21.15.144:0/312085935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07141418f0 msgr2=0x7f07141579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719c00640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07141418f0 0x7f07141579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719c00640 1 -- 172.21.15.144:0/312085935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0714141510 msgr2=0x7f0714145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719c00640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0714141510 0x7f0714145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719c00640 1 -- 172.21.15.144:0/312085935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071413e6a0 con 0x7f071406ee20 2024-05-30T16:47:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719200640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0714141510 0x7f0714145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.495+0000 7f0719c00640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 0x7f07140b02e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f070800c430 tx=0x7f070800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:49.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.496+0000 7f0711600640 1 -- 172.21.15.144:0/312085935 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708011790 con 0x7f071406ee20 2024-05-30T16:47:49.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.496+0000 7f0711600640 1 -- 172.21.15.144:0/312085935 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0708017070 con 0x7f071406ee20 2024-05-30T16:47:49.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.496+0000 7f0711600640 1 -- 172.21.15.144:0/312085935 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708011bb0 con 0x7f071406ee20 2024-05-30T16:47:49.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.496+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07140b08c0 con 0x7f071406ee20 2024-05-30T16:47:49.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.496+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07140b0e80 con 0x7f071406ee20 2024-05-30T16:47:49.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.497+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0714068b90 con 0x7f071406ee20 2024-05-30T16:47:49.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.498+0000 7f0711600640 1 -- 172.21.15.144:0/312085935 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f070801c460 con 0x7f071406ee20 2024-05-30T16:47:49.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.499+0000 7f0711600640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f06f406d0d0 0x7f06f406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.499+0000 7f0711600640 1 -- 172.21.15.144:0/312085935 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4971+0+0 (secure 0 0 0) 0x7f070808ca60 con 0x7f071406ee20 2024-05-30T16:47:49.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.499+0000 7f0719200640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f06f406d0d0 0x7f06f406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.500+0000 7f0719200640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f06f406d0d0 0x7f06f406f590 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0714140a60 tx=0x7f0700009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:49.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.504+0000 7f0711600640 1 -- 172.21.15.144:0/312085935 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f071413e6a0 con 0x7f071406ee20 2024-05-30T16:47:49.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.706+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f071406c1e0 con 0x7f071406ee20 2024-05-30T16:47:49.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.711+0000 7f0711600640 1 -- 172.21.15.144:0/312085935 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f070805a150 con 0x7f071406ee20 2024-05-30T16:47:49.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f06f406d0d0 msgr2=0x7f06f406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f06f406d0d0 0x7f06f406f590 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0714140a60 tx=0x7f0700009040 comp rx=0 tx=0).stop 2024-05-30T16:47:49.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 msgr2=0x7f07140b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 0x7f07140b02e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f070800c430 tx=0x7f070800c8f0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 shutdown_connections 2024-05-30T16:47:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f06f406d0d0 0x7f06f406f590 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07141418f0 0x7f07141579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0714141510 0x7f0714145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 --2- 172.21.15.144:0/312085935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f071406ee20 0x7f07140b02e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 >> 172.21.15.144:0/312085935 conn(0x7f071406bd00 msgr2=0x7f07140ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 shutdown_connections 2024-05-30T16:47:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.715+0000 7f071c600640 1 -- 172.21.15.144:0/312085935 wait complete. 2024-05-30T16:47:49.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones' 2024-05-30T16:47:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.931+0000 7ff8a1e00640 1 Processor -- start 2024-05-30T16:47:49.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.931+0000 7ff8a1e00640 1 -- start start 2024-05-30T16:47:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.933+0000 7ff8a1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.933+0000 7ff8a1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff89c0b5e00 0x7ff89c142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.933+0000 7ff8a1e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89c160730 con 0x7ff89c13f760 2024-05-30T16:47:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.933+0000 7ff8a1e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff89c1612b0 con 0x7ff89c0b5e00 2024-05-30T16:47:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.933+0000 7ff8a1e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff89c13fb40 con 0x7ff89c0cec70 2024-05-30T16:47:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.933+0000 7ff89b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff89c0b5e00 0x7ff89c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.933+0000 7ff89b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff89c0b5e00 0x7ff89c142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52866/0 (socket says 172.21.15.144:52866) 2024-05-30T16:47:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.933+0000 7ff89b400640 1 -- 172.21.15.144:0/4012416811 learned_addr learned my addr 172.21.15.144:0/4012416811 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.934+0000 7ff89a000640 1 --2- 172.21.15.144:0/4012416811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.934+0000 7ff89b400640 1 -- 172.21.15.144:0/4012416811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 msgr2=0x7ff89c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.934+0000 7ff89b400640 1 --2- 172.21.15.144:0/4012416811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.934+0000 7ff89b400640 1 -- 172.21.15.144:0/4012416811 >> v1:172.21.15.149:6789/0 conn(0x7ff89c13f760 legacy=0x7ff89c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.934+0000 7ff89b400640 1 -- 172.21.15.144:0/4012416811 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c160a10 con 0x7ff89c0b5e00 2024-05-30T16:47:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.934+0000 7ff89a000640 1 --2- 172.21.15.144:0/4012416811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.935+0000 7ff89b400640 1 --2- 172.21.15.144:0/4012416811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c0b5e00 0x7ff89c142200 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff894009e50 tx=0x7ff89402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74a44657c7b85a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.935+0000 7ff899600640 1 -- 172.21.15.144:0/4012416811 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894036070 con 0x7ff89c0b5e00 2024-05-30T16:47:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.935+0000 7ff899600640 1 -- 172.21.15.144:0/4012416811 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff894031600 con 0x7ff89c0b5e00 2024-05-30T16:47:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.935+0000 7ff899600640 1 -- 172.21.15.144:0/4012416811 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8940319d0 con 0x7ff89c0b5e00 2024-05-30T16:47:49.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.936+0000 7ff8a1e00640 1 -- 172.21.15.144:0/4012416811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c0b5e00 msgr2=0x7ff89c142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.936+0000 7ff8a1e00640 1 --2- 172.21.15.144:0/4012416811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c0b5e00 0x7ff89c142200 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff894009e50 tx=0x7ff89402a750 comp rx=0 tx=0).stop 2024-05-30T16:47:49.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.936+0000 7ff8a1e00640 1 -- 172.21.15.144:0/4012416811 shutdown_connections 2024-05-30T16:47:49.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.936+0000 7ff8a1e00640 1 --2- 172.21.15.144:0/4012416811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c0b5e00 0x7ff89c142200 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.936+0000 7ff8a1e00640 1 --2- 172.21.15.144:0/4012416811 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.936+0000 7ff8a1e00640 1 -- 172.21.15.144:0/4012416811 >> 172.21.15.144:0/4012416811 conn(0x7ff89c06bd00 msgr2=0x7ff89c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.936+0000 7ff8a1e00640 1 -- 172.21.15.144:0/4012416811 shutdown_connections 2024-05-30T16:47:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.936+0000 7ff8a1e00640 1 -- 172.21.15.144:0/4012416811 wait complete. 2024-05-30T16:47:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.938+0000 7ff8a1e00640 1 Processor -- start 2024-05-30T16:47:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.938+0000 7ff8a1e00640 1 -- start start 2024-05-30T16:47:49.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.939+0000 7ff8a1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c0b5e00 0x7ff89c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.939+0000 7ff8a1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.939+0000 7ff8a1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c13f760 0x7ff89c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.939+0000 7ff8a1e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c0cf0d0 con 0x7ff89c13f760 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.939+0000 7ff8a1e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c160fd0 con 0x7ff89c0b5e00 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.939+0000 7ff8a1e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff89c0cf250 con 0x7ff89c0cec70 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.939+0000 7ff89b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c13f760 0x7ff89c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.939+0000 7ff89b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c13f760 0x7ff89c0b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52870/0 (socket says 172.21.15.144:52870) 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.939+0000 7ff89b400640 1 -- 172.21.15.144:0/2077015025 learned_addr learned my addr 172.21.15.144:0/2077015025 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.940+0000 7ff89aa00640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c0b5e00 0x7ff89c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.940+0000 7ff89a000640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.940+0000 7ff89b400640 1 -- 172.21.15.144:0/2077015025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 msgr2=0x7ff89c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.940+0000 7ff89b400640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.940+0000 7ff89b400640 1 -- 172.21.15.144:0/2077015025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c0b5e00 msgr2=0x7ff89c152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.940+0000 7ff89b400640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c0b5e00 0x7ff89c152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.940+0000 7ff89b400640 1 -- 172.21.15.144:0/2077015025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c155940 con 0x7ff89c13f760 2024-05-30T16:47:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.940+0000 7ff89a000640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.940+0000 7ff89b400640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c13f760 0x7ff89c0b4930 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff894009f70 tx=0x7ff894004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.941+0000 7ff893400640 1 -- 172.21.15.144:0/2077015025 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894036050 con 0x7ff89c13f760 2024-05-30T16:47:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.941+0000 7ff893400640 1 -- 172.21.15.144:0/2077015025 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff894042070 con 0x7ff89c13f760 2024-05-30T16:47:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.941+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89c155c20 con 0x7ff89c13f760 2024-05-30T16:47:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.941+0000 7ff893400640 1 -- 172.21.15.144:0/2077015025 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894009510 con 0x7ff89c13f760 2024-05-30T16:47:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.942+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89c1561e0 con 0x7ff89c13f760 2024-05-30T16:47:49.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.943+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89c068b90 con 0x7ff89c13f760 2024-05-30T16:47:49.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.944+0000 7ff893400640 1 -- 172.21.15.144:0/2077015025 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7ff894007bd0 con 0x7ff89c13f760 2024-05-30T16:47:49.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.944+0000 7ff893400640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87c06d0d0 0x7ff87c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:49.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.945+0000 7ff893400640 1 -- 172.21.15.144:0/2077015025 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4971+0+0 (secure 0 0 0) 0x7ff8940adcc0 con 0x7ff89c13f760 2024-05-30T16:47:49.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.945+0000 7ff89aa00640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87c06d0d0 0x7ff87c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:49.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.946+0000 7ff89aa00640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87c06d0d0 0x7ff87c06f590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006fd0 tx=0x7ff88c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:49.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:49.950+0000 7ff893400640 1 -- 172.21.15.144:0/2077015025 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff89407b210 con 0x7ff89c13f760 2024-05-30T16:47:50.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.217+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]} v 0) -- 0x7ff89c06c330 con 0x7ff89c13f760 2024-05-30T16:47:50.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.251+0000 7ff893400640 1 -- 172.21.15.144:0/2077015025 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]}]=0 v263) ==== 162+0+0 (secure 0 0 0) 0x7ff89407ab10 con 0x7ff89c13f760 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87c06d0d0 msgr2=0x7ff87c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87c06d0d0 0x7ff87c06f590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006fd0 tx=0x7ff88c008040 comp rx=0 tx=0).stop 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c13f760 msgr2=0x7ff89c0b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c13f760 0x7ff89c0b4930 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff894009f70 tx=0x7ff894004a40 comp rx=0 tx=0).stop 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 shutdown_connections 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff87c06d0d0 0x7ff87c06f590 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff89c13f760 0x7ff89c0b4930 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c0cec70 0x7ff89c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 --2- 172.21.15.144:0/2077015025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c0b5e00 0x7ff89c152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 >> 172.21.15.144:0/2077015025 conn(0x7ff89c06bd00 msgr2=0x7ff89c15f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 shutdown_connections 2024-05-30T16:47:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.255+0000 7ff8a1e00640 1 -- 172.21.15.144:0/2077015025 wait complete. 2024-05-30T16:47:50.275 INFO:tasks.cephfs_test_runner:Test that one progress bar is printed when number of clone jobs is ... ok 2024-05-30T16:47:50.275 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that 2 progress bars are printed when number of clone jobs is 2024-05-30T16:47:50.275 INFO:tasks.cephfs_test_runner:test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:47:50.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:47:50.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.460+0000 7f1121400640 1 Processor -- start 2024-05-30T16:47:50.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.460+0000 7f1121400640 1 -- start start 2024-05-30T16:47:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.461+0000 7f1121400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c06f670 0x7f111c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.461+0000 7f1121400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f111c06bff0 0x7f111c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.461+0000 7f1121400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111c0cab30 con 0x7f111c0cf300 2024-05-30T16:47:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.461+0000 7f1121400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f111c15b090 con 0x7f111c06bff0 2024-05-30T16:47:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.461+0000 7f1121400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f111c0cf950 con 0x7f111c06f670 2024-05-30T16:47:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.462+0000 7f111b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f111c0cf300 0x7f111c06b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34914/0 (socket says 172.21.15.144:34914) 2024-05-30T16:47:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.462+0000 7f111b400640 1 -- 172.21.15.144:0/3007992957 learned_addr learned my addr 172.21.15.144:0/3007992957 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:50.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.462+0000 7f111be00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c06f670 0x7f111c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.462+0000 7f1120a00640 1 --2- 172.21.15.144:0/3007992957 >> v2:172.21.15.149:3300/0 conn(0x7f111c06bff0 0x7f111c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.462+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917590912 0 0) 0x7f111c0cab30 con 0x7f111c0cf300 2024-05-30T16:47:50.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.462+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1100003520 con 0x7f111c0cf300 2024-05-30T16:47:50.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2476238968 0 0) 0x7f1100003520 con 0x7f111c0cf300 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c06f670 msgr2=0x7f111c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c06f670 0x7f111c0b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 >> v2:172.21.15.149:3300/0 conn(0x7f111c06bff0 msgr2=0x7f111c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 --2- 172.21.15.144:0/3007992957 >> v2:172.21.15.149:3300/0 conn(0x7f111c06bff0 0x7f111c15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c0cfc30 con 0x7f111c0cf300 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f1108001670 con 0x7f111c0cf300 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 >> v1:172.21.15.144:6789/0 conn(0x7f111c0cf300 legacy=0x7f111c06b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11000039b0 0x7f1100003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c06f670 0x7f1100004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1100004d40 0x7f11000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f111c15b090 con 0x7f1100004d40 2024-05-30T16:47:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f111c0cf950 con 0x7f11000039b0 2024-05-30T16:47:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f110000dbd0 con 0x7f111c06f670 2024-05-30T16:47:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f1120a00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1100004d40 0x7f11000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f1120a00640 1 -- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c06f670 msgr2=0x7f1100004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f111be00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11000039b0 0x7f1100003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f1120a00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c06f670 0x7f1100004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f1120a00640 1 -- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11000039b0 msgr2=0x7f1100003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f1120a00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11000039b0 0x7f1100003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.463+0000 7f1120a00640 1 -- 172.21.15.144:0/3007992957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1100003520 con 0x7f1100004d40 2024-05-30T16:47:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f1120a00640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1100004d40 0x7f11000051c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f111400e170 tx=0x7f1100005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df3aef09af7ae1b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114034020 con 0x7f1100004d40 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1114030430 con 0x7f1100004d40 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f111aa00640 1 -- 172.21.15.144:0/3007992957 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114009c10 con 0x7f1100004d40 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f1121400640 1 -- 172.21.15.144:0/3007992957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1100004d40 msgr2=0x7f11000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f1121400640 1 --2- 172.21.15.144:0/3007992957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1100004d40 0x7f11000051c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f111400e170 tx=0x7f1100005830 comp rx=0 tx=0).stop 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f1120a00640 1 -- 172.21.15.144:0/3007992957 reap_dead start 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f1121400640 1 -- 172.21.15.144:0/3007992957 shutdown_connections 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f1121400640 1 -- 172.21.15.144:0/3007992957 >> 172.21.15.144:0/3007992957 conn(0x7f111c0b20a0 msgr2=0x7f111c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.465+0000 7f1121400640 1 -- 172.21.15.144:0/3007992957 shutdown_connections 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.466+0000 7f1121400640 1 -- 172.21.15.144:0/3007992957 wait complete. 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.467+0000 7f1121400640 1 Processor -- start 2024-05-30T16:47:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.467+0000 7f1121400640 1 -- start start 2024-05-30T16:47:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.468+0000 7f1121400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1100004d40 0x7f111c1487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.468+0000 7f1121400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111c1e39b0 0x7f111c15b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.468+0000 7f1121400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c1e42e0 0x7f111c1e4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.468+0000 7f1121400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f111c0ca840 con 0x7f111c1e39b0 2024-05-30T16:47:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.468+0000 7f1121400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f111c15e730 con 0x7f1100004d40 2024-05-30T16:47:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.468+0000 7f1121400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f111c06fa50 con 0x7f111c1e42e0 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.468+0000 7f111b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111c1e39b0 0x7f111c15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.468+0000 7f111b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111c1e39b0 0x7f111c15b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52886/0 (socket says 172.21.15.144:52886) 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.468+0000 7f111b400640 1 -- 172.21.15.144:0/4081816224 learned_addr learned my addr 172.21.15.144:0/4081816224 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f111b400640 1 -- 172.21.15.144:0/4081816224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c1e42e0 msgr2=0x7f111c1e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f111b400640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c1e42e0 0x7f111c1e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f111b400640 1 -- 172.21.15.144:0/4081816224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1100004d40 msgr2=0x7f111c1487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f111b400640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1100004d40 0x7f111c1487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f111b400640 1 -- 172.21.15.144:0/4081816224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c148d00 con 0x7f111c1e39b0 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f111b400640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111c1e39b0 0x7f111c15b210 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f110800c790 tx=0x7f110800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f1113e00640 1 -- 172.21.15.144:0/4081816224 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1108018070 con 0x7f111c1e39b0 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f1113e00640 1 -- 172.21.15.144:0/4081816224 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11080074e0 con 0x7f111c1e39b0 2024-05-30T16:47:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f1113e00640 1 -- 172.21.15.144:0/4081816224 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11080049e0 con 0x7f111c1e39b0 2024-05-30T16:47:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111c15bb80 con 0x7f111c1e39b0 2024-05-30T16:47:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.469+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111c15c140 con 0x7f111c1e39b0 2024-05-30T16:47:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.471+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111c075570 con 0x7f111c1e39b0 2024-05-30T16:47:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.471+0000 7f1113e00640 1 -- 172.21.15.144:0/4081816224 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f110801b070 con 0x7f111c1e39b0 2024-05-30T16:47:50.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.473+0000 7f1113e00640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10fc06d0d0 0x7f10fc06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.473+0000 7f1113e00640 1 -- 172.21.15.144:0/4081816224 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4971+0+0 (secure 0 0 0) 0x7f110808c130 con 0x7f111c1e39b0 2024-05-30T16:47:50.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.473+0000 7f111be00640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10fc06d0d0 0x7f10fc06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.474+0000 7f111be00640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10fc06d0d0 0x7f10fc06f590 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f110c006a90 tx=0x7f110c006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:50.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.477+0000 7f1113e00640 1 -- 172.21.15.144:0/4081816224 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f11080598b0 con 0x7f111c1e39b0 2024-05-30T16:47:50.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.662+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f111c0cab30 con 0x7f111c1e39b0 2024-05-30T16:47:50.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.664+0000 7f1113e00640 1 -- 172.21.15.144:0/4081816224 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13101 (secure 0 0 0) 0x7f11080591b0 con 0x7f111c1e39b0 2024-05-30T16:47:50.666 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:50.666 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":50,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:47:49.245854+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/4243254164":"2024-05-31T16:47:46.234757+0000","172.21.15.144:6836/4243254164":"2024-05-31T16:47:46.234757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:47:50.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10fc06d0d0 msgr2=0x7f10fc06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10fc06d0d0 0x7f10fc06f590 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f110c006a90 tx=0x7f110c006a20 comp rx=0 tx=0).stop 2024-05-30T16:47:50.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111c1e39b0 msgr2=0x7f111c15b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111c1e39b0 0x7f111c15b210 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f110800c790 tx=0x7f110800cc50 comp rx=0 tx=0).stop 2024-05-30T16:47:50.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 shutdown_connections 2024-05-30T16:47:50.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f10fc06d0d0 0x7f10fc06f590 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f111c1e42e0 0x7f111c1e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111c1e39b0 0x7f111c15b210 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 --2- 172.21.15.144:0/4081816224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1100004d40 0x7f111c1487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.667+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 >> 172.21.15.144:0/4081816224 conn(0x7f111c0b20a0 msgr2=0x7f111c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:50.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.668+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 shutdown_connections 2024-05-30T16:47:50.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.668+0000 7f1121400640 1 -- 172.21.15.144:0/4081816224 wait complete. 2024-05-30T16:47:50.687 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:41:40.927129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T16:47:50.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T16:47:50.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.883+0000 7f45d6200640 1 Processor -- start 2024-05-30T16:47:50.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.883+0000 7f45d6200640 1 -- start start 2024-05-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.885+0000 7f45d6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d0145150 0x7f45d00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.885+0000 7f45d6200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45d006f7e0 0x7f45d00b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.885+0000 7f45d6200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d00d00f0 con 0x7f45d00cfa70 2024-05-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.885+0000 7f45d6200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f45d00cfeb0 con 0x7f45d006f7e0 2024-05-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.885+0000 7f45d6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45d015f140 con 0x7f45d0145150 2024-05-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.885+0000 7f45cfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45d006f7e0 0x7f45d00b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.885+0000 7f45cfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45d006f7e0 0x7f45d00b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52890/0 (socket says 172.21.15.144:52890) 2024-05-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.885+0000 7f45cfe00640 1 -- 172.21.15.144:0/1244773428 learned_addr learned my addr 172.21.15.144:0/1244773428 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.886+0000 7f45cf400640 1 --2- 172.21.15.144:0/1244773428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d0145150 0x7f45d00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.886+0000 7f45cfe00640 1 -- 172.21.15.144:0/1244773428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d0145150 msgr2=0x7f45d00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.886+0000 7f45cfe00640 1 --2- 172.21.15.144:0/1244773428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d0145150 0x7f45d00cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.886+0000 7f45cfe00640 1 -- 172.21.15.144:0/1244773428 >> v1:172.21.15.149:6789/0 conn(0x7f45d00cfa70 legacy=0x7f45d006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.886+0000 7f45cfe00640 1 -- 172.21.15.144:0/1244773428 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d015f390 con 0x7f45d006f7e0 2024-05-30T16:47:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.886+0000 7f45cf400640 1 --2- 172.21.15.144:0/1244773428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d0145150 0x7f45d00cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.887+0000 7f45cfe00640 1 --2- 172.21.15.144:0/1244773428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d006f7e0 0x7f45d00b4930 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009e50 tx=0x7f45c802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d367843e149b5d42 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.887+0000 7f45cea00640 1 -- 172.21.15.144:0/1244773428 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8036070 con 0x7f45d006f7e0 2024-05-30T16:47:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.887+0000 7f45cea00640 1 -- 172.21.15.144:0/1244773428 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c8031600 con 0x7f45d006f7e0 2024-05-30T16:47:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.887+0000 7f45cea00640 1 -- 172.21.15.144:0/1244773428 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c80319d0 con 0x7f45d006f7e0 2024-05-30T16:47:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.888+0000 7f45d6200640 1 -- 172.21.15.144:0/1244773428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d006f7e0 msgr2=0x7f45d00b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.888+0000 7f45d6200640 1 --2- 172.21.15.144:0/1244773428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d006f7e0 0x7f45d00b4930 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009e50 tx=0x7f45c802a630 comp rx=0 tx=0).stop 2024-05-30T16:47:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.888+0000 7f45d6200640 1 -- 172.21.15.144:0/1244773428 shutdown_connections 2024-05-30T16:47:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.888+0000 7f45d6200640 1 --2- 172.21.15.144:0/1244773428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d006f7e0 0x7f45d00b4930 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.888+0000 7f45d6200640 1 --2- 172.21.15.144:0/1244773428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d0145150 0x7f45d00cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.888+0000 7f45d6200640 1 -- 172.21.15.144:0/1244773428 >> 172.21.15.144:0/1244773428 conn(0x7f45d006bd00 msgr2=0x7f45d006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.888+0000 7f45d6200640 1 -- 172.21.15.144:0/1244773428 shutdown_connections 2024-05-30T16:47:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.888+0000 7f45d6200640 1 -- 172.21.15.144:0/1244773428 wait complete. 2024-05-30T16:47:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.890+0000 7f45d6200640 1 Processor -- start 2024-05-30T16:47:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.890+0000 7f45d6200640 1 -- start start 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45d6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d006f7e0 0x7f45d015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45d6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d00cfa70 0x7f45d014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45d6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d0145150 0x7f45d015e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45d6200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45d00b64f0 con 0x7f45d0145150 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45d6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f45d015f950 con 0x7f45d006f7e0 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45d6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45d015fe70 con 0x7f45d00cfa70 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d0145150 0x7f45d015e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d0145150 0x7f45d015e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52892/0 (socket says 172.21.15.144:52892) 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45cfe00640 1 -- 172.21.15.144:0/521907910 learned_addr learned my addr 172.21.15.144:0/521907910 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45cf400640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d006f7e0 0x7f45d015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.891+0000 7f45c7e00640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d00cfa70 0x7f45d014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45cfe00640 1 -- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d00cfa70 msgr2=0x7f45d014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45cfe00640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d00cfa70 0x7f45d014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45cfe00640 1 -- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d006f7e0 msgr2=0x7f45d015bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:50.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45cfe00640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d006f7e0 0x7f45d015bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:50.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45cfe00640 1 -- 172.21.15.144:0/521907910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d013b280 con 0x7f45d0145150 2024-05-30T16:47:50.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45cf400640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d006f7e0 0x7f45d015bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:50.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45c7e00640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d00cfa70 0x7f45d014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:50.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45cfe00640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d0145150 0x7f45d015e9c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f45c8034040 tx=0x7f45c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45c7400640 1 -- 172.21.15.144:0/521907910 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8036050 con 0x7f45d0145150 2024-05-30T16:47:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45c7400640 1 -- 172.21.15.144:0/521907910 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c8042070 con 0x7f45d0145150 2024-05-30T16:47:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45c7400640 1 -- 172.21.15.144:0/521907910 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8009510 con 0x7f45d0145150 2024-05-30T16:47:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d013b560 con 0x7f45d0145150 2024-05-30T16:47:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.892+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d013bb20 con 0x7f45d0145150 2024-05-30T16:47:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.893+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d0068b90 con 0x7f45d0145150 2024-05-30T16:47:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.894+0000 7f45c7400640 1 -- 172.21.15.144:0/521907910 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f45c8007bd0 con 0x7f45d0145150 2024-05-30T16:47:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.895+0000 7f45c7400640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45ac06d0d0 0x7f45ac06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.895+0000 7f45c7400640 1 -- 172.21.15.144:0/521907910 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4971+0+0 (secure 0 0 0) 0x7f45c80ab4a0 con 0x7f45d0145150 2024-05-30T16:47:50.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.896+0000 7f45cf400640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45ac06d0d0 0x7f45ac06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:50.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.896+0000 7f45cf400640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45ac06d0d0 0x7f45ac06f590 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f45c0006fd0 tx=0x7f45c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:50.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:50.900+0000 7f45c7400640 1 -- 172.21.15.144:0/521907910 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45c807b1c0 con 0x7f45d0145150 2024-05-30T16:47:51.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.100+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f45d006ed50 con 0x7f45d0145150 2024-05-30T16:47:51.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.101+0000 7f45c7400640 1 -- 172.21.15.144:0/521907910 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7f45c807aac0 con 0x7f45d0145150 2024-05-30T16:47:51.102 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-05-30T16:47:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45ac06d0d0 msgr2=0x7f45ac06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45ac06d0d0 0x7f45ac06f590 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f45c0006fd0 tx=0x7f45c0008040 comp rx=0 tx=0).stop 2024-05-30T16:47:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d0145150 msgr2=0x7f45d015e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d0145150 0x7f45d015e9c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f45c8034040 tx=0x7f45c8004a40 comp rx=0 tx=0).stop 2024-05-30T16:47:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 shutdown_connections 2024-05-30T16:47:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f45ac06d0d0 0x7f45ac06f590 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45d0145150 0x7f45d015e9c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45d00cfa70 0x7f45d014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 --2- 172.21.15.144:0/521907910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d006f7e0 0x7f45d015bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 >> 172.21.15.144:0/521907910 conn(0x7f45d006bd00 msgr2=0x7f45d0141e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 shutdown_connections 2024-05-30T16:47:51.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.104+0000 7f45d6200640 1 -- 172.21.15.144:0/521907910 wait complete. 2024-05-30T16:47:51.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones' 2024-05-30T16:47:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.321+0000 7f75b0800640 1 Processor -- start 2024-05-30T16:47:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.321+0000 7f75b0800640 1 -- start start 2024-05-30T16:47:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.322+0000 7f75b0800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f75a815eb80 0x7f75a8162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75b0800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a8163550 con 0x7f75a80cfc70 2024-05-30T16:47:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75b0800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a8162f90 con 0x7f75a80ba2b0 2024-05-30T16:47:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75b0800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f75a815ef60 con 0x7f75a815eb80 2024-05-30T16:47:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75ade00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f75a815eb80 0x7f75a8162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75ae800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f75a80cfc70 0x7f75a80d3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34926/0 (socket says 172.21.15.144:34926) 2024-05-30T16:47:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75ae800640 1 -- 172.21.15.144:0/886890730 learned_addr learned my addr 172.21.15.144:0/886890730 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75aca00640 1 -- 172.21.15.144:0/886890730 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951971554 0 0) 0x7f75a8163550 con 0x7f75a80cfc70 2024-05-30T16:47:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75ade00640 1 -- 172.21.15.144:0/886890730 >> v1:172.21.15.149:6789/0 conn(0x7f75a80ba2b0 legacy=0x7f75a80cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75ade00640 1 -- 172.21.15.144:0/886890730 >> v1:172.21.15.144:6789/0 conn(0x7f75a80cfc70 legacy=0x7f75a80d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.323+0000 7f75ade00640 1 -- 172.21.15.144:0/886890730 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a8163270 con 0x7f75a815eb80 2024-05-30T16:47:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.324+0000 7f75ade00640 1 --2- 172.21.15.144:0/886890730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a815eb80 0x7f75a8162640 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009d90 tx=0x7f75a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71985711ca991df8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75aca00640 1 -- 172.21.15.144:0/886890730 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0007740 con 0x7f75a815eb80 2024-05-30T16:47:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75aca00640 1 -- 172.21.15.144:0/886890730 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a00078e0 con 0x7f75a815eb80 2024-05-30T16:47:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75aca00640 1 -- 172.21.15.144:0/886890730 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0007cb0 con 0x7f75a815eb80 2024-05-30T16:47:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75b0800640 1 -- 172.21.15.144:0/886890730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a815eb80 msgr2=0x7f75a8162640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75b0800640 1 --2- 172.21.15.144:0/886890730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a815eb80 0x7f75a8162640 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009d90 tx=0x7f75a002a6a0 comp rx=0 tx=0).stop 2024-05-30T16:47:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75b0800640 1 -- 172.21.15.144:0/886890730 shutdown_connections 2024-05-30T16:47:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75b0800640 1 --2- 172.21.15.144:0/886890730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a815eb80 0x7f75a8162640 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75b0800640 1 -- 172.21.15.144:0/886890730 >> 172.21.15.144:0/886890730 conn(0x7f75a806cf40 msgr2=0x7f75a806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75b0800640 1 -- 172.21.15.144:0/886890730 shutdown_connections 2024-05-30T16:47:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.325+0000 7f75b0800640 1 -- 172.21.15.144:0/886890730 wait complete. 2024-05-30T16:47:51.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.327+0000 7f75b0800640 1 Processor -- start 2024-05-30T16:47:51.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.327+0000 7f75b0800640 1 -- start start 2024-05-30T16:47:51.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.328+0000 7f75b0800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a80ba2b0 0x7f75a80c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:51.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.328+0000 7f75b0800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a80cfc70 0x7f75a80d3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:51.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.328+0000 7f75b0800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75a815eb80 0x7f75a80d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:51.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.328+0000 7f75b0800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f75a8162b80 con 0x7f75a80ba2b0 2024-05-30T16:47:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.328+0000 7f75b0800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f75a80d3050 con 0x7f75a80cfc70 2024-05-30T16:47:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.328+0000 7f75b0800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f75a8162d00 con 0x7f75a815eb80 2024-05-30T16:47:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.328+0000 7f75ade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a80ba2b0 0x7f75a80c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.328+0000 7f75ade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a80ba2b0 0x7f75a80c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52904/0 (socket says 172.21.15.144:52904) 2024-05-30T16:47:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.328+0000 7f75ade00640 1 -- 172.21.15.144:0/2609114703 learned_addr learned my addr 172.21.15.144:0/2609114703 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:51.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75ae800640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75a815eb80 0x7f75a80d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:51.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75ade00640 1 -- 172.21.15.144:0/2609114703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75a815eb80 msgr2=0x7f75a80d3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:51.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75ad400640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a80cfc70 0x7f75a80d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75ade00640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75a815eb80 0x7f75a80d3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75ade00640 1 -- 172.21.15.144:0/2609114703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a80cfc70 msgr2=0x7f75a80d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75ade00640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a80cfc70 0x7f75a80d3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75ade00640 1 -- 172.21.15.144:0/2609114703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a80c7990 con 0x7f75a80ba2b0 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75ae800640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75a815eb80 0x7f75a80d3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75ade00640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a80ba2b0 0x7f75a80c7450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009eb0 tx=0x7f75a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f759e000640 1 -- 172.21.15.144:0/2609114703 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0040070 con 0x7f75a80ba2b0 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f759e000640 1 -- 172.21.15.144:0/2609114703 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a0031c40 con 0x7f75a80ba2b0 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a80cc930 con 0x7f75a80ba2b0 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.329+0000 7f759e000640 1 -- 172.21.15.144:0/2609114703 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a003c420 con 0x7f75a80ba2b0 2024-05-30T16:47:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.330+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a80cbe50 con 0x7f75a80ba2b0 2024-05-30T16:47:51.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.331+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a8068b90 con 0x7f75a80ba2b0 2024-05-30T16:47:51.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.332+0000 7f759e000640 1 -- 172.21.15.144:0/2609114703 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f75a0039040 con 0x7f75a80ba2b0 2024-05-30T16:47:51.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.332+0000 7f759e000640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f758c06d0d0 0x7f758c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.333+0000 7f759e000640 1 -- 172.21.15.144:0/2609114703 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4971+0+0 (secure 0 0 0) 0x7f75a00ae290 con 0x7f75a80ba2b0 2024-05-30T16:47:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.333+0000 7f75ad400640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f758c06d0d0 0x7f758c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.333+0000 7f75ad400640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f758c06d0d0 0x7f758c06f590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f75a80ce9b0 tx=0x7f7598009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.337+0000 7f759e000640 1 -- 172.21.15.144:0/2609114703 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f75a80c7990 con 0x7f75a80ba2b0 2024-05-30T16:47:51.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:51.596+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]} v 0) -- 0x7f75a80c7da0 con 0x7f75a80ba2b0 2024-05-30T16:47:52.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.266+0000 7f759e000640 1 -- 172.21.15.144:0/2609114703 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]}]=0 v265) ==== 165+0+0 (secure 0 0 0) 0x7f75a007b220 con 0x7f75a80ba2b0 2024-05-30T16:47:52.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.270+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f758c06d0d0 msgr2=0x7f758c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:52.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.270+0000 7f75b0800640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f758c06d0d0 0x7f758c06f590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f75a80ce9b0 tx=0x7f7598009040 comp rx=0 tx=0).stop 2024-05-30T16:47:52.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.270+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a80ba2b0 msgr2=0x7f75a80c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:52.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.270+0000 7f75b0800640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a80ba2b0 0x7f75a80c7450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009eb0 tx=0x7f75a0004a40 comp rx=0 tx=0).stop 2024-05-30T16:47:52.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.270+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 shutdown_connections 2024-05-30T16:47:52.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.271+0000 7f75b0800640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f758c06d0d0 0x7f758c06f590 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.271+0000 7f75b0800640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75a815eb80 0x7f75a80d3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.271+0000 7f75b0800640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a80cfc70 0x7f75a80d3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.271+0000 7f75b0800640 1 --2- 172.21.15.144:0/2609114703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a80ba2b0 0x7f75a80c7450 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.271+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 >> 172.21.15.144:0/2609114703 conn(0x7f75a806cf40 msgr2=0x7f75a8154ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:52.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.271+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 shutdown_connections 2024-05-30T16:47:52.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.271+0000 7f75b0800640 1 -- 172.21.15.144:0/2609114703 wait complete. 2024-05-30T16:47:52.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:47:52.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.488+0000 7fa2d6200640 1 Processor -- start 2024-05-30T16:47:52.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.488+0000 7fa2d6200640 1 -- start start 2024-05-30T16:47:52.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.489+0000 7fa2d6200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa2d015eaa0 0x7fa2d00cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:52.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.489+0000 7fa2d6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d00b46b0 0x7fa2d00cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:52.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.489+0000 7fa2d6200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2d006e3f0 con 0x7fa2d006f7d0 2024-05-30T16:47:52.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.489+0000 7fa2d6200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d006e110 con 0x7fa2d015eaa0 2024-05-30T16:47:52.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.489+0000 7fa2d6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d00cd6c0 con 0x7fa2d00b46b0 2024-05-30T16:47:52.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.489+0000 7fa2c7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa2d006f7d0 0x7fa2d015f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34938/0 (socket says 172.21.15.144:34938) 2024-05-30T16:47:52.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.489+0000 7fa2c7e00640 1 -- 172.21.15.144:0/3485124812 learned_addr learned my addr 172.21.15.144:0/3485124812 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2d4e00640 1 --2- 172.21.15.144:0/3485124812 >> v2:172.21.15.149:3300/0 conn(0x7fa2d015eaa0 0x7fa2d00cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2d5800640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d00b46b0 0x7fa2d00cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769266609 0 0) 0x7fa2d006e3f0 con 0x7fa2d006f7d0 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b4003520 con 0x7fa2d006f7d0 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1469853793 0 0) 0x7fa2b4003520 con 0x7fa2d006f7d0 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d00b46b0 msgr2=0x7fa2d00cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d00b46b0 0x7fa2d00cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 >> v2:172.21.15.149:3300/0 conn(0x7fa2d015eaa0 msgr2=0x7fa2d00cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 --2- 172.21.15.144:0/3485124812 >> v2:172.21.15.149:3300/0 conn(0x7fa2d015eaa0 0x7fa2d00cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d00cd9a0 con 0x7fa2d006f7d0 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fa2b8001670 con 0x7fa2d006f7d0 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 >> v1:172.21.15.144:6789/0 conn(0x7fa2d006f7d0 legacy=0x7fa2d015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40039b0 0x7fa2b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2b4004800 0x7fa2b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2b40051c0 0x7fa2b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d006e110 con 0x7fa2b40051c0 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d00cd6c0 con 0x7fa2b40039b0 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b400c090 con 0x7fa2b4004800 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2d5800640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d00b46b0 0x7fa2d00cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.490+0000 7fa2d4e00640 1 --2- 172.21.15.144:0/3485124812 >> v2:172.21.15.149:3300/0 conn(0x7fa2d015eaa0 0x7fa2d00cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2d5800640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2b40051c0 0x7fa2b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2d4e00640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40039b0 0x7fa2b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2c7e00640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2b4004800 0x7fa2b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2d5800640 1 -- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2b4004800 msgr2=0x7fa2b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2d5800640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2b4004800 0x7fa2b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2d5800640 1 -- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40039b0 msgr2=0x7fa2b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2d5800640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40039b0 0x7fa2b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2d5800640 1 -- 172.21.15.144:0/3485124812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b4003520 con 0x7fa2b40051c0 2024-05-30T16:47:52.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2d4e00640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40039b0 0x7fa2b4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:52.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.491+0000 7fa2c7e00640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2b4004800 0x7fa2b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:52.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.492+0000 7fa2d5800640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2b40051c0 0x7fa2b400b9c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00b4a90 tx=0x7fa2b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62f5696a3017731 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:52.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.492+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800bb50 con 0x7fa2b40051c0 2024-05-30T16:47:52.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.492+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c8003990 con 0x7fa2b40051c0 2024-05-30T16:47:52.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.492+0000 7fa2cfe00640 1 -- 172.21.15.144:0/3485124812 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8003d60 con 0x7fa2b40051c0 2024-05-30T16:47:52.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.493+0000 7fa2d6200640 1 -- 172.21.15.144:0/3485124812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2b40051c0 msgr2=0x7fa2b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:52.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.493+0000 7fa2d6200640 1 --2- 172.21.15.144:0/3485124812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2b40051c0 0x7fa2b400b9c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00b4a90 tx=0x7fa2b4005830 comp rx=0 tx=0).stop 2024-05-30T16:47:52.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.493+0000 7fa2d5800640 1 -- 172.21.15.144:0/3485124812 reap_dead start 2024-05-30T16:47:52.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.493+0000 7fa2d6200640 1 -- 172.21.15.144:0/3485124812 shutdown_connections 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.493+0000 7fa2d6200640 1 -- 172.21.15.144:0/3485124812 >> 172.21.15.144:0/3485124812 conn(0x7fa2d006b8e0 msgr2=0x7fa2d006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.493+0000 7fa2d6200640 1 -- 172.21.15.144:0/3485124812 shutdown_connections 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.493+0000 7fa2d6200640 1 -- 172.21.15.144:0/3485124812 wait complete. 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.495+0000 7fa2d6200640 1 Processor -- start 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.495+0000 7fa2d6200640 1 -- start start 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.496+0000 7fa2d6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40051c0 0x7fa2d014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.496+0000 7fa2d6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d014b6b0 0x7fa2d006bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.496+0000 7fa2d6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d0147c10 0x7fa2d01480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.496+0000 7fa2d6200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d006dd30 con 0x7fa2d0147c10 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.496+0000 7fa2d6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d015ee80 con 0x7fa2b40051c0 2024-05-30T16:47:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.496+0000 7fa2d6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d006deb0 con 0x7fa2d014b6b0 2024-05-30T16:47:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d5800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d0147c10 0x7fa2d01480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d4e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40051c0 0x7fa2d014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d5800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d0147c10 0x7fa2d01480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52930/0 (socket says 172.21.15.144:52930) 2024-05-30T16:47:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d5800640 1 -- 172.21.15.144:0/1132891928 learned_addr learned my addr 172.21.15.144:0/1132891928 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2c7e00640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d014b6b0 0x7fa2d006bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d5800640 1 -- 172.21.15.144:0/1132891928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d014b6b0 msgr2=0x7fa2d006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d5800640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d014b6b0 0x7fa2d006bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d5800640 1 -- 172.21.15.144:0/1132891928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40051c0 msgr2=0x7fa2d014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d5800640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40051c0 0x7fa2d014ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d5800640 1 -- 172.21.15.144:0/1132891928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d015a9b0 con 0x7fa2d0147c10 2024-05-30T16:47:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2d5800640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d0147c10 0x7fa2d01480a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa2c802cdf0 tx=0x7fa2c8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.497+0000 7fa2cd600640 1 -- 172.21.15.144:0/1132891928 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8043070 con 0x7fa2d0147c10 2024-05-30T16:47:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.498+0000 7fa2cd600640 1 -- 172.21.15.144:0/1132891928 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c80044e0 con 0x7fa2d0147c10 2024-05-30T16:47:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.498+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d015ac90 con 0x7fa2d0147c10 2024-05-30T16:47:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.498+0000 7fa2cd600640 1 -- 172.21.15.144:0/1132891928 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800bb50 con 0x7fa2d0147c10 2024-05-30T16:47:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.498+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d015b250 con 0x7fa2d0147c10 2024-05-30T16:47:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.499+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d00632f0 con 0x7fa2d0147c10 2024-05-30T16:47:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.500+0000 7fa2cd600640 1 -- 172.21.15.144:0/1132891928 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fa2c8046070 con 0x7fa2d0147c10 2024-05-30T16:47:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.500+0000 7fa2cd600640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa2ac06d0d0 0x7fa2ac06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.501+0000 7fa2cd600640 1 -- 172.21.15.144:0/1132891928 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4971+0+0 (secure 0 0 0) 0x7fa2c80ac580 con 0x7fa2d0147c10 2024-05-30T16:47:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.501+0000 7fa2d4e00640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa2ac06d0d0 0x7fa2ac06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.501+0000 7fa2d4e00640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa2ac06d0d0 0x7fa2ac06f590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006e80 tx=0x7fa2c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.505+0000 7fa2cd600640 1 -- 172.21.15.144:0/1132891928 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2c80795a0 con 0x7fa2d0147c10 2024-05-30T16:47:52.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.701+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa2d0075570 con 0x7fa2d0147c10 2024-05-30T16:47:52.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.709+0000 7fa2cd600640 1 -- 172.21.15.144:0/1132891928 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fa2c807d8a0 con 0x7fa2d0147c10 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa2ac06d0d0 msgr2=0x7fa2ac06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa2ac06d0d0 0x7fa2ac06f590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006e80 tx=0x7fa2c0008040 comp rx=0 tx=0).stop 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d0147c10 msgr2=0x7fa2d01480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d0147c10 0x7fa2d01480a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa2c802cdf0 tx=0x7fa2c8004ab0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 shutdown_connections 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa2ac06d0d0 0x7fa2ac06f590 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2d0147c10 0x7fa2d01480a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2d014b6b0 0x7fa2d006bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 --2- 172.21.15.144:0/1132891928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2b40051c0 0x7fa2d014ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.712+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 >> 172.21.15.144:0/1132891928 conn(0x7fa2d006b8e0 msgr2=0x7fa2d015e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:52.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.713+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 shutdown_connections 2024-05-30T16:47:52.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:52.713+0000 7fa2d6200640 1 -- 172.21.15.144:0/1132891928 wait complete. 2024-05-30T16:47:52.731 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:47:52.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:47:52.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:47:52.951 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:47:52.951 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:47:52.951 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:47:53.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:47:53.009 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:47:53.010 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:47:53.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:47:53.068 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:47:53.068 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:47:53.125 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:47:53.125 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:47:53.125 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:47:53.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:47:53.183 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T16:47:53.183 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:47:53.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.390+0000 7fce54400640 1 Processor -- start 2024-05-30T16:47:53.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.390+0000 7fce54400640 1 -- start start 2024-05-30T16:47:53.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.392+0000 7fce54400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce4c141510 0x7fce4c1418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.392+0000 7fce54400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4c0b3fd0 con 0x7fce4c15f8f0 2024-05-30T16:47:53.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.392+0000 7fce54400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4c15fd80 con 0x7fce4c144020 2024-05-30T16:47:53.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.392+0000 7fce54400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fce4c06dfc0 con 0x7fce4c141510 2024-05-30T16:47:53.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.392+0000 7fce51000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fce4c15f8f0 0x7fce4c0b5440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34942/0 (socket says 172.21.15.144:34942) 2024-05-30T16:47:53.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.392+0000 7fce51000640 1 -- 172.21.15.144:0/1999056420 learned_addr learned my addr 172.21.15.144:0/1999056420 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:53.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.392+0000 7fce51a00640 1 --2- 172.21.15.144:0/1999056420 >> v2:172.21.15.149:3300/0 conn(0x7fce4c141510 0x7fce4c1418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679859802 0 0) 0x7fce4c0b3fd0 con 0x7fce4c15f8f0 2024-05-30T16:47:53.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce34003520 con 0x7fce4c15f8f0 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2919659393 0 0) 0x7fce34003520 con 0x7fce4c15f8f0 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 >> v2:172.21.15.149:3300/0 conn(0x7fce4c141510 msgr2=0x7fce4c1418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 --2- 172.21.15.144:0/1999056420 >> v2:172.21.15.149:3300/0 conn(0x7fce4c141510 0x7fce4c1418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 >> v1:172.21.15.149:6789/0 conn(0x7fce4c144020 legacy=0x7fce4c06e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c144790 con 0x7fce4c15f8f0 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fce38001670 con 0x7fce4c15f8f0 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 >> v1:172.21.15.144:6789/0 conn(0x7fce4c15f8f0 legacy=0x7fce4c0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340039b0 0x7fce34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce340052e0 0x7fce3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c06dfc0 con 0x7fce34004800 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce3400c1b0 con 0x7fce340039b0 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce3400c3b0 con 0x7fce340052e0 2024-05-30T16:47:53.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.393+0000 7fce51000640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.394+0000 7fce51a00640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340039b0 0x7fce34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.394+0000 7fce52400640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce340052e0 0x7fce3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.394+0000 7fce51000640 1 -- 172.21.15.144:0/1999056420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce340052e0 msgr2=0x7fce3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:53.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.394+0000 7fce51000640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce340052e0 0x7fce3400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.394+0000 7fce51000640 1 -- 172.21.15.144:0/1999056420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340039b0 msgr2=0x7fce34003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:53.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.394+0000 7fce51000640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340039b0 0x7fce34003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.394+0000 7fce51000640 1 -- 172.21.15.144:0/1999056420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce34003520 con 0x7fce34004800 2024-05-30T16:47:53.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.394+0000 7fce52400640 1 -- 172.21.15.144:0/1999056420 reap_dead start 2024-05-30T16:47:53.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.395+0000 7fce51000640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce34004c80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fce3800c210 tx=0x7fce34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f2eea7fe5baaf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:53.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.395+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38007d10 con 0x7fce34004800 2024-05-30T16:47:53.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.395+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce38005ad0 con 0x7fce34004800 2024-05-30T16:47:53.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.395+0000 7fce4be00640 1 -- 172.21.15.144:0/1999056420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38007070 con 0x7fce34004800 2024-05-30T16:47:53.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.396+0000 7fce54400640 1 -- 172.21.15.144:0/1999056420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 msgr2=0x7fce34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.396+0000 7fce54400640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce34004c80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fce3800c210 tx=0x7fce34005830 comp rx=0 tx=0).stop 2024-05-30T16:47:53.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.396+0000 7fce54400640 1 -- 172.21.15.144:0/1999056420 shutdown_connections 2024-05-30T16:47:53.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.396+0000 7fce54400640 1 --2- 172.21.15.144:0/1999056420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce34004c80 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.396+0000 7fce54400640 1 -- 172.21.15.144:0/1999056420 >> 172.21.15.144:0/1999056420 conn(0x7fce4c06bd00 msgr2=0x7fce4c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:53.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.396+0000 7fce54400640 1 -- 172.21.15.144:0/1999056420 shutdown_connections 2024-05-30T16:47:53.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.396+0000 7fce54400640 1 -- 172.21.15.144:0/1999056420 wait complete. 2024-05-30T16:47:53.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.398+0000 7fce54400640 1 Processor -- start 2024-05-30T16:47:53.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.398+0000 7fce54400640 1 -- start start 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.399+0000 7fce54400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce4c157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.399+0000 7fce54400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce4c139260 0x7fce4c145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.399+0000 7fce54400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce4c0b5440 0x7fce4c0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.399+0000 7fce54400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c06e210 con 0x7fce34004800 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.399+0000 7fce54400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c144d50 con 0x7fce4c0b5440 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.399+0000 7fce54400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce4c144490 con 0x7fce4c139260 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.399+0000 7fce51a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce4c157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.399+0000 7fce51a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce4c157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52952/0 (socket says 172.21.15.144:52952) 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.399+0000 7fce51a00640 1 -- 172.21.15.144:0/3884666977 learned_addr learned my addr 172.21.15.144:0/3884666977 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce51a00640 1 -- 172.21.15.144:0/3884666977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce4c139260 msgr2=0x7fce4c145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce51a00640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce4c139260 0x7fce4c145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce51a00640 1 -- 172.21.15.144:0/3884666977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce4c0b5440 msgr2=0x7fce4c0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce51a00640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce4c0b5440 0x7fce4c0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce51a00640 1 -- 172.21.15.144:0/3884666977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c158340 con 0x7fce34004800 2024-05-30T16:47:53.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce51a00640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce4c157e00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fce40011700 tx=0x7fce40011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:53.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce49600640 1 -- 172.21.15.144:0/3884666977 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4000f9c0 con 0x7fce34004800 2024-05-30T16:47:53.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce49600640 1 -- 172.21.15.144:0/3884666977 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4000fb60 con 0x7fce34004800 2024-05-30T16:47:53.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce49600640 1 -- 172.21.15.144:0/3884666977 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40015460 con 0x7fce34004800 2024-05-30T16:47:53.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c1458b0 con 0x7fce34004800 2024-05-30T16:47:53.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.400+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c147480 con 0x7fce34004800 2024-05-30T16:47:53.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.401+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce4c068b90 con 0x7fce34004800 2024-05-30T16:47:53.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.402+0000 7fce49600640 1 -- 172.21.15.144:0/3884666977 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fce40015600 con 0x7fce34004800 2024-05-30T16:47:53.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.403+0000 7fce49600640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce2c06d100 0x7fce2c06f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.403+0000 7fce49600640 1 -- 172.21.15.144:0/3884666977 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4971+0+0 (secure 0 0 0) 0x7fce4008ab20 con 0x7fce34004800 2024-05-30T16:47:53.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.404+0000 7fce51000640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce2c06d100 0x7fce2c06f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.404+0000 7fce51000640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce2c06d100 0x7fce2c06f5c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce38032000 tx=0x7fce38009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:53.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.408+0000 7fce49600640 1 -- 172.21.15.144:0/3884666977 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce40019030 con 0x7fce34004800 2024-05-30T16:47:53.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.656+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce4c15ebf0 con 0x7fce34004800 2024-05-30T16:47:53.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.657+0000 7fce49600640 1 -- 172.21.15.144:0/3884666977 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3878 (secure 0 0 0) 0x7fce4005a840 con 0x7fce34004800 2024-05-30T16:47:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:53.658 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1748821329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":1748821329},{"type":"v1","addr":"172.21.15.149:6835","nonce":1748821329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/498363694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":498363694},{"type":"v1","addr":"172.21.15.149:6834","nonce":498363694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1097253256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1097253256},{"type":"v1","addr":"172.21.15.144:6835","nonce":1097253256}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/4015331302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4015331302},{"type":"v1","addr":"172.21.15.144:6837","nonce":4015331302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-05-30T16:47:53.658 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 29 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.659+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce2c06d100 msgr2=0x7fce2c06f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.659+0000 7fce54400640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce2c06d100 0x7fce2c06f5c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce38032000 tx=0x7fce38009030 comp rx=0 tx=0).stop 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.659+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 msgr2=0x7fce4c157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.659+0000 7fce54400640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce4c157e00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fce40011700 tx=0x7fce40011bc0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.660+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 shutdown_connections 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.660+0000 7fce54400640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fce2c06d100 0x7fce2c06f5c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.660+0000 7fce54400640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce4c0b5440 0x7fce4c0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.660+0000 7fce54400640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce4c139260 0x7fce4c145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.660+0000 7fce54400640 1 --2- 172.21.15.144:0/3884666977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce34004800 0x7fce4c157e00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.660+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 >> 172.21.15.144:0/3884666977 conn(0x7fce4c06bd00 msgr2=0x7fce4c158920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.660+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 shutdown_connections 2024-05-30T16:47:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.660+0000 7fce54400640 1 -- 172.21.15.144:0/3884666977 wait complete. 2024-05-30T16:47:53.682 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:47:53.682 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T16:47:53.682 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:47:53.682 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:47:53.682 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:47:53.682 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T16:47:53.682 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:47:53.683 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:47:53.683 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:47:53.683 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T16:47:53.683 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:47:53.683 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:47:53.683 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:47:53.683 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T16:47:53.683 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:47:53.684 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:47:53.700 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:47:53.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:47:53.701 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:47:53.701 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:47:53.705 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:47:53.705 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:47:53.713 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:47:53.713 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:47:53.747 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:47:53.748 DEBUG:teuthology.parallel:result is None 2024-05-30T16:47:53.753 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:47:53.754 DEBUG:teuthology.parallel:result is None 2024-05-30T16:47:53.760 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:47:53.760 DEBUG:teuthology.parallel:result is None 2024-05-30T16:47:53.766 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:47:53.767 DEBUG:teuthology.parallel:result is None 2024-05-30T16:47:53.767 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T16:47:53.896 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-05-30T16:47:53.897 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-05-30T16:47:53.916 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-05-30T16:47:53.918 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-05-30T16:47:53.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.940+0000 7fe518a00640 1 Processor -- start 2024-05-30T16:47:53.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.940+0000 7fe518a00640 1 -- start start 2024-05-30T16:47:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.941+0000 7fe518a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5140b5520 0x7fe5140cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.941+0000 7fe518a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe51406f1d0 con 0x7fe514164290 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.941+0000 7fe518a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5141637b0 con 0x7fe51406ec20 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.941+0000 7fe518a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe5140b4d50 con 0x7fe5140b5520 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.941+0000 7fe509400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe514164290 0x7fe51406e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34984/0 (socket says 172.21.15.144:34984) 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.941+0000 7fe509400640 1 -- 172.21.15.144:0/3271170895 learned_addr learned my addr 172.21.15.144:0/3271170895 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.942+0000 7fe511e00640 1 --2- 172.21.15.144:0/3271170895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5140b5520 0x7fe5140cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.942+0000 7fe511400640 1 -- 172.21.15.144:0/3271170895 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953998015 0 0) 0x7fe51406f1d0 con 0x7fe514164290 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.942+0000 7fe511400640 1 -- 172.21.15.144:0/3271170895 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4f8003520 con 0x7fe514164290 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.942+0000 7fe511400640 1 -- 172.21.15.144:0/3271170895 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059718480 0 0) 0x7fe5141637b0 con 0x7fe51406ec20 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.942+0000 7fe511400640 1 -- 172.21.15.144:0/3271170895 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe51406f1d0 con 0x7fe51406ec20 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.942+0000 7fe511e00640 1 -- 172.21.15.144:0/3271170895 >> v1:172.21.15.149:6789/0 conn(0x7fe51406ec20 legacy=0x7fe51415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.942+0000 7fe511e00640 1 -- 172.21.15.144:0/3271170895 >> v1:172.21.15.144:6789/0 conn(0x7fe514164290 legacy=0x7fe51406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.942+0000 7fe511e00640 1 -- 172.21.15.144:0/3271170895 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe514163a90 con 0x7fe5140b5520 2024-05-30T16:47:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.943+0000 7fe511e00640 1 --2- 172.21.15.144:0/3271170895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5140b5520 0x7fe5140cebf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5040097d0 tx=0x7fe50402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd9f3c394bdcab69 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.943+0000 7fe511400640 1 -- 172.21.15.144:0/3271170895 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504037070 con 0x7fe5140b5520 2024-05-30T16:47:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.943+0000 7fe511400640 1 -- 172.21.15.144:0/3271170895 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe504032440 con 0x7fe5140b5520 2024-05-30T16:47:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.943+0000 7fe511400640 1 -- 172.21.15.144:0/3271170895 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504032810 con 0x7fe5140b5520 2024-05-30T16:47:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.944+0000 7fe518a00640 1 -- 172.21.15.144:0/3271170895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5140b5520 msgr2=0x7fe5140cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.944+0000 7fe518a00640 1 --2- 172.21.15.144:0/3271170895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5140b5520 0x7fe5140cebf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5040097d0 tx=0x7fe50402a210 comp rx=0 tx=0).stop 2024-05-30T16:47:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.944+0000 7fe518a00640 1 -- 172.21.15.144:0/3271170895 shutdown_connections 2024-05-30T16:47:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.944+0000 7fe518a00640 1 --2- 172.21.15.144:0/3271170895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5140b5520 0x7fe5140cebf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.944+0000 7fe518a00640 1 -- 172.21.15.144:0/3271170895 >> 172.21.15.144:0/3271170895 conn(0x7fe5140629c0 msgr2=0x7fe51406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.944+0000 7fe518a00640 1 -- 172.21.15.144:0/3271170895 shutdown_connections 2024-05-30T16:47:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.944+0000 7fe518a00640 1 -- 172.21.15.144:0/3271170895 wait complete. 2024-05-30T16:47:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.946+0000 7fe518a00640 1 Processor -- start 2024-05-30T16:47:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.946+0000 7fe518a00640 1 -- start start 2024-05-30T16:47:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe518a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe51406ec20 0x7fe5140ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe518a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5140b5520 0x7fe51414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe518a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe514164290 0x7fe51414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe518a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe5140b5900 con 0x7fe51406ec20 2024-05-30T16:47:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe518a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe5141634c0 con 0x7fe5140b5520 2024-05-30T16:47:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe518a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe5140b5a80 con 0x7fe514164290 2024-05-30T16:47:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe511e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe51406ec20 0x7fe5140ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe511e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe51406ec20 0x7fe5140ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53010/0 (socket says 172.21.15.144:53010) 2024-05-30T16:47:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe511e00640 1 -- 172.21.15.144:0/1805463619 learned_addr learned my addr 172.21.15.144:0/1805463619 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe509400640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5140b5520 0x7fe51414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe512800640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe514164290 0x7fe51414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe511e00640 1 -- 172.21.15.144:0/1805463619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe514164290 msgr2=0x7fe51414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe511e00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe514164290 0x7fe51414ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe511e00640 1 -- 172.21.15.144:0/1805463619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5140b5520 msgr2=0x7fe51414d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe511e00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5140b5520 0x7fe51414d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe511e00640 1 -- 172.21.15.144:0/1805463619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5140aa350 con 0x7fe51406ec20 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.947+0000 7fe509400640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5140b5520 0x7fe51414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.948+0000 7fe511e00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe51406ec20 0x7fe5140ade50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe5040098f0 tx=0x7fe5040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.948+0000 7fe50aa00640 1 -- 172.21.15.144:0/1805463619 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504041020 con 0x7fe51406ec20 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.948+0000 7fe50aa00640 1 -- 172.21.15.144:0/1805463619 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe50403d6e0 con 0x7fe51406ec20 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.948+0000 7fe50aa00640 1 -- 172.21.15.144:0/1805463619 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504037040 con 0x7fe51406ec20 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.948+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5140aa630 con 0x7fe51406ec20 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.948+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5140aabf0 con 0x7fe51406ec20 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.949+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe51406c870 con 0x7fe51406ec20 2024-05-30T16:47:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.950+0000 7fe50aa00640 1 -- 172.21.15.144:0/1805463619 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fe504044020 con 0x7fe51406ec20 2024-05-30T16:47:53.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.951+0000 7fe50aa00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe4f006d0d0 0x7fe4f006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:53.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.951+0000 7fe50aa00640 1 -- 172.21.15.144:0/1805463619 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4971+0+0 (secure 0 0 0) 0x7fe5040ad2a0 con 0x7fe51406ec20 2024-05-30T16:47:53.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.951+0000 7fe509400640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe4f006d0d0 0x7fe4f006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:53.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.952+0000 7fe509400640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe4f006d0d0 0x7fe4f006f590 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc007fd0 tx=0x7fe4fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:53.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:53.955+0000 7fe50aa00640 1 -- 172.21.15.144:0/1805463619 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe50404b030 con 0x7fe51406ec20 2024-05-30T16:47:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:54.150+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe514162d00 con 0x7fe51406ec20 2024-05-30T16:47:55.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.311+0000 7fe50aa00640 1 -- 172.21.15.144:0/1805463619 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) ==== 97+0+0 (secure 0 0 0) 0x7fe50407a910 con 0x7fe51406ec20 2024-05-30T16:47:55.313 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-05-30T16:47:55.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe4f006d0d0 msgr2=0x7fe4f006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:55.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe4f006d0d0 0x7fe4f006f590 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc007fd0 tx=0x7fe4fc009040 comp rx=0 tx=0).stop 2024-05-30T16:47:55.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe51406ec20 msgr2=0x7fe5140ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:55.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe51406ec20 0x7fe5140ade50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe5040098f0 tx=0x7fe5040046c0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 shutdown_connections 2024-05-30T16:47:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe4f006d0d0 0x7fe4f006f590 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe514164290 0x7fe51414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5140b5520 0x7fe51414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 --2- 172.21.15.144:0/1805463619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe51406ec20 0x7fe5140ade50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.315+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 >> 172.21.15.144:0/1805463619 conn(0x7fe5140629c0 msgr2=0x7fe51406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.316+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 shutdown_connections 2024-05-30T16:47:55.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.316+0000 7fe518a00640 1 -- 172.21.15.144:0/1805463619 wait complete. 2024-05-30T16:47:55.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T16:47:55.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.527+0000 7efcbc800640 1 Processor -- start 2024-05-30T16:47:55.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.528+0000 7efcbc800640 1 -- start start 2024-05-30T16:47:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.529+0000 7efcbc800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb415ec60 0x7efcb406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.529+0000 7efcbc800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcb40d1dc0 0x7efcb406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.529+0000 7efcbc800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb40d08d0 con 0x7efcb406cc70 2024-05-30T16:47:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.529+0000 7efcbc800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efcb415f5e0 con 0x7efcb40d1dc0 2024-05-30T16:47:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.529+0000 7efcbc800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efcb415f8c0 con 0x7efcb415ec60 2024-05-30T16:47:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.529+0000 7efcba800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcb40d1dc0 0x7efcb406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.530+0000 7efcba800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcb40d1dc0 0x7efcb406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42976/0 (socket says 172.21.15.144:42976) 2024-05-30T16:47:55.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.530+0000 7efcba800640 1 -- 172.21.15.144:0/733402274 learned_addr learned my addr 172.21.15.144:0/733402274 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:55.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.530+0000 7efcb9e00640 1 --2- 172.21.15.144:0/733402274 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb415ec60 0x7efcb406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:55.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.530+0000 7efcba800640 1 -- 172.21.15.144:0/733402274 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb415ec60 msgr2=0x7efcb406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:55.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.530+0000 7efcba800640 1 --2- 172.21.15.144:0/733402274 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb415ec60 0x7efcb406d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.530+0000 7efcba800640 1 -- 172.21.15.144:0/733402274 >> v1:172.21.15.149:6789/0 conn(0x7efcb406cc70 legacy=0x7efcb409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:55.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.530+0000 7efcba800640 1 -- 172.21.15.144:0/733402274 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb415fba0 con 0x7efcb40d1dc0 2024-05-30T16:47:55.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.531+0000 7efcba800640 1 --2- 172.21.15.144:0/733402274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40d1dc0 0x7efcb406d620 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009e50 tx=0x7efcb002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0306fe577462ee1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:55.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.531+0000 7efcb8a00640 1 -- 172.21.15.144:0/733402274 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0036070 con 0x7efcb40d1dc0 2024-05-30T16:47:55.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.531+0000 7efcb8a00640 1 -- 172.21.15.144:0/733402274 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb0031600 con 0x7efcb40d1dc0 2024-05-30T16:47:55.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.531+0000 7efcb8a00640 1 -- 172.21.15.144:0/733402274 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00319d0 con 0x7efcb40d1dc0 2024-05-30T16:47:55.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.532+0000 7efcbc800640 1 -- 172.21.15.144:0/733402274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40d1dc0 msgr2=0x7efcb406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:55.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.532+0000 7efcbc800640 1 --2- 172.21.15.144:0/733402274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40d1dc0 0x7efcb406d620 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009e50 tx=0x7efcb002a630 comp rx=0 tx=0).stop 2024-05-30T16:47:55.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.532+0000 7efcbc800640 1 -- 172.21.15.144:0/733402274 shutdown_connections 2024-05-30T16:47:55.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.532+0000 7efcbc800640 1 --2- 172.21.15.144:0/733402274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40d1dc0 0x7efcb406d620 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.532+0000 7efcbc800640 1 --2- 172.21.15.144:0/733402274 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb415ec60 0x7efcb406d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.532+0000 7efcbc800640 1 -- 172.21.15.144:0/733402274 >> 172.21.15.144:0/733402274 conn(0x7efcb40b4180 msgr2=0x7efcb40b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:55.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.532+0000 7efcbc800640 1 -- 172.21.15.144:0/733402274 shutdown_connections 2024-05-30T16:47:55.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.532+0000 7efcbc800640 1 -- 172.21.15.144:0/733402274 wait complete. 2024-05-30T16:47:55.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.534+0000 7efcbc800640 1 Processor -- start 2024-05-30T16:47:55.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.534+0000 7efcbc800640 1 -- start start 2024-05-30T16:47:55.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.535+0000 7efcbc800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb406cc70 0x7efcb40b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:55.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.535+0000 7efcbc800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb40d1dc0 0x7efcb40b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:55.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.535+0000 7efcbc800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb415ec60 0x7efcb415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:55.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.535+0000 7efcbc800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41627f0 con 0x7efcb415ec60 2024-05-30T16:47:55.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.535+0000 7efcbc800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4162670 con 0x7efcb40d1dc0 2024-05-30T16:47:55.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.535+0000 7efcbc800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efcb4162970 con 0x7efcb406cc70 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.535+0000 7efcba800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb415ec60 0x7efcb415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.535+0000 7efcba800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb415ec60 0x7efcb415bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42992/0 (socket says 172.21.15.144:42992) 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.535+0000 7efcba800640 1 -- 172.21.15.144:0/2074180440 learned_addr learned my addr 172.21.15.144:0/2074180440 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.536+0000 7efcb9400640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb40d1dc0 0x7efcb40b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.536+0000 7efcb9e00640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb406cc70 0x7efcb40b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.536+0000 7efcba800640 1 -- 172.21.15.144:0/2074180440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb406cc70 msgr2=0x7efcb40b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.536+0000 7efcba800640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb406cc70 0x7efcb40b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.536+0000 7efcba800640 1 -- 172.21.15.144:0/2074180440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb40d1dc0 msgr2=0x7efcb40b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.536+0000 7efcba800640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb40d1dc0 0x7efcb40b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.536+0000 7efcba800640 1 -- 172.21.15.144:0/2074180440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb40afd60 con 0x7efcb415ec60 2024-05-30T16:47:55.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.536+0000 7efcba800640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb415ec60 0x7efcb415bcb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009e50 tx=0x7efcb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.536+0000 7efcae000640 1 -- 172.21.15.144:0/2074180440 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0036050 con 0x7efcb415ec60 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.537+0000 7efcae000640 1 -- 172.21.15.144:0/2074180440 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb0042070 con 0x7efcb415ec60 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.537+0000 7efcae000640 1 -- 172.21.15.144:0/2074180440 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0009510 con 0x7efcb415ec60 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.537+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb40b0040 con 0x7efcb415ec60 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.537+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb40b0600 con 0x7efcb415ec60 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.538+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb4068b90 con 0x7efcb415ec60 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.539+0000 7efcae000640 1 -- 172.21.15.144:0/2074180440 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7efcb0007bd0 con 0x7efcb415ec60 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.539+0000 7efcae000640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc9806d0d0 0x7efc9806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.540+0000 7efcae000640 1 -- 172.21.15.144:0/2074180440 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4885+0+0 (secure 0 0 0) 0x7efcb00adae0 con 0x7efcb415ec60 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.540+0000 7efcb9e00640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc9806d0d0 0x7efc9806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.540+0000 7efcb9e00640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc9806d0d0 0x7efc9806f590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efca8006fd0 tx=0x7efca8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.544+0000 7efcae000640 1 -- 172.21.15.144:0/2074180440 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efcb007b110 con 0x7efcb415ec60 2024-05-30T16:47:55.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.815+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7efcb40b4ea0 con 0x7efcb415ec60 2024-05-30T16:47:55.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.816+0000 7efcae000640 1 -- 172.21.15.144:0/2074180440 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7efcb007aa10 con 0x7efcb415ec60 2024-05-30T16:47:55.817 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:55.817 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmF+/kKhAA0L6yP95TzJQ6K4jpCd5+tg==", 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmn8xEDRAAjwGDHViLwz305wNijyo18g==", 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-05-30T16:47:55.819 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmuIxAORAA/N4DIL7c+EuojamnyYrt8Q==", 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmohxgGxAA4vjzBoeVO37nSNV38b13jQ==", 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:47:55.820 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAVrFhmdJ6TFxAAFhv8K0nLudGT9rT6oHmhvQ==", 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAYrFhmC1VXIhAAyyeKMhil2CcMD+5mm3xcvg==", 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAbrFhmid0VLRAA/StAYue0HlyInB/n42h3wg==", 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAerFhmJwCyNhAAkvkgyy7RRMOwwfYhyd19XA==", 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAlrFhm/8G1CxAAAlDJwijmpj2gS8x2BhgIpA==", 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAorFhmO1zgJhAAxdZsdLD/lBuyuhEdX2AF6g==", 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.824 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAsrFhmPtDmAxAA1+YfFHQ7XLtQQIOp4BLnwQ==", 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAvrFhmbqIVDxAAr6NR0hbs+v/4CP4/WRT1SA==", 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA==", 2024-05-30T16:47:55.826 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmVgMROxAA2SCdaM/Q+v9jhyfF7SZoWg==", 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:47:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmvzKvMBAAIPPum2n8LgNjGXjueMBuqQ==", 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.828 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQASrFhmdx2UCRAAFENiZ9XGo/B0vBmixV0k0A==", 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAPrFhmtLjtJBAAhR92wuSYl1aS8+gl0+zhcg==", 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:47:55.829 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmn/cwIBAAc0kCDj+gFH2f0tY5cbGrjg==", 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhm8GMmFRAAtPZbiQkY1GfShaqCf3b4Zw==", 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-05-30T16:47:55.831 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:47:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc9806d0d0 msgr2=0x7efc9806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc9806d0d0 0x7efc9806f590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efca8006fd0 tx=0x7efca8008040 comp rx=0 tx=0).stop 2024-05-30T16:47:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb415ec60 msgr2=0x7efcb415bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb415ec60 0x7efcb415bcb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009e50 tx=0x7efcb0004a40 comp rx=0 tx=0).stop 2024-05-30T16:47:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 shutdown_connections 2024-05-30T16:47:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efc9806d0d0 0x7efc9806f590 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb415ec60 0x7efcb415bcb0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb40d1dc0 0x7efcb40b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 --2- 172.21.15.144:0/2074180440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb406cc70 0x7efcb40b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 >> 172.21.15.144:0/2074180440 conn(0x7efcb40b4180 msgr2=0x7efcb40cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 shutdown_connections 2024-05-30T16:47:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:55.819+0000 7efcbc800640 1 -- 172.21.15.144:0/2074180440 wait complete. 2024-05-30T16:47:55.840 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:47:56.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.031+0000 7f023e400640 1 Processor -- start 2024-05-30T16:47:56.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.031+0000 7f023e400640 1 -- start start 2024-05-30T16:47:56.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.033+0000 7f023e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f023806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.033+0000 7f023e400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f02380cec70 0x7f02380b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.033+0000 7f023e400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023806ee80 con 0x7f02380b5e00 2024-05-30T16:47:56.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.033+0000 7f023e400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f02381612b0 con 0x7f02380cec70 2024-05-30T16:47:56.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.033+0000 7f023e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f023813fb40 con 0x7f023813f760 2024-05-30T16:47:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.033+0000 7f0237400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f023806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.034+0000 7f0237400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f023806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:46480/0 (socket says 172.21.15.144:46480) 2024-05-30T16:47:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.034+0000 7f0237400640 1 -- 172.21.15.144:0/3239072880 learned_addr learned my addr 172.21.15.144:0/3239072880 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.034+0000 7f0236a00640 1 --2- 172.21.15.144:0/3239072880 >> v2:172.21.15.149:3300/0 conn(0x7f02380cec70 0x7f02380b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.034+0000 7f0237400640 1 -- 172.21.15.144:0/3239072880 >> v2:172.21.15.149:3300/0 conn(0x7f02380cec70 msgr2=0x7f02380b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.034+0000 7f0237400640 1 --2- 172.21.15.144:0/3239072880 >> v2:172.21.15.149:3300/0 conn(0x7f02380cec70 0x7f02380b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.034+0000 7f0237400640 1 -- 172.21.15.144:0/3239072880 >> v1:172.21.15.149:6789/0 conn(0x7f02380b5e00 legacy=0x7f0238142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.034+0000 7f0237400640 1 -- 172.21.15.144:0/3239072880 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0238160730 con 0x7f023813f760 2024-05-30T16:47:56.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.036+0000 7f0237400640 1 --2- 172.21.15.144:0/3239072880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f023806e940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0228009870 tx=0x7f022802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15646f4e943ab82 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:56.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.036+0000 7f0236000640 1 -- 172.21.15.144:0/3239072880 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228037070 con 0x7f023813f760 2024-05-30T16:47:56.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.036+0000 7f0236000640 1 -- 172.21.15.144:0/3239072880 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022802ae50 con 0x7f023813f760 2024-05-30T16:47:56.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.036+0000 7f0236000640 1 -- 172.21.15.144:0/3239072880 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228032860 con 0x7f023813f760 2024-05-30T16:47:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.037+0000 7f023e400640 1 -- 172.21.15.144:0/3239072880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 msgr2=0x7f023806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.037+0000 7f023e400640 1 --2- 172.21.15.144:0/3239072880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f023806e940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0228009870 tx=0x7f022802a300 comp rx=0 tx=0).stop 2024-05-30T16:47:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.037+0000 7f023e400640 1 -- 172.21.15.144:0/3239072880 shutdown_connections 2024-05-30T16:47:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.037+0000 7f023e400640 1 --2- 172.21.15.144:0/3239072880 >> v2:172.21.15.149:3300/0 conn(0x7f02380cec70 0x7f02380b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.037+0000 7f023e400640 1 --2- 172.21.15.144:0/3239072880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f023806e940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.037+0000 7f023e400640 1 -- 172.21.15.144:0/3239072880 >> 172.21.15.144:0/3239072880 conn(0x7f023806bd00 msgr2=0x7f023806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.037+0000 7f023e400640 1 -- 172.21.15.144:0/3239072880 shutdown_connections 2024-05-30T16:47:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.037+0000 7f023e400640 1 -- 172.21.15.144:0/3239072880 wait complete. 2024-05-30T16:47:56.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.039+0000 7f023e400640 1 Processor -- start 2024-05-30T16:47:56.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.039+0000 7f023e400640 1 -- start start 2024-05-30T16:47:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f023e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02380b5e00 0x7f0238159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f023e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02380cec70 0x7f023815f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f023e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f02381526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f023e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0238160fd0 con 0x7f02380cec70 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f023e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0238160cf0 con 0x7f02380b5e00 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f023e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f02380cf0d0 con 0x7f023813f760 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f0236a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02380cec70 0x7f023815f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f0236a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02380cec70 0x7f023815f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42998/0 (socket says 172.21.15.144:42998) 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f0236a00640 1 -- 172.21.15.144:0/3948746187 learned_addr learned my addr 172.21.15.144:0/3948746187 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f0237400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02380b5e00 0x7f0238159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.041+0000 7f0237e00640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f02381526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f0236a00640 1 -- 172.21.15.144:0/3948746187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 msgr2=0x7f02381526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f0236a00640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f02381526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f0236a00640 1 -- 172.21.15.144:0/3948746187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02380b5e00 msgr2=0x7f0238159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f0236a00640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02380b5e00 0x7f0238159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f0236a00640 1 -- 172.21.15.144:0/3948746187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02381551b0 con 0x7f02380cec70 2024-05-30T16:47:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f0237400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02380b5e00 0x7f0238159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:47:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f0236a00640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02380cec70 0x7f023815f110 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f022400e9e0 tx=0x7f022400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f022f400640 1 -- 172.21.15.144:0/3948746187 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224017070 con 0x7f02380cec70 2024-05-30T16:47:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f022f400640 1 -- 172.21.15.144:0/3948746187 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022400c9d0 con 0x7f02380cec70 2024-05-30T16:47:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0238155490 con 0x7f02380cec70 2024-05-30T16:47:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f022f400640 1 -- 172.21.15.144:0/3948746187 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022400cdc0 con 0x7f02380cec70 2024-05-30T16:47:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.042+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0238155a50 con 0x7f02380cec70 2024-05-30T16:47:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.044+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0238068b90 con 0x7f02380cec70 2024-05-30T16:47:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.045+0000 7f022f400640 1 -- 172.21.15.144:0/3948746187 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f022401a070 con 0x7f02380cec70 2024-05-30T16:47:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.045+0000 7f022f400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f021806d0d0 0x7f021806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.046+0000 7f022f400640 1 -- 172.21.15.144:0/3948746187 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4885+0+0 (secure 0 0 0) 0x7f022408a900 con 0x7f02380cec70 2024-05-30T16:47:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.046+0000 7f0237400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f021806d0d0 0x7f021806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.046+0000 7f0237400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f021806d0d0 0x7f021806f590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0228034000 tx=0x7f022802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.052+0000 7f022f400640 1 -- 172.21.15.144:0/3948746187 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f022405a620 con 0x7f02380cec70 2024-05-30T16:47:56.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.237+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f023806f250 con 0x7f02380cec70 2024-05-30T16:47:56.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.238+0000 7f022f400640 1 -- 172.21.15.144:0/3948746187 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) ==== 84+0+65 (secure 0 0 0) 0x7f0224059f20 con 0x7f02380cec70 2024-05-30T16:47:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:56.239 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:47:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:47:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-05-30T16:47:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-05-30T16:47:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:47:56.240 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f021806d0d0 msgr2=0x7f021806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f021806d0d0 0x7f021806f590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0228034000 tx=0x7f022802e000 comp rx=0 tx=0).stop 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02380cec70 msgr2=0x7f023815f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02380cec70 0x7f023815f110 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f022400e9e0 tx=0x7f022400eea0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 shutdown_connections 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f021806d0d0 0x7f021806f590 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f023813f760 0x7f02381526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02380cec70 0x7f023815f110 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 --2- 172.21.15.144:0/3948746187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02380b5e00 0x7f0238159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 >> 172.21.15.144:0/3948746187 conn(0x7f023806bd00 msgr2=0x7f023806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.240+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 shutdown_connections 2024-05-30T16:47:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.241+0000 7f023e400640 1 -- 172.21.15.144:0/3948746187 wait complete. 2024-05-30T16:47:56.260 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:47:56.260 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:47:56.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.454+0000 7ffb8a400640 1 Processor -- start 2024-05-30T16:47:56.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.455+0000 7ffb8a400640 1 -- start start 2024-05-30T16:47:56.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.456+0000 7ffb8a400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffb8415eb80 0x7ffb84162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.456+0000 7ffb8a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb840ba2b0 0x7ffb840cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.456+0000 7ffb8a400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb84163550 con 0x7ffb840cfaa0 2024-05-30T16:47:56.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.456+0000 7ffb8a400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ffb8415ef60 con 0x7ffb8415eb80 2024-05-30T16:47:56.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.456+0000 7ffb8a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffb840d4580 con 0x7ffb840ba2b0 2024-05-30T16:47:56.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.457+0000 7ffb82a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb840ba2b0 0x7ffb840cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.457+0000 7ffb82a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb840ba2b0 0x7ffb840cf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:46500/0 (socket says 172.21.15.144:46500) 2024-05-30T16:47:56.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.457+0000 7ffb82a00640 1 -- 172.21.15.144:0/1322466863 learned_addr learned my addr 172.21.15.144:0/1322466863 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:56.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.457+0000 7ffb83400640 1 --2- 172.21.15.144:0/1322466863 >> v2:172.21.15.149:3300/0 conn(0x7ffb8415eb80 0x7ffb84162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.457+0000 7ffb82a00640 1 -- 172.21.15.144:0/1322466863 >> v2:172.21.15.149:3300/0 conn(0x7ffb8415eb80 msgr2=0x7ffb84162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:56.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.457+0000 7ffb82a00640 1 --2- 172.21.15.144:0/1322466863 >> v2:172.21.15.149:3300/0 conn(0x7ffb8415eb80 0x7ffb84162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.457+0000 7ffb82a00640 1 -- 172.21.15.144:0/1322466863 >> v1:172.21.15.149:6789/0 conn(0x7ffb840cfaa0 legacy=0x7ffb840b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.458+0000 7ffb82a00640 1 -- 172.21.15.144:0/1322466863 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb84162f90 con 0x7ffb840ba2b0 2024-05-30T16:47:56.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.459+0000 7ffb82a00640 1 --2- 172.21.15.144:0/1322466863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb840ba2b0 0x7ffb840cf560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009870 tx=0x7ffb7402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da8f026c5bb296a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:56.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.459+0000 7ffb82000640 1 -- 172.21.15.144:0/1322466863 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74037070 con 0x7ffb840ba2b0 2024-05-30T16:47:56.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.459+0000 7ffb82000640 1 -- 172.21.15.144:0/1322466863 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb74032440 con 0x7ffb840ba2b0 2024-05-30T16:47:56.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.459+0000 7ffb82000640 1 -- 172.21.15.144:0/1322466863 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74032810 con 0x7ffb840ba2b0 2024-05-30T16:47:56.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.460+0000 7ffb8a400640 1 -- 172.21.15.144:0/1322466863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb840ba2b0 msgr2=0x7ffb840cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.460+0000 7ffb8a400640 1 --2- 172.21.15.144:0/1322466863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb840ba2b0 0x7ffb840cf560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009870 tx=0x7ffb7402a250 comp rx=0 tx=0).stop 2024-05-30T16:47:56.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.460+0000 7ffb8a400640 1 -- 172.21.15.144:0/1322466863 shutdown_connections 2024-05-30T16:47:56.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.460+0000 7ffb8a400640 1 --2- 172.21.15.144:0/1322466863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb840ba2b0 0x7ffb840cf560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.460+0000 7ffb8a400640 1 --2- 172.21.15.144:0/1322466863 >> v2:172.21.15.149:3300/0 conn(0x7ffb8415eb80 0x7ffb84162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.460+0000 7ffb8a400640 1 -- 172.21.15.144:0/1322466863 >> 172.21.15.144:0/1322466863 conn(0x7ffb8406cf40 msgr2=0x7ffb8406d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:56.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.460+0000 7ffb8a400640 1 -- 172.21.15.144:0/1322466863 shutdown_connections 2024-05-30T16:47:56.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.460+0000 7ffb8a400640 1 -- 172.21.15.144:0/1322466863 wait complete. 2024-05-30T16:47:56.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.462+0000 7ffb8a400640 1 Processor -- start 2024-05-30T16:47:56.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.462+0000 7ffb8a400640 1 -- start start 2024-05-30T16:47:56.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb8a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb840ba2b0 0x7ffb840cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb8a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb840cfaa0 0x7ffb84151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb8a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb8415eb80 0x7ffb84146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb8a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb840d3050 con 0x7ffb840cfaa0 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb8a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffb840d2d70 con 0x7ffb840ba2b0 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb8a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffb84162b80 con 0x7ffb8415eb80 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb840cfaa0 0x7ffb84151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb840cfaa0 0x7ffb84151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43004/0 (socket says 172.21.15.144:43004) 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb82a00640 1 -- 172.21.15.144:0/3446696661 learned_addr learned my addr 172.21.15.144:0/3446696661 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb83400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb840ba2b0 0x7ffb840cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb83e00640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb8415eb80 0x7ffb84146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb82a00640 1 -- 172.21.15.144:0/3446696661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb8415eb80 msgr2=0x7ffb84146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb82a00640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb8415eb80 0x7ffb84146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb82a00640 1 -- 172.21.15.144:0/3446696661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb840ba2b0 msgr2=0x7ffb840cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb82a00640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb840ba2b0 0x7ffb840cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:56.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.464+0000 7ffb82a00640 1 -- 172.21.15.144:0/3446696661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb84147090 con 0x7ffb840cfaa0 2024-05-30T16:47:56.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.465+0000 7ffb82a00640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb840cfaa0 0x7ffb84151f20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb7402a290 tx=0x7ffb740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:56.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.465+0000 7ffb7b400640 1 -- 172.21.15.144:0/3446696661 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74041020 con 0x7ffb840cfaa0 2024-05-30T16:47:56.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.465+0000 7ffb7b400640 1 -- 172.21.15.144:0/3446696661 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb740306c0 con 0x7ffb840cfaa0 2024-05-30T16:47:56.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.465+0000 7ffb7b400640 1 -- 172.21.15.144:0/3446696661 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74037040 con 0x7ffb840cfaa0 2024-05-30T16:47:56.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.465+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb84150d80 con 0x7ffb840cfaa0 2024-05-30T16:47:56.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.465+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb840ccbd0 con 0x7ffb840cfaa0 2024-05-30T16:47:56.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.466+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb84068b90 con 0x7ffb840cfaa0 2024-05-30T16:47:56.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.467+0000 7ffb7b400640 1 -- 172.21.15.144:0/3446696661 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7ffb74044020 con 0x7ffb840cfaa0 2024-05-30T16:47:56.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.468+0000 7ffb7b400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb6006d100 0x7ffb6006f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:56.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.468+0000 7ffb7b400640 1 -- 172.21.15.144:0/3446696661 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4885+0+0 (secure 0 0 0) 0x7ffb740ad370 con 0x7ffb840cfaa0 2024-05-30T16:47:56.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.469+0000 7ffb83400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb6006d100 0x7ffb6006f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:56.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.469+0000 7ffb83400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb6006d100 0x7ffb6006f5c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0099c0 tx=0x7ffb7c003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:56.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.472+0000 7ffb7b400640 1 -- 172.21.15.144:0/3446696661 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffb7404b030 con 0x7ffb840cfaa0 2024-05-30T16:47:56.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:56.654+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ffb840d25a0 con 0x7ffb840cfaa0 2024-05-30T16:47:57.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.330+0000 7ffb7b400640 1 -- 172.21.15.144:0/3446696661 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) ==== 138+0+0 (secure 0 0 0) 0x7ffb7407aa60 con 0x7ffb840cfaa0 2024-05-30T16:47:57.332 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-05-30T16:47:57.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.334+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb6006d100 msgr2=0x7ffb6006f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:57.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.334+0000 7ffb8a400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb6006d100 0x7ffb6006f5c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0099c0 tx=0x7ffb7c003990 comp rx=0 tx=0).stop 2024-05-30T16:47:57.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.334+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb840cfaa0 msgr2=0x7ffb84151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:57.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.334+0000 7ffb8a400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb840cfaa0 0x7ffb84151f20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb7402a290 tx=0x7ffb740046c0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.335+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 shutdown_connections 2024-05-30T16:47:57.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.335+0000 7ffb8a400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb6006d100 0x7ffb6006f5c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.335+0000 7ffb8a400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb8415eb80 0x7ffb84146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.335+0000 7ffb8a400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb840cfaa0 0x7ffb84151f20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.335+0000 7ffb8a400640 1 --2- 172.21.15.144:0/3446696661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb840ba2b0 0x7ffb840cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.335+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 >> 172.21.15.144:0/3446696661 conn(0x7ffb8406cf40 msgr2=0x7ffb84154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:57.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.336+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 shutdown_connections 2024-05-30T16:47:57.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.336+0000 7ffb8a400640 1 -- 172.21.15.144:0/3446696661 wait complete. 2024-05-30T16:47:57.363 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:47:57.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.561+0000 7f0be9200640 1 Processor -- start 2024-05-30T16:47:57.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.561+0000 7f0be9200640 1 -- start start 2024-05-30T16:47:57.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0be9200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0be414c630 0x7f0be40ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:57.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0be9200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0be40cea10 0x7f0be4072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:57.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0be9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be4072750 0x7f0be406dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:57.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0be9200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0be40cee30 con 0x7f0be40cea10 2024-05-30T16:47:57.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0be9200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f0be4072bc0 con 0x7f0be414c630 2024-05-30T16:47:57.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0be9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0be406fbf0 con 0x7f0be4072750 2024-05-30T16:47:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0bdbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0be40cea10 0x7f0be4072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0bdbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0be40cea10 0x7f0be4072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43012/0 (socket says 172.21.15.144:43012) 2024-05-30T16:47:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0bdbe00640 1 -- 172.21.15.144:0/1911872826 learned_addr learned my addr 172.21.15.144:0/1911872826 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0be2800640 1 --2- 172.21.15.144:0/1911872826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be4072750 0x7f0be406dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.563+0000 7f0be1e00640 1 --2- 172.21.15.144:0/1911872826 >> v2:172.21.15.149:3300/0 conn(0x7f0be414c630 0x7f0be40ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.564+0000 7f0bdbe00640 1 -- 172.21.15.144:0/1911872826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be4072750 msgr2=0x7f0be406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.564+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/1911872826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be4072750 0x7f0be406dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.564+0000 7f0bdbe00640 1 -- 172.21.15.144:0/1911872826 >> v2:172.21.15.149:3300/0 conn(0x7f0be414c630 msgr2=0x7f0be40ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.564+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/1911872826 >> v2:172.21.15.149:3300/0 conn(0x7f0be414c630 0x7f0be40ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.564+0000 7f0bdbe00640 1 -- 172.21.15.144:0/1911872826 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be40cf050 con 0x7f0be40cea10 2024-05-30T16:47:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.564+0000 7f0be1e00640 1 --2- 172.21.15.144:0/1911872826 >> v2:172.21.15.149:3300/0 conn(0x7f0be414c630 0x7f0be40ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.565+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/1911872826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be40cea10 0x7f0be4072210 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0be40b6870 tx=0x7f0bcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b31cdd6b8c5d93 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:57.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.565+0000 7f0be1400640 1 -- 172.21.15.144:0/1911872826 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc037070 con 0x7f0be40cea10 2024-05-30T16:47:57.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.565+0000 7f0be1400640 1 -- 172.21.15.144:0/1911872826 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bcc032440 con 0x7f0be40cea10 2024-05-30T16:47:57.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.565+0000 7f0be1400640 1 -- 172.21.15.144:0/1911872826 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc032810 con 0x7f0be40cea10 2024-05-30T16:47:57.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.566+0000 7f0be9200640 1 -- 172.21.15.144:0/1911872826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be40cea10 msgr2=0x7f0be4072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:57.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.566+0000 7f0be9200640 1 --2- 172.21.15.144:0/1911872826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be40cea10 0x7f0be4072210 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0be40b6870 tx=0x7f0bcc02a270 comp rx=0 tx=0).stop 2024-05-30T16:47:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.566+0000 7f0be9200640 1 -- 172.21.15.144:0/1911872826 shutdown_connections 2024-05-30T16:47:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.566+0000 7f0be9200640 1 --2- 172.21.15.144:0/1911872826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be4072750 0x7f0be406dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.566+0000 7f0be9200640 1 --2- 172.21.15.144:0/1911872826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be40cea10 0x7f0be4072210 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.566+0000 7f0be9200640 1 --2- 172.21.15.144:0/1911872826 >> v2:172.21.15.149:3300/0 conn(0x7f0be414c630 0x7f0be40ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.566+0000 7f0be9200640 1 -- 172.21.15.144:0/1911872826 >> 172.21.15.144:0/1911872826 conn(0x7f0be406bd00 msgr2=0x7f0be406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.566+0000 7f0be9200640 1 -- 172.21.15.144:0/1911872826 shutdown_connections 2024-05-30T16:47:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.566+0000 7f0be9200640 1 -- 172.21.15.144:0/1911872826 wait complete. 2024-05-30T16:47:57.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.568+0000 7f0be9200640 1 Processor -- start 2024-05-30T16:47:57.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.568+0000 7f0be9200640 1 -- start start 2024-05-30T16:47:57.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be4072750 0x7f0be4165570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:57.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be40cea10 0x7f0be41486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:57.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be414c630 0x7f0be40ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:57.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0be40cf8f0 con 0x7f0be4072750 2024-05-30T16:47:57.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0be40cf610 con 0x7f0be414c630 2024-05-30T16:47:57.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0be40b3c20 con 0x7f0be40cea10 2024-05-30T16:47:57.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be4072750 0x7f0be4165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:57.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be4072750 0x7f0be4165570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43018/0 (socket says 172.21.15.144:43018) 2024-05-30T16:47:57.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be1e00640 1 -- 172.21.15.144:0/2280726928 learned_addr learned my addr 172.21.15.144:0/2280726928 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:57.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be1e00640 1 -- 172.21.15.144:0/2280726928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be40cea10 msgr2=0x7f0be41486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:57.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0be2800640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be414c630 0x7f0be40ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:57.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.569+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be40cea10 0x7f0be41486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:57.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0be1e00640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be40cea10 0x7f0be41486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0be1e00640 1 -- 172.21.15.144:0/2280726928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be414c630 msgr2=0x7f0be40ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:57.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0be1e00640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be414c630 0x7f0be40ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:57.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0be1e00640 1 -- 172.21.15.144:0/2280726928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be40ac7c0 con 0x7f0be4072750 2024-05-30T16:47:57.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0be2800640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be414c630 0x7f0be40ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:57.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0be1e00640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be4072750 0x7f0be4165570 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400c820 tx=0x7f0bd400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:57.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0bda000640 1 -- 172.21.15.144:0/2280726928 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4015070 con 0x7f0be4072750 2024-05-30T16:47:57.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0bda000640 1 -- 172.21.15.144:0/2280726928 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd4007a30 con 0x7f0be4072750 2024-05-30T16:47:57.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be40acaa0 con 0x7f0be4072750 2024-05-30T16:47:57.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0bda000640 1 -- 172.21.15.144:0/2280726928 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4007e00 con 0x7f0be4072750 2024-05-30T16:47:57.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.570+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be40ae040 con 0x7f0be4072750 2024-05-30T16:47:57.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.571+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be40acfc0 con 0x7f0be4072750 2024-05-30T16:47:57.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.573+0000 7f0bda000640 1 -- 172.21.15.144:0/2280726928 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f0bd4018070 con 0x7f0be4072750 2024-05-30T16:47:57.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.574+0000 7f0bda000640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bc006d0d0 0x7f0bc006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:57.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.574+0000 7f0bda000640 1 -- 172.21.15.144:0/2280726928 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5255+0+0 (secure 0 0 0) 0x7f0bd408a520 con 0x7f0be4072750 2024-05-30T16:47:57.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.574+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bc006d0d0 0x7f0bc006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:57.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.575+0000 7f0bdbe00640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bc006d0d0 0x7f0bc006f590 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc034000 tx=0x7f0bcc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:57.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.579+0000 7f0bda000640 1 -- 172.21.15.144:0/2280726928 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0be40acfc0 con 0x7f0be4072750 2024-05-30T16:47:57.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:57.780+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0be4068b90 con 0x7f0be4072750 2024-05-30T16:47:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.337+0000 7f0bda000640 1 -- 172.21.15.144:0/2280726928 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) ==== 170+0+0 (secure 0 0 0) 0x7f0bd405a240 con 0x7f0be4072750 2024-05-30T16:47:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bc006d0d0 msgr2=0x7f0bc006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bc006d0d0 0x7f0bc006f590 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc034000 tx=0x7f0bcc02e000 comp rx=0 tx=0).stop 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be4072750 msgr2=0x7f0be4165570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be4072750 0x7f0be4165570 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400c820 tx=0x7f0bd400cc20 comp rx=0 tx=0).stop 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 shutdown_connections 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0bc006d0d0 0x7f0bc006f590 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be414c630 0x7f0be40ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0be40cea10 0x7f0be41486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 --2- 172.21.15.144:0/2280726928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0be4072750 0x7f0be4165570 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 >> 172.21.15.144:0/2280726928 conn(0x7f0be406bd00 msgr2=0x7f0be406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 shutdown_connections 2024-05-30T16:47:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.341+0000 7f0be9200640 1 -- 172.21.15.144:0/2280726928 wait complete. 2024-05-30T16:47:58.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:47:58.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.552+0000 7fde46000640 1 Processor -- start 2024-05-30T16:47:58.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.552+0000 7fde46000640 1 -- start start 2024-05-30T16:47:58.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.554+0000 7fde46000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde40145f10 0x7fde400cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:58.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.554+0000 7fde46000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fde4006c3d0 0x7fde40160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:58.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.554+0000 7fde46000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde401607c0 0x7fde4015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:58.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.554+0000 7fde46000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fde40160c50 con 0x7fde4006c3d0 2024-05-30T16:47:58.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.554+0000 7fde46000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fde40161100 con 0x7fde401607c0 2024-05-30T16:47:58.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.554+0000 7fde46000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fde4006c810 con 0x7fde40145f10 2024-05-30T16:47:58.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.554+0000 7fde37e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fde4006c3d0 0x7fde40160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:58.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.554+0000 7fde37e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fde4006c3d0 0x7fde40160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43034/0 (socket says 172.21.15.144:43034) 2024-05-30T16:47:58.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.554+0000 7fde37e00640 1 -- 172.21.15.144:0/2918051663 learned_addr learned my addr 172.21.15.144:0/2918051663 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:58.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.555+0000 7fde44c00640 1 --2- 172.21.15.144:0/2918051663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde40145f10 0x7fde400cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:58.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.555+0000 7fde45600640 1 --2- 172.21.15.144:0/2918051663 >> v2:172.21.15.149:3300/0 conn(0x7fde401607c0 0x7fde4015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:58.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.555+0000 7fde37e00640 1 -- 172.21.15.144:0/2918051663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde40145f10 msgr2=0x7fde400cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:58.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.555+0000 7fde37e00640 1 --2- 172.21.15.144:0/2918051663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde40145f10 0x7fde400cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.555+0000 7fde37e00640 1 -- 172.21.15.144:0/2918051663 >> v2:172.21.15.149:3300/0 conn(0x7fde401607c0 msgr2=0x7fde4015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:58.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.555+0000 7fde37e00640 1 --2- 172.21.15.144:0/2918051663 >> v2:172.21.15.149:3300/0 conn(0x7fde401607c0 0x7fde4015cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.555+0000 7fde37e00640 1 -- 172.21.15.144:0/2918051663 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde400cd3e0 con 0x7fde4006c3d0 2024-05-30T16:47:58.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.555+0000 7fde45600640 1 --2- 172.21.15.144:0/2918051663 >> v2:172.21.15.149:3300/0 conn(0x7fde401607c0 0x7fde4015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:58.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.555+0000 7fde44c00640 1 --2- 172.21.15.144:0/2918051663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde40145f10 0x7fde400cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:58.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.556+0000 7fde37e00640 1 --2- 172.21.15.144:0/2918051663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4006c3d0 0x7fde40160280 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fde4006dc50 tx=0x7fde3002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84dcc3cf604010e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:58.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.556+0000 7fde3fe00640 1 -- 172.21.15.144:0/2918051663 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30037070 con 0x7fde4006c3d0 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.556+0000 7fde3fe00640 1 -- 172.21.15.144:0/2918051663 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde30032440 con 0x7fde4006c3d0 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.556+0000 7fde3fe00640 1 -- 172.21.15.144:0/2918051663 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30032810 con 0x7fde4006c3d0 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.557+0000 7fde46000640 1 -- 172.21.15.144:0/2918051663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4006c3d0 msgr2=0x7fde40160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.557+0000 7fde46000640 1 --2- 172.21.15.144:0/2918051663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4006c3d0 0x7fde40160280 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fde4006dc50 tx=0x7fde3002a210 comp rx=0 tx=0).stop 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.557+0000 7fde46000640 1 -- 172.21.15.144:0/2918051663 shutdown_connections 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.557+0000 7fde46000640 1 --2- 172.21.15.144:0/2918051663 >> v2:172.21.15.149:3300/0 conn(0x7fde401607c0 0x7fde4015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.557+0000 7fde46000640 1 --2- 172.21.15.144:0/2918051663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4006c3d0 0x7fde40160280 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.557+0000 7fde46000640 1 --2- 172.21.15.144:0/2918051663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde40145f10 0x7fde400cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.557+0000 7fde46000640 1 -- 172.21.15.144:0/2918051663 >> 172.21.15.144:0/2918051663 conn(0x7fde4006b8e0 msgr2=0x7fde4006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.557+0000 7fde46000640 1 -- 172.21.15.144:0/2918051663 shutdown_connections 2024-05-30T16:47:58.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.557+0000 7fde46000640 1 -- 172.21.15.144:0/2918051663 wait complete. 2024-05-30T16:47:58.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.559+0000 7fde46000640 1 Processor -- start 2024-05-30T16:47:58.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.559+0000 7fde46000640 1 -- start start 2024-05-30T16:47:58.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.560+0000 7fde46000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde4006c3d0 0x7fde400b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:58.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.560+0000 7fde46000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde40145f10 0x7fde400b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.560+0000 7fde46000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde401607c0 0x7fde400b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.560+0000 7fde46000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde400cdc80 con 0x7fde40145f10 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.560+0000 7fde46000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fde400cd9a0 con 0x7fde401607c0 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.560+0000 7fde46000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fde400cdf60 con 0x7fde4006c3d0 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde37e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde40145f10 0x7fde400b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde37e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde40145f10 0x7fde400b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43040/0 (socket says 172.21.15.144:43040) 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde37e00640 1 -- 172.21.15.144:0/1484359976 learned_addr learned my addr 172.21.15.144:0/1484359976 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde44c00640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde4006c3d0 0x7fde400b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde45600640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde401607c0 0x7fde400b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde37e00640 1 -- 172.21.15.144:0/1484359976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde4006c3d0 msgr2=0x7fde400b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde37e00640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde4006c3d0 0x7fde400b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde37e00640 1 -- 172.21.15.144:0/1484359976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde401607c0 msgr2=0x7fde400b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde37e00640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde401607c0 0x7fde400b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:58.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde37e00640 1 -- 172.21.15.144:0/1484359976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde400cbdd0 con 0x7fde40145f10 2024-05-30T16:47:58.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.561+0000 7fde45600640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde401607c0 0x7fde400b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:47:58.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.562+0000 7fde37e00640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde40145f10 0x7fde400b0ce0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fde30000c00 tx=0x7fde300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:58.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.562+0000 7fde3d600640 1 -- 172.21.15.144:0/1484359976 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30041020 con 0x7fde40145f10 2024-05-30T16:47:58.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.562+0000 7fde3d600640 1 -- 172.21.15.144:0/1484359976 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde30030800 con 0x7fde40145f10 2024-05-30T16:47:58.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.562+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde401f45a0 con 0x7fde40145f10 2024-05-30T16:47:58.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.562+0000 7fde3d600640 1 -- 172.21.15.144:0/1484359976 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30037040 con 0x7fde40145f10 2024-05-30T16:47:58.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.562+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde401f4b60 con 0x7fde40145f10 2024-05-30T16:47:58.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.564+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde400632f0 con 0x7fde40145f10 2024-05-30T16:47:58.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.565+0000 7fde3d600640 1 -- 172.21.15.144:0/1484359976 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fde30044020 con 0x7fde40145f10 2024-05-30T16:47:58.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.566+0000 7fde3d600640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde1c06d0d0 0x7fde1c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:58.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.566+0000 7fde3d600640 1 -- 172.21.15.144:0/1484359976 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5637+0+0 (secure 0 0 0) 0x7fde300ada70 con 0x7fde40145f10 2024-05-30T16:47:58.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.566+0000 7fde44c00640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde1c06d0d0 0x7fde1c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:58.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.567+0000 7fde44c00640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde1c06d0d0 0x7fde1c06f590 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fde28006b10 tx=0x7fde28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:58.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.570+0000 7fde3d600640 1 -- 172.21.15.144:0/1484359976 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde3004b030 con 0x7fde40145f10 2024-05-30T16:47:58.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:58.806+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fde400b03c0 con 0x7fde40145f10 2024-05-30T16:47:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.386+0000 7fde3d600640 1 -- 172.21.15.144:0/1484359976 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v31) ==== 172+0+0 (secure 0 0 0) 0x7fde3007b0f0 con 0x7fde40145f10 2024-05-30T16:47:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 8 and data pool 9 2024-05-30T16:47:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde1c06d0d0 msgr2=0x7fde1c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde1c06d0d0 0x7fde1c06f590 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fde28006b10 tx=0x7fde28008040 comp rx=0 tx=0).stop 2024-05-30T16:47:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde40145f10 msgr2=0x7fde400b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde40145f10 0x7fde400b0ce0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fde30000c00 tx=0x7fde300046c0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 shutdown_connections 2024-05-30T16:47:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fde1c06d0d0 0x7fde1c06f590 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fde28006b10 tx=0x7fde28008040 comp rx=0 tx=0).stop 2024-05-30T16:47:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde401607c0 0x7fde400b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde40145f10 0x7fde400b0ce0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 --2- 172.21.15.144:0/1484359976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde4006c3d0 0x7fde400b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.394+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 >> 172.21.15.144:0/1484359976 conn(0x7fde4006b8e0 msgr2=0x7fde400b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.396+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 shutdown_connections 2024-05-30T16:47:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.396+0000 7fde46000640 1 -- 172.21.15.144:0/1484359976 wait complete. 2024-05-30T16:47:59.429 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:47:59.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.597+0000 7f5db0e00640 1 Processor -- start 2024-05-30T16:47:59.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.597+0000 7f5db0e00640 1 -- start start 2024-05-30T16:47:59.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.599+0000 7f5db0e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5dac0afa00 0x7f5dac140570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:59.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.599+0000 7f5db0e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dac0cd030 con 0x7f5dac0cc7a0 2024-05-30T16:47:59.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.599+0000 7f5db0e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dac0ceca0 con 0x7f5dac06dfc0 2024-05-30T16:47:59.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.599+0000 7f5db0e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5dac072920 con 0x7f5dac0afa00 2024-05-30T16:47:59.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.599+0000 7f5da9e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5dac0cc7a0 0x7f5dac15bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33250/0 (socket says 172.21.15.144:33250) 2024-05-30T16:47:59.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.599+0000 7f5da9e00640 1 -- 172.21.15.144:0/1499349415 learned_addr learned my addr 172.21.15.144:0/1499349415 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:47:59.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052700941 0 0) 0x7f5dac0cd030 con 0x7f5dac0cc7a0 2024-05-30T16:47:59.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d90003520 con 0x7f5dac0cc7a0 2024-05-30T16:47:59.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5daa800640 1 --2- 172.21.15.144:0/1499349415 >> v2:172.21.15.149:3300/0 conn(0x7f5dac0afa00 0x7f5dac140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:59.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 492206534 0 0) 0x7f5d90003520 con 0x7f5dac0cc7a0 2024-05-30T16:47:59.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 >> v2:172.21.15.149:3300/0 conn(0x7f5dac0afa00 msgr2=0x7f5dac140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:59.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 --2- 172.21.15.144:0/1499349415 >> v2:172.21.15.149:3300/0 conn(0x7f5dac0afa00 0x7f5dac140570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 >> v1:172.21.15.149:6789/0 conn(0x7f5dac06dfc0 legacy=0x7f5dac072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:59.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac0cd2a0 con 0x7f5dac0cc7a0 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f5d9c001670 con 0x7f5dac0cc7a0 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 >> v1:172.21.15.144:6789/0 conn(0x7f5dac0cc7a0 legacy=0x7f5dac15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5d90003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d90004800 0x7f5d90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d900053c0 0x7f5d9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac072920 con 0x7f5d900039b0 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9000c260 con 0x7f5d90004800 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9000c460 con 0x7f5d900053c0 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.600+0000 7f5da9e00640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5d90003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.601+0000 7f5da1400640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d90004800 0x7f5d90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.601+0000 7f5da9e00640 1 -- 172.21.15.144:0/1499349415 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d900053c0 msgr2=0x7f5d9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.601+0000 7f5daa800640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d900053c0 0x7f5d9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:59.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.601+0000 7f5da9e00640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d900053c0 0x7f5d9000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.601+0000 7f5da9e00640 1 -- 172.21.15.144:0/1499349415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d90004800 msgr2=0x7f5d90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:47:59.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.601+0000 7f5da9e00640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d90004800 0x7f5d90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.601+0000 7f5da9e00640 1 -- 172.21.15.144:0/1499349415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d90003520 con 0x7f5d900039b0 2024-05-30T16:47:59.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.601+0000 7f5daa800640 1 -- 172.21.15.144:0/1499349415 reap_dead start 2024-05-30T16:47:59.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.602+0000 7f5da9e00640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5d90003db0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c240 tx=0x7f5d90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbdf18ea1846fe2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:59.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.602+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c02e070 con 0x7f5d900039b0 2024-05-30T16:47:59.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.602+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c005af0 con 0x7f5d900039b0 2024-05-30T16:47:59.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.602+0000 7f5da9400640 1 -- 172.21.15.144:0/1499349415 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c007d30 con 0x7f5d900039b0 2024-05-30T16:47:59.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.603+0000 7f5db0e00640 1 -- 172.21.15.144:0/1499349415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 msgr2=0x7f5d90003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:59.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.603+0000 7f5db0e00640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5d90003db0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c240 tx=0x7f5d90005830 comp rx=0 tx=0).stop 2024-05-30T16:47:59.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.603+0000 7f5db0e00640 1 -- 172.21.15.144:0/1499349415 shutdown_connections 2024-05-30T16:47:59.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.603+0000 7f5db0e00640 1 --2- 172.21.15.144:0/1499349415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5d90003db0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.603+0000 7f5db0e00640 1 -- 172.21.15.144:0/1499349415 >> 172.21.15.144:0/1499349415 conn(0x7f5dac06bd00 msgr2=0x7f5dac06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:59.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.603+0000 7f5db0e00640 1 -- 172.21.15.144:0/1499349415 shutdown_connections 2024-05-30T16:47:59.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.603+0000 7f5db0e00640 1 -- 172.21.15.144:0/1499349415 wait complete. 2024-05-30T16:47:59.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.605+0000 7f5db0e00640 1 Processor -- start 2024-05-30T16:47:59.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.605+0000 7f5db0e00640 1 -- start start 2024-05-30T16:47:59.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5db0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5dac14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:59.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5db0e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac14c4a0 0x7f5dac1f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:59.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5db0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac1f5270 0x7f5dac0b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:59.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5db0e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac0cd860 con 0x7f5d900039b0 2024-05-30T16:47:59.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5db0e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac0afe70 con 0x7f5dac1f5270 2024-05-30T16:47:59.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5db0e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5dac0ccc60 con 0x7f5dac14c4a0 2024-05-30T16:47:59.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5da9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5dac14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:59.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5da9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5dac14bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43054/0 (socket says 172.21.15.144:43054) 2024-05-30T16:47:59.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5da9e00640 1 -- 172.21.15.144:0/2974692681 learned_addr learned my addr 172.21.15.144:0/2974692681 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:47:59.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5da1400640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac14c4a0 0x7f5dac1f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5da9e00640 1 -- 172.21.15.144:0/2974692681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac14c4a0 msgr2=0x7f5dac1f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5da9e00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac14c4a0 0x7f5dac1f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5da9e00640 1 -- 172.21.15.144:0/2974692681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac1f5270 msgr2=0x7f5dac0b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5da9e00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac1f5270 0x7f5dac0b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.606+0000 7f5da9e00640 1 -- 172.21.15.144:0/2974692681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac1f5720 con 0x7f5d900039b0 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.607+0000 7f5da9e00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5dac14bf60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c02ae30 tx=0x7f5dac0cd470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.607+0000 7f5da2a00640 1 -- 172.21.15.144:0/2974692681 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c042020 con 0x7f5d900039b0 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.607+0000 7f5da2a00640 1 -- 172.21.15.144:0/2974692681 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c004bf0 con 0x7f5d900039b0 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.607+0000 7f5da2a00640 1 -- 172.21.15.144:0/2974692681 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c007070 con 0x7f5d900039b0 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.607+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dac14aec0 con 0x7f5d900039b0 2024-05-30T16:47:59.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.607+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac14b480 con 0x7f5d900039b0 2024-05-30T16:47:59.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.608+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dac0cda80 con 0x7f5d900039b0 2024-05-30T16:47:59.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.609+0000 7f5da2a00640 1 -- 172.21.15.144:0/2974692681 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f5d9c045020 con 0x7f5d900039b0 2024-05-30T16:47:59.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.611+0000 7f5da2a00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806d0d0 0x7f5d8806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:47:59.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.611+0000 7f5da2a00640 1 -- 172.21.15.144:0/2974692681 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5737+0+0 (secure 0 0 0) 0x7f5d9c0acbe0 con 0x7f5d900039b0 2024-05-30T16:47:59.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.611+0000 7f5da1400640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806d0d0 0x7f5d8806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:47:59.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.612+0000 7f5da1400640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806d0d0 0x7f5d8806f590 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007fd0 tx=0x7f5d94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:47:59.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.615+0000 7f5da2a00640 1 -- 172.21.15.144:0/2974692681 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5dac0cda80 con 0x7f5d900039b0 2024-05-30T16:47:59.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.803+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5dac068b90 con 0x7f5d900039b0 2024-05-30T16:47:59.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.805+0000 7f5da2a00640 1 -- 172.21.15.144:0/2974692681 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16757 (secure 0 0 0) 0x7f5d9c07a4b0 con 0x7f5d900039b0 2024-05-30T16:47:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:47:59.806 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":58,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:47:58.808628+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:47:56.670101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:47:57.798316+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:47:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806d0d0 msgr2=0x7f5d8806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806d0d0 0x7f5d8806f590 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007fd0 tx=0x7f5d94009040 comp rx=0 tx=0).stop 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 msgr2=0x7f5dac14bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5dac14bf60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c02ae30 tx=0x7f5dac0cd470 comp rx=0 tx=0).stop 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 shutdown_connections 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806d0d0 0x7f5d8806f590 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac1f5270 0x7f5dac0b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac14c4a0 0x7f5dac1f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 --2- 172.21.15.144:0/2974692681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900039b0 0x7f5dac14bf60 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 >> 172.21.15.144:0/2974692681 conn(0x7f5dac06bd00 msgr2=0x7f5dac0b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:47:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 shutdown_connections 2024-05-30T16:47:59.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:47:59.807+0000 7f5db0e00640 1 -- 172.21.15.144:0/2974692681 wait complete. 2024-05-30T16:47:59.827 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:48:00.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.024+0000 7f387aa00640 1 Processor -- start 2024-05-30T16:48:00.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.024+0000 7f387aa00640 1 -- start start 2024-05-30T16:48:00.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.025+0000 7f387aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3874145150 0x7f38740cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.026+0000 7f387aa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38740d00f0 con 0x7f387406f7e0 2024-05-30T16:48:00.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.026+0000 7f387aa00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387415f390 con 0x7f38740cfa70 2024-05-30T16:48:00.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.026+0000 7f387aa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f38740cfeb0 con 0x7f3874145150 2024-05-30T16:48:00.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.026+0000 7f3873e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3874145150 0x7f38740cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:00.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.026+0000 7f3873e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3874145150 0x7f38740cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43064/0 (socket says 172.21.15.144:43064) 2024-05-30T16:48:00.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.026+0000 7f3873e00640 1 -- 172.21.15.144:0/2086584708 learned_addr learned my addr 172.21.15.144:0/2086584708 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:00.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.026+0000 7f3873e00640 1 -- 172.21.15.144:0/2086584708 >> v1:172.21.15.149:6789/0 conn(0x7f38740cfa70 legacy=0x7f387406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:00.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.026+0000 7f3873e00640 1 -- 172.21.15.144:0/2086584708 >> v1:172.21.15.144:6789/0 conn(0x7f387406f7e0 legacy=0x7f38740b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.026+0000 7f3873e00640 1 -- 172.21.15.144:0/2086584708 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387415f670 con 0x7f3874145150 2024-05-30T16:48:00.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.027+0000 7f3873e00640 1 --2- 172.21.15.144:0/2086584708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145150 0x7f38740cf530 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620b90b0c263d155 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:00.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f3873400640 1 -- 172.21.15.144:0/2086584708 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864037070 con 0x7f3874145150 2024-05-30T16:48:00.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f3873400640 1 -- 172.21.15.144:0/2086584708 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864032440 con 0x7f3874145150 2024-05-30T16:48:00.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f3873400640 1 -- 172.21.15.144:0/2086584708 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864032810 con 0x7f3874145150 2024-05-30T16:48:00.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f387aa00640 1 -- 172.21.15.144:0/2086584708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145150 msgr2=0x7f38740cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f387aa00640 1 --2- 172.21.15.144:0/2086584708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145150 0x7f38740cf530 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402a210 comp rx=0 tx=0).stop 2024-05-30T16:48:00.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f387aa00640 1 -- 172.21.15.144:0/2086584708 shutdown_connections 2024-05-30T16:48:00.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f387aa00640 1 --2- 172.21.15.144:0/2086584708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145150 0x7f38740cf530 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f387aa00640 1 -- 172.21.15.144:0/2086584708 >> 172.21.15.144:0/2086584708 conn(0x7f387406bd00 msgr2=0x7f387406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:00.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f387aa00640 1 -- 172.21.15.144:0/2086584708 shutdown_connections 2024-05-30T16:48:00.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.028+0000 7f387aa00640 1 -- 172.21.15.144:0/2086584708 wait complete. 2024-05-30T16:48:00.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.030+0000 7f387aa00640 1 Processor -- start 2024-05-30T16:48:00.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.030+0000 7f387aa00640 1 -- start start 2024-05-30T16:48:00.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.031+0000 7f387aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406f7e0 0x7f38741406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.031+0000 7f387aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38740cfa70 0x7f38741f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.031+0000 7f387aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874145150 0x7f38741e6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.031+0000 7f387aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38740b64f0 con 0x7f38740cfa70 2024-05-30T16:48:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.031+0000 7f387aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f387415f140 con 0x7f3874145150 2024-05-30T16:48:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.031+0000 7f387aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f387415fe70 con 0x7f387406f7e0 2024-05-30T16:48:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.031+0000 7f386b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38740cfa70 0x7f38741f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.031+0000 7f386b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38740cfa70 0x7f38741f4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43074/0 (socket says 172.21.15.144:43074) 2024-05-30T16:48:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.031+0000 7f386b400640 1 -- 172.21.15.144:0/90059873 learned_addr learned my addr 172.21.15.144:0/90059873 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:00.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f386b400640 1 -- 172.21.15.144:0/90059873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406f7e0 msgr2=0x7f38741406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f3873e00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406f7e0 0x7f38741406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:00.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f3878a00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874145150 0x7f38741e6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f386b400640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406f7e0 0x7f38741406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f386b400640 1 -- 172.21.15.144:0/90059873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874145150 msgr2=0x7f38741e6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f386b400640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874145150 0x7f38741e6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f386b400640 1 -- 172.21.15.144:0/90059873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387415be10 con 0x7f38740cfa70 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f3878a00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874145150 0x7f38741e6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f386b400640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38740cfa70 0x7f38741f4350 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c430 tx=0x7f385c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.032+0000 7f3870c00640 1 -- 172.21.15.144:0/90059873 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c011790 con 0x7f38740cfa70 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.033+0000 7f3870c00640 1 -- 172.21.15.144:0/90059873 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c017070 con 0x7f38740cfa70 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.033+0000 7f3870c00640 1 -- 172.21.15.144:0/90059873 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c011bb0 con 0x7f38740cfa70 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.033+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387415c0f0 con 0x7f38740cfa70 2024-05-30T16:48:00.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.033+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3874140c20 con 0x7f38740cfa70 2024-05-30T16:48:00.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.034+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3874068b90 con 0x7f38740cfa70 2024-05-30T16:48:00.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.035+0000 7f3870c00640 1 -- 172.21.15.144:0/90059873 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f385c01c460 con 0x7f38740cfa70 2024-05-30T16:48:00.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.036+0000 7f3870c00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d0d0 0x7f385006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.036+0000 7f3870c00640 1 -- 172.21.15.144:0/90059873 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5737+0+0 (secure 0 0 0) 0x7f385c08ccc0 con 0x7f38740cfa70 2024-05-30T16:48:00.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.036+0000 7f3873e00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d0d0 0x7f385006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:00.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.037+0000 7f3873e00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d0d0 0x7f385006f590 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3864034000 tx=0x7f386402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:00.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.040+0000 7f3870c00640 1 -- 172.21.15.144:0/90059873 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f385c05a140 con 0x7f38740cfa70 2024-05-30T16:48:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.240+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f387406cf20 con 0x7f38740cfa70 2024-05-30T16:48:00.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.243+0000 7f3870c00640 1 -- 172.21.15.144:0/90059873 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16757 (secure 0 0 0) 0x7f385c059a40 con 0x7f38740cfa70 2024-05-30T16:48:00.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:48:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":58,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:47:58.808628+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:47:56.670101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:47:57.798316+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:48:00.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d0d0 msgr2=0x7f385006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d0d0 0x7f385006f590 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3864034000 tx=0x7f386402e000 comp rx=0 tx=0).stop 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38740cfa70 msgr2=0x7f38741f4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38740cfa70 0x7f38741f4350 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c430 tx=0x7f385c00c8f0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 shutdown_connections 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d0d0 0x7f385006f590 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874145150 0x7f38741e6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38740cfa70 0x7f38741f4350 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 --2- 172.21.15.144:0/90059873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406f7e0 0x7f38741406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 >> 172.21.15.144:0/90059873 conn(0x7f387406bd00 msgr2=0x7f387406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 shutdown_connections 2024-05-30T16:48:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.245+0000 7f387aa00640 1 -- 172.21.15.144:0/90059873 wait complete. 2024-05-30T16:48:00.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:48:00.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.473+0000 7fad63200640 1 Processor -- start 2024-05-30T16:48:00.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.473+0000 7fad63200640 1 -- start start 2024-05-30T16:48:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.474+0000 7fad63200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad6406c5e0 0x7fad640cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad63200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad640d0040 con 0x7fad64162c90 2024-05-30T16:48:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad63200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad640ce640 con 0x7fad640cfc20 2024-05-30T16:48:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad63200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fad640ce920 con 0x7fad6406c5e0 2024-05-30T16:48:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad61400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad6406c5e0 0x7fad640cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad61e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fad64162c90 0x7fad640b3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33274/0 (socket says 172.21.15.144:33274) 2024-05-30T16:48:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad61400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad6406c5e0 0x7fad640cf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43086/0 (socket says 172.21.15.144:43086) 2024-05-30T16:48:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad61e00640 1 -- 172.21.15.144:0/2058710004 learned_addr learned my addr 172.21.15.144:0/2058710004 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:00.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad61400640 1 -- 172.21.15.144:0/2058710004 >> v1:172.21.15.149:6789/0 conn(0x7fad640cfc20 legacy=0x7fad6406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:00.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad61400640 1 -- 172.21.15.144:0/2058710004 >> v1:172.21.15.144:6789/0 conn(0x7fad64162c90 legacy=0x7fad640b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad61400640 1 -- 172.21.15.144:0/2058710004 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad640cec00 con 0x7fad6406c5e0 2024-05-30T16:48:00.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.475+0000 7fad60a00640 1 -- 172.21.15.144:0/2058710004 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533572562 0 0) 0x7fad54001110 con 0x7fad64162c90 2024-05-30T16:48:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.477+0000 7fad61400640 1 --2- 172.21.15.144:0/2058710004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 0x7fad640cf6e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fad500097a0 tx=0x7fad5002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b043b7bd9abfffc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.477+0000 7fad60a00640 1 -- 172.21.15.144:0/2058710004 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50037070 con 0x7fad6406c5e0 2024-05-30T16:48:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.477+0000 7fad60a00640 1 -- 172.21.15.144:0/2058710004 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5002ae50 con 0x7fad6406c5e0 2024-05-30T16:48:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.477+0000 7fad60a00640 1 -- 172.21.15.144:0/2058710004 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50032660 con 0x7fad6406c5e0 2024-05-30T16:48:00.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.478+0000 7fad63200640 1 -- 172.21.15.144:0/2058710004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 msgr2=0x7fad640cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.478+0000 7fad63200640 1 --2- 172.21.15.144:0/2058710004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 0x7fad640cf6e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fad500097a0 tx=0x7fad5002a140 comp rx=0 tx=0).stop 2024-05-30T16:48:00.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.478+0000 7fad63200640 1 -- 172.21.15.144:0/2058710004 shutdown_connections 2024-05-30T16:48:00.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.478+0000 7fad63200640 1 --2- 172.21.15.144:0/2058710004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 0x7fad640cf6e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.478+0000 7fad63200640 1 -- 172.21.15.144:0/2058710004 >> 172.21.15.144:0/2058710004 conn(0x7fad6406b8e0 msgr2=0x7fad6406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.478+0000 7fad63200640 1 -- 172.21.15.144:0/2058710004 shutdown_connections 2024-05-30T16:48:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.478+0000 7fad63200640 1 -- 172.21.15.144:0/2058710004 wait complete. 2024-05-30T16:48:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.479+0000 7fad63200640 1 Processor -- start 2024-05-30T16:48:00.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.480+0000 7fad63200640 1 -- start start 2024-05-30T16:48:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad63200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 0x7fad641632e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad63200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad640cfc20 0x7fad6414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad63200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad64162c90 0x7fad64165c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad63200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad640b3b70 con 0x7fad6406c5e0 2024-05-30T16:48:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad63200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fad640cf1c0 con 0x7fad640cfc20 2024-05-30T16:48:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad63200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fad64163070 con 0x7fad64162c90 2024-05-30T16:48:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 0x7fad641632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 0x7fad641632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43098/0 (socket says 172.21.15.144:43098) 2024-05-30T16:48:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad61e00640 1 -- 172.21.15.144:0/3316741926 learned_addr learned my addr 172.21.15.144:0/3316741926 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad61e00640 1 -- 172.21.15.144:0/3316741926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad64162c90 msgr2=0x7fad64165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad61e00640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad64162c90 0x7fad64165c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad61e00640 1 -- 172.21.15.144:0/3316741926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad640cfc20 msgr2=0x7fad6414d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad61e00640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad640cfc20 0x7fad6414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.481+0000 7fad61e00640 1 -- 172.21.15.144:0/3316741926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad64163930 con 0x7fad6406c5e0 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.482+0000 7fad61e00640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 0x7fad641632e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fad5400c780 tx=0x7fad5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.482+0000 7fad5a000640 1 -- 172.21.15.144:0/3316741926 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54018070 con 0x7fad6406c5e0 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.482+0000 7fad5a000640 1 -- 172.21.15.144:0/3316741926 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad540072d0 con 0x7fad6406c5e0 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.482+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad64163c10 con 0x7fad6406c5e0 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.482+0000 7fad5a000640 1 -- 172.21.15.144:0/3316741926 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad540047e0 con 0x7fad6406c5e0 2024-05-30T16:48:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.482+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad641641d0 con 0x7fad6406c5e0 2024-05-30T16:48:00.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.483+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad640632f0 con 0x7fad6406c5e0 2024-05-30T16:48:00.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.484+0000 7fad5a000640 1 -- 172.21.15.144:0/3316741926 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fad5401b070 con 0x7fad6406c5e0 2024-05-30T16:48:00.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.485+0000 7fad5a000640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad4406d0d0 0x7fad4406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:00.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.485+0000 7fad5a000640 1 -- 172.21.15.144:0/3316741926 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fad540898b0 con 0x7fad6406c5e0 2024-05-30T16:48:00.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.486+0000 7fad61400640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad4406d0d0 0x7fad4406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:00.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.486+0000 7fad61400640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad4406d0d0 0x7fad4406f590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fad50034000 tx=0x7fad5002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:00.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.490+0000 7fad5a000640 1 -- 172.21.15.144:0/3316741926 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad640d0040 con 0x7fad6406c5e0 2024-05-30T16:48:00.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:00.711+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fad64075570 con 0x7fad6406c5e0 2024-05-30T16:48:01.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.395+0000 7fad5a000640 1 -- 172.21.15.144:0/3316741926 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) ==== 118+0+0 (secure 0 0 0) 0x7fad540595d0 con 0x7fad6406c5e0 2024-05-30T16:48:01.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad4406d0d0 msgr2=0x7fad4406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad4406d0d0 0x7fad4406f590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fad50034000 tx=0x7fad5002c000 comp rx=0 tx=0).stop 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 msgr2=0x7fad641632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 0x7fad641632e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fad5400c780 tx=0x7fad5400cc40 comp rx=0 tx=0).stop 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 shutdown_connections 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad4406d0d0 0x7fad4406f590 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad64162c90 0x7fad64165c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad640cfc20 0x7fad6414d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 --2- 172.21.15.144:0/3316741926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6406c5e0 0x7fad641632e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 >> 172.21.15.144:0/3316741926 conn(0x7fad6406b8e0 msgr2=0x7fad64071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.398+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 shutdown_connections 2024-05-30T16:48:01.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.399+0000 7fad63200640 1 -- 172.21.15.144:0/3316741926 wait complete. 2024-05-30T16:48:01.423 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:48:01.423 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:48:01.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.624+0000 7fa216c00640 1 Processor -- start 2024-05-30T16:48:01.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.624+0000 7fa216c00640 1 -- start start 2024-05-30T16:48:01.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.626+0000 7fa216c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa2101418f0 0x7fa21015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:01.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.626+0000 7fa216c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa210144020 0x7fa21006e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:01.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.626+0000 7fa216c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2100b3fd0 con 0x7fa210141510 2024-05-30T16:48:01.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.626+0000 7fa216c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa21006dfc0 con 0x7fa210144020 2024-05-30T16:48:01.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.626+0000 7fa216c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa210144790 con 0x7fa2101418f0 2024-05-30T16:48:01.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.626+0000 7fa20fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa210141510 0x7fa2100b5440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33280/0 (socket says 172.21.15.144:33280) 2024-05-30T16:48:01.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.626+0000 7fa20fe00640 1 -- 172.21.15.144:0/3918205557 learned_addr learned my addr 172.21.15.144:0/3918205557 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:01.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.626+0000 7fa214c00640 1 --2- 172.21.15.144:0/3918205557 >> v2:172.21.15.144:3300/0 conn(0x7fa210144020 0x7fa21006e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:01.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.627+0000 7fa207400640 1 --2- 172.21.15.144:0/3918205557 >> v2:172.21.15.149:3300/0 conn(0x7fa2101418f0 0x7fa21015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:01.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.627+0000 7fa20f400640 1 -- 172.21.15.144:0/3918205557 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686727094 0 0) 0x7fa2100b3fd0 con 0x7fa210141510 2024-05-30T16:48:01.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.627+0000 7fa20f400640 1 -- 172.21.15.144:0/3918205557 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f4003520 con 0x7fa210141510 2024-05-30T16:48:01.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.627+0000 7fa214c00640 1 -- 172.21.15.144:0/3918205557 >> v2:172.21.15.149:3300/0 conn(0x7fa2101418f0 msgr2=0x7fa21015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:01.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.627+0000 7fa214c00640 1 --2- 172.21.15.144:0/3918205557 >> v2:172.21.15.149:3300/0 conn(0x7fa2101418f0 0x7fa21015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:01.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.627+0000 7fa214c00640 1 -- 172.21.15.144:0/3918205557 >> v1:172.21.15.144:6789/0 conn(0x7fa210141510 legacy=0x7fa2100b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:01.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.627+0000 7fa214c00640 1 -- 172.21.15.144:0/3918205557 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa210144a70 con 0x7fa210144020 2024-05-30T16:48:01.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.628+0000 7fa214c00640 1 --2- 172.21.15.144:0/3918205557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210144020 0x7fa21006e710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa2100b4f80 tx=0x7fa20802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb272dfd0609523 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:01.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.628+0000 7fa20f400640 1 -- 172.21.15.144:0/3918205557 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa208007740 con 0x7fa210144020 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.628+0000 7fa20f400640 1 -- 172.21.15.144:0/3918205557 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2080078e0 con 0x7fa210144020 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.628+0000 7fa20f400640 1 -- 172.21.15.144:0/3918205557 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa208007cb0 con 0x7fa210144020 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.629+0000 7fa216c00640 1 -- 172.21.15.144:0/3918205557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210144020 msgr2=0x7fa21006e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.629+0000 7fa216c00640 1 --2- 172.21.15.144:0/3918205557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210144020 0x7fa21006e710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa2100b4f80 tx=0x7fa20802a560 comp rx=0 tx=0).stop 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.629+0000 7fa216c00640 1 -- 172.21.15.144:0/3918205557 shutdown_connections 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.629+0000 7fa216c00640 1 --2- 172.21.15.144:0/3918205557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210144020 0x7fa21006e710 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.629+0000 7fa216c00640 1 --2- 172.21.15.144:0/3918205557 >> v2:172.21.15.149:3300/0 conn(0x7fa2101418f0 0x7fa21015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.629+0000 7fa216c00640 1 -- 172.21.15.144:0/3918205557 >> 172.21.15.144:0/3918205557 conn(0x7fa21006bd00 msgr2=0x7fa21006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.629+0000 7fa216c00640 1 -- 172.21.15.144:0/3918205557 shutdown_connections 2024-05-30T16:48:01.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.629+0000 7fa216c00640 1 -- 172.21.15.144:0/3918205557 wait complete. 2024-05-30T16:48:01.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.631+0000 7fa216c00640 1 Processor -- start 2024-05-30T16:48:01.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.631+0000 7fa216c00640 1 -- start start 2024-05-30T16:48:01.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.632+0000 7fa216c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210141510 0x7fa210155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:01.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.632+0000 7fa216c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2101418f0 0x7fa21013db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:01.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.632+0000 7fa216c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa210144020 0x7fa2101583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:01.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.632+0000 7fa216c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa210144490 con 0x7fa210141510 2024-05-30T16:48:01.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.632+0000 7fa216c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa21006e210 con 0x7fa210144020 2024-05-30T16:48:01.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.632+0000 7fa216c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa2100b5b50 con 0x7fa2101418f0 2024-05-30T16:48:01.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.632+0000 7fa20fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210141510 0x7fa210155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:01.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.632+0000 7fa20fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210141510 0x7fa210155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43122/0 (socket says 172.21.15.144:43122) 2024-05-30T16:48:01.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.632+0000 7fa20fe00640 1 -- 172.21.15.144:0/2745583737 learned_addr learned my addr 172.21.15.144:0/2745583737 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:01.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.633+0000 7fa214c00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa210144020 0x7fa2101583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:01.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.633+0000 7fa207400640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2101418f0 0x7fa21013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.633+0000 7fa20fe00640 1 -- 172.21.15.144:0/2745583737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2101418f0 msgr2=0x7fa21013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.633+0000 7fa20fe00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2101418f0 0x7fa21013db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.633+0000 7fa20fe00640 1 -- 172.21.15.144:0/2745583737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa210144020 msgr2=0x7fa2101583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.633+0000 7fa20fe00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa210144020 0x7fa2101583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.633+0000 7fa20fe00640 1 -- 172.21.15.144:0/2745583737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa210158d00 con 0x7fa210141510 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.633+0000 7fa20fe00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210141510 0x7fa210155ef0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c430 tx=0x7fa20000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.633+0000 7fa20cc00640 1 -- 172.21.15.144:0/2745583737 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200017070 con 0x7fa210141510 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.634+0000 7fa20cc00640 1 -- 172.21.15.144:0/2745583737 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa200005ce0 con 0x7fa210141510 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.634+0000 7fa20cc00640 1 -- 172.21.15.144:0/2745583737 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2000072f0 con 0x7fa210141510 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.634+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa210146680 con 0x7fa210141510 2024-05-30T16:48:01.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.634+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa210146c40 con 0x7fa210141510 2024-05-30T16:48:01.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.635+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa210068b90 con 0x7fa210141510 2024-05-30T16:48:01.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.636+0000 7fa20cc00640 1 -- 172.21.15.144:0/2745583737 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fa20001a070 con 0x7fa210141510 2024-05-30T16:48:01.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.638+0000 7fa20cc00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1ec06d0d0 0x7fa1ec06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:01.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.638+0000 7fa20cc00640 1 -- 172.21.15.144:0/2745583737 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fa200089a40 con 0x7fa210141510 2024-05-30T16:48:01.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.638+0000 7fa207400640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1ec06d0d0 0x7fa1ec06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:01.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.638+0000 7fa207400640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1ec06d0d0 0x7fa1ec06f590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa210140c20 tx=0x7fa1f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:01.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.642+0000 7fa20cc00640 1 -- 172.21.15.144:0/2745583737 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa200059760 con 0x7fa210141510 2024-05-30T16:48:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:01.884+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa210072a30 con 0x7fa210141510 2024-05-30T16:48:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.405+0000 7fa20cc00640 1 -- 172.21.15.144:0/2745583737 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7fa200059060 con 0x7fa210141510 2024-05-30T16:48:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1ec06d0d0 msgr2=0x7fa1ec06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1ec06d0d0 0x7fa1ec06f590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa210140c20 tx=0x7fa1f8008040 comp rx=0 tx=0).stop 2024-05-30T16:48:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210141510 msgr2=0x7fa210155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210141510 0x7fa210155ef0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c430 tx=0x7fa20000c8f0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 shutdown_connections 2024-05-30T16:48:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa1ec06d0d0 0x7fa1ec06f590 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa210144020 0x7fa2101583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2101418f0 0x7fa21013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 --2- 172.21.15.144:0/2745583737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa210141510 0x7fa210155ef0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 >> 172.21.15.144:0/2745583737 conn(0x7fa21006bd00 msgr2=0x7fa210141d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 shutdown_connections 2024-05-30T16:48:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.409+0000 7fa216c00640 1 -- 172.21.15.144:0/2745583737 wait complete. 2024-05-30T16:48:02.431 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:48:02.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:48:02.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.629+0000 7fd864e00640 1 Processor -- start 2024-05-30T16:48:02.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.629+0000 7fd864e00640 1 -- start start 2024-05-30T16:48:02.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.631+0000 7fd864e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8600cfc40 0x7fd86006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:02.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.631+0000 7fd864e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd86006f610 0x7fd8600b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:02.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.631+0000 7fd864e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8600d00f0 con 0x7fd860145150 2024-05-30T16:48:02.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.631+0000 7fd864e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd86015f140 con 0x7fd86006f610 2024-05-30T16:48:02.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.631+0000 7fd864e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd86015f390 con 0x7fd8600cfc40 2024-05-30T16:48:02.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.631+0000 7fd855400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8600cfc40 0x7fd86006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:02.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.632+0000 7fd85e800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd86006f610 0x7fd8600b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:02.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.632+0000 7fd85de00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd860145150 0x7fd8600cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:43682/0 (socket says 172.21.15.144:43682) 2024-05-30T16:48:02.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.632+0000 7fd85de00640 1 -- 172.21.15.144:0/1023979840 learned_addr learned my addr 172.21.15.144:0/1023979840 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.632+0000 7fd85e800640 1 -- 172.21.15.144:0/1023979840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8600cfc40 msgr2=0x7fd86006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.632+0000 7fd85e800640 1 --2- 172.21.15.144:0/1023979840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8600cfc40 0x7fd86006f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.632+0000 7fd85e800640 1 -- 172.21.15.144:0/1023979840 >> v1:172.21.15.149:6789/0 conn(0x7fd860145150 legacy=0x7fd8600cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.632+0000 7fd85e800640 1 -- 172.21.15.144:0/1023979840 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86015f670 con 0x7fd86006f610 2024-05-30T16:48:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.632+0000 7fd855400640 1 --2- 172.21.15.144:0/1023979840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8600cfc40 0x7fd86006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.634+0000 7fd85e800640 1 --2- 172.21.15.144:0/1023979840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd86006f610 0x7fd8600b4930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd858009d90 tx=0x7fd85802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b4652ba1ee3cc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:02.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.634+0000 7fd85d400640 1 -- 172.21.15.144:0/1023979840 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858031600 con 0x7fd86006f610 2024-05-30T16:48:02.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.634+0000 7fd85d400640 1 -- 172.21.15.144:0/1023979840 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8580317a0 con 0x7fd86006f610 2024-05-30T16:48:02.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.634+0000 7fd85d400640 1 -- 172.21.15.144:0/1023979840 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858031b70 con 0x7fd86006f610 2024-05-30T16:48:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.635+0000 7fd864e00640 1 -- 172.21.15.144:0/1023979840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd86006f610 msgr2=0x7fd8600b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.635+0000 7fd864e00640 1 --2- 172.21.15.144:0/1023979840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd86006f610 0x7fd8600b4930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd858009d90 tx=0x7fd85802a5d0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.635+0000 7fd864e00640 1 -- 172.21.15.144:0/1023979840 shutdown_connections 2024-05-30T16:48:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.635+0000 7fd864e00640 1 --2- 172.21.15.144:0/1023979840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd86006f610 0x7fd8600b4930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.635+0000 7fd864e00640 1 --2- 172.21.15.144:0/1023979840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8600cfc40 0x7fd86006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.635+0000 7fd864e00640 1 -- 172.21.15.144:0/1023979840 >> 172.21.15.144:0/1023979840 conn(0x7fd86006bd00 msgr2=0x7fd86006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.635+0000 7fd864e00640 1 -- 172.21.15.144:0/1023979840 shutdown_connections 2024-05-30T16:48:02.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.635+0000 7fd864e00640 1 -- 172.21.15.144:0/1023979840 wait complete. 2024-05-30T16:48:02.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.637+0000 7fd864e00640 1 Processor -- start 2024-05-30T16:48:02.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.637+0000 7fd864e00640 1 -- start start 2024-05-30T16:48:02.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd864e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd86006f610 0x7fd860131150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:02.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd864e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8600cfc40 0x7fd8600cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:02.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd864e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd860145150 0x7fd860138be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd864e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd86015fe70 con 0x7fd86006f610 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd864e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd8600b64f0 con 0x7fd8600cfc40 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd864e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd86015fff0 con 0x7fd860145150 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd85de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd86006f610 0x7fd860131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd85de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd86006f610 0x7fd860131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43124/0 (socket says 172.21.15.144:43124) 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd85de00640 1 -- 172.21.15.144:0/1364041499 learned_addr learned my addr 172.21.15.144:0/1364041499 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd855400640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8600cfc40 0x7fd8600cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd85de00640 1 -- 172.21.15.144:0/1364041499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd860145150 msgr2=0x7fd860138be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd85de00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd860145150 0x7fd860138be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd85de00640 1 -- 172.21.15.144:0/1364041499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8600cfc40 msgr2=0x7fd8600cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd85de00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8600cfc40 0x7fd8600cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.638+0000 7fd85de00640 1 -- 172.21.15.144:0/1364041499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd860131830 con 0x7fd86006f610 2024-05-30T16:48:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.639+0000 7fd85de00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd86006f610 0x7fd860131150 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd85000c4d0 tx=0x7fd85000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.639+0000 7fd856a00640 1 -- 172.21.15.144:0/1364041499 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850017070 con 0x7fd86006f610 2024-05-30T16:48:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.639+0000 7fd856a00640 1 -- 172.21.15.144:0/1364041499 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd850005ce0 con 0x7fd86006f610 2024-05-30T16:48:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.639+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86012f450 con 0x7fd86006f610 2024-05-30T16:48:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.639+0000 7fd856a00640 1 -- 172.21.15.144:0/1364041499 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850007270 con 0x7fd86006f610 2024-05-30T16:48:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.639+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd86012fa10 con 0x7fd86006f610 2024-05-30T16:48:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.640+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd860068b90 con 0x7fd86006f610 2024-05-30T16:48:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.641+0000 7fd856a00640 1 -- 172.21.15.144:0/1364041499 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fd85001a070 con 0x7fd86006f610 2024-05-30T16:48:02.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.642+0000 7fd856a00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd83c06d0d0 0x7fd83c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:02.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.642+0000 7fd856a00640 1 -- 172.21.15.144:0/1364041499 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fd85008c0f0 con 0x7fd86006f610 2024-05-30T16:48:02.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.642+0000 7fd855400640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd83c06d0d0 0x7fd83c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:02.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.643+0000 7fd855400640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd83c06d0d0 0x7fd83c06f590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd848009560 tx=0x7fd848008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:02.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.646+0000 7fd856a00640 1 -- 172.21.15.144:0/1364041499 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd850058e90 con 0x7fd86006f610 2024-05-30T16:48:02.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.880+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd86006f170 con 0x7fd86006f610 2024-05-30T16:48:02.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.882+0000 7fd856a00640 1 -- 172.21.15.144:0/1364041499 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5193 (secure 0 0 0) 0x7fd85005d190 con 0x7fd86006f610 2024-05-30T16:48:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:48:02.883 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/4221007288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4221007288},{"type":"v1","addr":"172.21.15.144:6837","nonce":4221007288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5155,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/2104436930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2104436930},{"type":"v1","addr":"172.21.15.149:6833","nonce":2104436930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2742911992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2742911992},{"type":"v1","addr":"172.21.15.149:6835","nonce":2742911992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:47:58.808544+0000","modified":"2024-05-30T16:48:01.886903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5808":{"gid":5808,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4146621541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4146621541},{"type":"v1","addr":"172.21.15.144:6835","nonce":4146621541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5808,"qdb_cluster":[5808]},"id":4}]} 2024-05-30T16:48:02.884 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 35 2024-05-30T16:48:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd83c06d0d0 msgr2=0x7fd83c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd83c06d0d0 0x7fd83c06f590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd848009560 tx=0x7fd848008040 comp rx=0 tx=0).stop 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd86006f610 msgr2=0x7fd860131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd86006f610 0x7fd860131150 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd85000c4d0 tx=0x7fd85000c990 comp rx=0 tx=0).stop 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 shutdown_connections 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd83c06d0d0 0x7fd83c06f590 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd860145150 0x7fd860138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8600cfc40 0x7fd8600cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 --2- 172.21.15.144:0/1364041499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd86006f610 0x7fd860131150 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 >> 172.21.15.144:0/1364041499 conn(0x7fd86006bd00 msgr2=0x7fd860138090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 shutdown_connections 2024-05-30T16:48:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:02.884+0000 7fd864e00640 1 -- 172.21.15.144:0/1364041499 wait complete. 2024-05-30T16:48:02.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:48:03.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.092+0000 7fdefb800640 1 Processor -- start 2024-05-30T16:48:03.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.092+0000 7fdefb800640 1 -- start start 2024-05-30T16:48:03.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.093+0000 7fdefb800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdef40cec70 0x7fdef40b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.093+0000 7fdefb800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef4160730 con 0x7fdef40b5e00 2024-05-30T16:48:03.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.094+0000 7fdefb800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef4160a10 con 0x7fdef413f760 2024-05-30T16:48:03.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.094+0000 7fdefb800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdef41612b0 con 0x7fdef40cec70 2024-05-30T16:48:03.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.094+0000 7fdef3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdef40cec70 0x7fdef40b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:03.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.094+0000 7fdef3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdef40cec70 0x7fdef40b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43138/0 (socket says 172.21.15.144:43138) 2024-05-30T16:48:03.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.094+0000 7fdef3e00640 1 -- 172.21.15.144:0/500174126 learned_addr learned my addr 172.21.15.144:0/500174126 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:03.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.094+0000 7fdef9800640 1 --1- 172.21.15.144:0/500174126 >> v1:172.21.15.144:6789/0 conn(0x7fdef40b5e00 0x7fdef4142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33284/0 (socket says 172.21.15.144:33284) 2024-05-30T16:48:03.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.094+0000 7fdef3e00640 1 -- 172.21.15.144:0/500174126 >> v1:172.21.15.149:6789/0 conn(0x7fdef413f760 legacy=0x7fdef406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:03.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.094+0000 7fdef3e00640 1 -- 172.21.15.144:0/500174126 >> v1:172.21.15.144:6789/0 conn(0x7fdef40b5e00 legacy=0x7fdef4142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.094+0000 7fdef3e00640 1 -- 172.21.15.144:0/500174126 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef4160cf0 con 0x7fdef40cec70 2024-05-30T16:48:03.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.095+0000 7fdef3e00640 1 --2- 172.21.15.144:0/500174126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 0x7fdef40b58c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009870 tx=0x7fdee002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acf6a69036a3328 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:03.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdef3400640 1 -- 172.21.15.144:0/500174126 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0037070 con 0x7fdef40cec70 2024-05-30T16:48:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdef3400640 1 -- 172.21.15.144:0/500174126 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee0032640 con 0x7fdef40cec70 2024-05-30T16:48:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdef3400640 1 -- 172.21.15.144:0/500174126 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0032a10 con 0x7fdef40cec70 2024-05-30T16:48:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdefb800640 1 -- 172.21.15.144:0/500174126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 msgr2=0x7fdef40b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdefb800640 1 --2- 172.21.15.144:0/500174126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 0x7fdef40b58c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009870 tx=0x7fdee002a330 comp rx=0 tx=0).stop 2024-05-30T16:48:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdefb800640 1 -- 172.21.15.144:0/500174126 shutdown_connections 2024-05-30T16:48:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdefb800640 1 --2- 172.21.15.144:0/500174126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 0x7fdef40b58c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdefb800640 1 -- 172.21.15.144:0/500174126 >> 172.21.15.144:0/500174126 conn(0x7fdef406bd00 msgr2=0x7fdef406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdefb800640 1 -- 172.21.15.144:0/500174126 shutdown_connections 2024-05-30T16:48:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.096+0000 7fdefb800640 1 -- 172.21.15.144:0/500174126 wait complete. 2024-05-30T16:48:03.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.098+0000 7fdefb800640 1 Processor -- start 2024-05-30T16:48:03.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.098+0000 7fdefb800640 1 -- start start 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.099+0000 7fdefb800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdef40b5e00 0x7fdef41f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.099+0000 7fdefb800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 0x7fdef413ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.099+0000 7fdefb800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdef413f760 0x7fdef41f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.099+0000 7fdefb800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdef40cf0d0 con 0x7fdef40cec70 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.099+0000 7fdefb800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdef40cf250 con 0x7fdef40b5e00 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.099+0000 7fdefb800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdef40ce6a0 con 0x7fdef413f760 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.099+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 0x7fdef413ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.099+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 0x7fdef413ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43152/0 (socket says 172.21.15.144:43152) 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.099+0000 7fdef3e00640 1 -- 172.21.15.144:0/2878942123 learned_addr learned my addr 172.21.15.144:0/2878942123 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdef3e00640 1 -- 172.21.15.144:0/2878942123 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdef413f760 msgr2=0x7fdef41f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdef3e00640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdef413f760 0x7fdef41f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdef3e00640 1 -- 172.21.15.144:0/2878942123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdef40b5e00 msgr2=0x7fdef41f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdef3e00640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdef40b5e00 0x7fdef41f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdef3e00640 1 -- 172.21.15.144:0/2878942123 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef413b0a0 con 0x7fdef40cec70 2024-05-30T16:48:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdef3e00640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 0x7fdef413ab60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fdee0000c00 tx=0x7fdee00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdef0c00640 1 -- 172.21.15.144:0/2878942123 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0037040 con 0x7fdef40cec70 2024-05-30T16:48:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdef0c00640 1 -- 172.21.15.144:0/2878942123 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee0042070 con 0x7fdef40cec70 2024-05-30T16:48:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdef0c00640 1 -- 172.21.15.144:0/2878942123 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0030bd0 con 0x7fdef40cec70 2024-05-30T16:48:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef41f83d0 con 0x7fdef40cec70 2024-05-30T16:48:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.100+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef41f8990 con 0x7fdef40cec70 2024-05-30T16:48:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.102+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef4068b90 con 0x7fdef40cec70 2024-05-30T16:48:03.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.103+0000 7fdef0c00640 1 -- 172.21.15.144:0/2878942123 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fdee0032500 con 0x7fdef40cec70 2024-05-30T16:48:03.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.103+0000 7fdef0c00640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fded406d0d0 0x7fded406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.104+0000 7fdef0c00640 1 -- 172.21.15.144:0/2878942123 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fdee00ad650 con 0x7fdef40cec70 2024-05-30T16:48:03.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.104+0000 7fdef8e00640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fded406d0d0 0x7fded406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:03.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.105+0000 7fdef8e00640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fded406d0d0 0x7fded406f590 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdee8006fd0 tx=0x7fdee8006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.108+0000 7fdef0c00640 1 -- 172.21.15.144:0/2878942123 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdee007ad50 con 0x7fdef40cec70 2024-05-30T16:48:03.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.308+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdef413b390 con 0x7fdef40cec70 2024-05-30T16:48:03.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.310+0000 7fdef0c00640 1 -- 172.21.15.144:0/2878942123 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16744 (secure 0 0 0) 0x7fdee007a650 con 0x7fdef40cec70 2024-05-30T16:48:03.311 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:48:03.312 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":59,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:48:00.381191+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:47:56.670101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:47:57.798316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:48:03.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.312+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fded406d0d0 msgr2=0x7fded406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.312+0000 7fdefb800640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fded406d0d0 0x7fded406f590 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdee8006fd0 tx=0x7fdee8006bc0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.312+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 msgr2=0x7fdef413ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.312+0000 7fdefb800640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 0x7fdef413ab60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fdee0000c00 tx=0x7fdee00046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.313+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 shutdown_connections 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.313+0000 7fdefb800640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fded406d0d0 0x7fded406f590 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.313+0000 7fdefb800640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdef413f760 0x7fdef41f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.313+0000 7fdefb800640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40cec70 0x7fdef413ab60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.313+0000 7fdefb800640 1 --2- 172.21.15.144:0/2878942123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdef40b5e00 0x7fdef41f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.313+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 >> 172.21.15.144:0/2878942123 conn(0x7fdef406bd00 msgr2=0x7fdef406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.313+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 shutdown_connections 2024-05-30T16:48:03.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.313+0000 7fdefb800640 1 -- 172.21.15.144:0/2878942123 wait complete. 2024-05-30T16:48:03.332 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:48:03.332 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:48:03.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.524+0000 7fd92b000640 1 Processor -- start 2024-05-30T16:48:03.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.524+0000 7fd92b000640 1 -- start start 2024-05-30T16:48:03.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.525+0000 7fd92b000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd924145150 0x7fd9240cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.525+0000 7fd92b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9240cfa70 0x7fd92406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd92b000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9240d00f0 con 0x7fd92406f610 2024-05-30T16:48:03.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd92b000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd9240cfeb0 con 0x7fd924145150 2024-05-30T16:48:03.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd92b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd92415f140 con 0x7fd9240cfa70 2024-05-30T16:48:03.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd923e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd924145150 0x7fd9240cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:03.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd929000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd92406f610 0x7fd924072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33290/0 (socket says 172.21.15.144:33290) 2024-05-30T16:48:03.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd929000640 1 -- 172.21.15.144:0/2386237944 learned_addr learned my addr 172.21.15.144:0/2386237944 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:03.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd91b400640 1 --2- 172.21.15.144:0/2386237944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9240cfa70 0x7fd92406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd923e00640 1 -- 172.21.15.144:0/2386237944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9240cfa70 msgr2=0x7fd92406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd923e00640 1 --2- 172.21.15.144:0/2386237944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9240cfa70 0x7fd92406f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd923e00640 1 -- 172.21.15.144:0/2386237944 >> v1:172.21.15.144:6789/0 conn(0x7fd92406f610 legacy=0x7fd924072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.526+0000 7fd923e00640 1 -- 172.21.15.144:0/2386237944 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92415f390 con 0x7fd924145150 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.527+0000 7fd923e00640 1 --2- 172.21.15.144:0/2386237944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd924145150 0x7fd9240cf530 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd9140097a0 tx=0x7fd91402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca03393a0b6c585 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd923400640 1 -- 172.21.15.144:0/2386237944 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914037070 con 0x7fd924145150 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd923400640 1 -- 172.21.15.144:0/2386237944 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91402ae50 con 0x7fd924145150 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd923400640 1 -- 172.21.15.144:0/2386237944 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914032660 con 0x7fd924145150 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd92b000640 1 -- 172.21.15.144:0/2386237944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd924145150 msgr2=0x7fd9240cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd92b000640 1 --2- 172.21.15.144:0/2386237944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd924145150 0x7fd9240cf530 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd9140097a0 tx=0x7fd91402a100 comp rx=0 tx=0).stop 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd92b000640 1 -- 172.21.15.144:0/2386237944 shutdown_connections 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd92b000640 1 --2- 172.21.15.144:0/2386237944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9240cfa70 0x7fd92406f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd92b000640 1 --2- 172.21.15.144:0/2386237944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd924145150 0x7fd9240cf530 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd92b000640 1 -- 172.21.15.144:0/2386237944 >> 172.21.15.144:0/2386237944 conn(0x7fd92406bd00 msgr2=0x7fd92406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:03.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd92b000640 1 -- 172.21.15.144:0/2386237944 shutdown_connections 2024-05-30T16:48:03.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.528+0000 7fd92b000640 1 -- 172.21.15.144:0/2386237944 wait complete. 2024-05-30T16:48:03.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.531+0000 7fd92b000640 1 Processor -- start 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.531+0000 7fd92b000640 1 -- start start 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.532+0000 7fd92b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd92406f610 0x7fd92415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.532+0000 7fd92b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9240cfa70 0x7fd9241f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.532+0000 7fd92b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd924145150 0x7fd924143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.532+0000 7fd92b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9240b64f0 con 0x7fd92406f610 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.532+0000 7fd92b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd92415f950 con 0x7fd9240cfa70 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.532+0000 7fd92b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd92415fe70 con 0x7fd924145150 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.532+0000 7fd923e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd92406f610 0x7fd92415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.532+0000 7fd923e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd92406f610 0x7fd92415e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43166/0 (socket says 172.21.15.144:43166) 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.532+0000 7fd923e00640 1 -- 172.21.15.144:0/4292654481 learned_addr learned my addr 172.21.15.144:0/4292654481 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd923e00640 1 -- 172.21.15.144:0/4292654481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd924145150 msgr2=0x7fd924143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd923e00640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd924145150 0x7fd924143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd923e00640 1 -- 172.21.15.144:0/4292654481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9240cfa70 msgr2=0x7fd9241f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd923e00640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9240cfa70 0x7fd9241f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd923e00640 1 -- 172.21.15.144:0/4292654481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92415ee30 con 0x7fd92406f610 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd923e00640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd92406f610 0x7fd92415e690 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd9140097a0 tx=0x7fd9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd920c00640 1 -- 172.21.15.144:0/4292654481 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914042070 con 0x7fd92406f610 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd920c00640 1 -- 172.21.15.144:0/4292654481 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91403e670 con 0x7fd92406f610 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd920c00640 1 -- 172.21.15.144:0/4292654481 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914037040 con 0x7fd92406f610 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9241e4f70 con 0x7fd92406f610 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.533+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9241e5530 con 0x7fd92406f610 2024-05-30T16:48:03.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.535+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd924068b90 con 0x7fd92406f610 2024-05-30T16:48:03.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.536+0000 7fd920c00640 1 -- 172.21.15.144:0/4292654481 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fd914045070 con 0x7fd92406f610 2024-05-30T16:48:03.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.537+0000 7fd920c00640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd90006d0d0 0x7fd90006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:03.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.537+0000 7fd920c00640 1 -- 172.21.15.144:0/4292654481 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fd9140aae30 con 0x7fd92406f610 2024-05-30T16:48:03.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.537+0000 7fd91b400640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd90006d0d0 0x7fd90006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:03.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.538+0000 7fd91b400640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd90006d0d0 0x7fd90006f590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd90c006fd0 tx=0x7fd90c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:03.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.541+0000 7fd920c00640 1 -- 172.21.15.144:0/4292654481 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd91407ac70 con 0x7fd92406f610 2024-05-30T16:48:03.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.723+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9241f27e0 con 0x7fd90006d0d0 2024-05-30T16:48:03.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.734+0000 7fd920c00640 1 -- 172.21.15.144:0/4292654481 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251928 (secure 0 0 0) 0x7fd90c00ae20 con 0x7fd90006d0d0 2024-05-30T16:48:03.740 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:48:03.742 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:48:03.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd90006d0d0 msgr2=0x7fd90006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd90006d0d0 0x7fd90006f590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd90c006fd0 tx=0x7fd90c008040 comp rx=0 tx=0).stop 2024-05-30T16:48:03.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd92406f610 msgr2=0x7fd92415e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:03.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd92406f610 0x7fd92415e690 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd9140097a0 tx=0x7fd9140046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 shutdown_connections 2024-05-30T16:48:03.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd90006d0d0 0x7fd90006f590 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd924145150 0x7fd924143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9240cfa70 0x7fd9241f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 --2- 172.21.15.144:0/4292654481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd92406f610 0x7fd92415e690 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:03.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 >> 172.21.15.144:0/4292654481 conn(0x7fd92406bd00 msgr2=0x7fd9240b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:03.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 shutdown_connections 2024-05-30T16:48:03.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.739+0000 7fd92b000640 1 -- 172.21.15.144:0/4292654481 wait complete. 2024-05-30T16:48:03.759 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-05-30T16:48:03.044613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":360308,"kb_used_data":6700,"kb_used_omap":12,"kb_used_meta":353459,"kb_avail":754614412,"statfs":{"total":773094113280,"available":772725157888,"internally_reserved":0,"allocated":6860800,"data_stored":3533388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":361942579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710868"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.408008+0000","last_change":"2024-05-30T16:47:59.403797+0000","last_active":"2024-05-30T16:47:59.408008+0000","last_peered":"2024-05-30T16:47:59.408008+0000","last_clean":"2024-05-30T16:47:59.408008+0000","last_became_active":"2024-05-30T16:47:59.403415+0000","last_became_peered":"2024-05-30T16:47:59.403415+0000","last_unstale":"2024-05-30T16:47:59.408008+0000","last_undegraded":"2024-05-30T16:47:59.408008+0000","last_fullsized":"2024-05-30T16:47:59.408008+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:44:30.684645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.399585+0000","last_change":"2024-05-30T16:47:59.398661+0000","last_active":"2024-05-30T16:47:59.399585+0000","last_peered":"2024-05-30T16:47:59.399585+0000","last_clean":"2024-05-30T16:47:59.399585+0000","last_became_active":"2024-05-30T16:47:59.398253+0000","last_became_peered":"2024-05-30T16:47:59.398253+0000","last_unstale":"2024-05-30T16:47:59.399585+0000","last_undegraded":"2024-05-30T16:47:59.399585+0000","last_fullsized":"2024-05-30T16:47:59.399585+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:44.227925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403471+0000","last_change":"2024-05-30T16:47:59.383945+0000","last_active":"2024-05-30T16:48:00.403471+0000","last_peered":"2024-05-30T16:48:00.403471+0000","last_clean":"2024-05-30T16:48:00.403471+0000","last_became_active":"2024-05-30T16:47:59.383563+0000","last_became_peered":"2024-05-30T16:47:59.383563+0000","last_unstale":"2024-05-30T16:48:00.403471+0000","last_undegraded":"2024-05-30T16:48:00.403471+0000","last_fullsized":"2024-05-30T16:48:00.403471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:32.401290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973766+0000","last_change":"2024-05-30T16:47:59.394271+0000","last_active":"2024-05-30T16:48:00.973766+0000","last_peered":"2024-05-30T16:48:00.973766+0000","last_clean":"2024-05-30T16:48:00.973766+0000","last_became_active":"2024-05-30T16:47:59.393517+0000","last_became_peered":"2024-05-30T16:47:59.393517+0000","last_unstale":"2024-05-30T16:48:00.973766+0000","last_undegraded":"2024-05-30T16:48:00.973766+0000","last_fullsized":"2024-05-30T16:48:00.973766+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:51:15.317500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.405194+0000","last_change":"2024-05-30T16:47:59.400381+0000","last_active":"2024-05-30T16:47:59.405194+0000","last_peered":"2024-05-30T16:47:59.405194+0000","last_clean":"2024-05-30T16:47:59.405194+0000","last_became_active":"2024-05-30T16:47:59.395986+0000","last_became_peered":"2024-05-30T16:47:59.395986+0000","last_unstale":"2024-05-30T16:47:59.405194+0000","last_undegraded":"2024-05-30T16:47:59.405194+0000","last_fullsized":"2024-05-30T16:47:59.405194+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:49.177393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403165+0000","last_change":"2024-05-30T16:47:59.384437+0000","last_active":"2024-05-30T16:48:00.403165+0000","last_peered":"2024-05-30T16:48:00.403165+0000","last_clean":"2024-05-30T16:48:00.403165+0000","last_became_active":"2024-05-30T16:47:59.384039+0000","last_became_peered":"2024-05-30T16:47:59.384039+0000","last_unstale":"2024-05-30T16:48:00.403165+0000","last_undegraded":"2024-05-30T16:48:00.403165+0000","last_fullsized":"2024-05-30T16:48:00.403165+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:44.696058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399051+0000","last_change":"2024-05-30T16:47:59.394822+0000","last_active":"2024-05-30T16:48:00.399051+0000","last_peered":"2024-05-30T16:48:00.399051+0000","last_clean":"2024-05-30T16:48:00.399051+0000","last_became_active":"2024-05-30T16:47:59.394110+0000","last_became_peered":"2024-05-30T16:47:59.394110+0000","last_unstale":"2024-05-30T16:48:00.399051+0000","last_undegraded":"2024-05-30T16:48:00.399051+0000","last_fullsized":"2024-05-30T16:48:00.399051+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:34.547846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.399589+0000","last_change":"2024-05-30T16:47:59.391694+0000","last_active":"2024-05-30T16:47:59.399589+0000","last_peered":"2024-05-30T16:47:59.399589+0000","last_clean":"2024-05-30T16:47:59.399589+0000","last_became_active":"2024-05-30T16:47:59.391026+0000","last_became_peered":"2024-05-30T16:47:59.391026+0000","last_unstale":"2024-05-30T16:47:59.399589+0000","last_undegraded":"2024-05-30T16:47:59.399589+0000","last_fullsized":"2024-05-30T16:47:59.399589+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:38:38.804657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399356+0000","last_change":"2024-05-30T16:47:59.387202+0000","last_active":"2024-05-30T16:48:00.399356+0000","last_peered":"2024-05-30T16:48:00.399356+0000","last_clean":"2024-05-30T16:48:00.399356+0000","last_became_active":"2024-05-30T16:47:59.386863+0000","last_became_peered":"2024-05-30T16:47:59.386863+0000","last_unstale":"2024-05-30T16:48:00.399356+0000","last_undegraded":"2024-05-30T16:48:00.399356+0000","last_fullsized":"2024-05-30T16:48:00.399356+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:21:21.749576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.402047+0000","last_change":"2024-05-30T16:47:59.390787+0000","last_active":"2024-05-30T16:47:59.402047+0000","last_peered":"2024-05-30T16:47:59.402047+0000","last_clean":"2024-05-30T16:47:59.402047+0000","last_became_active":"2024-05-30T16:47:59.390495+0000","last_became_peered":"2024-05-30T16:47:59.390495+0000","last_unstale":"2024-05-30T16:47:59.402047+0000","last_undegraded":"2024-05-30T16:47:59.402047+0000","last_fullsized":"2024-05-30T16:47:59.402047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:20:20.159418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.407407+0000","last_change":"2024-05-30T16:47:59.402732+0000","last_active":"2024-05-30T16:47:59.407407+0000","last_peered":"2024-05-30T16:47:59.407407+0000","last_clean":"2024-05-30T16:47:59.407407+0000","last_became_active":"2024-05-30T16:47:59.402363+0000","last_became_peered":"2024-05-30T16:47:59.402363+0000","last_unstale":"2024-05-30T16:47:59.407407+0000","last_undegraded":"2024-05-30T16:47:59.407407+0000","last_fullsized":"2024-05-30T16:47:59.407407+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:25:36.475680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974104+0000","last_change":"2024-05-30T16:47:59.395027+0000","last_active":"2024-05-30T16:48:00.974104+0000","last_peered":"2024-05-30T16:48:00.974104+0000","last_clean":"2024-05-30T16:48:00.974104+0000","last_became_active":"2024-05-30T16:47:59.394740+0000","last_became_peered":"2024-05-30T16:47:59.394740+0000","last_unstale":"2024-05-30T16:48:00.974104+0000","last_undegraded":"2024-05-30T16:48:00.974104+0000","last_fullsized":"2024-05-30T16:48:00.974104+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:05:18.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403041+0000","last_change":"2024-05-30T16:47:59.398075+0000","last_active":"2024-05-30T16:48:00.403041+0000","last_peered":"2024-05-30T16:48:00.403041+0000","last_clean":"2024-05-30T16:48:00.403041+0000","last_became_active":"2024-05-30T16:47:59.397770+0000","last_became_peered":"2024-05-30T16:47:59.397770+0000","last_unstale":"2024-05-30T16:48:00.403041+0000","last_undegraded":"2024-05-30T16:48:00.403041+0000","last_fullsized":"2024-05-30T16:48:00.403041+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:13.639125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400408+0000","last_change":"2024-05-30T16:47:59.383394+0000","last_active":"2024-05-30T16:48:00.400408+0000","last_peered":"2024-05-30T16:48:00.400408+0000","last_clean":"2024-05-30T16:48:00.400408+0000","last_became_active":"2024-05-30T16:47:59.382886+0000","last_became_peered":"2024-05-30T16:47:59.382886+0000","last_unstale":"2024-05-30T16:48:00.400408+0000","last_undegraded":"2024-05-30T16:48:00.400408+0000","last_fullsized":"2024-05-30T16:48:00.400408+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:42:16.783829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399472+0000","last_change":"2024-05-30T16:47:59.391866+0000","last_active":"2024-05-30T16:48:00.399472+0000","last_peered":"2024-05-30T16:48:00.399472+0000","last_clean":"2024-05-30T16:48:00.399472+0000","last_became_active":"2024-05-30T16:47:59.391555+0000","last_became_peered":"2024-05-30T16:47:59.391555+0000","last_unstale":"2024-05-30T16:48:00.399472+0000","last_undegraded":"2024-05-30T16:48:00.399472+0000","last_fullsized":"2024-05-30T16:48:00.399472+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:57:27.388588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403321+0000","last_change":"2024-05-30T16:47:59.387891+0000","last_active":"2024-05-30T16:48:00.403321+0000","last_peered":"2024-05-30T16:48:00.403321+0000","last_clean":"2024-05-30T16:48:00.403321+0000","last_became_active":"2024-05-30T16:47:59.387612+0000","last_became_peered":"2024-05-30T16:47:59.387612+0000","last_unstale":"2024-05-30T16:48:00.403321+0000","last_undegraded":"2024-05-30T16:48:00.403321+0000","last_fullsized":"2024-05-30T16:48:00.403321+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:51:15.317500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.407784+0000","last_change":"2024-05-30T16:47:59.401312+0000","last_active":"2024-05-30T16:47:59.407784+0000","last_peered":"2024-05-30T16:47:59.407784+0000","last_clean":"2024-05-30T16:47:59.407784+0000","last_became_active":"2024-05-30T16:47:59.400988+0000","last_became_peered":"2024-05-30T16:47:59.400988+0000","last_unstale":"2024-05-30T16:47:59.407784+0000","last_undegraded":"2024-05-30T16:47:59.407784+0000","last_fullsized":"2024-05-30T16:47:59.407784+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:13.948859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402781+0000","last_change":"2024-05-30T16:47:59.387878+0000","last_active":"2024-05-30T16:48:00.402781+0000","last_peered":"2024-05-30T16:48:00.402781+0000","last_clean":"2024-05-30T16:48:00.402781+0000","last_became_active":"2024-05-30T16:47:59.387625+0000","last_became_peered":"2024-05-30T16:47:59.387625+0000","last_unstale":"2024-05-30T16:48:00.402781+0000","last_undegraded":"2024-05-30T16:48:00.402781+0000","last_fullsized":"2024-05-30T16:48:00.402781+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:42:37.732411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.410573+0000","last_change":"2024-05-30T16:47:59.404031+0000","last_active":"2024-05-30T16:47:59.410573+0000","last_peered":"2024-05-30T16:47:59.410573+0000","last_clean":"2024-05-30T16:47:59.410573+0000","last_became_active":"2024-05-30T16:47:59.403439+0000","last_became_peered":"2024-05-30T16:47:59.403439+0000","last_unstale":"2024-05-30T16:47:59.410573+0000","last_undegraded":"2024-05-30T16:47:59.410573+0000","last_fullsized":"2024-05-30T16:47:59.410573+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:05:03.420497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.412035+0000","last_change":"2024-05-30T16:47:59.405683+0000","last_active":"2024-05-30T16:47:59.412035+0000","last_peered":"2024-05-30T16:47:59.412035+0000","last_clean":"2024-05-30T16:47:59.412035+0000","last_became_active":"2024-05-30T16:47:59.405265+0000","last_became_peered":"2024-05-30T16:47:59.405265+0000","last_unstale":"2024-05-30T16:47:59.412035+0000","last_undegraded":"2024-05-30T16:47:59.412035+0000","last_fullsized":"2024-05-30T16:47:59.412035+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:54.636109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403937+0000","last_change":"2024-05-30T16:47:59.396706+0000","last_active":"2024-05-30T16:48:00.403937+0000","last_peered":"2024-05-30T16:48:00.403937+0000","last_clean":"2024-05-30T16:48:00.403937+0000","last_became_active":"2024-05-30T16:47:59.396310+0000","last_became_peered":"2024-05-30T16:47:59.396310+0000","last_unstale":"2024-05-30T16:48:00.403937+0000","last_undegraded":"2024-05-30T16:48:00.403937+0000","last_fullsized":"2024-05-30T16:48:00.403937+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:55:25.030553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.399970+0000","last_change":"2024-05-30T16:47:59.389671+0000","last_active":"2024-05-30T16:47:59.399970+0000","last_peered":"2024-05-30T16:47:59.399970+0000","last_clean":"2024-05-30T16:47:59.399970+0000","last_became_active":"2024-05-30T16:47:59.389351+0000","last_became_peered":"2024-05-30T16:47:59.389351+0000","last_unstale":"2024-05-30T16:47:59.399970+0000","last_undegraded":"2024-05-30T16:47:59.399970+0000","last_fullsized":"2024-05-30T16:47:59.399970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:12:16.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402610+0000","last_change":"2024-05-30T16:47:59.402306+0000","last_active":"2024-05-30T16:48:00.402610+0000","last_peered":"2024-05-30T16:48:00.402610+0000","last_clean":"2024-05-30T16:48:00.402610+0000","last_became_active":"2024-05-30T16:47:59.402122+0000","last_became_peered":"2024-05-30T16:47:59.402122+0000","last_unstale":"2024-05-30T16:48:00.402610+0000","last_undegraded":"2024-05-30T16:48:00.402610+0000","last_fullsized":"2024-05-30T16:48:00.402610+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:44.227925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.401627+0000","last_change":"2024-05-30T16:47:59.391686+0000","last_active":"2024-05-30T16:48:00.401627+0000","last_peered":"2024-05-30T16:48:00.401627+0000","last_clean":"2024-05-30T16:48:00.401627+0000","last_became_active":"2024-05-30T16:47:59.391093+0000","last_became_peered":"2024-05-30T16:47:59.391093+0000","last_unstale":"2024-05-30T16:48:00.401627+0000","last_undegraded":"2024-05-30T16:48:00.401627+0000","last_fullsized":"2024-05-30T16:48:00.401627+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:42:38.071803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.401145+0000","last_change":"2024-05-30T16:47:59.396140+0000","last_active":"2024-05-30T16:47:59.401145+0000","last_peered":"2024-05-30T16:47:59.401145+0000","last_clean":"2024-05-30T16:47:59.401145+0000","last_became_active":"2024-05-30T16:47:59.395237+0000","last_became_peered":"2024-05-30T16:47:59.395237+0000","last_unstale":"2024-05-30T16:47:59.401145+0000","last_undegraded":"2024-05-30T16:47:59.401145+0000","last_fullsized":"2024-05-30T16:47:59.401145+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:46:02.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974468+0000","last_change":"2024-05-30T16:47:59.391916+0000","last_active":"2024-05-30T16:48:00.974468+0000","last_peered":"2024-05-30T16:48:00.974468+0000","last_clean":"2024-05-30T16:48:00.974468+0000","last_became_active":"2024-05-30T16:47:59.391396+0000","last_became_peered":"2024-05-30T16:47:59.391396+0000","last_unstale":"2024-05-30T16:48:00.974468+0000","last_undegraded":"2024-05-30T16:48:00.974468+0000","last_fullsized":"2024-05-30T16:48:00.974468+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:17:36.818656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403533+0000","last_change":"2024-05-30T16:47:59.387871+0000","last_active":"2024-05-30T16:48:00.403533+0000","last_peered":"2024-05-30T16:48:00.403533+0000","last_clean":"2024-05-30T16:48:00.403533+0000","last_became_active":"2024-05-30T16:47:59.387574+0000","last_became_peered":"2024-05-30T16:47:59.387574+0000","last_unstale":"2024-05-30T16:48:00.403533+0000","last_undegraded":"2024-05-30T16:48:00.403533+0000","last_fullsized":"2024-05-30T16:48:00.403533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:05:18.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.405147+0000","last_change":"2024-05-30T16:47:59.399956+0000","last_active":"2024-05-30T16:47:59.405147+0000","last_peered":"2024-05-30T16:47:59.405147+0000","last_clean":"2024-05-30T16:47:59.405147+0000","last_became_active":"2024-05-30T16:47:59.397525+0000","last_became_peered":"2024-05-30T16:47:59.397525+0000","last_unstale":"2024-05-30T16:47:59.405147+0000","last_undegraded":"2024-05-30T16:47:59.405147+0000","last_fullsized":"2024-05-30T16:47:59.405147+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:29:34.053930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.407721+0000","last_change":"2024-05-30T16:47:59.400699+0000","last_active":"2024-05-30T16:47:59.407721+0000","last_peered":"2024-05-30T16:47:59.407721+0000","last_clean":"2024-05-30T16:47:59.407721+0000","last_became_active":"2024-05-30T16:47:59.399642+0000","last_became_peered":"2024-05-30T16:47:59.399642+0000","last_unstale":"2024-05-30T16:47:59.407721+0000","last_undegraded":"2024-05-30T16:47:59.407721+0000","last_fullsized":"2024-05-30T16:47:59.407721+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:11:17.857778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403770+0000","last_change":"2024-05-30T16:47:59.384790+0000","last_active":"2024-05-30T16:48:00.403770+0000","last_peered":"2024-05-30T16:48:00.403770+0000","last_clean":"2024-05-30T16:48:00.403770+0000","last_became_active":"2024-05-30T16:47:59.384414+0000","last_became_peered":"2024-05-30T16:47:59.384414+0000","last_unstale":"2024-05-30T16:48:00.403770+0000","last_undegraded":"2024-05-30T16:48:00.403770+0000","last_fullsized":"2024-05-30T16:48:00.403770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:44:47.381594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.393606+0000","last_change":"2024-05-30T16:47:59.389203+0000","last_active":"2024-05-30T16:47:59.393606+0000","last_peered":"2024-05-30T16:47:59.393606+0000","last_clean":"2024-05-30T16:47:59.393606+0000","last_became_active":"2024-05-30T16:47:59.388844+0000","last_became_peered":"2024-05-30T16:47:59.388844+0000","last_unstale":"2024-05-30T16:47:59.393606+0000","last_undegraded":"2024-05-30T16:47:59.393606+0000","last_fullsized":"2024-05-30T16:47:59.393606+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:03.972639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403154+0000","last_change":"2024-05-30T16:47:59.394090+0000","last_active":"2024-05-30T16:48:00.403154+0000","last_peered":"2024-05-30T16:48:00.403154+0000","last_clean":"2024-05-30T16:48:00.403154+0000","last_became_active":"2024-05-30T16:47:59.393149+0000","last_became_peered":"2024-05-30T16:47:59.393149+0000","last_unstale":"2024-05-30T16:48:00.403154+0000","last_undegraded":"2024-05-30T16:48:00.403154+0000","last_fullsized":"2024-05-30T16:48:00.403154+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:44:03.238598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403703+0000","last_change":"2024-05-30T16:47:59.394331+0000","last_active":"2024-05-30T16:48:00.403703+0000","last_peered":"2024-05-30T16:48:00.403703+0000","last_clean":"2024-05-30T16:48:00.403703+0000","last_became_active":"2024-05-30T16:47:59.394031+0000","last_became_peered":"2024-05-30T16:47:59.394031+0000","last_unstale":"2024-05-30T16:48:00.403703+0000","last_undegraded":"2024-05-30T16:48:00.403703+0000","last_fullsized":"2024-05-30T16:48:00.403703+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:17:36.818656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403776+0000","last_change":"2024-05-30T16:47:58.379426+0000","last_active":"2024-05-30T16:48:00.403776+0000","last_peered":"2024-05-30T16:48:00.403776+0000","last_clean":"2024-05-30T16:48:00.403776+0000","last_became_active":"2024-05-30T16:47:58.379082+0000","last_became_peered":"2024-05-30T16:47:58.379082+0000","last_unstale":"2024-05-30T16:48:00.403776+0000","last_undegraded":"2024-05-30T16:48:00.403776+0000","last_fullsized":"2024-05-30T16:48:00.403776+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:21:20.734478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.405003+0000","last_change":"2024-05-30T16:47:59.399645+0000","last_active":"2024-05-30T16:47:59.405003+0000","last_peered":"2024-05-30T16:47:59.405003+0000","last_clean":"2024-05-30T16:47:59.405003+0000","last_became_active":"2024-05-30T16:47:59.398640+0000","last_became_peered":"2024-05-30T16:47:59.398640+0000","last_unstale":"2024-05-30T16:47:59.405003+0000","last_undegraded":"2024-05-30T16:47:59.405003+0000","last_fullsized":"2024-05-30T16:47:59.405003+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:32:25.170389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.416008+0000","last_change":"2024-05-30T16:47:58.375240+0000","last_active":"2024-05-30T16:47:59.416008+0000","last_peered":"2024-05-30T16:47:59.416008+0000","last_clean":"2024-05-30T16:47:59.416008+0000","last_became_active":"2024-05-30T16:47:58.374943+0000","last_became_peered":"2024-05-30T16:47:58.374943+0000","last_unstale":"2024-05-30T16:47:59.416008+0000","last_undegraded":"2024-05-30T16:47:59.416008+0000","last_fullsized":"2024-05-30T16:47:59.416008+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:17:35.803558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403685+0000","last_change":"2024-05-30T16:47:59.390443+0000","last_active":"2024-05-30T16:48:00.403685+0000","last_peered":"2024-05-30T16:48:00.403685+0000","last_clean":"2024-05-30T16:48:00.403685+0000","last_became_active":"2024-05-30T16:47:59.389593+0000","last_became_peered":"2024-05-30T16:47:59.389593+0000","last_unstale":"2024-05-30T16:48:00.403685+0000","last_undegraded":"2024-05-30T16:48:00.403685+0000","last_fullsized":"2024-05-30T16:48:00.403685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:33.230592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.404143+0000","last_change":"2024-05-30T16:47:58.362630+0000","last_active":"2024-05-30T16:48:00.404143+0000","last_peered":"2024-05-30T16:48:00.404143+0000","last_clean":"2024-05-30T16:48:00.404143+0000","last_became_active":"2024-05-30T16:47:58.362360+0000","last_became_peered":"2024-05-30T16:47:58.362360+0000","last_unstale":"2024-05-30T16:48:00.404143+0000","last_undegraded":"2024-05-30T16:48:00.404143+0000","last_fullsized":"2024-05-30T16:48:00.404143+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:57:26.373490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403824+0000","last_change":"2024-05-30T16:47:59.399125+0000","last_active":"2024-05-30T16:48:00.403824+0000","last_peered":"2024-05-30T16:48:00.403824+0000","last_clean":"2024-05-30T16:48:00.403824+0000","last_became_active":"2024-05-30T16:47:59.397193+0000","last_became_peered":"2024-05-30T16:47:59.397193+0000","last_unstale":"2024-05-30T16:48:00.403824+0000","last_undegraded":"2024-05-30T16:48:00.403824+0000","last_fullsized":"2024-05-30T16:48:00.403824+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:44.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974096+0000","last_change":"2024-05-30T16:47:58.381230+0000","last_active":"2024-05-30T16:48:00.974096+0000","last_peered":"2024-05-30T16:48:00.974096+0000","last_clean":"2024-05-30T16:48:00.974096+0000","last_became_active":"2024-05-30T16:47:58.378973+0000","last_became_peered":"2024-05-30T16:47:58.378973+0000","last_unstale":"2024-05-30T16:48:00.974096+0000","last_undegraded":"2024-05-30T16:48:00.974096+0000","last_fullsized":"2024-05-30T16:48:00.974096+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:48.991020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.412921+0000","last_change":"2024-05-30T16:47:59.408444+0000","last_active":"2024-05-30T16:47:59.412921+0000","last_peered":"2024-05-30T16:47:59.412921+0000","last_clean":"2024-05-30T16:47:59.412921+0000","last_became_active":"2024-05-30T16:47:59.405515+0000","last_became_peered":"2024-05-30T16:47:59.405515+0000","last_unstale":"2024-05-30T16:47:59.412921+0000","last_undegraded":"2024-05-30T16:47:59.412921+0000","last_fullsized":"2024-05-30T16:47:59.412921+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:46.310829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399689+0000","last_change":"2024-05-30T16:47:58.370781+0000","last_active":"2024-05-30T16:48:00.399689+0000","last_peered":"2024-05-30T16:48:00.399689+0000","last_clean":"2024-05-30T16:48:00.399689+0000","last_became_active":"2024-05-30T16:47:58.370505+0000","last_became_peered":"2024-05-30T16:47:58.370505+0000","last_unstale":"2024-05-30T16:48:00.399689+0000","last_undegraded":"2024-05-30T16:48:00.399689+0000","last_fullsized":"2024-05-30T16:48:00.399689+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:00:47.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.413994+0000","last_change":"2024-05-30T16:47:59.406065+0000","last_active":"2024-05-30T16:47:59.413994+0000","last_peered":"2024-05-30T16:47:59.413994+0000","last_clean":"2024-05-30T16:47:59.413994+0000","last_became_active":"2024-05-30T16:47:59.405699+0000","last_became_peered":"2024-05-30T16:47:59.405699+0000","last_unstale":"2024-05-30T16:47:59.413994+0000","last_undegraded":"2024-05-30T16:47:59.413994+0000","last_fullsized":"2024-05-30T16:47:59.413994+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:46.914948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403239+0000","last_change":"2024-05-30T16:47:58.368111+0000","last_active":"2024-05-30T16:48:00.403239+0000","last_peered":"2024-05-30T16:48:00.403239+0000","last_clean":"2024-05-30T16:48:00.403239+0000","last_became_active":"2024-05-30T16:47:58.366724+0000","last_became_peered":"2024-05-30T16:47:58.366724+0000","last_unstale":"2024-05-30T16:48:00.403239+0000","last_undegraded":"2024-05-30T16:48:00.403239+0000","last_fullsized":"2024-05-30T16:48:00.403239+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:33.532748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402094+0000","last_change":"2024-05-30T16:47:59.392951+0000","last_active":"2024-05-30T16:48:00.402094+0000","last_peered":"2024-05-30T16:48:00.402094+0000","last_clean":"2024-05-30T16:48:00.402094+0000","last_became_active":"2024-05-30T16:47:59.392690+0000","last_became_peered":"2024-05-30T16:47:59.392690+0000","last_unstale":"2024-05-30T16:48:00.402094+0000","last_undegraded":"2024-05-30T16:48:00.402094+0000","last_fullsized":"2024-05-30T16:48:00.402094+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:51:14.166642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973459+0000","last_change":"2024-05-30T16:47:58.380872+0000","last_active":"2024-05-30T16:48:00.973459+0000","last_peered":"2024-05-30T16:48:00.973459+0000","last_clean":"2024-05-30T16:48:00.973459+0000","last_became_active":"2024-05-30T16:47:58.378547+0000","last_became_peered":"2024-05-30T16:47:58.378547+0000","last_unstale":"2024-05-30T16:48:00.973459+0000","last_undegraded":"2024-05-30T16:48:00.973459+0000","last_fullsized":"2024-05-30T16:48:00.973459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:21:20.734478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.408739+0000","last_change":"2024-05-30T16:47:59.399244+0000","last_active":"2024-05-30T16:47:59.408739+0000","last_peered":"2024-05-30T16:47:59.408739+0000","last_clean":"2024-05-30T16:47:59.408739+0000","last_became_active":"2024-05-30T16:47:59.398950+0000","last_became_peered":"2024-05-30T16:47:59.398950+0000","last_unstale":"2024-05-30T16:47:59.408739+0000","last_undegraded":"2024-05-30T16:47:59.408739+0000","last_fullsized":"2024-05-30T16:47:59.408739+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:42:37.732411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399657+0000","last_change":"2024-05-30T16:47:58.372694+0000","last_active":"2024-05-30T16:48:00.399657+0000","last_peered":"2024-05-30T16:48:00.399657+0000","last_clean":"2024-05-30T16:48:00.399657+0000","last_became_active":"2024-05-30T16:47:58.372268+0000","last_became_peered":"2024-05-30T16:47:58.372268+0000","last_unstale":"2024-05-30T16:48:00.399657+0000","last_undegraded":"2024-05-30T16:48:00.399657+0000","last_fullsized":"2024-05-30T16:48:00.399657+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:25:31.967585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400892+0000","last_change":"2024-05-30T16:47:59.394260+0000","last_active":"2024-05-30T16:48:00.400892+0000","last_peered":"2024-05-30T16:48:00.400892+0000","last_clean":"2024-05-30T16:48:00.400892+0000","last_became_active":"2024-05-30T16:47:59.392880+0000","last_became_peered":"2024-05-30T16:47:59.392880+0000","last_unstale":"2024-05-30T16:48:00.400892+0000","last_undegraded":"2024-05-30T16:48:00.400892+0000","last_fullsized":"2024-05-30T16:48:00.400892+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:50.006118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402922+0000","last_change":"2024-05-30T16:47:58.373624+0000","last_active":"2024-05-30T16:48:00.402922+0000","last_peered":"2024-05-30T16:48:00.402922+0000","last_clean":"2024-05-30T16:48:00.402922+0000","last_became_active":"2024-05-30T16:47:58.373250+0000","last_became_peered":"2024-05-30T16:47:58.373250+0000","last_unstale":"2024-05-30T16:48:00.402922+0000","last_undegraded":"2024-05-30T16:48:00.402922+0000","last_fullsized":"2024-05-30T16:48:00.402922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:35:15.046552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403016+0000","last_change":"2024-05-30T16:47:59.396583+0000","last_active":"2024-05-30T16:48:00.403016+0000","last_peered":"2024-05-30T16:48:00.403016+0000","last_clean":"2024-05-30T16:48:00.403016+0000","last_became_active":"2024-05-30T16:47:59.396025+0000","last_became_peered":"2024-05-30T16:47:59.396025+0000","last_unstale":"2024-05-30T16:48:00.403016+0000","last_undegraded":"2024-05-30T16:48:00.403016+0000","last_fullsized":"2024-05-30T16:48:00.403016+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:11:17.857778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.387184+0000","last_change":"2024-05-30T16:47:58.375356+0000","last_active":"2024-05-30T16:47:59.387184+0000","last_peered":"2024-05-30T16:47:59.387184+0000","last_clean":"2024-05-30T16:47:59.387184+0000","last_became_active":"2024-05-30T16:47:58.375006+0000","last_became_peered":"2024-05-30T16:47:58.375006+0000","last_unstale":"2024-05-30T16:47:59.387184+0000","last_undegraded":"2024-05-30T16:47:59.387184+0000","last_fullsized":"2024-05-30T16:47:59.387184+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:43.078233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.402856+0000","last_change":"2024-05-30T16:47:59.391827+0000","last_active":"2024-05-30T16:47:59.402856+0000","last_peered":"2024-05-30T16:47:59.402856+0000","last_clean":"2024-05-30T16:47:59.402856+0000","last_became_active":"2024-05-30T16:47:59.391135+0000","last_became_peered":"2024-05-30T16:47:59.391135+0000","last_unstale":"2024-05-30T16:47:59.402856+0000","last_undegraded":"2024-05-30T16:47:59.402856+0000","last_fullsized":"2024-05-30T16:47:59.402856+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:32:20.528161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403727+0000","last_change":"2024-05-30T16:47:58.374791+0000","last_active":"2024-05-30T16:48:00.403727+0000","last_peered":"2024-05-30T16:48:00.403727+0000","last_clean":"2024-05-30T16:48:00.403727+0000","last_became_active":"2024-05-30T16:47:58.373701+0000","last_became_peered":"2024-05-30T16:47:58.373701+0000","last_unstale":"2024-05-30T16:48:00.403727+0000","last_undegraded":"2024-05-30T16:48:00.403727+0000","last_fullsized":"2024-05-30T16:48:00.403727+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:33:00.082379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403390+0000","last_change":"2024-05-30T16:47:59.397440+0000","last_active":"2024-05-30T16:48:00.403390+0000","last_peered":"2024-05-30T16:48:00.403390+0000","last_clean":"2024-05-30T16:48:00.403390+0000","last_became_active":"2024-05-30T16:47:59.397109+0000","last_became_peered":"2024-05-30T16:47:59.397109+0000","last_unstale":"2024-05-30T16:48:00.403390+0000","last_undegraded":"2024-05-30T16:48:00.403390+0000","last_fullsized":"2024-05-30T16:48:00.403390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:54.636109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400603+0000","last_change":"2024-05-30T16:47:58.372138+0000","last_active":"2024-05-30T16:48:00.400603+0000","last_peered":"2024-05-30T16:48:00.400603+0000","last_clean":"2024-05-30T16:48:00.400603+0000","last_became_active":"2024-05-30T16:47:58.371823+0000","last_became_peered":"2024-05-30T16:47:58.371823+0000","last_unstale":"2024-05-30T16:48:00.400603+0000","last_undegraded":"2024-05-30T16:48:00.400603+0000","last_fullsized":"2024-05-30T16:48:00.400603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:42:37.056704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973623+0000","last_change":"2024-05-30T16:47:59.405335+0000","last_active":"2024-05-30T16:48:00.973623+0000","last_peered":"2024-05-30T16:48:00.973623+0000","last_clean":"2024-05-30T16:48:00.973623+0000","last_became_active":"2024-05-30T16:47:59.405097+0000","last_became_peered":"2024-05-30T16:47:59.405097+0000","last_unstale":"2024-05-30T16:48:00.973623+0000","last_undegraded":"2024-05-30T16:48:00.973623+0000","last_fullsized":"2024-05-30T16:48:00.973623+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:44.696058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.420948+0000","last_change":"2024-05-30T16:47:58.374745+0000","last_active":"2024-05-30T16:47:59.420948+0000","last_peered":"2024-05-30T16:47:59.420948+0000","last_clean":"2024-05-30T16:47:59.420948+0000","last_became_active":"2024-05-30T16:47:58.374442+0000","last_became_peered":"2024-05-30T16:47:58.374442+0000","last_unstale":"2024-05-30T16:47:59.420948+0000","last_undegraded":"2024-05-30T16:47:59.420948+0000","last_fullsized":"2024-05-30T16:47:59.420948+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:05:17.956609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402297+0000","last_change":"2024-05-30T16:47:59.390131+0000","last_active":"2024-05-30T16:48:00.402297+0000","last_peered":"2024-05-30T16:48:00.402297+0000","last_clean":"2024-05-30T16:48:00.402297+0000","last_became_active":"2024-05-30T16:47:59.389257+0000","last_became_peered":"2024-05-30T16:47:59.389257+0000","last_unstale":"2024-05-30T16:48:00.402297+0000","last_undegraded":"2024-05-30T16:48:00.402297+0000","last_fullsized":"2024-05-30T16:48:00.402297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:40.779106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399189+0000","last_change":"2024-05-30T16:47:58.371849+0000","last_active":"2024-05-30T16:48:00.399189+0000","last_peered":"2024-05-30T16:48:00.399189+0000","last_clean":"2024-05-30T16:48:00.399189+0000","last_became_active":"2024-05-30T16:47:58.371439+0000","last_became_peered":"2024-05-30T16:47:58.371439+0000","last_unstale":"2024-05-30T16:48:00.399189+0000","last_undegraded":"2024-05-30T16:48:00.399189+0000","last_fullsized":"2024-05-30T16:48:00.399189+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:22:31.591949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.398879+0000","last_change":"2024-05-30T16:47:59.387412+0000","last_active":"2024-05-30T16:48:00.398879+0000","last_peered":"2024-05-30T16:48:00.398879+0000","last_clean":"2024-05-30T16:48:00.398879+0000","last_became_active":"2024-05-30T16:47:59.387087+0000","last_became_peered":"2024-05-30T16:47:59.387087+0000","last_unstale":"2024-05-30T16:48:00.398879+0000","last_undegraded":"2024-05-30T16:48:00.398879+0000","last_fullsized":"2024-05-30T16:48:00.398879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:06:31.961231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973532+0000","last_change":"2024-05-30T16:47:58.374840+0000","last_active":"2024-05-30T16:48:00.973532+0000","last_peered":"2024-05-30T16:48:00.973532+0000","last_clean":"2024-05-30T16:48:00.973532+0000","last_became_active":"2024-05-30T16:47:58.374553+0000","last_became_peered":"2024-05-30T16:47:58.374553+0000","last_unstale":"2024-05-30T16:48:00.973532+0000","last_undegraded":"2024-05-30T16:48:00.973532+0000","last_fullsized":"2024-05-30T16:48:00.973532+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:42:15.768731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402826+0000","last_change":"2024-05-30T16:47:59.402416+0000","last_active":"2024-05-30T16:48:00.402826+0000","last_peered":"2024-05-30T16:48:00.402826+0000","last_clean":"2024-05-30T16:48:00.402826+0000","last_became_active":"2024-05-30T16:47:59.402182+0000","last_became_peered":"2024-05-30T16:47:59.402182+0000","last_unstale":"2024-05-30T16:48:00.402826+0000","last_undegraded":"2024-05-30T16:48:00.402826+0000","last_fullsized":"2024-05-30T16:48:00.402826+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:31.217931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400988+0000","last_change":"2024-05-30T16:47:58.379529+0000","last_active":"2024-05-30T16:48:00.400988+0000","last_peered":"2024-05-30T16:48:00.400988+0000","last_clean":"2024-05-30T16:48:00.400988+0000","last_became_active":"2024-05-30T16:47:58.379159+0000","last_became_peered":"2024-05-30T16:47:58.379159+0000","last_unstale":"2024-05-30T16:48:00.400988+0000","last_undegraded":"2024-05-30T16:48:00.400988+0000","last_fullsized":"2024-05-30T16:48:00.400988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:28:46.449937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403134+0000","last_change":"2024-05-30T16:47:59.384305+0000","last_active":"2024-05-30T16:48:00.403134+0000","last_peered":"2024-05-30T16:48:00.403134+0000","last_clean":"2024-05-30T16:48:00.403134+0000","last_became_active":"2024-05-30T16:47:59.383857+0000","last_became_peered":"2024-05-30T16:47:59.383857+0000","last_unstale":"2024-05-30T16:48:00.403134+0000","last_undegraded":"2024-05-30T16:48:00.403134+0000","last_fullsized":"2024-05-30T16:48:00.403134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:13.948859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.418751+0000","last_change":"2024-05-30T16:47:58.371989+0000","last_active":"2024-05-30T16:47:59.418751+0000","last_peered":"2024-05-30T16:47:59.418751+0000","last_clean":"2024-05-30T16:47:59.418751+0000","last_became_active":"2024-05-30T16:47:58.371663+0000","last_became_peered":"2024-05-30T16:47:58.371663+0000","last_unstale":"2024-05-30T16:47:59.418751+0000","last_undegraded":"2024-05-30T16:47:59.418751+0000","last_fullsized":"2024-05-30T16:47:59.418751+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:22.481811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974548+0000","last_change":"2024-05-30T16:47:59.404070+0000","last_active":"2024-05-30T16:48:00.974548+0000","last_peered":"2024-05-30T16:48:00.974548+0000","last_clean":"2024-05-30T16:48:00.974548+0000","last_became_active":"2024-05-30T16:47:59.403741+0000","last_became_peered":"2024-05-30T16:47:59.403741+0000","last_unstale":"2024-05-30T16:48:00.974548+0000","last_undegraded":"2024-05-30T16:48:00.974548+0000","last_fullsized":"2024-05-30T16:48:00.974548+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:23.496909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403718+0000","last_change":"2024-05-30T16:47:58.370885+0000","last_active":"2024-05-30T16:48:00.403718+0000","last_peered":"2024-05-30T16:48:00.403718+0000","last_clean":"2024-05-30T16:48:00.403718+0000","last_became_active":"2024-05-30T16:47:58.370624+0000","last_became_peered":"2024-05-30T16:47:58.370624+0000","last_unstale":"2024-05-30T16:48:00.403718+0000","last_undegraded":"2024-05-30T16:48:00.403718+0000","last_fullsized":"2024-05-30T16:48:00.403718+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:10:47.755146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.400482+0000","last_change":"2024-05-30T16:47:59.393959+0000","last_active":"2024-05-30T16:47:59.400482+0000","last_peered":"2024-05-30T16:47:59.400482+0000","last_clean":"2024-05-30T16:47:59.400482+0000","last_became_active":"2024-05-30T16:47:59.392585+0000","last_became_peered":"2024-05-30T16:47:59.392585+0000","last_unstale":"2024-05-30T16:47:59.400482+0000","last_undegraded":"2024-05-30T16:47:59.400482+0000","last_fullsized":"2024-05-30T16:47:59.400482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:40.779106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974700+0000","last_change":"2024-05-30T16:47:58.379219+0000","last_active":"2024-05-30T16:48:00.974700+0000","last_peered":"2024-05-30T16:48:00.974700+0000","last_clean":"2024-05-30T16:48:00.974700+0000","last_became_active":"2024-05-30T16:47:58.378861+0000","last_became_peered":"2024-05-30T16:47:58.378861+0000","last_unstale":"2024-05-30T16:48:00.974700+0000","last_undegraded":"2024-05-30T16:48:00.974700+0000","last_fullsized":"2024-05-30T16:48:00.974700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:57:26.373490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403635+0000","last_change":"2024-05-30T16:47:59.404141+0000","last_active":"2024-05-30T16:48:00.403635+0000","last_peered":"2024-05-30T16:48:00.403635+0000","last_clean":"2024-05-30T16:48:00.403635+0000","last_became_active":"2024-05-30T16:47:59.403866+0000","last_became_peered":"2024-05-30T16:47:59.403866+0000","last_unstale":"2024-05-30T16:48:00.403635+0000","last_undegraded":"2024-05-30T16:48:00.403635+0000","last_fullsized":"2024-05-30T16:48:00.403635+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:46.310829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403598+0000","last_change":"2024-05-30T16:47:58.373532+0000","last_active":"2024-05-30T16:48:00.403598+0000","last_peered":"2024-05-30T16:48:00.403598+0000","last_clean":"2024-05-30T16:48:00.403598+0000","last_became_active":"2024-05-30T16:47:58.373228+0000","last_became_peered":"2024-05-30T16:47:58.373228+0000","last_unstale":"2024-05-30T16:48:00.403598+0000","last_undegraded":"2024-05-30T16:48:00.403598+0000","last_fullsized":"2024-05-30T16:48:00.403598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:51:56.244054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973991+0000","last_change":"2024-05-30T16:47:59.403690+0000","last_active":"2024-05-30T16:48:00.973991+0000","last_peered":"2024-05-30T16:48:00.973991+0000","last_clean":"2024-05-30T16:48:00.973991+0000","last_became_active":"2024-05-30T16:47:59.403369+0000","last_became_peered":"2024-05-30T16:47:59.403369+0000","last_unstale":"2024-05-30T16:48:00.973991+0000","last_undegraded":"2024-05-30T16:48:00.973991+0000","last_fullsized":"2024-05-30T16:48:00.973991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:02.167351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.418898+0000","last_change":"2024-05-30T16:47:58.368867+0000","last_active":"2024-05-30T16:47:59.418898+0000","last_peered":"2024-05-30T16:47:59.418898+0000","last_clean":"2024-05-30T16:47:59.418898+0000","last_became_active":"2024-05-30T16:47:58.368624+0000","last_became_peered":"2024-05-30T16:47:58.368624+0000","last_unstale":"2024-05-30T16:47:59.418898+0000","last_undegraded":"2024-05-30T16:47:59.418898+0000","last_fullsized":"2024-05-30T16:47:59.418898+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:32.215493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403465+0000","last_change":"2024-05-30T16:47:59.396931+0000","last_active":"2024-05-30T16:48:00.403465+0000","last_peered":"2024-05-30T16:48:00.403465+0000","last_clean":"2024-05-30T16:48:00.403465+0000","last_became_active":"2024-05-30T16:47:59.396640+0000","last_became_peered":"2024-05-30T16:47:59.396640+0000","last_unstale":"2024-05-30T16:48:00.403465+0000","last_undegraded":"2024-05-30T16:48:00.403465+0000","last_fullsized":"2024-05-30T16:48:00.403465+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:02.167351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.377194+0000","last_change":"2024-05-30T16:47:58.372030+0000","last_active":"2024-05-30T16:47:59.377194+0000","last_peered":"2024-05-30T16:47:59.377194+0000","last_clean":"2024-05-30T16:47:59.377194+0000","last_became_active":"2024-05-30T16:47:58.371715+0000","last_became_peered":"2024-05-30T16:47:58.371715+0000","last_unstale":"2024-05-30T16:47:59.377194+0000","last_undegraded":"2024-05-30T16:47:59.377194+0000","last_fullsized":"2024-05-30T16:47:59.377194+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:48:25.572862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403076+0000","last_change":"2024-05-30T16:47:59.394792+0000","last_active":"2024-05-30T16:48:00.403076+0000","last_peered":"2024-05-30T16:48:00.403076+0000","last_clean":"2024-05-30T16:48:00.403076+0000","last_became_active":"2024-05-30T16:47:59.393739+0000","last_became_peered":"2024-05-30T16:47:59.393739+0000","last_unstale":"2024-05-30T16:48:00.403076+0000","last_undegraded":"2024-05-30T16:48:00.403076+0000","last_fullsized":"2024-05-30T16:48:00.403076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:33:01.097478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973450+0000","last_change":"2024-05-30T16:47:58.374896+0000","last_active":"2024-05-30T16:48:00.973450+0000","last_peered":"2024-05-30T16:48:00.973450+0000","last_clean":"2024-05-30T16:48:00.973450+0000","last_became_active":"2024-05-30T16:47:58.374540+0000","last_became_peered":"2024-05-30T16:47:58.374540+0000","last_unstale":"2024-05-30T16:48:00.973450+0000","last_undegraded":"2024-05-30T16:48:00.973450+0000","last_fullsized":"2024-05-30T16:48:00.973450+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:33.532748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974464+0000","last_change":"2024-05-30T16:47:59.391927+0000","last_active":"2024-05-30T16:48:00.974464+0000","last_peered":"2024-05-30T16:48:00.974464+0000","last_clean":"2024-05-30T16:48:00.974464+0000","last_became_active":"2024-05-30T16:47:59.391685+0000","last_became_peered":"2024-05-30T16:47:59.391685+0000","last_unstale":"2024-05-30T16:48:00.974464+0000","last_undegraded":"2024-05-30T16:48:00.974464+0000","last_fullsized":"2024-05-30T16:48:00.974464+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:33.230592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.419324+0000","last_change":"2024-05-30T16:47:58.367752+0000","last_active":"2024-05-30T16:47:59.419324+0000","last_peered":"2024-05-30T16:47:59.419324+0000","last_clean":"2024-05-30T16:47:59.419324+0000","last_became_active":"2024-05-30T16:47:58.367471+0000","last_became_peered":"2024-05-30T16:47:58.367471+0000","last_unstale":"2024-05-30T16:47:59.419324+0000","last_undegraded":"2024-05-30T16:47:59.419324+0000","last_fullsized":"2024-05-30T16:47:59.419324+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:53:31.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974510+0000","last_change":"2024-05-30T16:47:59.394271+0000","last_active":"2024-05-30T16:48:00.974510+0000","last_peered":"2024-05-30T16:48:00.974510+0000","last_clean":"2024-05-30T16:48:00.974510+0000","last_became_active":"2024-05-30T16:47:59.393958+0000","last_became_peered":"2024-05-30T16:47:59.393958+0000","last_unstale":"2024-05-30T16:48:00.974510+0000","last_undegraded":"2024-05-30T16:48:00.974510+0000","last_fullsized":"2024-05-30T16:48:00.974510+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:44.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.406374+0000","last_change":"2024-05-30T16:47:58.364595+0000","last_active":"2024-05-30T16:48:00.406374+0000","last_peered":"2024-05-30T16:48:00.406374+0000","last_clean":"2024-05-30T16:48:00.406374+0000","last_became_active":"2024-05-30T16:47:58.364248+0000","last_became_peered":"2024-05-30T16:47:58.364248+0000","last_unstale":"2024-05-30T16:48:00.406374+0000","last_undegraded":"2024-05-30T16:48:00.406374+0000","last_fullsized":"2024-05-30T16:48:00.406374+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:06:30.946133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.399350+0000","last_change":"2024-05-30T16:47:59.388245+0000","last_active":"2024-05-30T16:47:59.399350+0000","last_peered":"2024-05-30T16:47:59.399350+0000","last_clean":"2024-05-30T16:47:59.399350+0000","last_became_active":"2024-05-30T16:47:59.386627+0000","last_became_peered":"2024-05-30T16:47:59.386627+0000","last_unstale":"2024-05-30T16:47:59.399350+0000","last_undegraded":"2024-05-30T16:47:59.399350+0000","last_fullsized":"2024-05-30T16:47:59.399350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:27.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.404173+0000","last_change":"2024-05-30T16:47:58.365550+0000","last_active":"2024-05-30T16:48:00.404173+0000","last_peered":"2024-05-30T16:48:00.404173+0000","last_clean":"2024-05-30T16:48:00.404173+0000","last_became_active":"2024-05-30T16:47:58.365257+0000","last_became_peered":"2024-05-30T16:47:58.365257+0000","last_unstale":"2024-05-30T16:48:00.404173+0000","last_undegraded":"2024-05-30T16:48:00.404173+0000","last_fullsized":"2024-05-30T16:48:00.404173+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:06:11.536343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.404032+0000","last_change":"2024-05-30T16:47:59.397518+0000","last_active":"2024-05-30T16:48:00.404032+0000","last_peered":"2024-05-30T16:48:00.404032+0000","last_clean":"2024-05-30T16:48:00.404032+0000","last_became_active":"2024-05-30T16:47:59.396787+0000","last_became_peered":"2024-05-30T16:47:59.396787+0000","last_unstale":"2024-05-30T16:48:00.404032+0000","last_undegraded":"2024-05-30T16:48:00.404032+0000","last_fullsized":"2024-05-30T16:48:00.404032+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:23.496909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974418+0000","last_change":"2024-05-30T16:47:58.380084+0000","last_active":"2024-05-30T16:48:00.974418+0000","last_peered":"2024-05-30T16:48:00.974418+0000","last_clean":"2024-05-30T16:48:00.974418+0000","last_became_active":"2024-05-30T16:47:58.379481+0000","last_became_peered":"2024-05-30T16:47:58.379481+0000","last_unstale":"2024-05-30T16:48:00.974418+0000","last_undegraded":"2024-05-30T16:48:00.974418+0000","last_fullsized":"2024-05-30T16:48:00.974418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:57.782946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.408328+0000","last_change":"2024-05-30T16:47:59.400603+0000","last_active":"2024-05-30T16:47:59.408328+0000","last_peered":"2024-05-30T16:47:59.408328+0000","last_clean":"2024-05-30T16:47:59.408328+0000","last_became_active":"2024-05-30T16:47:59.400335+0000","last_became_peered":"2024-05-30T16:47:59.400335+0000","last_unstale":"2024-05-30T16:47:59.408328+0000","last_undegraded":"2024-05-30T16:47:59.408328+0000","last_fullsized":"2024-05-30T16:47:59.408328+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:31.217931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.377336+0000","last_change":"2024-05-30T16:47:58.379532+0000","last_active":"2024-05-30T16:47:59.377336+0000","last_peered":"2024-05-30T16:47:59.377336+0000","last_clean":"2024-05-30T16:47:59.377336+0000","last_became_active":"2024-05-30T16:47:58.379119+0000","last_became_peered":"2024-05-30T16:47:58.379119+0000","last_unstale":"2024-05-30T16:47:59.377336+0000","last_undegraded":"2024-05-30T16:47:59.377336+0000","last_fullsized":"2024-05-30T16:47:59.377336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:28.725736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403425+0000","last_change":"2024-05-30T16:47:59.409548+0000","last_active":"2024-05-30T16:48:00.403425+0000","last_peered":"2024-05-30T16:48:00.403425+0000","last_clean":"2024-05-30T16:48:00.403425+0000","last_became_active":"2024-05-30T16:47:59.409187+0000","last_became_peered":"2024-05-30T16:47:59.409187+0000","last_unstale":"2024-05-30T16:48:00.403425+0000","last_undegraded":"2024-05-30T16:48:00.403425+0000","last_fullsized":"2024-05-30T16:48:00.403425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:46.914948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400515+0000","last_change":"2024-05-30T16:47:58.371478+0000","last_active":"2024-05-30T16:48:00.400515+0000","last_peered":"2024-05-30T16:48:00.400515+0000","last_clean":"2024-05-30T16:48:00.400515+0000","last_became_active":"2024-05-30T16:47:58.371209+0000","last_became_peered":"2024-05-30T16:47:58.371209+0000","last_unstale":"2024-05-30T16:48:00.400515+0000","last_undegraded":"2024-05-30T16:48:00.400515+0000","last_fullsized":"2024-05-30T16:48:00.400515+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:01:22.437924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.402186+0000","last_change":"2024-05-30T16:47:59.391045+0000","last_active":"2024-05-30T16:47:59.402186+0000","last_peered":"2024-05-30T16:47:59.402186+0000","last_clean":"2024-05-30T16:47:59.402186+0000","last_became_active":"2024-05-30T16:47:59.390708+0000","last_became_peered":"2024-05-30T16:47:59.390708+0000","last_unstale":"2024-05-30T16:47:59.402186+0000","last_undegraded":"2024-05-30T16:47:59.402186+0000","last_fullsized":"2024-05-30T16:47:59.402186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:57:45.288105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.377130+0000","last_change":"2024-05-30T16:47:58.364575+0000","last_active":"2024-05-30T16:47:59.377130+0000","last_peered":"2024-05-30T16:47:59.377130+0000","last_clean":"2024-05-30T16:47:59.377130+0000","last_became_active":"2024-05-30T16:47:58.364302+0000","last_became_peered":"2024-05-30T16:47:58.364302+0000","last_unstale":"2024-05-30T16:47:59.377130+0000","last_undegraded":"2024-05-30T16:47:59.377130+0000","last_fullsized":"2024-05-30T16:47:59.377130+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:23:39.552282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.400463+0000","last_change":"2024-05-30T16:47:59.390540+0000","last_active":"2024-05-30T16:47:59.400463+0000","last_peered":"2024-05-30T16:47:59.400463+0000","last_clean":"2024-05-30T16:47:59.400463+0000","last_became_active":"2024-05-30T16:47:59.390262+0000","last_became_peered":"2024-05-30T16:47:59.390262+0000","last_unstale":"2024-05-30T16:47:59.400463+0000","last_undegraded":"2024-05-30T16:47:59.400463+0000","last_fullsized":"2024-05-30T16:47:59.400463+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:59.928555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.385914+0000","last_change":"2024-05-30T16:47:58.378978+0000","last_active":"2024-05-30T16:47:59.385914+0000","last_peered":"2024-05-30T16:47:59.385914+0000","last_clean":"2024-05-30T16:47:59.385914+0000","last_became_active":"2024-05-30T16:47:58.378659+0000","last_became_peered":"2024-05-30T16:47:58.378659+0000","last_unstale":"2024-05-30T16:47:59.385914+0000","last_undegraded":"2024-05-30T16:47:59.385914+0000","last_fullsized":"2024-05-30T16:47:59.385914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:01.152253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.412081+0000","last_change":"2024-05-30T16:47:59.406325+0000","last_active":"2024-05-30T16:47:59.412081+0000","last_peered":"2024-05-30T16:47:59.412081+0000","last_clean":"2024-05-30T16:47:59.412081+0000","last_became_active":"2024-05-30T16:47:59.406015+0000","last_became_peered":"2024-05-30T16:47:59.406015+0000","last_unstale":"2024-05-30T16:47:59.412081+0000","last_undegraded":"2024-05-30T16:47:59.412081+0000","last_fullsized":"2024-05-30T16:47:59.412081+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:32.401290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.401305+0000","last_change":"2024-05-30T16:47:58.379111+0000","last_active":"2024-05-30T16:48:00.401305+0000","last_peered":"2024-05-30T16:48:00.401305+0000","last_clean":"2024-05-30T16:48:00.401305+0000","last_became_active":"2024-05-30T16:47:58.378816+0000","last_became_peered":"2024-05-30T16:47:58.378816+0000","last_unstale":"2024-05-30T16:48:00.401305+0000","last_undegraded":"2024-05-30T16:48:00.401305+0000","last_fullsized":"2024-05-30T16:48:00.401305+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:43:56.245073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":242,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.401156+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:48:00.401156+0000","last_peered":"2024-05-30T16:48:00.401156+0000","last_clean":"2024-05-30T16:48:00.401156+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:48:00.401156+0000","last_undegraded":"2024-05-30T16:48:00.401156+0000","last_fullsized":"2024-05-30T16:48:00.401156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1310720,"data_stored":887962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45768,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326072,"statfs":{"total":96636764160,"available":96589897728,"internally_reserved":0,"allocated":708608,"data_stored":297434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40192,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331648,"statfs":{"total":96636764160,"available":96595607552,"internally_reserved":0,"allocated":704512,"data_stored":291758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45764,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326076,"statfs":{"total":96636764160,"available":96589901824,"internally_reserved":0,"allocated":708608,"data_stored":292718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45764,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326076,"statfs":{"total":96636764160,"available":96589901824,"internally_reserved":0,"allocated":704512,"data_stored":291162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62396,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309444,"statfs":{"total":96636764160,"available":96572870656,"internally_reserved":0,"allocated":704512,"data_stored":291162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45760,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326080,"statfs":{"total":96636764160,"available":96589905920,"internally_reserved":0,"allocated":700416,"data_stored":291196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46360,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325480,"statfs":{"total":96636764160,"available":96589291520,"internally_reserved":0,"allocated":1318912,"data_stored":889996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:48:03.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:48:03.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.998+0000 7f84ce000640 1 Processor -- start 2024-05-30T16:48:03.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.998+0000 7f84ce000640 1 -- start start 2024-05-30T16:48:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:03.999+0000 7f84ce000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f84c81418f0 0x7f84c815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.000+0000 7f84ce000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c80b3fd0 con 0x7f84c8141510 2024-05-30T16:48:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.000+0000 7f84ce000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c8144790 con 0x7f84c8144020 2024-05-30T16:48:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.000+0000 7f84ce000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f84c806dfc0 con 0x7f84c81418f0 2024-05-30T16:48:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.000+0000 7f84c7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f84c8141510 0x7f84c80b5440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33292/0 (socket says 172.21.15.144:33292) 2024-05-30T16:48:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.000+0000 7f84c7400640 1 -- 172.21.15.144:0/3868143677 learned_addr learned my addr 172.21.15.144:0/3868143677 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.000+0000 7f84bea00640 1 --2- 172.21.15.144:0/3868143677 >> v2:172.21.15.144:3300/0 conn(0x7f84c81418f0 0x7f84c815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.000+0000 7f84c6a00640 1 -- 172.21.15.144:0/3868143677 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713672832 0 0) 0x7f84c80b3fd0 con 0x7f84c8141510 2024-05-30T16:48:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.000+0000 7f84c6a00640 1 -- 172.21.15.144:0/3868143677 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84ac003520 con 0x7f84c8141510 2024-05-30T16:48:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.001+0000 7f84bea00640 1 -- 172.21.15.144:0/3868143677 >> v1:172.21.15.149:6789/0 conn(0x7f84c8144020 legacy=0x7f84c806e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.001+0000 7f84bea00640 1 -- 172.21.15.144:0/3868143677 >> v1:172.21.15.144:6789/0 conn(0x7f84c8141510 legacy=0x7f84c80b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.001+0000 7f84bea00640 1 -- 172.21.15.144:0/3868143677 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c8144a70 con 0x7f84c81418f0 2024-05-30T16:48:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.002+0000 7f84bea00640 1 --2- 172.21.15.144:0/3868143677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 0x7f84c815f8f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f84b00097a0 tx=0x7f84b002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d856332ea54c6a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.002+0000 7f84c6a00640 1 -- 172.21.15.144:0/3868143677 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0037070 con 0x7f84c81418f0 2024-05-30T16:48:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.002+0000 7f84c6a00640 1 -- 172.21.15.144:0/3868143677 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b0032440 con 0x7f84c81418f0 2024-05-30T16:48:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.002+0000 7f84c6a00640 1 -- 172.21.15.144:0/3868143677 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b002ae60 con 0x7f84c81418f0 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.003+0000 7f84ce000640 1 -- 172.21.15.144:0/3868143677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 msgr2=0x7f84c815f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.003+0000 7f84ce000640 1 --2- 172.21.15.144:0/3868143677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 0x7f84c815f8f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f84b00097a0 tx=0x7f84b002a110 comp rx=0 tx=0).stop 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.003+0000 7f84ce000640 1 -- 172.21.15.144:0/3868143677 shutdown_connections 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.003+0000 7f84ce000640 1 --2- 172.21.15.144:0/3868143677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 0x7f84c815f8f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.003+0000 7f84ce000640 1 -- 172.21.15.144:0/3868143677 >> 172.21.15.144:0/3868143677 conn(0x7f84c806bd00 msgr2=0x7f84c806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.003+0000 7f84ce000640 1 -- 172.21.15.144:0/3868143677 shutdown_connections 2024-05-30T16:48:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.003+0000 7f84ce000640 1 -- 172.21.15.144:0/3868143677 wait complete. 2024-05-30T16:48:04.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.004+0000 7f84ce000640 1 Processor -- start 2024-05-30T16:48:04.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.005+0000 7f84ce000640 1 -- start start 2024-05-30T16:48:04.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.005+0000 7f84ce000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c8141510 0x7f84c8155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.005+0000 7f84ce000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 0x7f84c8160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.005+0000 7f84ce000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84c8144020 0x7f84c8160e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.005+0000 7f84ce000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8144490 con 0x7f84c81418f0 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.005+0000 7f84ce000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f84c806e210 con 0x7f84c8141510 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.005+0000 7f84ce000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f84c80b5b50 con 0x7f84c8144020 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84bea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 0x7f84c8160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84bea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 0x7f84c8160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43196/0 (socket says 172.21.15.144:43196) 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84bea00640 1 -- 172.21.15.144:0/2339575150 learned_addr learned my addr 172.21.15.144:0/2339575150 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84c7400640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c8141510 0x7f84c8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84c7e00640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84c8144020 0x7f84c8160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84bea00640 1 -- 172.21.15.144:0/2339575150 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84c8144020 msgr2=0x7f84c8160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84bea00640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84c8144020 0x7f84c8160e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84bea00640 1 -- 172.21.15.144:0/2339575150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c8141510 msgr2=0x7f84c8155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84bea00640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c8141510 0x7f84c8155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84bea00640 1 -- 172.21.15.144:0/2339575150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c80b2a10 con 0x7f84c81418f0 2024-05-30T16:48:04.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.006+0000 7f84c7e00640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84c8144020 0x7f84c8160e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:04.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.007+0000 7f84bea00640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 0x7f84c8160940 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f84b00098c0 tx=0x7f84b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:04.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.007+0000 7f84bfe00640 1 -- 172.21.15.144:0/2339575150 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0037040 con 0x7f84c81418f0 2024-05-30T16:48:04.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.007+0000 7f84bfe00640 1 -- 172.21.15.144:0/2339575150 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b0030580 con 0x7f84c81418f0 2024-05-30T16:48:04.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.007+0000 7f84bfe00640 1 -- 172.21.15.144:0/2339575150 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0030950 con 0x7f84c81418f0 2024-05-30T16:48:04.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.007+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c80b2cf0 con 0x7f84c81418f0 2024-05-30T16:48:04.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.007+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c8155570 con 0x7f84c81418f0 2024-05-30T16:48:04.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.008+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c8068b90 con 0x7f84c81418f0 2024-05-30T16:48:04.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.009+0000 7f84bfe00640 1 -- 172.21.15.144:0/2339575150 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f84b0044020 con 0x7f84c81418f0 2024-05-30T16:48:04.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.010+0000 7f84bfe00640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f84a406d0d0 0x7f84a406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.010+0000 7f84bfe00640 1 -- 172.21.15.144:0/2339575150 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f84b00ad200 con 0x7f84c81418f0 2024-05-30T16:48:04.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.010+0000 7f84c7400640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f84a406d0d0 0x7f84a406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.011+0000 7f84c7400640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f84a406d0d0 0x7f84a406f590 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f84b80011e0 tx=0x7f84b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:04.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.015+0000 7f84bfe00640 1 -- 172.21.15.144:0/2339575150 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f84b007a560 con 0x7f84c81418f0 2024-05-30T16:48:04.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.213+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84c8075f70 con 0x7f84a406d0d0 2024-05-30T16:48:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.231+0000 7f84bfe00640 1 -- 172.21.15.144:0/2339575150 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251928 (secure 0 0 0) 0x7f84b8005890 con 0x7f84a406d0d0 2024-05-30T16:48:04.237 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:48:04.238 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:48:04.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f84a406d0d0 msgr2=0x7f84a406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f84a406d0d0 0x7f84a406f590 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f84b80011e0 tx=0x7f84b8009040 comp rx=0 tx=0).stop 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 msgr2=0x7f84c8160940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 0x7f84c8160940 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f84b00098c0 tx=0x7f84b00046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 shutdown_connections 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f84a406d0d0 0x7f84a406f590 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f84b80011e0 tx=0x7f84b8009040 comp rx=0 tx=0).stop 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84c8144020 0x7f84c8160e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84c81418f0 0x7f84c8160940 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 --2- 172.21.15.144:0/2339575150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c8141510 0x7f84c8155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 >> 172.21.15.144:0/2339575150 conn(0x7f84c806bd00 msgr2=0x7f84c80af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 shutdown_connections 2024-05-30T16:48:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.238+0000 7f84ce000640 1 -- 172.21.15.144:0/2339575150 wait complete. 2024-05-30T16:48:04.259 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-05-30T16:48:03.044613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":360308,"kb_used_data":6700,"kb_used_omap":12,"kb_used_meta":353459,"kb_avail":754614412,"statfs":{"total":773094113280,"available":772725157888,"internally_reserved":0,"allocated":6860800,"data_stored":3533388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":361942579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710868"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.408008+0000","last_change":"2024-05-30T16:47:59.403797+0000","last_active":"2024-05-30T16:47:59.408008+0000","last_peered":"2024-05-30T16:47:59.408008+0000","last_clean":"2024-05-30T16:47:59.408008+0000","last_became_active":"2024-05-30T16:47:59.403415+0000","last_became_peered":"2024-05-30T16:47:59.403415+0000","last_unstale":"2024-05-30T16:47:59.408008+0000","last_undegraded":"2024-05-30T16:47:59.408008+0000","last_fullsized":"2024-05-30T16:47:59.408008+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:44:30.684645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.399585+0000","last_change":"2024-05-30T16:47:59.398661+0000","last_active":"2024-05-30T16:47:59.399585+0000","last_peered":"2024-05-30T16:47:59.399585+0000","last_clean":"2024-05-30T16:47:59.399585+0000","last_became_active":"2024-05-30T16:47:59.398253+0000","last_became_peered":"2024-05-30T16:47:59.398253+0000","last_unstale":"2024-05-30T16:47:59.399585+0000","last_undegraded":"2024-05-30T16:47:59.399585+0000","last_fullsized":"2024-05-30T16:47:59.399585+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:44.227925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403471+0000","last_change":"2024-05-30T16:47:59.383945+0000","last_active":"2024-05-30T16:48:00.403471+0000","last_peered":"2024-05-30T16:48:00.403471+0000","last_clean":"2024-05-30T16:48:00.403471+0000","last_became_active":"2024-05-30T16:47:59.383563+0000","last_became_peered":"2024-05-30T16:47:59.383563+0000","last_unstale":"2024-05-30T16:48:00.403471+0000","last_undegraded":"2024-05-30T16:48:00.403471+0000","last_fullsized":"2024-05-30T16:48:00.403471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:32.401290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973766+0000","last_change":"2024-05-30T16:47:59.394271+0000","last_active":"2024-05-30T16:48:00.973766+0000","last_peered":"2024-05-30T16:48:00.973766+0000","last_clean":"2024-05-30T16:48:00.973766+0000","last_became_active":"2024-05-30T16:47:59.393517+0000","last_became_peered":"2024-05-30T16:47:59.393517+0000","last_unstale":"2024-05-30T16:48:00.973766+0000","last_undegraded":"2024-05-30T16:48:00.973766+0000","last_fullsized":"2024-05-30T16:48:00.973766+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:51:15.317500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.405194+0000","last_change":"2024-05-30T16:47:59.400381+0000","last_active":"2024-05-30T16:47:59.405194+0000","last_peered":"2024-05-30T16:47:59.405194+0000","last_clean":"2024-05-30T16:47:59.405194+0000","last_became_active":"2024-05-30T16:47:59.395986+0000","last_became_peered":"2024-05-30T16:47:59.395986+0000","last_unstale":"2024-05-30T16:47:59.405194+0000","last_undegraded":"2024-05-30T16:47:59.405194+0000","last_fullsized":"2024-05-30T16:47:59.405194+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:49.177393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403165+0000","last_change":"2024-05-30T16:47:59.384437+0000","last_active":"2024-05-30T16:48:00.403165+0000","last_peered":"2024-05-30T16:48:00.403165+0000","last_clean":"2024-05-30T16:48:00.403165+0000","last_became_active":"2024-05-30T16:47:59.384039+0000","last_became_peered":"2024-05-30T16:47:59.384039+0000","last_unstale":"2024-05-30T16:48:00.403165+0000","last_undegraded":"2024-05-30T16:48:00.403165+0000","last_fullsized":"2024-05-30T16:48:00.403165+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:44.696058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399051+0000","last_change":"2024-05-30T16:47:59.394822+0000","last_active":"2024-05-30T16:48:00.399051+0000","last_peered":"2024-05-30T16:48:00.399051+0000","last_clean":"2024-05-30T16:48:00.399051+0000","last_became_active":"2024-05-30T16:47:59.394110+0000","last_became_peered":"2024-05-30T16:47:59.394110+0000","last_unstale":"2024-05-30T16:48:00.399051+0000","last_undegraded":"2024-05-30T16:48:00.399051+0000","last_fullsized":"2024-05-30T16:48:00.399051+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:34.547846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.399589+0000","last_change":"2024-05-30T16:47:59.391694+0000","last_active":"2024-05-30T16:47:59.399589+0000","last_peered":"2024-05-30T16:47:59.399589+0000","last_clean":"2024-05-30T16:47:59.399589+0000","last_became_active":"2024-05-30T16:47:59.391026+0000","last_became_peered":"2024-05-30T16:47:59.391026+0000","last_unstale":"2024-05-30T16:47:59.399589+0000","last_undegraded":"2024-05-30T16:47:59.399589+0000","last_fullsized":"2024-05-30T16:47:59.399589+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:38:38.804657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399356+0000","last_change":"2024-05-30T16:47:59.387202+0000","last_active":"2024-05-30T16:48:00.399356+0000","last_peered":"2024-05-30T16:48:00.399356+0000","last_clean":"2024-05-30T16:48:00.399356+0000","last_became_active":"2024-05-30T16:47:59.386863+0000","last_became_peered":"2024-05-30T16:47:59.386863+0000","last_unstale":"2024-05-30T16:48:00.399356+0000","last_undegraded":"2024-05-30T16:48:00.399356+0000","last_fullsized":"2024-05-30T16:48:00.399356+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:21:21.749576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.402047+0000","last_change":"2024-05-30T16:47:59.390787+0000","last_active":"2024-05-30T16:47:59.402047+0000","last_peered":"2024-05-30T16:47:59.402047+0000","last_clean":"2024-05-30T16:47:59.402047+0000","last_became_active":"2024-05-30T16:47:59.390495+0000","last_became_peered":"2024-05-30T16:47:59.390495+0000","last_unstale":"2024-05-30T16:47:59.402047+0000","last_undegraded":"2024-05-30T16:47:59.402047+0000","last_fullsized":"2024-05-30T16:47:59.402047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:20:20.159418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.407407+0000","last_change":"2024-05-30T16:47:59.402732+0000","last_active":"2024-05-30T16:47:59.407407+0000","last_peered":"2024-05-30T16:47:59.407407+0000","last_clean":"2024-05-30T16:47:59.407407+0000","last_became_active":"2024-05-30T16:47:59.402363+0000","last_became_peered":"2024-05-30T16:47:59.402363+0000","last_unstale":"2024-05-30T16:47:59.407407+0000","last_undegraded":"2024-05-30T16:47:59.407407+0000","last_fullsized":"2024-05-30T16:47:59.407407+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:25:36.475680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974104+0000","last_change":"2024-05-30T16:47:59.395027+0000","last_active":"2024-05-30T16:48:00.974104+0000","last_peered":"2024-05-30T16:48:00.974104+0000","last_clean":"2024-05-30T16:48:00.974104+0000","last_became_active":"2024-05-30T16:47:59.394740+0000","last_became_peered":"2024-05-30T16:47:59.394740+0000","last_unstale":"2024-05-30T16:48:00.974104+0000","last_undegraded":"2024-05-30T16:48:00.974104+0000","last_fullsized":"2024-05-30T16:48:00.974104+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:05:18.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403041+0000","last_change":"2024-05-30T16:47:59.398075+0000","last_active":"2024-05-30T16:48:00.403041+0000","last_peered":"2024-05-30T16:48:00.403041+0000","last_clean":"2024-05-30T16:48:00.403041+0000","last_became_active":"2024-05-30T16:47:59.397770+0000","last_became_peered":"2024-05-30T16:47:59.397770+0000","last_unstale":"2024-05-30T16:48:00.403041+0000","last_undegraded":"2024-05-30T16:48:00.403041+0000","last_fullsized":"2024-05-30T16:48:00.403041+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:13.639125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400408+0000","last_change":"2024-05-30T16:47:59.383394+0000","last_active":"2024-05-30T16:48:00.400408+0000","last_peered":"2024-05-30T16:48:00.400408+0000","last_clean":"2024-05-30T16:48:00.400408+0000","last_became_active":"2024-05-30T16:47:59.382886+0000","last_became_peered":"2024-05-30T16:47:59.382886+0000","last_unstale":"2024-05-30T16:48:00.400408+0000","last_undegraded":"2024-05-30T16:48:00.400408+0000","last_fullsized":"2024-05-30T16:48:00.400408+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:42:16.783829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399472+0000","last_change":"2024-05-30T16:47:59.391866+0000","last_active":"2024-05-30T16:48:00.399472+0000","last_peered":"2024-05-30T16:48:00.399472+0000","last_clean":"2024-05-30T16:48:00.399472+0000","last_became_active":"2024-05-30T16:47:59.391555+0000","last_became_peered":"2024-05-30T16:47:59.391555+0000","last_unstale":"2024-05-30T16:48:00.399472+0000","last_undegraded":"2024-05-30T16:48:00.399472+0000","last_fullsized":"2024-05-30T16:48:00.399472+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:57:27.388588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403321+0000","last_change":"2024-05-30T16:47:59.387891+0000","last_active":"2024-05-30T16:48:00.403321+0000","last_peered":"2024-05-30T16:48:00.403321+0000","last_clean":"2024-05-30T16:48:00.403321+0000","last_became_active":"2024-05-30T16:47:59.387612+0000","last_became_peered":"2024-05-30T16:47:59.387612+0000","last_unstale":"2024-05-30T16:48:00.403321+0000","last_undegraded":"2024-05-30T16:48:00.403321+0000","last_fullsized":"2024-05-30T16:48:00.403321+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:51:15.317500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.407784+0000","last_change":"2024-05-30T16:47:59.401312+0000","last_active":"2024-05-30T16:47:59.407784+0000","last_peered":"2024-05-30T16:47:59.407784+0000","last_clean":"2024-05-30T16:47:59.407784+0000","last_became_active":"2024-05-30T16:47:59.400988+0000","last_became_peered":"2024-05-30T16:47:59.400988+0000","last_unstale":"2024-05-30T16:47:59.407784+0000","last_undegraded":"2024-05-30T16:47:59.407784+0000","last_fullsized":"2024-05-30T16:47:59.407784+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:13.948859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402781+0000","last_change":"2024-05-30T16:47:59.387878+0000","last_active":"2024-05-30T16:48:00.402781+0000","last_peered":"2024-05-30T16:48:00.402781+0000","last_clean":"2024-05-30T16:48:00.402781+0000","last_became_active":"2024-05-30T16:47:59.387625+0000","last_became_peered":"2024-05-30T16:47:59.387625+0000","last_unstale":"2024-05-30T16:48:00.402781+0000","last_undegraded":"2024-05-30T16:48:00.402781+0000","last_fullsized":"2024-05-30T16:48:00.402781+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:42:37.732411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.410573+0000","last_change":"2024-05-30T16:47:59.404031+0000","last_active":"2024-05-30T16:47:59.410573+0000","last_peered":"2024-05-30T16:47:59.410573+0000","last_clean":"2024-05-30T16:47:59.410573+0000","last_became_active":"2024-05-30T16:47:59.403439+0000","last_became_peered":"2024-05-30T16:47:59.403439+0000","last_unstale":"2024-05-30T16:47:59.410573+0000","last_undegraded":"2024-05-30T16:47:59.410573+0000","last_fullsized":"2024-05-30T16:47:59.410573+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:05:03.420497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.412035+0000","last_change":"2024-05-30T16:47:59.405683+0000","last_active":"2024-05-30T16:47:59.412035+0000","last_peered":"2024-05-30T16:47:59.412035+0000","last_clean":"2024-05-30T16:47:59.412035+0000","last_became_active":"2024-05-30T16:47:59.405265+0000","last_became_peered":"2024-05-30T16:47:59.405265+0000","last_unstale":"2024-05-30T16:47:59.412035+0000","last_undegraded":"2024-05-30T16:47:59.412035+0000","last_fullsized":"2024-05-30T16:47:59.412035+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:54.636109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403937+0000","last_change":"2024-05-30T16:47:59.396706+0000","last_active":"2024-05-30T16:48:00.403937+0000","last_peered":"2024-05-30T16:48:00.403937+0000","last_clean":"2024-05-30T16:48:00.403937+0000","last_became_active":"2024-05-30T16:47:59.396310+0000","last_became_peered":"2024-05-30T16:47:59.396310+0000","last_unstale":"2024-05-30T16:48:00.403937+0000","last_undegraded":"2024-05-30T16:48:00.403937+0000","last_fullsized":"2024-05-30T16:48:00.403937+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:55:25.030553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.399970+0000","last_change":"2024-05-30T16:47:59.389671+0000","last_active":"2024-05-30T16:47:59.399970+0000","last_peered":"2024-05-30T16:47:59.399970+0000","last_clean":"2024-05-30T16:47:59.399970+0000","last_became_active":"2024-05-30T16:47:59.389351+0000","last_became_peered":"2024-05-30T16:47:59.389351+0000","last_unstale":"2024-05-30T16:47:59.399970+0000","last_undegraded":"2024-05-30T16:47:59.399970+0000","last_fullsized":"2024-05-30T16:47:59.399970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:12:16.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402610+0000","last_change":"2024-05-30T16:47:59.402306+0000","last_active":"2024-05-30T16:48:00.402610+0000","last_peered":"2024-05-30T16:48:00.402610+0000","last_clean":"2024-05-30T16:48:00.402610+0000","last_became_active":"2024-05-30T16:47:59.402122+0000","last_became_peered":"2024-05-30T16:47:59.402122+0000","last_unstale":"2024-05-30T16:48:00.402610+0000","last_undegraded":"2024-05-30T16:48:00.402610+0000","last_fullsized":"2024-05-30T16:48:00.402610+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:44.227925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.401627+0000","last_change":"2024-05-30T16:47:59.391686+0000","last_active":"2024-05-30T16:48:00.401627+0000","last_peered":"2024-05-30T16:48:00.401627+0000","last_clean":"2024-05-30T16:48:00.401627+0000","last_became_active":"2024-05-30T16:47:59.391093+0000","last_became_peered":"2024-05-30T16:47:59.391093+0000","last_unstale":"2024-05-30T16:48:00.401627+0000","last_undegraded":"2024-05-30T16:48:00.401627+0000","last_fullsized":"2024-05-30T16:48:00.401627+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:42:38.071803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.401145+0000","last_change":"2024-05-30T16:47:59.396140+0000","last_active":"2024-05-30T16:47:59.401145+0000","last_peered":"2024-05-30T16:47:59.401145+0000","last_clean":"2024-05-30T16:47:59.401145+0000","last_became_active":"2024-05-30T16:47:59.395237+0000","last_became_peered":"2024-05-30T16:47:59.395237+0000","last_unstale":"2024-05-30T16:47:59.401145+0000","last_undegraded":"2024-05-30T16:47:59.401145+0000","last_fullsized":"2024-05-30T16:47:59.401145+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:46:02.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974468+0000","last_change":"2024-05-30T16:47:59.391916+0000","last_active":"2024-05-30T16:48:00.974468+0000","last_peered":"2024-05-30T16:48:00.974468+0000","last_clean":"2024-05-30T16:48:00.974468+0000","last_became_active":"2024-05-30T16:47:59.391396+0000","last_became_peered":"2024-05-30T16:47:59.391396+0000","last_unstale":"2024-05-30T16:48:00.974468+0000","last_undegraded":"2024-05-30T16:48:00.974468+0000","last_fullsized":"2024-05-30T16:48:00.974468+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:17:36.818656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403533+0000","last_change":"2024-05-30T16:47:59.387871+0000","last_active":"2024-05-30T16:48:00.403533+0000","last_peered":"2024-05-30T16:48:00.403533+0000","last_clean":"2024-05-30T16:48:00.403533+0000","last_became_active":"2024-05-30T16:47:59.387574+0000","last_became_peered":"2024-05-30T16:47:59.387574+0000","last_unstale":"2024-05-30T16:48:00.403533+0000","last_undegraded":"2024-05-30T16:48:00.403533+0000","last_fullsized":"2024-05-30T16:48:00.403533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:05:18.971707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.405147+0000","last_change":"2024-05-30T16:47:59.399956+0000","last_active":"2024-05-30T16:47:59.405147+0000","last_peered":"2024-05-30T16:47:59.405147+0000","last_clean":"2024-05-30T16:47:59.405147+0000","last_became_active":"2024-05-30T16:47:59.397525+0000","last_became_peered":"2024-05-30T16:47:59.397525+0000","last_unstale":"2024-05-30T16:47:59.405147+0000","last_undegraded":"2024-05-30T16:47:59.405147+0000","last_fullsized":"2024-05-30T16:47:59.405147+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:29:34.053930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.407721+0000","last_change":"2024-05-30T16:47:59.400699+0000","last_active":"2024-05-30T16:47:59.407721+0000","last_peered":"2024-05-30T16:47:59.407721+0000","last_clean":"2024-05-30T16:47:59.407721+0000","last_became_active":"2024-05-30T16:47:59.399642+0000","last_became_peered":"2024-05-30T16:47:59.399642+0000","last_unstale":"2024-05-30T16:47:59.407721+0000","last_undegraded":"2024-05-30T16:47:59.407721+0000","last_fullsized":"2024-05-30T16:47:59.407721+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:11:17.857778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403770+0000","last_change":"2024-05-30T16:47:59.384790+0000","last_active":"2024-05-30T16:48:00.403770+0000","last_peered":"2024-05-30T16:48:00.403770+0000","last_clean":"2024-05-30T16:48:00.403770+0000","last_became_active":"2024-05-30T16:47:59.384414+0000","last_became_peered":"2024-05-30T16:47:59.384414+0000","last_unstale":"2024-05-30T16:48:00.403770+0000","last_undegraded":"2024-05-30T16:48:00.403770+0000","last_fullsized":"2024-05-30T16:48:00.403770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:44:47.381594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.393606+0000","last_change":"2024-05-30T16:47:59.389203+0000","last_active":"2024-05-30T16:47:59.393606+0000","last_peered":"2024-05-30T16:47:59.393606+0000","last_clean":"2024-05-30T16:47:59.393606+0000","last_became_active":"2024-05-30T16:47:59.388844+0000","last_became_peered":"2024-05-30T16:47:59.388844+0000","last_unstale":"2024-05-30T16:47:59.393606+0000","last_undegraded":"2024-05-30T16:47:59.393606+0000","last_fullsized":"2024-05-30T16:47:59.393606+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:03.972639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403154+0000","last_change":"2024-05-30T16:47:59.394090+0000","last_active":"2024-05-30T16:48:00.403154+0000","last_peered":"2024-05-30T16:48:00.403154+0000","last_clean":"2024-05-30T16:48:00.403154+0000","last_became_active":"2024-05-30T16:47:59.393149+0000","last_became_peered":"2024-05-30T16:47:59.393149+0000","last_unstale":"2024-05-30T16:48:00.403154+0000","last_undegraded":"2024-05-30T16:48:00.403154+0000","last_fullsized":"2024-05-30T16:48:00.403154+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:44:03.238598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403703+0000","last_change":"2024-05-30T16:47:59.394331+0000","last_active":"2024-05-30T16:48:00.403703+0000","last_peered":"2024-05-30T16:48:00.403703+0000","last_clean":"2024-05-30T16:48:00.403703+0000","last_became_active":"2024-05-30T16:47:59.394031+0000","last_became_peered":"2024-05-30T16:47:59.394031+0000","last_unstale":"2024-05-30T16:48:00.403703+0000","last_undegraded":"2024-05-30T16:48:00.403703+0000","last_fullsized":"2024-05-30T16:48:00.403703+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:17:36.818656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403776+0000","last_change":"2024-05-30T16:47:58.379426+0000","last_active":"2024-05-30T16:48:00.403776+0000","last_peered":"2024-05-30T16:48:00.403776+0000","last_clean":"2024-05-30T16:48:00.403776+0000","last_became_active":"2024-05-30T16:47:58.379082+0000","last_became_peered":"2024-05-30T16:47:58.379082+0000","last_unstale":"2024-05-30T16:48:00.403776+0000","last_undegraded":"2024-05-30T16:48:00.403776+0000","last_fullsized":"2024-05-30T16:48:00.403776+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:21:20.734478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.405003+0000","last_change":"2024-05-30T16:47:59.399645+0000","last_active":"2024-05-30T16:47:59.405003+0000","last_peered":"2024-05-30T16:47:59.405003+0000","last_clean":"2024-05-30T16:47:59.405003+0000","last_became_active":"2024-05-30T16:47:59.398640+0000","last_became_peered":"2024-05-30T16:47:59.398640+0000","last_unstale":"2024-05-30T16:47:59.405003+0000","last_undegraded":"2024-05-30T16:47:59.405003+0000","last_fullsized":"2024-05-30T16:47:59.405003+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:32:25.170389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.416008+0000","last_change":"2024-05-30T16:47:58.375240+0000","last_active":"2024-05-30T16:47:59.416008+0000","last_peered":"2024-05-30T16:47:59.416008+0000","last_clean":"2024-05-30T16:47:59.416008+0000","last_became_active":"2024-05-30T16:47:58.374943+0000","last_became_peered":"2024-05-30T16:47:58.374943+0000","last_unstale":"2024-05-30T16:47:59.416008+0000","last_undegraded":"2024-05-30T16:47:59.416008+0000","last_fullsized":"2024-05-30T16:47:59.416008+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:17:35.803558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403685+0000","last_change":"2024-05-30T16:47:59.390443+0000","last_active":"2024-05-30T16:48:00.403685+0000","last_peered":"2024-05-30T16:48:00.403685+0000","last_clean":"2024-05-30T16:48:00.403685+0000","last_became_active":"2024-05-30T16:47:59.389593+0000","last_became_peered":"2024-05-30T16:47:59.389593+0000","last_unstale":"2024-05-30T16:48:00.403685+0000","last_undegraded":"2024-05-30T16:48:00.403685+0000","last_fullsized":"2024-05-30T16:48:00.403685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:33.230592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.404143+0000","last_change":"2024-05-30T16:47:58.362630+0000","last_active":"2024-05-30T16:48:00.404143+0000","last_peered":"2024-05-30T16:48:00.404143+0000","last_clean":"2024-05-30T16:48:00.404143+0000","last_became_active":"2024-05-30T16:47:58.362360+0000","last_became_peered":"2024-05-30T16:47:58.362360+0000","last_unstale":"2024-05-30T16:48:00.404143+0000","last_undegraded":"2024-05-30T16:48:00.404143+0000","last_fullsized":"2024-05-30T16:48:00.404143+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:57:26.373490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403824+0000","last_change":"2024-05-30T16:47:59.399125+0000","last_active":"2024-05-30T16:48:00.403824+0000","last_peered":"2024-05-30T16:48:00.403824+0000","last_clean":"2024-05-30T16:48:00.403824+0000","last_became_active":"2024-05-30T16:47:59.397193+0000","last_became_peered":"2024-05-30T16:47:59.397193+0000","last_unstale":"2024-05-30T16:48:00.403824+0000","last_undegraded":"2024-05-30T16:48:00.403824+0000","last_fullsized":"2024-05-30T16:48:00.403824+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:44.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974096+0000","last_change":"2024-05-30T16:47:58.381230+0000","last_active":"2024-05-30T16:48:00.974096+0000","last_peered":"2024-05-30T16:48:00.974096+0000","last_clean":"2024-05-30T16:48:00.974096+0000","last_became_active":"2024-05-30T16:47:58.378973+0000","last_became_peered":"2024-05-30T16:47:58.378973+0000","last_unstale":"2024-05-30T16:48:00.974096+0000","last_undegraded":"2024-05-30T16:48:00.974096+0000","last_fullsized":"2024-05-30T16:48:00.974096+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:48.991020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.412921+0000","last_change":"2024-05-30T16:47:59.408444+0000","last_active":"2024-05-30T16:47:59.412921+0000","last_peered":"2024-05-30T16:47:59.412921+0000","last_clean":"2024-05-30T16:47:59.412921+0000","last_became_active":"2024-05-30T16:47:59.405515+0000","last_became_peered":"2024-05-30T16:47:59.405515+0000","last_unstale":"2024-05-30T16:47:59.412921+0000","last_undegraded":"2024-05-30T16:47:59.412921+0000","last_fullsized":"2024-05-30T16:47:59.412921+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:46.310829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399689+0000","last_change":"2024-05-30T16:47:58.370781+0000","last_active":"2024-05-30T16:48:00.399689+0000","last_peered":"2024-05-30T16:48:00.399689+0000","last_clean":"2024-05-30T16:48:00.399689+0000","last_became_active":"2024-05-30T16:47:58.370505+0000","last_became_peered":"2024-05-30T16:47:58.370505+0000","last_unstale":"2024-05-30T16:48:00.399689+0000","last_undegraded":"2024-05-30T16:48:00.399689+0000","last_fullsized":"2024-05-30T16:48:00.399689+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:00:47.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.413994+0000","last_change":"2024-05-30T16:47:59.406065+0000","last_active":"2024-05-30T16:47:59.413994+0000","last_peered":"2024-05-30T16:47:59.413994+0000","last_clean":"2024-05-30T16:47:59.413994+0000","last_became_active":"2024-05-30T16:47:59.405699+0000","last_became_peered":"2024-05-30T16:47:59.405699+0000","last_unstale":"2024-05-30T16:47:59.413994+0000","last_undegraded":"2024-05-30T16:47:59.413994+0000","last_fullsized":"2024-05-30T16:47:59.413994+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:46.914948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403239+0000","last_change":"2024-05-30T16:47:58.368111+0000","last_active":"2024-05-30T16:48:00.403239+0000","last_peered":"2024-05-30T16:48:00.403239+0000","last_clean":"2024-05-30T16:48:00.403239+0000","last_became_active":"2024-05-30T16:47:58.366724+0000","last_became_peered":"2024-05-30T16:47:58.366724+0000","last_unstale":"2024-05-30T16:48:00.403239+0000","last_undegraded":"2024-05-30T16:48:00.403239+0000","last_fullsized":"2024-05-30T16:48:00.403239+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:33.532748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402094+0000","last_change":"2024-05-30T16:47:59.392951+0000","last_active":"2024-05-30T16:48:00.402094+0000","last_peered":"2024-05-30T16:48:00.402094+0000","last_clean":"2024-05-30T16:48:00.402094+0000","last_became_active":"2024-05-30T16:47:59.392690+0000","last_became_peered":"2024-05-30T16:47:59.392690+0000","last_unstale":"2024-05-30T16:48:00.402094+0000","last_undegraded":"2024-05-30T16:48:00.402094+0000","last_fullsized":"2024-05-30T16:48:00.402094+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:51:14.166642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973459+0000","last_change":"2024-05-30T16:47:58.380872+0000","last_active":"2024-05-30T16:48:00.973459+0000","last_peered":"2024-05-30T16:48:00.973459+0000","last_clean":"2024-05-30T16:48:00.973459+0000","last_became_active":"2024-05-30T16:47:58.378547+0000","last_became_peered":"2024-05-30T16:47:58.378547+0000","last_unstale":"2024-05-30T16:48:00.973459+0000","last_undegraded":"2024-05-30T16:48:00.973459+0000","last_fullsized":"2024-05-30T16:48:00.973459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:21:20.734478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.408739+0000","last_change":"2024-05-30T16:47:59.399244+0000","last_active":"2024-05-30T16:47:59.408739+0000","last_peered":"2024-05-30T16:47:59.408739+0000","last_clean":"2024-05-30T16:47:59.408739+0000","last_became_active":"2024-05-30T16:47:59.398950+0000","last_became_peered":"2024-05-30T16:47:59.398950+0000","last_unstale":"2024-05-30T16:47:59.408739+0000","last_undegraded":"2024-05-30T16:47:59.408739+0000","last_fullsized":"2024-05-30T16:47:59.408739+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:42:37.732411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399657+0000","last_change":"2024-05-30T16:47:58.372694+0000","last_active":"2024-05-30T16:48:00.399657+0000","last_peered":"2024-05-30T16:48:00.399657+0000","last_clean":"2024-05-30T16:48:00.399657+0000","last_became_active":"2024-05-30T16:47:58.372268+0000","last_became_peered":"2024-05-30T16:47:58.372268+0000","last_unstale":"2024-05-30T16:48:00.399657+0000","last_undegraded":"2024-05-30T16:48:00.399657+0000","last_fullsized":"2024-05-30T16:48:00.399657+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:25:31.967585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400892+0000","last_change":"2024-05-30T16:47:59.394260+0000","last_active":"2024-05-30T16:48:00.400892+0000","last_peered":"2024-05-30T16:48:00.400892+0000","last_clean":"2024-05-30T16:48:00.400892+0000","last_became_active":"2024-05-30T16:47:59.392880+0000","last_became_peered":"2024-05-30T16:47:59.392880+0000","last_unstale":"2024-05-30T16:48:00.400892+0000","last_undegraded":"2024-05-30T16:48:00.400892+0000","last_fullsized":"2024-05-30T16:48:00.400892+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:50.006118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402922+0000","last_change":"2024-05-30T16:47:58.373624+0000","last_active":"2024-05-30T16:48:00.402922+0000","last_peered":"2024-05-30T16:48:00.402922+0000","last_clean":"2024-05-30T16:48:00.402922+0000","last_became_active":"2024-05-30T16:47:58.373250+0000","last_became_peered":"2024-05-30T16:47:58.373250+0000","last_unstale":"2024-05-30T16:48:00.402922+0000","last_undegraded":"2024-05-30T16:48:00.402922+0000","last_fullsized":"2024-05-30T16:48:00.402922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:35:15.046552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403016+0000","last_change":"2024-05-30T16:47:59.396583+0000","last_active":"2024-05-30T16:48:00.403016+0000","last_peered":"2024-05-30T16:48:00.403016+0000","last_clean":"2024-05-30T16:48:00.403016+0000","last_became_active":"2024-05-30T16:47:59.396025+0000","last_became_peered":"2024-05-30T16:47:59.396025+0000","last_unstale":"2024-05-30T16:48:00.403016+0000","last_undegraded":"2024-05-30T16:48:00.403016+0000","last_fullsized":"2024-05-30T16:48:00.403016+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:11:17.857778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.387184+0000","last_change":"2024-05-30T16:47:58.375356+0000","last_active":"2024-05-30T16:47:59.387184+0000","last_peered":"2024-05-30T16:47:59.387184+0000","last_clean":"2024-05-30T16:47:59.387184+0000","last_became_active":"2024-05-30T16:47:58.375006+0000","last_became_peered":"2024-05-30T16:47:58.375006+0000","last_unstale":"2024-05-30T16:47:59.387184+0000","last_undegraded":"2024-05-30T16:47:59.387184+0000","last_fullsized":"2024-05-30T16:47:59.387184+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:43.078233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.402856+0000","last_change":"2024-05-30T16:47:59.391827+0000","last_active":"2024-05-30T16:47:59.402856+0000","last_peered":"2024-05-30T16:47:59.402856+0000","last_clean":"2024-05-30T16:47:59.402856+0000","last_became_active":"2024-05-30T16:47:59.391135+0000","last_became_peered":"2024-05-30T16:47:59.391135+0000","last_unstale":"2024-05-30T16:47:59.402856+0000","last_undegraded":"2024-05-30T16:47:59.402856+0000","last_fullsized":"2024-05-30T16:47:59.402856+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:32:20.528161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403727+0000","last_change":"2024-05-30T16:47:58.374791+0000","last_active":"2024-05-30T16:48:00.403727+0000","last_peered":"2024-05-30T16:48:00.403727+0000","last_clean":"2024-05-30T16:48:00.403727+0000","last_became_active":"2024-05-30T16:47:58.373701+0000","last_became_peered":"2024-05-30T16:47:58.373701+0000","last_unstale":"2024-05-30T16:48:00.403727+0000","last_undegraded":"2024-05-30T16:48:00.403727+0000","last_fullsized":"2024-05-30T16:48:00.403727+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:33:00.082379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403390+0000","last_change":"2024-05-30T16:47:59.397440+0000","last_active":"2024-05-30T16:48:00.403390+0000","last_peered":"2024-05-30T16:48:00.403390+0000","last_clean":"2024-05-30T16:48:00.403390+0000","last_became_active":"2024-05-30T16:47:59.397109+0000","last_became_peered":"2024-05-30T16:47:59.397109+0000","last_unstale":"2024-05-30T16:48:00.403390+0000","last_undegraded":"2024-05-30T16:48:00.403390+0000","last_fullsized":"2024-05-30T16:48:00.403390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:54.636109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400603+0000","last_change":"2024-05-30T16:47:58.372138+0000","last_active":"2024-05-30T16:48:00.400603+0000","last_peered":"2024-05-30T16:48:00.400603+0000","last_clean":"2024-05-30T16:48:00.400603+0000","last_became_active":"2024-05-30T16:47:58.371823+0000","last_became_peered":"2024-05-30T16:47:58.371823+0000","last_unstale":"2024-05-30T16:48:00.400603+0000","last_undegraded":"2024-05-30T16:48:00.400603+0000","last_fullsized":"2024-05-30T16:48:00.400603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:42:37.056704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973623+0000","last_change":"2024-05-30T16:47:59.405335+0000","last_active":"2024-05-30T16:48:00.973623+0000","last_peered":"2024-05-30T16:48:00.973623+0000","last_clean":"2024-05-30T16:48:00.973623+0000","last_became_active":"2024-05-30T16:47:59.405097+0000","last_became_peered":"2024-05-30T16:47:59.405097+0000","last_unstale":"2024-05-30T16:48:00.973623+0000","last_undegraded":"2024-05-30T16:48:00.973623+0000","last_fullsized":"2024-05-30T16:48:00.973623+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:44.696058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.420948+0000","last_change":"2024-05-30T16:47:58.374745+0000","last_active":"2024-05-30T16:47:59.420948+0000","last_peered":"2024-05-30T16:47:59.420948+0000","last_clean":"2024-05-30T16:47:59.420948+0000","last_became_active":"2024-05-30T16:47:58.374442+0000","last_became_peered":"2024-05-30T16:47:58.374442+0000","last_unstale":"2024-05-30T16:47:59.420948+0000","last_undegraded":"2024-05-30T16:47:59.420948+0000","last_fullsized":"2024-05-30T16:47:59.420948+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:05:17.956609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402297+0000","last_change":"2024-05-30T16:47:59.390131+0000","last_active":"2024-05-30T16:48:00.402297+0000","last_peered":"2024-05-30T16:48:00.402297+0000","last_clean":"2024-05-30T16:48:00.402297+0000","last_became_active":"2024-05-30T16:47:59.389257+0000","last_became_peered":"2024-05-30T16:47:59.389257+0000","last_unstale":"2024-05-30T16:48:00.402297+0000","last_undegraded":"2024-05-30T16:48:00.402297+0000","last_fullsized":"2024-05-30T16:48:00.402297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:40.779106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.399189+0000","last_change":"2024-05-30T16:47:58.371849+0000","last_active":"2024-05-30T16:48:00.399189+0000","last_peered":"2024-05-30T16:48:00.399189+0000","last_clean":"2024-05-30T16:48:00.399189+0000","last_became_active":"2024-05-30T16:47:58.371439+0000","last_became_peered":"2024-05-30T16:47:58.371439+0000","last_unstale":"2024-05-30T16:48:00.399189+0000","last_undegraded":"2024-05-30T16:48:00.399189+0000","last_fullsized":"2024-05-30T16:48:00.399189+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:22:31.591949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.398879+0000","last_change":"2024-05-30T16:47:59.387412+0000","last_active":"2024-05-30T16:48:00.398879+0000","last_peered":"2024-05-30T16:48:00.398879+0000","last_clean":"2024-05-30T16:48:00.398879+0000","last_became_active":"2024-05-30T16:47:59.387087+0000","last_became_peered":"2024-05-30T16:47:59.387087+0000","last_unstale":"2024-05-30T16:48:00.398879+0000","last_undegraded":"2024-05-30T16:48:00.398879+0000","last_fullsized":"2024-05-30T16:48:00.398879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:06:31.961231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973532+0000","last_change":"2024-05-30T16:47:58.374840+0000","last_active":"2024-05-30T16:48:00.973532+0000","last_peered":"2024-05-30T16:48:00.973532+0000","last_clean":"2024-05-30T16:48:00.973532+0000","last_became_active":"2024-05-30T16:47:58.374553+0000","last_became_peered":"2024-05-30T16:47:58.374553+0000","last_unstale":"2024-05-30T16:48:00.973532+0000","last_undegraded":"2024-05-30T16:48:00.973532+0000","last_fullsized":"2024-05-30T16:48:00.973532+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:42:15.768731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.402826+0000","last_change":"2024-05-30T16:47:59.402416+0000","last_active":"2024-05-30T16:48:00.402826+0000","last_peered":"2024-05-30T16:48:00.402826+0000","last_clean":"2024-05-30T16:48:00.402826+0000","last_became_active":"2024-05-30T16:47:59.402182+0000","last_became_peered":"2024-05-30T16:47:59.402182+0000","last_unstale":"2024-05-30T16:48:00.402826+0000","last_undegraded":"2024-05-30T16:48:00.402826+0000","last_fullsized":"2024-05-30T16:48:00.402826+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:31.217931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400988+0000","last_change":"2024-05-30T16:47:58.379529+0000","last_active":"2024-05-30T16:48:00.400988+0000","last_peered":"2024-05-30T16:48:00.400988+0000","last_clean":"2024-05-30T16:48:00.400988+0000","last_became_active":"2024-05-30T16:47:58.379159+0000","last_became_peered":"2024-05-30T16:47:58.379159+0000","last_unstale":"2024-05-30T16:48:00.400988+0000","last_undegraded":"2024-05-30T16:48:00.400988+0000","last_fullsized":"2024-05-30T16:48:00.400988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:28:46.449937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403134+0000","last_change":"2024-05-30T16:47:59.384305+0000","last_active":"2024-05-30T16:48:00.403134+0000","last_peered":"2024-05-30T16:48:00.403134+0000","last_clean":"2024-05-30T16:48:00.403134+0000","last_became_active":"2024-05-30T16:47:59.383857+0000","last_became_peered":"2024-05-30T16:47:59.383857+0000","last_unstale":"2024-05-30T16:48:00.403134+0000","last_undegraded":"2024-05-30T16:48:00.403134+0000","last_fullsized":"2024-05-30T16:48:00.403134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:01:13.948859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.418751+0000","last_change":"2024-05-30T16:47:58.371989+0000","last_active":"2024-05-30T16:47:59.418751+0000","last_peered":"2024-05-30T16:47:59.418751+0000","last_clean":"2024-05-30T16:47:59.418751+0000","last_became_active":"2024-05-30T16:47:58.371663+0000","last_became_peered":"2024-05-30T16:47:58.371663+0000","last_unstale":"2024-05-30T16:47:59.418751+0000","last_undegraded":"2024-05-30T16:47:59.418751+0000","last_fullsized":"2024-05-30T16:47:59.418751+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:22.481811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974548+0000","last_change":"2024-05-30T16:47:59.404070+0000","last_active":"2024-05-30T16:48:00.974548+0000","last_peered":"2024-05-30T16:48:00.974548+0000","last_clean":"2024-05-30T16:48:00.974548+0000","last_became_active":"2024-05-30T16:47:59.403741+0000","last_became_peered":"2024-05-30T16:47:59.403741+0000","last_unstale":"2024-05-30T16:48:00.974548+0000","last_undegraded":"2024-05-30T16:48:00.974548+0000","last_fullsized":"2024-05-30T16:48:00.974548+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:23.496909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403718+0000","last_change":"2024-05-30T16:47:58.370885+0000","last_active":"2024-05-30T16:48:00.403718+0000","last_peered":"2024-05-30T16:48:00.403718+0000","last_clean":"2024-05-30T16:48:00.403718+0000","last_became_active":"2024-05-30T16:47:58.370624+0000","last_became_peered":"2024-05-30T16:47:58.370624+0000","last_unstale":"2024-05-30T16:48:00.403718+0000","last_undegraded":"2024-05-30T16:48:00.403718+0000","last_fullsized":"2024-05-30T16:48:00.403718+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:10:47.755146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.400482+0000","last_change":"2024-05-30T16:47:59.393959+0000","last_active":"2024-05-30T16:47:59.400482+0000","last_peered":"2024-05-30T16:47:59.400482+0000","last_clean":"2024-05-30T16:47:59.400482+0000","last_became_active":"2024-05-30T16:47:59.392585+0000","last_became_peered":"2024-05-30T16:47:59.392585+0000","last_unstale":"2024-05-30T16:47:59.400482+0000","last_undegraded":"2024-05-30T16:47:59.400482+0000","last_fullsized":"2024-05-30T16:47:59.400482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:15:40.779106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974700+0000","last_change":"2024-05-30T16:47:58.379219+0000","last_active":"2024-05-30T16:48:00.974700+0000","last_peered":"2024-05-30T16:48:00.974700+0000","last_clean":"2024-05-30T16:48:00.974700+0000","last_became_active":"2024-05-30T16:47:58.378861+0000","last_became_peered":"2024-05-30T16:47:58.378861+0000","last_unstale":"2024-05-30T16:48:00.974700+0000","last_undegraded":"2024-05-30T16:48:00.974700+0000","last_fullsized":"2024-05-30T16:48:00.974700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:57:26.373490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403635+0000","last_change":"2024-05-30T16:47:59.404141+0000","last_active":"2024-05-30T16:48:00.403635+0000","last_peered":"2024-05-30T16:48:00.403635+0000","last_clean":"2024-05-30T16:48:00.403635+0000","last_became_active":"2024-05-30T16:47:59.403866+0000","last_became_peered":"2024-05-30T16:47:59.403866+0000","last_unstale":"2024-05-30T16:48:00.403635+0000","last_undegraded":"2024-05-30T16:48:00.403635+0000","last_fullsized":"2024-05-30T16:48:00.403635+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:46.310829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403598+0000","last_change":"2024-05-30T16:47:58.373532+0000","last_active":"2024-05-30T16:48:00.403598+0000","last_peered":"2024-05-30T16:48:00.403598+0000","last_clean":"2024-05-30T16:48:00.403598+0000","last_became_active":"2024-05-30T16:47:58.373228+0000","last_became_peered":"2024-05-30T16:47:58.373228+0000","last_unstale":"2024-05-30T16:48:00.403598+0000","last_undegraded":"2024-05-30T16:48:00.403598+0000","last_fullsized":"2024-05-30T16:48:00.403598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:51:56.244054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973991+0000","last_change":"2024-05-30T16:47:59.403690+0000","last_active":"2024-05-30T16:48:00.973991+0000","last_peered":"2024-05-30T16:48:00.973991+0000","last_clean":"2024-05-30T16:48:00.973991+0000","last_became_active":"2024-05-30T16:47:59.403369+0000","last_became_peered":"2024-05-30T16:47:59.403369+0000","last_unstale":"2024-05-30T16:48:00.973991+0000","last_undegraded":"2024-05-30T16:48:00.973991+0000","last_fullsized":"2024-05-30T16:48:00.973991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:02.167351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.418898+0000","last_change":"2024-05-30T16:47:58.368867+0000","last_active":"2024-05-30T16:47:59.418898+0000","last_peered":"2024-05-30T16:47:59.418898+0000","last_clean":"2024-05-30T16:47:59.418898+0000","last_became_active":"2024-05-30T16:47:58.368624+0000","last_became_peered":"2024-05-30T16:47:58.368624+0000","last_unstale":"2024-05-30T16:47:59.418898+0000","last_undegraded":"2024-05-30T16:47:59.418898+0000","last_fullsized":"2024-05-30T16:47:59.418898+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:32.215493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403465+0000","last_change":"2024-05-30T16:47:59.396931+0000","last_active":"2024-05-30T16:48:00.403465+0000","last_peered":"2024-05-30T16:48:00.403465+0000","last_clean":"2024-05-30T16:48:00.403465+0000","last_became_active":"2024-05-30T16:47:59.396640+0000","last_became_peered":"2024-05-30T16:47:59.396640+0000","last_unstale":"2024-05-30T16:48:00.403465+0000","last_undegraded":"2024-05-30T16:48:00.403465+0000","last_fullsized":"2024-05-30T16:48:00.403465+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:02.167351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.377194+0000","last_change":"2024-05-30T16:47:58.372030+0000","last_active":"2024-05-30T16:47:59.377194+0000","last_peered":"2024-05-30T16:47:59.377194+0000","last_clean":"2024-05-30T16:47:59.377194+0000","last_became_active":"2024-05-30T16:47:58.371715+0000","last_became_peered":"2024-05-30T16:47:58.371715+0000","last_unstale":"2024-05-30T16:47:59.377194+0000","last_undegraded":"2024-05-30T16:47:59.377194+0000","last_fullsized":"2024-05-30T16:47:59.377194+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:48:25.572862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403076+0000","last_change":"2024-05-30T16:47:59.394792+0000","last_active":"2024-05-30T16:48:00.403076+0000","last_peered":"2024-05-30T16:48:00.403076+0000","last_clean":"2024-05-30T16:48:00.403076+0000","last_became_active":"2024-05-30T16:47:59.393739+0000","last_became_peered":"2024-05-30T16:47:59.393739+0000","last_unstale":"2024-05-30T16:48:00.403076+0000","last_undegraded":"2024-05-30T16:48:00.403076+0000","last_fullsized":"2024-05-30T16:48:00.403076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:33:01.097478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.973450+0000","last_change":"2024-05-30T16:47:58.374896+0000","last_active":"2024-05-30T16:48:00.973450+0000","last_peered":"2024-05-30T16:48:00.973450+0000","last_clean":"2024-05-30T16:48:00.973450+0000","last_became_active":"2024-05-30T16:47:58.374540+0000","last_became_peered":"2024-05-30T16:47:58.374540+0000","last_unstale":"2024-05-30T16:48:00.973450+0000","last_undegraded":"2024-05-30T16:48:00.973450+0000","last_fullsized":"2024-05-30T16:48:00.973450+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:33.532748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974464+0000","last_change":"2024-05-30T16:47:59.391927+0000","last_active":"2024-05-30T16:48:00.974464+0000","last_peered":"2024-05-30T16:48:00.974464+0000","last_clean":"2024-05-30T16:48:00.974464+0000","last_became_active":"2024-05-30T16:47:59.391685+0000","last_became_peered":"2024-05-30T16:47:59.391685+0000","last_unstale":"2024-05-30T16:48:00.974464+0000","last_undegraded":"2024-05-30T16:48:00.974464+0000","last_fullsized":"2024-05-30T16:48:00.974464+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:07:33.230592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.419324+0000","last_change":"2024-05-30T16:47:58.367752+0000","last_active":"2024-05-30T16:47:59.419324+0000","last_peered":"2024-05-30T16:47:59.419324+0000","last_clean":"2024-05-30T16:47:59.419324+0000","last_became_active":"2024-05-30T16:47:58.367471+0000","last_became_peered":"2024-05-30T16:47:58.367471+0000","last_unstale":"2024-05-30T16:47:59.419324+0000","last_undegraded":"2024-05-30T16:47:59.419324+0000","last_fullsized":"2024-05-30T16:47:59.419324+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:53:31.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974510+0000","last_change":"2024-05-30T16:47:59.394271+0000","last_active":"2024-05-30T16:48:00.974510+0000","last_peered":"2024-05-30T16:48:00.974510+0000","last_clean":"2024-05-30T16:48:00.974510+0000","last_became_active":"2024-05-30T16:47:59.393958+0000","last_became_peered":"2024-05-30T16:47:59.393958+0000","last_unstale":"2024-05-30T16:48:00.974510+0000","last_undegraded":"2024-05-30T16:48:00.974510+0000","last_fullsized":"2024-05-30T16:48:00.974510+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:18:44.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.406374+0000","last_change":"2024-05-30T16:47:58.364595+0000","last_active":"2024-05-30T16:48:00.406374+0000","last_peered":"2024-05-30T16:48:00.406374+0000","last_clean":"2024-05-30T16:48:00.406374+0000","last_became_active":"2024-05-30T16:47:58.364248+0000","last_became_peered":"2024-05-30T16:47:58.364248+0000","last_unstale":"2024-05-30T16:48:00.406374+0000","last_undegraded":"2024-05-30T16:48:00.406374+0000","last_fullsized":"2024-05-30T16:48:00.406374+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:06:30.946133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.399350+0000","last_change":"2024-05-30T16:47:59.388245+0000","last_active":"2024-05-30T16:47:59.399350+0000","last_peered":"2024-05-30T16:47:59.399350+0000","last_clean":"2024-05-30T16:47:59.399350+0000","last_became_active":"2024-05-30T16:47:59.386627+0000","last_became_peered":"2024-05-30T16:47:59.386627+0000","last_unstale":"2024-05-30T16:47:59.399350+0000","last_undegraded":"2024-05-30T16:47:59.399350+0000","last_fullsized":"2024-05-30T16:47:59.399350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:14:27.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.404173+0000","last_change":"2024-05-30T16:47:58.365550+0000","last_active":"2024-05-30T16:48:00.404173+0000","last_peered":"2024-05-30T16:48:00.404173+0000","last_clean":"2024-05-30T16:48:00.404173+0000","last_became_active":"2024-05-30T16:47:58.365257+0000","last_became_peered":"2024-05-30T16:47:58.365257+0000","last_unstale":"2024-05-30T16:48:00.404173+0000","last_undegraded":"2024-05-30T16:48:00.404173+0000","last_fullsized":"2024-05-30T16:48:00.404173+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:06:11.536343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.404032+0000","last_change":"2024-05-30T16:47:59.397518+0000","last_active":"2024-05-30T16:48:00.404032+0000","last_peered":"2024-05-30T16:48:00.404032+0000","last_clean":"2024-05-30T16:48:00.404032+0000","last_became_active":"2024-05-30T16:47:59.396787+0000","last_became_peered":"2024-05-30T16:47:59.396787+0000","last_unstale":"2024-05-30T16:48:00.404032+0000","last_undegraded":"2024-05-30T16:48:00.404032+0000","last_fullsized":"2024-05-30T16:48:00.404032+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:23.496909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.974418+0000","last_change":"2024-05-30T16:47:58.380084+0000","last_active":"2024-05-30T16:48:00.974418+0000","last_peered":"2024-05-30T16:48:00.974418+0000","last_clean":"2024-05-30T16:48:00.974418+0000","last_became_active":"2024-05-30T16:47:58.379481+0000","last_became_peered":"2024-05-30T16:47:58.379481+0000","last_unstale":"2024-05-30T16:48:00.974418+0000","last_undegraded":"2024-05-30T16:48:00.974418+0000","last_fullsized":"2024-05-30T16:48:00.974418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:11:57.782946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.408328+0000","last_change":"2024-05-30T16:47:59.400603+0000","last_active":"2024-05-30T16:47:59.408328+0000","last_peered":"2024-05-30T16:47:59.408328+0000","last_clean":"2024-05-30T16:47:59.408328+0000","last_became_active":"2024-05-30T16:47:59.400335+0000","last_became_peered":"2024-05-30T16:47:59.400335+0000","last_unstale":"2024-05-30T16:47:59.408328+0000","last_undegraded":"2024-05-30T16:47:59.408328+0000","last_fullsized":"2024-05-30T16:47:59.408328+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:31.217931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.377336+0000","last_change":"2024-05-30T16:47:58.379532+0000","last_active":"2024-05-30T16:47:59.377336+0000","last_peered":"2024-05-30T16:47:59.377336+0000","last_clean":"2024-05-30T16:47:59.377336+0000","last_became_active":"2024-05-30T16:47:58.379119+0000","last_became_peered":"2024-05-30T16:47:58.379119+0000","last_unstale":"2024-05-30T16:47:59.377336+0000","last_undegraded":"2024-05-30T16:47:59.377336+0000","last_fullsized":"2024-05-30T16:47:59.377336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:28.725736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.403425+0000","last_change":"2024-05-30T16:47:59.409548+0000","last_active":"2024-05-30T16:48:00.403425+0000","last_peered":"2024-05-30T16:48:00.403425+0000","last_clean":"2024-05-30T16:48:00.403425+0000","last_became_active":"2024-05-30T16:47:59.409187+0000","last_became_peered":"2024-05-30T16:47:59.409187+0000","last_unstale":"2024-05-30T16:48:00.403425+0000","last_undegraded":"2024-05-30T16:48:00.403425+0000","last_fullsized":"2024-05-30T16:48:00.403425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:46.914948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.400515+0000","last_change":"2024-05-30T16:47:58.371478+0000","last_active":"2024-05-30T16:48:00.400515+0000","last_peered":"2024-05-30T16:48:00.400515+0000","last_clean":"2024-05-30T16:48:00.400515+0000","last_became_active":"2024-05-30T16:47:58.371209+0000","last_became_peered":"2024-05-30T16:47:58.371209+0000","last_unstale":"2024-05-30T16:48:00.400515+0000","last_undegraded":"2024-05-30T16:48:00.400515+0000","last_fullsized":"2024-05-30T16:48:00.400515+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:01:22.437924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.402186+0000","last_change":"2024-05-30T16:47:59.391045+0000","last_active":"2024-05-30T16:47:59.402186+0000","last_peered":"2024-05-30T16:47:59.402186+0000","last_clean":"2024-05-30T16:47:59.402186+0000","last_became_active":"2024-05-30T16:47:59.390708+0000","last_became_peered":"2024-05-30T16:47:59.390708+0000","last_unstale":"2024-05-30T16:47:59.402186+0000","last_undegraded":"2024-05-30T16:47:59.402186+0000","last_fullsized":"2024-05-30T16:47:59.402186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:57:45.288105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.377130+0000","last_change":"2024-05-30T16:47:58.364575+0000","last_active":"2024-05-30T16:47:59.377130+0000","last_peered":"2024-05-30T16:47:59.377130+0000","last_clean":"2024-05-30T16:47:59.377130+0000","last_became_active":"2024-05-30T16:47:58.364302+0000","last_became_peered":"2024-05-30T16:47:58.364302+0000","last_unstale":"2024-05-30T16:47:59.377130+0000","last_undegraded":"2024-05-30T16:47:59.377130+0000","last_fullsized":"2024-05-30T16:47:59.377130+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:23:39.552282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.400463+0000","last_change":"2024-05-30T16:47:59.390540+0000","last_active":"2024-05-30T16:47:59.400463+0000","last_peered":"2024-05-30T16:47:59.400463+0000","last_clean":"2024-05-30T16:47:59.400463+0000","last_became_active":"2024-05-30T16:47:59.390262+0000","last_became_peered":"2024-05-30T16:47:59.390262+0000","last_unstale":"2024-05-30T16:47:59.400463+0000","last_undegraded":"2024-05-30T16:47:59.400463+0000","last_fullsized":"2024-05-30T16:47:59.400463+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:59.928555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.385914+0000","last_change":"2024-05-30T16:47:58.378978+0000","last_active":"2024-05-30T16:47:59.385914+0000","last_peered":"2024-05-30T16:47:59.385914+0000","last_clean":"2024-05-30T16:47:59.385914+0000","last_became_active":"2024-05-30T16:47:58.378659+0000","last_became_peered":"2024-05-30T16:47:58.378659+0000","last_unstale":"2024-05-30T16:47:59.385914+0000","last_undegraded":"2024-05-30T16:47:59.385914+0000","last_fullsized":"2024-05-30T16:47:59.385914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:01.152253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-05-30T16:47:59.412081+0000","last_change":"2024-05-30T16:47:59.406325+0000","last_active":"2024-05-30T16:47:59.412081+0000","last_peered":"2024-05-30T16:47:59.412081+0000","last_clean":"2024-05-30T16:47:59.412081+0000","last_became_active":"2024-05-30T16:47:59.406015+0000","last_became_peered":"2024-05-30T16:47:59.406015+0000","last_unstale":"2024-05-30T16:47:59.412081+0000","last_undegraded":"2024-05-30T16:47:59.412081+0000","last_fullsized":"2024-05-30T16:47:59.412081+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:58.331398+0000","last_clean_scrub_stamp":"2024-05-30T16:47:58.331398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:32.401290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.401305+0000","last_change":"2024-05-30T16:47:58.379111+0000","last_active":"2024-05-30T16:48:00.401305+0000","last_peered":"2024-05-30T16:48:00.401305+0000","last_clean":"2024-05-30T16:48:00.401305+0000","last_became_active":"2024-05-30T16:47:58.378816+0000","last_became_peered":"2024-05-30T16:47:58.378816+0000","last_unstale":"2024-05-30T16:48:00.401305+0000","last_undegraded":"2024-05-30T16:48:00.401305+0000","last_fullsized":"2024-05-30T16:48:00.401305+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:47:57.316300+0000","last_clean_scrub_stamp":"2024-05-30T16:47:57.316300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:43:56.245073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":242,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-30T16:48:00.401156+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:48:00.401156+0000","last_peered":"2024-05-30T16:48:00.401156+0000","last_clean":"2024-05-30T16:48:00.401156+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:48:00.401156+0000","last_undegraded":"2024-05-30T16:48:00.401156+0000","last_fullsized":"2024-05-30T16:48:00.401156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1310720,"data_stored":887962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45768,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326072,"statfs":{"total":96636764160,"available":96589897728,"internally_reserved":0,"allocated":708608,"data_stored":297434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40192,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331648,"statfs":{"total":96636764160,"available":96595607552,"internally_reserved":0,"allocated":704512,"data_stored":291758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45764,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326076,"statfs":{"total":96636764160,"available":96589901824,"internally_reserved":0,"allocated":708608,"data_stored":292718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45764,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326076,"statfs":{"total":96636764160,"available":96589901824,"internally_reserved":0,"allocated":704512,"data_stored":291162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62396,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309444,"statfs":{"total":96636764160,"available":96572870656,"internally_reserved":0,"allocated":704512,"data_stored":291162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45760,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326080,"statfs":{"total":96636764160,"available":96589905920,"internally_reserved":0,"allocated":700416,"data_stored":291196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46360,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325480,"statfs":{"total":96636764160,"available":96589291520,"internally_reserved":0,"allocated":1318912,"data_stored":889996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:48:04.263 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:48:04.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T16:48:04.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.514+0000 7f24af600640 1 Processor -- start 2024-05-30T16:48:04.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.514+0000 7f24af600640 1 -- start start 2024-05-30T16:48:04.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.515+0000 7f24af600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80cec70 0x7f24a80b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.515+0000 7f24af600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24a80b5e00 0x7f24a8142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.515+0000 7f24af600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a8160730 con 0x7f24a813f760 2024-05-30T16:48:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.515+0000 7f24af600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f24a81612b0 con 0x7f24a80b5e00 2024-05-30T16:48:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.515+0000 7f24af600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24a813fb40 con 0x7f24a80cec70 2024-05-30T16:48:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.516+0000 7f24ad600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24a80b5e00 0x7f24a8142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.516+0000 7f24acc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f24a813f760 0x7f24a806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33302/0 (socket says 172.21.15.144:33302) 2024-05-30T16:48:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.516+0000 7f24acc00640 1 -- 172.21.15.144:0/1100798378 learned_addr learned my addr 172.21.15.144:0/1100798378 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.516+0000 7f24a7e00640 1 --2- 172.21.15.144:0/1100798378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80cec70 0x7f24a80b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.516+0000 7f24ad600640 1 -- 172.21.15.144:0/1100798378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80cec70 msgr2=0x7f24a80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.516+0000 7f24ad600640 1 --2- 172.21.15.144:0/1100798378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80cec70 0x7f24a80b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.516+0000 7f24ad600640 1 -- 172.21.15.144:0/1100798378 >> v1:172.21.15.144:6789/0 conn(0x7f24a813f760 legacy=0x7f24a806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.516+0000 7f24ad600640 1 -- 172.21.15.144:0/1100798378 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a8160a10 con 0x7f24a80b5e00 2024-05-30T16:48:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.516+0000 7f24a7400640 1 -- 172.21.15.144:0/1100798378 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 356687349 0 0) 0x7f24a8160730 con 0x7f24a813f760 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.517+0000 7f24ad600640 1 --2- 172.21.15.144:0/1100798378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80b5e00 0x7f24a8142200 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009d90 tx=0x7f24a002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2932c270622c7394 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.518+0000 7f24a7400640 1 -- 172.21.15.144:0/1100798378 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0007740 con 0x7f24a80b5e00 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.518+0000 7f24a7400640 1 -- 172.21.15.144:0/1100798378 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a00078e0 con 0x7f24a80b5e00 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.518+0000 7f24a7400640 1 -- 172.21.15.144:0/1100798378 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0007cb0 con 0x7f24a80b5e00 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.518+0000 7f24af600640 1 -- 172.21.15.144:0/1100798378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80b5e00 msgr2=0x7f24a8142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.518+0000 7f24af600640 1 --2- 172.21.15.144:0/1100798378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80b5e00 0x7f24a8142200 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009d90 tx=0x7f24a002a6f0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.518+0000 7f24af600640 1 -- 172.21.15.144:0/1100798378 shutdown_connections 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.518+0000 7f24af600640 1 --2- 172.21.15.144:0/1100798378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80b5e00 0x7f24a8142200 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.518+0000 7f24af600640 1 --2- 172.21.15.144:0/1100798378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80cec70 0x7f24a80b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.518+0000 7f24af600640 1 -- 172.21.15.144:0/1100798378 >> 172.21.15.144:0/1100798378 conn(0x7f24a806bd00 msgr2=0x7f24a806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.519+0000 7f24af600640 1 -- 172.21.15.144:0/1100798378 shutdown_connections 2024-05-30T16:48:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.519+0000 7f24af600640 1 -- 172.21.15.144:0/1100798378 wait complete. 2024-05-30T16:48:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.520+0000 7f24af600640 1 Processor -- start 2024-05-30T16:48:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.520+0000 7f24af600640 1 -- start start 2024-05-30T16:48:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.521+0000 7f24af600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80b5e00 0x7f24a8156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.521+0000 7f24af600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80cec70 0x7f24a81f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.521+0000 7f24af600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a813f760 0x7f24a8138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.521+0000 7f24af600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24a80cf0d0 con 0x7f24a80cec70 2024-05-30T16:48:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.521+0000 7f24af600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24a8160fd0 con 0x7f24a813f760 2024-05-30T16:48:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.521+0000 7f24af600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24a80cf250 con 0x7f24a80b5e00 2024-05-30T16:48:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.521+0000 7f24a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80cec70 0x7f24a81f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80cec70 0x7f24a81f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43222/0 (socket says 172.21.15.144:43222) 2024-05-30T16:48:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24a7e00640 1 -- 172.21.15.144:0/2796954355 learned_addr learned my addr 172.21.15.144:0/2796954355 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24acc00640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80b5e00 0x7f24a8156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24a7e00640 1 -- 172.21.15.144:0/2796954355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80b5e00 msgr2=0x7f24a8156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24ad600640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a813f760 0x7f24a8138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24a7e00640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80b5e00 0x7f24a8156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24a7e00640 1 -- 172.21.15.144:0/2796954355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a813f760 msgr2=0x7f24a8138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24a7e00640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a813f760 0x7f24a8138770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24a7e00640 1 -- 172.21.15.144:0/2796954355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a8156bb0 con 0x7f24a80cec70 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24acc00640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80b5e00 0x7f24a8156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24a7e00640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80cec70 0x7f24a81f2510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f249400d830 tx=0x7f249400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.522+0000 7f24a4c00640 1 -- 172.21.15.144:0/2796954355 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249400b6c0 con 0x7f24a80cec70 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.523+0000 7f24a4c00640 1 -- 172.21.15.144:0/2796954355 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2494019070 con 0x7f24a80cec70 2024-05-30T16:48:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.523+0000 7f24a4c00640 1 -- 172.21.15.144:0/2796954355 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249400ba80 con 0x7f24a80cec70 2024-05-30T16:48:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.523+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a8135a30 con 0x7f24a80cec70 2024-05-30T16:48:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.523+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a8135ff0 con 0x7f24a80cec70 2024-05-30T16:48:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.524+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a8068b90 con 0x7f24a80cec70 2024-05-30T16:48:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.525+0000 7f24a4c00640 1 -- 172.21.15.144:0/2796954355 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f249400bc20 con 0x7f24a80cec70 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.526+0000 7f24a4c00640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f248806d0d0 0x7f248806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.526+0000 7f24a4c00640 1 -- 172.21.15.144:0/2796954355 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f249408d530 con 0x7f24a80cec70 2024-05-30T16:48:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.526+0000 7f24acc00640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f248806d0d0 0x7f248806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:04.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.527+0000 7f24acc00640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f248806d0d0 0x7f248806f590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f249c000f60 tx=0x7f249c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:04.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.530+0000 7f24a4c00640 1 -- 172.21.15.144:0/2796954355 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f249405a710 con 0x7f24a80cec70 2024-05-30T16:48:04.729 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-05-30T16:48:04.727+0000 7ff2be000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:48:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.813+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f24a815f810 con 0x7f24a80cec70 2024-05-30T16:48:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.818+0000 7f24a4c00640 1 -- 172.21.15.144:0/2796954355 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f249408be20 con 0x7f24a80cec70 2024-05-30T16:48:04.820 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-05-30T16:48:04.820 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA== 2024-05-30T16:48:04.820 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-05-30T16:48:04.820 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-05-30T16:48:04.820 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T16:48:04.820 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-05-30T16:48:04.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.821+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f248806d0d0 msgr2=0x7f248806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.821+0000 7f24af600640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f248806d0d0 0x7f248806f590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f249c000f60 tx=0x7f249c009040 comp rx=0 tx=0).stop 2024-05-30T16:48:04.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.821+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80cec70 msgr2=0x7f24a81f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:04.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.821+0000 7f24af600640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80cec70 0x7f24a81f2510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f249400d830 tx=0x7f249400dcf0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.822+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 shutdown_connections 2024-05-30T16:48:04.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.822+0000 7f24af600640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f248806d0d0 0x7f248806f590 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.822+0000 7f24af600640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a813f760 0x7f24a8138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.822+0000 7f24af600640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a80cec70 0x7f24a81f2510 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.822+0000 7f24af600640 1 --2- 172.21.15.144:0/2796954355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a80b5e00 0x7f24a8156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:04.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.822+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 >> 172.21.15.144:0/2796954355 conn(0x7f24a806bd00 msgr2=0x7f24a813fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:04.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.822+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 shutdown_connections 2024-05-30T16:48:04.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:04.822+0000 7f24af600640 1 -- 172.21.15.144:0/2796954355 wait complete. 2024-05-30T16:48:04.842 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:48:05.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.039+0000 7fe832800640 1 Processor -- start 2024-05-30T16:48:05.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.039+0000 7fe832800640 1 -- start start 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.040+0000 7fe832800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe82c06bff0 0x7fe82c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.041+0000 7fe832800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82c0cab30 con 0x7fe82c06f670 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.041+0000 7fe832800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82c0cf950 con 0x7fe82c0cf300 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.041+0000 7fe832800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c15b090 con 0x7fe82c06bff0 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.041+0000 7fe831400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe82c06f670 0x7fe82c0b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35346/0 (socket says 172.21.15.144:35346) 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.041+0000 7fe831400640 1 -- 172.21.15.144:0/2486844836 learned_addr learned my addr 172.21.15.144:0/2486844836 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.041+0000 7fe831e00640 1 --2- 172.21.15.144:0/2486844836 >> v2:172.21.15.149:3300/0 conn(0x7fe82c06bff0 0x7fe82c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.041+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497815397 0 0) 0x7fe82c0cab30 con 0x7fe82c06f670 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.041+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe814004630 con 0x7fe82c06f670 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 318150345 0 0) 0x7fe814004630 con 0x7fe82c06f670 2024-05-30T16:48:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 >> v2:172.21.15.149:3300/0 conn(0x7fe82c06bff0 msgr2=0x7fe82c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 --2- 172.21.15.144:0/2486844836 >> v2:172.21.15.149:3300/0 conn(0x7fe82c06bff0 0x7fe82c15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 >> v1:172.21.15.149:6789/0 conn(0x7fe82c0cf300 legacy=0x7fe82c06b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c0cfc30 con 0x7fe82c06f670 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fe81c001670 con 0x7fe82c06f670 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 >> v1:172.21.15.144:6789/0 conn(0x7fe82c06f670 legacy=0x7fe82c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe814004af0 0x7fe814004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe814005910 0x7fe814005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8140062d0 0x7fe81400cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c15b090 con 0x7fe8140062d0 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe81400d1a0 con 0x7fe814005910 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe81400d3a0 con 0x7fe814004af0 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.042+0000 7fe831e00640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8140062d0 0x7fe81400cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.043+0000 7fe831400640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe814004af0 0x7fe814004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.043+0000 7fe830a00640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe814005910 0x7fe814005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.043+0000 7fe831e00640 1 -- 172.21.15.144:0/2486844836 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe814004af0 msgr2=0x7fe814004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.043+0000 7fe831e00640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe814004af0 0x7fe814004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.043+0000 7fe831e00640 1 -- 172.21.15.144:0/2486844836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe814005910 msgr2=0x7fe814005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.043+0000 7fe831e00640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe814005910 0x7fe814005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.043+0000 7fe831e00640 1 -- 172.21.15.144:0/2486844836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe814004630 con 0x7fe8140062d0 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.043+0000 7fe830a00640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe814005910 0x7fe814005d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.044+0000 7fe831e00640 1 -- 172.21.15.144:0/2486844836 reap_dead start 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.044+0000 7fe831e00640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8140062d0 0x7fe81400cad0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0cd620 tx=0x7fe814006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372a59309de25567 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.044+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824009690 con 0x7fe8140062d0 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.044+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe824004020 con 0x7fe8140062d0 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.044+0000 7fe82be00640 1 -- 172.21.15.144:0/2486844836 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824004410 con 0x7fe8140062d0 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.045+0000 7fe832800640 1 -- 172.21.15.144:0/2486844836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8140062d0 msgr2=0x7fe81400cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.045+0000 7fe832800640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8140062d0 0x7fe81400cad0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0cd620 tx=0x7fe814006940 comp rx=0 tx=0).stop 2024-05-30T16:48:05.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.045+0000 7fe832800640 1 -- 172.21.15.144:0/2486844836 shutdown_connections 2024-05-30T16:48:05.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.045+0000 7fe832800640 1 --2- 172.21.15.144:0/2486844836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8140062d0 0x7fe81400cad0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.045+0000 7fe832800640 1 -- 172.21.15.144:0/2486844836 >> 172.21.15.144:0/2486844836 conn(0x7fe82c0b20a0 msgr2=0x7fe82c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:05.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.045+0000 7fe832800640 1 -- 172.21.15.144:0/2486844836 shutdown_connections 2024-05-30T16:48:05.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.045+0000 7fe832800640 1 -- 172.21.15.144:0/2486844836 wait complete. 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.047+0000 7fe832800640 1 Processor -- start 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.047+0000 7fe832800640 1 -- start start 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe832800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8140062d0 0x7fe82c073850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe832800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82c072120 0x7fe82c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe832800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe82c15be30 0x7fe82c0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe832800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0ca840 con 0x7fe82c072120 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe832800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c15e730 con 0x7fe82c15be30 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe832800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c06fa50 con 0x7fe8140062d0 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe830a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82c072120 0x7fe82c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe830a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82c072120 0x7fe82c151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60810/0 (socket says 172.21.15.144:60810) 2024-05-30T16:48:05.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe830a00640 1 -- 172.21.15.144:0/2717849531 learned_addr learned my addr 172.21.15.144:0/2717849531 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe831400640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8140062d0 0x7fe82c073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe831e00640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe82c15be30 0x7fe82c0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe830a00640 1 -- 172.21.15.144:0/2717849531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8140062d0 msgr2=0x7fe82c073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe830a00640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8140062d0 0x7fe82c073850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe830a00640 1 -- 172.21.15.144:0/2717849531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe82c15be30 msgr2=0x7fe82c0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe830a00640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe82c15be30 0x7fe82c0c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.048+0000 7fe830a00640 1 -- 172.21.15.144:0/2717849531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c152040 con 0x7fe82c072120 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.049+0000 7fe830a00640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82c072120 0x7fe82c151b00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe82000d8b0 tx=0x7fe82000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.049+0000 7fe829600640 1 -- 172.21.15.144:0/2717849531 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820003da0 con 0x7fe82c072120 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.049+0000 7fe829600640 1 -- 172.21.15.144:0/2717849531 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe820017070 con 0x7fe82c072120 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.049+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c0727b0 con 0x7fe82c072120 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.049+0000 7fe829600640 1 -- 172.21.15.144:0/2717849531 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820005310 con 0x7fe82c072120 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.049+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c072d70 con 0x7fe82c072120 2024-05-30T16:48:05.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.050+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c075570 con 0x7fe82c072120 2024-05-30T16:48:05.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.051+0000 7fe829600640 1 -- 172.21.15.144:0/2717849531 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fe8200054b0 con 0x7fe82c072120 2024-05-30T16:48:05.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.052+0000 7fe829600640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe81006d0d0 0x7fe81006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.053+0000 7fe829600640 1 -- 172.21.15.144:0/2717849531 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fe82008d150 con 0x7fe82c072120 2024-05-30T16:48:05.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.053+0000 7fe831400640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe81006d0d0 0x7fe81006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.053+0000 7fe831400640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe81006d0d0 0x7fe81006f590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe81c001eb0 tx=0x7fe81c001170 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.057+0000 7fe829600640 1 -- 172.21.15.144:0/2717849531 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe82005a4c0 con 0x7fe82c072120 2024-05-30T16:48:05.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.287+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe82c0af660 con 0x7fe82c072120 2024-05-30T16:48:05.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.288+0000 7fe829600640 1 -- 172.21.15.144:0/2717849531 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5193 (secure 0 0 0) 0x7fe820059dc0 con 0x7fe82c072120 2024-05-30T16:48:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:48:05.290 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/4221007288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4221007288},{"type":"v1","addr":"172.21.15.144:6837","nonce":4221007288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5155,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/2104436930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2104436930},{"type":"v1","addr":"172.21.15.149:6833","nonce":2104436930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2742911992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2742911992},{"type":"v1","addr":"172.21.15.149:6835","nonce":2742911992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:47:58.808544+0000","modified":"2024-05-30T16:48:01.886903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5808":{"gid":5808,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4146621541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4146621541},{"type":"v1","addr":"172.21.15.144:6835","nonce":4146621541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5808,"qdb_cluster":[5808]},"id":4}]} 2024-05-30T16:48:05.290 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 35 2024-05-30T16:48:05.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe81006d0d0 msgr2=0x7fe81006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe81006d0d0 0x7fe81006f590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe81c001eb0 tx=0x7fe81c001170 comp rx=0 tx=0).stop 2024-05-30T16:48:05.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82c072120 msgr2=0x7fe82c151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82c072120 0x7fe82c151b00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe82000d8b0 tx=0x7fe82000dd70 comp rx=0 tx=0).stop 2024-05-30T16:48:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 shutdown_connections 2024-05-30T16:48:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe81006d0d0 0x7fe81006f590 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe82c15be30 0x7fe82c0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82c072120 0x7fe82c151b00 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 --2- 172.21.15.144:0/2717849531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8140062d0 0x7fe82c073850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 >> 172.21.15.144:0/2717849531 conn(0x7fe82c0b20a0 msgr2=0x7fe82c0b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 shutdown_connections 2024-05-30T16:48:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.291+0000 7fe832800640 1 -- 172.21.15.144:0/2717849531 wait complete. 2024-05-30T16:48:05.712 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:47:58.808544+0000', 'modified': '2024-05-30T16:48:01.886903+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5808}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5808': {'gid': 5808, 'name': 'c', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/4146621541', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 4146621541}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 4146621541}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5808, 'qdb_cluster': [5808]} 2024-05-30T16:48:05.712 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:48:05.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-30T16:48:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.918+0000 7efcff800640 1 Processor -- start 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.919+0000 7efcff800640 1 -- start start 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.920+0000 7efcff800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efcf806efb0 0x7efcf815f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.920+0000 7efcff800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcf815fe40 0x7efcf80ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.920+0000 7efcff800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf815f120 con 0x7efcf8159320 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.920+0000 7efcff800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efcf80cee40 con 0x7efcf815fe40 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.920+0000 7efcff800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7efcf80cf120 con 0x7efcf806efb0 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcfce00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efcf8159320 0x7efcf806f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35354/0 (socket says 172.21.15.144:35354) 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcfce00640 1 -- 172.21.15.144:0/3860333187 learned_addr learned my addr 172.21.15.144:0/3860333187 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcfd800640 1 --2- 172.21.15.144:0/3860333187 >> v2:172.21.15.144:3300/0 conn(0x7efcf815fe40 0x7efcf80ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcefe00640 1 --2- 172.21.15.144:0/3860333187 >> v2:172.21.15.149:3300/0 conn(0x7efcf806efb0 0x7efcf815f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcfd800640 1 -- 172.21.15.144:0/3860333187 >> v2:172.21.15.149:3300/0 conn(0x7efcf806efb0 msgr2=0x7efcf815f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcfd800640 1 --2- 172.21.15.144:0/3860333187 >> v2:172.21.15.149:3300/0 conn(0x7efcf806efb0 0x7efcf815f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcfd800640 1 -- 172.21.15.144:0/3860333187 >> v1:172.21.15.144:6789/0 conn(0x7efcf8159320 legacy=0x7efcf806f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcfd800640 1 -- 172.21.15.144:0/3860333187 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf80cf400 con 0x7efcf815fe40 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcf7e00640 1 -- 172.21.15.144:0/3860333187 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383263145 0 0) 0x7efcf815f120 con 0x7efcf8159320 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.921+0000 7efcefe00640 1 --2- 172.21.15.144:0/3860333187 >> v2:172.21.15.149:3300/0 conn(0x7efcf806efb0 0x7efcf815f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.922+0000 7efcfd800640 1 --2- 172.21.15.144:0/3860333187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf815fe40 0x7efcf80ccba0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7efcf806c770 tx=0x7efcf002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3868fc1587589be0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.922+0000 7efcf7e00640 1 -- 172.21.15.144:0/3860333187 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0007740 con 0x7efcf815fe40 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.922+0000 7efcf7e00640 1 -- 172.21.15.144:0/3860333187 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf00078e0 con 0x7efcf815fe40 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.923+0000 7efcf7e00640 1 -- 172.21.15.144:0/3860333187 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0007cb0 con 0x7efcf815fe40 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.923+0000 7efcff800640 1 -- 172.21.15.144:0/3860333187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf815fe40 msgr2=0x7efcf80ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.923+0000 7efcff800640 1 --2- 172.21.15.144:0/3860333187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf815fe40 0x7efcf80ccba0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7efcf806c770 tx=0x7efcf002a5f0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.923+0000 7efcff800640 1 -- 172.21.15.144:0/3860333187 shutdown_connections 2024-05-30T16:48:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.923+0000 7efcff800640 1 --2- 172.21.15.144:0/3860333187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf815fe40 0x7efcf80ccba0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.923+0000 7efcff800640 1 --2- 172.21.15.144:0/3860333187 >> v2:172.21.15.149:3300/0 conn(0x7efcf806efb0 0x7efcf815f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.923+0000 7efcff800640 1 -- 172.21.15.144:0/3860333187 >> 172.21.15.144:0/3860333187 conn(0x7efcf80629c0 msgr2=0x7efcf806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.923+0000 7efcff800640 1 -- 172.21.15.144:0/3860333187 shutdown_connections 2024-05-30T16:48:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.923+0000 7efcff800640 1 -- 172.21.15.144:0/3860333187 wait complete. 2024-05-30T16:48:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.925+0000 7efcff800640 1 Processor -- start 2024-05-30T16:48:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.925+0000 7efcff800640 1 -- start start 2024-05-30T16:48:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.926+0000 7efcff800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcf806efb0 0x7efcf81f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.926+0000 7efcff800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf8159320 0x7efcf8143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.926+0000 7efcff800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf8143fd0 0x7efcf8143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.926+0000 7efcff800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efcf80cd260 con 0x7efcf8159320 2024-05-30T16:48:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.926+0000 7efcff800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efcf80cd0e0 con 0x7efcf8143fd0 2024-05-30T16:48:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.926+0000 7efcff800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efcf80cd3e0 con 0x7efcf806efb0 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.926+0000 7efcefe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf8159320 0x7efcf8143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.926+0000 7efcefe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf8159320 0x7efcf8143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60830/0 (socket says 172.21.15.144:60830) 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.926+0000 7efcefe00640 1 -- 172.21.15.144:0/3217943856 learned_addr learned my addr 172.21.15.144:0/3217943856 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcfd800640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf8143fd0 0x7efcf8143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcfce00640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcf806efb0 0x7efcf81f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcefe00640 1 -- 172.21.15.144:0/3217943856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcf806efb0 msgr2=0x7efcf81f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcefe00640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcf806efb0 0x7efcf81f78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcefe00640 1 -- 172.21.15.144:0/3217943856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf8143fd0 msgr2=0x7efcf8143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcefe00640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf8143fd0 0x7efcf8143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcefe00640 1 -- 172.21.15.144:0/3217943856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf80b0e00 con 0x7efcf8159320 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcefe00640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf8159320 0x7efcf8143310 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efce000c820 tx=0x7efce000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcf5600640 1 -- 172.21.15.144:0/3217943856 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0015070 con 0x7efcf8159320 2024-05-30T16:48:05.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcf5600640 1 -- 172.21.15.144:0/3217943856 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce0007a30 con 0x7efcf8159320 2024-05-30T16:48:05.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcf5600640 1 -- 172.21.15.144:0/3217943856 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0007e00 con 0x7efcf8159320 2024-05-30T16:48:05.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.927+0000 7efcff800640 1 -- 172.21.15.144:0/3217943856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf80b1080 con 0x7efcf8159320 2024-05-30T16:48:05.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.928+0000 7efcff800640 1 -- 172.21.15.144:0/3217943856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf80b1640 con 0x7efcf8159320 2024-05-30T16:48:05.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.930+0000 7efcf5600640 1 -- 172.21.15.144:0/3217943856 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7efce0018070 con 0x7efcf8159320 2024-05-30T16:48:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.930+0000 7efcf5600640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcd406d0d0 0x7efcd406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.931+0000 7efcf5600640 1 -- 172.21.15.144:0/3217943856 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7efce008cfd0 con 0x7efcf8159320 2024-05-30T16:48:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.931+0000 7efcfce00640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcd406d0d0 0x7efcd406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.932+0000 7efd0260a740 1 Processor -- start 2024-05-30T16:48:05.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.932+0000 7efcfce00640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcd406d0d0 0x7efcd406f590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efce8007fd0 tx=0x7efce8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.932+0000 7efd0260a740 1 -- start start 2024-05-30T16:48:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.932+0000 7efd0260a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc5292a0 0x55dddc52ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efd0260a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc548ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efd0260a740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc5493e0 0x55dddc549840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efd0260a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dddc466b10 con 0x55dddc52cf60 2024-05-30T16:48:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efd0260a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55dddc40d2b0 con 0x55dddc5292a0 2024-05-30T16:48:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efd0260a740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55dddc462ad0 con 0x55dddc5493e0 2024-05-30T16:48:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efcefe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc548ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efcefe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc548ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60834/0 (socket says 172.21.15.144:60834) 2024-05-30T16:48:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efcefe00640 1 -- 172.21.15.144:0/2717324105 learned_addr learned my addr 172.21.15.144:0/2717324105 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efcefe00640 1 -- 172.21.15.144:0/2717324105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc5493e0 msgr2=0x55dddc549840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efcefe00640 1 --2- 172.21.15.144:0/2717324105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc5493e0 0x55dddc549840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efcefe00640 1 -- 172.21.15.144:0/2717324105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc5292a0 msgr2=0x55dddc52ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efcefe00640 1 --2- 172.21.15.144:0/2717324105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc5292a0 0x55dddc52ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efcefe00640 1 -- 172.21.15.144:0/2717324105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddc1792d0 con 0x55dddc52cf60 2024-05-30T16:48:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.933+0000 7efcefe00640 1 --2- 172.21.15.144:0/2717324105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc548ea0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efce000c7f0 tx=0x7efce0059a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452436ea0492eb29 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efced600640 1 -- 172.21.15.144:0/2717324105 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0088070 con 0x55dddc52cf60 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efced600640 1 -- 172.21.15.144:0/2717324105 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce005ae50 con 0x55dddc52cf60 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efced600640 1 -- 172.21.15.144:0/2717324105 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce001f040 con 0x55dddc52cf60 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efd0260a740 1 -- 172.21.15.144:0/2717324105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 msgr2=0x55dddc548ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efd0260a740 1 --2- 172.21.15.144:0/2717324105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc548ea0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efce000c7f0 tx=0x7efce0059a20 comp rx=0 tx=0).stop 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efd0260a740 1 -- 172.21.15.144:0/2717324105 shutdown_connections 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efd0260a740 1 --2- 172.21.15.144:0/2717324105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc5493e0 0x55dddc549840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efd0260a740 1 --2- 172.21.15.144:0/2717324105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc548ea0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efd0260a740 1 --2- 172.21.15.144:0/2717324105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc5292a0 0x55dddc52ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efd0260a740 1 -- 172.21.15.144:0/2717324105 >> 172.21.15.144:0/2717324105 conn(0x55dddc4ff280 msgr2=0x55dddc500280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.934+0000 7efd0260a740 1 -- 172.21.15.144:0/2717324105 shutdown_connections 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.935+0000 7efd0260a740 1 -- 172.21.15.144:0/2717324105 wait complete. 2024-05-30T16:48:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.935+0000 7efd0260a740 1 -- start start 2024-05-30T16:48:05.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.935+0000 7efd0260a740 1 Processor -- start 2024-05-30T16:48:05.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.936+0000 7efd0260a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc525d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.936+0000 7efd0260a740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc5493e0 0x55dddc52b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.936+0000 7efd0260a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc525830 0x55dddc530020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.936+0000 7efd0260a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dddc466b10 con 0x55dddc52cf60 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.936+0000 7efd0260a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55dddc420570 con 0x55dddc525830 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.936+0000 7efd0260a740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55dddc4fd0b0 con 0x55dddc5493e0 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.936+0000 7efd0260a740 10 client.0 _ll_register_callbacks cb 0x55dddc3eefc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcfce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc525d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcfce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc525d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60846/0 (socket says 172.21.15.144:60846) 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcfce00640 1 -- 172.21.15.144:0/248257528 learned_addr learned my addr 172.21.15.144:0/248257528 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcefe00640 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc5493e0 0x55dddc52b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcfce00640 1 -- 172.21.15.144:0/248257528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc5493e0 msgr2=0x55dddc52b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcfce00640 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc5493e0 0x55dddc52b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcfce00640 1 -- 172.21.15.144:0/248257528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc525830 msgr2=0x55dddc530020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcfce00640 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc525830 0x55dddc530020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcfce00640 1 -- 172.21.15.144:0/248257528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddc2436b0 con 0x55dddc52cf60 2024-05-30T16:48:05.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efcfce00640 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc525d20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efce8005aa0 tx=0x7efce8005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca74bcea429a58a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.937+0000 7efce6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efce6000640 1 -- 172.21.15.144:0/248257528 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce8021420 con 0x55dddc52cf60 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efce6000640 1 -- 172.21.15.144:0/248257528 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7efce8022c90 con 0x55dddc52cf60 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efd0260a740 1 -- 172.21.15.144:0/248257528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efce005ae50 con 0x55dddc52cf60 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efce6000640 1 -- 172.21.15.144:0/248257528 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efce8012410 con 0x55dddc52cf60 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efd0260a740 10 client.5949 fetch_fsmap learned FSMap version 35 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efd0260a740 1 -- 172.21.15.144:0/248257528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55dddc530b50 con 0x55dddc52cf60 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efce6000640 1 -- 172.21.15.144:0/248257528 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce005ae50 con 0x55dddc52cf60 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efce6000640 1 -- 172.21.15.144:0/248257528 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7efce8029050 con 0x55dddc52cf60 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efd0260a740 10 client.5949 fetch_fsmap finished waiting for FSMap version 35 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efd0260a740 10 client.5949 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efd0260a740 20 client.5949 populate_metadata read hostname 'smithi144' 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efd0260a740 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] conn(0x55dddc52e530 0x55dddc5657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efd0260a740 4 client.5949 mds_command: new command op to 5808 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:48:05.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.938+0000 7efd0260a740 1 -- 172.21.15.144:0/248257528 --> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dddc474530 con 0x55dddc52e530 2024-05-30T16:48:05.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.939+0000 7efcefe00640 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] conn(0x55dddc52e530 0x55dddc5657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.939+0000 7efcefe00640 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] conn(0x55dddc52e530 0x55dddc5657b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae1f245c449e567 server_cookie=c933ed9ebb9e2a30 in_seq=0 out_seq=0 2024-05-30T16:48:05.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.939+0000 7efce6000640 10 client.5949 ms_handle_connect on v2:172.21.15.144:6834/4146621541 2024-05-30T16:48:05.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efce6000640 1 -- 172.21.15.144:0/248257528 <== mds.0 v2:172.21.15.144:6834/4146621541 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dddc474530 con 0x55dddc52e530 2024-05-30T16:48:05.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efce6000640 10 client.5949 handle_command_reply: tid=0 2024-05-30T16:48:05.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 client.5949 shutdown 2024-05-30T16:48:05.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 -- 172.21.15.144:0/248257528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 msgr2=0x55dddc525d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc525d20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efce8005aa0 tx=0x7efce8005ea0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 -- 172.21.15.144:0/248257528 shutdown_connections 2024-05-30T16:48:05.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] conn(0x55dddc52e530 0x55dddc5657b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc525830 0x55dddc530020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc5493e0 0x55dddc52b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efce6000640 0 client.5949 ms_handle_reset on v2:172.21.15.144:6834/4146621541 2024-05-30T16:48:05.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 --2- 172.21.15.144:0/248257528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc525d20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 -- 172.21.15.144:0/248257528 >> 172.21.15.144:0/248257528 conn(0x55dddc5292a0 msgr2=0x55dddc54afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:05.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 -- 172.21.15.144:0/248257528 shutdown_connections 2024-05-30T16:48:05.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.940+0000 7efd0260a740 1 -- 172.21.15.144:0/248257528 wait complete. 2024-05-30T16:48:05.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.941+0000 7efd0260a740 20 client.5949 trim_cache size 0 max 16384 2024-05-30T16:48:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.960+0000 7efd0260a740 1 Processor -- start 2024-05-30T16:48:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.960+0000 7efd0260a740 1 -- start start 2024-05-30T16:48:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.961+0000 7efd0260a740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 0x55dddc529920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.961+0000 7efd0260a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc529e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.961+0000 7efd0260a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc5493e0 0x55dddc56a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.961+0000 7efd0260a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8142390 con 0x55dddc52cf60 2024-05-30T16:48:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.961+0000 7efd0260a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8140c30 con 0x55dddc5493e0 2024-05-30T16:48:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.961+0000 7efd0260a740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efcf8141d40 con 0x55dddc525830 2024-05-30T16:48:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.961+0000 7efcefe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc529e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.961+0000 7efcefe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc529e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60848/0 (socket says 172.21.15.144:60848) 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.961+0000 7efcefe00640 1 -- 172.21.15.144:0/3599563052 learned_addr learned my addr 172.21.15.144:0/3599563052 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcfd800640 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc5493e0 0x55dddc56a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcfce00640 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 0x55dddc529920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcefe00640 1 -- 172.21.15.144:0/3599563052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 msgr2=0x55dddc529920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcefe00640 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 0x55dddc529920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcefe00640 1 -- 172.21.15.144:0/3599563052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc5493e0 msgr2=0x55dddc56a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcefe00640 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc5493e0 0x55dddc56a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcefe00640 1 -- 172.21.15.144:0/3599563052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddc54a330 con 0x55dddc52cf60 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcfce00640 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 0x55dddc529920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcefe00640 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc529e60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efce0059ab0 tx=0x7efce001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae4e042650b47 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcecc00640 1 -- 172.21.15.144:0/3599563052 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0088040 con 0x55dddc52cf60 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcecc00640 1 -- 172.21.15.144:0/3599563052 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce005ae50 con 0x55dddc52cf60 2024-05-30T16:48:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.962+0000 7efcecc00640 1 -- 172.21.15.144:0/3599563052 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce001f040 con 0x55dddc52cf60 2024-05-30T16:48:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.963+0000 7efd0260a740 1 -- 172.21.15.144:0/3599563052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 msgr2=0x55dddc529e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.963+0000 7efd0260a740 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc529e60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efce0059ab0 tx=0x7efce001c000 comp rx=0 tx=0).stop 2024-05-30T16:48:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.963+0000 7efd0260a740 1 -- 172.21.15.144:0/3599563052 shutdown_connections 2024-05-30T16:48:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.963+0000 7efd0260a740 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc5493e0 0x55dddc56a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.963+0000 7efd0260a740 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc52cf60 0x55dddc529e60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.963+0000 7efd0260a740 1 --2- 172.21.15.144:0/3599563052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 0x55dddc529920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.963+0000 7efd0260a740 1 -- 172.21.15.144:0/3599563052 >> 172.21.15.144:0/3599563052 conn(0x55dddc5292a0 msgr2=0x55dddc5479f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.963+0000 7efd0260a740 1 -- 172.21.15.144:0/3599563052 shutdown_connections 2024-05-30T16:48:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.963+0000 7efd0260a740 1 -- 172.21.15.144:0/3599563052 wait complete. 2024-05-30T16:48:05.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.964+0000 7efd0260a740 1 -- start start 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.964+0000 7efd0260a740 1 Processor -- start 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efd0260a740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 0x55dddc5c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efd0260a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc52cf60 0x55dddc5247f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efd0260a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc5493e0 0x55dddc524d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efd0260a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dddc52e3b0 con 0x55dddc5493e0 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efd0260a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55dddc52df10 con 0x55dddc52cf60 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efd0260a740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55dddc52e940 con 0x55dddc525830 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efd0260a740 10 client.0 _ll_register_callbacks cb 0x7efce80076c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efcfd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc5493e0 0x55dddc524d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efcfd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc5493e0 0x55dddc524d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60862/0 (socket says 172.21.15.144:60862) 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.965+0000 7efcfd800640 1 -- 172.21.15.144:0/3816688436 learned_addr learned my addr 172.21.15.144:0/3816688436 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efcfd800640 1 -- 172.21.15.144:0/3816688436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 msgr2=0x55dddc5c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efcfd800640 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 0x55dddc5c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efcfd800640 1 -- 172.21.15.144:0/3816688436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc52cf60 msgr2=0x55dddc5247f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efcfd800640 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc52cf60 0x55dddc5247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efcfd800640 1 -- 172.21.15.144:0/3816688436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddc52d5c0 con 0x55dddc5493e0 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efcfd800640 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc5493e0 0x55dddc524d30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009e80 tx=0x7efcf0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2391170e86bdbd79 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efce6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efce6000640 1 -- 172.21.15.144:0/3816688436 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0009450 con 0x55dddc5493e0 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efce6000640 1 -- 172.21.15.144:0/3816688436 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7efcf00047f0 con 0x55dddc5493e0 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efd0260a740 1 -- 172.21.15.144:0/3816688436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efce005ae50 con 0x55dddc5493e0 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efce6000640 1 -- 172.21.15.144:0/3816688436 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efcf004d050 con 0x55dddc5493e0 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efd0260a740 10 client.5955 fetch_fsmap learned FSMap version 35 2024-05-30T16:48:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.966+0000 7efd0260a740 1 -- 172.21.15.144:0/3816688436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55dddc52a230 con 0x55dddc5493e0 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.967+0000 7efce6000640 1 -- 172.21.15.144:0/3816688436 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce005ae50 con 0x55dddc5493e0 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.967+0000 7efce6000640 1 -- 172.21.15.144:0/3816688436 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7efcf0050020 con 0x55dddc5493e0 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.967+0000 7efd0260a740 10 client.5955 fetch_fsmap finished waiting for FSMap version 35 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.967+0000 7efd0260a740 10 client.5955 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.967+0000 7efd0260a740 20 client.5955 populate_metadata read hostname 'smithi144' 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.967+0000 7efd0260a740 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] conn(0x55dddc52a7e0 0x55dddc52abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.967+0000 7efd0260a740 4 client.5955 mds_command: new command op to 5808 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.967+0000 7efd0260a740 1 -- 172.21.15.144:0/3816688436 --> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] -- command(tid 0: {"prefix": "status"}) -- 0x55dddc46e3a0 con 0x55dddc52a7e0 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.967+0000 7efcfce00640 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] conn(0x55dddc52a7e0 0x55dddc52abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efcfce00640 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] conn(0x55dddc52a7e0 0x55dddc52abc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f32238a1cae3105c server_cookie=f89673bc58babb1d in_seq=0 out_seq=0 2024-05-30T16:48:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efce6000640 10 client.5955 ms_handle_connect on v2:172.21.15.144:6834/4146621541 2024-05-30T16:48:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efce6000640 1 -- 172.21.15.144:0/3816688436 <== mds.0 v2:172.21.15.144:6834/4146621541 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55dddc46e3a0 con 0x55dddc52a7e0 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efce6000640 10 client.5955 handle_command_reply: tid=0 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 client.5955 shutdown 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 -- 172.21.15.144:0/3816688436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc5493e0 msgr2=0x55dddc524d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc5493e0 0x55dddc524d30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009e80 tx=0x7efcf0004270 comp rx=0 tx=0).stop 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 -- 172.21.15.144:0/3816688436 shutdown_connections 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.144:6834/4146621541,v1:172.21.15.144:6835/4146621541] conn(0x55dddc52a7e0 0x55dddc52abc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dddc5493e0 0x55dddc524d30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dddc52cf60 0x55dddc5247f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 --2- 172.21.15.144:0/3816688436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55dddc525830 0x55dddc5c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 -- 172.21.15.144:0/3816688436 >> 172.21.15.144:0/3816688436 conn(0x55dddc5292a0 msgr2=0x55dddc529920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efce6000640 0 client.5955 ms_handle_reset on v2:172.21.15.144:6834/4146621541 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 -- 172.21.15.144:0/3816688436 shutdown_connections 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.968+0000 7efd0260a740 1 -- 172.21.15.144:0/3816688436 wait complete. 2024-05-30T16:48:05.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efd0260a740 20 client.5955 trim_cache size 0 max 16384 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5808, 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.5841981289999998, 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 35, 2024-05-30T16:48:05.974 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 59, 2024-05-30T16:48:05.975 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 59, 2024-05-30T16:48:05.975 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 12.069469439000001 2024-05-30T16:48:05.975 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:48:05.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 -- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcd406d0d0 msgr2=0x7efcd406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcd406d0d0 0x7efcd406f590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efce8007fd0 tx=0x7efce8009040 comp rx=0 tx=0).stop 2024-05-30T16:48:05.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 -- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf8159320 msgr2=0x7efcf8143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf8159320 0x7efcf8143310 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efce000c820 tx=0x7efce000cc20 comp rx=0 tx=0).stop 2024-05-30T16:48:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 -- 172.21.15.144:0/3217943856 shutdown_connections 2024-05-30T16:48:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcd406d0d0 0x7efcd406f590 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf8143fd0 0x7efcf8143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf8159320 0x7efcf8143310 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 --2- 172.21.15.144:0/3217943856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcf806efb0 0x7efcf81f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 -- 172.21.15.144:0/3217943856 >> 172.21.15.144:0/3217943856 conn(0x7efcf80629c0 msgr2=0x7efcf8156310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 -- 172.21.15.144:0/3217943856 shutdown_connections 2024-05-30T16:48:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:05.969+0000 7efcff800640 1 -- 172.21.15.144:0/3217943856 wait complete. 2024-05-30T16:48:05.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:48:06.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.174+0000 7fc23f200640 1 Processor -- start 2024-05-30T16:48:06.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.174+0000 7fc23f200640 1 -- start start 2024-05-30T16:48:06.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.175+0000 7fc23f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc2380cc0b0 0x7fc23815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:06.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.175+0000 7fc23f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc23806fcf0 0x7fc23806bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:06.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.175+0000 7fc23f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23815da70 con 0x7fc23806b8e0 2024-05-30T16:48:06.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.175+0000 7fc23f200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc2380ccd20 con 0x7fc2380cc0b0 2024-05-30T16:48:06.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.175+0000 7fc23f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc2380cd000 con 0x7fc23806fcf0 2024-05-30T16:48:06.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.176+0000 7fc23de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc2380cc0b0 0x7fc23815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:06.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.176+0000 7fc23d400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc23806b8e0 0x7fc2381600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35356/0 (socket says 172.21.15.144:35356) 2024-05-30T16:48:06.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.176+0000 7fc23d400640 1 -- 172.21.15.144:0/1971457017 learned_addr learned my addr 172.21.15.144:0/1971457017 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.176+0000 7fc23e800640 1 --2- 172.21.15.144:0/1971457017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc23806fcf0 0x7fc23806bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.176+0000 7fc23de00640 1 -- 172.21.15.144:0/1971457017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc23806fcf0 msgr2=0x7fc23806bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.176+0000 7fc23de00640 1 --2- 172.21.15.144:0/1971457017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc23806fcf0 0x7fc23806bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.176+0000 7fc23de00640 1 -- 172.21.15.144:0/1971457017 >> v1:172.21.15.144:6789/0 conn(0x7fc23806b8e0 legacy=0x7fc2381600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.176+0000 7fc23de00640 1 -- 172.21.15.144:0/1971457017 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2380cd2e0 con 0x7fc2380cc0b0 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.176+0000 7fc23ca00640 1 -- 172.21.15.144:0/1971457017 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829095618 0 0) 0x7fc228001110 con 0x7fc23806b8e0 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.177+0000 7fc23de00640 1 --2- 172.21.15.144:0/1971457017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2380cc0b0 0x7fc23815d530 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0097a0 tx=0x7fc22c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71df3cd4a6aa0ff9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.177+0000 7fc23ca00640 1 -- 172.21.15.144:0/1971457017 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c037070 con 0x7fc2380cc0b0 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23ca00640 1 -- 172.21.15.144:0/1971457017 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c02ae50 con 0x7fc2380cc0b0 2024-05-30T16:48:06.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23ca00640 1 -- 172.21.15.144:0/1971457017 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c032660 con 0x7fc2380cc0b0 2024-05-30T16:48:06.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23f200640 1 -- 172.21.15.144:0/1971457017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2380cc0b0 msgr2=0x7fc23815d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:06.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23f200640 1 --2- 172.21.15.144:0/1971457017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2380cc0b0 0x7fc23815d530 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0097a0 tx=0x7fc22c02a100 comp rx=0 tx=0).stop 2024-05-30T16:48:06.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23f200640 1 -- 172.21.15.144:0/1971457017 shutdown_connections 2024-05-30T16:48:06.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23f200640 1 --2- 172.21.15.144:0/1971457017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc23806fcf0 0x7fc23806bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:06.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23f200640 1 --2- 172.21.15.144:0/1971457017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2380cc0b0 0x7fc23815d530 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:06.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23f200640 1 -- 172.21.15.144:0/1971457017 >> 172.21.15.144:0/1971457017 conn(0x7fc2380b20a0 msgr2=0x7fc2380b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:06.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23f200640 1 -- 172.21.15.144:0/1971457017 shutdown_connections 2024-05-30T16:48:06.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.178+0000 7fc23f200640 1 -- 172.21.15.144:0/1971457017 wait complete. 2024-05-30T16:48:06.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.180+0000 7fc23f200640 1 Processor -- start 2024-05-30T16:48:06.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.180+0000 7fc23f200640 1 -- start start 2024-05-30T16:48:06.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.181+0000 7fc23f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc23806b8e0 0x7fc2380734c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.181+0000 7fc23f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc23806fcf0 0x7fc23814a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.181+0000 7fc23f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2380cc0b0 0x7fc238159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.181+0000 7fc23f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc2380cc490 con 0x7fc23806fcf0 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.181+0000 7fc23f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc2380cc9e0 con 0x7fc23806b8e0 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.181+0000 7fc23f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc238073aa0 con 0x7fc2380cc0b0 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.181+0000 7fc23d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc23806fcf0 0x7fc23814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.181+0000 7fc23d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc23806fcf0 0x7fc23814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60892/0 (socket says 172.21.15.144:60892) 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.181+0000 7fc23d400640 1 -- 172.21.15.144:0/4226013492 learned_addr learned my addr 172.21.15.144:0/4226013492 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc23de00640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc23806b8e0 0x7fc2380734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc23d400640 1 -- 172.21.15.144:0/4226013492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2380cc0b0 msgr2=0x7fc238159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc23d400640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2380cc0b0 0x7fc238159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc23d400640 1 -- 172.21.15.144:0/4226013492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc23806b8e0 msgr2=0x7fc2380734c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc23d400640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc23806b8e0 0x7fc2380734c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc23d400640 1 -- 172.21.15.144:0/4226013492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc238159fd0 con 0x7fc23806fcf0 2024-05-30T16:48:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc23d400640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc23806fcf0 0x7fc23814a750 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc22800c780 tx=0x7fc22800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc232000640 1 -- 172.21.15.144:0/4226013492 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc228018070 con 0x7fc23806fcf0 2024-05-30T16:48:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc232000640 1 -- 172.21.15.144:0/4226013492 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2280072d0 con 0x7fc23806fcf0 2024-05-30T16:48:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc232000640 1 -- 172.21.15.144:0/4226013492 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2280047e0 con 0x7fc23806fcf0 2024-05-30T16:48:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2381f51a0 con 0x7fc23806fcf0 2024-05-30T16:48:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.182+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2381f46c0 con 0x7fc23806fcf0 2024-05-30T16:48:06.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.183+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc238075570 con 0x7fc23806fcf0 2024-05-30T16:48:06.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.184+0000 7fc232000640 1 -- 172.21.15.144:0/4226013492 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fc22801b070 con 0x7fc23806fcf0 2024-05-30T16:48:06.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.185+0000 7fc232000640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc21c06d0d0 0x7fc21c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:06.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.185+0000 7fc232000640 1 -- 172.21.15.144:0/4226013492 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fc22808c190 con 0x7fc23806fcf0 2024-05-30T16:48:06.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.186+0000 7fc23de00640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc21c06d0d0 0x7fc21c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:06.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.186+0000 7fc23de00640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc21c06d0d0 0x7fc21c06f590 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc22c034000 tx=0x7fc22c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:06.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.190+0000 7fc232000640 1 -- 172.21.15.144:0/4226013492 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc23815da70 con 0x7fc23806fcf0 2024-05-30T16:48:06.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.415+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc2380b4100 con 0x7fc23806fcf0 2024-05-30T16:48:06.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.415+0000 7fc232000640 1 -- 172.21.15.144:0/4226013492 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) ==== 53+0+73 (secure 0 0 0) 0x7fc228059580 con 0x7fc23806fcf0 2024-05-30T16:48:06.417 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:48:06.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc21c06d0d0 msgr2=0x7fc21c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:06.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc21c06d0d0 0x7fc21c06f590 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc22c034000 tx=0x7fc22c02e000 comp rx=0 tx=0).stop 2024-05-30T16:48:06.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc23806fcf0 msgr2=0x7fc23814a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:06.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc23806fcf0 0x7fc23814a750 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc22800c780 tx=0x7fc22800cc40 comp rx=0 tx=0).stop 2024-05-30T16:48:06.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 shutdown_connections 2024-05-30T16:48:06.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc21c06d0d0 0x7fc21c06f590 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:06.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2380cc0b0 0x7fc238159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:06.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc23806fcf0 0x7fc23814a750 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:06.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 --2- 172.21.15.144:0/4226013492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc23806b8e0 0x7fc2380734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:06.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 >> 172.21.15.144:0/4226013492 conn(0x7fc2380b20a0 msgr2=0x7fc2380c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:06.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 shutdown_connections 2024-05-30T16:48:06.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06.418+0000 7fc23f200640 1 -- 172.21.15.144:0/4226013492 wait complete. 2024-05-30T16:48:06.438 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T16:48:06.438 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:48:06.438 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-05-30T16:48:06.439 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:48:06.439 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:48:06.439 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T16:48:06.439 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T16:48:06.439 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:48:06.439 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:48:06.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:06.439 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-05-30T16:48:06.486 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:48:06.486 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-05-30T16:48:06.487 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42200sec preferred_lft 42200sec 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9019:bbff:fe7f:ed10/64 scope link 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9c4d:5aff:fe40:b9d1/64 scope link 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:48:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:dc:91:e3:69:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:48:06.489 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9cdc:91ff:fee3:6906/64 scope link 2024-05-30T16:48:06.489 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:48:06.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:06.489 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:48:06.603 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-05-30T16:48:06.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:06.607 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-05-30T16:48:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-05-30T16:48:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:48:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:48:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:48:06.656 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:48:06.657 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:48:06.657 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:48:06.657 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:48:06.657 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:48:06.657 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:48:06.657 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:48:06.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:48:06.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:48:06.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:06.850 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:48:06.896 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:48:06.896 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:48:06.897 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:48:06.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:06.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-05-30T16:48:07.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:48:07.023 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:48:07.074 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:48:07.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:48:07.075 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:48:07.126 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T16:48:07.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:07.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:48:07.255 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:48:07.255 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:48:07.289 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:48:07.289 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:48:07.289 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-05-30T16:48:07.289 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@865cdc9a-e28b-4870-8751-0312b261bc38.cephfs=/ 2024-05-30T16:48:07.289 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-05-30T16:48:07.291 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-30T16:48:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-05-30T16:48:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-30T16:48:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-05-30T16:48:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-30T16:48:07.295 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T16:48:07.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:07.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:48:07.371 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:48:07.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:48:07.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:48:07.505 INFO:teuthology.orchestra.run.smithi144.stdout:client5206 2024-05-30T16:48:07.506 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:48:07.506 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:48:07.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T16:48:07.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.797+0000 7efe6f000640 1 Processor -- start 2024-05-30T16:48:07.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.797+0000 7efe6f000640 1 -- start start 2024-05-30T16:48:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.798+0000 7efe6f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6813f760 0x7efe6806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.798+0000 7efe6f000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe680b5fd0 0x7efe68142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.798+0000 7efe6f000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe6806ee80 con 0x7efe680cec70 2024-05-30T16:48:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.798+0000 7efe6f000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efe681612b0 con 0x7efe680b5fd0 2024-05-30T16:48:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.798+0000 7efe6f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe6813fb40 con 0x7efe6813f760 2024-05-30T16:48:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe6d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe680b5fd0 0x7efe68142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe6d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe680b5fd0 0x7efe68142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60894/0 (socket says 172.21.15.144:60894) 2024-05-30T16:48:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe5f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efe680cec70 0x7efe680b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35372/0 (socket says 172.21.15.144:35372) 2024-05-30T16:48:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe6d000640 1 -- 172.21.15.144:0/2393728137 learned_addr learned my addr 172.21.15.144:0/2393728137 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe67e00640 1 --2- 172.21.15.144:0/2393728137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6813f760 0x7efe6806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe6d000640 1 -- 172.21.15.144:0/2393728137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6813f760 msgr2=0x7efe6806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe6d000640 1 --2- 172.21.15.144:0/2393728137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6813f760 0x7efe6806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe6d000640 1 -- 172.21.15.144:0/2393728137 >> v1:172.21.15.144:6789/0 conn(0x7efe680cec70 legacy=0x7efe680b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe6d000640 1 -- 172.21.15.144:0/2393728137 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe68160730 con 0x7efe680b5fd0 2024-05-30T16:48:07.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.799+0000 7efe67e00640 1 --2- 172.21.15.144:0/2393728137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6813f760 0x7efe6806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:07.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.800+0000 7efe6d000640 1 --2- 172.21.15.144:0/2393728137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680b5fd0 0x7efe68142200 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efe60009e50 tx=0x7efe6002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ba3cbd92ed418a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe67400640 1 -- 172.21.15.144:0/2393728137 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60036070 con 0x7efe680b5fd0 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe67400640 1 -- 172.21.15.144:0/2393728137 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60031600 con 0x7efe680b5fd0 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe67400640 1 -- 172.21.15.144:0/2393728137 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe600319d0 con 0x7efe680b5fd0 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe6f000640 1 -- 172.21.15.144:0/2393728137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680b5fd0 msgr2=0x7efe68142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe6f000640 1 --2- 172.21.15.144:0/2393728137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680b5fd0 0x7efe68142200 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efe60009e50 tx=0x7efe6002a7a0 comp rx=0 tx=0).stop 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe6f000640 1 -- 172.21.15.144:0/2393728137 shutdown_connections 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe6f000640 1 --2- 172.21.15.144:0/2393728137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680b5fd0 0x7efe68142200 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe6f000640 1 --2- 172.21.15.144:0/2393728137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6813f760 0x7efe6806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe6f000640 1 -- 172.21.15.144:0/2393728137 >> 172.21.15.144:0/2393728137 conn(0x7efe6806bd00 msgr2=0x7efe6806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.801+0000 7efe6f000640 1 -- 172.21.15.144:0/2393728137 shutdown_connections 2024-05-30T16:48:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.802+0000 7efe6f000640 1 -- 172.21.15.144:0/2393728137 wait complete. 2024-05-30T16:48:07.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.804+0000 7efe6f000640 1 Processor -- start 2024-05-30T16:48:07.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.804+0000 7efe6f000640 1 -- start start 2024-05-30T16:48:07.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.805+0000 7efe6f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe680b5fd0 0x7efe6815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:07.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.805+0000 7efe6f000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680cec70 0x7efe681f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:07.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.805+0000 7efe6f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe6813f760 0x7efe681547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:07.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.805+0000 7efe6f000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe68160fd0 con 0x7efe680cec70 2024-05-30T16:48:07.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.805+0000 7efe6f000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe68160cf0 con 0x7efe6813f760 2024-05-30T16:48:07.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.805+0000 7efe6f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe680cf0d0 con 0x7efe680b5fd0 2024-05-30T16:48:07.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe5f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680cec70 0x7efe681f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:07.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe5f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680cec70 0x7efe681f1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60908/0 (socket says 172.21.15.144:60908) 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe5f400640 1 -- 172.21.15.144:0/2571975786 learned_addr learned my addr 172.21.15.144:0/2571975786 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe67e00640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe680b5fd0 0x7efe6815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe6d000640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe6813f760 0x7efe681547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe5f400640 1 -- 172.21.15.144:0/2571975786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe680b5fd0 msgr2=0x7efe6815a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe5f400640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe680b5fd0 0x7efe6815a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe5f400640 1 -- 172.21.15.144:0/2571975786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe6813f760 msgr2=0x7efe681547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe5f400640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe6813f760 0x7efe681547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.806+0000 7efe5f400640 1 -- 172.21.15.144:0/2571975786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe681574e0 con 0x7efe680cec70 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.807+0000 7efe5f400640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680cec70 0x7efe681f1a90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c400 tx=0x7efe5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.807+0000 7efe64c00640 1 -- 172.21.15.144:0/2571975786 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe500074e0 con 0x7efe680cec70 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.807+0000 7efe64c00640 1 -- 172.21.15.144:0/2571975786 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe50007680 con 0x7efe680cec70 2024-05-30T16:48:07.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.807+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe681577c0 con 0x7efe680cec70 2024-05-30T16:48:07.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.807+0000 7efe64c00640 1 -- 172.21.15.144:0/2571975786 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50004a00 con 0x7efe680cec70 2024-05-30T16:48:07.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.807+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe68158060 con 0x7efe680cec70 2024-05-30T16:48:07.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.808+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe68158260 con 0x7efe680cec70 2024-05-30T16:48:07.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.809+0000 7efe64c00640 1 -- 172.21.15.144:0/2571975786 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7efe5001a020 con 0x7efe680cec70 2024-05-30T16:48:07.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.811+0000 7efe64c00640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efe4406d0d0 0x7efe4406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:07.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.811+0000 7efe64c00640 1 -- 172.21.15.144:0/2571975786 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7efe50089d90 con 0x7efe680cec70 2024-05-30T16:48:07.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.811+0000 7efe67e00640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efe4406d0d0 0x7efe4406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:07.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.812+0000 7efe67e00640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efe4406d0d0 0x7efe4406f590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efe5800a950 tx=0x7efe58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:07.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:07.816+0000 7efe64c00640 1 -- 172.21.15.144:0/2571975786 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efe68158260 con 0x7efe680cec70 2024-05-30T16:48:08.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.061+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7efe68068b90 con 0x7efe680cec70 2024-05-30T16:48:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.831+0000 7efe64c00640 1 -- 172.21.15.144:0/2571975786 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v36) ==== 136+0+0 (secure 0 0 0) 0x7efe50059ab0 con 0x7efe680cec70 2024-05-30T16:48:08.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efe4406d0d0 msgr2=0x7efe4406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:08.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efe4406d0d0 0x7efe4406f590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efe5800a950 tx=0x7efe58008040 comp rx=0 tx=0).stop 2024-05-30T16:48:08.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680cec70 msgr2=0x7efe681f1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680cec70 0x7efe681f1a90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c400 tx=0x7efe5000c8c0 comp rx=0 tx=0).stop 2024-05-30T16:48:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 shutdown_connections 2024-05-30T16:48:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efe4406d0d0 0x7efe4406f590 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe6813f760 0x7efe681547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe680cec70 0x7efe681f1a90 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 --2- 172.21.15.144:0/2571975786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe680b5fd0 0x7efe6815a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 >> 172.21.15.144:0/2571975786 conn(0x7efe6806bd00 msgr2=0x7efe680b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 shutdown_connections 2024-05-30T16:48:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:08.836+0000 7efe6f000640 1 -- 172.21.15.144:0/2571975786 wait complete. 2024-05-30T16:48:08.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:48:09.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.063+0000 7f4efa000640 1 Processor -- start 2024-05-30T16:48:09.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.064+0000 7f4efa000640 1 -- start start 2024-05-30T16:48:09.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.065+0000 7f4efa000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ef41418b0 0x7f4ef4141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.065+0000 7f4efa000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4ef40b2e40 0x7f4ef41625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.065+0000 7f4efa000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef40b3730 con 0x7f4ef41414d0 2024-05-30T16:48:09.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.065+0000 7f4efa000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef41422f0 con 0x7f4ef40b2e40 2024-05-30T16:48:09.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.065+0000 7f4efa000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef40b3a10 con 0x7f4ef41418b0 2024-05-30T16:48:09.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef8c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4ef41414d0 0x7f4ef40b2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35378/0 (socket says 172.21.15.144:35378) 2024-05-30T16:48:09.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef8c00640 1 -- 172.21.15.144:0/3963301635 learned_addr learned my addr 172.21.15.144:0/3963301635 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:09.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef9600640 1 --2- 172.21.15.144:0/3963301635 >> v2:172.21.15.149:3300/0 conn(0x7f4ef40b2e40 0x7f4ef41625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4eebe00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ef41418b0 0x7f4ef4141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3163838400 0 0) 0x7f4ef40b3730 con 0x7f4ef41414d0 2024-05-30T16:48:09.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ed4003520 con 0x7f4ef41414d0 2024-05-30T16:48:09.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4065310434 0 0) 0x7f4ed4003520 con 0x7f4ef41414d0 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ef41418b0 msgr2=0x7f4ef4141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef3e00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ef41418b0 0x7f4ef4141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 >> v2:172.21.15.149:3300/0 conn(0x7f4ef40b2e40 msgr2=0x7f4ef41625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef3e00640 1 --2- 172.21.15.144:0/3963301635 >> v2:172.21.15.149:3300/0 conn(0x7f4ef40b2e40 0x7f4ef41625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.066+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef40b3cf0 con 0x7f4ef41414d0 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f4ee4001670 con 0x7f4ef41414d0 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4eebe00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ef41418b0 0x7f4ef4141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 >> v1:172.21.15.144:6789/0 conn(0x7f4ef41414d0 legacy=0x7f4ef40b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4ef3e00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ed40039b0 0x7f4ed4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4ef3e00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed4004800 0x7f4ed4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4ef3e00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ef41418b0 0x7f4ed40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef40b3a10 con 0x7f4ed4004800 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed400b9c0 con 0x7f4ed40039b0 2024-05-30T16:48:09.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed400bb40 con 0x7f4ef41418b0 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4eebe00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed4004800 0x7f4ed4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4ef8c00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ed40039b0 0x7f4ed4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4eebe00640 1 -- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ef41418b0 msgr2=0x7f4ed40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4eebe00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ef41418b0 0x7f4ed40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4eebe00640 1 -- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ed40039b0 msgr2=0x7f4ed4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4eebe00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ed40039b0 0x7f4ed4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.067+0000 7f4eebe00640 1 -- 172.21.15.144:0/3963301635 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed4003520 con 0x7f4ed4004800 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.068+0000 7f4eebe00640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed4004800 0x7f4ed4004c80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0098a0 tx=0x7f4ed4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3c388f8e5a6a4b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00f040 con 0x7f4ed4004800 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc02ad00 con 0x7f4ed4004800 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4ef3e00640 1 -- 172.21.15.144:0/3963301635 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc004250 con 0x7f4ed4004800 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4efa000640 1 -- 172.21.15.144:0/3963301635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed4004800 msgr2=0x7f4ed4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4efa000640 1 --2- 172.21.15.144:0/3963301635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ed4004800 0x7f4ed4004c80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0098a0 tx=0x7f4ed4005830 comp rx=0 tx=0).stop 2024-05-30T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4ef9600640 1 -- 172.21.15.144:0/3963301635 reap_dead start 2024-05-30T16:48:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4efa000640 1 -- 172.21.15.144:0/3963301635 shutdown_connections 2024-05-30T16:48:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4efa000640 1 -- 172.21.15.144:0/3963301635 >> 172.21.15.144:0/3963301635 conn(0x7f4ef40627b0 msgr2=0x7f4ef406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4efa000640 1 -- 172.21.15.144:0/3963301635 shutdown_connections 2024-05-30T16:48:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.069+0000 7f4efa000640 1 -- 172.21.15.144:0/3963301635 wait complete. 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.071+0000 7f4efa000640 1 Processor -- start 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.071+0000 7f4efa000640 1 -- start start 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.072+0000 7f4efa000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed4004800 0x7f4ef415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.072+0000 7f4efa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ef4156820 0x7f4ef4154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.072+0000 7f4efa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef41385e0 0x7f4ef413ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.072+0000 7f4efa000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef4141f30 con 0x7f4ef41385e0 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.072+0000 7f4efa000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef4141db0 con 0x7f4ef4156820 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.072+0000 7f4efa000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef41420b0 con 0x7f4ed4004800 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.072+0000 7f4ef9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef41385e0 0x7f4ef413ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.072+0000 7f4ef9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef41385e0 0x7f4ef413ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60924/0 (socket says 172.21.15.144:60924) 2024-05-30T16:48:09.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.072+0000 7f4ef9600640 1 -- 172.21.15.144:0/674790380 learned_addr learned my addr 172.21.15.144:0/674790380 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4ef9600640 1 -- 172.21.15.144:0/674790380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed4004800 msgr2=0x7f4ef415ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4ef9600640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed4004800 0x7f4ef415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4eebe00640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ef4156820 0x7f4ef4154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4ef9600640 1 -- 172.21.15.144:0/674790380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ef4156820 msgr2=0x7f4ef4154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4ef9600640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ef4156820 0x7f4ef4154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4ef9600640 1 -- 172.21.15.144:0/674790380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef415b4e0 con 0x7f4ef41385e0 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4ef9600640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef41385e0 0x7f4ef413ba70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00ee50 tx=0x7f4eec00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4ef1600640 1 -- 172.21.15.144:0/674790380 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00bc50 con 0x7f4ef41385e0 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4ef1600640 1 -- 172.21.15.144:0/674790380 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eec01a070 con 0x7f4ef41385e0 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef415b7c0 con 0x7f4ef41385e0 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.073+0000 7f4ef1600640 1 -- 172.21.15.144:0/674790380 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec014400 con 0x7f4ef41385e0 2024-05-30T16:48:09.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.074+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef4159230 con 0x7f4ef41385e0 2024-05-30T16:48:09.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.075+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef40b5790 con 0x7f4ef41385e0 2024-05-30T16:48:09.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.076+0000 7f4ef1600640 1 -- 172.21.15.144:0/674790380 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f4eec005d10 con 0x7f4ef41385e0 2024-05-30T16:48:09.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.077+0000 7f4ef1600640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4ed006d100 0x7f4ed006f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.077+0000 7f4ef1600640 1 -- 172.21.15.144:0/674790380 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f4eec08d270 con 0x7f4ef41385e0 2024-05-30T16:48:09.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.077+0000 7f4ef8c00640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4ed006d100 0x7f4ed006f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.078+0000 7f4ef8c00640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4ed006d100 0x7f4ed006f5c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4001eb0 tx=0x7f4ee4000f40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:09.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.082+0000 7f4ef1600640 1 -- 172.21.15.144:0/674790380 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4eec024020 con 0x7f4ef41385e0 2024-05-30T16:48:09.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.307+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f4ef413fce0 con 0x7f4ed006d100 2024-05-30T16:48:09.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.310+0000 7f4ef1600640 1 -- 172.21.15.144:0/674790380 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f4ef413fce0 con 0x7f4ed006d100 2024-05-30T16:48:09.312 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:48:09.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:48:09.312 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-05-30T16:48:09.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:48:09.312 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:48:09.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4ed006d100 msgr2=0x7f4ed006f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4ed006d100 0x7f4ed006f5c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4001eb0 tx=0x7f4ee4000f40 comp rx=0 tx=0).stop 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef41385e0 msgr2=0x7f4ef413ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef41385e0 0x7f4ef413ba70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00ee50 tx=0x7f4eec00b480 comp rx=0 tx=0).stop 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 shutdown_connections 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4ed006d100 0x7f4ed006f5c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef41385e0 0x7f4ef413ba70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ef4156820 0x7f4ef4154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 --2- 172.21.15.144:0/674790380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ed4004800 0x7f4ef415ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 >> 172.21.15.144:0/674790380 conn(0x7f4ef40627b0 msgr2=0x7f4ef4074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 shutdown_connections 2024-05-30T16:48:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.313+0000 7f4efa000640 1 -- 172.21.15.144:0/674790380 wait complete. 2024-05-30T16:48:09.333 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:48:09.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.530+0000 7fda0d800640 1 Processor -- start 2024-05-30T16:48:09.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.530+0000 7fda0d800640 1 -- start start 2024-05-30T16:48:09.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.532+0000 7fda0d800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda08144e70 0x7fda0806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.532+0000 7fda0d800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda080b49d0 0x7fda08162480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.532+0000 7fda0d800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda080b3500 con 0x7fda08147cc0 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.532+0000 7fda0d800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fda08145250 con 0x7fda080b49d0 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.532+0000 7fda0d800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fda080b3e30 con 0x7fda08144e70 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.532+0000 7fda0ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda080b49d0 0x7fda08162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.532+0000 7fda07400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fda08147cc0 0x7fda080b42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35386/0 (socket says 172.21.15.144:35386) 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.533+0000 7fda07400640 1 -- 172.21.15.144:0/2375682127 learned_addr learned my addr 172.21.15.144:0/2375682127 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.533+0000 7fda0ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda080b49d0 0x7fda08162480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60940/0 (socket says 172.21.15.144:60940) 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.533+0000 7fda07e00640 1 --2- 172.21.15.144:0/2375682127 >> v2:172.21.15.149:3300/0 conn(0x7fda08144e70 0x7fda0806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.533+0000 7fda0ce00640 1 -- 172.21.15.144:0/2375682127 >> v2:172.21.15.149:3300/0 conn(0x7fda08144e70 msgr2=0x7fda0806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.533+0000 7fda0ce00640 1 --2- 172.21.15.144:0/2375682127 >> v2:172.21.15.149:3300/0 conn(0x7fda08144e70 0x7fda0806dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.533+0000 7fda0ce00640 1 -- 172.21.15.144:0/2375682127 >> v1:172.21.15.144:6789/0 conn(0x7fda08147cc0 legacy=0x7fda080b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.533+0000 7fda0ce00640 1 -- 172.21.15.144:0/2375682127 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda080b37e0 con 0x7fda080b49d0 2024-05-30T16:48:09.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.533+0000 7fda06a00640 1 -- 172.21.15.144:0/2375682127 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392238971 0 0) 0x7fda080b3500 con 0x7fda08147cc0 2024-05-30T16:48:09.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.534+0000 7fda0ce00640 1 --2- 172.21.15.144:0/2375682127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda080b49d0 0x7fda08162480 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fda08073580 tx=0x7fda0002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b234054621c336a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:09.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.534+0000 7fda06a00640 1 -- 172.21.15.144:0/2375682127 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00007740 con 0x7fda080b49d0 2024-05-30T16:48:09.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.534+0000 7fda06a00640 1 -- 172.21.15.144:0/2375682127 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda000078e0 con 0x7fda080b49d0 2024-05-30T16:48:09.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.534+0000 7fda06a00640 1 -- 172.21.15.144:0/2375682127 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00007cb0 con 0x7fda080b49d0 2024-05-30T16:48:09.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.535+0000 7fda0d800640 1 -- 172.21.15.144:0/2375682127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda080b49d0 msgr2=0x7fda08162480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.535+0000 7fda0d800640 1 --2- 172.21.15.144:0/2375682127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda080b49d0 0x7fda08162480 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fda08073580 tx=0x7fda0002a680 comp rx=0 tx=0).stop 2024-05-30T16:48:09.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.535+0000 7fda0d800640 1 -- 172.21.15.144:0/2375682127 shutdown_connections 2024-05-30T16:48:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.535+0000 7fda0d800640 1 --2- 172.21.15.144:0/2375682127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda080b49d0 0x7fda08162480 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.535+0000 7fda0d800640 1 --2- 172.21.15.144:0/2375682127 >> v2:172.21.15.149:3300/0 conn(0x7fda08144e70 0x7fda0806dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.535+0000 7fda0d800640 1 -- 172.21.15.144:0/2375682127 >> 172.21.15.144:0/2375682127 conn(0x7fda0806b8e0 msgr2=0x7fda0806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.535+0000 7fda0d800640 1 -- 172.21.15.144:0/2375682127 shutdown_connections 2024-05-30T16:48:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.535+0000 7fda0d800640 1 -- 172.21.15.144:0/2375682127 wait complete. 2024-05-30T16:48:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.537+0000 7fda0d800640 1 Processor -- start 2024-05-30T16:48:09.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.537+0000 7fda0d800640 1 -- start start 2024-05-30T16:48:09.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.538+0000 7fda0d800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda080b49d0 0x7fda080cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.538+0000 7fda0d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08144e70 0x7fda0815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.538+0000 7fda0d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda08147cc0 0x7fda081f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.538+0000 7fda0d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fda0806c740 con 0x7fda08144e70 2024-05-30T16:48:09.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.538+0000 7fda0d800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fda0806c3d0 con 0x7fda080b49d0 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.538+0000 7fda0d800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fda0806e270 con 0x7fda08147cc0 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.538+0000 7fda07400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08144e70 0x7fda0815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fda07400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08144e70 0x7fda0815e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60948/0 (socket says 172.21.15.144:60948) 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fda07400640 1 -- 172.21.15.144:0/915563200 learned_addr learned my addr 172.21.15.144:0/915563200 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fda07400640 1 -- 172.21.15.144:0/915563200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda08147cc0 msgr2=0x7fda081f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fda07400640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda08147cc0 0x7fda081f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fda07400640 1 -- 172.21.15.144:0/915563200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda080b49d0 msgr2=0x7fda080cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fda07400640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda080b49d0 0x7fda080cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fda07400640 1 -- 172.21.15.144:0/915563200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda080cdc10 con 0x7fda08144e70 2024-05-30T16:48:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fda07400640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08144e70 0x7fda0815e370 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000c4d0 tx=0x7fd9f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fd9ffe00640 1 -- 172.21.15.144:0/915563200 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0018070 con 0x7fda08144e70 2024-05-30T16:48:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fd9ffe00640 1 -- 172.21.15.144:0/915563200 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f0007500 con 0x7fda08144e70 2024-05-30T16:48:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.539+0000 7fd9ffe00640 1 -- 172.21.15.144:0/915563200 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0004a20 con 0x7fda08144e70 2024-05-30T16:48:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.540+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda081f4de0 con 0x7fda08144e70 2024-05-30T16:48:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.540+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda080ccef0 con 0x7fda08144e70 2024-05-30T16:48:09.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.541+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda080632f0 con 0x7fda08144e70 2024-05-30T16:48:09.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.542+0000 7fd9ffe00640 1 -- 172.21.15.144:0/915563200 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7fd9f0004bc0 con 0x7fda08144e70 2024-05-30T16:48:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.543+0000 7fd9ffe00640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9e406d0d0 0x7fd9e406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.543+0000 7fd9ffe00640 1 -- 172.21.15.144:0/915563200 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fd9f008c0d0 con 0x7fda08144e70 2024-05-30T16:48:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.544+0000 7fda07e00640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9e406d0d0 0x7fd9e406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.544+0000 7fda07e00640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9e406d0d0 0x7fd9e406f590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80098f0 tx=0x7fd9f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.548+0000 7fd9ffe00640 1 -- 172.21.15.144:0/915563200 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd9f00594c0 con 0x7fda08144e70 2024-05-30T16:48:09.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.747+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fda080cfeb0 con 0x7fda08144e70 2024-05-30T16:48:09.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.748+0000 7fd9ffe00640 1 -- 172.21.15.144:0/915563200 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fd9f0058dc0 con 0x7fda08144e70 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9e406d0d0 msgr2=0x7fd9e406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9e406d0d0 0x7fd9e406f590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80098f0 tx=0x7fd9f8008040 comp rx=0 tx=0).stop 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08144e70 msgr2=0x7fda0815e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08144e70 0x7fda0815e370 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000c4d0 tx=0x7fd9f000c990 comp rx=0 tx=0).stop 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 shutdown_connections 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9e406d0d0 0x7fd9e406f590 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda08147cc0 0x7fda081f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08144e70 0x7fda0815e370 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 --2- 172.21.15.144:0/915563200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda080b49d0 0x7fda080cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.751+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 >> 172.21.15.144:0/915563200 conn(0x7fda0806b8e0 msgr2=0x7fda080b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.752+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 shutdown_connections 2024-05-30T16:48:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.752+0000 7fda0d800640 1 -- 172.21.15.144:0/915563200 wait complete. 2024-05-30T16:48:09.771 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-05-30T16:48:09.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.976+0000 7f9d28400640 1 Processor -- start 2024-05-30T16:48:09.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.977+0000 7f9d28400640 1 -- start start 2024-05-30T16:48:09.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.978+0000 7f9d28400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d200afe40 0x7f9d201669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.978+0000 7f9d28400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9d20072570 0x7f9d20163350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.978+0000 7f9d28400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d20070170 con 0x7f9d201645b0 2024-05-30T16:48:09.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.978+0000 7f9d28400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9d20167910 con 0x7f9d200afe40 2024-05-30T16:48:09.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.978+0000 7f9d28400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9d20167070 con 0x7f9d20072570 2024-05-30T16:48:09.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.979+0000 7f9d25a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d200afe40 0x7f9d201669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.979+0000 7f9d25a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d200afe40 0x7f9d201669e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60950/0 (socket says 172.21.15.144:60950) 2024-05-30T16:48:09.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.979+0000 7f9d25000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9d201645b0 0x7f9d20071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35396/0 (socket says 172.21.15.144:35396) 2024-05-30T16:48:09.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.979+0000 7f9d25a00640 1 -- 172.21.15.144:0/920037099 learned_addr learned my addr 172.21.15.144:0/920037099 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.979+0000 7f9d26400640 1 --2- 172.21.15.144:0/920037099 >> v2:172.21.15.149:3300/0 conn(0x7f9d20072570 0x7f9d20163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.979+0000 7f9d25a00640 1 -- 172.21.15.144:0/920037099 >> v2:172.21.15.149:3300/0 conn(0x7f9d20072570 msgr2=0x7f9d20163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.979+0000 7f9d25a00640 1 --2- 172.21.15.144:0/920037099 >> v2:172.21.15.149:3300/0 conn(0x7f9d20072570 0x7f9d20163350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.979+0000 7f9d25a00640 1 -- 172.21.15.144:0/920037099 >> v1:172.21.15.144:6789/0 conn(0x7f9d201645b0 legacy=0x7f9d20071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.979+0000 7f9d25a00640 1 -- 172.21.15.144:0/920037099 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d20167350 con 0x7f9d200afe40 2024-05-30T16:48:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.981+0000 7f9d25a00640 1 --2- 172.21.15.144:0/920037099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d200afe40 0x7f9d201669e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9d2006f470 tx=0x7f9d1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3796f7085238d4e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.981+0000 7f9d1fe00640 1 -- 172.21.15.144:0/920037099 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14037070 con 0x7f9d200afe40 2024-05-30T16:48:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.981+0000 7f9d1fe00640 1 -- 172.21.15.144:0/920037099 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d14032440 con 0x7f9d200afe40 2024-05-30T16:48:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.981+0000 7f9d1fe00640 1 -- 172.21.15.144:0/920037099 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14032810 con 0x7f9d200afe40 2024-05-30T16:48:09.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.982+0000 7f9d28400640 1 -- 172.21.15.144:0/920037099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d200afe40 msgr2=0x7f9d201669e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.982+0000 7f9d28400640 1 --2- 172.21.15.144:0/920037099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d200afe40 0x7f9d201669e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9d2006f470 tx=0x7f9d1402a270 comp rx=0 tx=0).stop 2024-05-30T16:48:09.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.982+0000 7f9d28400640 1 -- 172.21.15.144:0/920037099 shutdown_connections 2024-05-30T16:48:09.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.982+0000 7f9d28400640 1 --2- 172.21.15.144:0/920037099 >> v2:172.21.15.149:3300/0 conn(0x7f9d20072570 0x7f9d20163350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.982+0000 7f9d28400640 1 --2- 172.21.15.144:0/920037099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d200afe40 0x7f9d201669e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.982+0000 7f9d28400640 1 -- 172.21.15.144:0/920037099 >> 172.21.15.144:0/920037099 conn(0x7f9d200629c0 msgr2=0x7f9d2006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:09.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.982+0000 7f9d28400640 1 -- 172.21.15.144:0/920037099 shutdown_connections 2024-05-30T16:48:09.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.982+0000 7f9d28400640 1 -- 172.21.15.144:0/920037099 wait complete. 2024-05-30T16:48:09.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.984+0000 7f9d28400640 1 Processor -- start 2024-05-30T16:48:09.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.984+0000 7f9d28400640 1 -- start start 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d28400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d20072570 0x7f9d2015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d28400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d200afe40 0x7f9d201eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d28400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d201645b0 0x7f9d20154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d28400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d200ceb80 con 0x7f9d201645b0 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d28400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d200ce660 con 0x7f9d20072570 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d28400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9d200ced00 con 0x7f9d200afe40 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d26400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d201645b0 0x7f9d20154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d26400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d201645b0 0x7f9d20154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60960/0 (socket says 172.21.15.144:60960) 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d26400640 1 -- 172.21.15.144:0/2287554268 learned_addr learned my addr 172.21.15.144:0/2287554268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:09.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d25a00640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d20072570 0x7f9d2015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.985+0000 7f9d25000640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d200afe40 0x7f9d201eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d26400640 1 -- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d200afe40 msgr2=0x7f9d201eda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d26400640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d200afe40 0x7f9d201eda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d26400640 1 -- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d20072570 msgr2=0x7f9d2015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:09.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d26400640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d20072570 0x7f9d2015ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:09.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d26400640 1 -- 172.21.15.144:0/2287554268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d201edf90 con 0x7f9d201645b0 2024-05-30T16:48:09.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d25a00640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d20072570 0x7f9d2015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:09.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d25000640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d200afe40 0x7f9d201eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:09.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d26400640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d201645b0 0x7f9d20154eb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009dd0 tx=0x7f9d1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:09.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d1d600640 1 -- 172.21.15.144:0/2287554268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18018020 con 0x7f9d201645b0 2024-05-30T16:48:09.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d1d600640 1 -- 172.21.15.144:0/2287554268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d18014480 con 0x7f9d201645b0 2024-05-30T16:48:09.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d1d600640 1 -- 172.21.15.144:0/2287554268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18014870 con 0x7f9d201645b0 2024-05-30T16:48:09.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2015b200 con 0x7f9d201645b0 2024-05-30T16:48:09.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.986+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d200b4110 con 0x7f9d201645b0 2024-05-30T16:48:09.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.987+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d20075570 con 0x7f9d201645b0 2024-05-30T16:48:09.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.988+0000 7f9d1d600640 1 -- 172.21.15.144:0/2287554268 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f9d18005d10 con 0x7f9d201645b0 2024-05-30T16:48:09.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.989+0000 7f9d1d600640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d0006d0d0 0x7f9d0006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.989+0000 7f9d1d600640 1 -- 172.21.15.144:0/2287554268 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f9d1808d660 con 0x7f9d201645b0 2024-05-30T16:48:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.990+0000 7f9d25a00640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d0006d0d0 0x7f9d0006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.990+0000 7f9d25a00640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d0006d0d0 0x7f9d0006f590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d14034000 tx=0x7f9d1402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:09.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:09.994+0000 7f9d1d600640 1 -- 172.21.15.144:0/2287554268 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d18022070 con 0x7f9d201645b0 2024-05-30T16:48:10.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.190+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f9d2006f4d0 con 0x7f9d201645b0 2024-05-30T16:48:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.197+0000 7f9d1d600640 1 -- 172.21.15.144:0/2287554268 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v15)=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7f9d18010040 con 0x7f9d201645b0 2024-05-30T16:48:10.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d0006d0d0 msgr2=0x7f9d0006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d0006d0d0 0x7f9d0006f590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d14034000 tx=0x7f9d1402e000 comp rx=0 tx=0).stop 2024-05-30T16:48:10.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d201645b0 msgr2=0x7f9d20154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d201645b0 0x7f9d20154eb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009dd0 tx=0x7f9d1800c490 comp rx=0 tx=0).stop 2024-05-30T16:48:10.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 shutdown_connections 2024-05-30T16:48:10.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d0006d0d0 0x7f9d0006f590 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d201645b0 0x7f9d20154eb0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d200afe40 0x7f9d201eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 --2- 172.21.15.144:0/2287554268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d20072570 0x7f9d2015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 >> 172.21.15.144:0/2287554268 conn(0x7f9d200629c0 msgr2=0x7f9d200b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:10.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 shutdown_connections 2024-05-30T16:48:10.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.200+0000 7f9d28400640 1 -- 172.21.15.144:0/2287554268 wait complete. 2024-05-30T16:48:10.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T16:48:10.226 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.225+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.226 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.225+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.226 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.225+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.226 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.225+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.226 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.225+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.394+0000 7f1c78200640 1 Processor -- start 2024-05-30T16:48:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.394+0000 7f1c78200640 1 -- start start 2024-05-30T16:48:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.396+0000 7f1c78200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1c700cec70 0x7f1c700b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.396+0000 7f1c78200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c70160730 con 0x7f1c700b5e00 2024-05-30T16:48:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.396+0000 7f1c78200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c70160a10 con 0x7f1c7013f760 2024-05-30T16:48:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.396+0000 7f1c78200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f1c701612b0 con 0x7f1c700cec70 2024-05-30T16:48:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.396+0000 7f1c76200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1c700b5e00 0x7f1c70142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35402/0 (socket says 172.21.15.144:35402) 2024-05-30T16:48:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.396+0000 7f1c76200640 1 -- 172.21.15.144:0/3273201919 learned_addr learned my addr 172.21.15.144:0/3273201919 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c74e00640 1 --2- 172.21.15.144:0/3273201919 >> v2:172.21.15.149:3300/0 conn(0x7f1c700cec70 0x7f1c700b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806742176 0 0) 0x7f1c70160730 con 0x7f1c700b5e00 2024-05-30T16:48:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c58003520 con 0x7f1c700b5e00 2024-05-30T16:48:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2755418491 0 0) 0x7f1c58003520 con 0x7f1c700b5e00 2024-05-30T16:48:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 >> v2:172.21.15.149:3300/0 conn(0x7f1c700cec70 msgr2=0x7f1c700b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 --2- 172.21.15.144:0/3273201919 >> v2:172.21.15.149:3300/0 conn(0x7f1c700cec70 0x7f1c700b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 >> v1:172.21.15.149:6789/0 conn(0x7f1c7013f760 legacy=0x7f1c7006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c70160cf0 con 0x7f1c700b5e00 2024-05-30T16:48:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f1c680019f0 con 0x7f1c700b5e00 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 >> v1:172.21.15.144:6789/0 conn(0x7f1c700b5e00 legacy=0x7f1c70142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 --2- 172.21.15.144:0/3273201919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58003a00 0x7f1c58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 --2- 172.21.15.144:0/3273201919 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c58004800 0x7f1c58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 --2- 172.21.15.144:0/3273201919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c580051c0 0x7f1c5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1c701612b0 con 0x7f1c58003a00 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5800c0a0 con 0x7f1c580051c0 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5800c2a0 con 0x7f1c58004800 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.397+0000 7f1c75800640 1 --2- 172.21.15.144:0/3273201919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58003a00 0x7f1c58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.398+0000 7f1c75800640 1 -- 172.21.15.144:0/3273201919 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c58004800 msgr2=0x7f1c58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.398+0000 7f1c75800640 1 --2- 172.21.15.144:0/3273201919 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c58004800 0x7f1c58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.398+0000 7f1c75800640 1 -- 172.21.15.144:0/3273201919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c580051c0 msgr2=0x7f1c5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.398+0000 7f1c75800640 1 --2- 172.21.15.144:0/3273201919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c580051c0 0x7f1c5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.398+0000 7f1c75800640 1 -- 172.21.15.144:0/3273201919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c58003520 con 0x7f1c58003a00 2024-05-30T16:48:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.398+0000 7f1c76200640 1 -- 172.21.15.144:0/3273201919 reap_dead start 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.399+0000 7f1c75800640 1 --2- 172.21.15.144:0/3273201919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58003a00 0x7f1c58003e20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1c64001750 tx=0x7f1c58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f759b93069d3e20 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.399+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64001370 con 0x7f1c58003a00 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.399+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c640052d0 con 0x7f1c58003a00 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.399+0000 7f1c6fe00640 1 -- 172.21.15.144:0/3273201919 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6402abe0 con 0x7f1c58003a00 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.400+0000 7f1c78200640 1 -- 172.21.15.144:0/3273201919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58003a00 msgr2=0x7f1c58003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.400+0000 7f1c78200640 1 --2- 172.21.15.144:0/3273201919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58003a00 0x7f1c58003e20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1c64001750 tx=0x7f1c58005830 comp rx=0 tx=0).stop 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.400+0000 7f1c78200640 1 -- 172.21.15.144:0/3273201919 shutdown_connections 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.400+0000 7f1c78200640 1 --2- 172.21.15.144:0/3273201919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58003a00 0x7f1c58003e20 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.400+0000 7f1c78200640 1 -- 172.21.15.144:0/3273201919 >> 172.21.15.144:0/3273201919 conn(0x7f1c7006bd00 msgr2=0x7f1c7006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.400+0000 7f1c78200640 1 -- 172.21.15.144:0/3273201919 shutdown_connections 2024-05-30T16:48:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.400+0000 7f1c78200640 1 -- 172.21.15.144:0/3273201919 wait complete. 2024-05-30T16:48:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.402+0000 7f1c78200640 1 Processor -- start 2024-05-30T16:48:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.402+0000 7f1c78200640 1 -- start start 2024-05-30T16:48:10.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c78200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c58003a00 0x7f1c7015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c78200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c70154f30 0x7f1c701595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c78200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c700b2700 0x7f1c700b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c78200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1c700cf0d0 con 0x7f1c70154f30 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c78200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1c700cf250 con 0x7f1c700b2700 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c78200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1c700ce6a0 con 0x7f1c58003a00 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c74e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c70154f30 0x7f1c701595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c74e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c70154f30 0x7f1c701595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60998/0 (socket says 172.21.15.144:60998) 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c74e00640 1 -- 172.21.15.144:0/3469695755 learned_addr learned my addr 172.21.15.144:0/3469695755 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c74e00640 1 -- 172.21.15.144:0/3469695755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c58003a00 msgr2=0x7f1c7015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c74e00640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c58003a00 0x7f1c7015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c74e00640 1 -- 172.21.15.144:0/3469695755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c700b2700 msgr2=0x7f1c700b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c74e00640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c700b2700 0x7f1c700b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.403+0000 7f1c74e00640 1 -- 172.21.15.144:0/3469695755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c70159b30 con 0x7f1c70154f30 2024-05-30T16:48:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.404+0000 7f1c74e00640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c70154f30 0x7f1c701595f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e7a0 tx=0x7f1c5c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.404+0000 7f1c6d600640 1 -- 172.21.15.144:0/3469695755 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c017070 con 0x7f1c70154f30 2024-05-30T16:48:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.404+0000 7f1c6d600640 1 -- 172.21.15.144:0/3469695755 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00ee50 con 0x7f1c70154f30 2024-05-30T16:48:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.404+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c70156130 con 0x7f1c70154f30 2024-05-30T16:48:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.404+0000 7f1c6d600640 1 -- 172.21.15.144:0/3469695755 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00cb80 con 0x7f1c70154f30 2024-05-30T16:48:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.404+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c701566f0 con 0x7f1c70154f30 2024-05-30T16:48:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.405+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c70068b90 con 0x7f1c70154f30 2024-05-30T16:48:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.406+0000 7f1c6d600640 1 -- 172.21.15.144:0/3469695755 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f1c5c01a070 con 0x7f1c70154f30 2024-05-30T16:48:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.407+0000 7f1c6d600640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1c5006d100 0x7f1c5006f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.407+0000 7f1c6d600640 1 -- 172.21.15.144:0/3469695755 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f1c5c08cbe0 con 0x7f1c70154f30 2024-05-30T16:48:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.407+0000 7f1c75800640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1c5006d100 0x7f1c5006f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.408+0000 7f1c75800640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1c5006d100 0x7f1c5006f5c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1c64032000 tx=0x7f1c6402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:10.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.411+0000 7f1c6d600640 1 -- 172.21.15.144:0/3469695755 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c5c059fd0 con 0x7f1c70154f30 2024-05-30T16:48:10.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.644+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f1c70075f70 con 0x7f1c5006d100 2024-05-30T16:48:10.659 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.658+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.659 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.658+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.659 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.658+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.659 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.658+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.659 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:10.658+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.705+0000 7f1c6d600640 1 -- 172.21.15.144:0/3469695755 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1c64005150 con 0x7f1c5006d100 2024-05-30T16:48:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1c5006d100 msgr2=0x7f1c5006f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1c5006d100 0x7f1c5006f5c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1c64032000 tx=0x7f1c6402c000 comp rx=0 tx=0).stop 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c70154f30 msgr2=0x7f1c701595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c70154f30 0x7f1c701595f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e7a0 tx=0x7f1c5c00ec60 comp rx=0 tx=0).stop 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 shutdown_connections 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1c5006d100 0x7f1c5006f5c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c700b2700 0x7f1c700b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c70154f30 0x7f1c701595f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 --2- 172.21.15.144:0/3469695755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c58003a00 0x7f1c7015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 >> 172.21.15.144:0/3469695755 conn(0x7f1c7006bd00 msgr2=0x7f1c7015d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.708+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 shutdown_connections 2024-05-30T16:48:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.709+0000 7f1c78200640 1 -- 172.21.15.144:0/3469695755 wait complete. 2024-05-30T16:48:10.728 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:48:10.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.914+0000 7f818ea00640 1 Processor -- start 2024-05-30T16:48:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.914+0000 7f818ea00640 1 -- start start 2024-05-30T16:48:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.916+0000 7f818ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81880b5fd0 0x7f8188142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.916+0000 7f818ea00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8188160730 con 0x7f818813f760 2024-05-30T16:48:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.916+0000 7f818ea00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8188160a10 con 0x7f81880cec70 2024-05-30T16:48:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.916+0000 7f818ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f81881612b0 con 0x7f81880b5fd0 2024-05-30T16:48:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.916+0000 7f8187e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f818813f760 0x7f818806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35408/0 (socket says 172.21.15.144:35408) 2024-05-30T16:48:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.916+0000 7f8187e00640 1 -- 172.21.15.144:0/4230032865 learned_addr learned my addr 172.21.15.144:0/4230032865 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.916+0000 7f818ca00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81880b5fd0 0x7f8188142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049574494 0 0) 0x7f8188160730 con 0x7f818813f760 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f816c003520 con 0x7f818813f760 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3946537170 0 0) 0x7f816c003520 con 0x7f818813f760 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81880b5fd0 msgr2=0x7f8188142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81880b5fd0 0x7f8188142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 >> v1:172.21.15.149:6789/0 conn(0x7f81880cec70 legacy=0x7f81880b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8188160cf0 con 0x7f818813f760 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f8178001690 con 0x7f818813f760 2024-05-30T16:48:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 >> v1:172.21.15.144:6789/0 conn(0x7f818813f760 legacy=0x7f818806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f816c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81880b5fd0 0x7f816c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f816c004d40 0x7f816c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81881612b0 con 0x7f816c0039e0 2024-05-30T16:48:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f816c00bb60 con 0x7f816c004d40 2024-05-30T16:48:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f816c00bd60 con 0x7f81880b5fd0 2024-05-30T16:48:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.917+0000 7f8187e00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f816c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.918+0000 7f8187400640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81880b5fd0 0x7f816c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.918+0000 7f818ca00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f816c004d40 0x7f816c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.918+0000 7f8187e00640 1 -- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81880b5fd0 msgr2=0x7f816c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:10.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.918+0000 7f8187e00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81880b5fd0 0x7f816c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.918+0000 7f8187e00640 1 -- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f816c004d40 msgr2=0x7f816c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:10.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.918+0000 7f8187e00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f816c004d40 0x7f816c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.918+0000 7f8187e00640 1 -- 172.21.15.144:0/4230032865 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816c003520 con 0x7f816c0039e0 2024-05-30T16:48:10.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.918+0000 7f818ca00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f816c004d40 0x7f816c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:10.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.919+0000 7f8187e00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f816c003e00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f81880cdfe0 tx=0x7f816c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb84db00507baf3f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:10.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.919+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178007c40 con 0x7f816c0039e0 2024-05-30T16:48:10.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.919+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8178005ad0 con 0x7f816c0039e0 2024-05-30T16:48:10.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.919+0000 7f8186a00640 1 -- 172.21.15.144:0/4230032865 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178007070 con 0x7f816c0039e0 2024-05-30T16:48:10.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.920+0000 7f818ea00640 1 -- 172.21.15.144:0/4230032865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 msgr2=0x7f816c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.920+0000 7f818ea00640 1 --2- 172.21.15.144:0/4230032865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f816c003e00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f81880cdfe0 tx=0x7f816c005830 comp rx=0 tx=0).stop 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.920+0000 7f818ca00640 1 -- 172.21.15.144:0/4230032865 reap_dead start 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.920+0000 7f818ea00640 1 -- 172.21.15.144:0/4230032865 shutdown_connections 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.920+0000 7f818ea00640 1 -- 172.21.15.144:0/4230032865 >> 172.21.15.144:0/4230032865 conn(0x7f818806bd00 msgr2=0x7f818806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.920+0000 7f818ea00640 1 -- 172.21.15.144:0/4230032865 shutdown_connections 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.920+0000 7f818ea00640 1 -- 172.21.15.144:0/4230032865 wait complete. 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.922+0000 7f818ea00640 1 Processor -- start 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.922+0000 7f818ea00640 1 -- start start 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.923+0000 7f818ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f8188152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.923+0000 7f818ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f818815b7c0 0x7f818815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.923+0000 7f818ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8188132a10 0x7f8188132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.923+0000 7f818ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81880cf0d0 con 0x7f816c0039e0 2024-05-30T16:48:10.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.923+0000 7f818ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f81880cf250 con 0x7f818815b7c0 2024-05-30T16:48:10.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.923+0000 7f818ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f81880ce6a0 con 0x7f8188132a10 2024-05-30T16:48:10.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.923+0000 7f8187e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f8188152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.923+0000 7f8187e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f8188152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32806/0 (socket says 172.21.15.144:32806) 2024-05-30T16:48:10.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.923+0000 7f8187e00640 1 -- 172.21.15.144:0/1111675849 learned_addr learned my addr 172.21.15.144:0/1111675849 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:10.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f818ca00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8188132a10 0x7f8188132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f8187400640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f818815b7c0 0x7f818815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f8187e00640 1 -- 172.21.15.144:0/1111675849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8188132a10 msgr2=0x7f8188132e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f8187e00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8188132a10 0x7f8188132e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f8187e00640 1 -- 172.21.15.144:0/1111675849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f818815b7c0 msgr2=0x7f818815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:10.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f8187e00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f818815b7c0 0x7f818815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:10.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f8187e00640 1 -- 172.21.15.144:0/1111675849 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8188133760 con 0x7f816c0039e0 2024-05-30T16:48:10.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f8187e00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f8188152b80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f817800c1a0 tx=0x7f8188160ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:10.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f817fe00640 1 -- 172.21.15.144:0/1111675849 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178043070 con 0x7f816c0039e0 2024-05-30T16:48:10.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f817fe00640 1 -- 172.21.15.144:0/1111675849 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8178038040 con 0x7f816c0039e0 2024-05-30T16:48:10.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f817fe00640 1 -- 172.21.15.144:0/1111675849 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81780072b0 con 0x7f816c0039e0 2024-05-30T16:48:10.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.924+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81881f4450 con 0x7f816c0039e0 2024-05-30T16:48:10.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.925+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81881f4a10 con 0x7f816c0039e0 2024-05-30T16:48:10.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.926+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8188068b90 con 0x7f816c0039e0 2024-05-30T16:48:10.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.927+0000 7f817fe00640 1 -- 172.21.15.144:0/1111675849 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 91754+0+0 (secure 0 0 0) 0x7f8178007450 con 0x7f816c0039e0 2024-05-30T16:48:10.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.928+0000 7f817fe00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f816806d0d0 0x7f816806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:10.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.928+0000 7f817fe00640 1 -- 172.21.15.144:0/1111675849 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f81780aa220 con 0x7f816c0039e0 2024-05-30T16:48:10.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.928+0000 7f8187400640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f816806d0d0 0x7f816806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:10.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.929+0000 7f8187400640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f816806d0d0 0x7f816806f590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8188130690 tx=0x7f8174009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:10.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:10.932+0000 7f817fe00640 1 -- 172.21.15.144:0/1111675849 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8178079ec0 con 0x7f816c0039e0 2024-05-30T16:48:11.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.159+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f8188075f70 con 0x7f816806d0d0 2024-05-30T16:48:11.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.167+0000 7f817fe00640 1 -- 172.21.15.144:0/1111675849 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f81740014b0 con 0x7f816806d0d0 2024-05-30T16:48:11.168 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/sv1/a0b39717-4394-420c-8354-c59e09f897db 2024-05-30T16:48:11.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f816806d0d0 msgr2=0x7f816806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:11.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f816806d0d0 0x7f816806f590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8188130690 tx=0x7f8174009040 comp rx=0 tx=0).stop 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 msgr2=0x7f8188152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f8188152b80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f817800c1a0 tx=0x7f8188160ec0 comp rx=0 tx=0).stop 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 shutdown_connections 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f816806d0d0 0x7f816806f590 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8188132a10 0x7f8188132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f818815b7c0 0x7f818815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 --2- 172.21.15.144:0/1111675849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f816c0039e0 0x7f8188152b80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 >> 172.21.15.144:0/1111675849 conn(0x7f818806bd00 msgr2=0x7f818815f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 shutdown_connections 2024-05-30T16:48:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:11.169+0000 7f818ea00640 1 -- 172.21.15.144:0/1111675849 wait complete. 2024-05-30T16:48:11.188 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/a0b39717-4394-420c-8354-c59e09f897db 2024-05-30T16:48:11.188 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:48:11.188 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:48:11.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:11.237 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a0b39717-4394-420c-8354-c59e09f897db/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:48:16.930 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:48:16.941 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:48:18.437 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:48:18.437 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:48:18.437 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.09648 s, 151 MB/s 2024-05-30T16:48:18.438 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:48:18.438 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:48:18.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:18.476 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a0b39717-4394-420c-8354-c59e09f897db/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:48:25.667 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:48:25.668 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:48:25.668 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.10437 s, 151 MB/s 2024-05-30T16:48:25.669 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:48:25.669 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:48:25.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:25.707 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a0b39717-4394-420c-8354-c59e09f897db/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:48:33.108 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:48:33.109 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:48:33.109 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.31401 s, 147 MB/s 2024-05-30T16:48:33.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T16:48:33.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.313+0000 7f40e7e00640 1 Processor -- start 2024-05-30T16:48:33.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.314+0000 7f40e7e00640 1 -- start start 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.315+0000 7f40e7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40e815eac0 0x7f40e81625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.315+0000 7f40e7e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f40e8162af0 0x7f40e80b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.315+0000 7f40e7e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e80b6b10 con 0x7f40e80b6700 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.315+0000 7f40e7e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f40e815eea0 con 0x7f40e815eac0 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.315+0000 7f40e7e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f40e8162f90 con 0x7f40e8162af0 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.315+0000 7f40e6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40e815eac0 0x7f40e81625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.315+0000 7f40e6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40e815eac0 0x7f40e81625b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45716/0 (socket says 172.21.15.144:45716) 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.315+0000 7f40e6a00640 1 -- 172.21.15.144:0/114140620 learned_addr learned my addr 172.21.15.144:0/114140620 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.316+0000 7f40de000640 1 --2- 172.21.15.144:0/114140620 >> v2:172.21.15.149:3300/0 conn(0x7f40e8162af0 0x7f40e80b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:33.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.316+0000 7f40e6a00640 1 -- 172.21.15.144:0/114140620 >> v2:172.21.15.149:3300/0 conn(0x7f40e8162af0 msgr2=0x7f40e80b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:33.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.316+0000 7f40e6a00640 1 --2- 172.21.15.144:0/114140620 >> v2:172.21.15.149:3300/0 conn(0x7f40e8162af0 0x7f40e80b61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.316+0000 7f40e6a00640 1 -- 172.21.15.144:0/114140620 >> v1:172.21.15.149:6789/0 conn(0x7f40e80b6700 legacy=0x7f40e806c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:33.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.316+0000 7f40e6a00640 1 -- 172.21.15.144:0/114140620 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e8163270 con 0x7f40e815eac0 2024-05-30T16:48:33.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.317+0000 7f40e6a00640 1 --2- 172.21.15.144:0/114140620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e815eac0 0x7f40e81625b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40e80d57e0 tx=0x7f40d802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87ee2192263e6d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:33.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.317+0000 7f40e6000640 1 -- 172.21.15.144:0/114140620 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8037070 con 0x7f40e815eac0 2024-05-30T16:48:33.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.317+0000 7f40e6000640 1 -- 172.21.15.144:0/114140620 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d8032440 con 0x7f40e815eac0 2024-05-30T16:48:33.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.317+0000 7f40e6000640 1 -- 172.21.15.144:0/114140620 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8032810 con 0x7f40e815eac0 2024-05-30T16:48:33.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.318+0000 7f40e7e00640 1 -- 172.21.15.144:0/114140620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e815eac0 msgr2=0x7f40e81625b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.318+0000 7f40e7e00640 1 --2- 172.21.15.144:0/114140620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e815eac0 0x7f40e81625b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40e80d57e0 tx=0x7f40d802a230 comp rx=0 tx=0).stop 2024-05-30T16:48:33.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.318+0000 7f40e7e00640 1 -- 172.21.15.144:0/114140620 shutdown_connections 2024-05-30T16:48:33.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.318+0000 7f40e7e00640 1 --2- 172.21.15.144:0/114140620 >> v2:172.21.15.149:3300/0 conn(0x7f40e8162af0 0x7f40e80b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.318+0000 7f40e7e00640 1 --2- 172.21.15.144:0/114140620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e815eac0 0x7f40e81625b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.318+0000 7f40e7e00640 1 -- 172.21.15.144:0/114140620 >> 172.21.15.144:0/114140620 conn(0x7f40e80d11c0 msgr2=0x7f40e80d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:33.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.318+0000 7f40e7e00640 1 -- 172.21.15.144:0/114140620 shutdown_connections 2024-05-30T16:48:33.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.318+0000 7f40e7e00640 1 -- 172.21.15.144:0/114140620 wait complete. 2024-05-30T16:48:33.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.320+0000 7f40e7e00640 1 Processor -- start 2024-05-30T16:48:33.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.321+0000 7f40e7e00640 1 -- start start 2024-05-30T16:48:33.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e80b6700 0x7f40e814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e815eac0 0x7f40e814abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40e8162af0 0x7f40e814a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f40e80b78e0 con 0x7f40e80b6700 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40e80d2db0 con 0x7f40e8162af0 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f40e80d42e0 con 0x7f40e815eac0 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e80b6700 0x7f40e814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e80b6700 0x7f40e814d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45720/0 (socket says 172.21.15.144:45720) 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e6a00640 1 -- 172.21.15.144:0/2421871223 learned_addr learned my addr 172.21.15.144:0/2421871223 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e6a00640 1 -- 172.21.15.144:0/2421871223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e815eac0 msgr2=0x7f40e814abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e6a00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e815eac0 0x7f40e814abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e6a00640 1 -- 172.21.15.144:0/2421871223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40e8162af0 msgr2=0x7f40e814a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e6a00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40e8162af0 0x7f40e814a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.322+0000 7f40e6a00640 1 -- 172.21.15.144:0/2421871223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e814db90 con 0x7f40e80b6700 2024-05-30T16:48:33.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.323+0000 7f40e6a00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e80b6700 0x7f40e814d650 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000c00 tx=0x7f40d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:33.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.323+0000 7f40dfe00640 1 -- 172.21.15.144:0/2421871223 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8041020 con 0x7f40e80b6700 2024-05-30T16:48:33.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.323+0000 7f40dfe00640 1 -- 172.21.15.144:0/2421871223 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d8030990 con 0x7f40e80b6700 2024-05-30T16:48:33.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.323+0000 7f40dfe00640 1 -- 172.21.15.144:0/2421871223 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8037040 con 0x7f40e80b6700 2024-05-30T16:48:33.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.323+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e80ce370 con 0x7f40e80b6700 2024-05-30T16:48:33.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.323+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e8160ca0 con 0x7f40e80b6700 2024-05-30T16:48:33.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.324+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e8075570 con 0x7f40e80b6700 2024-05-30T16:48:33.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.325+0000 7f40dfe00640 1 -- 172.21.15.144:0/2421871223 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 91856+0+0 (secure 0 0 0) 0x7f40d8044020 con 0x7f40e80b6700 2024-05-30T16:48:33.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.326+0000 7f40dfe00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f40c406d1f0 0x7f40c406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.326+0000 7f40dfe00640 1 -- 172.21.15.144:0/2421871223 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f40d80aae40 con 0x7f40e80b6700 2024-05-30T16:48:33.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.326+0000 7f40de000640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f40c406d1f0 0x7f40c406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:33.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.327+0000 7f40de000640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f40c406d1f0 0x7f40c406f6b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f40e8151300 tx=0x7f40d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.330+0000 7f40dfe00640 1 -- 172.21.15.144:0/2421871223 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f40d804b030 con 0x7f40e80b6700 2024-05-30T16:48:33.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.545+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f40e80d2450 con 0x7f40c406d1f0 2024-05-30T16:48:33.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.568+0000 7f40dfe00640 1 -- 172.21.15.144:0/2421871223 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f40e80d2450 con 0x7f40c406d1f0 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f40c406d1f0 msgr2=0x7f40c406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f40c406d1f0 0x7f40c406f6b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f40e8151300 tx=0x7f40d0008040 comp rx=0 tx=0).stop 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e80b6700 msgr2=0x7f40e814d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e80b6700 0x7f40e814d650 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000c00 tx=0x7f40d80046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 shutdown_connections 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f40c406d1f0 0x7f40c406f6b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40e8162af0 0x7f40e814a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e815eac0 0x7f40e814abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 --2- 172.21.15.144:0/2421871223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e80b6700 0x7f40e814d650 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 >> 172.21.15.144:0/2421871223 conn(0x7f40e80d11c0 msgr2=0x7f40e80cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 shutdown_connections 2024-05-30T16:48:33.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.571+0000 7f40e7e00640 1 -- 172.21.15.144:0/2421871223 wait complete. 2024-05-30T16:48:33.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:48:33.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.789+0000 7fc495e00640 1 Processor -- start 2024-05-30T16:48:33.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.789+0000 7fc495e00640 1 -- start start 2024-05-30T16:48:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.790+0000 7fc495e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc490140c80 0x7fc490165c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.791+0000 7fc495e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4900cd030 con 0x7fc4900cc7a0 2024-05-30T16:48:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.791+0000 7fc495e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4900ceca0 con 0x7fc4900afa00 2024-05-30T16:48:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.791+0000 7fc495e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc4901413f0 con 0x7fc490140c80 2024-05-30T16:48:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.791+0000 7fc48e000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc4900cc7a0 0x7fc490140570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40030/0 (socket says 172.21.15.144:40030) 2024-05-30T16:48:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.791+0000 7fc48e000640 1 -- 172.21.15.144:0/1105087420 learned_addr learned my addr 172.21.15.144:0/1105087420 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:33.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.791+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4058614371 0 0) 0x7fc4900cd030 con 0x7fc4900cc7a0 2024-05-30T16:48:33.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc474003520 con 0x7fc4900cc7a0 2024-05-30T16:48:33.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48f400640 1 --2- 172.21.15.144:0/1105087420 >> v2:172.21.15.149:3300/0 conn(0x7fc490140c80 0x7fc490165c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:33.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1288141793 0 0) 0x7fc474003520 con 0x7fc4900cc7a0 2024-05-30T16:48:33.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 >> v2:172.21.15.149:3300/0 conn(0x7fc490140c80 msgr2=0x7fc490165c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 --2- 172.21.15.144:0/1105087420 >> v2:172.21.15.149:3300/0 conn(0x7fc490140c80 0x7fc490165c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 >> v1:172.21.15.149:6789/0 conn(0x7fc4900afa00 legacy=0x7fc49015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4900cd2a0 con 0x7fc4900cc7a0 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fc478001670 con 0x7fc4900cc7a0 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 >> v1:172.21.15.144:6789/0 conn(0x7fc4900cc7a0 legacy=0x7fc490140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc474003a00 0x7fc474003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc474004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc4740053c0 0x7fc47400cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc47400d3c0 con 0x7fc474004800 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc47400d570 con 0x7fc474003a00 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc47400d770 con 0x7fc4740053c0 2024-05-30T16:48:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48f400640 1 --2- 172.21.15.144:0/1105087420 >> v2:172.21.15.149:3300/0 conn(0x7fc490140c80 0x7fc490165c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.792+0000 7fc48e000640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc474004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.793+0000 7fc48ea00640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc474003a00 0x7fc474003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.793+0000 7fc48e000640 1 -- 172.21.15.144:0/1105087420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc4740053c0 msgr2=0x7fc47400cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.793+0000 7fc48e000640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc4740053c0 0x7fc47400cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.793+0000 7fc48e000640 1 -- 172.21.15.144:0/1105087420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc474003a00 msgr2=0x7fc474003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.793+0000 7fc48e000640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc474003a00 0x7fc474003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.793+0000 7fc48e000640 1 -- 172.21.15.144:0/1105087420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc474003520 con 0x7fc474004800 2024-05-30T16:48:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.793+0000 7fc48f400640 1 -- 172.21.15.144:0/1105087420 reap_dead start 2024-05-30T16:48:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.794+0000 7fc48e000640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc474004c80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc4900b02b0 tx=0x7fc474005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79e02fe2f3886ba server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.794+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478007c40 con 0x7fc474004800 2024-05-30T16:48:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.794+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc478005af0 con 0x7fc474004800 2024-05-30T16:48:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.794+0000 7fc48d600640 1 -- 172.21.15.144:0/1105087420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478007070 con 0x7fc474004800 2024-05-30T16:48:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.795+0000 7fc495e00640 1 -- 172.21.15.144:0/1105087420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 msgr2=0x7fc474004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.795+0000 7fc495e00640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc474004c80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc4900b02b0 tx=0x7fc474005830 comp rx=0 tx=0).stop 2024-05-30T16:48:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.795+0000 7fc495e00640 1 -- 172.21.15.144:0/1105087420 shutdown_connections 2024-05-30T16:48:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.795+0000 7fc495e00640 1 --2- 172.21.15.144:0/1105087420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc474004c80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.795+0000 7fc495e00640 1 -- 172.21.15.144:0/1105087420 >> 172.21.15.144:0/1105087420 conn(0x7fc49006bd00 msgr2=0x7fc49006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.795+0000 7fc495e00640 1 -- 172.21.15.144:0/1105087420 shutdown_connections 2024-05-30T16:48:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.795+0000 7fc495e00640 1 -- 172.21.15.144:0/1105087420 wait complete. 2024-05-30T16:48:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.797+0000 7fc495e00640 1 Processor -- start 2024-05-30T16:48:33.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.797+0000 7fc495e00640 1 -- start start 2024-05-30T16:48:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.798+0000 7fc495e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc4901f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.798+0000 7fc495e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc490154850 0x7fc49015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.798+0000 7fc495e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc49015c560 0x7fc4900b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.798+0000 7fc495e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4900ccc60 con 0x7fc474004800 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.798+0000 7fc495e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc4900cd860 con 0x7fc490154850 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.798+0000 7fc495e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc4900afde0 con 0x7fc49015c560 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.798+0000 7fc48ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc4901f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.798+0000 7fc48ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc4901f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45738/0 (socket says 172.21.15.144:45738) 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.798+0000 7fc48ea00640 1 -- 172.21.15.144:0/997084164 learned_addr learned my addr 172.21.15.144:0/997084164 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc48ea00640 1 -- 172.21.15.144:0/997084164 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc49015c560 msgr2=0x7fc4900b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc48ea00640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc49015c560 0x7fc4900b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc48ea00640 1 -- 172.21.15.144:0/997084164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc490154850 msgr2=0x7fc49015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc48ea00640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc490154850 0x7fc49015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc48ea00640 1 -- 172.21.15.144:0/997084164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4900b0f30 con 0x7fc474004800 2024-05-30T16:48:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc48ea00640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc4901f0900 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc48000d760 tx=0x7fc48000dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc487400640 1 -- 172.21.15.144:0/997084164 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480003da0 con 0x7fc474004800 2024-05-30T16:48:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc487400640 1 -- 172.21.15.144:0/997084164 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc480017070 con 0x7fc474004800 2024-05-30T16:48:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc487400640 1 -- 172.21.15.144:0/997084164 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48000b8b0 con 0x7fc474004800 2024-05-30T16:48:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4900b16d0 con 0x7fc474004800 2024-05-30T16:48:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.799+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc490154cd0 con 0x7fc474004800 2024-05-30T16:48:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.800+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc49015c980 con 0x7fc474004800 2024-05-30T16:48:33.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.801+0000 7fc487400640 1 -- 172.21.15.144:0/997084164 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 91856+0+0 (secure 0 0 0) 0x7fc48000ba50 con 0x7fc474004800 2024-05-30T16:48:33.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.802+0000 7fc487400640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc46c06d1f0 0x7fc46c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.802+0000 7fc487400640 1 -- 172.21.15.144:0/997084164 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fc48008a4d0 con 0x7fc474004800 2024-05-30T16:48:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.803+0000 7fc48e000640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc46c06d1f0 0x7fc46c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.803+0000 7fc48e000640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc46c06d1f0 0x7fc46c06f6b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc478032000 tx=0x7fc478009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:33.807+0000 7fc487400640 1 -- 172.21.15.144:0/997084164 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc48005a350 con 0x7fc474004800 2024-05-30T16:48:34.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.044+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fc490075f70 con 0x7fc46c06d1f0 2024-05-30T16:48:34.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.051+0000 7fc487400640 1 -- 172.21.15.144:0/997084164 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fc4780014b0 con 0x7fc46c06d1f0 2024-05-30T16:48:34.052 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/sv1/a0b39717-4394-420c-8354-c59e09f897db 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc46c06d1f0 msgr2=0x7fc46c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc46c06d1f0 0x7fc46c06f6b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc478032000 tx=0x7fc478009030 comp rx=0 tx=0).stop 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 msgr2=0x7fc4901f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc4901f0900 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc48000d760 tx=0x7fc48000dc20 comp rx=0 tx=0).stop 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 shutdown_connections 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc46c06d1f0 0x7fc46c06f6b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc49015c560 0x7fc4900b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc490154850 0x7fc49015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 --2- 172.21.15.144:0/997084164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc474004800 0x7fc4901f0900 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 >> 172.21.15.144:0/997084164 conn(0x7fc49006bd00 msgr2=0x7fc4900b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.054+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 shutdown_connections 2024-05-30T16:48:34.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.055+0000 7fc495e00640 1 -- 172.21.15.144:0/997084164 wait complete. 2024-05-30T16:48:34.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:48:34.074 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a0b39717-4394-420c-8354-c59e09f897db 2024-05-30T16:48:34.074 DEBUG:teuthology.orchestra.run.smithi144:> ) 2024-05-30T16:48:34.123 INFO:teuthology.orchestra.run.smithi144.stdout:# file: volumes/_nogroup/sv1/a0b39717-4394-420c-8354-c59e09f897db 2024-05-30T16:48:34.123 INFO:teuthology.orchestra.run.smithi144.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T16:48:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:48:34.124 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T16:48:34.125 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone56761 2024-05-30T16:48:34.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.327+0000 7fd5e6000640 1 Processor -- start 2024-05-30T16:48:34.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.327+0000 7fd5e6000640 1 -- start start 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5e6000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd5e0141510 0x7fd5e01418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5e6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5e0144020 0x7fd5e006e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5e6000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e00b3fd0 con 0x7fd5e015f8f0 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5e6000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e006dfc0 con 0x7fd5e0144020 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5e6000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e015fd80 con 0x7fd5e0141510 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5dfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5e0144020 0x7fd5e006e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5dfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5e0144020 0x7fd5e006e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45746/0 (socket says 172.21.15.144:45746) 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5dfe00640 1 -- 172.21.15.144:0/1039066616 learned_addr learned my addr 172.21.15.144:0/1039066616 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5dfe00640 1 -- 172.21.15.144:0/1039066616 >> v2:172.21.15.149:3300/0 conn(0x7fd5e0141510 msgr2=0x7fd5e01418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5dfe00640 1 --2- 172.21.15.144:0/1039066616 >> v2:172.21.15.149:3300/0 conn(0x7fd5e0141510 0x7fd5e01418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.329+0000 7fd5dfe00640 1 -- 172.21.15.144:0/1039066616 >> v1:172.21.15.149:6789/0 conn(0x7fd5e015f8f0 legacy=0x7fd5e00b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:34.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.330+0000 7fd5dfe00640 1 -- 172.21.15.144:0/1039066616 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e0144790 con 0x7fd5e0144020 2024-05-30T16:48:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.330+0000 7fd5dfe00640 1 --2- 172.21.15.144:0/1039066616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e0144020 0x7fd5e006e710 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0070180 tx=0x7fd5d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9237df17db522677 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.331+0000 7fd5dea00640 1 -- 172.21.15.144:0/1039066616 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8037070 con 0x7fd5e0144020 2024-05-30T16:48:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.331+0000 7fd5dea00640 1 -- 172.21.15.144:0/1039066616 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d802ae20 con 0x7fd5e0144020 2024-05-30T16:48:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.331+0000 7fd5dea00640 1 -- 172.21.15.144:0/1039066616 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8032660 con 0x7fd5e0144020 2024-05-30T16:48:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.331+0000 7fd5e6000640 1 -- 172.21.15.144:0/1039066616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e0144020 msgr2=0x7fd5e006e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.331+0000 7fd5e6000640 1 --2- 172.21.15.144:0/1039066616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e0144020 0x7fd5e006e710 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0070180 tx=0x7fd5d802a110 comp rx=0 tx=0).stop 2024-05-30T16:48:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.331+0000 7fd5e6000640 1 -- 172.21.15.144:0/1039066616 shutdown_connections 2024-05-30T16:48:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.331+0000 7fd5e6000640 1 --2- 172.21.15.144:0/1039066616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e0144020 0x7fd5e006e710 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.331+0000 7fd5e6000640 1 --2- 172.21.15.144:0/1039066616 >> v2:172.21.15.149:3300/0 conn(0x7fd5e0141510 0x7fd5e01418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.331+0000 7fd5e6000640 1 -- 172.21.15.144:0/1039066616 >> 172.21.15.144:0/1039066616 conn(0x7fd5e006bd00 msgr2=0x7fd5e006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.332+0000 7fd5e6000640 1 -- 172.21.15.144:0/1039066616 shutdown_connections 2024-05-30T16:48:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.332+0000 7fd5e6000640 1 -- 172.21.15.144:0/1039066616 wait complete. 2024-05-30T16:48:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.333+0000 7fd5e6000640 1 Processor -- start 2024-05-30T16:48:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.333+0000 7fd5e6000640 1 -- start start 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.334+0000 7fd5e6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e0141510 0x7fd5e01f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.334+0000 7fd5e6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e0144020 0x7fd5e0131480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.334+0000 7fd5e6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e015f8f0 0x7fd5e01319c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.334+0000 7fd5e6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e006e210 con 0x7fd5e015f8f0 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.334+0000 7fd5e6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e0144d50 con 0x7fd5e0141510 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.334+0000 7fd5e6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e0144490 con 0x7fd5e0144020 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.334+0000 7fd5dfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e015f8f0 0x7fd5e01319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5dfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e015f8f0 0x7fd5e01319c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45762/0 (socket says 172.21.15.144:45762) 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5dfe00640 1 -- 172.21.15.144:0/2978036397 learned_addr learned my addr 172.21.15.144:0/2978036397 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5dfe00640 1 -- 172.21.15.144:0/2978036397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e0144020 msgr2=0x7fd5e0131480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5df400640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e0141510 0x7fd5e01f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5d6a00640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e0144020 0x7fd5e0131480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5dfe00640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e0144020 0x7fd5e0131480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5dfe00640 1 -- 172.21.15.144:0/2978036397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e0141510 msgr2=0x7fd5e01f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5dfe00640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e0141510 0x7fd5e01f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5dfe00640 1 -- 172.21.15.144:0/2978036397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e0147620 con 0x7fd5e015f8f0 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5df400640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e0141510 0x7fd5e01f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.335+0000 7fd5dfe00640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e015f8f0 0x7fd5e01319c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd5d802a150 tx=0x7fd5d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.336+0000 7fd5d7e00640 1 -- 172.21.15.144:0/2978036397 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8042070 con 0x7fd5e015f8f0 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.336+0000 7fd5d7e00640 1 -- 172.21.15.144:0/2978036397 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d803e670 con 0x7fd5e015f8f0 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.336+0000 7fd5d7e00640 1 -- 172.21.15.144:0/2978036397 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8037040 con 0x7fd5e015f8f0 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.336+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e0147900 con 0x7fd5e015f8f0 2024-05-30T16:48:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.336+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e0147ec0 con 0x7fd5e015f8f0 2024-05-30T16:48:34.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.337+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e0068b90 con 0x7fd5e015f8f0 2024-05-30T16:48:34.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.338+0000 7fd5d7e00640 1 -- 172.21.15.144:0/2978036397 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 91856+0+0 (secure 0 0 0) 0x7fd5d8045070 con 0x7fd5e015f8f0 2024-05-30T16:48:34.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.339+0000 7fd5d7e00640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5bc06d1f0 0x7fd5bc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.339+0000 7fd5d7e00640 1 -- 172.21.15.144:0/2978036397 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fd5d80aabf0 con 0x7fd5e015f8f0 2024-05-30T16:48:34.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.339+0000 7fd5df400640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5bc06d1f0 0x7fd5bc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.340+0000 7fd5df400640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5bc06d1f0 0x7fd5bc06f6b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0007eb0 tx=0x7fd5d00073c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:34.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.343+0000 7fd5d7e00640 1 -- 172.21.15.144:0/2978036397 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5d802ae20 con 0x7fd5e015f8f0 2024-05-30T16:48:34.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.575+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone56761", "target": ["mon-mgr", ""]}) -- 0x7fd5e01f4f10 con 0x7fd5bc06d1f0 2024-05-30T16:48:34.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.703+0000 7fd5d7e00640 1 -- 172.21.15.144:0/2978036397 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd5e01f4f10 con 0x7fd5bc06d1f0 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5bc06d1f0 msgr2=0x7fd5bc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5bc06d1f0 0x7fd5bc06f6b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0007eb0 tx=0x7fd5d00073c0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e015f8f0 msgr2=0x7fd5e01319c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e015f8f0 0x7fd5e01319c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd5d802a150 tx=0x7fd5d80046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 shutdown_connections 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd5bc06d1f0 0x7fd5bc06f6b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e015f8f0 0x7fd5e01319c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e0144020 0x7fd5e0131480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 --2- 172.21.15.144:0/2978036397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e0141510 0x7fd5e01f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 >> 172.21.15.144:0/2978036397 conn(0x7fd5e006bd00 msgr2=0x7fd5e006e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:34.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.706+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 shutdown_connections 2024-05-30T16:48:34.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.707+0000 7fd5e6000640 1 -- 172.21.15.144:0/2978036397 wait complete. 2024-05-30T16:48:34.709 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.709+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.709 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.709+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.709 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.709+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.709 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.709+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.709 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.709+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone56762 2024-05-30T16:48:34.728 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.728+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.728 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.728+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.728 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.728+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.728 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.728+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.729 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:34.728+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:34.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.915+0000 7f746e200640 1 Processor -- start 2024-05-30T16:48:34.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.916+0000 7f746e200640 1 -- start start 2024-05-30T16:48:34.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.917+0000 7f746e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680d1260 0x7f74680b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.917+0000 7f746e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74680cf3c0 0x7f74680cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.917+0000 7f746e200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74680d2a90 con 0x7f74680d1640 2024-05-30T16:48:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.917+0000 7f746e200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f74680d36a0 con 0x7f74680cf3c0 2024-05-30T16:48:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.917+0000 7f746e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f74680d2d70 con 0x7f74680d1260 2024-05-30T16:48:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.917+0000 7f7467e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f74680d1640 0x7f74680d22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51860/0 (socket says 172.21.15.144:51860) 2024-05-30T16:48:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.917+0000 7f7467e00640 1 -- 172.21.15.144:0/1086867512 learned_addr learned my addr 172.21.15.144:0/1086867512 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.918+0000 7f746d800640 1 --2- 172.21.15.144:0/1086867512 >> v2:172.21.15.144:3300/0 conn(0x7f74680cf3c0 0x7f74680cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.918+0000 7f746ce00640 1 --2- 172.21.15.144:0/1086867512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680d1260 0x7f74680b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.918+0000 7f7467400640 1 -- 172.21.15.144:0/1086867512 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741905599 0 0) 0x7f74680d2a90 con 0x7f74680d1640 2024-05-30T16:48:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.918+0000 7f7467400640 1 -- 172.21.15.144:0/1086867512 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f744c003520 con 0x7f74680d1640 2024-05-30T16:48:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.918+0000 7f746d800640 1 -- 172.21.15.144:0/1086867512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680d1260 msgr2=0x7f74680b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.918+0000 7f746d800640 1 --2- 172.21.15.144:0/1086867512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680d1260 0x7f74680b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.918+0000 7f746d800640 1 -- 172.21.15.144:0/1086867512 >> v1:172.21.15.144:6789/0 conn(0x7f74680d1640 legacy=0x7f74680d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.918+0000 7f746d800640 1 -- 172.21.15.144:0/1086867512 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74680d3050 con 0x7f74680cf3c0 2024-05-30T16:48:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.918+0000 7f746ce00640 1 --2- 172.21.15.144:0/1086867512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680d1260 0x7f74680b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:48:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.919+0000 7f746d800640 1 --2- 172.21.15.144:0/1086867512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680cf3c0 0x7f74680cf810 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f74600097a0 tx=0x7f746002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3604dbf01a1eafc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.919+0000 7f7467400640 1 -- 172.21.15.144:0/1086867512 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460037070 con 0x7f74680cf3c0 2024-05-30T16:48:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.919+0000 7f7467400640 1 -- 172.21.15.144:0/1086867512 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7460032440 con 0x7f74680cf3c0 2024-05-30T16:48:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.919+0000 7f7467400640 1 -- 172.21.15.144:0/1086867512 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460032810 con 0x7f74680cf3c0 2024-05-30T16:48:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.920+0000 7f746e200640 1 -- 172.21.15.144:0/1086867512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680cf3c0 msgr2=0x7f74680cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.920+0000 7f746e200640 1 --2- 172.21.15.144:0/1086867512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680cf3c0 0x7f74680cf810 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f74600097a0 tx=0x7f746002a180 comp rx=0 tx=0).stop 2024-05-30T16:48:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.920+0000 7f746e200640 1 -- 172.21.15.144:0/1086867512 shutdown_connections 2024-05-30T16:48:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.920+0000 7f746e200640 1 --2- 172.21.15.144:0/1086867512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680cf3c0 0x7f74680cf810 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.920+0000 7f746e200640 1 --2- 172.21.15.144:0/1086867512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680d1260 0x7f74680b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.920+0000 7f746e200640 1 -- 172.21.15.144:0/1086867512 >> 172.21.15.144:0/1086867512 conn(0x7f746808bfc0 msgr2=0x7f74680d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.920+0000 7f746e200640 1 -- 172.21.15.144:0/1086867512 shutdown_connections 2024-05-30T16:48:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.920+0000 7f746e200640 1 -- 172.21.15.144:0/1086867512 wait complete. 2024-05-30T16:48:34.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.922+0000 7f746e200640 1 Processor -- start 2024-05-30T16:48:34.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.922+0000 7f746e200640 1 -- start start 2024-05-30T16:48:34.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.923+0000 7f746e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680cf3c0 0x7f7468157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.923+0000 7f746e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74680d1260 0x7f74680b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.923+0000 7f746e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680d1640 0x7f74680b8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.923+0000 7f746e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f74680cfed0 con 0x7f74680d1640 2024-05-30T16:48:34.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.923+0000 7f746e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f74680cfd50 con 0x7f74680d1260 2024-05-30T16:48:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.923+0000 7f746e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f74680d0050 con 0x7f74680cf3c0 2024-05-30T16:48:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.923+0000 7f746d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680d1640 0x7f74680b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.923+0000 7f746d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680d1640 0x7f74680b8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48646/0 (socket says 172.21.15.144:48646) 2024-05-30T16:48:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.923+0000 7f746d800640 1 -- 172.21.15.144:0/165063114 learned_addr learned my addr 172.21.15.144:0/165063114 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f746d800640 1 -- 172.21.15.144:0/165063114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680cf3c0 msgr2=0x7f7468157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f746ce00640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680cf3c0 0x7f7468157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f7467e00640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74680d1260 0x7f74680b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f746d800640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680cf3c0 0x7f7468157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f746d800640 1 -- 172.21.15.144:0/165063114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74680d1260 msgr2=0x7f74680b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f746d800640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74680d1260 0x7f74680b8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f746d800640 1 -- 172.21.15.144:0/165063114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746814a440 con 0x7f74680d1640 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f746d800640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680d1640 0x7f74680b8790 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f74600098c0 tx=0x7f74600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f7464c00640 1 -- 172.21.15.144:0/165063114 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460041020 con 0x7f74680d1640 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f7464c00640 1 -- 172.21.15.144:0/165063114 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746003d640 con 0x7f74680d1640 2024-05-30T16:48:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f7464c00640 1 -- 172.21.15.144:0/165063114 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460037040 con 0x7f74680d1640 2024-05-30T16:48:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.924+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746814a6e0 con 0x7f74680d1640 2024-05-30T16:48:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.925+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746814aca0 con 0x7f74680d1640 2024-05-30T16:48:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.926+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7468075570 con 0x7f74680d1640 2024-05-30T16:48:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.927+0000 7f7464c00640 1 -- 172.21.15.144:0/165063114 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 91856+0+0 (secure 0 0 0) 0x7f7460044020 con 0x7f74680d1640 2024-05-30T16:48:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.927+0000 7f7464c00640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f744406d220 0x7f744406f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.928+0000 7f7464c00640 1 -- 172.21.15.144:0/165063114 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f74600aab80 con 0x7f74680d1640 2024-05-30T16:48:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.928+0000 7f746ce00640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f744406d220 0x7f744406f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.928+0000 7f746ce00640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f744406d220 0x7f744406f6e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7458009f70 tx=0x7f745800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:34.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:34.932+0000 7f7464c00640 1 -- 172.21.15.144:0/165063114 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f746004b030 con 0x7f74680d1640 2024-05-30T16:48:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.170+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone56762", "target": ["mon-mgr", ""]}) -- 0x7f74680d5610 con 0x7f744406d220 2024-05-30T16:48:35.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.196+0000 7f7464c00640 1 -- 172.21.15.144:0/165063114 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 19) ==== 91958+0+0 (secure 0 0 0) 0x7f74600768f0 con 0x7f74680d1640 2024-05-30T16:48:35.712 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.711+0000 7fe1bb600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.712 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.711+0000 7fe1bb600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.712 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.711+0000 7fe1bb600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.712 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.711+0000 7fe1bb600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.712 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.711+0000 7fe1bb600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.859+0000 7f7464c00640 1 -- 172.21.15.144:0/165063114 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f74680d5610 con 0x7f744406d220 2024-05-30T16:48:35.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.862+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f744406d220 msgr2=0x7f744406f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:35.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f744406d220 0x7f744406f6e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7458009f70 tx=0x7f745800b040 comp rx=0 tx=0).stop 2024-05-30T16:48:35.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680d1640 msgr2=0x7f74680b8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:35.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680d1640 0x7f74680b8790 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f74600098c0 tx=0x7f74600046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:35.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 shutdown_connections 2024-05-30T16:48:35.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f744406d220 0x7f744406f6e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:35.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74680d1640 0x7f74680b8790 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:35.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74680d1260 0x7f74680b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:35.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 --2- 172.21.15.144:0/165063114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74680cf3c0 0x7f7468157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:35.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 >> 172.21.15.144:0/165063114 conn(0x7f746808bfc0 msgr2=0x7f74680b97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:35.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 shutdown_connections 2024-05-30T16:48:35.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:35.863+0000 7f746e200640 1 -- 172.21.15.144:0/165063114 wait complete. 2024-05-30T16:48:35.874 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.873+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.874 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.873+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.874 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.873+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.874 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.873+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.874 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:35.873+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:35.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone56763 2024-05-30T16:48:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.213+0000 7f2b6fa00640 1 Processor -- start 2024-05-30T16:48:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.213+0000 7f2b6fa00640 1 -- start start 2024-05-30T16:48:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.216+0000 7f2b6fa00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2b6814c630 0x7f2b680ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.216+0000 7f2b6fa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b680cea10 0x7f2b68072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.216+0000 7f2b6fa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b68072750 0x7f2b6806dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.216+0000 7f2b6fa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6806fbf0 con 0x7f2b68072750 2024-05-30T16:48:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.216+0000 7f2b6fa00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2b680cf050 con 0x7f2b6814c630 2024-05-30T16:48:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.216+0000 7f2b6fa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2b680cf330 con 0x7f2b680cea10 2024-05-30T16:48:36.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.217+0000 7f2b6da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b68072750 0x7f2b6806dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:36.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.217+0000 7f2b6da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b68072750 0x7f2b6806dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48696/0 (socket says 172.21.15.144:48696) 2024-05-30T16:48:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.217+0000 7f2b6da00640 1 -- 172.21.15.144:0/670915101 learned_addr learned my addr 172.21.15.144:0/670915101 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.217+0000 7f2b6d000640 1 --2- 172.21.15.144:0/670915101 >> v2:172.21.15.149:3300/0 conn(0x7f2b6814c630 0x7f2b680ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.218+0000 7f2b6da00640 1 -- 172.21.15.144:0/670915101 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b680cea10 msgr2=0x7f2b68072210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:48:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.218+0000 7f2b6da00640 1 --2- 172.21.15.144:0/670915101 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b680cea10 0x7f2b68072210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.218+0000 7f2b6da00640 1 -- 172.21.15.144:0/670915101 >> v2:172.21.15.149:3300/0 conn(0x7f2b6814c630 msgr2=0x7f2b680ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.218+0000 7f2b6da00640 1 --2- 172.21.15.144:0/670915101 >> v2:172.21.15.149:3300/0 conn(0x7f2b6814c630 0x7f2b680ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.218+0000 7f2b6da00640 1 -- 172.21.15.144:0/670915101 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b680cf610 con 0x7f2b68072750 2024-05-30T16:48:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.220+0000 7f2b6da00640 1 --2- 172.21.15.144:0/670915101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b68072750 0x7f2b6806dfc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2b680b6870 tx=0x7f2b5402a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9031b0081b7359c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.221+0000 7f2b67400640 1 -- 172.21.15.144:0/670915101 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54037070 con 0x7f2b68072750 2024-05-30T16:48:36.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.222+0000 7f2b67400640 1 -- 172.21.15.144:0/670915101 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b54032440 con 0x7f2b68072750 2024-05-30T16:48:36.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.223+0000 7f2b67400640 1 -- 172.21.15.144:0/670915101 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54037070 con 0x7f2b68072750 2024-05-30T16:48:36.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.223+0000 7f2b6fa00640 1 -- 172.21.15.144:0/670915101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b68072750 msgr2=0x7f2b6806dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:36.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.223+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/670915101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b68072750 0x7f2b6806dfc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2b680b6870 tx=0x7f2b5402a280 comp rx=0 tx=0).stop 2024-05-30T16:48:36.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.224+0000 7f2b6fa00640 1 -- 172.21.15.144:0/670915101 shutdown_connections 2024-05-30T16:48:36.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.224+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/670915101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b68072750 0x7f2b6806dfc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:36.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.224+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/670915101 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b680cea10 0x7f2b68072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:36.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.224+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/670915101 >> v2:172.21.15.149:3300/0 conn(0x7f2b6814c630 0x7f2b680ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:36.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.224+0000 7f2b6fa00640 1 -- 172.21.15.144:0/670915101 >> 172.21.15.144:0/670915101 conn(0x7f2b6806bd00 msgr2=0x7f2b6806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:36.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.224+0000 7f2b6fa00640 1 -- 172.21.15.144:0/670915101 shutdown_connections 2024-05-30T16:48:36.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.224+0000 7f2b6fa00640 1 -- 172.21.15.144:0/670915101 wait complete. 2024-05-30T16:48:36.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.229+0000 7f2b6fa00640 1 Processor -- start 2024-05-30T16:48:36.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.230+0000 7f2b6fa00640 1 -- start start 2024-05-30T16:48:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.231+0000 7f2b6fa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b68072750 0x7f2b681e2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.231+0000 7f2b6fa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b680cea10 0x7f2b681e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.231+0000 7f2b6fa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6814c630 0x7f2b681e5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.232+0000 7f2b6fa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6814ca10 con 0x7f2b6814c630 2024-05-30T16:48:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.232+0000 7f2b6fa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2b680b3c20 con 0x7f2b680cea10 2024-05-30T16:48:36.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.232+0000 7f2b6fa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6814cb90 con 0x7f2b68072750 2024-05-30T16:48:36.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.233+0000 7f2b6d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b68072750 0x7f2b681e2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:36.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.233+0000 7f2b67e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b680cea10 0x7f2b681e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:36.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.233+0000 7f2b67e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b680cea10 0x7f2b681e53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:57494/0 (socket says 172.21.15.144:57494) 2024-05-30T16:48:36.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.233+0000 7f2b67e00640 1 -- 172.21.15.144:0/2650081383 learned_addr learned my addr 172.21.15.144:0/2650081383 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:36.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.233+0000 7f2b6da00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6814c630 0x7f2b681e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:36.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.234+0000 7f2b67e00640 1 -- 172.21.15.144:0/2650081383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b68072750 msgr2=0x7f2b681e2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:36.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.234+0000 7f2b67e00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b68072750 0x7f2b681e2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:36.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.234+0000 7f2b67e00640 1 -- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6814c630 msgr2=0x7f2b681e5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:36.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.234+0000 7f2b67e00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6814c630 0x7f2b681e5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:36.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.234+0000 7f2b67e00640 1 -- 172.21.15.144:0/2650081383 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b681e7400 con 0x7f2b680cea10 2024-05-30T16:48:36.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.234+0000 7f2b6da00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6814c630 0x7f2b681e5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:36.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.235+0000 7f2b67e00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b680cea10 0x7f2b681e53f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800b450 tx=0x7f2b5800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:36.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.237+0000 7f2b64c00640 1 -- 172.21.15.144:0/2650081383 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58015020 con 0x7f2b680cea10 2024-05-30T16:48:36.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.237+0000 7f2b64c00640 1 -- 172.21.15.144:0/2650081383 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b580118b0 con 0x7f2b680cea10 2024-05-30T16:48:36.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.237+0000 7f2b64c00640 1 -- 172.21.15.144:0/2650081383 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58011ca0 con 0x7f2b680cea10 2024-05-30T16:48:36.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.238+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b681e76e0 con 0x7f2b680cea10 2024-05-30T16:48:36.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.238+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b681e7110 con 0x7f2b680cea10 2024-05-30T16:48:36.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.245+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b40005290 con 0x7f2b680cea10 2024-05-30T16:48:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.250+0000 7f2b64c00640 1 -- 172.21.15.144:0/2650081383 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) ==== 91958+0+0 (secure 0 0 0) 0x7f2b58018020 con 0x7f2b680cea10 2024-05-30T16:48:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.252+0000 7f2b64c00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b4806d3e0 0x7f2b4806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.255+0000 7f2b64c00640 1 -- 172.21.15.144:0/2650081383 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f2b5808a800 con 0x7f2b680cea10 2024-05-30T16:48:36.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.257+0000 7f2b64c00640 1 -- 172.21.15.144:0/2650081383 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b5801f020 con 0x7f2b680cea10 2024-05-30T16:48:36.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.257+0000 7f2b6d000640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b4806d3e0 0x7f2b4806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:36.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.272+0000 7f2b6d000640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b4806d3e0 0x7f2b4806f8a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2b600070b0 tx=0x7f2b60007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:36.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:36.755+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone56763", "target": ["mon-mgr", ""]}) -- 0x7f2b40000c80 con 0x7f2b4806d3e0 2024-05-30T16:48:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.251+0000 7f2b64c00640 1 -- 172.21.15.144:0/2650081383 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mgrmap(e 20) ==== 92060+0+0 (secure 0 0 0) 0x7f2b5800f050 con 0x7f2b680cea10 2024-05-30T16:48:37.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.665+0000 7f2b64c00640 1 -- 172.21.15.144:0/2650081383 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2b40000c80 con 0x7f2b4806d3e0 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b4806d3e0 msgr2=0x7f2b4806f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b4806d3e0 0x7f2b4806f8a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2b600070b0 tx=0x7f2b60007040 comp rx=0 tx=0).stop 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b680cea10 msgr2=0x7f2b681e53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b680cea10 0x7f2b681e53f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800b450 tx=0x7f2b5800b910 comp rx=0 tx=0).stop 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 shutdown_connections 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2b4806d3e0 0x7f2b4806f8a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6814c630 0x7f2b681e5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b680cea10 0x7f2b681e53f0 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800b450 tx=0x7f2b5800b910 comp rx=0 tx=0).stop 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 --2- 172.21.15.144:0/2650081383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b68072750 0x7f2b681e2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.673+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 >> 172.21.15.144:0/2650081383 conn(0x7f2b6806bd00 msgr2=0x7f2b680ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:37.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.677+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 shutdown_connections 2024-05-30T16:48:37.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:37.678+0000 7f2b6fa00640 1 -- 172.21.15.144:0/2650081383 wait complete. 2024-05-30T16:48:37.700 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:37.698+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:37.700 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:37.698+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:37.700 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:37.698+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:37.700 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:37.698+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:37.700 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:37.698+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:37.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone56764 2024-05-30T16:48:38.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.178+0000 7fef75600640 1 Processor -- start 2024-05-30T16:48:38.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.178+0000 7fef75600640 1 -- start start 2024-05-30T16:48:38.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.180+0000 7fef75600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fef70072470 0x7fef7015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:38.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.182+0000 7fef6e000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fef70143410 0x7fef70071d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:43752/0 (socket says 172.21.15.144:43752) 2024-05-30T16:48:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.182+0000 7fef6ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fef70062980 0x7fef700cd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51872/0 (socket says 172.21.15.144:51872) 2024-05-30T16:48:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.182+0000 7fef6e000640 1 -- 172.21.15.144:0/1070710651 learned_addr learned my addr 172.21.15.144:0/1070710651 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.183+0000 7fef6f400640 1 --2- 172.21.15.144:0/1070710651 >> v2:172.21.15.149:3300/0 conn(0x7fef70072470 0x7fef7015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.183+0000 7fef75600640 1 -- 172.21.15.144:0/1070710651 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700ce020 con 0x7fef70062980 2024-05-30T16:48:38.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.184+0000 7fef75600640 1 -- 172.21.15.144:0/1070710651 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700ce300 con 0x7fef70143410 2024-05-30T16:48:38.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.184+0000 7fef75600640 1 -- 172.21.15.144:0/1070710651 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fef700ce950 con 0x7fef70072470 2024-05-30T16:48:38.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.187+0000 7fef6f400640 1 -- 172.21.15.144:0/1070710651 >> v1:172.21.15.149:6789/0 conn(0x7fef70143410 legacy=0x7fef70071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:38.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.187+0000 7fef6f400640 1 -- 172.21.15.144:0/1070710651 >> v1:172.21.15.144:6789/0 conn(0x7fef70062980 legacy=0x7fef700cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:38.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.187+0000 7fef6f400640 1 -- 172.21.15.144:0/1070710651 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef700ce5e0 con 0x7fef70072470 2024-05-30T16:48:38.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.192+0000 7fef6f400640 1 --2- 172.21.15.144:0/1070710651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70072470 0x7fef7015bc80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fef600097a0 tx=0x7fef6002a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e6069d13e0642e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:38.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.197+0000 7fef6d600640 1 -- 172.21.15.144:0/1070710651 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60037070 con 0x7fef70072470 2024-05-30T16:48:38.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.197+0000 7fef6d600640 1 -- 172.21.15.144:0/1070710651 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef60032640 con 0x7fef70072470 2024-05-30T16:48:38.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.197+0000 7fef6d600640 1 -- 172.21.15.144:0/1070710651 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60032a50 con 0x7fef70072470 2024-05-30T16:48:38.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.199+0000 7fef75600640 1 -- 172.21.15.144:0/1070710651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70072470 msgr2=0x7fef7015bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:38.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.199+0000 7fef75600640 1 --2- 172.21.15.144:0/1070710651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70072470 0x7fef7015bc80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fef600097a0 tx=0x7fef6002a2e0 comp rx=0 tx=0).stop 2024-05-30T16:48:38.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.203+0000 7fef75600640 1 -- 172.21.15.144:0/1070710651 shutdown_connections 2024-05-30T16:48:38.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.203+0000 7fef75600640 1 --2- 172.21.15.144:0/1070710651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70072470 0x7fef7015bc80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:38.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.203+0000 7fef75600640 1 -- 172.21.15.144:0/1070710651 >> 172.21.15.144:0/1070710651 conn(0x7fef70062570 msgr2=0x7fef7006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:38.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.203+0000 7fef75600640 1 -- 172.21.15.144:0/1070710651 shutdown_connections 2024-05-30T16:48:38.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.204+0000 7fef75600640 1 -- 172.21.15.144:0/1070710651 wait complete. 2024-05-30T16:48:38.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.208+0000 7fef75600640 1 Processor -- start 2024-05-30T16:48:38.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.209+0000 7fef75600640 1 -- start start 2024-05-30T16:48:38.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.212+0000 7fef75600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70062980 0x7fef701655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:38.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.212+0000 7fef75600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef70072470 0x7fef7015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:38.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.212+0000 7fef75600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef70143410 0x7fef7015b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:38.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.214+0000 7fef75600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fef700d0280 con 0x7fef70143410 2024-05-30T16:48:38.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.214+0000 7fef75600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef700d0100 con 0x7fef70062980 2024-05-30T16:48:38.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.214+0000 7fef75600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fef70167500 con 0x7fef70072470 2024-05-30T16:48:38.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.213+0000 7fef6e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef70072470 0x7fef7015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:38.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.214+0000 7fef6e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef70072470 0x7fef7015b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:59256/0 (socket says 172.21.15.144:59256) 2024-05-30T16:48:38.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.214+0000 7fef6e000640 1 -- 172.21.15.144:0/3968623378 learned_addr learned my addr 172.21.15.144:0/3968623378 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:38.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.214+0000 7fef6ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70062980 0x7fef701655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:38.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.216+0000 7fef6f400640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef70143410 0x7fef7015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:38.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.218+0000 7fef6ea00640 1 -- 172.21.15.144:0/3968623378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef70072470 msgr2=0x7fef7015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:38.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.218+0000 7fef6ea00640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef70072470 0x7fef7015b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:38.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.218+0000 7fef6ea00640 1 -- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef70143410 msgr2=0x7fef7015b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:38.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.218+0000 7fef6ea00640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef70143410 0x7fef7015b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:38.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.218+0000 7fef6ea00640 1 -- 172.21.15.144:0/3968623378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef70165f10 con 0x7fef70062980 2024-05-30T16:48:38.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.218+0000 7fef6f400640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef70143410 0x7fef7015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:38.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.219+0000 7fef6e000640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef70072470 0x7fef7015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:38.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.220+0000 7fef6ea00640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70062980 0x7fef701655a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c730 tx=0x7fef6800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:38.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.221+0000 7fef66a00640 1 -- 172.21.15.144:0/3968623378 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68017070 con 0x7fef70062980 2024-05-30T16:48:38.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.227+0000 7fef66a00640 1 -- 172.21.15.144:0/3968623378 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6800ce40 con 0x7fef70062980 2024-05-30T16:48:38.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.227+0000 7fef66a00640 1 -- 172.21.15.144:0/3968623378 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6800a7e0 con 0x7fef70062980 2024-05-30T16:48:38.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.228+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef701661f0 con 0x7fef70062980 2024-05-30T16:48:38.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.228+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef701667b0 con 0x7fef70062980 2024-05-30T16:48:38.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.230+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef70075570 con 0x7fef70062980 2024-05-30T16:48:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.242+0000 7fef66a00640 1 -- 172.21.15.144:0/3968623378 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 20) ==== 92060+0+0 (secure 0 0 0) 0x7fef6801a070 con 0x7fef70062980 2024-05-30T16:48:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.244+0000 7fef66a00640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fef5006d430 0x7fef5006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.246+0000 7fef66a00640 1 -- 172.21.15.144:0/3968623378 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fef68057720 con 0x7fef70062980 2024-05-30T16:48:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.246+0000 7fef66a00640 1 -- 172.21.15.144:0/3968623378 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef68059680 con 0x7fef70062980 2024-05-30T16:48:38.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.251+0000 7fef6e000640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fef5006d430 0x7fef5006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:38.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.253+0000 7fef6e000640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fef5006d430 0x7fef5006f8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fef70165530 tx=0x7fef5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:38.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:38.802+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone56764", "target": ["mon-mgr", ""]}) -- 0x7fef70072fb0 con 0x7fef5006d430 2024-05-30T16:48:39.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.324+0000 7fef66a00640 1 -- 172.21.15.144:0/3968623378 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mgrmap(e 21) ==== 92111+0+0 (secure 0 0 0) 0x7fef68055cf0 con 0x7fef70062980 2024-05-30T16:48:39.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.564+0000 7fef66a00640 1 -- 172.21.15.144:0/3968623378 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fef70072fb0 con 0x7fef5006d430 2024-05-30T16:48:39.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fef5006d430 msgr2=0x7fef5006f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:39.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fef5006d430 0x7fef5006f8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fef70165530 tx=0x7fef5c009040 comp rx=0 tx=0).stop 2024-05-30T16:48:39.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70062980 msgr2=0x7fef701655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:39.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70062980 0x7fef701655a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c730 tx=0x7fef6800cbf0 comp rx=0 tx=0).stop 2024-05-30T16:48:39.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 shutdown_connections 2024-05-30T16:48:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fef5006d430 0x7fef5006f8f0 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fef70165530 tx=0x7fef5c009040 comp rx=0 tx=0).stop 2024-05-30T16:48:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef70143410 0x7fef7015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef70072470 0x7fef7015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 --2- 172.21.15.144:0/3968623378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef70062980 0x7fef701655a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.572+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 >> 172.21.15.144:0/3968623378 conn(0x7fef70062570 msgr2=0x7fef701428f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.573+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 shutdown_connections 2024-05-30T16:48:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:39.573+0000 7fef75600640 1 -- 172.21.15.144:0/3968623378 wait complete. 2024-05-30T16:48:39.622 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone56765 2024-05-30T16:48:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.095+0000 7fc3f2c00640 1 Processor -- start 2024-05-30T16:48:40.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.096+0000 7fc3f2c00640 1 -- start start 2024-05-30T16:48:40.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.100+0000 7fc3f2c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc3ec072210 0x7fc3ec072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.101+0000 7fc3f2c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec072b70 con 0x7fc3ec0b4140 2024-05-30T16:48:40.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.101+0000 7fc3f2c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec06fbf0 con 0x7fc3ec14c630 2024-05-30T16:48:40.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.101+0000 7fc3f2c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc3ec0cf050 con 0x7fc3ec072210 2024-05-30T16:48:40.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.101+0000 7fc3ebe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc3ec14c630 0x7fc3ec0ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:43758/0 (socket says 172.21.15.144:43758) 2024-05-30T16:48:40.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.101+0000 7fc3ebe00640 1 -- 172.21.15.144:0/1435759603 learned_addr learned my addr 172.21.15.144:0/1435759603 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:40.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.103+0000 7fc3eb400640 1 --2- 172.21.15.144:0/1435759603 >> v2:172.21.15.144:3300/0 conn(0x7fc3ec072210 0x7fc3ec072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.103+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306379479 0 0) 0x7fc3ec06fbf0 con 0x7fc3ec14c630 2024-05-30T16:48:40.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.103+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d0003520 con 0x7fc3ec14c630 2024-05-30T16:48:40.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.105+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059454871 0 0) 0x7fc3ec072b70 con 0x7fc3ec0b4140 2024-05-30T16:48:40.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.105+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec06fbf0 con 0x7fc3ec0b4140 2024-05-30T16:48:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2653157326 0 0) 0x7fc3ec06fbf0 con 0x7fc3ec0b4140 2024-05-30T16:48:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 >> v2:172.21.15.144:3300/0 conn(0x7fc3ec072210 msgr2=0x7fc3ec072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 --2- 172.21.15.144:0/1435759603 >> v2:172.21.15.144:3300/0 conn(0x7fc3ec072210 0x7fc3ec072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 >> v1:172.21.15.149:6789/0 conn(0x7fc3ec14c630 legacy=0x7fc3ec0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec0cf330 con 0x7fc3ec0b4140 2024-05-30T16:48:40.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fc3e40019d0 con 0x7fc3ec0b4140 2024-05-30T16:48:40.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 >> v1:172.21.15.144:6789/0 conn(0x7fc3ec0b4140 legacy=0x7fc3ec0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0003b90 0x7fc3d0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3d0004800 0x7fc3d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3d0005210 0x7fc3d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec0cf050 con 0x7fc3d0003b90 2024-05-30T16:48:40.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d000c160 con 0x7fc3d0005210 2024-05-30T16:48:40.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.107+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d000c360 con 0x7fc3d0004800 2024-05-30T16:48:40.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.111+0000 7fc3ebe00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0003b90 0x7fc3d0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.113+0000 7fc3eb400640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3d0004800 0x7fc3d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.113+0000 7fc3f0c00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3d0005210 0x7fc3d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.114+0000 7fc3f0c00640 1 -- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3d0004800 msgr2=0x7fc3d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:40.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.114+0000 7fc3f0c00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3d0004800 0x7fc3d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.114+0000 7fc3f0c00640 1 -- 172.21.15.144:0/1435759603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0003b90 msgr2=0x7fc3d0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:40.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.114+0000 7fc3f0c00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0003b90 0x7fc3d0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.114+0000 7fc3f0c00640 1 -- 172.21.15.144:0/1435759603 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec06fbf0 con 0x7fc3d0005210 2024-05-30T16:48:40.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.115+0000 7fc3f0c00640 1 -- 172.21.15.144:0/1435759603 reap_dead start 2024-05-30T16:48:40.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.117+0000 7fc3f0c00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3d0005210 0x7fc3d000b9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400c320 tx=0x7fc3d0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f1a0bc5d18f2162 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:40.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.119+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4036070 con 0x7fc3d0005210 2024-05-30T16:48:40.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.121+0000 7fc3eaa00640 1 -- 172.21.15.144:0/1435759603 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e402d070 con 0x7fc3d0005210 2024-05-30T16:48:40.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.122+0000 7fc3f2c00640 1 -- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3d0005210 msgr2=0x7fc3d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.122+0000 7fc3f2c00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3d0005210 0x7fc3d000b9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400c320 tx=0x7fc3d0005830 comp rx=0 tx=0).stop 2024-05-30T16:48:40.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.123+0000 7fc3f2c00640 1 -- 172.21.15.144:0/1435759603 shutdown_connections 2024-05-30T16:48:40.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.123+0000 7fc3f2c00640 1 --2- 172.21.15.144:0/1435759603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3d0005210 0x7fc3d000b9c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.123+0000 7fc3f2c00640 1 -- 172.21.15.144:0/1435759603 >> 172.21.15.144:0/1435759603 conn(0x7fc3ec06bd00 msgr2=0x7fc3ec06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:40.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.124+0000 7fc3f2c00640 1 -- 172.21.15.144:0/1435759603 shutdown_connections 2024-05-30T16:48:40.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.125+0000 7fc3f2c00640 1 -- 172.21.15.144:0/1435759603 wait complete. 2024-05-30T16:48:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.130+0000 7fc3f2c00640 1 Processor -- start 2024-05-30T16:48:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.130+0000 7fc3f2c00640 1 -- start start 2024-05-30T16:48:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.133+0000 7fc3f2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0005210 0x7fc3ec0a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.133+0000 7fc3f2c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ec1457a0 0x7fc3ec0a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.133+0000 7fc3f2c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec1f8c00 0x7fc3ec1f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.133+0000 7fc3f2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec0b3c20 con 0x7fc3d0005210 2024-05-30T16:48:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.133+0000 7fc3f2c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec0cf8f0 con 0x7fc3ec1f8c00 2024-05-30T16:48:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.133+0000 7fc3f2c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ec14ca10 con 0x7fc3ec1457a0 2024-05-30T16:48:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.135+0000 7fc3eb400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ec1457a0 0x7fc3ec0a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.135+0000 7fc3ebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0005210 0x7fc3ec0a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.135+0000 7fc3ebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0005210 0x7fc3ec0a9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48738/0 (socket says 172.21.15.144:48738) 2024-05-30T16:48:40.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.135+0000 7fc3ebe00640 1 -- 172.21.15.144:0/3953417518 learned_addr learned my addr 172.21.15.144:0/3953417518 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:40.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.136+0000 7fc3f0c00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec1f8c00 0x7fc3ec1f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.138+0000 7fc3eb400640 1 -- 172.21.15.144:0/3953417518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec1f8c00 msgr2=0x7fc3ec1f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.138+0000 7fc3eb400640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec1f8c00 0x7fc3ec1f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.138+0000 7fc3eb400640 1 -- 172.21.15.144:0/3953417518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0005210 msgr2=0x7fc3ec0a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.138+0000 7fc3eb400640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0005210 0x7fc3ec0a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.138+0000 7fc3eb400640 1 -- 172.21.15.144:0/3953417518 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec0aafa0 con 0x7fc3ec1457a0 2024-05-30T16:48:40.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.150+0000 7fc3eb400640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ec1457a0 0x7fc3ec0a9ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00f4c0 tx=0x7fc3dc00f980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:40.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.152+0000 7fc3e3e00640 1 -- 172.21.15.144:0/3953417518 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc004440 con 0x7fc3ec1457a0 2024-05-30T16:48:40.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.152+0000 7fc3e3e00640 1 -- 172.21.15.144:0/3953417518 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3dc01a070 con 0x7fc3ec1457a0 2024-05-30T16:48:40.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.152+0000 7fc3e3e00640 1 -- 172.21.15.144:0/3953417518 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc003830 con 0x7fc3ec1457a0 2024-05-30T16:48:40.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.153+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec0ab280 con 0x7fc3ec1457a0 2024-05-30T16:48:40.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.153+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ec0ab840 con 0x7fc3ec1457a0 2024-05-30T16:48:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.156+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ec068b90 con 0x7fc3ec1457a0 2024-05-30T16:48:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.160+0000 7fc3e3e00640 1 -- 172.21.15.144:0/3953417518 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 21) ==== 92111+0+0 (secure 0 0 0) 0x7fc3dc012070 con 0x7fc3ec1457a0 2024-05-30T16:48:40.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.162+0000 7fc3e3e00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc3cc06d5c0 0x7fc3cc06fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:40.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.163+0000 7fc3e3e00640 1 -- 172.21.15.144:0/3953417518 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fc3dc08a7a0 con 0x7fc3ec1457a0 2024-05-30T16:48:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.166+0000 7fc3e3e00640 1 -- 172.21.15.144:0/3953417518 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3dc059d70 con 0x7fc3ec1457a0 2024-05-30T16:48:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.196+0000 7fc3ebe00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc3cc06d5c0 0x7fc3cc06fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:40.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.215+0000 7fc3ebe00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc3cc06d5c0 0x7fc3cc06fa80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0ce500 tx=0x7fc3d8007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:40.704+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone56765", "target": ["mon-mgr", ""]}) -- 0x7fc3ec075f70 con 0x7fc3cc06d5c0 2024-05-30T16:48:41.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.845+0000 7fc3e3e00640 1 -- 172.21.15.144:0/3953417518 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc3d80015f0 con 0x7fc3cc06d5c0 2024-05-30T16:48:41.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.859+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc3cc06d5c0 msgr2=0x7fc3cc06fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.859+0000 7fc3f2c00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc3cc06d5c0 0x7fc3cc06fa80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0ce500 tx=0x7fc3d8007d70 comp rx=0 tx=0).stop 2024-05-30T16:48:41.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.859+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ec1457a0 msgr2=0x7fc3ec0a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:41.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.859+0000 7fc3f2c00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ec1457a0 0x7fc3ec0a9ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00f4c0 tx=0x7fc3dc00f980 comp rx=0 tx=0).stop 2024-05-30T16:48:41.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.862+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 shutdown_connections 2024-05-30T16:48:41.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.862+0000 7fc3f2c00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc3cc06d5c0 0x7fc3cc06fa80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.862+0000 7fc3f2c00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec1f8c00 0x7fc3ec1f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.862+0000 7fc3f2c00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3ec1457a0 0x7fc3ec0a9ab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.862+0000 7fc3f2c00640 1 --2- 172.21.15.144:0/3953417518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3d0005210 0x7fc3ec0a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:41.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.862+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 >> 172.21.15.144:0/3953417518 conn(0x7fc3ec06bd00 msgr2=0x7fc3ec0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:41.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.864+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 shutdown_connections 2024-05-30T16:48:41.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:41.864+0000 7fc3f2c00640 1 -- 172.21.15.144:0/3953417518 wait complete. 2024-05-30T16:48:41.933 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone56766 2024-05-30T16:48:42.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.422+0000 7f7870a00640 1 Processor -- start 2024-05-30T16:48:42.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.422+0000 7f7870a00640 1 -- start start 2024-05-30T16:48:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.425+0000 7f7870a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f786c0cc6c0 0x7f786c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.425+0000 7f7870a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786c16bb00 con 0x7f786c16eec0 2024-05-30T16:48:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.425+0000 7f7870a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786c16bde0 con 0x7f786c08b2c0 2024-05-30T16:48:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.425+0000 7f7870a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f786c16c8c0 con 0x7f786c0cc6c0 2024-05-30T16:48:42.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.426+0000 7f786be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f786c16eec0 0x7f786c16f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51888/0 (socket says 172.21.15.144:51888) 2024-05-30T16:48:42.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.426+0000 7f786be00640 1 -- 172.21.15.144:0/2074458027 learned_addr learned my addr 172.21.15.144:0/2074458027 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.429+0000 7f786aa00640 1 --2- 172.21.15.144:0/2074458027 >> v2:172.21.15.149:3300/0 conn(0x7f786c0cc6c0 0x7f786c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.432+0000 7f786aa00640 1 -- 172.21.15.144:0/2074458027 >> v1:172.21.15.149:6789/0 conn(0x7f786c08b2c0 legacy=0x7f786c08b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.432+0000 7f786aa00640 1 -- 172.21.15.144:0/2074458027 >> v1:172.21.15.144:6789/0 conn(0x7f786c16eec0 legacy=0x7f786c16f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.432+0000 7f786aa00640 1 -- 172.21.15.144:0/2074458027 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786c16c0c0 con 0x7f786c0cc6c0 2024-05-30T16:48:42.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.435+0000 7f786aa00640 1 --2- 172.21.15.144:0/2074458027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 0x7f786c0b4e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f785800a970 tx=0x7f785802b630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74415ebf0e62dfb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:42.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.438+0000 7f786a000640 1 -- 172.21.15.144:0/2074458027 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785800b040 con 0x7f786c0cc6c0 2024-05-30T16:48:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.439+0000 7f786a000640 1 -- 172.21.15.144:0/2074458027 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7858030710 con 0x7f786c0cc6c0 2024-05-30T16:48:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.439+0000 7f786a000640 1 -- 172.21.15.144:0/2074458027 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858030ae0 con 0x7f786c0cc6c0 2024-05-30T16:48:42.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.441+0000 7f7870a00640 1 -- 172.21.15.144:0/2074458027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 msgr2=0x7f786c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.441+0000 7f7870a00640 1 --2- 172.21.15.144:0/2074458027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 0x7f786c0b4e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f785800a970 tx=0x7f785802b630 comp rx=0 tx=0).stop 2024-05-30T16:48:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.441+0000 7f7870a00640 1 -- 172.21.15.144:0/2074458027 shutdown_connections 2024-05-30T16:48:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.441+0000 7f7870a00640 1 --2- 172.21.15.144:0/2074458027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 0x7f786c0b4e20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.441+0000 7f7870a00640 1 -- 172.21.15.144:0/2074458027 >> 172.21.15.144:0/2074458027 conn(0x7f786c0b2160 msgr2=0x7f786c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.442+0000 7f7870a00640 1 -- 172.21.15.144:0/2074458027 shutdown_connections 2024-05-30T16:48:42.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.442+0000 7f7870a00640 1 -- 172.21.15.144:0/2074458027 wait complete. 2024-05-30T16:48:42.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.450+0000 7f7870a00640 1 Processor -- start 2024-05-30T16:48:42.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.455+0000 7f7870a00640 1 -- start start 2024-05-30T16:48:42.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.465+0000 7f7870a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786c08b2c0 0x7f786c08ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.465+0000 7f7870a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 0x7f786c1f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.465+0000 7f7870a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f786c16eec0 0x7f786c169f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.465+0000 7f7870a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f786c16b7d0 con 0x7f786c08b2c0 2024-05-30T16:48:42.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.465+0000 7f7870a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f786c0b5720 con 0x7f786c0cc6c0 2024-05-30T16:48:42.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.465+0000 7f7870a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f786c0ce0a0 con 0x7f786c16eec0 2024-05-30T16:48:42.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.470+0000 7f786b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786c08b2c0 0x7f786c08ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.470+0000 7f786be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f786c16eec0 0x7f786c169f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.470+0000 7f786be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f786c16eec0 0x7f786c169f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:59290/0 (socket says 172.21.15.144:59290) 2024-05-30T16:48:42.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.470+0000 7f786be00640 1 -- 172.21.15.144:0/629069757 learned_addr learned my addr 172.21.15.144:0/629069757 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:42.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.472+0000 7f786aa00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 0x7f786c1f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.474+0000 7f786aa00640 1 -- 172.21.15.144:0/629069757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f786c16eec0 msgr2=0x7f786c169f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.475+0000 7f786aa00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f786c16eec0 0x7f786c169f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.475+0000 7f786aa00640 1 -- 172.21.15.144:0/629069757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786c08b2c0 msgr2=0x7f786c08ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:42.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.475+0000 7f786aa00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786c08b2c0 0x7f786c08ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:42.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.475+0000 7f786aa00640 1 -- 172.21.15.144:0/629069757 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786c207180 con 0x7f786c0cc6c0 2024-05-30T16:48:42.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.476+0000 7f786aa00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 0x7f786c1f5fa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7858032000 tx=0x7f78580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:42.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.477+0000 7f7863400640 1 -- 172.21.15.144:0/629069757 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785803f020 con 0x7f786c0cc6c0 2024-05-30T16:48:42.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.478+0000 7f7863400640 1 -- 172.21.15.144:0/629069757 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7858033cd0 con 0x7f786c0cc6c0 2024-05-30T16:48:42.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.478+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f786c207460 con 0x7f786c0cc6c0 2024-05-30T16:48:42.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.479+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f786c207a20 con 0x7f786c0cc6c0 2024-05-30T16:48:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.481+0000 7f7863400640 1 -- 172.21.15.144:0/629069757 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858033e80 con 0x7f786c0cc6c0 2024-05-30T16:48:42.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.489+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7844005290 con 0x7f786c0cc6c0 2024-05-30T16:48:42.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.490+0000 7f7863400640 1 -- 172.21.15.144:0/629069757 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 21) ==== 92111+0+0 (secure 0 0 0) 0x7f7858042020 con 0x7f786c0cc6c0 2024-05-30T16:48:42.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.497+0000 7f7863400640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f784c06d590 0x7f784c06fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:42.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.501+0000 7f7863400640 1 -- 172.21.15.144:0/629069757 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f78580ab000 con 0x7f786c0cc6c0 2024-05-30T16:48:42.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.502+0000 7f7863400640 1 -- 172.21.15.144:0/629069757 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7858049030 con 0x7f786c0cc6c0 2024-05-30T16:48:42.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.505+0000 7f786b400640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f784c06d590 0x7f784c06fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:42.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:42.518+0000 7f786b400640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f784c06d590 0x7f784c06fa50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f785c000f60 tx=0x7f785c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:43.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:43.159+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone56766", "target": ["mon-mgr", ""]}) -- 0x7f7844000c80 con 0x7f784c06d590 2024-05-30T16:48:44.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.207+0000 7f7863400640 1 -- 172.21.15.144:0/629069757 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7844000c80 con 0x7f784c06d590 2024-05-30T16:48:44.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.224+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f784c06d590 msgr2=0x7f784c06fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:44.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.224+0000 7f7870a00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f784c06d590 0x7f784c06fa50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f785c000f60 tx=0x7f785c009040 comp rx=0 tx=0).stop 2024-05-30T16:48:44.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.224+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 msgr2=0x7f786c1f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:44.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.224+0000 7f7870a00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 0x7f786c1f5fa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7858032000 tx=0x7f78580046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.225+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 shutdown_connections 2024-05-30T16:48:44.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.225+0000 7f7870a00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f784c06d590 0x7f784c06fa50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.225+0000 7f7870a00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f786c16eec0 0x7f786c169f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.225+0000 7f7870a00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f786c0cc6c0 0x7f786c1f5fa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.225+0000 7f7870a00640 1 --2- 172.21.15.144:0/629069757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786c08b2c0 0x7f786c08ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.225+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 >> 172.21.15.144:0/629069757 conn(0x7f786c0b2160 msgr2=0x7f786c1650a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:44.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.226+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 shutdown_connections 2024-05-30T16:48:44.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.226+0000 7f7870a00640 1 -- 172.21.15.144:0/629069757 wait complete. 2024-05-30T16:48:44.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone56767 2024-05-30T16:48:44.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.825+0000 7fa6df200640 1 Processor -- start 2024-05-30T16:48:44.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.825+0000 7fa6df200640 1 -- start start 2024-05-30T16:48:44.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.828+0000 7fa6df200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6e00b4f80 0x7fa6e006e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:44.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.830+0000 7fa6dde00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6e00b4f80 0x7fa6e006e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:44.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.830+0000 7fa6de800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa6e006fdc0 0x7fa6e015e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42928/0 (socket says 172.21.15.144:42928) 2024-05-30T16:48:44.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.830+0000 7fa6de800640 1 -- 172.21.15.144:0/442929383 learned_addr learned my addr 172.21.15.144:0/442929383 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:44.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.830+0000 7fa6df200640 1 -- 172.21.15.144:0/442929383 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6e00b56f0 con 0x7fa6e006fdc0 2024-05-30T16:48:44.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.830+0000 7fa6df200640 1 -- 172.21.15.144:0/442929383 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6e00cf290 con 0x7fa6e00b4910 2024-05-30T16:48:44.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.831+0000 7fa6df200640 1 -- 172.21.15.144:0/442929383 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa6e00cd2a0 con 0x7fa6e00b4f80 2024-05-30T16:48:44.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.832+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1470013123 0 0) 0x7fa6e00cf290 con 0x7fa6e00b4910 2024-05-30T16:48:44.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.832+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6c4003520 con 0x7fa6e00b4910 2024-05-30T16:48:44.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.832+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806807030 0 0) 0x7fa6e00b56f0 con 0x7fa6e006fdc0 2024-05-30T16:48:44.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.832+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e00cf290 con 0x7fa6e006fdc0 2024-05-30T16:48:44.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3333496569 0 0) 0x7fa6c4003520 con 0x7fa6e00b4910 2024-05-30T16:48:44.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 >> v2:172.21.15.149:3300/0 conn(0x7fa6e00b4f80 msgr2=0x7fa6e006e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:44.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 --2- 172.21.15.144:0/442929383 >> v2:172.21.15.149:3300/0 conn(0x7fa6e00b4f80 0x7fa6e006e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 >> v1:172.21.15.144:6789/0 conn(0x7fa6e006fdc0 legacy=0x7fa6e015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:44.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e00cf570 con 0x7fa6e00b4910 2024-05-30T16:48:44.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fa6cc0015a0 con 0x7fa6e00b4910 2024-05-30T16:48:44.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 >> v1:172.21.15.149:6789/0 conn(0x7fa6e00b4910 legacy=0x7fa6e015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:44.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c4003b90 0x7fa6c4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:44.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c4004800 0x7fa6c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:44.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:44.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e00cd2a0 con 0x7fa6c40051c0 2024-05-30T16:48:44.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c400c090 con 0x7fa6c4004800 2024-05-30T16:48:44.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c400c290 con 0x7fa6c4003b90 2024-05-30T16:48:44.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.833+0000 7fa6dde00640 1 --2- 172.21.15.144:0/442929383 >> v2:172.21.15.149:3300/0 conn(0x7fa6e00b4f80 0x7fa6e006e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:48:44.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.834+0000 7fa6dd400640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c4004800 0x7fa6c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:44.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.835+0000 7fa6de800640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:44.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.835+0000 7fa6dde00640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c4003b90 0x7fa6c4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:44.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.836+0000 7fa6de800640 1 -- 172.21.15.144:0/442929383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c4003b90 msgr2=0x7fa6c4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:44.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.836+0000 7fa6de800640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c4003b90 0x7fa6c4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.836+0000 7fa6de800640 1 -- 172.21.15.144:0/442929383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c4004800 msgr2=0x7fa6c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:44.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.836+0000 7fa6de800640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c4004800 0x7fa6c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.836+0000 7fa6de800640 1 -- 172.21.15.144:0/442929383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e00cf570 con 0x7fa6c40051c0 2024-05-30T16:48:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.838+0000 7fa6de800640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6c400b9c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00b00a0 tx=0x7fa6c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3feb423b5ce65c90 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.838+0000 7fa6de800640 1 -- 172.21.15.144:0/442929383 reap_dead start 2024-05-30T16:48:44.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.839+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8001f50 con 0x7fa6c40051c0 2024-05-30T16:48:44.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.839+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d8032630 con 0x7fa6c40051c0 2024-05-30T16:48:44.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.839+0000 7fa6dca00640 1 -- 172.21.15.144:0/442929383 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8032a20 con 0x7fa6c40051c0 2024-05-30T16:48:44.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.845+0000 7fa6df200640 1 -- 172.21.15.144:0/442929383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 msgr2=0x7fa6c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:44.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.845+0000 7fa6df200640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6c400b9c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00b00a0 tx=0x7fa6c4005830 comp rx=0 tx=0).stop 2024-05-30T16:48:44.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.850+0000 7fa6df200640 1 -- 172.21.15.144:0/442929383 shutdown_connections 2024-05-30T16:48:44.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.851+0000 7fa6df200640 1 --2- 172.21.15.144:0/442929383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6c400b9c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.851+0000 7fa6df200640 1 -- 172.21.15.144:0/442929383 >> 172.21.15.144:0/442929383 conn(0x7fa6e006b8e0 msgr2=0x7fa6e006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:44.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.852+0000 7fa6df200640 1 -- 172.21.15.144:0/442929383 shutdown_connections 2024-05-30T16:48:44.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.852+0000 7fa6df200640 1 -- 172.21.15.144:0/442929383 wait complete. 2024-05-30T16:48:44.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.858+0000 7fa6df200640 1 Processor -- start 2024-05-30T16:48:44.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.858+0000 7fa6df200640 1 -- start start 2024-05-30T16:48:44.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.861+0000 7fa6df200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6e014f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:44.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.862+0000 7fa6df200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e014bb30 0x7fa6e014d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:44.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.862+0000 7fa6df200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e01f0720 0x7fa6e01f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:44.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.862+0000 7fa6df200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e00cfef0 con 0x7fa6c40051c0 2024-05-30T16:48:44.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.862+0000 7fa6df200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e00cfd70 con 0x7fa6e014bb30 2024-05-30T16:48:44.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.862+0000 7fa6df200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e00d0070 con 0x7fa6e01f0720 2024-05-30T16:48:44.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.862+0000 7fa6dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6e014f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.862+0000 7fa6dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6e014f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59806/0 (socket says 172.21.15.144:59806) 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.862+0000 7fa6dde00640 1 -- 172.21.15.144:0/2997365234 learned_addr learned my addr 172.21.15.144:0/2997365234 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.864+0000 7fa6dd400640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e014bb30 0x7fa6e014d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.864+0000 7fa6de800640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e01f0720 0x7fa6e01f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.865+0000 7fa6dde00640 1 -- 172.21.15.144:0/2997365234 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e01f0720 msgr2=0x7fa6e01f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.865+0000 7fa6dde00640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e01f0720 0x7fa6e01f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.865+0000 7fa6dde00640 1 -- 172.21.15.144:0/2997365234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e014bb30 msgr2=0x7fa6e014d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.865+0000 7fa6dde00640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e014bb30 0x7fa6e014d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.865+0000 7fa6dde00640 1 -- 172.21.15.144:0/2997365234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e0153e50 con 0x7fa6c40051c0 2024-05-30T16:48:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.865+0000 7fa6dde00640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6e014f280 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0011cd0 tx=0x7fa6d000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:44.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.866+0000 7fa6d6000640 1 -- 172.21.15.144:0/2997365234 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000fd20 con 0x7fa6c40051c0 2024-05-30T16:48:44.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.866+0000 7fa6d6000640 1 -- 172.21.15.144:0/2997365234 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d001ab40 con 0x7fa6c40051c0 2024-05-30T16:48:44.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.866+0000 7fa6d6000640 1 -- 172.21.15.144:0/2997365234 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0004030 con 0x7fa6c40051c0 2024-05-30T16:48:44.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.867+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e0154130 con 0x7fa6c40051c0 2024-05-30T16:48:44.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.867+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e01546f0 con 0x7fa6c40051c0 2024-05-30T16:48:44.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.869+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e0075570 con 0x7fa6c40051c0 2024-05-30T16:48:44.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.873+0000 7fa6d6000640 1 -- 172.21.15.144:0/2997365234 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 92111+0+0 (secure 0 0 0) 0x7fa6d0012040 con 0x7fa6c40051c0 2024-05-30T16:48:44.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.876+0000 7fa6d6000640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6c006d4e0 0x7fa6c006f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:44.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.877+0000 7fa6d6000640 1 -- 172.21.15.144:0/2997365234 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fa6d0093120 con 0x7fa6c40051c0 2024-05-30T16:48:44.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.877+0000 7fa6dd400640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6c006d4e0 0x7fa6c006f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:44.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.883+0000 7fa6dd400640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6c006d4e0 0x7fa6c006f9a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc001710 tx=0x7fa6cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:44.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:44.894+0000 7fa6d6000640 1 -- 172.21.15.144:0/2997365234 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa6d0062730 con 0x7fa6c40051c0 2024-05-30T16:48:45.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:45.511+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone56767", "target": ["mon-mgr", ""]}) -- 0x7fa6e00cc770 con 0x7fa6c006d4e0 2024-05-30T16:48:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.520+0000 7fa6d6000640 1 -- 172.21.15.144:0/2997365234 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa6e00cc770 con 0x7fa6c006d4e0 2024-05-30T16:48:46.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6c006d4e0 msgr2=0x7fa6c006f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:46.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6c006d4e0 0x7fa6c006f9a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc001710 tx=0x7fa6cc009040 comp rx=0 tx=0).stop 2024-05-30T16:48:46.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 msgr2=0x7fa6e014f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:46.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6e014f280 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0011cd0 tx=0x7fa6d000f610 comp rx=0 tx=0).stop 2024-05-30T16:48:46.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 shutdown_connections 2024-05-30T16:48:46.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa6c006d4e0 0x7fa6c006f9a0 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc001710 tx=0x7fa6cc009040 comp rx=0 tx=0).stop 2024-05-30T16:48:46.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e01f0720 0x7fa6e01f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:46.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e014bb30 0x7fa6e014d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:46.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 --2- 172.21.15.144:0/2997365234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c40051c0 0x7fa6e014f280 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:46.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.527+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 >> 172.21.15.144:0/2997365234 conn(0x7fa6e006b8e0 msgr2=0x7fa6e00b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:46.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.528+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 shutdown_connections 2024-05-30T16:48:46.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:46.528+0000 7fa6df200640 1 -- 172.21.15.144:0/2997365234 wait complete. 2024-05-30T16:48:46.598 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:48:47.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.087+0000 7f0adbe00640 1 Processor -- start 2024-05-30T16:48:47.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.090+0000 7f0adbe00640 1 -- start start 2024-05-30T16:48:47.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.095+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ad40b61c0 0x7f0ad40b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:47.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.096+0000 7f0ad9400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0ad415eac0 0x7f0ad41625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:56278/0 (socket says 172.21.15.144:56278) 2024-05-30T16:48:47.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.096+0000 7f0ad9400640 1 -- 172.21.15.144:0/1388650782 learned_addr learned my addr 172.21.15.144:0/1388650782 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:47.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.097+0000 7f0ad8a00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ad40b61c0 0x7f0ad40b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:47.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.097+0000 7f0adbe00640 1 -- 172.21.15.144:0/1388650782 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad415eea0 con 0x7f0ad40d32d0 2024-05-30T16:48:47.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.099+0000 7f0adbe00640 1 -- 172.21.15.144:0/1388650782 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad4162cc0 con 0x7f0ad415eac0 2024-05-30T16:48:47.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.100+0000 7f0adbe00640 1 -- 172.21.15.144:0/1388650782 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad40b6b40 con 0x7f0ad40b61c0 2024-05-30T16:48:47.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.100+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520518116 0 0) 0x7f0ad4162cc0 con 0x7f0ad415eac0 2024-05-30T16:48:47.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.101+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0abc003520 con 0x7f0ad415eac0 2024-05-30T16:48:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.102+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3783255223 0 0) 0x7f0abc003520 con 0x7f0ad415eac0 2024-05-30T16:48:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.102+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ad40b61c0 msgr2=0x7f0ad40b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.102+0000 7f0ad3e00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ad40b61c0 0x7f0ad40b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.102+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 >> v1:172.21.15.144:6789/0 conn(0x7f0ad40d32d0 legacy=0x7f0ad40d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.102+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad4162f90 con 0x7f0ad415eac0 2024-05-30T16:48:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.102+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f0ac8001670 con 0x7f0ad415eac0 2024-05-30T16:48:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.102+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 >> v1:172.21.15.149:6789/0 conn(0x7f0ad415eac0 legacy=0x7f0ad41625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.102+0000 7f0ad3e00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0abc0039b0 0x7f0abc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.103+0000 7f0ad3e00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0abc0043a0 0x7f0abc004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.103+0000 7f0ad3e00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0abc005080 0x7f0abc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:47.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.103+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40b6b40 con 0x7f0abc0043a0 2024-05-30T16:48:47.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.103+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc00bfb0 con 0x7f0abc005080 2024-05-30T16:48:47.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.103+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0abc00c1b0 con 0x7f0abc0039b0 2024-05-30T16:48:47.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.105+0000 7f0ad9e00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0abc005080 0x7f0abc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:47.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.106+0000 7f0ad9e00640 1 -- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0abc0039b0 msgr2=0x7f0abc003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:48:47.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.106+0000 7f0ad9e00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0abc0039b0 0x7f0abc003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.106+0000 7f0ad9e00640 1 -- 172.21.15.144:0/1388650782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0abc0043a0 msgr2=0x7f0abc004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:47.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.106+0000 7f0ad9e00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0abc0043a0 0x7f0abc004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.106+0000 7f0ad9e00640 1 -- 172.21.15.144:0/1388650782 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad4162f90 con 0x7f0abc005080 2024-05-30T16:48:47.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.116+0000 7f0ad9e00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0abc005080 0x7f0abc00b9c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0acc001a30 tx=0x7f0abc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a18195a97f0db25a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:47.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.118+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc001a70 con 0x7f0abc005080 2024-05-30T16:48:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.119+0000 7f0ad3e00640 1 -- 172.21.15.144:0/1388650782 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc003b70 con 0x7f0abc005080 2024-05-30T16:48:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.120+0000 7f0adbe00640 1 -- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0abc005080 msgr2=0x7f0abc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.120+0000 7f0adbe00640 1 --2- 172.21.15.144:0/1388650782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0abc005080 0x7f0abc00b9c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0acc001a30 tx=0x7f0abc005830 comp rx=0 tx=0).stop 2024-05-30T16:48:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.121+0000 7f0ad9e00640 1 -- 172.21.15.144:0/1388650782 reap_dead start 2024-05-30T16:48:47.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.122+0000 7f0adbe00640 1 -- 172.21.15.144:0/1388650782 shutdown_connections 2024-05-30T16:48:47.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.122+0000 7f0adbe00640 1 -- 172.21.15.144:0/1388650782 >> 172.21.15.144:0/1388650782 conn(0x7f0ad40d11c0 msgr2=0x7f0ad40d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:47.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.122+0000 7f0adbe00640 1 -- 172.21.15.144:0/1388650782 shutdown_connections 2024-05-30T16:48:47.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.123+0000 7f0adbe00640 1 -- 172.21.15.144:0/1388650782 wait complete. 2024-05-30T16:48:47.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.127+0000 7f0adbe00640 1 Processor -- start 2024-05-30T16:48:47.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.128+0000 7f0adbe00640 1 -- start start 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.129+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0abc005080 0x7f0ad415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.130+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad4148fe0 0x7f0ad40c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.130+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ad40b8b40 0x7f0ad40b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.130+0000 7f0adbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40d2db0 con 0x7f0ad4148fe0 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.130+0000 7f0adbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40d2ad0 con 0x7f0abc005080 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.130+0000 7f0adbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad40b78e0 con 0x7f0ad40b8b40 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.130+0000 7f0ad8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad4148fe0 0x7f0ad40c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.130+0000 7f0ad8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad4148fe0 0x7f0ad40c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59830/0 (socket says 172.21.15.144:59830) 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.130+0000 7f0ad8a00640 1 -- 172.21.15.144:0/82214706 learned_addr learned my addr 172.21.15.144:0/82214706 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.131+0000 7f0ad8a00640 1 -- 172.21.15.144:0/82214706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ad40b8b40 msgr2=0x7f0ad40b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.131+0000 7f0ad8a00640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ad40b8b40 0x7f0ad40b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.131+0000 7f0ad8a00640 1 -- 172.21.15.144:0/82214706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0abc005080 msgr2=0x7f0ad415a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.131+0000 7f0ad8a00640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0abc005080 0x7f0ad415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.131+0000 7f0ad8a00640 1 -- 172.21.15.144:0/82214706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad40cabf0 con 0x7f0ad4148fe0 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.131+0000 7f0ad8a00640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad4148fe0 0x7f0ad40c7970 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000e810 tx=0x7f0ac000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.132+0000 7f0ad1600640 1 -- 172.21.15.144:0/82214706 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0017070 con 0x7f0ad4148fe0 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.132+0000 7f0ad1600640 1 -- 172.21.15.144:0/82214706 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac0004020 con 0x7f0ad4148fe0 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.132+0000 7f0ad1600640 1 -- 172.21.15.144:0/82214706 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0004450 con 0x7f0ad4148fe0 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.132+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad40cb140 con 0x7f0ad4148fe0 2024-05-30T16:48:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.132+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad4160af0 con 0x7f0ad4148fe0 2024-05-30T16:48:47.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.134+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad4075570 con 0x7f0ad4148fe0 2024-05-30T16:48:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.140+0000 7f0ad1600640 1 -- 172.21.15.144:0/82214706 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 92111+0+0 (secure 0 0 0) 0x7f0ac000c860 con 0x7f0ad4148fe0 2024-05-30T16:48:47.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.145+0000 7f0ad1600640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0ab406d4f0 0x7f0ab406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.147+0000 7f0ad9400640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0ab406d4f0 0x7f0ab406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.147+0000 7f0ad1600640 1 -- 172.21.15.144:0/82214706 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f0ac008a4b0 con 0x7f0ad4148fe0 2024-05-30T16:48:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.156+0000 7f0ad9400640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0ab406d4f0 0x7f0ab406f9b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8001eb0 tx=0x7f0ac8001620 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.156+0000 7f0ad1600640 1 -- 172.21.15.144:0/82214706 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ac005a130 con 0x7f0ad4148fe0 2024-05-30T16:48:47.196 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:48:47.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:48:47.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.862+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0ad40d2450 con 0x7f0ad4148fe0 2024-05-30T16:48:47.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.868+0000 7f0ad1600640 1 -- 172.21.15.144:0/82214706 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2401 (secure 0 0 0) 0x7f0ac0059a30 con 0x7f0ad4148fe0 2024-05-30T16:48:47.870 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:48:47.870 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:48:47.870 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:48:47.870 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:48:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 440, 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 59, 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:48:47.872 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 2378, 2024-05-30T16:48:47.873 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 9828629543, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 19583655936, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 753510457344, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 563139428, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 636512227, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 136, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 169 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 36, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:48:47.874 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 4, 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "c", 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5808 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:48:47.875 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 7, 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:46:18.992681+0000", 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:48:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: "8791c6a1-5723-467e-bca1-83d58526d8f3": { 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 30.859% (8s)\n [========....................] (remaining: 18s)", 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.30858999490737915, 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: "972001b1-9f10-4c64-bdc9-a12803ed001f": { 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "5 ongoing+pending clones; Avg progress is 26.458% (0s)\n [=======.....................] ", 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.26458001136779785, 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:48:47.877 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:48:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.878+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0ab406d4f0 msgr2=0x7f0ab406f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.878+0000 7f0adbe00640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0ab406d4f0 0x7f0ab406f9b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8001eb0 tx=0x7f0ac8001620 comp rx=0 tx=0).stop 2024-05-30T16:48:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.878+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad4148fe0 msgr2=0x7f0ad40c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.878+0000 7f0adbe00640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad4148fe0 0x7f0ad40c7970 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000e810 tx=0x7f0ac000ecd0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.881+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 shutdown_connections 2024-05-30T16:48:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.881+0000 7f0adbe00640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0ab406d4f0 0x7f0ab406f9b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.881+0000 7f0adbe00640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ad40b8b40 0x7f0ad40b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.881+0000 7f0adbe00640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad4148fe0 0x7f0ad40c7970 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.881+0000 7f0adbe00640 1 --2- 172.21.15.144:0/82214706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0abc005080 0x7f0ad415a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.881+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 >> 172.21.15.144:0/82214706 conn(0x7f0ad40d11c0 msgr2=0x7f0ad40b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:47.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.887+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 shutdown_connections 2024-05-30T16:48:47.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:47.887+0000 7f0adbe00640 1 -- 172.21.15.144:0/82214706 wait complete. 2024-05-30T16:48:47.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone56761 2024-05-30T16:48:48.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.516+0000 7fc273200640 1 Processor -- start 2024-05-30T16:48:48.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.517+0000 7fc273200640 1 -- start start 2024-05-30T16:48:48.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.531+0000 7fc273200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc27406c5e0 0x7fc2740cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:48.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.534+0000 7fc271400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc27406c5e0 0x7fc2740cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:48.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.534+0000 7fc273200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2740d0040 con 0x7fc2740cfc20 2024-05-30T16:48:48.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.534+0000 7fc271e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc274162c90 0x7fc2740b3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:56286/0 (socket says 172.21.15.144:56286) 2024-05-30T16:48:48.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.534+0000 7fc271e00640 1 -- 172.21.15.144:0/1249981966 learned_addr learned my addr 172.21.15.144:0/1249981966 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:48.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.534+0000 7fc273200640 1 -- 172.21.15.144:0/1249981966 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2740ce640 con 0x7fc274162c90 2024-05-30T16:48:48.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.534+0000 7fc273200640 1 -- 172.21.15.144:0/1249981966 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc2740ce920 con 0x7fc27406c5e0 2024-05-30T16:48:48.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.538+0000 7fc270a00640 1 -- 172.21.15.144:0/1249981966 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352233499 0 0) 0x7fc264001110 con 0x7fc2740cfc20 2024-05-30T16:48:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.538+0000 7fc271400640 1 -- 172.21.15.144:0/1249981966 >> v1:172.21.15.149:6789/0 conn(0x7fc274162c90 legacy=0x7fc2740b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.538+0000 7fc271400640 1 -- 172.21.15.144:0/1249981966 >> v1:172.21.15.144:6789/0 conn(0x7fc2740cfc20 legacy=0x7fc27406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.538+0000 7fc271400640 1 -- 172.21.15.144:0/1249981966 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2740cec00 con 0x7fc27406c5e0 2024-05-30T16:48:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.540+0000 7fc271400640 1 --2- 172.21.15.144:0/1249981966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc27406c5e0 0x7fc2740cf6e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2600097a0 tx=0x7fc26002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e28e0b022ccabb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.542+0000 7fc270a00640 1 -- 172.21.15.144:0/1249981966 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260037070 con 0x7fc27406c5e0 2024-05-30T16:48:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.542+0000 7fc270a00640 1 -- 172.21.15.144:0/1249981966 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc260032440 con 0x7fc27406c5e0 2024-05-30T16:48:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.542+0000 7fc270a00640 1 -- 172.21.15.144:0/1249981966 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260032810 con 0x7fc27406c5e0 2024-05-30T16:48:48.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.544+0000 7fc273200640 1 -- 172.21.15.144:0/1249981966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc27406c5e0 msgr2=0x7fc2740cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:48.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.544+0000 7fc273200640 1 --2- 172.21.15.144:0/1249981966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc27406c5e0 0x7fc2740cf6e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2600097a0 tx=0x7fc26002a1c0 comp rx=0 tx=0).stop 2024-05-30T16:48:48.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.544+0000 7fc273200640 1 -- 172.21.15.144:0/1249981966 shutdown_connections 2024-05-30T16:48:48.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.544+0000 7fc273200640 1 --2- 172.21.15.144:0/1249981966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc27406c5e0 0x7fc2740cf6e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:48.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.544+0000 7fc273200640 1 -- 172.21.15.144:0/1249981966 >> 172.21.15.144:0/1249981966 conn(0x7fc27406b8e0 msgr2=0x7fc27406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:48.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.546+0000 7fc273200640 1 -- 172.21.15.144:0/1249981966 shutdown_connections 2024-05-30T16:48:48.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.549+0000 7fc273200640 1 -- 172.21.15.144:0/1249981966 wait complete. 2024-05-30T16:48:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.558+0000 7fc273200640 1 Processor -- start 2024-05-30T16:48:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.559+0000 7fc273200640 1 -- start start 2024-05-30T16:48:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.562+0000 7fc273200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2740cfc20 0x7fc27414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.563+0000 7fc273200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274162c90 0x7fc2740b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.563+0000 7fc273200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2740b17f0 0x7fc2741ec060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.564+0000 7fc273200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740b3b70 con 0x7fc274162c90 2024-05-30T16:48:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.564+0000 7fc273200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740cf1c0 con 0x7fc2740b17f0 2024-05-30T16:48:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.564+0000 7fc271e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2740cfc20 0x7fc27414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.564+0000 7fc273200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc274163070 con 0x7fc2740cfc20 2024-05-30T16:48:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.564+0000 7fc271400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274162c90 0x7fc2740b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.564+0000 7fc271400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274162c90 0x7fc2740b12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59844/0 (socket says 172.21.15.144:59844) 2024-05-30T16:48:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.564+0000 7fc271400640 1 -- 172.21.15.144:0/820576517 learned_addr learned my addr 172.21.15.144:0/820576517 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.564+0000 7fc272800640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2740b17f0 0x7fc2741ec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.565+0000 7fc271400640 1 -- 172.21.15.144:0/820576517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2740cfc20 msgr2=0x7fc27414d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.565+0000 7fc271400640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2740cfc20 0x7fc27414d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.565+0000 7fc271400640 1 -- 172.21.15.144:0/820576517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2740b17f0 msgr2=0x7fc2741ec060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:48.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.565+0000 7fc271400640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2740b17f0 0x7fc2741ec060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:48.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.566+0000 7fc271400640 1 -- 172.21.15.144:0/820576517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2741651a0 con 0x7fc274162c90 2024-05-30T16:48:48.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.566+0000 7fc272800640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2740b17f0 0x7fc2741ec060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:48:48.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.570+0000 7fc271400640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274162c90 0x7fc2740b12b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc26002a730 tx=0x7fc2600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:48.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.571+0000 7fc271e00640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2740cfc20 0x7fc27414d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:48.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.584+0000 7fc26a000640 1 -- 172.21.15.144:0/820576517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260041020 con 0x7fc274162c90 2024-05-30T16:48:48.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.585+0000 7fc26a000640 1 -- 172.21.15.144:0/820576517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc260030770 con 0x7fc274162c90 2024-05-30T16:48:48.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.585+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc274165480 con 0x7fc274162c90 2024-05-30T16:48:48.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.586+0000 7fc26a000640 1 -- 172.21.15.144:0/820576517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260037040 con 0x7fc274162c90 2024-05-30T16:48:48.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.591+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc274165a40 con 0x7fc274162c90 2024-05-30T16:48:48.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.596+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2740632f0 con 0x7fc274162c90 2024-05-30T16:48:48.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.596+0000 7fc26a000640 1 -- 172.21.15.144:0/820576517 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 92111+0+0 (secure 0 0 0) 0x7fc260044020 con 0x7fc274162c90 2024-05-30T16:48:48.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.600+0000 7fc26a000640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406d540 0x7fc25406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:48.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.601+0000 7fc26a000640 1 -- 172.21.15.144:0/820576517 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fc2600411c0 con 0x7fc274162c90 2024-05-30T16:48:48.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.605+0000 7fc271e00640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406d540 0x7fc25406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:48.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.611+0000 7fc271e00640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406d540 0x7fc25406fa00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0012e0 tx=0x7fc26c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:48.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:48.620+0000 7fc26a000640 1 -- 172.21.15.144:0/820576517 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc26007a220 con 0x7fc274162c90 2024-05-30T16:48:49.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:49.199+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone56761", "target": ["mon-mgr", ""]}) -- 0x7fc274075570 con 0x7fc25406d540 2024-05-30T16:48:49.434 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:49.430+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:49.434 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:49.430+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:49.435 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:49.430+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:49.435 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:49.430+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:49.435 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:49.430+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:48:51.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.426+0000 7fc26a000640 1 -- 172.21.15.144:0/820576517 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc274075570 con 0x7fc25406d540 2024-05-30T16:48:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406d540 msgr2=0x7fc25406fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406d540 0x7fc25406fa00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0012e0 tx=0x7fc26c009040 comp rx=0 tx=0).stop 2024-05-30T16:48:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274162c90 msgr2=0x7fc2740b12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274162c90 0x7fc2740b12b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc26002a730 tx=0x7fc2600046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 shutdown_connections 2024-05-30T16:48:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc25406d540 0x7fc25406fa00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2740b17f0 0x7fc2741ec060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc274162c90 0x7fc2740b12b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 --2- 172.21.15.144:0/820576517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2740cfc20 0x7fc27414d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.429+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 >> 172.21.15.144:0/820576517 conn(0x7fc27406b8e0 msgr2=0x7fc274071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.430+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 shutdown_connections 2024-05-30T16:48:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.430+0000 7fc273200640 1 -- 172.21.15.144:0/820576517 wait complete. 2024-05-30T16:48:51.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone56762 2024-05-30T16:48:51.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.968+0000 7f4e8c400640 1 Processor -- start 2024-05-30T16:48:51.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.968+0000 7f4e8c400640 1 -- start start 2024-05-30T16:48:51.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.970+0000 7f4e8c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e840afa00 0x7f4e8415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:51.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.970+0000 7f4e8c400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4e84140c80 0x7f4e840cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:51.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.970+0000 7f4e8c400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e840cd030 con 0x7f4e840cc7a0 2024-05-30T16:48:51.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.970+0000 7f4e8c400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f4e841413f0 con 0x7f4e84140c80 2024-05-30T16:48:51.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.970+0000 7f4e8c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e840cd860 con 0x7f4e840afa00 2024-05-30T16:48:51.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.972+0000 7f4e89000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4e840cc7a0 0x7f4e84140570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42952/0 (socket says 172.21.15.144:42952) 2024-05-30T16:48:51.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.972+0000 7f4e89000640 1 -- 172.21.15.144:0/3873037650 learned_addr learned my addr 172.21.15.144:0/3873037650 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:51.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.974+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950137644 0 0) 0x7f4e840cd030 con 0x7f4e840cc7a0 2024-05-30T16:48:51.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.974+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e6c003520 con 0x7f4e840cc7a0 2024-05-30T16:48:51.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.974+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2585770286 0 0) 0x7f4e6c003520 con 0x7f4e840cc7a0 2024-05-30T16:48:51.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e840afa00 msgr2=0x7f4e8415bd90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e840afa00 0x7f4e8415bd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 >> v2:172.21.15.149:3300/0 conn(0x7f4e84140c80 msgr2=0x7f4e840cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e8a400640 1 --2- 172.21.15.144:0/3873037650 >> v2:172.21.15.149:3300/0 conn(0x7f4e84140c80 0x7f4e840cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 --2- 172.21.15.144:0/3873037650 >> v2:172.21.15.149:3300/0 conn(0x7f4e84140c80 0x7f4e840cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8415c2d0 con 0x7f4e840cc7a0 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f4e74001670 con 0x7f4e840cc7a0 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 >> v1:172.21.15.144:6789/0 conn(0x7f4e840cc7a0 legacy=0x7f4e84140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e6c0039e0 0x7f4e6c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e6c004800 0x7f4e6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e6c0051c0 0x7f4e6c0145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:51.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4e840cd860 con 0x7f4e6c0051c0 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c009c10 con 0x7f4e6c004800 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6c009e10 con 0x7f4e6c0039e0 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e8a400640 1 --2- 172.21.15.144:0/3873037650 >> v2:172.21.15.149:3300/0 conn(0x7f4e84140c80 0x7f4e840cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.975+0000 7f4e8a400640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e6c0051c0 0x7f4e6c0145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.976+0000 7f4e89000640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e6c004800 0x7f4e6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.976+0000 7f4e89a00640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e6c0039e0 0x7f4e6c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.976+0000 7f4e8a400640 1 -- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e6c0039e0 msgr2=0x7f4e6c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.976+0000 7f4e8a400640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e6c0039e0 0x7f4e6c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.976+0000 7f4e8a400640 1 -- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e6c004800 msgr2=0x7f4e6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.976+0000 7f4e8a400640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e6c004800 0x7f4e6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.976+0000 7f4e8a400640 1 -- 172.21.15.144:0/3873037650 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c003520 con 0x7f4e6c0051c0 2024-05-30T16:48:51.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.976+0000 7f4e89a00640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e6c0039e0 0x7f4e6c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:51.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.978+0000 7f4e8a400640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e6c0051c0 0x7f4e6c0145c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00c410 tx=0x7f4e6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21d95b2002b1587 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:51.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.979+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c007c00 con 0x7f4e6c0051c0 2024-05-30T16:48:51.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.979+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c04dbc0 con 0x7f4e6c0051c0 2024-05-30T16:48:51.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.979+0000 7f4e83e00640 1 -- 172.21.15.144:0/3873037650 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c003990 con 0x7f4e6c0051c0 2024-05-30T16:48:51.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.980+0000 7f4e8c400640 1 -- 172.21.15.144:0/3873037650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e6c0051c0 msgr2=0x7f4e6c0145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:51.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.980+0000 7f4e8c400640 1 --2- 172.21.15.144:0/3873037650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e6c0051c0 0x7f4e6c0145c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00c410 tx=0x7f4e6c005830 comp rx=0 tx=0).stop 2024-05-30T16:48:51.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.981+0000 7f4e8a400640 1 -- 172.21.15.144:0/3873037650 reap_dead start 2024-05-30T16:48:51.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.981+0000 7f4e8c400640 1 -- 172.21.15.144:0/3873037650 shutdown_connections 2024-05-30T16:48:51.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.981+0000 7f4e8c400640 1 -- 172.21.15.144:0/3873037650 >> 172.21.15.144:0/3873037650 conn(0x7f4e8406bd00 msgr2=0x7f4e8406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:51.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.982+0000 7f4e8c400640 1 -- 172.21.15.144:0/3873037650 shutdown_connections 2024-05-30T16:48:51.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.985+0000 7f4e8c400640 1 -- 172.21.15.144:0/3873037650 wait complete. 2024-05-30T16:48:51.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.989+0000 7f4e8c400640 1 Processor -- start 2024-05-30T16:48:51.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.989+0000 7f4e8c400640 1 -- start start 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.991+0000 7f4e8c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e8413b310 0x7f4e841e5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.991+0000 7f4e8c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e841e6110 0x7f4e8413ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.991+0000 7f4e8c400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8413d410 0x7f4e8413d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.991+0000 7f4e8c400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4e840cd580 con 0x7f4e8413d410 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.991+0000 7f4e8c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e840cecd0 con 0x7f4e8413b310 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.991+0000 7f4e8c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e840ccc60 con 0x7f4e841e6110 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.991+0000 7f4e8a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8413d410 0x7f4e8413d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.992+0000 7f4e8a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8413d410 0x7f4e8413d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59870/0 (socket says 172.21.15.144:59870) 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.992+0000 7f4e8a400640 1 -- 172.21.15.144:0/2340941413 learned_addr learned my addr 172.21.15.144:0/2340941413 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.993+0000 7f4e8a400640 1 -- 172.21.15.144:0/2340941413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e841e6110 msgr2=0x7f4e8413ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.993+0000 7f4e8a400640 1 --2- 172.21.15.144:0/2340941413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e841e6110 0x7f4e8413ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.993+0000 7f4e8a400640 1 -- 172.21.15.144:0/2340941413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e8413b310 msgr2=0x7f4e841e5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.993+0000 7f4e89a00640 1 --2- 172.21.15.144:0/2340941413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e8413b310 0x7f4e841e5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.993+0000 7f4e8a400640 1 --2- 172.21.15.144:0/2340941413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e8413b310 0x7f4e841e5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:51.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.993+0000 7f4e8a400640 1 -- 172.21.15.144:0/2340941413 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e840b00f0 con 0x7f4e8413d410 2024-05-30T16:48:51.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.993+0000 7f4e89a00640 1 --2- 172.21.15.144:0/2340941413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e8413b310 0x7f4e841e5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:51.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.993+0000 7f4e8a400640 1 --2- 172.21.15.144:0/2340941413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8413d410 0x7f4e8413d870 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00c530 tx=0x7f4e7c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:51.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.994+0000 7f4e81600640 1 -- 172.21.15.144:0/2340941413 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c007c00 con 0x7f4e8413d410 2024-05-30T16:48:51.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.994+0000 7f4e81600640 1 -- 172.21.15.144:0/2340941413 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c04d9c0 con 0x7f4e8413d410 2024-05-30T16:48:51.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.994+0000 7f4e81600640 1 -- 172.21.15.144:0/2340941413 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0074e0 con 0x7f4e8413d410 2024-05-30T16:48:51.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.994+0000 7f4e8c400640 1 -- 172.21.15.144:0/2340941413 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e840b03d0 con 0x7f4e8413d410 2024-05-30T16:48:51.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.994+0000 7f4e8c400640 1 -- 172.21.15.144:0/2340941413 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e840b0990 con 0x7f4e8413d410 2024-05-30T16:48:51.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.996+0000 7f4e8c400640 1 -- 172.21.15.144:0/2340941413 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e840b0b90 con 0x7f4e8413d410 2024-05-30T16:48:51.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.997+0000 7f4e81600640 1 -- 172.21.15.144:0/2340941413 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f4e7c069030 con 0x7f4e8413d410 2024-05-30T16:48:52.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.999+0000 7f4e81600640 1 --2- 172.21.15.144:0/2340941413 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4e6806d620 0x7f4e6806fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:52.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.999+0000 7f4e81600640 1 -- 172.21.15.144:0/2340941413 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f4e7c0cdaa0 con 0x7f4e8413d410 2024-05-30T16:48:52.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:51.999+0000 7f4e89a00640 1 --2- 172.21.15.144:0/2340941413 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4e6806d620 0x7f4e6806fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:52.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:52.000+0000 7f4e89a00640 1 --2- 172.21.15.144:0/2340941413 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4e6806d620 0x7f4e6806fae0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4e84073250 tx=0x7f4e78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:52.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:52.005+0000 7f4e81600640 1 -- 172.21.15.144:0/2340941413 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e840b0b90 con 0x7f4e8413d410 2024-05-30T16:48:52.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:52.517+0000 7f4e8c400640 1 -- 172.21.15.144:0/2340941413 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone56762", "target": ["mon-mgr", ""]}) -- 0x7f4e841e6550 con 0x7f4e6806d620 2024-05-30T16:48:52.797 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:48:52.795+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:48:52.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:52.796+0000 7f4e81600640 1 -- 172.21.15.144:0/2340941413 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f4e841e6550 con 0x7f4e6806d620 2024-05-30T16:48:52.805 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:48:52.832 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:48:52.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone56763 2024-05-30T16:48:53.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.318+0000 7f34a1200640 1 Processor -- start 2024-05-30T16:48:53.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.319+0000 7f34a1200640 1 -- start start 2024-05-30T16:48:53.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.326+0000 7f34a1200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f349c072210 0x7f349c072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.326+0000 7f34a1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c0b4140 0x7f349c0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.326+0000 7f34a1200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349c072b70 con 0x7f349c14c630 2024-05-30T16:48:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.327+0000 7f34a1200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f349c06fbf0 con 0x7f349c072210 2024-05-30T16:48:53.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.327+0000 7f34a1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f349c0cf050 con 0x7f349c0b4140 2024-05-30T16:48:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.328+0000 7f3499e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f349c14c630 0x7f349c0ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:56292/0 (socket says 172.21.15.144:56292) 2024-05-30T16:48:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.328+0000 7f3499e00640 1 -- 172.21.15.144:0/3206817107 learned_addr learned my addr 172.21.15.144:0/3206817107 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:48:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.328+0000 7f349a800640 1 --2- 172.21.15.144:0/3206817107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c0b4140 0x7f349c0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:53.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.328+0000 7f3499400640 1 --2- 172.21.15.144:0/3206817107 >> v2:172.21.15.149:3300/0 conn(0x7f349c072210 0x7f349c072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:53.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.331+0000 7f3499400640 1 -- 172.21.15.144:0/3206817107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c0b4140 msgr2=0x7f349c0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.331+0000 7f3499400640 1 --2- 172.21.15.144:0/3206817107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c0b4140 0x7f349c0b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.331+0000 7f3499400640 1 -- 172.21.15.144:0/3206817107 >> v1:172.21.15.149:6789/0 conn(0x7f349c14c630 legacy=0x7f349c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.331+0000 7f3499400640 1 -- 172.21.15.144:0/3206817107 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c0cf330 con 0x7f349c072210 2024-05-30T16:48:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.340+0000 7f3499400640 1 --2- 172.21.15.144:0/3206817107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c072210 0x7f349c072630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f348c0097a0 tx=0x7f348c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4d5a1ff97aa5fa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.346+0000 7f3498a00640 1 -- 172.21.15.144:0/3206817107 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c037070 con 0x7f349c072210 2024-05-30T16:48:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.346+0000 7f3498a00640 1 -- 172.21.15.144:0/3206817107 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c02ada0 con 0x7f349c072210 2024-05-30T16:48:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.346+0000 7f3498a00640 1 -- 172.21.15.144:0/3206817107 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c032660 con 0x7f349c072210 2024-05-30T16:48:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.348+0000 7f34a1200640 1 -- 172.21.15.144:0/3206817107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c072210 msgr2=0x7f349c072630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.348+0000 7f34a1200640 1 --2- 172.21.15.144:0/3206817107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c072210 0x7f349c072630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f348c0097a0 tx=0x7f348c02a110 comp rx=0 tx=0).stop 2024-05-30T16:48:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.348+0000 7f34a1200640 1 -- 172.21.15.144:0/3206817107 shutdown_connections 2024-05-30T16:48:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.348+0000 7f34a1200640 1 --2- 172.21.15.144:0/3206817107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c0b4140 0x7f349c0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.348+0000 7f34a1200640 1 --2- 172.21.15.144:0/3206817107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c072210 0x7f349c072630 secure :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f348c0097a0 tx=0x7f348c02a110 comp rx=0 tx=0).stop 2024-05-30T16:48:53.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.348+0000 7f34a1200640 1 -- 172.21.15.144:0/3206817107 >> 172.21.15.144:0/3206817107 conn(0x7f349c06bd00 msgr2=0x7f349c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:53.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.349+0000 7f34a1200640 1 -- 172.21.15.144:0/3206817107 shutdown_connections 2024-05-30T16:48:53.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.349+0000 7f34a1200640 1 -- 172.21.15.144:0/3206817107 wait complete. 2024-05-30T16:48:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.362+0000 7f34a1200640 1 Processor -- start 2024-05-30T16:48:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.362+0000 7f34a1200640 1 -- start start 2024-05-30T16:48:53.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.367+0000 7f34a1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c0b4140 0x7f349c1e8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:53.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.377+0000 7f3499e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c0b4140 0x7f349c1e8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:53.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.377+0000 7f3499e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c0b4140 0x7f349c1e8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:46416/0 (socket says 172.21.15.144:46416) 2024-05-30T16:48:53.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.379+0000 7f34a1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c14c630 0x7f349c149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:53.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.379+0000 7f3499e00640 1 -- 172.21.15.144:0/2241158606 learned_addr learned my addr 172.21.15.144:0/2241158606 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:53.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.380+0000 7f34a1200640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c149e80 0x7f349c1e7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:53.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.380+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f349c0b3c20 con 0x7f349c149e80 2024-05-30T16:48:53.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.380+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f349c0cf8f0 con 0x7f349c0b4140 2024-05-30T16:48:53.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.380+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f349c14ca10 con 0x7f349c14c630 2024-05-30T16:48:53.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.380+0000 7f3499400640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c14c630 0x7f349c149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:53.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.382+0000 7f3499400640 1 -- 172.21.15.144:0/2241158606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c0b4140 msgr2=0x7f349c1e8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:53.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.382+0000 7f3499400640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c0b4140 0x7f349c1e8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:53.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.382+0000 7f3499400640 1 -- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c149e80 msgr2=0x7f349c1e7470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:48:53.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.382+0000 7f3499400640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c149e80 0x7f349c1e7470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:53.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.382+0000 7f3499400640 1 -- 172.21.15.144:0/2241158606 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c1e6420 con 0x7f349c14c630 2024-05-30T16:48:53.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.383+0000 7f3499e00640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c0b4140 0x7f349c1e8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:53.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.383+0000 7f3499400640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c14c630 0x7f349c149940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f348c031000 tx=0x7f348c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:53.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.386+0000 7f3492000640 1 -- 172.21.15.144:0/2241158606 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c041070 con 0x7f349c14c630 2024-05-30T16:48:53.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.386+0000 7f3492000640 1 -- 172.21.15.144:0/2241158606 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c004020 con 0x7f349c14c630 2024-05-30T16:48:53.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.386+0000 7f3492000640 1 -- 172.21.15.144:0/2241158606 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c041070 con 0x7f349c14c630 2024-05-30T16:48:53.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.386+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349c1e66b0 con 0x7f349c14c630 2024-05-30T16:48:53.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.387+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f349c1e6c70 con 0x7f349c14c630 2024-05-30T16:48:53.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.392+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349c068b90 con 0x7f349c14c630 2024-05-30T16:48:53.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.403+0000 7f3492000640 1 -- 172.21.15.144:0/2241158606 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f348c0041d0 con 0x7f349c14c630 2024-05-30T16:48:53.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.405+0000 7f3492000640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f347c06d750 0x7f347c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:53.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.405+0000 7f3492000640 1 -- 172.21.15.144:0/2241158606 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f348c0aa4d0 con 0x7f349c14c630 2024-05-30T16:48:53.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.420+0000 7f3492000640 1 -- 172.21.15.144:0/2241158606 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f348c07a330 con 0x7f349c14c630 2024-05-30T16:48:53.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.465+0000 7f3499e00640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f347c06d750 0x7f347c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:53.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.468+0000 7f3499e00640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f347c06d750 0x7f347c06fc10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3494007fd0 tx=0x7f3494009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:53.952+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone56763", "target": ["mon-mgr", ""]}) -- 0x7f349c075f70 con 0x7f347c06d750 2024-05-30T16:48:55.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.421+0000 7f3492000640 1 -- 172.21.15.144:0/2241158606 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f34940020b0 con 0x7f347c06d750 2024-05-30T16:48:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f347c06d750 msgr2=0x7f347c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f347c06d750 0x7f347c06fc10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3494007fd0 tx=0x7f3494009040 comp rx=0 tx=0).stop 2024-05-30T16:48:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c14c630 msgr2=0x7f349c149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c14c630 0x7f349c149940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f348c031000 tx=0x7f348c0046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 shutdown_connections 2024-05-30T16:48:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f347c06d750 0x7f347c06fc10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c149e80 0x7f349c1e7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f349c14c630 0x7f349c149940 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f348c031000 tx=0x7f348c0046c0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 --2- 172.21.15.144:0/2241158606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c0b4140 0x7f349c1e8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.428+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 >> 172.21.15.144:0/2241158606 conn(0x7f349c06bd00 msgr2=0x7f349c0ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.434+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 shutdown_connections 2024-05-30T16:48:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.434+0000 7f34a1200640 1 -- 172.21.15.144:0/2241158606 wait complete. 2024-05-30T16:48:55.499 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone56764 2024-05-30T16:48:55.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.933+0000 7f0f4f200640 1 Processor -- start 2024-05-30T16:48:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.933+0000 7f0f4f200640 1 -- start start 2024-05-30T16:48:55.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.936+0000 7f0f4f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f48166280 0x7f0f48070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:55.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.936+0000 7f0f4f200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0f4806bff0 0x7f0f480d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:55.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.936+0000 7f0f4f200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f48166660 con 0x7f0f48071540 2024-05-30T16:48:55.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.936+0000 7f0f4f200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480b5480 con 0x7f0f48166280 2024-05-30T16:48:55.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.936+0000 7f0f4f200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f0f48073740 con 0x7f0f4806bff0 2024-05-30T16:48:55.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.937+0000 7f0f47e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f48166280 0x7f0f48070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.937+0000 7f0f47e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f48166280 0x7f0f48070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49638/0 (socket says 172.21.15.144:49638) 2024-05-30T16:48:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.937+0000 7f0f47e00640 1 -- 172.21.15.144:0/3437816850 learned_addr learned my addr 172.21.15.144:0/3437816850 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:55.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.939+0000 7f0f47e00640 1 -- 172.21.15.144:0/3437816850 >> v2:172.21.15.149:3300/0 conn(0x7f0f4806bff0 msgr2=0x7f0f480d0e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:48:55.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.939+0000 7f0f47e00640 1 --2- 172.21.15.144:0/3437816850 >> v2:172.21.15.149:3300/0 conn(0x7f0f4806bff0 0x7f0f480d0e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.939+0000 7f0f47e00640 1 -- 172.21.15.144:0/3437816850 >> v1:172.21.15.149:6789/0 conn(0x7f0f48071540 legacy=0x7f0f4806b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:55.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.939+0000 7f0f47e00640 1 -- 172.21.15.144:0/3437816850 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f480b5110 con 0x7f0f48166280 2024-05-30T16:48:55.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.943+0000 7f0f47e00640 1 --2- 172.21.15.144:0/3437816850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48166280 0x7f0f48070aa0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0f48073020 tx=0x7f0f3802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc349fab94ee9e16 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:55.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.944+0000 7f0f46a00640 1 -- 172.21.15.144:0/3437816850 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38037070 con 0x7f0f48166280 2024-05-30T16:48:55.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.944+0000 7f0f46a00640 1 -- 172.21.15.144:0/3437816850 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f38032440 con 0x7f0f48166280 2024-05-30T16:48:55.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.944+0000 7f0f46a00640 1 -- 172.21.15.144:0/3437816850 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38032810 con 0x7f0f48166280 2024-05-30T16:48:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.947+0000 7f0f4f200640 1 -- 172.21.15.144:0/3437816850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48166280 msgr2=0x7f0f48070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.947+0000 7f0f4f200640 1 --2- 172.21.15.144:0/3437816850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48166280 0x7f0f48070aa0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0f48073020 tx=0x7f0f3802a250 comp rx=0 tx=0).stop 2024-05-30T16:48:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.947+0000 7f0f4f200640 1 -- 172.21.15.144:0/3437816850 shutdown_connections 2024-05-30T16:48:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.947+0000 7f0f4f200640 1 --2- 172.21.15.144:0/3437816850 >> v2:172.21.15.149:3300/0 conn(0x7f0f4806bff0 0x7f0f480d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.947+0000 7f0f4f200640 1 --2- 172.21.15.144:0/3437816850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48166280 0x7f0f48070aa0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.947+0000 7f0f4f200640 1 -- 172.21.15.144:0/3437816850 >> 172.21.15.144:0/3437816850 conn(0x7f0f4806f0d0 msgr2=0x7f0f4806f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.948+0000 7f0f4f200640 1 -- 172.21.15.144:0/3437816850 shutdown_connections 2024-05-30T16:48:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.948+0000 7f0f4f200640 1 -- 172.21.15.144:0/3437816850 wait complete. 2024-05-30T16:48:55.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.952+0000 7f0f4f200640 1 Processor -- start 2024-05-30T16:48:55.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.953+0000 7f0f4f200640 1 -- start start 2024-05-30T16:48:55.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.956+0000 7f0f4f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4806bff0 0x7f0f480c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.957+0000 7f0f4f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48071540 0x7f0f480c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:55.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.959+0000 7f0f4f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f480c8670 0x7f0f4815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:55.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.959+0000 7f0f4f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48071330 con 0x7f0f48071540 2024-05-30T16:48:55.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.959+0000 7f0f4f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f480711b0 con 0x7f0f4806bff0 2024-05-30T16:48:55.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.959+0000 7f0f4f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0f480d13a0 con 0x7f0f480c8670 2024-05-30T16:48:55.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.960+0000 7f0f47e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4806bff0 0x7f0f480c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:55.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.960+0000 7f0f47400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48071540 0x7f0f480c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:55.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.960+0000 7f0f47400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48071540 0x7f0f480c6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49640/0 (socket says 172.21.15.144:49640) 2024-05-30T16:48:55.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.960+0000 7f0f47400640 1 -- 172.21.15.144:0/3321988925 learned_addr learned my addr 172.21.15.144:0/3321988925 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:55.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.962+0000 7f0f4d200640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f480c8670 0x7f0f4815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.962+0000 7f0f47400640 1 -- 172.21.15.144:0/3321988925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f480c8670 msgr2=0x7f0f4815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.962+0000 7f0f47400640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f480c8670 0x7f0f4815ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.962+0000 7f0f47400640 1 -- 172.21.15.144:0/3321988925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4806bff0 msgr2=0x7f0f480c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.962+0000 7f0f47400640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4806bff0 0x7f0f480c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.962+0000 7f0f47400640 1 -- 172.21.15.144:0/3321988925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f480c8be0 con 0x7f0f48071540 2024-05-30T16:48:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.963+0000 7f0f47e00640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4806bff0 0x7f0f480c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.963+0000 7f0f4d200640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f480c8670 0x7f0f4815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:48:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.963+0000 7f0f47400640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48071540 0x7f0f480c6fe0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400b3e0 tx=0x7f0f3400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.964+0000 7f0f3fe00640 1 -- 172.21.15.144:0/3321988925 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34015020 con 0x7f0f48071540 2024-05-30T16:48:55.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.965+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f480c8ec0 con 0x7f0f48071540 2024-05-30T16:48:55.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.965+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f480c9480 con 0x7f0f48071540 2024-05-30T16:48:55.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.966+0000 7f0f3fe00640 1 -- 172.21.15.144:0/3321988925 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f34011850 con 0x7f0f48071540 2024-05-30T16:48:55.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.966+0000 7f0f3fe00640 1 -- 172.21.15.144:0/3321988925 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34011c40 con 0x7f0f48071540 2024-05-30T16:48:55.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.976+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f20005290 con 0x7f0f48071540 2024-05-30T16:48:55.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.976+0000 7f0f3fe00640 1 -- 172.21.15.144:0/3321988925 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f0f34018020 con 0x7f0f48071540 2024-05-30T16:48:55.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.982+0000 7f0f3fe00640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0f2806d550 0x7f0f2806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:55.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.983+0000 7f0f3fe00640 1 -- 172.21.15.144:0/3321988925 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f0f3408a720 con 0x7f0f48071540 2024-05-30T16:48:55.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.984+0000 7f0f47e00640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0f2806d550 0x7f0f2806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:55.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.991+0000 7f0f47e00640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0f2806d550 0x7f0f2806fa10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0f38034000 tx=0x7f0f3802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:55.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:55.993+0000 7f0f3fe00640 1 -- 172.21.15.144:0/3321988925 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0f3401f020 con 0x7f0f48071540 2024-05-30T16:48:56.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:56.628+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone56764", "target": ["mon-mgr", ""]}) -- 0x7f0f20000bc0 con 0x7f0f2806d550 2024-05-30T16:48:58.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.426+0000 7f0f3fe00640 1 -- 172.21.15.144:0/3321988925 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0f20000bc0 con 0x7f0f2806d550 2024-05-30T16:48:58.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.437+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0f2806d550 msgr2=0x7f0f2806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.438+0000 7f0f4f200640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0f2806d550 0x7f0f2806fa10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0f38034000 tx=0x7f0f3802e000 comp rx=0 tx=0).stop 2024-05-30T16:48:58.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.438+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48071540 msgr2=0x7f0f480c6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.438+0000 7f0f4f200640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48071540 0x7f0f480c6fe0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400b3e0 tx=0x7f0f3400b8a0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.438+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 shutdown_connections 2024-05-30T16:48:58.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.438+0000 7f0f4f200640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f0f2806d550 0x7f0f2806fa10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.438+0000 7f0f4f200640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f480c8670 0x7f0f4815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.439+0000 7f0f4f200640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f48071540 0x7f0f480c6fe0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.439+0000 7f0f4f200640 1 --2- 172.21.15.144:0/3321988925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f4806bff0 0x7f0f480c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.439+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 >> 172.21.15.144:0/3321988925 conn(0x7f0f4806f0d0 msgr2=0x7f0f4806f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:58.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.439+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 shutdown_connections 2024-05-30T16:48:58.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.439+0000 7f0f4f200640 1 -- 172.21.15.144:0/3321988925 wait complete. 2024-05-30T16:48:58.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone56765 2024-05-30T16:48:58.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.952+0000 7fb640400640 1 Processor -- start 2024-05-30T16:48:58.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.953+0000 7fb640400640 1 -- start start 2024-05-30T16:48:58.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.955+0000 7fb640400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb63815ffc0 0x7fb6380b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.955+0000 7fb640400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb63809b140 0x7fb6380cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.955+0000 7fb640400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6380d1500 con 0x7fb63809b5d0 2024-05-30T16:48:58.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.955+0000 7fb640400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb6380d1070 con 0x7fb63809b140 2024-05-30T16:48:58.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.955+0000 7fb640400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb6380d04a0 con 0x7fb63815ffc0 2024-05-30T16:48:58.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.957+0000 7fb63da00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb63815ffc0 0x7fb6380b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.957+0000 7fb63da00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb63815ffc0 0x7fb6380b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:55206/0 (socket says 172.21.15.144:55206) 2024-05-30T16:48:58.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.957+0000 7fb63da00640 1 -- 172.21.15.144:0/2505123329 learned_addr learned my addr 172.21.15.144:0/2505123329 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:58.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.957+0000 7fb63da00640 1 -- 172.21.15.144:0/2505123329 >> v2:172.21.15.144:3300/0 conn(0x7fb63809b140 msgr2=0x7fb6380cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:58.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.957+0000 7fb63da00640 1 --2- 172.21.15.144:0/2505123329 >> v2:172.21.15.144:3300/0 conn(0x7fb63809b140 0x7fb6380cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.958+0000 7fb63da00640 1 -- 172.21.15.144:0/2505123329 >> v1:172.21.15.144:6789/0 conn(0x7fb63809b5d0 legacy=0x7fb63809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:48:58.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.957+0000 7fb63d000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb63809b5d0 0x7fb63809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60812/0 (socket says 172.21.15.144:60812) 2024-05-30T16:48:58.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.962+0000 7fb63da00640 1 -- 172.21.15.144:0/2505123329 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6380d0740 con 0x7fb63815ffc0 2024-05-30T16:48:58.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.968+0000 7fb63da00640 1 --2- 172.21.15.144:0/2505123329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63815ffc0 0x7fb6380b4b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb638072850 tx=0x7fb63002a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=558c93d5aa4a9c36 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:58.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.972+0000 7fb637e00640 1 -- 172.21.15.144:0/2505123329 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630036070 con 0x7fb63815ffc0 2024-05-30T16:48:58.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.972+0000 7fb637e00640 1 -- 172.21.15.144:0/2505123329 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb630031600 con 0x7fb63815ffc0 2024-05-30T16:48:58.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.972+0000 7fb637e00640 1 -- 172.21.15.144:0/2505123329 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6300319d0 con 0x7fb63815ffc0 2024-05-30T16:48:58.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.974+0000 7fb640400640 1 -- 172.21.15.144:0/2505123329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63815ffc0 msgr2=0x7fb6380b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.974+0000 7fb640400640 1 --2- 172.21.15.144:0/2505123329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63815ffc0 0x7fb6380b4b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb638072850 tx=0x7fb63002a750 comp rx=0 tx=0).stop 2024-05-30T16:48:58.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.977+0000 7fb640400640 1 -- 172.21.15.144:0/2505123329 shutdown_connections 2024-05-30T16:48:58.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.977+0000 7fb640400640 1 --2- 172.21.15.144:0/2505123329 >> v2:172.21.15.144:3300/0 conn(0x7fb63809b140 0x7fb6380cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.977+0000 7fb640400640 1 --2- 172.21.15.144:0/2505123329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63815ffc0 0x7fb6380b4b10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.978+0000 7fb640400640 1 -- 172.21.15.144:0/2505123329 >> 172.21.15.144:0/2505123329 conn(0x7fb6380b3ff0 msgr2=0x7fb6380b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:48:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.979+0000 7fb640400640 1 -- 172.21.15.144:0/2505123329 shutdown_connections 2024-05-30T16:48:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.979+0000 7fb640400640 1 -- 172.21.15.144:0/2505123329 wait complete. 2024-05-30T16:48:58.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.983+0000 7fb640400640 1 Processor -- start 2024-05-30T16:48:58.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.983+0000 7fb640400640 1 -- start start 2024-05-30T16:48:58.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.985+0000 7fb640400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb63809b140 0x7fb6380c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.986+0000 7fb640400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63809b5d0 0x7fb6380c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.986+0000 7fb640400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb63815ffc0 0x7fb6380cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:58.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.986+0000 7fb640400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb63809bcb0 con 0x7fb63809b140 2024-05-30T16:48:58.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.986+0000 7fb640400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb6380d0d00 con 0x7fb63809b5d0 2024-05-30T16:48:58.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.986+0000 7fb640400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6380cd550 con 0x7fb63815ffc0 2024-05-30T16:48:58.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.987+0000 7fb63da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb63809b140 0x7fb6380c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.987+0000 7fb63da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb63809b140 0x7fb6380c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49666/0 (socket says 172.21.15.144:49666) 2024-05-30T16:48:58.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.987+0000 7fb63da00640 1 -- 172.21.15.144:0/1221627683 learned_addr learned my addr 172.21.15.144:0/1221627683 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:48:58.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.987+0000 7fb63e400640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb63815ffc0 0x7fb6380cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:58.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.987+0000 7fb63da00640 1 -- 172.21.15.144:0/1221627683 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb63815ffc0 msgr2=0x7fb6380cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.987+0000 7fb63da00640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb63815ffc0 0x7fb6380cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.987+0000 7fb63da00640 1 -- 172.21.15.144:0/1221627683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63809b5d0 msgr2=0x7fb6380c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:48:58.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.987+0000 7fb63da00640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63809b5d0 0x7fb6380c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:48:58.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.988+0000 7fb63da00640 1 -- 172.21.15.144:0/1221627683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6380cb240 con 0x7fb63809b140 2024-05-30T16:48:58.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.988+0000 7fb63da00640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb63809b140 0x7fb6380c8620 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb630009f40 tx=0x7fb630004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:58.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.989+0000 7fb635600640 1 -- 172.21.15.144:0/1221627683 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630041020 con 0x7fb63809b140 2024-05-30T16:48:58.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.989+0000 7fb635600640 1 -- 172.21.15.144:0/1221627683 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6300077a0 con 0x7fb63809b140 2024-05-30T16:48:58.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.989+0000 7fb635600640 1 -- 172.21.15.144:0/1221627683 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630036040 con 0x7fb63809b140 2024-05-30T16:48:58.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.989+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6380cb520 con 0x7fb63809b140 2024-05-30T16:48:58.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.990+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6380cbae0 con 0x7fb63809b140 2024-05-30T16:48:58.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.991+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb638075570 con 0x7fb63809b140 2024-05-30T16:48:58.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.995+0000 7fb635600640 1 -- 172.21.15.144:0/1221627683 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7fb630044020 con 0x7fb63809b140 2024-05-30T16:48:58.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.997+0000 7fb635600640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61806d620 0x7fb61806fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:48:59.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:58.998+0000 7fb635600640 1 -- 172.21.15.144:0/1221627683 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fb6300ab8e0 con 0x7fb63809b140 2024-05-30T16:48:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:59.009+0000 7fb635600640 1 -- 172.21.15.144:0/1221627683 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb63004b030 con 0x7fb63809b140 2024-05-30T16:48:59.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:59.011+0000 7fb63d000640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61806d620 0x7fb61806fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:48:59.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:59.014+0000 7fb63d000640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61806d620 0x7fb61806fae0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb638150ff0 tx=0x7fb62c0079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:48:59.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:48:59.564+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone56765", "target": ["mon-mgr", ""]}) -- 0x7fb63816b6b0 con 0x7fb61806d620 2024-05-30T16:49:00.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.323+0000 7fb635600640 1 -- 172.21.15.144:0/1221627683 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb63816b6b0 con 0x7fb61806d620 2024-05-30T16:49:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.328+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61806d620 msgr2=0x7fb61806fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.328+0000 7fb640400640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61806d620 0x7fb61806fae0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb638150ff0 tx=0x7fb62c0079c0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.328+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb63809b140 msgr2=0x7fb6380c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.328+0000 7fb640400640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb63809b140 0x7fb6380c8620 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb630009f40 tx=0x7fb630004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.329+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 shutdown_connections 2024-05-30T16:49:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.329+0000 7fb640400640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb61806d620 0x7fb61806fae0 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb638150ff0 tx=0x7fb62c0079c0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.329+0000 7fb640400640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb63815ffc0 0x7fb6380cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.329+0000 7fb640400640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb63809b5d0 0x7fb6380c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.329+0000 7fb640400640 1 --2- 172.21.15.144:0/1221627683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb63809b140 0x7fb6380c8620 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.329+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 >> 172.21.15.144:0/1221627683 conn(0x7fb6380b3ff0 msgr2=0x7fb63815d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.329+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 shutdown_connections 2024-05-30T16:49:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.329+0000 7fb640400640 1 -- 172.21.15.144:0/1221627683 wait complete. 2024-05-30T16:49:00.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone56766 2024-05-30T16:49:00.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.821+0000 7f1ed8a00640 1 Processor -- start 2024-05-30T16:49:00.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.822+0000 7f1ed8a00640 1 -- start start 2024-05-30T16:49:00.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.823+0000 7f1ed8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed413f760 0x7f1ed406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.823+0000 7f1ed8a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ed40cec70 0x7f1ed40b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.823+0000 7f1ed8a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ed40b5e00 0x7f1ed4142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.823+0000 7f1ed8a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed41612b0 con 0x7f1ed40b5e00 2024-05-30T16:49:00.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.823+0000 7f1ed8a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed413fb40 con 0x7f1ed40cec70 2024-05-30T16:49:00.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.823+0000 7f1ed8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed406ee80 con 0x7f1ed413f760 2024-05-30T16:49:00.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.824+0000 7f1ed2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ed40b5e00 0x7f1ed4142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.824+0000 7f1ed2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ed40b5e00 0x7f1ed4142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49680/0 (socket says 172.21.15.144:49680) 2024-05-30T16:49:00.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.824+0000 7f1ed2800640 1 -- 172.21.15.144:0/1422112859 learned_addr learned my addr 172.21.15.144:0/1422112859 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:00.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.824+0000 7f1ed1e00640 1 --2- 172.21.15.144:0/1422112859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed413f760 0x7f1ed406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.824+0000 7f1ecbe00640 1 --2- 172.21.15.144:0/1422112859 >> v2:172.21.15.149:3300/0 conn(0x7f1ed40cec70 0x7f1ed40b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.825+0000 7f1ed2800640 1 -- 172.21.15.144:0/1422112859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed413f760 msgr2=0x7f1ed406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.825+0000 7f1ed2800640 1 --2- 172.21.15.144:0/1422112859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed413f760 0x7f1ed406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.825+0000 7f1ed2800640 1 -- 172.21.15.144:0/1422112859 >> v2:172.21.15.149:3300/0 conn(0x7f1ed40cec70 msgr2=0x7f1ed40b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.825+0000 7f1ed2800640 1 --2- 172.21.15.144:0/1422112859 >> v2:172.21.15.149:3300/0 conn(0x7f1ed40cec70 0x7f1ed40b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.825+0000 7f1ed2800640 1 -- 172.21.15.144:0/1422112859 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed4160730 con 0x7f1ed40b5e00 2024-05-30T16:49:00.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.827+0000 7f1ed2800640 1 --2- 172.21.15.144:0/1422112859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40b5e00 0x7f1ed4142200 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4070120 tx=0x7f1ecc02eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b7d4d2670ee4a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:00.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.827+0000 7f1ed1400640 1 -- 172.21.15.144:0/1422112859 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc036070 con 0x7f1ed40b5e00 2024-05-30T16:49:00.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.827+0000 7f1ed1400640 1 -- 172.21.15.144:0/1422112859 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc030680 con 0x7f1ed40b5e00 2024-05-30T16:49:00.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.827+0000 7f1ed1400640 1 -- 172.21.15.144:0/1422112859 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc030a50 con 0x7f1ed40b5e00 2024-05-30T16:49:00.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.828+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1422112859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40b5e00 msgr2=0x7f1ed4142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.828+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1422112859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40b5e00 0x7f1ed4142200 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4070120 tx=0x7f1ecc02eb30 comp rx=0 tx=0).stop 2024-05-30T16:49:00.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.828+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1422112859 shutdown_connections 2024-05-30T16:49:00.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.828+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1422112859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40b5e00 0x7f1ed4142200 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.828+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1422112859 >> v2:172.21.15.149:3300/0 conn(0x7f1ed40cec70 0x7f1ed40b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.828+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1422112859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed413f760 0x7f1ed406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.828+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1422112859 >> 172.21.15.144:0/1422112859 conn(0x7f1ed406bd00 msgr2=0x7f1ed406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:00.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.829+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1422112859 shutdown_connections 2024-05-30T16:49:00.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.829+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1422112859 wait complete. 2024-05-30T16:49:00.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.831+0000 7f1ed8a00640 1 Processor -- start 2024-05-30T16:49:00.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.831+0000 7f1ed8a00640 1 -- start start 2024-05-30T16:49:00.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.833+0000 7f1ed8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed40b5e00 0x7f1ed40b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.833+0000 7f1ed8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40cec70 0x7f1ed40b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.833+0000 7f1ed8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ed413f760 0x7f1ed41f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.833+0000 7f1ed8a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed4160fd0 con 0x7f1ed40cec70 2024-05-30T16:49:00.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.833+0000 7f1ed8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed4160cf0 con 0x7f1ed413f760 2024-05-30T16:49:00.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.833+0000 7f1ed8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed40cf0d0 con 0x7f1ed40b5e00 2024-05-30T16:49:00.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.834+0000 7f1ed1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed40b5e00 0x7f1ed40b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.835+0000 7f1ed1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed40b5e00 0x7f1ed40b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:42992/0 (socket says 172.21.15.144:42992) 2024-05-30T16:49:00.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.835+0000 7f1ed1e00640 1 -- 172.21.15.144:0/1478145267 learned_addr learned my addr 172.21.15.144:0/1478145267 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:00.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.835+0000 7f1ed2800640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ed413f760 0x7f1ed41f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.834+0000 7f1ecbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40cec70 0x7f1ed40b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.836+0000 7f1ecbe00640 1 -- 172.21.15.144:0/1478145267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed40b5e00 msgr2=0x7f1ed40b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.836+0000 7f1ecbe00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed40b5e00 0x7f1ed40b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.836+0000 7f1ecbe00640 1 -- 172.21.15.144:0/1478145267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ed413f760 msgr2=0x7f1ed41f8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:00.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.836+0000 7f1ecbe00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ed413f760 0x7f1ed41f8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:00.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.836+0000 7f1ecbe00640 1 -- 172.21.15.144:0/1478145267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed40b1620 con 0x7f1ed40cec70 2024-05-30T16:49:00.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.837+0000 7f1ecbe00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40cec70 0x7f1ed40b2950 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00d5f0 tx=0x7f1ebc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:00.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.837+0000 7f1eca000640 1 -- 172.21.15.144:0/1478145267 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc018020 con 0x7f1ed40cec70 2024-05-30T16:49:00.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.837+0000 7f1eca000640 1 -- 172.21.15.144:0/1478145267 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ebc014620 con 0x7f1ed40cec70 2024-05-30T16:49:00.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.837+0000 7f1eca000640 1 -- 172.21.15.144:0/1478145267 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc014a10 con 0x7f1ed40cec70 2024-05-30T16:49:00.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.837+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed40b1900 con 0x7f1ed40cec70 2024-05-30T16:49:00.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.838+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed40b1260 con 0x7f1ed40cec70 2024-05-30T16:49:00.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.842+0000 7f1eca000640 1 -- 172.21.15.144:0/1478145267 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f1ebc01b020 con 0x7f1ed40cec70 2024-05-30T16:49:00.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.843+0000 7f1eca000640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1eb006d550 0x7f1eb006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:00.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.843+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed41f8d00 con 0x7f1ed40cec70 2024-05-30T16:49:00.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.844+0000 7f1eca000640 1 -- 172.21.15.144:0/1478145267 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f1ebc08a9c0 con 0x7f1ed40cec70 2024-05-30T16:49:00.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.854+0000 7f1ed1e00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1eb006d550 0x7f1eb006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:00.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.855+0000 7f1eca000640 1 -- 172.21.15.144:0/1478145267 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ebc022030 con 0x7f1ed40cec70 2024-05-30T16:49:00.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:00.856+0000 7f1ed1e00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1eb006d550 0x7f1eb006fa10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009b60 tx=0x7f1ec4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:01.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.425+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone56766", "target": ["mon-mgr", ""]}) -- 0x7f1ed40b3480 con 0x7f1eb006d550 2024-05-30T16:49:01.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.740+0000 7f1eca000640 1 -- 172.21.15.144:0/1478145267 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1ed40b3480 con 0x7f1eb006d550 2024-05-30T16:49:01.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.744+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1eb006d550 msgr2=0x7f1eb006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.744+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1eb006d550 0x7f1eb006fa10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009b60 tx=0x7f1ec4009190 comp rx=0 tx=0).stop 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40cec70 msgr2=0x7f1ed40b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40cec70 0x7f1ed40b2950 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00d5f0 tx=0x7f1ebc00dab0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 shutdown_connections 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1eb006d550 0x7f1eb006fa10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ed413f760 0x7f1ed41f8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed40cec70 0x7f1ed40b2950 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 --2- 172.21.15.144:0/1478145267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ed40b5e00 0x7f1ed40b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 >> 172.21.15.144:0/1478145267 conn(0x7f1ed406bd00 msgr2=0x7f1ed413c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 shutdown_connections 2024-05-30T16:49:01.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:01.745+0000 7f1ed8a00640 1 -- 172.21.15.144:0/1478145267 wait complete. 2024-05-30T16:49:01.782 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone56767 2024-05-30T16:49:02.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.118+0000 7f6053a00640 1 Processor -- start 2024-05-30T16:49:02.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.119+0000 7f6053a00640 1 -- start start 2024-05-30T16:49:02.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.121+0000 7f6053a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f604c140f20 0x7f604c15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.121+0000 7f6053a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f604c15ef30 0x7f604c071df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.121+0000 7f6053a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f604c141300 con 0x7f604c070500 2024-05-30T16:49:02.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.121+0000 7f6053a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f604c0b65f0 con 0x7f604c15ef30 2024-05-30T16:49:02.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.121+0000 7f6053a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f604c0b6310 con 0x7f604c140f20 2024-05-30T16:49:02.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.122+0000 7f604be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f604c15ef30 0x7f604c071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.122+0000 7f604be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f604c15ef30 0x7f604c071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49698/0 (socket says 172.21.15.144:49698) 2024-05-30T16:49:02.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.122+0000 7f604be00640 1 -- 172.21.15.144:0/3790992695 learned_addr learned my addr 172.21.15.144:0/3790992695 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:02.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.123+0000 7f604be00640 1 -- 172.21.15.144:0/3790992695 >> v2:172.21.15.149:3300/0 conn(0x7f604c140f20 msgr2=0x7f604c15bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:02.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.123+0000 7f604be00640 1 --2- 172.21.15.144:0/3790992695 >> v2:172.21.15.149:3300/0 conn(0x7f604c140f20 0x7f604c15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.123+0000 7f604be00640 1 -- 172.21.15.144:0/3790992695 >> v1:172.21.15.149:6789/0 conn(0x7f604c070500 legacy=0x7f604c06dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:02.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.123+0000 7f604be00640 1 -- 172.21.15.144:0/3790992695 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c15b040 con 0x7f604c15ef30 2024-05-30T16:49:02.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.125+0000 7f604be00640 1 --2- 172.21.15.144:0/3790992695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c15ef30 0x7f604c071df0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f604c06c650 tx=0x7f603402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9c210eb40cfdd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:02.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.126+0000 7f604b400640 1 -- 172.21.15.144:0/3790992695 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034036070 con 0x7f604c15ef30 2024-05-30T16:49:02.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.126+0000 7f604b400640 1 -- 172.21.15.144:0/3790992695 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6034031600 con 0x7f604c15ef30 2024-05-30T16:49:02.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.126+0000 7f604b400640 1 -- 172.21.15.144:0/3790992695 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60340319d0 con 0x7f604c15ef30 2024-05-30T16:49:02.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.127+0000 7f6053a00640 1 -- 172.21.15.144:0/3790992695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c15ef30 msgr2=0x7f604c071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.127+0000 7f6053a00640 1 --2- 172.21.15.144:0/3790992695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c15ef30 0x7f604c071df0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f604c06c650 tx=0x7f603402a420 comp rx=0 tx=0).stop 2024-05-30T16:49:02.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.127+0000 7f6053a00640 1 -- 172.21.15.144:0/3790992695 shutdown_connections 2024-05-30T16:49:02.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.127+0000 7f6053a00640 1 --2- 172.21.15.144:0/3790992695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c15ef30 0x7f604c071df0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.127+0000 7f6053a00640 1 --2- 172.21.15.144:0/3790992695 >> v2:172.21.15.149:3300/0 conn(0x7f604c140f20 0x7f604c15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.127+0000 7f6053a00640 1 -- 172.21.15.144:0/3790992695 >> 172.21.15.144:0/3790992695 conn(0x7f604c070050 msgr2=0x7f604c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:02.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.127+0000 7f6053a00640 1 -- 172.21.15.144:0/3790992695 shutdown_connections 2024-05-30T16:49:02.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.128+0000 7f6053a00640 1 -- 172.21.15.144:0/3790992695 wait complete. 2024-05-30T16:49:02.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.130+0000 7f6053a00640 1 Processor -- start 2024-05-30T16:49:02.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.131+0000 7f6053a00640 1 -- start start 2024-05-30T16:49:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.133+0000 7f6053a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c070500 0x7f604c156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.133+0000 7f6053a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604c140f20 0x7f604c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.133+0000 7f6053a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f604c15ef30 0x7f604c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.134+0000 7f6053a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f604c15f3a0 con 0x7f604c070500 2024-05-30T16:49:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.134+0000 7f6053a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f604c15b600 con 0x7f604c15ef30 2024-05-30T16:49:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.134+0000 7f6053a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f604c0b5fb0 con 0x7f604c140f20 2024-05-30T16:49:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.134+0000 7f6051000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c070500 0x7f604c156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.134+0000 7f6051000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c070500 0x7f604c156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49708/0 (socket says 172.21.15.144:49708) 2024-05-30T16:49:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.134+0000 7f6051000640 1 -- 172.21.15.144:0/881354127 learned_addr learned my addr 172.21.15.144:0/881354127 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.135+0000 7f6051000640 1 -- 172.21.15.144:0/881354127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604c140f20 msgr2=0x7f604c0b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.135+0000 7f6051000640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604c140f20 0x7f604c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.135+0000 7f6051000640 1 -- 172.21.15.144:0/881354127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f604c15ef30 msgr2=0x7f604c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.135+0000 7f6051000640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f604c15ef30 0x7f604c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.135+0000 7f6051000640 1 -- 172.21.15.144:0/881354127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c0b00e0 con 0x7f604c070500 2024-05-30T16:49:02.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.135+0000 7f6051000640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c070500 0x7f604c156b70 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f603c00b410 tx=0x7f603c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:02.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.136+0000 7f6048c00640 1 -- 172.21.15.144:0/881354127 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c015020 con 0x7f604c070500 2024-05-30T16:49:02.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.136+0000 7f6048c00640 1 -- 172.21.15.144:0/881354127 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f603c011850 con 0x7f604c070500 2024-05-30T16:49:02.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.136+0000 7f6048c00640 1 -- 172.21.15.144:0/881354127 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c011c40 con 0x7f604c070500 2024-05-30T16:49:02.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.136+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604c0b03c0 con 0x7f604c070500 2024-05-30T16:49:02.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.136+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f604c0b0980 con 0x7f604c070500 2024-05-30T16:49:02.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.138+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f604c0cdc30 con 0x7f604c070500 2024-05-30T16:49:02.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.140+0000 7f6048c00640 1 -- 172.21.15.144:0/881354127 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f603c018020 con 0x7f604c070500 2024-05-30T16:49:02.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.142+0000 7f6048c00640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f602806d5d0 0x7f602806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.142+0000 7f6048c00640 1 -- 172.21.15.144:0/881354127 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f603c08a710 con 0x7f604c070500 2024-05-30T16:49:02.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.143+0000 7f604be00640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f602806d5d0 0x7f602806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.145+0000 7f604be00640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f602806d5d0 0x7f602806fa90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6034033000 tx=0x7f603402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:02.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.151+0000 7f6048c00640 1 -- 172.21.15.144:0/881354127 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f604c0cdc30 con 0x7f604c070500 2024-05-30T16:49:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.601+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone56767", "target": ["mon-mgr", ""]}) -- 0x7f604c075f70 con 0x7f602806d5d0 2024-05-30T16:49:02.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.786+0000 7f6048c00640 1 -- 172.21.15.144:0/881354127 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6034004220 con 0x7f602806d5d0 2024-05-30T16:49:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.788+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f602806d5d0 msgr2=0x7f602806fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.788+0000 7f6053a00640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f602806d5d0 0x7f602806fa90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6034033000 tx=0x7f603402e000 comp rx=0 tx=0).stop 2024-05-30T16:49:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c070500 msgr2=0x7f604c156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c070500 0x7f604c156b70 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f603c00b410 tx=0x7f603c00b8d0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 shutdown_connections 2024-05-30T16:49:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f602806d5d0 0x7f602806fa90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f604c15ef30 0x7f604c0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604c140f20 0x7f604c0b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 --2- 172.21.15.144:0/881354127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f604c070500 0x7f604c156b70 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 >> 172.21.15.144:0/881354127 conn(0x7f604c070050 msgr2=0x7f604c13f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 shutdown_connections 2024-05-30T16:49:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.789+0000 7f6053a00640 1 -- 172.21.15.144:0/881354127 wait complete. 2024-05-30T16:49:02.807 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:49:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.975+0000 7f82adc00640 1 Processor -- start 2024-05-30T16:49:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.975+0000 7f82adc00640 1 -- start start 2024-05-30T16:49:02.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.976+0000 7f82adc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82a80b55a0 0x7f82a81425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.976+0000 7f82adc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a80ce510 con 0x7f82a80cd700 2024-05-30T16:49:02.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.976+0000 7f82adc00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a80ce7d0 con 0x7f82a8141f20 2024-05-30T16:49:02.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.976+0000 7f82adc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f82a8142300 con 0x7f82a80b55a0 2024-05-30T16:49:02.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.976+0000 7f829fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f82a80cd700 0x7f82a80b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60822/0 (socket says 172.21.15.144:60822) 2024-05-30T16:49:02.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.976+0000 7f82a7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82a80b55a0 0x7f82a81425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.976+0000 7f829fe00640 1 -- 172.21.15.144:0/968838155 learned_addr learned my addr 172.21.15.144:0/968838155 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:02.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.977+0000 7f82a7400640 1 -- 172.21.15.144:0/968838155 >> v1:172.21.15.149:6789/0 conn(0x7f82a8141f20 legacy=0x7f82a80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:02.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.977+0000 7f82a7400640 1 -- 172.21.15.144:0/968838155 >> v1:172.21.15.144:6789/0 conn(0x7f82a80cd700 legacy=0x7f82a80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.977+0000 7f82a7400640 1 -- 172.21.15.144:0/968838155 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a80ceab0 con 0x7f82a80b55a0 2024-05-30T16:49:02.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.978+0000 7f82a7400640 1 --2- 172.21.15.144:0/968838155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a80b55a0 0x7f82a81425b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009d90 tx=0x7f82a002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88617df54fa51f41 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:02.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.978+0000 7f82a6000640 1 -- 172.21.15.144:0/968838155 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0031600 con 0x7f82a80b55a0 2024-05-30T16:49:02.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.978+0000 7f82a6000640 1 -- 172.21.15.144:0/968838155 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a00317a0 con 0x7f82a80b55a0 2024-05-30T16:49:02.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.978+0000 7f82a6000640 1 -- 172.21.15.144:0/968838155 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0031b70 con 0x7f82a80b55a0 2024-05-30T16:49:02.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.979+0000 7f82adc00640 1 -- 172.21.15.144:0/968838155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a80b55a0 msgr2=0x7f82a81425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.979+0000 7f82adc00640 1 --2- 172.21.15.144:0/968838155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a80b55a0 0x7f82a81425b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009d90 tx=0x7f82a002a610 comp rx=0 tx=0).stop 2024-05-30T16:49:02.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.979+0000 7f82adc00640 1 -- 172.21.15.144:0/968838155 shutdown_connections 2024-05-30T16:49:02.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.979+0000 7f82adc00640 1 --2- 172.21.15.144:0/968838155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a80b55a0 0x7f82a81425b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.979+0000 7f82adc00640 1 -- 172.21.15.144:0/968838155 >> 172.21.15.144:0/968838155 conn(0x7f82a80629c0 msgr2=0x7f82a806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:02.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.979+0000 7f82adc00640 1 -- 172.21.15.144:0/968838155 shutdown_connections 2024-05-30T16:49:02.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.979+0000 7f82adc00640 1 -- 172.21.15.144:0/968838155 wait complete. 2024-05-30T16:49:02.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.980+0000 7f82adc00640 1 Processor -- start 2024-05-30T16:49:02.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.980+0000 7f82adc00640 1 -- start start 2024-05-30T16:49:02.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.981+0000 7f82adc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a80b55a0 0x7f82a815b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.981+0000 7f82adc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82a80cd700 0x7f82a80aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.981+0000 7f82adc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a8141f20 0x7f82a815dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.981+0000 7f82adc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f82a80cf590 con 0x7f82a8141f20 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.981+0000 7f82adc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82a80cf100 con 0x7f82a80b55a0 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.981+0000 7f82adc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82a80cf710 con 0x7f82a80cd700 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a8141f20 0x7f82a815dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a8141f20 0x7f82a815dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49722/0 (socket says 172.21.15.144:49722) 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a7400640 1 -- 172.21.15.144:0/3763263019 learned_addr learned my addr 172.21.15.144:0/3763263019 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a7400640 1 -- 172.21.15.144:0/3763263019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82a80cd700 msgr2=0x7f82a80aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a7400640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82a80cd700 0x7f82a80aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a7400640 1 -- 172.21.15.144:0/3763263019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a80b55a0 msgr2=0x7f82a815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a6a00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a80b55a0 0x7f82a815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a7400640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a80b55a0 0x7f82a815b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a7400640 1 -- 172.21.15.144:0/3763263019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a815b780 con 0x7f82a8141f20 2024-05-30T16:49:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.982+0000 7f82a7400640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a8141f20 0x7f82a815dfc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009eb0 tx=0x7f82a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.983+0000 7f829ea00640 1 -- 172.21.15.144:0/3763263019 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0040070 con 0x7f82a8141f20 2024-05-30T16:49:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.983+0000 7f829ea00640 1 -- 172.21.15.144:0/3763263019 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a0030b60 con 0x7f82a8141f20 2024-05-30T16:49:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.983+0000 7f829ea00640 1 -- 172.21.15.144:0/3763263019 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0045460 con 0x7f82a8141f20 2024-05-30T16:49:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.983+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a8130a30 con 0x7f82a8141f20 2024-05-30T16:49:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.983+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a8130ff0 con 0x7f82a8141f20 2024-05-30T16:49:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.984+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a8068b20 con 0x7f82a8141f20 2024-05-30T16:49:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.985+0000 7f829ea00640 1 -- 172.21.15.144:0/3763263019 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f82a0039040 con 0x7f82a8141f20 2024-05-30T16:49:02.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.986+0000 7f829ea00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f828406d550 0x7f828406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:02.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.986+0000 7f829ea00640 1 -- 172.21.15.144:0/3763263019 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f82a00ac010 con 0x7f82a8141f20 2024-05-30T16:49:02.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.986+0000 7f82a6a00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f828406d550 0x7f828406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:02.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.987+0000 7f82a6a00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f828406d550 0x7f828406fa10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8298006fd0 tx=0x7f8298008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:02.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:02.991+0000 7f829ea00640 1 -- 172.21.15.144:0/3763263019 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f82a815b780 con 0x7f82a8141f20 2024-05-30T16:49:03.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.204+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f82a806cea0 con 0x7f828406d550 2024-05-30T16:49:03.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.206+0000 7f829ea00640 1 -- 172.21.15.144:0/3763263019 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f82a806cea0 con 0x7f828406d550 2024-05-30T16:49:03.207 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:49:03.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:03.208 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-05-30T16:49:03.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:03.208 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:49:03.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.208+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f828406d550 msgr2=0x7f828406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.208+0000 7f82adc00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f828406d550 0x7f828406fa10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8298006fd0 tx=0x7f8298008040 comp rx=0 tx=0).stop 2024-05-30T16:49:03.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.208+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a8141f20 msgr2=0x7f82a815dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.208+0000 7f82adc00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a8141f20 0x7f82a815dfc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009eb0 tx=0x7f82a0004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:03.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.209+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 shutdown_connections 2024-05-30T16:49:03.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.209+0000 7f82adc00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f828406d550 0x7f828406fa10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.209+0000 7f82adc00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82a8141f20 0x7f82a815dfc0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.209+0000 7f82adc00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82a80cd700 0x7f82a80aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.209+0000 7f82adc00640 1 --2- 172.21.15.144:0/3763263019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a80b55a0 0x7f82a815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.209+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 >> 172.21.15.144:0/3763263019 conn(0x7f82a80629c0 msgr2=0x7f82a8074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:03.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.209+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 shutdown_connections 2024-05-30T16:49:03.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.209+0000 7f82adc00640 1 -- 172.21.15.144:0/3763263019 wait complete. 2024-05-30T16:49:03.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:49:03.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.417+0000 7f804dc00640 1 Processor -- start 2024-05-30T16:49:03.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.417+0000 7f804dc00640 1 -- start start 2024-05-30T16:49:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f804dc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f804806d7f0 0x7f80480d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f804dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f804806cc70 0x7f80480d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f804dc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80480d08d0 con 0x7f804815ec60 2024-05-30T16:49:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f804dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f804815f5e0 con 0x7f804806cc70 2024-05-30T16:49:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f804dc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f804815f8c0 con 0x7f804806d7f0 2024-05-30T16:49:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f8046a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f804815ec60 0x7f804806d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60838/0 (socket says 172.21.15.144:60838) 2024-05-30T16:49:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f8046a00640 1 -- 172.21.15.144:0/3975469272 learned_addr learned my addr 172.21.15.144:0/3975469272 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f8047400640 1 --2- 172.21.15.144:0/3975469272 >> v2:172.21.15.144:3300/0 conn(0x7f804806cc70 0x7f80480d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f803e000640 1 --2- 172.21.15.144:0/3975469272 >> v2:172.21.15.149:3300/0 conn(0x7f804806d7f0 0x7f80480d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f8046000640 1 -- 172.21.15.144:0/3975469272 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221192191 0 0) 0x7f80480d08d0 con 0x7f804815ec60 2024-05-30T16:49:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.419+0000 7f8046000640 1 -- 172.21.15.144:0/3975469272 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f802c003520 con 0x7f804815ec60 2024-05-30T16:49:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.420+0000 7f8047400640 1 -- 172.21.15.144:0/3975469272 >> v2:172.21.15.149:3300/0 conn(0x7f804806d7f0 msgr2=0x7f80480d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.420+0000 7f8047400640 1 --2- 172.21.15.144:0/3975469272 >> v2:172.21.15.149:3300/0 conn(0x7f804806d7f0 0x7f80480d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.420+0000 7f8047400640 1 -- 172.21.15.144:0/3975469272 >> v1:172.21.15.144:6789/0 conn(0x7f804815ec60 legacy=0x7f804806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.420+0000 7f8047400640 1 -- 172.21.15.144:0/3975469272 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804815fba0 con 0x7f804806cc70 2024-05-30T16:49:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.421+0000 7f8047400640 1 --2- 172.21.15.144:0/3975469272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804806cc70 0x7f80480d12f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f804806e740 tx=0x7f804002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb33550d6179322 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.421+0000 7f8046000640 1 -- 172.21.15.144:0/3975469272 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040037070 con 0x7f804806cc70 2024-05-30T16:49:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.421+0000 7f8046000640 1 -- 172.21.15.144:0/3975469272 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8040032440 con 0x7f804806cc70 2024-05-30T16:49:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.421+0000 7f8046000640 1 -- 172.21.15.144:0/3975469272 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804002ae60 con 0x7f804806cc70 2024-05-30T16:49:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.421+0000 7f804dc00640 1 -- 172.21.15.144:0/3975469272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804806cc70 msgr2=0x7f80480d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.421+0000 7f804dc00640 1 --2- 172.21.15.144:0/3975469272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804806cc70 0x7f80480d12f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f804806e740 tx=0x7f804002a110 comp rx=0 tx=0).stop 2024-05-30T16:49:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.422+0000 7f804dc00640 1 -- 172.21.15.144:0/3975469272 shutdown_connections 2024-05-30T16:49:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.422+0000 7f804dc00640 1 --2- 172.21.15.144:0/3975469272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804806cc70 0x7f80480d12f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.422+0000 7f804dc00640 1 --2- 172.21.15.144:0/3975469272 >> v2:172.21.15.149:3300/0 conn(0x7f804806d7f0 0x7f80480d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.422+0000 7f804dc00640 1 -- 172.21.15.144:0/3975469272 >> 172.21.15.144:0/3975469272 conn(0x7f80480b4180 msgr2=0x7f80480b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.422+0000 7f804dc00640 1 -- 172.21.15.144:0/3975469272 shutdown_connections 2024-05-30T16:49:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.422+0000 7f804dc00640 1 -- 172.21.15.144:0/3975469272 wait complete. 2024-05-30T16:49:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.423+0000 7f804dc00640 1 Processor -- start 2024-05-30T16:49:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.423+0000 7f804dc00640 1 -- start start 2024-05-30T16:49:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.424+0000 7f804dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f804806cc70 0x7f804809fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.424+0000 7f804dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f804806d7f0 0x7f80480b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.424+0000 7f804dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804815ec60 0x7f8048153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.424+0000 7f804dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f80481627f0 con 0x7f804815ec60 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.424+0000 7f804dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8048162670 con 0x7f804806d7f0 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.424+0000 7f804dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8048162970 con 0x7f804806cc70 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8047400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804815ec60 0x7f8048153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8047400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804815ec60 0x7f8048153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49732/0 (socket says 172.21.15.144:49732) 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8047400640 1 -- 172.21.15.144:0/3891099404 learned_addr learned my addr 172.21.15.144:0/3891099404 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f803e000640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f804806d7f0 0x7f80480b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8046a00640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f804806cc70 0x7f804809fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8047400640 1 -- 172.21.15.144:0/3891099404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f804806cc70 msgr2=0x7f804809fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8047400640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f804806cc70 0x7f804809fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8047400640 1 -- 172.21.15.144:0/3891099404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f804806d7f0 msgr2=0x7f80480b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8047400640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f804806d7f0 0x7f80480b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8047400640 1 -- 172.21.15.144:0/3891099404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80480b7b10 con 0x7f804815ec60 2024-05-30T16:49:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f803e000640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f804806d7f0 0x7f80480b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.425+0000 7f8047400640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804815ec60 0x7f8048153a10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8040009890 tx=0x7f80400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.426+0000 7f803f400640 1 -- 172.21.15.144:0/3891099404 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040037040 con 0x7f804815ec60 2024-05-30T16:49:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.426+0000 7f803f400640 1 -- 172.21.15.144:0/3891099404 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8040042070 con 0x7f804815ec60 2024-05-30T16:49:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.426+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80480b7d90 con 0x7f804815ec60 2024-05-30T16:49:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.426+0000 7f803f400640 1 -- 172.21.15.144:0/3891099404 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400308a0 con 0x7f804815ec60 2024-05-30T16:49:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.426+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80480b8350 con 0x7f804815ec60 2024-05-30T16:49:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.427+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8048068b90 con 0x7f804815ec60 2024-05-30T16:49:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.428+0000 7f803f400640 1 -- 172.21.15.144:0/3891099404 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f8040030a40 con 0x7f804815ec60 2024-05-30T16:49:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.429+0000 7f803f400640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f802406d550 0x7f802406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.429+0000 7f803f400640 1 -- 172.21.15.144:0/3891099404 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f80400aaf60 con 0x7f804815ec60 2024-05-30T16:49:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.429+0000 7f8046a00640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f802406d550 0x7f802406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.430+0000 7f8046a00640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f802406d550 0x7f802406fa10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8038000f60 tx=0x7f8038009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:03.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.433+0000 7f803f400640 1 -- 172.21.15.144:0/3891099404 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f80480b7b10 con 0x7f804815ec60 2024-05-30T16:49:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.693+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f80480b4ea0 con 0x7f804815ec60 2024-05-30T16:49:03.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.694+0000 7f803f400640 1 -- 172.21.15.144:0/3891099404 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2873 (secure 0 0 0) 0x7f804007ad50 con 0x7f804815ec60 2024-05-30T16:49:03.695 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:03.695 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:49:03.695 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:49:03.695 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:49:03.695 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:49:03.695 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:49:03.696 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 455, 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 59, 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:49:03.697 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4162, 2024-05-30T16:49:03.698 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 17303570511, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 34575548416, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 738518564864, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 618484046, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 622036298, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 149, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 167 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 36, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:49:03.699 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 4, 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "c", 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5808 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:49:03.700 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 8, 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:48:55.082244+0000", 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "services": { 2024-05-30T16:49:03.701 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: "daemons": { 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: "summary": "", 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: "c": { 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: "start_epoch": 0, 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: "start_stamp": "0.000000", 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 0, 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: "metadata": {}, 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: "task_status": {} 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:03.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: "8791c6a1-5723-467e-bca1-83d58526d8f3": { 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "2 ongoing clones; Avg progress is 28.516% (24s)\n [=======.....................] (remaining: 61s)", 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.28516000509262085, 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: "972001b1-9f10-4c64-bdc9-a12803ed001f": { 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "2 ongoing+pending clones; Avg progress is 28.516% (16s)\n [=======.....................] (remaining: 41s)", 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.28516000509262085, 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:03.703 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:49:03.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f802406d550 msgr2=0x7f802406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f802406d550 0x7f802406fa10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8038000f60 tx=0x7f8038009040 comp rx=0 tx=0).stop 2024-05-30T16:49:03.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804815ec60 msgr2=0x7f8048153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:03.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804815ec60 0x7f8048153a10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8040009890 tx=0x7f80400046c0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 shutdown_connections 2024-05-30T16:49:03.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f802406d550 0x7f802406fa10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f804815ec60 0x7f8048153a10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f804806d7f0 0x7f80480b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 --2- 172.21.15.144:0/3891099404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f804806cc70 0x7f804809fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:03.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.696+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 >> 172.21.15.144:0/3891099404 conn(0x7f80480b4180 msgr2=0x7f8048071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:03.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.697+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 shutdown_connections 2024-05-30T16:49:03.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:03.697+0000 7f804dc00640 1 -- 172.21.15.144:0/3891099404 wait complete. 2024-05-30T16:49:08.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:49:08.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.929+0000 7f6b47000640 1 Processor -- start 2024-05-30T16:49:08.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.929+0000 7f6b47000640 1 -- start start 2024-05-30T16:49:08.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.930+0000 7f6b47000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 0x7f6b4015c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.930+0000 7f6b47000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4015f780 con 0x7f6b4015c780 2024-05-30T16:49:08.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.930+0000 7f6b47000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4015fa60 con 0x7f6b400caf10 2024-05-30T16:49:08.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.930+0000 7f6b47000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4015fd40 con 0x7f6b400cb2f0 2024-05-30T16:49:08.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.930+0000 7f6b46600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6b4015c780 0x7f6b400b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:36066/0 (socket says 172.21.15.144:36066) 2024-05-30T16:49:08.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.931+0000 7f6b46600640 1 -- 172.21.15.144:0/563538795 learned_addr learned my addr 172.21.15.144:0/563538795 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:08.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.931+0000 7f6b45200640 1 --2- 172.21.15.144:0/563538795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 0x7f6b4015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.931+0000 7f6b45200640 1 -- 172.21.15.144:0/563538795 >> v1:172.21.15.149:6789/0 conn(0x7f6b400caf10 legacy=0x7f6b4015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.931+0000 7f6b45200640 1 -- 172.21.15.144:0/563538795 >> v1:172.21.15.144:6789/0 conn(0x7f6b4015c780 legacy=0x7f6b400b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.932+0000 7f6b45200640 1 -- 172.21.15.144:0/563538795 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4015b950 con 0x7f6b400cb2f0 2024-05-30T16:49:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.933+0000 7f6b45200640 1 --2- 172.21.15.144:0/563538795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 0x7f6b4015c240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0097d0 tx=0x7f6b2c02a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdfe066568b7a082 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.938+0000 7f6b3fe00640 1 -- 172.21.15.144:0/563538795 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c037070 con 0x7f6b400cb2f0 2024-05-30T16:49:08.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.938+0000 7f6b3fe00640 1 -- 172.21.15.144:0/563538795 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b2c032440 con 0x7f6b400cb2f0 2024-05-30T16:49:08.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.938+0000 7f6b3fe00640 1 -- 172.21.15.144:0/563538795 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c032810 con 0x7f6b400cb2f0 2024-05-30T16:49:08.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.939+0000 7f6b47000640 1 -- 172.21.15.144:0/563538795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 msgr2=0x7f6b4015c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.939+0000 7f6b47000640 1 --2- 172.21.15.144:0/563538795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 0x7f6b4015c240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0097d0 tx=0x7f6b2c02a200 comp rx=0 tx=0).stop 2024-05-30T16:49:08.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.939+0000 7f6b47000640 1 -- 172.21.15.144:0/563538795 shutdown_connections 2024-05-30T16:49:08.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.939+0000 7f6b47000640 1 --2- 172.21.15.144:0/563538795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 0x7f6b4015c240 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.939+0000 7f6b47000640 1 -- 172.21.15.144:0/563538795 >> 172.21.15.144:0/563538795 conn(0x7f6b400b20a0 msgr2=0x7f6b400b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:08.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.939+0000 7f6b47000640 1 -- 172.21.15.144:0/563538795 shutdown_connections 2024-05-30T16:49:08.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.939+0000 7f6b47000640 1 -- 172.21.15.144:0/563538795 wait complete. 2024-05-30T16:49:08.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.941+0000 7f6b47000640 1 Processor -- start 2024-05-30T16:49:08.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.941+0000 7f6b47000640 1 -- start start 2024-05-30T16:49:08.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b47000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b400caf10 0x7f6b4014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b47000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 0x7f6b4006f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b47000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4015c780 0x7f6b40155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b47000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b400cf8b0 con 0x7f6b4015c780 2024-05-30T16:49:08.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b47000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b400b3b60 con 0x7f6b400caf10 2024-05-30T16:49:08.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b47000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b400cfa30 con 0x7f6b400cb2f0 2024-05-30T16:49:08.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b46600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4015c780 0x7f6b40155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b46600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4015c780 0x7f6b40155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41272/0 (socket says 172.21.15.144:41272) 2024-05-30T16:49:08.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b46600640 1 -- 172.21.15.144:0/497666126 learned_addr learned my addr 172.21.15.144:0/497666126 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:08.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.942+0000 7f6b45c00640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b400caf10 0x7f6b4014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b46600640 1 -- 172.21.15.144:0/497666126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 msgr2=0x7f6b4006f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b46600640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 0x7f6b4006f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b46600640 1 -- 172.21.15.144:0/497666126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b400caf10 msgr2=0x7f6b4014e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:08.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b46600640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b400caf10 0x7f6b4014e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:08.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b46600640 1 -- 172.21.15.144:0/497666126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4014ee80 con 0x7f6b4015c780 2024-05-30T16:49:08.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b45c00640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b400caf10 0x7f6b4014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:08.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b46600640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4015c780 0x7f6b40155250 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800cad0 tx=0x7f6b3800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b3d600640 1 -- 172.21.15.144:0/497666126 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38017070 con 0x7f6b4015c780 2024-05-30T16:49:08.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b3d600640 1 -- 172.21.15.144:0/497666126 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3800ab70 con 0x7f6b4015c780 2024-05-30T16:49:08.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b3d600640 1 -- 172.21.15.144:0/497666126 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38012400 con 0x7f6b4015c780 2024-05-30T16:49:08.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4006e590 con 0x7f6b4015c780 2024-05-30T16:49:08.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.943+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4006eb50 con 0x7f6b4015c780 2024-05-30T16:49:08.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.945+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b40075570 con 0x7f6b4015c780 2024-05-30T16:49:08.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.946+0000 7f6b3d600640 1 -- 172.21.15.144:0/497666126 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f6b3801a070 con 0x7f6b4015c780 2024-05-30T16:49:08.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.947+0000 7f6b3d600640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6b2006d550 0x7f6b2006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:08.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.947+0000 7f6b3d600640 1 -- 172.21.15.144:0/497666126 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f6b3808a320 con 0x7f6b4015c780 2024-05-30T16:49:08.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.947+0000 7f6b45c00640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6b2006d550 0x7f6b2006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:08.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.948+0000 7f6b45c00640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6b2006d550 0x7f6b2006fa10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6b34001680 tx=0x7f6b34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:08.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:08.952+0000 7f6b3d600640 1 -- 172.21.15.144:0/497666126 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b380598d0 con 0x7f6b4015c780 2024-05-30T16:49:09.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.228+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6b400b5000 con 0x7f6b4015c780 2024-05-30T16:49:09.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.229+0000 7f6b3d600640 1 -- 172.21.15.144:0/497666126 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2378 (secure 0 0 0) 0x7f6b3805dbd0 con 0x7f6b4015c780 2024-05-30T16:49:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:09.230 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:49:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:49:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:49:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 461, 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 59, 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:49:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4884, 2024-05-30T16:49:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 20336212102, 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 41094266880, 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 731999846400, 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 598659647, 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 598024059, 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 146, 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 164 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 36, 2024-05-30T16:49:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4, 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 4, 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "c", 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5808 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 9, 2024-05-30T16:49:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:49:05.097167+0000", 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "8791c6a1-5723-467e-bca1-83d58526d8f3": { 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (30s)\n [============================] ", 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "972001b1-9f10-4c64-bdc9-a12803ed001f": { 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "No pending clones left, waiting 27.0 seconds before exiting (22s)\n [============================] ", 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:09.238 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:49:09.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.231+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6b2006d550 msgr2=0x7f6b2006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.231+0000 7f6b47000640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6b2006d550 0x7f6b2006fa10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6b34001680 tx=0x7f6b34009040 comp rx=0 tx=0).stop 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.231+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4015c780 msgr2=0x7f6b40155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.231+0000 7f6b47000640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4015c780 0x7f6b40155250 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800cad0 tx=0x7f6b3800cf90 comp rx=0 tx=0).stop 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.232+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 shutdown_connections 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.232+0000 7f6b47000640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6b2006d550 0x7f6b2006fa10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.232+0000 7f6b47000640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4015c780 0x7f6b40155250 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.232+0000 7f6b47000640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b400cb2f0 0x7f6b4006f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.232+0000 7f6b47000640 1 --2- 172.21.15.144:0/497666126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b400caf10 0x7f6b4014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.232+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 >> 172.21.15.144:0/497666126 conn(0x7f6b400b20a0 msgr2=0x7f6b400cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.232+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 shutdown_connections 2024-05-30T16:49:09.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:09.232+0000 7f6b47000640 1 -- 172.21.15.144:0/497666126 wait complete. 2024-05-30T16:49:14.255 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.463+0000 7f7fcda00640 1 Processor -- start 2024-05-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.463+0000 7f7fcda00640 1 -- start start 2024-05-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.464+0000 7f7fcda00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7fc80b4db0 0x7f7fc80ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.464+0000 7f7fcda00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc806b8e0 0x7f7fc806bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.464+0000 7f7fcda00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc815eb70 con 0x7f7fc815e790 2024-05-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.464+0000 7f7fcda00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc80cea50 con 0x7f7fc80b4db0 2024-05-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.464+0000 7f7fcda00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc80cded0 con 0x7f7fc806b8e0 2024-05-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.465+0000 7f7fc7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7fc815e790 0x7f7fc8162ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:36072/0 (socket says 172.21.15.144:36072) 2024-05-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.465+0000 7f7fc7e00640 1 -- 172.21.15.144:0/3626350349 learned_addr learned my addr 172.21.15.144:0/3626350349 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.465+0000 7f7fbfe00640 1 --2- 172.21.15.144:0/3626350349 >> v2:172.21.15.149:3300/0 conn(0x7f7fc80b4db0 0x7f7fc80ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.465+0000 7f7fcd000640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc806b8e0 0x7f7fc806bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.465+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487540761 0 0) 0x7f7fb8001110 con 0x7f7fc815e790 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.465+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fac003520 con 0x7f7fc815e790 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2335866659 0 0) 0x7f7fac003520 con 0x7f7fc815e790 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc806b8e0 msgr2=0x7f7fc806bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc806b8e0 0x7f7fc806bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 >> v2:172.21.15.149:3300/0 conn(0x7f7fc80b4db0 msgr2=0x7f7fc80ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 --2- 172.21.15.144:0/3626350349 >> v2:172.21.15.149:3300/0 conn(0x7f7fc80b4db0 0x7f7fc80ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc80ce1b0 con 0x7f7fc815e790 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f7fb8001840 con 0x7f7fc815e790 2024-05-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 >> v1:172.21.15.144:6789/0 conn(0x7f7fc815e790 legacy=0x7f7fc8162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fac004800 0x7f7fac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc806b8e0 0x7f7fac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80cea50 con 0x7f7fac0039b0 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80cded0 con 0x7f7fac004800 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac00b9f0 con 0x7f7fc806b8e0 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.466+0000 7f7fc7e00640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.467+0000 7f7fbfe00640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fac004800 0x7f7fac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.467+0000 7f7fc7e00640 1 -- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc806b8e0 msgr2=0x7f7fac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.467+0000 7f7fc7e00640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc806b8e0 0x7f7fac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.467+0000 7f7fc7e00640 1 -- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fac004800 msgr2=0x7f7fac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.467+0000 7f7fc7e00640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fac004800 0x7f7fac004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.467+0000 7f7fc7e00640 1 -- 172.21.15.144:0/3626350349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac003520 con 0x7f7fac0039b0 2024-05-30T16:49:14.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.468+0000 7f7fc7e00640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fac003dd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c3e0 tx=0x7f7fac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426c64b9aae154da server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.468+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8032020 con 0x7f7fac0039b0 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.468+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8005af0 con 0x7f7fac0039b0 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.468+0000 7f7fc7400640 1 -- 172.21.15.144:0/3626350349 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800c0e0 con 0x7f7fac0039b0 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.469+0000 7f7fcda00640 1 -- 172.21.15.144:0/3626350349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 msgr2=0x7f7fac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.469+0000 7f7fcda00640 1 --2- 172.21.15.144:0/3626350349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fac003dd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c3e0 tx=0x7f7fac005830 comp rx=0 tx=0).stop 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.469+0000 7f7fcd000640 1 -- 172.21.15.144:0/3626350349 reap_dead start 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.469+0000 7f7fcda00640 1 -- 172.21.15.144:0/3626350349 shutdown_connections 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.469+0000 7f7fcda00640 1 -- 172.21.15.144:0/3626350349 >> 172.21.15.144:0/3626350349 conn(0x7f7fc80b20a0 msgr2=0x7f7fc80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.469+0000 7f7fcda00640 1 -- 172.21.15.144:0/3626350349 shutdown_connections 2024-05-30T16:49:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.469+0000 7f7fcda00640 1 -- 172.21.15.144:0/3626350349 wait complete. 2024-05-30T16:49:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.471+0000 7f7fcda00640 1 Processor -- start 2024-05-30T16:49:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.471+0000 7f7fcda00640 1 -- start start 2024-05-30T16:49:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fcda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fc81f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fcda00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc8073450 0x7f7fc8071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fcda00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc81f86a0 0x7f7fc8145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fcda00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc806bd70 con 0x7f7fac0039b0 2024-05-30T16:49:14.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fcda00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80ce770 con 0x7f7fc81f86a0 2024-05-30T16:49:14.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fcda00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc806bef0 con 0x7f7fc8073450 2024-05-30T16:49:14.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fc81f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fc7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fc81f8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41290/0 (socket says 172.21.15.144:41290) 2024-05-30T16:49:14.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fc7e00640 1 -- 172.21.15.144:0/3396031124 learned_addr learned my addr 172.21.15.144:0/3396031124 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:14.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fc7e00640 1 -- 172.21.15.144:0/3396031124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc8073450 msgr2=0x7f7fc8071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.472+0000 7f7fc7e00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc8073450 0x7f7fc8071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.473+0000 7f7fc7e00640 1 -- 172.21.15.144:0/3396031124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc81f86a0 msgr2=0x7f7fc8145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.473+0000 7f7fc7e00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc81f86a0 0x7f7fc8145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.473+0000 7f7fc7e00640 1 -- 172.21.15.144:0/3396031124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc80723b0 con 0x7f7fac0039b0 2024-05-30T16:49:14.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.473+0000 7f7fc7e00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fc81f8fd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7fb802b010 tx=0x7f7fb8001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.473+0000 7f7fc4c00640 1 -- 172.21.15.144:0/3396031124 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8007270 con 0x7f7fac0039b0 2024-05-30T16:49:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.473+0000 7f7fc4c00640 1 -- 172.21.15.144:0/3396031124 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8007410 con 0x7f7fac0039b0 2024-05-30T16:49:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.473+0000 7f7fc4c00640 1 -- 172.21.15.144:0/3396031124 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80077e0 con 0x7f7fac0039b0 2024-05-30T16:49:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.473+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc8072690 con 0x7f7fac0039b0 2024-05-30T16:49:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.473+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc8072c50 con 0x7f7fac0039b0 2024-05-30T16:49:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.474+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc8075570 con 0x7f7fac0039b0 2024-05-30T16:49:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.475+0000 7f7fc4c00640 1 -- 172.21.15.144:0/3396031124 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f7fb8035020 con 0x7f7fac0039b0 2024-05-30T16:49:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.476+0000 7f7fc4c00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fa406d550 0x7f7fa406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:14.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.476+0000 7f7fc4c00640 1 -- 172.21.15.144:0/3396031124 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f7fb80aaa90 con 0x7f7fac0039b0 2024-05-30T16:49:14.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.477+0000 7f7fbfe00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fa406d550 0x7f7fa406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:14.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.477+0000 7f7fbfe00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fa406d550 0x7f7fa406fa10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8073e20 tx=0x7f7fb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:14.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.481+0000 7f7fc4c00640 1 -- 172.21.15.144:0/3396031124 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7fb8048060 con 0x7f7fac0039b0 2024-05-30T16:49:14.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.749+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7fc80b0620 con 0x7f7fac0039b0 2024-05-30T16:49:14.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.750+0000 7f7fc4c00640 1 -- 172.21.15.144:0/3396031124 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2376 (secure 0 0 0) 0x7f7fc815eb70 con 0x7f7fac0039b0 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:49:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 466, 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:49:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 59, 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:49:14.754 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4883, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 20336253379, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 41094340608, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 731999772672, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 255398347, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 252622167, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 63, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 69 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:49:14.755 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 36, 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4, 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 4, 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "c", 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5808 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:14.756 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:49:14.757 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 9, 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:49:05.097167+0000", 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "8791c6a1-5723-467e-bca1-83d58526d8f3": { 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (36s)\n [============================] ", 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "972001b1-9f10-4c64-bdc9-a12803ed001f": { 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "No pending clones left, waiting 21.0 seconds before exiting (28s)\n [============================] ", 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:14.758 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:14.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:14.759 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:49:14.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fa406d550 msgr2=0x7f7fa406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fa406d550 0x7f7fa406fa10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8073e20 tx=0x7f7fb0008040 comp rx=0 tx=0).stop 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 msgr2=0x7f7fc81f8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fc81f8fd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7fb802b010 tx=0x7f7fb8001c10 comp rx=0 tx=0).stop 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 shutdown_connections 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7fa406d550 0x7f7fa406fa10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc81f86a0 0x7f7fc8145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc8073450 0x7f7fc8071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 --2- 172.21.15.144:0/3396031124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac0039b0 0x7f7fc81f8fd0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 >> 172.21.15.144:0/3396031124 conn(0x7f7fc80b20a0 msgr2=0x7f7fc80b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.753+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 shutdown_connections 2024-05-30T16:49:14.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:14.754+0000 7f7fcda00640 1 -- 172.21.15.144:0/3396031124 wait complete. 2024-05-30T16:49:17.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:49:17.477 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:49:19.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:49:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.979+0000 7faa39c00640 1 Processor -- start 2024-05-30T16:49:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.979+0000 7faa39c00640 1 -- start start 2024-05-30T16:49:19.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.981+0000 7faa39c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa3406bd60 0x7faa3406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.981+0000 7faa39c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa340ccd20 con 0x7faa340cc0b0 2024-05-30T16:49:19.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.981+0000 7faa39c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa340cd000 con 0x7faa3406b8e0 2024-05-30T16:49:19.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.981+0000 7faa39c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7faa340cd2e0 con 0x7faa3406bd60 2024-05-30T16:49:19.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.981+0000 7faa33e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faa340cc0b0 0x7faa3415d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:38410/0 (socket says 172.21.15.144:38410) 2024-05-30T16:49:19.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.981+0000 7faa33e00640 1 -- 172.21.15.144:0/2342794491 learned_addr learned my addr 172.21.15.144:0/2342794491 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1424429750 0 0) 0x7faa340ccd20 con 0x7faa340cc0b0 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa18003520 con 0x7faa340cc0b0 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa39200640 1 --2- 172.21.15.144:0/2342794491 >> v2:172.21.15.149:3300/0 conn(0x7faa3406bd60 0x7faa3406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 532852635 0 0) 0x7faa18003520 con 0x7faa340cc0b0 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 >> v2:172.21.15.149:3300/0 conn(0x7faa3406bd60 msgr2=0x7faa3406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 --2- 172.21.15.144:0/2342794491 >> v2:172.21.15.149:3300/0 conn(0x7faa3406bd60 0x7faa3406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 >> v1:172.21.15.149:6789/0 conn(0x7faa3406b8e0 legacy=0x7faa3406ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa340cd5c0 con 0x7faa340cc0b0 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7faa24001670 con 0x7faa340cc0b0 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa39200640 1 --2- 172.21.15.144:0/2342794491 >> v2:172.21.15.149:3300/0 conn(0x7faa3406bd60 0x7faa3406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 >> v1:172.21.15.144:6789/0 conn(0x7faa340cc0b0 legacy=0x7faa3415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa18003a00 0x7faa18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa18004800 0x7faa18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa180052e0 0x7faa1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa340cd2e0 con 0x7faa18004800 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faa1800c200 con 0x7faa18003a00 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.982+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faa1800c400 con 0x7faa180052e0 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa2b400640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa18004800 0x7faa18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa33e00640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa18003a00 0x7faa18003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa2b400640 1 -- 172.21.15.144:0/2342794491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa180052e0 msgr2=0x7faa1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa39200640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa180052e0 0x7faa1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa2b400640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa180052e0 0x7faa1800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa2b400640 1 -- 172.21.15.144:0/2342794491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa18003a00 msgr2=0x7faa18003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa2b400640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa18003a00 0x7faa18003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa2b400640 1 -- 172.21.15.144:0/2342794491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa18003520 con 0x7faa18004800 2024-05-30T16:49:19.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa33e00640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa18003a00 0x7faa18003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:19.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.983+0000 7faa39200640 1 -- 172.21.15.144:0/2342794491 reap_dead start 2024-05-30T16:49:19.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.984+0000 7faa2b400640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa18004800 0x7faa18004c80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7faa1c001750 tx=0x7faa18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c60993c02575449 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.984+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c001370 con 0x7faa18004800 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.984+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c0052d0 con 0x7faa18004800 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.984+0000 7faa33400640 1 -- 172.21.15.144:0/2342794491 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c02abc0 con 0x7faa18004800 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.985+0000 7faa39c00640 1 -- 172.21.15.144:0/2342794491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa18004800 msgr2=0x7faa18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.985+0000 7faa39c00640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa18004800 0x7faa18004c80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7faa1c001750 tx=0x7faa18005830 comp rx=0 tx=0).stop 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.985+0000 7faa39c00640 1 -- 172.21.15.144:0/2342794491 shutdown_connections 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.985+0000 7faa39c00640 1 --2- 172.21.15.144:0/2342794491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa18004800 0x7faa18004c80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.985+0000 7faa39c00640 1 -- 172.21.15.144:0/2342794491 >> 172.21.15.144:0/2342794491 conn(0x7faa340b20a0 msgr2=0x7faa340b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.985+0000 7faa39c00640 1 -- 172.21.15.144:0/2342794491 shutdown_connections 2024-05-30T16:49:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.985+0000 7faa39c00640 1 -- 172.21.15.144:0/2342794491 wait complete. 2024-05-30T16:49:19.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.987+0000 7faa39c00640 1 Processor -- start 2024-05-30T16:49:19.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.987+0000 7faa39c00640 1 -- start start 2024-05-30T16:49:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.988+0000 7faa39c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa18004800 0x7faa34159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.988+0000 7faa39c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa340af260 0x7faa341570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.988+0000 7faa39c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa341f3f40 0x7faa3415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.988+0000 7faa39c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa340cc490 con 0x7faa340af260 2024-05-30T16:49:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.988+0000 7faa39c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faa340cc9e0 con 0x7faa341f3f40 2024-05-30T16:49:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.988+0000 7faa39c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faa34156a70 con 0x7faa18004800 2024-05-30T16:49:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.988+0000 7faa2b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa340af260 0x7faa341570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.988+0000 7faa2b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa340af260 0x7faa341570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50472/0 (socket says 172.21.15.144:50472) 2024-05-30T16:49:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.988+0000 7faa2b400640 1 -- 172.21.15.144:0/1401771357 learned_addr learned my addr 172.21.15.144:0/1401771357 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa33e00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa18004800 0x7faa34159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa39200640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa341f3f40 0x7faa3415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa2b400640 1 -- 172.21.15.144:0/1401771357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa18004800 msgr2=0x7faa34159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa2b400640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa18004800 0x7faa34159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa2b400640 1 -- 172.21.15.144:0/1401771357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa341f3f40 msgr2=0x7faa3415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa2b400640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa341f3f40 0x7faa3415b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa2b400640 1 -- 172.21.15.144:0/1401771357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3415c0b0 con 0x7faa340af260 2024-05-30T16:49:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa2b400640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa340af260 0x7faa341570e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7faa1c02a570 tx=0x7faa1c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa30c00640 1 -- 172.21.15.144:0/1401771357 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c037040 con 0x7faa340af260 2024-05-30T16:49:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.989+0000 7faa30c00640 1 -- 172.21.15.144:0/1401771357 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c040070 con 0x7faa340af260 2024-05-30T16:49:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.990+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa34157620 con 0x7faa340af260 2024-05-30T16:49:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.990+0000 7faa30c00640 1 -- 172.21.15.144:0/1401771357 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c001370 con 0x7faa340af260 2024-05-30T16:49:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.990+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa341596d0 con 0x7faa340af260 2024-05-30T16:49:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.991+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa340691f0 con 0x7faa340af260 2024-05-30T16:49:19.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.992+0000 7faa30c00640 1 -- 172.21.15.144:0/1401771357 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7faa1c0052d0 con 0x7faa340af260 2024-05-30T16:49:19.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.993+0000 7faa30c00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faa1006d550 0x7faa1006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:19.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.993+0000 7faa30c00640 1 -- 172.21.15.144:0/1401771357 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7faa1c0aa1c0 con 0x7faa340af260 2024-05-30T16:49:19.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.993+0000 7faa33e00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faa1006d550 0x7faa1006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:19.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.994+0000 7faa33e00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faa1006d550 0x7faa1006fa10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faa24000c00 tx=0x7faa24009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:19.997+0000 7faa30c00640 1 -- 172.21.15.144:0/1401771357 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa340691f0 con 0x7faa340af260 2024-05-30T16:49:20.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.275+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faa34075570 con 0x7faa340af260 2024-05-30T16:49:20.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.276+0000 7faa30c00640 1 -- 172.21.15.144:0/1401771357 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2362 (secure 0 0 0) 0x7faa1c07a040 con 0x7faa340af260 2024-05-30T16:49:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:20.277 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:49:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 472, 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 59, 2024-05-30T16:49:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4883, 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 20336264455, 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 41094365184, 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 731999748096, 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 85, 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 4861, 2024-05-30T16:49:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 1 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 36, 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4, 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 4, 2024-05-30T16:49:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "c", 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5808 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:49:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 9, 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:49:05.097167+0000", 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:49:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "8791c6a1-5723-467e-bca1-83d58526d8f3": { 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 15.0 seconds before exiting (43s)\n [============================] ", 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "972001b1-9f10-4c64-bdc9-a12803ed001f": { 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "No pending clones left, waiting 15.0 seconds before exiting (34s)\n [============================] ", 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:20.285 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:49:20.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faa1006d550 msgr2=0x7faa1006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:20.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faa1006d550 0x7faa1006fa10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faa24000c00 tx=0x7faa24009040 comp rx=0 tx=0).stop 2024-05-30T16:49:20.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa340af260 msgr2=0x7faa341570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:20.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa340af260 0x7faa341570e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7faa1c02a570 tx=0x7faa1c001120 comp rx=0 tx=0).stop 2024-05-30T16:49:20.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 shutdown_connections 2024-05-30T16:49:20.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faa1006d550 0x7faa1006fa10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:20.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa341f3f40 0x7faa3415b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:20.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa340af260 0x7faa341570e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:20.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 --2- 172.21.15.144:0/1401771357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa18004800 0x7faa34159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:20.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 >> 172.21.15.144:0/1401771357 conn(0x7faa340b20a0 msgr2=0x7faa34072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:20.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 shutdown_connections 2024-05-30T16:49:20.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:20.279+0000 7faa39c00640 1 -- 172.21.15.144:0/1401771357 wait complete. 2024-05-30T16:49:25.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:49:25.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.510+0000 7fc97fe00640 1 Processor -- start 2024-05-30T16:49:25.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.510+0000 7fc97fe00640 1 -- start start 2024-05-30T16:49:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.511+0000 7fc97fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9800ba090 0x7fc9800cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.511+0000 7fc97fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9800cfa10 0x7fc9800d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.511+0000 7fc97fe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98015ed40 con 0x7fc98015e960 2024-05-30T16:49:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.511+0000 7fc97fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc9800cfe80 con 0x7fc9800ba090 2024-05-30T16:49:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.511+0000 7fc97fe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc9800d2b40 con 0x7fc9800cfa10 2024-05-30T16:49:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.512+0000 7fc976000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9800ba090 0x7fc9800cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.512+0000 7fc976000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9800ba090 0x7fc9800cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46046/0 (socket says 172.21.15.144:46046) 2024-05-30T16:49:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.512+0000 7fc976000640 1 -- 172.21.15.144:0/556156436 learned_addr learned my addr 172.21.15.144:0/556156436 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:25.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.512+0000 7fc97f400640 1 --2- 172.21.15.144:0/556156436 >> v2:172.21.15.149:3300/0 conn(0x7fc9800cfa10 0x7fc9800d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.512+0000 7fc976000640 1 -- 172.21.15.144:0/556156436 >> v2:172.21.15.149:3300/0 conn(0x7fc9800cfa10 msgr2=0x7fc9800d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.512+0000 7fc976000640 1 --2- 172.21.15.144:0/556156436 >> v2:172.21.15.149:3300/0 conn(0x7fc9800cfa10 0x7fc9800d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.512+0000 7fc976000640 1 -- 172.21.15.144:0/556156436 >> v1:172.21.15.149:6789/0 conn(0x7fc98015e960 legacy=0x7fc980162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.512+0000 7fc976000640 1 -- 172.21.15.144:0/556156436 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc980162ca0 con 0x7fc9800ba090 2024-05-30T16:49:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.513+0000 7fc976000640 1 --2- 172.21.15.144:0/556156436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800ba090 0x7fc9800cf4d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc9800cf110 tx=0x7fc96802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef657afe216c710 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97e000640 1 -- 172.21.15.144:0/556156436 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968037070 con 0x7fc9800ba090 2024-05-30T16:49:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97e000640 1 -- 172.21.15.144:0/556156436 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc968032440 con 0x7fc9800ba090 2024-05-30T16:49:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97e000640 1 -- 172.21.15.144:0/556156436 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968032810 con 0x7fc9800ba090 2024-05-30T16:49:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97fe00640 1 -- 172.21.15.144:0/556156436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800ba090 msgr2=0x7fc9800cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97fe00640 1 --2- 172.21.15.144:0/556156436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800ba090 0x7fc9800cf4d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc9800cf110 tx=0x7fc96802a230 comp rx=0 tx=0).stop 2024-05-30T16:49:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97fe00640 1 -- 172.21.15.144:0/556156436 shutdown_connections 2024-05-30T16:49:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97fe00640 1 --2- 172.21.15.144:0/556156436 >> v2:172.21.15.149:3300/0 conn(0x7fc9800cfa10 0x7fc9800d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97fe00640 1 --2- 172.21.15.144:0/556156436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800ba090 0x7fc9800cf4d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97fe00640 1 -- 172.21.15.144:0/556156436 >> 172.21.15.144:0/556156436 conn(0x7fc9800d1360 msgr2=0x7fc9800d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97fe00640 1 -- 172.21.15.144:0/556156436 shutdown_connections 2024-05-30T16:49:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.514+0000 7fc97fe00640 1 -- 172.21.15.144:0/556156436 wait complete. 2024-05-30T16:49:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.516+0000 7fc97fe00640 1 Processor -- start 2024-05-30T16:49:25.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.516+0000 7fc97fe00640 1 -- start start 2024-05-30T16:49:25.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.517+0000 7fc97fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9800ba090 0x7fc980156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:25.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.517+0000 7fc97fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800cfa10 0x7fc980157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:25.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.517+0000 7fc97fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc98015e960 0x7fc980153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:25.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.517+0000 7fc97fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc9800d2d90 con 0x7fc9800cfa10 2024-05-30T16:49:25.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.517+0000 7fc97fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc980163260 con 0x7fc98015e960 2024-05-30T16:49:25.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.517+0000 7fc97fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9800b78a0 con 0x7fc9800ba090 2024-05-30T16:49:25.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.517+0000 7fc976000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800cfa10 0x7fc980157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc976000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800cfa10 0x7fc980157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46060/0 (socket says 172.21.15.144:46060) 2024-05-30T16:49:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc976000640 1 -- 172.21.15.144:0/3259829882 learned_addr learned my addr 172.21.15.144:0/3259829882 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc97f400640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc98015e960 0x7fc980153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc976000640 1 -- 172.21.15.144:0/3259829882 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9800ba090 msgr2=0x7fc980156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc97ea00640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9800ba090 0x7fc980156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc976000640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9800ba090 0x7fc980156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc976000640 1 -- 172.21.15.144:0/3259829882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc98015e960 msgr2=0x7fc980153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc976000640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc98015e960 0x7fc980153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc976000640 1 -- 172.21.15.144:0/3259829882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9801f5580 con 0x7fc9800cfa10 2024-05-30T16:49:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.518+0000 7fc976000640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800cfa10 0x7fc980157cd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc96802a270 tx=0x7fc9680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.519+0000 7fc977400640 1 -- 172.21.15.144:0/3259829882 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968041020 con 0x7fc9800cfa10 2024-05-30T16:49:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.519+0000 7fc977400640 1 -- 172.21.15.144:0/3259829882 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9680306c0 con 0x7fc9800cfa10 2024-05-30T16:49:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.519+0000 7fc977400640 1 -- 172.21.15.144:0/3259829882 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968037040 con 0x7fc9800cfa10 2024-05-30T16:49:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.519+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc980156690 con 0x7fc9800cfa10 2024-05-30T16:49:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.519+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9801f4ce0 con 0x7fc9800cfa10 2024-05-30T16:49:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.520+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc980075570 con 0x7fc9800cfa10 2024-05-30T16:49:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.521+0000 7fc977400640 1 -- 172.21.15.144:0/3259829882 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7fc968044020 con 0x7fc9800cfa10 2024-05-30T16:49:25.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.522+0000 7fc977400640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc95c06d550 0x7fc95c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:25.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.522+0000 7fc977400640 1 -- 172.21.15.144:0/3259829882 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7fc9680aad90 con 0x7fc9800cfa10 2024-05-30T16:49:25.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.523+0000 7fc97ea00640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc95c06d550 0x7fc95c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:25.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.523+0000 7fc97ea00640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc95c06d550 0x7fc95c06fa10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc970003d90 tx=0x7fc970009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:25.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.527+0000 7fc977400640 1 -- 172.21.15.144:0/3259829882 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc96804b030 con 0x7fc9800cfa10 2024-05-30T16:49:25.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.791+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc9801f5820 con 0x7fc9800cfa10 2024-05-30T16:49:25.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.792+0000 7fc977400640 1 -- 172.21.15.144:0/3259829882 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2362 (secure 0 0 0) 0x7fc96807ac70 con 0x7fc9800cfa10 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:49:25.793 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 478, 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:49:25.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 59, 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:49:25.795 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4883, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 20336264455, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 41094365184, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 731999748096, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 85, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 1194, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:49:25.796 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 1 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 36, 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4, 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 4, 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "c", 2024-05-30T16:49:25.797 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5808 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:25.798 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 9, 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:49:05.097167+0000", 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "8791c6a1-5723-467e-bca1-83d58526d8f3": { 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 11.0 seconds before exiting (47s)\n [============================] ", 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "972001b1-9f10-4c64-bdc9-a12803ed001f": { 2024-05-30T16:49:25.799 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "No pending clones left, waiting 11.0 seconds before exiting (38s)\n [============================] ", 2024-05-30T16:49:25.800 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:25.800 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:25.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:25.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:25.800 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.794+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc95c06d550 msgr2=0x7fc95c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc95c06d550 0x7fc95c06fa10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc970003d90 tx=0x7fc970009040 comp rx=0 tx=0).stop 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800cfa10 msgr2=0x7fc980157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800cfa10 0x7fc980157cd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc96802a270 tx=0x7fc9680046c0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 shutdown_connections 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc95c06d550 0x7fc95c06fa10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc98015e960 0x7fc980153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9800cfa10 0x7fc980157cd0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 --2- 172.21.15.144:0/3259829882 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9800ba090 0x7fc980156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 >> 172.21.15.144:0/3259829882 conn(0x7fc9800d1360 msgr2=0x7fc9800d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 shutdown_connections 2024-05-30T16:49:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:25.795+0000 7fc97fe00640 1 -- 172.21.15.144:0/3259829882 wait complete. 2024-05-30T16:49:30.816 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:49:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.024+0000 7f1fda800640 1 Processor -- start 2024-05-30T16:49:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.025+0000 7f1fda800640 1 -- start start 2024-05-30T16:49:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.026+0000 7f1fda800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1fd406f670 0x7f1fd40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.026+0000 7f1fda800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1fd40cf300 0x7f1fd406b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.026+0000 7f1fda800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd406be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.026+0000 7f1fda800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd415b090 con 0x7f1fd40cf300 2024-05-30T16:49:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.026+0000 7f1fda800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd40cab30 con 0x7f1fd406f670 2024-05-30T16:49:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.026+0000 7f1fda800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd40cf950 con 0x7f1fd40b4f00 2024-05-30T16:49:31.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd8a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1fd40cf300 0x7f1fd406b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd9400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1fd406f670 0x7f1fd40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd8a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1fd40cf300 0x7f1fd406b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46070/0 (socket says 172.21.15.144:46070) 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd8a00640 1 -- 172.21.15.144:0/1152730134 learned_addr learned my addr 172.21.15.144:0/1152730134 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd9e00640 1 --2- 172.21.15.144:0/1152730134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd406be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd8a00640 1 -- 172.21.15.144:0/1152730134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 msgr2=0x7f1fd406be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd8a00640 1 --2- 172.21.15.144:0/1152730134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd406be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd8a00640 1 -- 172.21.15.144:0/1152730134 >> v2:172.21.15.149:3300/0 conn(0x7f1fd406f670 msgr2=0x7f1fd40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd8a00640 1 --2- 172.21.15.144:0/1152730134 >> v2:172.21.15.149:3300/0 conn(0x7f1fd406f670 0x7f1fd40b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd8a00640 1 -- 172.21.15.144:0/1152730134 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd40cfc30 con 0x7f1fd40cf300 2024-05-30T16:49:31.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.027+0000 7f1fd9e00640 1 --2- 172.21.15.144:0/1152730134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd406be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:31.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.028+0000 7f1fd8a00640 1 --2- 172.21.15.144:0/1152730134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 0x7f1fd406b8e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1fd406c5c0 tx=0x7f1fc002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eaeb7d68694ecbf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:31.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fd3e00640 1 -- 172.21.15.144:0/1152730134 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0037070 con 0x7f1fd40cf300 2024-05-30T16:49:31.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fd3e00640 1 -- 172.21.15.144:0/1152730134 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc0032440 con 0x7f1fd40cf300 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fd3e00640 1 -- 172.21.15.144:0/1152730134 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0032810 con 0x7f1fd40cf300 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fda800640 1 -- 172.21.15.144:0/1152730134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 msgr2=0x7f1fd406b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fda800640 1 --2- 172.21.15.144:0/1152730134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 0x7f1fd406b8e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1fd406c5c0 tx=0x7f1fc002a1e0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fda800640 1 -- 172.21.15.144:0/1152730134 shutdown_connections 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fda800640 1 --2- 172.21.15.144:0/1152730134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd406be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fda800640 1 --2- 172.21.15.144:0/1152730134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 0x7f1fd406b8e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fda800640 1 --2- 172.21.15.144:0/1152730134 >> v2:172.21.15.149:3300/0 conn(0x7f1fd406f670 0x7f1fd40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fda800640 1 -- 172.21.15.144:0/1152730134 >> 172.21.15.144:0/1152730134 conn(0x7f1fd40b20a0 msgr2=0x7f1fd40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fda800640 1 -- 172.21.15.144:0/1152730134 shutdown_connections 2024-05-30T16:49:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.029+0000 7f1fda800640 1 -- 172.21.15.144:0/1152730134 wait complete. 2024-05-30T16:49:31.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.031+0000 7f1fda800640 1 Processor -- start 2024-05-30T16:49:31.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.031+0000 7f1fda800640 1 -- start start 2024-05-30T16:49:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.032+0000 7f1fda800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fd406f670 0x7f1fd41580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.032+0000 7f1fda800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd414c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.032+0000 7f1fda800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 0x7f1fd415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.032+0000 7f1fda800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd40ca840 con 0x7f1fd40cf300 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.032+0000 7f1fda800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd415e730 con 0x7f1fd406f670 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.032+0000 7f1fda800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd406fa50 con 0x7f1fd40b4f00 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 0x7f1fd415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 0x7f1fd415b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46082/0 (socket says 172.21.15.144:46082) 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9e00640 1 -- 172.21.15.144:0/1704636408 learned_addr learned my addr 172.21.15.144:0/1704636408 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9400640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fd406f670 0x7f1fd41580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd8a00640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd414c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9e00640 1 -- 172.21.15.144:0/1704636408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 msgr2=0x7f1fd414c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9e00640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd414c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9e00640 1 -- 172.21.15.144:0/1704636408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fd406f670 msgr2=0x7f1fd41580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9e00640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fd406f670 0x7f1fd41580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9e00640 1 -- 172.21.15.144:0/1704636408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd4158630 con 0x7f1fd40cf300 2024-05-30T16:49:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd8a00640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd414c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.033+0000 7f1fd9e00640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 0x7f1fd415b210 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00afc0 tx=0x7f1fcc00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.034+0000 7f1fd1600640 1 -- 172.21.15.144:0/1704636408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00a2d0 con 0x7f1fd40cf300 2024-05-30T16:49:31.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.034+0000 7f1fd1600640 1 -- 172.21.15.144:0/1704636408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc003990 con 0x7f1fd40cf300 2024-05-30T16:49:31.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.034+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd415cd70 con 0x7f1fd40cf300 2024-05-30T16:49:31.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.034+0000 7f1fd1600640 1 -- 172.21.15.144:0/1704636408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc003d40 con 0x7f1fd40cf300 2024-05-30T16:49:31.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.034+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd4073970 con 0x7f1fd40cf300 2024-05-30T16:49:31.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.035+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd4075570 con 0x7f1fd40cf300 2024-05-30T16:49:31.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.036+0000 7f1fd1600640 1 -- 172.21.15.144:0/1704636408 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 92162+0+0 (secure 0 0 0) 0x7f1fcc012070 con 0x7f1fd40cf300 2024-05-30T16:49:31.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.037+0000 7f1fd1600640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fb406d720 0x7f1fb406fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:31.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.037+0000 7f1fd1600640 1 -- 172.21.15.144:0/1704636408 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f1fcc08a710 con 0x7f1fd40cf300 2024-05-30T16:49:31.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.037+0000 7f1fd9400640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fb406d720 0x7f1fb406fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:31.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.038+0000 7f1fd9400640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fb406d720 0x7f1fb406fbe0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009ad0 tx=0x7f1fc8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:31.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.041+0000 7f1fd1600640 1 -- 172.21.15.144:0/1704636408 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1fcc05a590 con 0x7f1fd40cf300 2024-05-30T16:49:31.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.320+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1fd40b47d0 con 0x7f1fd40cf300 2024-05-30T16:49:31.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.321+0000 7f1fd1600640 1 -- 172.21.15.144:0/1704636408 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2329 (secure 0 0 0) 0x7f1fcc059e90 con 0x7f1fd40cf300 2024-05-30T16:49:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:31.322 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:49:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:49:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:49:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:49:31.322 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:49:31.323 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 483, 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 59, 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:49:31.324 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:49:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:49:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:49:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:49:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:49:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:49:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:49:31.325 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4883, 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 20336267397, 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 41094373376, 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 731999739904, 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 341, 2024-05-30T16:49:31.326 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 36, 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4, 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:31.327 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 4, 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "c", 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5808 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:49:31.328 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 9, 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:49:05.097167+0000", 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:31.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: "8791c6a1-5723-467e-bca1-83d58526d8f3": { 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "All cloning finished, waiting 3.0 seconds before exiting (55s)\n [============================] ", 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: "972001b1-9f10-4c64-bdc9-a12803ed001f": { 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "No pending clones left, waiting 3.0 seconds before exiting (46s)\n [============================] ", 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 1, 2024-05-30T16:49:31.330 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:49:31.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:31.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:31.331 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:49:31.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fb406d720 msgr2=0x7f1fb406fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fb406d720 0x7f1fb406fbe0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009ad0 tx=0x7f1fc8008040 comp rx=0 tx=0).stop 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 msgr2=0x7f1fd415b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 0x7f1fd415b210 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00afc0 tx=0x7f1fcc00d490 comp rx=0 tx=0).stop 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 shutdown_connections 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1fb406d720 0x7f1fb406fbe0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fd40cf300 0x7f1fd415b210 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fd40b4f00 0x7f1fd414c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 --2- 172.21.15.144:0/1704636408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fd406f670 0x7f1fd41580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 >> 172.21.15.144:0/1704636408 conn(0x7f1fd40b20a0 msgr2=0x7f1fd40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.324+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 shutdown_connections 2024-05-30T16:49:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:31.325+0000 7f1fda800640 1 -- 172.21.15.144:0/1704636408 wait complete. 2024-05-30T16:49:36.345 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:49:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.552+0000 7f1e1a200640 1 Processor -- start 2024-05-30T16:49:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.553+0000 7f1e1a200640 1 -- start start 2024-05-30T16:49:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.554+0000 7f1e1a200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1e140b5fd0 0x7f1e14142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.554+0000 7f1e1a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e14160730 con 0x7f1e140cec70 2024-05-30T16:49:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.554+0000 7f1e1a200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e14160a10 con 0x7f1e1413f760 2024-05-30T16:49:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.554+0000 7f1e1a200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f1e141612b0 con 0x7f1e140b5fd0 2024-05-30T16:49:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.554+0000 7f1e0aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1e140cec70 0x7f1e140b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44582/0 (socket says 172.21.15.144:44582) 2024-05-30T16:49:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.554+0000 7f1e0aa00640 1 -- 172.21.15.144:0/2737763113 learned_addr learned my addr 172.21.15.144:0/2737763113 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.555+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307962003 0 0) 0x7f1e14160730 con 0x7f1e140cec70 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.555+0000 7f1e13e00640 1 --2- 172.21.15.144:0/2737763113 >> v2:172.21.15.149:3300/0 conn(0x7f1e140b5fd0 0x7f1e14142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.555+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1df8003520 con 0x7f1e140cec70 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.555+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1465070330 0 0) 0x7f1df8003520 con 0x7f1e140cec70 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.555+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 >> v2:172.21.15.149:3300/0 conn(0x7f1e140b5fd0 msgr2=0x7f1e14142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.555+0000 7f1e12a00640 1 --2- 172.21.15.144:0/2737763113 >> v2:172.21.15.149:3300/0 conn(0x7f1e140b5fd0 0x7f1e14142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.555+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 >> v1:172.21.15.149:6789/0 conn(0x7f1e1413f760 legacy=0x7f1e1406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.555+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e14160cf0 con 0x7f1e140cec70 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.555+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f1dfc001670 con 0x7f1e140cec70 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 >> v1:172.21.15.144:6789/0 conn(0x7f1e140cec70 legacy=0x7f1e140b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e12a00640 1 --2- 172.21.15.144:0/2737763113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80039b0 0x7f1df8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e12a00640 1 --2- 172.21.15.144:0/2737763113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1df8004800 0x7f1df8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e12a00640 1 --2- 172.21.15.144:0/2737763113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df80051c0 0x7f1df800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1e141612b0 con 0x7f1df80039b0 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1df800c110 con 0x7f1df8004800 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1df800c310 con 0x7f1df80051c0 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e13e00640 1 --2- 172.21.15.144:0/2737763113 >> v2:172.21.15.149:3300/0 conn(0x7f1e140b5fd0 0x7f1e14142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e13400640 1 --2- 172.21.15.144:0/2737763113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80039b0 0x7f1df8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e13400640 1 -- 172.21.15.144:0/2737763113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df80051c0 msgr2=0x7f1df800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e13400640 1 --2- 172.21.15.144:0/2737763113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df80051c0 0x7f1df800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e13400640 1 -- 172.21.15.144:0/2737763113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1df8004800 msgr2=0x7f1df8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e13400640 1 --2- 172.21.15.144:0/2737763113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1df8004800 0x7f1df8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e13400640 1 -- 172.21.15.144:0/2737763113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df8003520 con 0x7f1df80039b0 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.556+0000 7f1e13e00640 1 -- 172.21.15.144:0/2737763113 reap_dead start 2024-05-30T16:49:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.557+0000 7f1e13400640 1 --2- 172.21.15.144:0/2737763113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80039b0 0x7f1df8003dd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1e04001750 tx=0x7f1df8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c418c30b5aff7cd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.558+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04001370 con 0x7f1df80039b0 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.558+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e040052d0 con 0x7f1df80039b0 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.558+0000 7f1e12a00640 1 -- 172.21.15.144:0/2737763113 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0402abe0 con 0x7f1df80039b0 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.558+0000 7f1e1a200640 1 -- 172.21.15.144:0/2737763113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80039b0 msgr2=0x7f1df8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.558+0000 7f1e1a200640 1 --2- 172.21.15.144:0/2737763113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80039b0 0x7f1df8003dd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1e04001750 tx=0x7f1df8005830 comp rx=0 tx=0).stop 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.558+0000 7f1e1a200640 1 -- 172.21.15.144:0/2737763113 shutdown_connections 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.558+0000 7f1e1a200640 1 --2- 172.21.15.144:0/2737763113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80039b0 0x7f1df8003dd0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.558+0000 7f1e1a200640 1 -- 172.21.15.144:0/2737763113 >> 172.21.15.144:0/2737763113 conn(0x7f1e1406bd00 msgr2=0x7f1e1406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.558+0000 7f1e1a200640 1 -- 172.21.15.144:0/2737763113 shutdown_connections 2024-05-30T16:49:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.559+0000 7f1e1a200640 1 -- 172.21.15.144:0/2737763113 wait complete. 2024-05-30T16:49:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.560+0000 7f1e1a200640 1 Processor -- start 2024-05-30T16:49:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.560+0000 7f1e1a200640 1 -- start start 2024-05-30T16:49:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.561+0000 7f1e1a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df80039b0 0x7f1e14155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.561+0000 7f1e1a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e14156b60 0x7f1e141384c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.561+0000 7f1e1a200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1415b7c0 0x7f1e1415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.561+0000 7f1e1a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1e140cf0d0 con 0x7f1e14156b60 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.561+0000 7f1e1a200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1e140cf250 con 0x7f1e1415b7c0 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.561+0000 7f1e1a200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1e140ce6a0 con 0x7f1df80039b0 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e0aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e14156b60 0x7f1e141384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e0aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e14156b60 0x7f1e141384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56376/0 (socket says 172.21.15.144:56376) 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e0aa00640 1 -- 172.21.15.144:0/2200694633 learned_addr learned my addr 172.21.15.144:0/2200694633 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e13400640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df80039b0 0x7f1e14155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e13e00640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1415b7c0 0x7f1e1415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e0aa00640 1 -- 172.21.15.144:0/2200694633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df80039b0 msgr2=0x7f1e14155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e0aa00640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df80039b0 0x7f1e14155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e0aa00640 1 -- 172.21.15.144:0/2200694633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1415b7c0 msgr2=0x7f1e1415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e0aa00640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1415b7c0 0x7f1e1415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e0aa00640 1 -- 172.21.15.144:0/2200694633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e14138e30 con 0x7f1e14156b60 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e13e00640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1415b7c0 0x7f1e1415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.562+0000 7f1e0aa00640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e14156b60 0x7f1e141384c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c760 tx=0x7f1dfc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.563+0000 7f1e0be00640 1 -- 172.21.15.144:0/2200694633 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc018070 con 0x7f1e14156b60 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.563+0000 7f1e0be00640 1 -- 172.21.15.144:0/2200694633 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dfc0072f0 con 0x7f1e14156b60 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.563+0000 7f1e0be00640 1 -- 172.21.15.144:0/2200694633 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0047e0 con 0x7f1e14156b60 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.563+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e140b3890 con 0x7f1e14156b60 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.563+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e140b3e50 con 0x7f1e14156b60 2024-05-30T16:49:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.564+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e14068b90 con 0x7f1e14156b60 2024-05-30T16:49:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.565+0000 7f1e0be00640 1 -- 172.21.15.144:0/2200694633 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 92111+0+0 (secure 0 0 0) 0x7f1dfc004980 con 0x7f1e14156b60 2024-05-30T16:49:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.566+0000 7f1e0be00640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1df006d4c0 0x7f1df006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.566+0000 7f1e0be00640 1 -- 172.21.15.144:0/2200694633 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f1dfc089c80 con 0x7f1e14156b60 2024-05-30T16:49:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.566+0000 7f1e13400640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1df006d4c0 0x7f1df006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.567+0000 7f1e13400640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1df006d4c0 0x7f1df006f980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1e04032000 tx=0x7f1e0402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:36.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.571+0000 7f1e0be00640 1 -- 172.21.15.144:0/2200694633 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1dfc059900 con 0x7f1e14156b60 2024-05-30T16:49:36.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.848+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1e140b4020 con 0x7f1e14156b60 2024-05-30T16:49:36.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.849+0000 7f1e0be00640 1 -- 172.21.15.144:0/2200694633 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1823 (secure 0 0 0) 0x7f1dfc059200 con 0x7f1e14156b60 2024-05-30T16:49:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:49:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 489, 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 59, 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:49:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:49:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 4883, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 20336267397, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 41094373376, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 731999739904, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 341, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 36, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:49:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 4, 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "c", 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 5808 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:49:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 9, 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:49:05.097167+0000", 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": {} 2024-05-30T16:49:36.856 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:49:36.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1df006d4c0 msgr2=0x7f1df006f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1df006d4c0 0x7f1df006f980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1e04032000 tx=0x7f1e0402e000 comp rx=0 tx=0).stop 2024-05-30T16:49:36.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e14156b60 msgr2=0x7f1e141384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:36.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e14156b60 0x7f1e141384c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c760 tx=0x7f1dfc00cc20 comp rx=0 tx=0).stop 2024-05-30T16:49:36.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 shutdown_connections 2024-05-30T16:49:36.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1df006d4c0 0x7f1df006f980 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e1415b7c0 0x7f1e1415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e14156b60 0x7f1e141384c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 --2- 172.21.15.144:0/2200694633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df80039b0 0x7f1e14155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:36.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 >> 172.21.15.144:0/2200694633 conn(0x7f1e1406bd00 msgr2=0x7f1e14140430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:36.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.852+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 shutdown_connections 2024-05-30T16:49:36.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:36.853+0000 7f1e1a200640 1 -- 172.21.15.144:0/2200694633 wait complete. 2024-05-30T16:49:36.874 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T16:49:37.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.077+0000 7f3878a00640 1 Processor -- start 2024-05-30T16:49:37.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.077+0000 7f3878a00640 1 -- start start 2024-05-30T16:49:37.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3878a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3874145f10 0x7f38740cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3878a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3874160990 0x7f387406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3878a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387406c810 con 0x7f387406c3d0 2024-05-30T16:49:37.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3878a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3874161100 con 0x7f3874160990 2024-05-30T16:49:37.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3878a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38740cd3e0 con 0x7f3874145f10 2024-05-30T16:49:37.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3873e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3874160990 0x7f387406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3873e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3874160990 0x7f387406dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56382/0 (socket says 172.21.15.144:56382) 2024-05-30T16:49:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3873e00640 1 -- 172.21.15.144:0/3503494124 learned_addr learned my addr 172.21.15.144:0/3503494124 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3873e00640 1 -- 172.21.15.144:0/3503494124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3874145f10 msgr2=0x7f38740cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3873e00640 1 --2- 172.21.15.144:0/3503494124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3874145f10 0x7f38740cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3873e00640 1 -- 172.21.15.144:0/3503494124 >> v1:172.21.15.149:6789/0 conn(0x7f387406c3d0 legacy=0x7f3874160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.079+0000 7f3873e00640 1 -- 172.21.15.144:0/3503494124 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38740cd6c0 con 0x7f3874160990 2024-05-30T16:49:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.081+0000 7f3873e00640 1 --2- 172.21.15.144:0/3503494124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874160990 0x7f387406dd30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f386c009e50 tx=0x7f386c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9370de45605fb02 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.081+0000 7f3872a00640 1 -- 172.21.15.144:0/3503494124 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c036070 con 0x7f3874160990 2024-05-30T16:49:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.081+0000 7f3872a00640 1 -- 172.21.15.144:0/3503494124 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386c031600 con 0x7f3874160990 2024-05-30T16:49:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.081+0000 7f3872a00640 1 -- 172.21.15.144:0/3503494124 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0319d0 con 0x7f3874160990 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.082+0000 7f3878a00640 1 -- 172.21.15.144:0/3503494124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874160990 msgr2=0x7f387406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.082+0000 7f3878a00640 1 --2- 172.21.15.144:0/3503494124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874160990 0x7f387406dd30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f386c009e50 tx=0x7f386c02a6c0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.082+0000 7f3878a00640 1 -- 172.21.15.144:0/3503494124 shutdown_connections 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.082+0000 7f3878a00640 1 --2- 172.21.15.144:0/3503494124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874160990 0x7f387406dd30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.082+0000 7f3878a00640 1 --2- 172.21.15.144:0/3503494124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3874145f10 0x7f38740cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.082+0000 7f3878a00640 1 -- 172.21.15.144:0/3503494124 >> 172.21.15.144:0/3503494124 conn(0x7f387406b8e0 msgr2=0x7f387406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.082+0000 7f3878a00640 1 -- 172.21.15.144:0/3503494124 shutdown_connections 2024-05-30T16:49:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.082+0000 7f3878a00640 1 -- 172.21.15.144:0/3503494124 wait complete. 2024-05-30T16:49:37.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.084+0000 7f3878a00640 1 Processor -- start 2024-05-30T16:49:37.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.084+0000 7f3878a00640 1 -- start start 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.085+0000 7f3878a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406c3d0 0x7f387415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.085+0000 7f3878a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145f10 0x7f38740adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.085+0000 7f3878a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874160990 0x7f38740ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.085+0000 7f3878a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38740cdf60 con 0x7f3874145f10 2024-05-30T16:49:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.085+0000 7f3878a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38740cdc80 con 0x7f3874160990 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.085+0000 7f3878a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38741462f0 con 0x7f387406c3d0 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f386be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145f10 0x7f38740adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f386be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145f10 0x7f38740adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56386/0 (socket says 172.21.15.144:56386) 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f386be00640 1 -- 172.21.15.144:0/2231978253 learned_addr learned my addr 172.21.15.144:0/2231978253 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f3873e00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874160990 0x7f38740ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f3873400640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406c3d0 0x7f387415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f386be00640 1 -- 172.21.15.144:0/2231978253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406c3d0 msgr2=0x7f387415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f386be00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406c3d0 0x7f387415d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f386be00640 1 -- 172.21.15.144:0/2231978253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874160990 msgr2=0x7f38740ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f386be00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874160990 0x7f38740ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f386be00640 1 -- 172.21.15.144:0/2231978253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38740aa530 con 0x7f3874145f10 2024-05-30T16:49:37.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.086+0000 7f386be00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145f10 0x7f38740adfb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c430 tx=0x7f385c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.087+0000 7f386b400640 1 -- 172.21.15.144:0/2231978253 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c011790 con 0x7f3874145f10 2024-05-30T16:49:37.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.087+0000 7f386b400640 1 -- 172.21.15.144:0/2231978253 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c017070 con 0x7f3874145f10 2024-05-30T16:49:37.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.087+0000 7f386b400640 1 -- 172.21.15.144:0/2231978253 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c011bb0 con 0x7f3874145f10 2024-05-30T16:49:37.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.087+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38740aa810 con 0x7f3874145f10 2024-05-30T16:49:37.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.087+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38740aadd0 con 0x7f3874145f10 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.088+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38740632f0 con 0x7f3874145f10 2024-05-30T16:49:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.089+0000 7f386b400640 1 -- 172.21.15.144:0/2231978253 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 92111+0+0 (secure 0 0 0) 0x7f385c01c460 con 0x7f3874145f10 2024-05-30T16:49:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.090+0000 7f386b400640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d4c0 0x7f385006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.090+0000 7f386b400640 1 -- 172.21.15.144:0/2231978253 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f385c08a6b0 con 0x7f3874145f10 2024-05-30T16:49:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.090+0000 7f3873400640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d4c0 0x7f385006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.091+0000 7f3873400640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d4c0 0x7f385006f980 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f386400a810 tx=0x7f3864008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.094+0000 7f386b400640 1 -- 172.21.15.144:0/2231978253 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f385c05a2d0 con 0x7f3874145f10 2024-05-30T16:49:37.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.321+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3874142660 con 0x7f385006d4c0 2024-05-30T16:49:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.338+0000 7f386b400640 1 -- 172.21.15.144:0/2231978253 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+381 (secure 0 0 0) 0x7f3874142660 con 0x7f385006d4c0 2024-05-30T16:49:37.340 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:37.340 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:49:37.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:37.340 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone56764" 2024-05-30T16:49:37.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:37.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:37.340 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sv1" 2024-05-30T16:49:37.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone56765" 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone56762" 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone56761" 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone56766" 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:37.341 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone56767" 2024-05-30T16:49:37.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:37.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:37.342 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_clone56763" 2024-05-30T16:49:37.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:37.342 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d4c0 msgr2=0x7f385006f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d4c0 0x7f385006f980 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f386400a810 tx=0x7f3864008040 comp rx=0 tx=0).stop 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145f10 msgr2=0x7f38740adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145f10 0x7f38740adfb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c430 tx=0x7f385c00c8f0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 shutdown_connections 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f385006d4c0 0x7f385006f980 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874160990 0x7f38740ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3874145f10 0x7f38740adfb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 --2- 172.21.15.144:0/2231978253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f387406c3d0 0x7f387415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 >> 172.21.15.144:0/2231978253 conn(0x7f387406b8e0 msgr2=0x7f3874144230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 shutdown_connections 2024-05-30T16:49:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.341+0000 7f3878a00640 1 -- 172.21.15.144:0/2231978253 wait complete. 2024-05-30T16:49:37.362 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone56764 2024-05-30T16:49:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.563+0000 7f510f200640 1 Processor -- start 2024-05-30T16:49:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.564+0000 7f510f200640 1 -- start start 2024-05-30T16:49:37.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.565+0000 7f510f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51100cfe30 0x7f51100b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.565+0000 7f510f200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f51100b4f10 0x7f5110071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.565+0000 7f510f200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100b4370 con 0x7f51100722a0 2024-05-30T16:49:37.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.565+0000 7f510f200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f51100d0210 con 0x7f51100cfe30 2024-05-30T16:49:37.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.565+0000 7f510f200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f51100726e0 con 0x7f51100b4f10 2024-05-30T16:49:37.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.566+0000 7f510de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51100cfe30 0x7f51100b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.566+0000 7f510de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51100cfe30 0x7f51100b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56402/0 (socket says 172.21.15.144:56402) 2024-05-30T16:49:37.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.566+0000 7f510de00640 1 -- 172.21.15.144:0/3848384937 learned_addr learned my addr 172.21.15.144:0/3848384937 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:37.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.566+0000 7f5105400640 1 --2- 172.21.15.144:0/3848384937 >> v2:172.21.15.149:3300/0 conn(0x7f51100b4f10 0x7f5110071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.566+0000 7f510de00640 1 -- 172.21.15.144:0/3848384937 >> v2:172.21.15.149:3300/0 conn(0x7f51100b4f10 msgr2=0x7f5110071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:37.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.566+0000 7f510de00640 1 --2- 172.21.15.144:0/3848384937 >> v2:172.21.15.149:3300/0 conn(0x7f51100b4f10 0x7f5110071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.566+0000 7f510de00640 1 -- 172.21.15.144:0/3848384937 >> v1:172.21.15.149:6789/0 conn(0x7f51100722a0 legacy=0x7f511006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:37.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.566+0000 7f510de00640 1 -- 172.21.15.144:0/3848384937 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51101632c0 con 0x7f51100cfe30 2024-05-30T16:49:37.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.567+0000 7f510de00640 1 --2- 172.21.15.144:0/3848384937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100cfe30 0x7f51100b49d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f511006fee0 tx=0x7f510002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb52e86e333747 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.568+0000 7f510d400640 1 -- 172.21.15.144:0/3848384937 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100036070 con 0x7f51100cfe30 2024-05-30T16:49:37.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.568+0000 7f510d400640 1 -- 172.21.15.144:0/3848384937 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5100031600 con 0x7f51100cfe30 2024-05-30T16:49:37.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.568+0000 7f510d400640 1 -- 172.21.15.144:0/3848384937 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51000319d0 con 0x7f51100cfe30 2024-05-30T16:49:37.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.568+0000 7f510f200640 1 -- 172.21.15.144:0/3848384937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100cfe30 msgr2=0x7f51100b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.568+0000 7f510f200640 1 --2- 172.21.15.144:0/3848384937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100cfe30 0x7f51100b49d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f511006fee0 tx=0x7f510002a6f0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.568+0000 7f510f200640 1 -- 172.21.15.144:0/3848384937 shutdown_connections 2024-05-30T16:49:37.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.568+0000 7f510f200640 1 --2- 172.21.15.144:0/3848384937 >> v2:172.21.15.149:3300/0 conn(0x7f51100b4f10 0x7f5110071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.568+0000 7f510f200640 1 --2- 172.21.15.144:0/3848384937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100cfe30 0x7f51100b49d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.568+0000 7f510f200640 1 -- 172.21.15.144:0/3848384937 >> 172.21.15.144:0/3848384937 conn(0x7f51100b2160 msgr2=0x7f51100b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:37.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.569+0000 7f510f200640 1 -- 172.21.15.144:0/3848384937 shutdown_connections 2024-05-30T16:49:37.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.569+0000 7f510f200640 1 -- 172.21.15.144:0/3848384937 wait complete. 2024-05-30T16:49:37.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.570+0000 7f510f200640 1 Processor -- start 2024-05-30T16:49:37.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.571+0000 7f510f200640 1 -- start start 2024-05-30T16:49:37.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.571+0000 7f510f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100722a0 0x7f51100ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51100b4f10 0x7f51101500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51100cfe30 0x7f5110150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5110163b60 con 0x7f51100722a0 2024-05-30T16:49:37.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5110163880 con 0x7f51100cfe30 2024-05-30T16:49:37.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5110164080 con 0x7f51100b4f10 2024-05-30T16:49:37.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100722a0 0x7f51100ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100722a0 0x7f51100ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56410/0 (socket says 172.21.15.144:56410) 2024-05-30T16:49:37.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510de00640 1 -- 172.21.15.144:0/2641354124 learned_addr learned my addr 172.21.15.144:0/2641354124 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:37.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510e800640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51100cfe30 0x7f5110150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510de00640 1 -- 172.21.15.144:0/2641354124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51100b4f10 msgr2=0x7f51101500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510de00640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51100b4f10 0x7f51101500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510de00640 1 -- 172.21.15.144:0/2641354124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51100cfe30 msgr2=0x7f5110150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510de00640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51100cfe30 0x7f5110150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510de00640 1 -- 172.21.15.144:0/2641354124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51100ae860 con 0x7f51100722a0 2024-05-30T16:49:37.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.572+0000 7f510e800640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51100cfe30 0x7f5110150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:37.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.573+0000 7f510de00640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100722a0 0x7f51100ce9b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5100034040 tx=0x7f5100004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.573+0000 7f5106a00640 1 -- 172.21.15.144:0/2641354124 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100036050 con 0x7f51100722a0 2024-05-30T16:49:37.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.573+0000 7f5106a00640 1 -- 172.21.15.144:0/2641354124 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5100042070 con 0x7f51100722a0 2024-05-30T16:49:37.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.573+0000 7f5106a00640 1 -- 172.21.15.144:0/2641354124 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100009510 con 0x7f51100722a0 2024-05-30T16:49:37.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.573+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51100aeb40 con 0x7f51100722a0 2024-05-30T16:49:37.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.573+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51100af100 con 0x7f51100722a0 2024-05-30T16:49:37.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.574+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5110075570 con 0x7f51100722a0 2024-05-30T16:49:37.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.575+0000 7f5106a00640 1 -- 172.21.15.144:0/2641354124 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 92111+0+0 (secure 0 0 0) 0x7f5100007c50 con 0x7f51100722a0 2024-05-30T16:49:37.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.576+0000 7f5106a00640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f50ec06d4c0 0x7f50ec06f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:37.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.576+0000 7f5106a00640 1 -- 172.21.15.144:0/2641354124 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f51000ab400 con 0x7f51100722a0 2024-05-30T16:49:37.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.577+0000 7f5105400640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f50ec06d4c0 0x7f50ec06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:37.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.577+0000 7f5105400640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f50ec06d4c0 0x7f50ec06f980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f51101fc100 tx=0x7f50f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:37.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.581+0000 7f5106a00640 1 -- 172.21.15.144:0/2641354124 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f510007b2c0 con 0x7f51100722a0 2024-05-30T16:49:37.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.808+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone56764", "target": ["mon-mgr", ""]}) -- 0x7f5110162ab0 con 0x7f50ec06d4c0 2024-05-30T16:49:37.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.833+0000 7f5106a00640 1 -- 172.21.15.144:0/2641354124 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5110162ab0 con 0x7f50ec06d4c0 2024-05-30T16:49:37.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f50ec06d4c0 msgr2=0x7f50ec06f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f50ec06d4c0 0x7f50ec06f980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f51101fc100 tx=0x7f50f8008040 comp rx=0 tx=0).stop 2024-05-30T16:49:37.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100722a0 msgr2=0x7f51100ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:37.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100722a0 0x7f51100ce9b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5100034040 tx=0x7f5100004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:37.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 shutdown_connections 2024-05-30T16:49:37.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f50ec06d4c0 0x7f50ec06f980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51100cfe30 0x7f5110150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51100b4f10 0x7f51101500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 --2- 172.21.15.144:0/2641354124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51100722a0 0x7f51100ce9b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:37.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 >> 172.21.15.144:0/2641354124 conn(0x7f51100b2160 msgr2=0x7f51100b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:37.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.836+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 shutdown_connections 2024-05-30T16:49:37.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:37.837+0000 7f510f200640 1 -- 172.21.15.144:0/2641354124 wait complete. 2024-05-30T16:49:37.839 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.838+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:37.839 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.838+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:37.840 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.838+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:37.840 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.838+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:37.840 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.838+0000 7fe1cba00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:37.859 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T16:49:37.864 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.861+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:37.864 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.861+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:37.864 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.861+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:37.864 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.861+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:37.864 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:49:37.861+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:49:38.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.038+0000 7f3447a00640 1 Processor -- start 2024-05-30T16:49:38.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.038+0000 7f3447a00640 1 -- start start 2024-05-30T16:49:38.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.039+0000 7f3447a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34400cec70 0x7f34400b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.039+0000 7f3447a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3440160730 con 0x7f34400b5e00 2024-05-30T16:49:38.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.039+0000 7f3447a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3440160a10 con 0x7f344013f760 2024-05-30T16:49:38.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.039+0000 7f3447a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f34401612b0 con 0x7f34400cec70 2024-05-30T16:49:38.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.040+0000 7f343fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34400cec70 0x7f34400b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.040+0000 7f343fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34400cec70 0x7f34400b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56452/0 (socket says 172.21.15.144:56452) 2024-05-30T16:49:38.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.040+0000 7f343fe00640 1 -- 172.21.15.144:0/2139163936 learned_addr learned my addr 172.21.15.144:0/2139163936 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:38.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.040+0000 7f343fe00640 1 -- 172.21.15.144:0/2139163936 >> v1:172.21.15.149:6789/0 conn(0x7f344013f760 legacy=0x7f344006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:38.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.040+0000 7f343fe00640 1 -- 172.21.15.144:0/2139163936 >> v1:172.21.15.144:6789/0 conn(0x7f34400b5e00 legacy=0x7f3440142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:38.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.040+0000 7f343fe00640 1 -- 172.21.15.144:0/2139163936 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3440160cf0 con 0x7f34400cec70 2024-05-30T16:49:38.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.041+0000 7f343fe00640 1 --2- 172.21.15.144:0/2139163936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34400cec70 0x7f34400b58c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f342c009870 tx=0x7f342c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfa85c4b2e0f6ec server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:38.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.041+0000 7f343f400640 1 -- 172.21.15.144:0/2139163936 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c037070 con 0x7f34400cec70 2024-05-30T16:49:38.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.041+0000 7f343f400640 1 -- 172.21.15.144:0/2139163936 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342c032640 con 0x7f34400cec70 2024-05-30T16:49:38.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.041+0000 7f343f400640 1 -- 172.21.15.144:0/2139163936 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c032a10 con 0x7f34400cec70 2024-05-30T16:49:38.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.042+0000 7f3447a00640 1 -- 172.21.15.144:0/2139163936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34400cec70 msgr2=0x7f34400b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.042+0000 7f3447a00640 1 --2- 172.21.15.144:0/2139163936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34400cec70 0x7f34400b58c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f342c009870 tx=0x7f342c02a300 comp rx=0 tx=0).stop 2024-05-30T16:49:38.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.042+0000 7f3447a00640 1 -- 172.21.15.144:0/2139163936 shutdown_connections 2024-05-30T16:49:38.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.042+0000 7f3447a00640 1 --2- 172.21.15.144:0/2139163936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34400cec70 0x7f34400b58c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.042+0000 7f3447a00640 1 -- 172.21.15.144:0/2139163936 >> 172.21.15.144:0/2139163936 conn(0x7f344006bd00 msgr2=0x7f344006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:38.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.042+0000 7f3447a00640 1 -- 172.21.15.144:0/2139163936 shutdown_connections 2024-05-30T16:49:38.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.042+0000 7f3447a00640 1 -- 172.21.15.144:0/2139163936 wait complete. 2024-05-30T16:49:38.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.044+0000 7f3447a00640 1 Processor -- start 2024-05-30T16:49:38.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.044+0000 7f3447a00640 1 -- start start 2024-05-30T16:49:38.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.045+0000 7f3447a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34400b5e00 0x7f34400b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.045+0000 7f3447a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34400cec70 0x7f34401e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.045+0000 7f3447a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f344013f760 0x7f34401e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.045+0000 7f3447a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34400cf0d0 con 0x7f34400cec70 2024-05-30T16:49:38.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.045+0000 7f3447a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34400cf250 con 0x7f34400b5e00 2024-05-30T16:49:38.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.045+0000 7f3447a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34400ce6a0 con 0x7f344013f760 2024-05-30T16:49:38.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f344013f760 0x7f34401e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34400b5e00 0x7f34400b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f344013f760 0x7f34401e8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:54276/0 (socket says 172.21.15.144:54276) 2024-05-30T16:49:38.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34400b5e00 0x7f34400b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:50884/0 (socket says 172.21.15.144:50884) 2024-05-30T16:49:38.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445a00640 1 -- 172.21.15.144:0/3913701928 learned_addr learned my addr 172.21.15.144:0/3913701928 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:38.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445000640 1 -- 172.21.15.144:0/3913701928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f344013f760 msgr2=0x7f34401e8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445000640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f344013f760 0x7f34401e8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445000640 1 -- 172.21.15.144:0/3913701928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34400cec70 msgr2=0x7f34401e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445000640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34400cec70 0x7f34401e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445000640 1 -- 172.21.15.144:0/3913701928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34400b2040 con 0x7f34400b5e00 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.046+0000 7f3445a00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f344013f760 0x7f34401e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.047+0000 7f3445000640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34400b5e00 0x7f34400b17f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f343000b3e0 tx=0x7f343000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.047+0000 7f343cc00640 1 -- 172.21.15.144:0/3913701928 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430015030 con 0x7f34400b5e00 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.047+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34400b2320 con 0x7f34400b5e00 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.047+0000 7f343cc00640 1 -- 172.21.15.144:0/3913701928 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3430004020 con 0x7f34400b5e00 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.047+0000 7f343cc00640 1 -- 172.21.15.144:0/3913701928 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430004410 con 0x7f34400b5e00 2024-05-30T16:49:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.047+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34400b28e0 con 0x7f34400b5e00 2024-05-30T16:49:38.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.048+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34400cf6b0 con 0x7f34400b5e00 2024-05-30T16:49:38.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.051+0000 7f343cc00640 1 -- 172.21.15.144:0/3913701928 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 23) ==== 92111+0+0 (secure 0 0 0) 0x7f3430018070 con 0x7f34400b5e00 2024-05-30T16:49:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.052+0000 7f343cc00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f342006d4c0 0x7f342006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.052+0000 7f343cc00640 1 -- 172.21.15.144:0/3913701928 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f343008a6b0 con 0x7f34400b5e00 2024-05-30T16:49:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.052+0000 7f343fe00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f342006d4c0 0x7f342006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.053+0000 7f343fe00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f342006d4c0 0x7f342006f980 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f342c034000 tx=0x7f342c02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:38.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.066+0000 7f343cc00640 1 -- 172.21.15.144:0/3913701928 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34400cf6b0 con 0x7f34400b5e00 2024-05-30T16:49:38.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.297+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3440075f70 con 0x7f342006d4c0 2024-05-30T16:49:38.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.328+0000 7f343cc00640 1 -- 172.21.15.144:0/3913701928 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f342c032610 con 0x7f342006d4c0 2024-05-30T16:49:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:38.330 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:49:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ss1" 2024-05-30T16:49:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:38.330 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:49:38.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f342006d4c0 msgr2=0x7f342006f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f342006d4c0 0x7f342006f980 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f342c034000 tx=0x7f342c02c000 comp rx=0 tx=0).stop 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34400b5e00 msgr2=0x7f34400b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34400b5e00 0x7f34400b17f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f343000b3e0 tx=0x7f343000b8a0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 shutdown_connections 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f342006d4c0 0x7f342006f980 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f344013f760 0x7f34401e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34400cec70 0x7f34401e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 --2- 172.21.15.144:0/3913701928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34400b5e00 0x7f34400b17f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 >> 172.21.15.144:0/3913701928 conn(0x7f344006bd00 msgr2=0x7f344006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 shutdown_connections 2024-05-30T16:49:38.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.331+0000 7f3447a00640 1 -- 172.21.15.144:0/3913701928 wait complete. 2024-05-30T16:49:38.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T16:49:38.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.561+0000 7f0346a00640 1 Processor -- start 2024-05-30T16:49:38.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.561+0000 7f0346a00640 1 -- start start 2024-05-30T16:49:38.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.563+0000 7f0346a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f03400cfc40 0x7f034006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.563+0000 7f0346a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 0x7f03400b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.563+0000 7f0346a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03400d00f0 con 0x7f0340145150 2024-05-30T16:49:38.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.563+0000 7f0346a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f034015f140 con 0x7f03400cfc40 2024-05-30T16:49:38.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.563+0000 7f0346a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f034015f390 con 0x7f034006f610 2024-05-30T16:49:38.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.563+0000 7f033fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0340145150 0x7f03400cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44594/0 (socket says 172.21.15.144:44594) 2024-05-30T16:49:38.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f033fe00640 1 -- 172.21.15.144:0/2880779906 learned_addr learned my addr 172.21.15.144:0/2880779906 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:38.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f033f400640 1 --2- 172.21.15.144:0/2880779906 >> v2:172.21.15.144:3300/0 conn(0x7f03400cfc40 0x7f034006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f033ea00640 1 -- 172.21.15.144:0/2880779906 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036035132 0 0) 0x7f03400d00f0 con 0x7f0340145150 2024-05-30T16:49:38.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f033ea00640 1 -- 172.21.15.144:0/2880779906 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0320005730 con 0x7f0340145150 2024-05-30T16:49:38.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f0344a00640 1 --2- 172.21.15.144:0/2880779906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 0x7f03400b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f033f400640 1 -- 172.21.15.144:0/2880779906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 msgr2=0x7f03400b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:38.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f033f400640 1 --2- 172.21.15.144:0/2880779906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 0x7f03400b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f033f400640 1 -- 172.21.15.144:0/2880779906 >> v1:172.21.15.144:6789/0 conn(0x7f0340145150 legacy=0x7f03400cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f033ea00640 1 -- 172.21.15.144:0/2880779906 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2109643724 0 0) 0x7f0320005730 con 0x7f0340145150 2024-05-30T16:49:38.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.564+0000 7f033f400640 1 -- 172.21.15.144:0/2880779906 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034015f670 con 0x7f03400cfc40 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.565+0000 7f033f400640 1 --2- 172.21.15.144:0/2880779906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 0x7f034006f0d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4701fc500ab12e8f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f033ea00640 1 -- 172.21.15.144:0/2880779906 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330001670 con 0x7f03400cfc40 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f033ea00640 1 -- 172.21.15.144:0/2880779906 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0328007540 con 0x7f03400cfc40 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f033ea00640 1 -- 172.21.15.144:0/2880779906 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328007910 con 0x7f03400cfc40 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f0346a00640 1 -- 172.21.15.144:0/2880779906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 msgr2=0x7f034006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f0346a00640 1 --2- 172.21.15.144:0/2880779906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 0x7f034006f0d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032802a560 comp rx=0 tx=0).stop 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f0346a00640 1 -- 172.21.15.144:0/2880779906 shutdown_connections 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f0346a00640 1 --2- 172.21.15.144:0/2880779906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 0x7f03400b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f0346a00640 1 --2- 172.21.15.144:0/2880779906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 0x7f034006f0d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f0346a00640 1 -- 172.21.15.144:0/2880779906 >> 172.21.15.144:0/2880779906 conn(0x7f034006bd00 msgr2=0x7f034006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.566+0000 7f0346a00640 1 -- 172.21.15.144:0/2880779906 shutdown_connections 2024-05-30T16:49:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.567+0000 7f0346a00640 1 -- 172.21.15.144:0/2880779906 wait complete. 2024-05-30T16:49:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.568+0000 7f0346a00640 1 Processor -- start 2024-05-30T16:49:38.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.568+0000 7f0346a00640 1 -- start start 2024-05-30T16:49:38.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.569+0000 7f0346a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 0x7f034015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.569+0000 7f0346a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 0x7f03401f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.569+0000 7f0346a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0340145150 0x7f034013ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.569+0000 7f0346a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f034015fe70 con 0x7f03400cfc40 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.569+0000 7f0346a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03400b64f0 con 0x7f0340145150 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.569+0000 7f0346a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f034015fff0 con 0x7f034006f610 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f033f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 0x7f03401f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f033f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 0x7f03401f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56480/0 (socket says 172.21.15.144:56480) 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f033f400640 1 -- 172.21.15.144:0/1052383627 learned_addr learned my addr 172.21.15.144:0/1052383627 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f033fe00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 0x7f034015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f0344a00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0340145150 0x7f034013ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f033f400640 1 -- 172.21.15.144:0/1052383627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 msgr2=0x7f034015a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f033f400640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 0x7f034015a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f033f400640 1 -- 172.21.15.144:0/1052383627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0340145150 msgr2=0x7f034013ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f033f400640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0340145150 0x7f034013ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.570+0000 7f033f400640 1 -- 172.21.15.144:0/1052383627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03400b17a0 con 0x7f03400cfc40 2024-05-30T16:49:38.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.571+0000 7f033f400640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 0x7f03401f4b40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f0328004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:38.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.571+0000 7f0337e00640 1 -- 172.21.15.144:0/1052383627 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328040070 con 0x7f03400cfc40 2024-05-30T16:49:38.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.571+0000 7f0337e00640 1 -- 172.21.15.144:0/1052383627 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0328031c40 con 0x7f03400cfc40 2024-05-30T16:49:38.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.571+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03400b1a80 con 0x7f03400cfc40 2024-05-30T16:49:38.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.571+0000 7f0337e00640 1 -- 172.21.15.144:0/1052383627 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328009450 con 0x7f03400cfc40 2024-05-30T16:49:38.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.571+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03401f5080 con 0x7f03400cfc40 2024-05-30T16:49:38.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.572+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0340068b90 con 0x7f03400cfc40 2024-05-30T16:49:38.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.573+0000 7f0337e00640 1 -- 172.21.15.144:0/1052383627 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 92111+0+0 (secure 0 0 0) 0x7f0328039040 con 0x7f03400cfc40 2024-05-30T16:49:38.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.574+0000 7f0337e00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f031c06d4c0 0x7f031c06f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:38.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.574+0000 7f0337e00640 1 -- 172.21.15.144:0/1052383627 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5737+0+0 (secure 0 0 0) 0x7f03280abd80 con 0x7f03400cfc40 2024-05-30T16:49:38.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.574+0000 7f033fe00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f031c06d4c0 0x7f031c06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:38.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.575+0000 7f033fe00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f031c06d4c0 0x7f031c06f980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03300011e0 tx=0x7f0330009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:38.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.579+0000 7f0337e00640 1 -- 172.21.15.144:0/1052383627 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f032807bc00 con 0x7f03400cfc40 2024-05-30T16:49:38.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.813+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0340075f70 con 0x7f031c06d4c0 2024-05-30T16:49:38.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.885+0000 7f0337e00640 1 -- 172.21.15.144:0/1052383627 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0330001b10 con 0x7f031c06d4c0 2024-05-30T16:49:38.887 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f031c06d4c0 msgr2=0x7f031c06f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f031c06d4c0 0x7f031c06f980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03300011e0 tx=0x7f0330009040 comp rx=0 tx=0).stop 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 msgr2=0x7f03401f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 0x7f03401f4b40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f0328004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 shutdown_connections 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f031c06d4c0 0x7f031c06f980 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0340145150 0x7f034013ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03400cfc40 0x7f03401f4b40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 --2- 172.21.15.144:0/1052383627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f034006f610 0x7f034015a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.889+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 >> 172.21.15.144:0/1052383627 conn(0x7f034006bd00 msgr2=0x7f0340143ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.890+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 shutdown_connections 2024-05-30T16:49:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:38.890+0000 7f0346a00640 1 -- 172.21.15.144:0/1052383627 wait complete. 2024-05-30T16:49:38.912 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T16:49:39.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.118+0000 7fec9b600640 1 Processor -- start 2024-05-30T16:49:39.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.118+0000 7fec9b600640 1 -- start start 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.119+0000 7fec9b600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec9415e910 0x7fec940cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.119+0000 7fec9b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940ba540 0x7fec940cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.119+0000 7fec9b600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fec940d2dc0 0x7fec940d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.119+0000 7fec9b600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fec940d2930 con 0x7fec9415e910 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.119+0000 7fec9b600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fec940b9360 con 0x7fec940d2dc0 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.119+0000 7fec9b600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec940b9640 con 0x7fec940ba540 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec98c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec9415e910 0x7fec940cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec98c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec9415e910 0x7fec940cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56484/0 (socket says 172.21.15.144:56484) 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec98c00640 1 -- 172.21.15.144:0/2399358249 learned_addr learned my addr 172.21.15.144:0/2399358249 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec99600640 1 --2- 172.21.15.144:0/2399358249 >> v2:172.21.15.149:3300/0 conn(0x7fec940d2dc0 0x7fec940d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec93e00640 1 --2- 172.21.15.144:0/2399358249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940ba540 0x7fec940cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec98c00640 1 -- 172.21.15.144:0/2399358249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940ba540 msgr2=0x7fec940cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:39.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec98c00640 1 --2- 172.21.15.144:0/2399358249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940ba540 0x7fec940cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec98c00640 1 -- 172.21.15.144:0/2399358249 >> v2:172.21.15.149:3300/0 conn(0x7fec940d2dc0 msgr2=0x7fec940d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:39.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec98c00640 1 --2- 172.21.15.144:0/2399358249 >> v2:172.21.15.149:3300/0 conn(0x7fec940d2dc0 0x7fec940d3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec98c00640 1 -- 172.21.15.144:0/2399358249 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec940b9920 con 0x7fec9415e910 2024-05-30T16:49:39.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec99600640 1 --2- 172.21.15.144:0/2399358249 >> v2:172.21.15.149:3300/0 conn(0x7fec940d2dc0 0x7fec940d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:39.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.120+0000 7fec93e00640 1 --2- 172.21.15.144:0/2399358249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940ba540 0x7fec940cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:39.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.121+0000 7fec98c00640 1 --2- 172.21.15.144:0/2399358249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 0x7fec940cf4f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fec940cb880 tx=0x7fec8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9751aba088ab9c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:39.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec93400640 1 -- 172.21.15.144:0/2399358249 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88037070 con 0x7fec9415e910 2024-05-30T16:49:39.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec93400640 1 -- 172.21.15.144:0/2399358249 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec88032440 con 0x7fec9415e910 2024-05-30T16:49:39.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec93400640 1 -- 172.21.15.144:0/2399358249 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88032810 con 0x7fec9415e910 2024-05-30T16:49:39.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec9b600640 1 -- 172.21.15.144:0/2399358249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 msgr2=0x7fec940cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec9b600640 1 --2- 172.21.15.144:0/2399358249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 0x7fec940cf4f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fec940cb880 tx=0x7fec8802a270 comp rx=0 tx=0).stop 2024-05-30T16:49:39.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec9b600640 1 -- 172.21.15.144:0/2399358249 shutdown_connections 2024-05-30T16:49:39.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec9b600640 1 --2- 172.21.15.144:0/2399358249 >> v2:172.21.15.149:3300/0 conn(0x7fec940d2dc0 0x7fec940d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec9b600640 1 --2- 172.21.15.144:0/2399358249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940ba540 0x7fec940cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec9b600640 1 --2- 172.21.15.144:0/2399358249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 0x7fec940cf4f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.122+0000 7fec9b600640 1 -- 172.21.15.144:0/2399358249 >> 172.21.15.144:0/2399358249 conn(0x7fec940627b0 msgr2=0x7fec94062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:39.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.123+0000 7fec9b600640 1 -- 172.21.15.144:0/2399358249 shutdown_connections 2024-05-30T16:49:39.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.123+0000 7fec9b600640 1 -- 172.21.15.144:0/2399358249 wait complete. 2024-05-30T16:49:39.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.124+0000 7fec9b600640 1 Processor -- start 2024-05-30T16:49:39.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.124+0000 7fec9b600640 1 -- start start 2024-05-30T16:49:39.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.125+0000 7fec9b600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec940ba540 0x7fec941f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.125+0000 7fec9b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940d2dc0 0x7fec940d40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.125+0000 7fec9b600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 0x7fec940d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.125+0000 7fec9b600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec9415ee70 con 0x7fec9415e910 2024-05-30T16:49:39.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.125+0000 7fec9b600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec9415ecf0 con 0x7fec940ba540 2024-05-30T16:49:39.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.125+0000 7fec9b600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec940d3790 con 0x7fec940d2dc0 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec99600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 0x7fec940d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec99600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 0x7fec940d45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56496/0 (socket says 172.21.15.144:56496) 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec99600640 1 -- 172.21.15.144:0/144231691 learned_addr learned my addr 172.21.15.144:0/144231691 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec98c00640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec940ba540 0x7fec941f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec93e00640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940d2dc0 0x7fec940d40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec99600640 1 -- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940d2dc0 msgr2=0x7fec940d40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec99600640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940d2dc0 0x7fec940d40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec99600640 1 -- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec940ba540 msgr2=0x7fec941f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec99600640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec940ba540 0x7fec941f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec99600640 1 -- 172.21.15.144:0/144231691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec941f5880 con 0x7fec9415e910 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec98c00640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec940ba540 0x7fec941f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec93e00640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940d2dc0 0x7fec940d40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:39.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.126+0000 7fec99600640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 0x7fec940d45f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00cf20 tx=0x7fec8c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:39.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.127+0000 7fec90c00640 1 -- 172.21.15.144:0/144231691 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c01a070 con 0x7fec9415e910 2024-05-30T16:49:39.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.127+0000 7fec90c00640 1 -- 172.21.15.144:0/144231691 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c00d840 con 0x7fec9415e910 2024-05-30T16:49:39.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.127+0000 7fec90c00640 1 -- 172.21.15.144:0/144231691 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00dc30 con 0x7fec9415e910 2024-05-30T16:49:39.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.127+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9415f100 con 0x7fec9415e910 2024-05-30T16:49:39.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.127+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9415f6c0 con 0x7fec9415e910 2024-05-30T16:49:39.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.128+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec94068b90 con 0x7fec9415e910 2024-05-30T16:49:39.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.129+0000 7fec90c00640 1 -- 172.21.15.144:0/144231691 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 92111+0+0 (secure 0 0 0) 0x7fec8c01d070 con 0x7fec9415e910 2024-05-30T16:49:39.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.130+0000 7fec90c00640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec7406d4c0 0x7fec7406f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.130+0000 7fec90c00640 1 -- 172.21.15.144:0/144231691 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7fec8c08ad70 con 0x7fec9415e910 2024-05-30T16:49:39.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.130+0000 7fec98c00640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec7406d4c0 0x7fec7406f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.131+0000 7fec98c00640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec7406d4c0 0x7fec7406f980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fec88034000 tx=0x7fec8802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:39.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.135+0000 7fec90c00640 1 -- 172.21.15.144:0/144231691 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fec8c05abf0 con 0x7fec9415e910 2024-05-30T16:49:39.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.377+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fec94075f70 con 0x7fec7406d4c0 2024-05-30T16:49:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.408+0000 7fec90c00640 1 -- 172.21.15.144:0/144231691 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fec88032800 con 0x7fec7406d4c0 2024-05-30T16:49:39.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.411+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec7406d4c0 msgr2=0x7fec7406f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.411+0000 7fec9b600640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec7406d4c0 0x7fec7406f980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fec88034000 tx=0x7fec8802e000 comp rx=0 tx=0).stop 2024-05-30T16:49:39.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.411+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 msgr2=0x7fec940d45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.411+0000 7fec9b600640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 0x7fec940d45f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00cf20 tx=0x7fec8c00a7d0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.412+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 shutdown_connections 2024-05-30T16:49:39.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.412+0000 7fec9b600640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec7406d4c0 0x7fec7406f980 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.412+0000 7fec9b600640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9415e910 0x7fec940d45f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.412+0000 7fec9b600640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec940d2dc0 0x7fec940d40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.412+0000 7fec9b600640 1 --2- 172.21.15.144:0/144231691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec940ba540 0x7fec941f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.412+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 >> 172.21.15.144:0/144231691 conn(0x7fec940627b0 msgr2=0x7fec940b8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:39.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.412+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 shutdown_connections 2024-05-30T16:49:39.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.412+0000 7fec9b600640 1 -- 172.21.15.144:0/144231691 wait complete. 2024-05-30T16:49:39.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone56765 2024-05-30T16:49:39.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.628+0000 7f46d2000640 1 Processor -- start 2024-05-30T16:49:39.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.628+0000 7f46d2000640 1 -- start start 2024-05-30T16:49:39.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.629+0000 7f46d2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46cc14c630 0x7f46cc0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.629+0000 7f46d2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc0cea10 0x7f46cc072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.629+0000 7f46d2000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46cc06fbf0 con 0x7f46cc072750 2024-05-30T16:49:39.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.629+0000 7f46d2000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f46cc0cf050 con 0x7f46cc14c630 2024-05-30T16:49:39.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.629+0000 7f46d2000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f46cc0cf330 con 0x7f46cc0cea10 2024-05-30T16:49:39.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.630+0000 7f46cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46cc14c630 0x7f46cc0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.630+0000 7f46cbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f46cc072750 0x7f46cc06dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44610/0 (socket says 172.21.15.144:44610) 2024-05-30T16:49:39.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.630+0000 7f46cbe00640 1 -- 172.21.15.144:0/3803936010 learned_addr learned my addr 172.21.15.144:0/3803936010 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:39.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.630+0000 7f46caa00640 1 --2- 172.21.15.144:0/3803936010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc0cea10 0x7f46cc072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.630+0000 7f46cb400640 1 -- 172.21.15.144:0/3803936010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc0cea10 msgr2=0x7f46cc072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:39.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.630+0000 7f46cb400640 1 --2- 172.21.15.144:0/3803936010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc0cea10 0x7f46cc072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.630+0000 7f46ca000640 1 -- 172.21.15.144:0/3803936010 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503639498 0 0) 0x7f46cc06fbf0 con 0x7f46cc072750 2024-05-30T16:49:39.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.630+0000 7f46cb400640 1 -- 172.21.15.144:0/3803936010 >> v1:172.21.15.144:6789/0 conn(0x7f46cc072750 legacy=0x7f46cc06dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.630+0000 7f46cb400640 1 -- 172.21.15.144:0/3803936010 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46cc0cf610 con 0x7f46cc14c630 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.632+0000 7f46cb400640 1 --2- 172.21.15.144:0/3803936010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 0x7f46cc0ce4d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009d90 tx=0x7f46bc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba63d606f777397 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.632+0000 7f46ca000640 1 -- 172.21.15.144:0/3803936010 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc007740 con 0x7f46cc14c630 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.632+0000 7f46ca000640 1 -- 172.21.15.144:0/3803936010 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46bc0078e0 con 0x7f46cc14c630 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.632+0000 7f46ca000640 1 -- 172.21.15.144:0/3803936010 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc007cb0 con 0x7f46cc14c630 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.632+0000 7f46d2000640 1 -- 172.21.15.144:0/3803936010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 msgr2=0x7f46cc0ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.632+0000 7f46d2000640 1 --2- 172.21.15.144:0/3803936010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 0x7f46cc0ce4d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009d90 tx=0x7f46bc02a6f0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.632+0000 7f46d2000640 1 -- 172.21.15.144:0/3803936010 shutdown_connections 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.632+0000 7f46d2000640 1 --2- 172.21.15.144:0/3803936010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc0cea10 0x7f46cc072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.633+0000 7f46d2000640 1 --2- 172.21.15.144:0/3803936010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 0x7f46cc0ce4d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.633+0000 7f46d2000640 1 -- 172.21.15.144:0/3803936010 >> 172.21.15.144:0/3803936010 conn(0x7f46cc06bd00 msgr2=0x7f46cc06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:39.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.633+0000 7f46d2000640 1 -- 172.21.15.144:0/3803936010 shutdown_connections 2024-05-30T16:49:39.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.633+0000 7f46d2000640 1 -- 172.21.15.144:0/3803936010 wait complete. 2024-05-30T16:49:39.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.634+0000 7f46d2000640 1 Processor -- start 2024-05-30T16:49:39.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.634+0000 7f46d2000640 1 -- start start 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.635+0000 7f46d2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc072750 0x7f46cc165980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.635+0000 7f46d2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46cc0cea10 0x7f46cc1461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.635+0000 7f46d2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 0x7f46cc146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.635+0000 7f46d2000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc14ca10 con 0x7f46cc14c630 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.635+0000 7f46d2000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc0b3c20 con 0x7f46cc0cea10 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.635+0000 7f46d2000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f46cc14cb90 con 0x7f46cc072750 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 0x7f46cc146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 0x7f46cc146720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56510/0 (socket says 172.21.15.144:56510) 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cbe00640 1 -- 172.21.15.144:0/3007543459 learned_addr learned my addr 172.21.15.144:0/3007543459 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:39.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cb400640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc072750 0x7f46cc165980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46caa00640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46cc0cea10 0x7f46cc1461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cbe00640 1 -- 172.21.15.144:0/3007543459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc072750 msgr2=0x7f46cc165980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cbe00640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc072750 0x7f46cc165980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cbe00640 1 -- 172.21.15.144:0/3007543459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46cc0cea10 msgr2=0x7f46cc1461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cbe00640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46cc0cea10 0x7f46cc1461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cbe00640 1 -- 172.21.15.144:0/3007543459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46cc165ec0 con 0x7f46cc14c630 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.636+0000 7f46cbe00640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 0x7f46cc146720 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c480 tx=0x7f46c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.637+0000 7f46c3400640 1 -- 172.21.15.144:0/3007543459 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4005ce0 con 0x7f46cc14c630 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.637+0000 7f46c3400640 1 -- 172.21.15.144:0/3007543459 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c4007070 con 0x7f46cc14c630 2024-05-30T16:49:39.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.637+0000 7f46c3400640 1 -- 172.21.15.144:0/3007543459 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c40074e0 con 0x7f46cc14c630 2024-05-30T16:49:39.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.637+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46cc0aa0a0 con 0x7f46cc14c630 2024-05-30T16:49:39.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.637+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46cc1459e0 con 0x7f46cc14c630 2024-05-30T16:49:39.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.638+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46cc1457e0 con 0x7f46cc14c630 2024-05-30T16:49:39.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.639+0000 7f46c3400640 1 -- 172.21.15.144:0/3007543459 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 92111+0+0 (secure 0 0 0) 0x7f46c401b400 con 0x7f46cc14c630 2024-05-30T16:49:39.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.640+0000 7f46c3400640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f46ac06d4c0 0x7f46ac06f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:39.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.640+0000 7f46c3400640 1 -- 172.21.15.144:0/3007543459 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7f46c408a410 con 0x7f46cc14c630 2024-05-30T16:49:39.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.640+0000 7f46cb400640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f46ac06d4c0 0x7f46ac06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:39.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.641+0000 7f46cb400640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f46ac06d4c0 0x7f46ac06f980 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f46bc034000 tx=0x7f46bc033040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:39.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.645+0000 7f46c3400640 1 -- 172.21.15.144:0/3007543459 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46c405a030 con 0x7f46cc14c630 2024-05-30T16:49:39.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.880+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone56765", "target": ["mon-mgr", ""]}) -- 0x7f46cc075f70 con 0x7f46ac06d4c0 2024-05-30T16:49:39.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.913+0000 7f46c3400640 1 -- 172.21.15.144:0/3007543459 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f46bc007880 con 0x7f46ac06d4c0 2024-05-30T16:49:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.915+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f46ac06d4c0 msgr2=0x7f46ac06f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.915+0000 7f46d2000640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f46ac06d4c0 0x7f46ac06f980 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f46bc034000 tx=0x7f46bc033040 comp rx=0 tx=0).stop 2024-05-30T16:49:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.915+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 msgr2=0x7f46cc146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.915+0000 7f46d2000640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 0x7f46cc146720 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c480 tx=0x7f46c400c940 comp rx=0 tx=0).stop 2024-05-30T16:49:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.916+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 shutdown_connections 2024-05-30T16:49:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.916+0000 7f46d2000640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f46ac06d4c0 0x7f46ac06f980 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.916+0000 7f46d2000640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46cc14c630 0x7f46cc146720 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.916+0000 7f46d2000640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46cc0cea10 0x7f46cc1461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.916+0000 7f46d2000640 1 --2- 172.21.15.144:0/3007543459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46cc072750 0x7f46cc165980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.916+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 >> 172.21.15.144:0/3007543459 conn(0x7f46cc06bd00 msgr2=0x7f46cc0ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.916+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 shutdown_connections 2024-05-30T16:49:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:39.916+0000 7f46d2000640 1 -- 172.21.15.144:0/3007543459 wait complete. 2024-05-30T16:49:39.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone56762 2024-05-30T16:49:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.129+0000 7fdc25a00640 1 Processor -- start 2024-05-30T16:49:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.129+0000 7fdc25a00640 1 -- start start 2024-05-30T16:49:40.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.131+0000 7fdc25a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdc2013f760 0x7fdc2006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.131+0000 7fdc25a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc200cec70 0x7fdc200b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.131+0000 7fdc25a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2006ee80 con 0x7fdc200b5e00 2024-05-30T16:49:40.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.131+0000 7fdc25a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fdc201612b0 con 0x7fdc2013f760 2024-05-30T16:49:40.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.131+0000 7fdc25a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdc2013fb40 con 0x7fdc200cec70 2024-05-30T16:49:40.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.131+0000 7fdc1f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdc200b5e00 0x7fdc20142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44622/0 (socket says 172.21.15.144:44622) 2024-05-30T16:49:40.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.131+0000 7fdc1f400640 1 -- 172.21.15.144:0/1960754886 learned_addr learned my addr 172.21.15.144:0/1960754886 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:40.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc16000640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc200cec70 0x7fdc200b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1ea00640 1 --2- 172.21.15.144:0/1960754886 >> v2:172.21.15.149:3300/0 conn(0x7fdc2013f760 0x7fdc2006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147493554 0 0) 0x7fdc2006ee80 con 0x7fdc200b5e00 2024-05-30T16:49:40.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc04003520 con 0x7fdc200b5e00 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1768645106 0 0) 0x7fdc04003520 con 0x7fdc200b5e00 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc200cec70 msgr2=0x7fdc200b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc200cec70 0x7fdc200b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 >> v2:172.21.15.149:3300/0 conn(0x7fdc2013f760 msgr2=0x7fdc2006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 --2- 172.21.15.144:0/1960754886 >> v2:172.21.15.149:3300/0 conn(0x7fdc2013f760 0x7fdc2006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc20160730 con 0x7fdc200b5e00 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fdc180019f0 con 0x7fdc200b5e00 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 >> v1:172.21.15.144:6789/0 conn(0x7fdc200b5e00 legacy=0x7fdc20142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc200cec70 0x7fdc040039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc04003f30 0x7fdc04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc04004d40 0x7fdc040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc201612b0 con 0x7fdc04004d40 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0400b9c0 con 0x7fdc04003f30 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.132+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0400bb70 con 0x7fdc200cec70 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.133+0000 7fdc1f400640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc04004d40 0x7fdc040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.133+0000 7fdc1ea00640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc200cec70 0x7fdc040039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.133+0000 7fdc16000640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc04003f30 0x7fdc04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.133+0000 7fdc1f400640 1 -- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc200cec70 msgr2=0x7fdc040039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.133+0000 7fdc1f400640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc200cec70 0x7fdc040039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.133+0000 7fdc1f400640 1 -- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc04003f30 msgr2=0x7fdc04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.133+0000 7fdc1f400640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc04003f30 0x7fdc04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.133+0000 7fdc1f400640 1 -- 172.21.15.144:0/1960754886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc04003520 con 0x7fdc04004d40 2024-05-30T16:49:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.134+0000 7fdc1f400640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc04004d40 0x7fdc040051c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800a870 tx=0x7fdc04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc5386932e41f63 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.134+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800a4c0 con 0x7fdc04004d40 2024-05-30T16:49:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.135+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1802f070 con 0x7fdc04004d40 2024-05-30T16:49:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.135+0000 7fdc1e000640 1 -- 172.21.15.144:0/1960754886 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1802bcc0 con 0x7fdc04004d40 2024-05-30T16:49:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.135+0000 7fdc25a00640 1 -- 172.21.15.144:0/1960754886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc04004d40 msgr2=0x7fdc040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.135+0000 7fdc25a00640 1 --2- 172.21.15.144:0/1960754886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc04004d40 0x7fdc040051c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800a870 tx=0x7fdc04005830 comp rx=0 tx=0).stop 2024-05-30T16:49:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.135+0000 7fdc1f400640 1 -- 172.21.15.144:0/1960754886 reap_dead start 2024-05-30T16:49:40.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.135+0000 7fdc25a00640 1 -- 172.21.15.144:0/1960754886 shutdown_connections 2024-05-30T16:49:40.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.135+0000 7fdc25a00640 1 -- 172.21.15.144:0/1960754886 >> 172.21.15.144:0/1960754886 conn(0x7fdc2006bd00 msgr2=0x7fdc2006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:40.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.135+0000 7fdc25a00640 1 -- 172.21.15.144:0/1960754886 shutdown_connections 2024-05-30T16:49:40.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.135+0000 7fdc25a00640 1 -- 172.21.15.144:0/1960754886 wait complete. 2024-05-30T16:49:40.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.137+0000 7fdc25a00640 1 Processor -- start 2024-05-30T16:49:40.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.137+0000 7fdc25a00640 1 -- start start 2024-05-30T16:49:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.138+0000 7fdc25a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc04004d40 0x7fdc20151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.138+0000 7fdc25a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc20138c20 0x7fdc2013a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.138+0000 7fdc25a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2015f030 0x7fdc2015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.138+0000 7fdc25a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc20160fd0 con 0x7fdc2015f030 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.138+0000 7fdc25a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdc20160cf0 con 0x7fdc20138c20 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.138+0000 7fdc25a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdc200cf0d0 con 0x7fdc04004d40 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.138+0000 7fdc1f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2015f030 0x7fdc2015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.138+0000 7fdc1f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2015f030 0x7fdc2015f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56524/0 (socket says 172.21.15.144:56524) 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc1f400640 1 -- 172.21.15.144:0/1820816408 learned_addr learned my addr 172.21.15.144:0/1820816408 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc1ea00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc04004d40 0x7fdc20151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc16000640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc20138c20 0x7fdc2013a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc1f400640 1 -- 172.21.15.144:0/1820816408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc04004d40 msgr2=0x7fdc20151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc1f400640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc04004d40 0x7fdc20151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc1f400640 1 -- 172.21.15.144:0/1820816408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc20138c20 msgr2=0x7fdc2013a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc1f400640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc20138c20 0x7fdc2013a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc1f400640 1 -- 172.21.15.144:0/1820816408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc20139550 con 0x7fdc2015f030 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc1ea00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc04004d40 0x7fdc20151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc1f400640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2015f030 0x7fdc2015f4b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fdc18001cf0 tx=0x7fdc18001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.139+0000 7fdc17400640 1 -- 172.21.15.144:0/1820816408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18002030 con 0x7fdc2015f030 2024-05-30T16:49:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.140+0000 7fdc17400640 1 -- 172.21.15.144:0/1820816408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc180019e0 con 0x7fdc2015f030 2024-05-30T16:49:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.140+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc20139830 con 0x7fdc2015f030 2024-05-30T16:49:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.140+0000 7fdc17400640 1 -- 172.21.15.144:0/1820816408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18034670 con 0x7fdc2015f030 2024-05-30T16:49:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.140+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc20151c70 con 0x7fdc2015f030 2024-05-30T16:49:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.141+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc20068b90 con 0x7fdc2015f030 2024-05-30T16:49:40.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.142+0000 7fdc17400640 1 -- 172.21.15.144:0/1820816408 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fdc18034810 con 0x7fdc2015f030 2024-05-30T16:49:40.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.143+0000 7fdc17400640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdbfc06d5e0 0x7fdbfc06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.143+0000 7fdc17400640 1 -- 172.21.15.144:0/1820816408 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7fdc180aaad0 con 0x7fdc2015f030 2024-05-30T16:49:40.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.143+0000 7fdc1ea00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdbfc06d5e0 0x7fdbfc06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.144+0000 7fdc1ea00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdbfc06d5e0 0x7fdbfc06faa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009a80 tx=0x7fdc10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.148+0000 7fdc17400640 1 -- 172.21.15.144:0/1820816408 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdc18046060 con 0x7fdc2015f030 2024-05-30T16:49:40.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.377+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone56762", "target": ["mon-mgr", ""]}) -- 0x7fdc20075f70 con 0x7fdbfc06d5e0 2024-05-30T16:49:40.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.419+0000 7fdc17400640 1 -- 172.21.15.144:0/1820816408 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdc10012b00 con 0x7fdbfc06d5e0 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdbfc06d5e0 msgr2=0x7fdbfc06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdbfc06d5e0 0x7fdbfc06faa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009a80 tx=0x7fdc10008040 comp rx=0 tx=0).stop 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2015f030 msgr2=0x7fdc2015f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2015f030 0x7fdc2015f4b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fdc18001cf0 tx=0x7fdc18001360 comp rx=0 tx=0).stop 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 shutdown_connections 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdbfc06d5e0 0x7fdbfc06faa0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2015f030 0x7fdc2015f4b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc20138c20 0x7fdc2013a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 --2- 172.21.15.144:0/1820816408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc04004d40 0x7fdc20151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 >> 172.21.15.144:0/1820816408 conn(0x7fdc2006bd00 msgr2=0x7fdc2013db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 shutdown_connections 2024-05-30T16:49:40.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.422+0000 7fdc25a00640 1 -- 172.21.15.144:0/1820816408 wait complete. 2024-05-30T16:49:40.444 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone56761 2024-05-30T16:49:40.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.669+0000 7fec5ae00640 1 Processor -- start 2024-05-30T16:49:40.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.669+0000 7fec5ae00640 1 -- start start 2024-05-30T16:49:40.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.673+0000 7fec5ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec5415bb00 0x7fec54071df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.673+0000 7fec5ae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec54072740 con 0x7fec54072330 2024-05-30T16:49:40.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.673+0000 7fec5ae00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec54141300 con 0x7fec54140f20 2024-05-30T16:49:40.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.673+0000 7fec5ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fec540b65f0 con 0x7fec5415bb00 2024-05-30T16:49:40.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.674+0000 7fec58e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fec54072330 0x7fec540ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44628/0 (socket says 172.21.15.144:44628) 2024-05-30T16:49:40.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.674+0000 7fec58e00640 1 -- 172.21.15.144:0/4067251378 learned_addr learned my addr 172.21.15.144:0/4067251378 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:40.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.675+0000 7fec53400640 1 --2- 172.21.15.144:0/4067251378 >> v2:172.21.15.144:3300/0 conn(0x7fec5415bb00 0x7fec54071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.675+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 216013159 0 0) 0x7fec54141300 con 0x7fec54140f20 2024-05-30T16:49:40.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.675+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec38003520 con 0x7fec54140f20 2024-05-30T16:49:40.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.676+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3240922901 0 0) 0x7fec38003520 con 0x7fec54140f20 2024-05-30T16:49:40.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.676+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 >> v2:172.21.15.144:3300/0 conn(0x7fec5415bb00 msgr2=0x7fec54071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:40.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.677+0000 7fec52a00640 1 --2- 172.21.15.144:0/4067251378 >> v2:172.21.15.144:3300/0 conn(0x7fec5415bb00 0x7fec54071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.677+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 >> v1:172.21.15.144:6789/0 conn(0x7fec54072330 legacy=0x7fec540ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.677+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec540b6310 con 0x7fec54140f20 2024-05-30T16:49:40.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.677+0000 7fec53400640 1 --2- 172.21.15.144:0/4067251378 >> v2:172.21.15.144:3300/0 conn(0x7fec5415bb00 0x7fec54071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:49:40.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.678+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fec40001670 con 0x7fec54140f20 2024-05-30T16:49:40.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.678+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 >> v1:172.21.15.149:6789/0 conn(0x7fec54140f20 legacy=0x7fec5415ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.678+0000 7fec52a00640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec380039b0 0x7fec38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.678+0000 7fec52a00640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec380042d0 0x7fec38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.678+0000 7fec52a00640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec38004f40 0x7fec3800ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.678+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec540b65f0 con 0x7fec38004f40 2024-05-30T16:49:40.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.678+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec38010510 con 0x7fec380039b0 2024-05-30T16:49:40.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.678+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec38010690 con 0x7fec380042d0 2024-05-30T16:49:40.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.679+0000 7fec53400640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec380042d0 0x7fec38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.679+0000 7fec58e00640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec38004f40 0x7fec3800ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.679+0000 7fec53e00640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec380039b0 0x7fec38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.680+0000 7fec53400640 1 -- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec380039b0 msgr2=0x7fec38003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:40.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.680+0000 7fec53400640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec380039b0 0x7fec38003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.680+0000 7fec53400640 1 -- 172.21.15.144:0/4067251378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec38004f40 msgr2=0x7fec3800ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:40.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.680+0000 7fec53400640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec38004f40 0x7fec3800ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.680+0000 7fec53400640 1 -- 172.21.15.144:0/4067251378 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec38003520 con 0x7fec380042d0 2024-05-30T16:49:40.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.680+0000 7fec58e00640 1 -- 172.21.15.144:0/4067251378 reap_dead start 2024-05-30T16:49:40.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.682+0000 7fec53400640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec380042d0 0x7fec38004800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fec4400e540 tx=0x7fec38005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df80dbcb8bbc62b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:40.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.682+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44037070 con 0x7fec380042d0 2024-05-30T16:49:40.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.682+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec44032600 con 0x7fec380042d0 2024-05-30T16:49:40.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.682+0000 7fec52a00640 1 -- 172.21.15.144:0/4067251378 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44009c30 con 0x7fec380042d0 2024-05-30T16:49:40.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.683+0000 7fec5ae00640 1 -- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec380042d0 msgr2=0x7fec38004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.683+0000 7fec5ae00640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec380042d0 0x7fec38004800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fec4400e540 tx=0x7fec38005830 comp rx=0 tx=0).stop 2024-05-30T16:49:40.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.685+0000 7fec5ae00640 1 -- 172.21.15.144:0/4067251378 shutdown_connections 2024-05-30T16:49:40.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.685+0000 7fec5ae00640 1 --2- 172.21.15.144:0/4067251378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec380042d0 0x7fec38004800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.685+0000 7fec5ae00640 1 -- 172.21.15.144:0/4067251378 >> 172.21.15.144:0/4067251378 conn(0x7fec54070050 msgr2=0x7fec5406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:40.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.686+0000 7fec5ae00640 1 -- 172.21.15.144:0/4067251378 shutdown_connections 2024-05-30T16:49:40.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.687+0000 7fec5ae00640 1 -- 172.21.15.144:0/4067251378 wait complete. 2024-05-30T16:49:40.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.690+0000 7fec5ae00640 1 Processor -- start 2024-05-30T16:49:40.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.690+0000 7fec5ae00640 1 -- start start 2024-05-30T16:49:40.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.692+0000 7fec5ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec380042d0 0x7fec540b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.692+0000 7fec5ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec541e5040 0x7fec541e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.692+0000 7fec5ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec541e5a00 0x7fec541e5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.692+0000 7fec5ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec5415b600 con 0x7fec380042d0 2024-05-30T16:49:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.692+0000 7fec5ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec5415b320 con 0x7fec541e5a00 2024-05-30T16:49:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.692+0000 7fec5ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec540b5fb0 con 0x7fec541e5040 2024-05-30T16:49:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec58e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec541e5a00 0x7fec541e5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec53400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec541e5040 0x7fec541e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec58e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec541e5a00 0x7fec541e5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:50966/0 (socket says 172.21.15.144:50966) 2024-05-30T16:49:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec58e00640 1 -- 172.21.15.144:0/1931579060 learned_addr learned my addr 172.21.15.144:0/1931579060 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec53400640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec541e5040 0x7fec541e54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:54388/0 (socket says 172.21.15.144:54388) 2024-05-30T16:49:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec53e00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec380042d0 0x7fec540b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec53400640 1 -- 172.21.15.144:0/1931579060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec541e5a00 msgr2=0x7fec541e5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec53400640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec541e5a00 0x7fec541e5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec53400640 1 -- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec380042d0 msgr2=0x7fec540b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.693+0000 7fec53400640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec380042d0 0x7fec540b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.694+0000 7fec53400640 1 -- 172.21.15.144:0/1931579060 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5415a700 con 0x7fec541e5040 2024-05-30T16:49:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.695+0000 7fec53400640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec541e5040 0x7fec541e54c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec44032000 tx=0x7fec44004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.696+0000 7fec4be00640 1 -- 172.21.15.144:0/1931579060 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44042020 con 0x7fec541e5040 2024-05-30T16:49:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.696+0000 7fec4be00640 1 -- 172.21.15.144:0/1931579060 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4403d690 con 0x7fec541e5040 2024-05-30T16:49:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.696+0000 7fec4be00640 1 -- 172.21.15.144:0/1931579060 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44037040 con 0x7fec541e5040 2024-05-30T16:49:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.696+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec541e6550 con 0x7fec541e5040 2024-05-30T16:49:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.696+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec540b3f60 con 0x7fec541e5040 2024-05-30T16:49:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.698+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec54068b90 con 0x7fec541e5040 2024-05-30T16:49:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.700+0000 7fec4be00640 1 -- 172.21.15.144:0/1931579060 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fec44045020 con 0x7fec541e5040 2024-05-30T16:49:40.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.701+0000 7fec4be00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec3406d610 0x7fec3406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:40.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.702+0000 7fec4be00640 1 -- 172.21.15.144:0/1931579060 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7fec440abc20 con 0x7fec541e5040 2024-05-30T16:49:40.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.703+0000 7fec53e00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec3406d610 0x7fec3406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:40.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.704+0000 7fec53e00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec3406d610 0x7fec3406fad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fec400017e0 tx=0x7fec400015b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:40.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:40.710+0000 7fec4be00640 1 -- 172.21.15.144:0/1931579060 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fec4404c030 con 0x7fec541e5040 2024-05-30T16:49:41.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.090+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone56761", "target": ["mon-mgr", ""]}) -- 0x7fec54075f70 con 0x7fec3406d610 2024-05-30T16:49:41.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.111+0000 7fec4be00640 1 -- 172.21.15.144:0/1931579060 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fec40008cf0 con 0x7fec3406d610 2024-05-30T16:49:41.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec3406d610 msgr2=0x7fec3406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec3406d610 0x7fec3406fad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fec400017e0 tx=0x7fec400015b0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec541e5040 msgr2=0x7fec541e54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec541e5040 0x7fec541e54c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec44032000 tx=0x7fec44004ab0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 shutdown_connections 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fec3406d610 0x7fec3406fad0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec541e5a00 0x7fec541e5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec541e5040 0x7fec541e54c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 --2- 172.21.15.144:0/1931579060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec380042d0 0x7fec540b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 >> 172.21.15.144:0/1931579060 conn(0x7fec54070050 msgr2=0x7fec5415bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 shutdown_connections 2024-05-30T16:49:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.113+0000 7fec5ae00640 1 -- 172.21.15.144:0/1931579060 wait complete. 2024-05-30T16:49:41.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone56766 2024-05-30T16:49:41.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.308+0000 7f4e55000640 1 Processor -- start 2024-05-30T16:49:41.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.308+0000 7f4e55000640 1 -- start start 2024-05-30T16:49:41.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.310+0000 7f4e55000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e500cfc40 0x7f4e5006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.310+0000 7f4e55000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e500d00f0 con 0x7f4e5006f610 2024-05-30T16:49:41.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.310+0000 7f4e55000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e5015f390 con 0x7f4e50145150 2024-05-30T16:49:41.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.310+0000 7f4e55000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4e5006fa60 con 0x7f4e500cfc40 2024-05-30T16:49:41.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.310+0000 7f4e45400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e500cfc40 0x7f4e5006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.310+0000 7f4e4e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4e5006f610 0x7f4e500b4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44640/0 (socket says 172.21.15.144:44640) 2024-05-30T16:49:41.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.310+0000 7f4e4e800640 1 -- 172.21.15.144:0/2232450451 learned_addr learned my addr 172.21.15.144:0/2232450451 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:41.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.311+0000 7f4e45400640 1 -- 172.21.15.144:0/2232450451 >> v1:172.21.15.149:6789/0 conn(0x7f4e50145150 legacy=0x7f4e500cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:41.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.311+0000 7f4e45400640 1 -- 172.21.15.144:0/2232450451 >> v1:172.21.15.144:6789/0 conn(0x7f4e5006f610 legacy=0x7f4e500b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.311+0000 7f4e4d400640 1 -- 172.21.15.144:0/2232450451 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4132381897 0 0) 0x7f4e500d00f0 con 0x7f4e5006f610 2024-05-30T16:49:41.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.311+0000 7f4e45400640 1 -- 172.21.15.144:0/2232450451 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5015f670 con 0x7f4e500cfc40 2024-05-30T16:49:41.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.312+0000 7f4e45400640 1 --2- 172.21.15.144:0/2232450451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e500cfc40 0x7f4e5006f0d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4e380097a0 tx=0x7f4e3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20548b919bdc7105 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:41.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.312+0000 7f4e4d400640 1 -- 172.21.15.144:0/2232450451 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38037070 con 0x7f4e500cfc40 2024-05-30T16:49:41.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.312+0000 7f4e4d400640 1 -- 172.21.15.144:0/2232450451 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e38032440 con 0x7f4e500cfc40 2024-05-30T16:49:41.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.312+0000 7f4e4d400640 1 -- 172.21.15.144:0/2232450451 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38032810 con 0x7f4e500cfc40 2024-05-30T16:49:41.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.313+0000 7f4e55000640 1 -- 172.21.15.144:0/2232450451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e500cfc40 msgr2=0x7f4e5006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.313+0000 7f4e55000640 1 --2- 172.21.15.144:0/2232450451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e500cfc40 0x7f4e5006f0d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4e380097a0 tx=0x7f4e3802a1a0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.313+0000 7f4e55000640 1 -- 172.21.15.144:0/2232450451 shutdown_connections 2024-05-30T16:49:41.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.313+0000 7f4e55000640 1 --2- 172.21.15.144:0/2232450451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e500cfc40 0x7f4e5006f0d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.313+0000 7f4e55000640 1 -- 172.21.15.144:0/2232450451 >> 172.21.15.144:0/2232450451 conn(0x7f4e5006bd00 msgr2=0x7f4e5006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:41.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.313+0000 7f4e55000640 1 -- 172.21.15.144:0/2232450451 shutdown_connections 2024-05-30T16:49:41.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.313+0000 7f4e55000640 1 -- 172.21.15.144:0/2232450451 wait complete. 2024-05-30T16:49:41.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.315+0000 7f4e55000640 1 Processor -- start 2024-05-30T16:49:41.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.315+0000 7f4e55000640 1 -- start start 2024-05-30T16:49:41.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e55000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5006f610 0x7f4e500b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e55000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e500cfc40 0x7f4e50141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e55000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e50145150 0x7f4e50139950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e55000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4e500b64f0 con 0x7f4e5006f610 2024-05-30T16:49:41.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e55000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5015f140 con 0x7f4e50145150 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e55000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5015fe70 con 0x7f4e500cfc40 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5006f610 0x7f4e500b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5006f610 0x7f4e500b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56556/0 (socket says 172.21.15.144:56556) 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e4de00640 1 -- 172.21.15.144:0/960596697 learned_addr learned my addr 172.21.15.144:0/960596697 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e4de00640 1 -- 172.21.15.144:0/960596697 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e500cfc40 msgr2=0x7f4e50141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e4de00640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e500cfc40 0x7f4e50141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e4de00640 1 -- 172.21.15.144:0/960596697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e50145150 msgr2=0x7f4e50139950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e4de00640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e50145150 0x7f4e50139950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.316+0000 7f4e4de00640 1 -- 172.21.15.144:0/960596697 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e501f5b50 con 0x7f4e5006f610 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.317+0000 7f4e4de00640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5006f610 0x7f4e500b4ee0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000c400 tx=0x7f4e4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.317+0000 7f4e46a00640 1 -- 172.21.15.144:0/960596697 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40017070 con 0x7f4e5006f610 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.317+0000 7f4e46a00640 1 -- 172.21.15.144:0/960596697 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e400052d0 con 0x7f4e5006f610 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.317+0000 7f4e46a00640 1 -- 172.21.15.144:0/960596697 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40003830 con 0x7f4e5006f610 2024-05-30T16:49:41.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.317+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e50142440 con 0x7f4e5006f610 2024-05-30T16:49:41.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.317+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e501f5df0 con 0x7f4e5006f610 2024-05-30T16:49:41.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.318+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e500afe20 con 0x7f4e5006f610 2024-05-30T16:49:41.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.319+0000 7f4e46a00640 1 -- 172.21.15.144:0/960596697 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f4e4001a070 con 0x7f4e5006f610 2024-05-30T16:49:41.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.320+0000 7f4e46a00640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4e2c06d5e0 0x7f4e2c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.320+0000 7f4e46a00640 1 -- 172.21.15.144:0/960596697 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7f4e400899c0 con 0x7f4e5006f610 2024-05-30T16:49:41.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.321+0000 7f4e45400640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4e2c06d5e0 0x7f4e2c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.321+0000 7f4e45400640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4e2c06d5e0 0x7f4e2c06faa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4e38034000 tx=0x7f4e3802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.325+0000 7f4e46a00640 1 -- 172.21.15.144:0/960596697 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e500afe20 con 0x7f4e5006f610 2024-05-30T16:49:41.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.541+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone56766", "target": ["mon-mgr", ""]}) -- 0x7f4e50068b90 con 0x7f4e2c06d5e0 2024-05-30T16:49:41.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.579+0000 7f4e46a00640 1 -- 172.21.15.144:0/960596697 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4e50068b90 con 0x7f4e2c06d5e0 2024-05-30T16:49:41.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.583+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4e2c06d5e0 msgr2=0x7f4e2c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.583+0000 7f4e55000640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4e2c06d5e0 0x7f4e2c06faa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4e38034000 tx=0x7f4e3802c000 comp rx=0 tx=0).stop 2024-05-30T16:49:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.583+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5006f610 msgr2=0x7f4e500b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.583+0000 7f4e55000640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5006f610 0x7f4e500b4ee0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000c400 tx=0x7f4e4000c8c0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.584+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 shutdown_connections 2024-05-30T16:49:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.584+0000 7f4e55000640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4e2c06d5e0 0x7f4e2c06faa0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.584+0000 7f4e55000640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e50145150 0x7f4e50139950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.584+0000 7f4e55000640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e500cfc40 0x7f4e50141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.584+0000 7f4e55000640 1 --2- 172.21.15.144:0/960596697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5006f610 0x7f4e500b4ee0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.584+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 >> 172.21.15.144:0/960596697 conn(0x7f4e5006bd00 msgr2=0x7f4e500cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.584+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 shutdown_connections 2024-05-30T16:49:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.585+0000 7f4e55000640 1 -- 172.21.15.144:0/960596697 wait complete. 2024-05-30T16:49:41.612 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone56767 2024-05-30T16:49:41.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.885+0000 7fa486600640 1 Processor -- start 2024-05-30T16:49:41.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.885+0000 7fa486600640 1 -- start start 2024-05-30T16:49:41.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.887+0000 7fa486600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa480145150 0x7fa4800cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.887+0000 7fa486600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa48006f7e0 0x7fa4800b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.887+0000 7fa486600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4800d00f0 con 0x7fa4800cfa70 2024-05-30T16:49:41.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.887+0000 7fa486600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa4800cfeb0 con 0x7fa480145150 2024-05-30T16:49:41.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.887+0000 7fa486600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa48015f140 con 0x7fa48006f7e0 2024-05-30T16:49:41.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.888+0000 7fa47f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa480145150 0x7fa4800cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.888+0000 7fa47ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa4800cfa70 0x7fa48006f0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44654/0 (socket says 172.21.15.144:44654) 2024-05-30T16:49:41.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.888+0000 7fa47ea00640 1 -- 172.21.15.144:0/1198057322 learned_addr learned my addr 172.21.15.144:0/1198057322 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:41.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.888+0000 7fa47fe00640 1 --2- 172.21.15.144:0/1198057322 >> v2:172.21.15.149:3300/0 conn(0x7fa48006f7e0 0x7fa4800b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.888+0000 7fa47f400640 1 -- 172.21.15.144:0/1198057322 >> v2:172.21.15.149:3300/0 conn(0x7fa48006f7e0 msgr2=0x7fa4800b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:41.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.888+0000 7fa47f400640 1 --2- 172.21.15.144:0/1198057322 >> v2:172.21.15.149:3300/0 conn(0x7fa48006f7e0 0x7fa4800b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.888+0000 7fa47f400640 1 -- 172.21.15.144:0/1198057322 >> v1:172.21.15.144:6789/0 conn(0x7fa4800cfa70 legacy=0x7fa48006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.889+0000 7fa47f400640 1 -- 172.21.15.144:0/1198057322 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48015f390 con 0x7fa480145150 2024-05-30T16:49:41.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.890+0000 7fa47f400640 1 --2- 172.21.15.144:0/1198057322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa480145150 0x7fa4800cf530 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa48006fd50 tx=0x7fa47002c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4889220b24caf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:41.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.891+0000 7fa47e000640 1 -- 172.21.15.144:0/1198057322 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470039070 con 0x7fa480145150 2024-05-30T16:49:41.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.891+0000 7fa47e000640 1 -- 172.21.15.144:0/1198057322 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa470034640 con 0x7fa480145150 2024-05-30T16:49:41.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.891+0000 7fa47e000640 1 -- 172.21.15.144:0/1198057322 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470034a10 con 0x7fa480145150 2024-05-30T16:49:41.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.892+0000 7fa486600640 1 -- 172.21.15.144:0/1198057322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa480145150 msgr2=0x7fa4800cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.892+0000 7fa486600640 1 --2- 172.21.15.144:0/1198057322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa480145150 0x7fa4800cf530 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa48006fd50 tx=0x7fa47002c320 comp rx=0 tx=0).stop 2024-05-30T16:49:41.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.892+0000 7fa486600640 1 -- 172.21.15.144:0/1198057322 shutdown_connections 2024-05-30T16:49:41.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.892+0000 7fa486600640 1 --2- 172.21.15.144:0/1198057322 >> v2:172.21.15.149:3300/0 conn(0x7fa48006f7e0 0x7fa4800b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.892+0000 7fa486600640 1 --2- 172.21.15.144:0/1198057322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa480145150 0x7fa4800cf530 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.892+0000 7fa486600640 1 -- 172.21.15.144:0/1198057322 >> 172.21.15.144:0/1198057322 conn(0x7fa48006bd00 msgr2=0x7fa48006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:41.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.894+0000 7fa486600640 1 -- 172.21.15.144:0/1198057322 shutdown_connections 2024-05-30T16:49:41.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.895+0000 7fa486600640 1 -- 172.21.15.144:0/1198057322 wait complete. 2024-05-30T16:49:41.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.898+0000 7fa486600640 1 Processor -- start 2024-05-30T16:49:41.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.898+0000 7fa486600640 1 -- start start 2024-05-30T16:49:41.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa486600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa48006f7e0 0x7fa48015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa486600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4800cfa70 0x7fa4800cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa486600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa48015bad0 0x7fa48013c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa486600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4800b64f0 con 0x7fa4800cfa70 2024-05-30T16:49:41.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa486600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa48015f950 con 0x7fa48015bad0 2024-05-30T16:49:41.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa486600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa48015fe70 con 0x7fa48006f7e0 2024-05-30T16:49:41.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa47f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa48006f7e0 0x7fa48015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa47f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa48006f7e0 0x7fa48015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:54414/0 (socket says 172.21.15.144:54414) 2024-05-30T16:49:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa47f400640 1 -- 172.21.15.144:0/1044257153 learned_addr learned my addr 172.21.15.144:0/1044257153 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.900+0000 7fa47fe00640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa48015bad0 0x7fa48013c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.901+0000 7fa47ea00640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4800cfa70 0x7fa4800cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.901+0000 7fa47f400640 1 -- 172.21.15.144:0/1044257153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa48015bad0 msgr2=0x7fa48013c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.901+0000 7fa47f400640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa48015bad0 0x7fa48013c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.901+0000 7fa47f400640 1 -- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4800cfa70 msgr2=0x7fa4800cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.901+0000 7fa47f400640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4800cfa70 0x7fa4800cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.901+0000 7fa47f400640 1 -- 172.21.15.144:0/1044257153 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48015bfd0 con 0x7fa48006f7e0 2024-05-30T16:49:41.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.902+0000 7fa47ea00640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4800cfa70 0x7fa4800cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:41.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.902+0000 7fa47f400640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa48006f7e0 0x7fa48015b200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa4700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:41.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.904+0000 7fa477400640 1 -- 172.21.15.144:0/1044257153 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470044070 con 0x7fa48006f7e0 2024-05-30T16:49:41.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.904+0000 7fa477400640 1 -- 172.21.15.144:0/1044257153 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa470032980 con 0x7fa48006f7e0 2024-05-30T16:49:41.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.904+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48015c2b0 con 0x7fa48006f7e0 2024-05-30T16:49:41.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.904+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa48015c870 con 0x7fa48006f7e0 2024-05-30T16:49:41.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.905+0000 7fa477400640 1 -- 172.21.15.144:0/1044257153 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470039070 con 0x7fa48006f7e0 2024-05-30T16:49:41.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.907+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa480068b90 con 0x7fa48006f7e0 2024-05-30T16:49:41.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.910+0000 7fa477400640 1 -- 172.21.15.144:0/1044257153 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fa470047070 con 0x7fa48006f7e0 2024-05-30T16:49:41.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.911+0000 7fa477400640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa46006d6e0 0x7fa46006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:41.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.911+0000 7fa477400640 1 -- 172.21.15.144:0/1044257153 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7fa4700aa6a0 con 0x7fa48006f7e0 2024-05-30T16:49:41.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.912+0000 7fa47ea00640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa46006d6e0 0x7fa46006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:41.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.915+0000 7fa47ea00640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa46006d6e0 0x7fa46006fba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa4800cd260 tx=0x7fa46c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:41.920+0000 7fa477400640 1 -- 172.21.15.144:0/1044257153 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa470079ed0 con 0x7fa48006f7e0 2024-05-30T16:49:42.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.205+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone56767", "target": ["mon-mgr", ""]}) -- 0x7fa480143840 con 0x7fa46006d6e0 2024-05-30T16:49:42.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.233+0000 7fa477400640 1 -- 172.21.15.144:0/1044257153 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa480143840 con 0x7fa46006d6e0 2024-05-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa46006d6e0 msgr2=0x7fa46006fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa46006d6e0 0x7fa46006fba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa4800cd260 tx=0x7fa46c009040 comp rx=0 tx=0).stop 2024-05-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa48006f7e0 msgr2=0x7fa48015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa48006f7e0 0x7fa48015b200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa4700046c0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 shutdown_connections 2024-05-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa46006d6e0 0x7fa46006fba0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa48015bad0 0x7fa48013c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4800cfa70 0x7fa4800cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 --2- 172.21.15.144:0/1044257153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa48006f7e0 0x7fa48015b200 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.236+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 >> 172.21.15.144:0/1044257153 conn(0x7fa48006bd00 msgr2=0x7fa4800cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.237+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 shutdown_connections 2024-05-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.237+0000 7fa486600640 1 -- 172.21.15.144:0/1044257153 wait complete. 2024-05-30T16:49:42.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone56763 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.433+0000 7fb283200640 1 Processor -- start 2024-05-30T16:49:42.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.433+0000 7fb283200640 1 -- start start 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.435+0000 7fb283200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb284071d60 0x7fb2840721f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.435+0000 7fb283200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb284160b90 con 0x7fb284146010 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.435+0000 7fb283200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb284160e70 con 0x7fb2840cd8e0 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.435+0000 7fb283200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb2840cce00 con 0x7fb284071d60 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.436+0000 7fb281e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb284146010 0x7fb2841600f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44660/0 (socket says 172.21.15.144:44660) 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.436+0000 7fb281e00640 1 -- 172.21.15.144:0/775353540 learned_addr learned my addr 172.21.15.144:0/775353540 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:42.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.436+0000 7fb281400640 1 --2- 172.21.15.144:0/775353540 >> v2:172.21.15.144:3300/0 conn(0x7fb284071d60 0x7fb2840721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.436+0000 7fb280a00640 1 -- 172.21.15.144:0/775353540 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685123485 0 0) 0x7fb284160b90 con 0x7fb284146010 2024-05-30T16:49:42.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.436+0000 7fb280a00640 1 -- 172.21.15.144:0/775353540 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb264003520 con 0x7fb284146010 2024-05-30T16:49:42.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.436+0000 7fb281400640 1 -- 172.21.15.144:0/775353540 >> v1:172.21.15.149:6789/0 conn(0x7fb2840cd8e0 legacy=0x7fb2840cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:42.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.436+0000 7fb281400640 1 -- 172.21.15.144:0/775353540 >> v1:172.21.15.144:6789/0 conn(0x7fb284146010 legacy=0x7fb2841600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.436+0000 7fb281400640 1 -- 172.21.15.144:0/775353540 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2840cd0e0 con 0x7fb284071d60 2024-05-30T16:49:42.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.437+0000 7fb281400640 1 --2- 172.21.15.144:0/775353540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb284071d60 0x7fb2840721f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009d90 tx=0x7fb26c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedb389d595acd95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:42.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.437+0000 7fb280a00640 1 -- 172.21.15.144:0/775353540 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c007740 con 0x7fb284071d60 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.437+0000 7fb280a00640 1 -- 172.21.15.144:0/775353540 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c0078e0 con 0x7fb284071d60 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.437+0000 7fb280a00640 1 -- 172.21.15.144:0/775353540 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c007c90 con 0x7fb284071d60 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.438+0000 7fb283200640 1 -- 172.21.15.144:0/775353540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb284071d60 msgr2=0x7fb2840721f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.438+0000 7fb283200640 1 --2- 172.21.15.144:0/775353540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb284071d60 0x7fb2840721f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009d90 tx=0x7fb26c02a6a0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.438+0000 7fb283200640 1 -- 172.21.15.144:0/775353540 shutdown_connections 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.438+0000 7fb283200640 1 --2- 172.21.15.144:0/775353540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb284071d60 0x7fb2840721f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.438+0000 7fb283200640 1 -- 172.21.15.144:0/775353540 >> 172.21.15.144:0/775353540 conn(0x7fb2840b2160 msgr2=0x7fb2840b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.438+0000 7fb283200640 1 -- 172.21.15.144:0/775353540 shutdown_connections 2024-05-30T16:49:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.438+0000 7fb283200640 1 -- 172.21.15.144:0/775353540 wait complete. 2024-05-30T16:49:42.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.440+0000 7fb283200640 1 Processor -- start 2024-05-30T16:49:42.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.440+0000 7fb283200640 1 -- start start 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.441+0000 7fb283200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb284071d60 0x7fb28413dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.441+0000 7fb283200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840cd8e0 0x7fb28415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.441+0000 7fb283200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284146010 0x7fb2840aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.441+0000 7fb283200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb28415cd20 con 0x7fb2840cd8e0 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.441+0000 7fb283200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb284160800 con 0x7fb284146010 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.441+0000 7fb283200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb28415cea0 con 0x7fb284071d60 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.441+0000 7fb281400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840cd8e0 0x7fb28415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.441+0000 7fb281400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840cd8e0 0x7fb28415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56572/0 (socket says 172.21.15.144:56572) 2024-05-30T16:49:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.441+0000 7fb281400640 1 -- 172.21.15.144:0/3712227654 learned_addr learned my addr 172.21.15.144:0/3712227654 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:42.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb281e00640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb284071d60 0x7fb28413dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb281400640 1 -- 172.21.15.144:0/3712227654 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb284071d60 msgr2=0x7fb28413dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb281400640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb284071d60 0x7fb28413dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb281400640 1 -- 172.21.15.144:0/3712227654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284146010 msgr2=0x7fb2840aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb281400640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284146010 0x7fb2840aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb281400640 1 -- 172.21.15.144:0/3712227654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28414f740 con 0x7fb2840cd8e0 2024-05-30T16:49:42.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb281400640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840cd8e0 0x7fb28415f380 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009eb0 tx=0x7fb26c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:42.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb27a000640 1 -- 172.21.15.144:0/3712227654 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c040070 con 0x7fb2840cd8e0 2024-05-30T16:49:42.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb27a000640 1 -- 172.21.15.144:0/3712227654 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c031c40 con 0x7fb2840cd8e0 2024-05-30T16:49:42.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb27a000640 1 -- 172.21.15.144:0/3712227654 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c009450 con 0x7fb2840cd8e0 2024-05-30T16:49:42.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.442+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28414fa20 con 0x7fb2840cd8e0 2024-05-30T16:49:42.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.443+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28414ffe0 con 0x7fb2840cd8e0 2024-05-30T16:49:42.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.444+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb284075570 con 0x7fb2840cd8e0 2024-05-30T16:49:42.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.444+0000 7fb27a000640 1 -- 172.21.15.144:0/3712227654 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fb26c039040 con 0x7fb2840cd8e0 2024-05-30T16:49:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.446+0000 7fb27a000640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb26006d5e0 0x7fb26006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.446+0000 7fb27a000640 1 -- 172.21.15.144:0/3712227654 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7fb26c0abef0 con 0x7fb2840cd8e0 2024-05-30T16:49:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.446+0000 7fb281e00640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb26006d5e0 0x7fb26006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.447+0000 7fb281e00640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb26006d5e0 0x7fb26006faa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb274005880 tx=0x7fb274009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:42.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.451+0000 7fb27a000640 1 -- 172.21.15.144:0/3712227654 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb26c07b720 con 0x7fb2840cd8e0 2024-05-30T16:49:42.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.752+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone56763", "target": ["mon-mgr", ""]}) -- 0x7fb284072dc0 con 0x7fb26006d5e0 2024-05-30T16:49:42.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.794+0000 7fb27a000640 1 -- 172.21.15.144:0/3712227654 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb284072dc0 con 0x7fb26006d5e0 2024-05-30T16:49:42.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb26006d5e0 msgr2=0x7fb26006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb26006d5e0 0x7fb26006faa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb274005880 tx=0x7fb274009040 comp rx=0 tx=0).stop 2024-05-30T16:49:42.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840cd8e0 msgr2=0x7fb28415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:42.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840cd8e0 0x7fb28415f380 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009eb0 tx=0x7fb26c004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:42.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 shutdown_connections 2024-05-30T16:49:42.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb26006d5e0 0x7fb26006faa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284146010 0x7fb2840aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840cd8e0 0x7fb28415f380 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 --2- 172.21.15.144:0/3712227654 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb284071d60 0x7fb28413dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:42.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.798+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 >> 172.21.15.144:0/3712227654 conn(0x7fb2840b2160 msgr2=0x7fb2840b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:42.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.799+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 shutdown_connections 2024-05-30T16:49:42.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42.799+0000 7fb283200640 1 -- 172.21.15.144:0/3712227654 wait complete. 2024-05-30T16:49:42.828 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T16:49:42.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:49:42.981 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-05-30T16:49:42.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:49:42.996 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:49:42.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:49:43.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:49:43.242 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:49:43.243 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:49:43.243 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:49:43.243 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:43.283 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:49:43.284 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:43.364 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:49:43.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.594+0000 7f5527e00640 1 Processor -- start 2024-05-30T16:49:43.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.595+0000 7f5527e00640 1 -- start start 2024-05-30T16:49:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.596+0000 7f5527e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f552015e9a0 0x7f55200ba160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.596+0000 7f5527e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f55200d17f0 0x7f55200d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.596+0000 7f5527e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55200d2180 con 0x7f552006ce40 2024-05-30T16:49:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.596+0000 7f5527e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5520163510 con 0x7f552015e9a0 2024-05-30T16:49:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.596+0000 7f5527e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f55200b3e30 con 0x7f55200d17f0 2024-05-30T16:49:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.597+0000 7f5525400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f552015e9a0 0x7f55200ba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.597+0000 7f5525400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f552015e9a0 0x7f55200ba160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56580/0 (socket says 172.21.15.144:56580) 2024-05-30T16:49:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.597+0000 7f5525400640 1 -- 172.21.15.144:0/2018554631 learned_addr learned my addr 172.21.15.144:0/2018554631 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.598+0000 7f5525400640 1 -- 172.21.15.144:0/2018554631 >> v2:172.21.15.149:3300/0 conn(0x7f55200d17f0 msgr2=0x7f55200d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.598+0000 7f5525400640 1 --2- 172.21.15.144:0/2018554631 >> v2:172.21.15.149:3300/0 conn(0x7f55200d17f0 0x7f55200d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.598+0000 7f5525400640 1 -- 172.21.15.144:0/2018554631 >> v1:172.21.15.149:6789/0 conn(0x7f552006ce40 legacy=0x7f552006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.598+0000 7f5525400640 1 -- 172.21.15.144:0/2018554631 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5520162620 con 0x7f552015e9a0 2024-05-30T16:49:43.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.599+0000 7f5525400640 1 --2- 172.21.15.144:0/2018554631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f552015e9a0 0x7f55200ba160 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f55200b4300 tx=0x7f551402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c8c3e246479d2d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:43.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.600+0000 7f551fe00640 1 -- 172.21.15.144:0/2018554631 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514037070 con 0x7f552015e9a0 2024-05-30T16:49:43.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.600+0000 7f551fe00640 1 -- 172.21.15.144:0/2018554631 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514032440 con 0x7f552015e9a0 2024-05-30T16:49:43.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.600+0000 7f551fe00640 1 -- 172.21.15.144:0/2018554631 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514032810 con 0x7f552015e9a0 2024-05-30T16:49:43.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.601+0000 7f5527e00640 1 -- 172.21.15.144:0/2018554631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f552015e9a0 msgr2=0x7f55200ba160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.601+0000 7f5527e00640 1 --2- 172.21.15.144:0/2018554631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f552015e9a0 0x7f55200ba160 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f55200b4300 tx=0x7f551402a2c0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.601+0000 7f5527e00640 1 -- 172.21.15.144:0/2018554631 shutdown_connections 2024-05-30T16:49:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.601+0000 7f5527e00640 1 --2- 172.21.15.144:0/2018554631 >> v2:172.21.15.149:3300/0 conn(0x7f55200d17f0 0x7f55200d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.601+0000 7f5527e00640 1 --2- 172.21.15.144:0/2018554631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f552015e9a0 0x7f55200ba160 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.601+0000 7f5527e00640 1 -- 172.21.15.144:0/2018554631 >> 172.21.15.144:0/2018554631 conn(0x7f55200b67e0 msgr2=0x7f55200b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.603+0000 7f5527e00640 1 -- 172.21.15.144:0/2018554631 shutdown_connections 2024-05-30T16:49:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.603+0000 7f5527e00640 1 -- 172.21.15.144:0/2018554631 wait complete. 2024-05-30T16:49:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.606+0000 7f5527e00640 1 Processor -- start 2024-05-30T16:49:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.606+0000 7f5527e00640 1 -- start start 2024-05-30T16:49:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5527e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f552006ce40 0x7f55201f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5527e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55200d17f0 0x7f55200c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5527e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55201f5df0 0x7f55200c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5527e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5520162ec0 con 0x7f55200d17f0 2024-05-30T16:49:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5527e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5520162be0 con 0x7f552006ce40 2024-05-30T16:49:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5527e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f55201631a0 con 0x7f55201f5df0 2024-05-30T16:49:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5524a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55200d17f0 0x7f55200c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5524a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55200d17f0 0x7f55200c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56586/0 (socket says 172.21.15.144:56586) 2024-05-30T16:49:43.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5524a00640 1 -- 172.21.15.144:0/2224351015 learned_addr learned my addr 172.21.15.144:0/2224351015 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:43.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.608+0000 7f5525400640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f552006ce40 0x7f55201f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.609+0000 7f5525e00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55201f5df0 0x7f55200c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.609+0000 7f5524a00640 1 -- 172.21.15.144:0/2224351015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55201f5df0 msgr2=0x7f55200c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.609+0000 7f5524a00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55201f5df0 0x7f55200c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.609+0000 7f5524a00640 1 -- 172.21.15.144:0/2224351015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f552006ce40 msgr2=0x7f55201f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:43.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.609+0000 7f5524a00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f552006ce40 0x7f55201f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:43.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.609+0000 7f5524a00640 1 -- 172.21.15.144:0/2224351015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55200c83e0 con 0x7f55200d17f0 2024-05-30T16:49:43.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.609+0000 7f5525e00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55201f5df0 0x7f55200c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:43.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.609+0000 7f5524a00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55200d17f0 0x7f55200c9480 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f550c00b470 tx=0x7f550c00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:43.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.610+0000 7f551d600640 1 -- 172.21.15.144:0/2224351015 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c015020 con 0x7f55200d17f0 2024-05-30T16:49:43.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.610+0000 7f551d600640 1 -- 172.21.15.144:0/2224351015 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c011830 con 0x7f55200d17f0 2024-05-30T16:49:43.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.610+0000 7f551d600640 1 -- 172.21.15.144:0/2224351015 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c011c20 con 0x7f55200d17f0 2024-05-30T16:49:43.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.611+0000 7f5527e00640 1 -- 172.21.15.144:0/2224351015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55200c86c0 con 0x7f55200d17f0 2024-05-30T16:49:43.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.611+0000 7f5527e00640 1 -- 172.21.15.144:0/2224351015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55200c8c80 con 0x7f55200d17f0 2024-05-30T16:49:43.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.613+0000 7f5512a00640 1 -- 172.21.15.144:0/2224351015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5520068b20 con 0x7f55200d17f0 2024-05-30T16:49:43.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.614+0000 7f551d600640 1 -- 172.21.15.144:0/2224351015 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f550c018020 con 0x7f55200d17f0 2024-05-30T16:49:43.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.615+0000 7f551d600640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f550006d610 0x7f550006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:43.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.615+0000 7f551d600640 1 -- 172.21.15.144:0/2224351015 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7f550c08a4b0 con 0x7f55200d17f0 2024-05-30T16:49:43.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.616+0000 7f5525400640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f550006d610 0x7f550006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:43.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.617+0000 7f5525400640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f550006d610 0x7f550006fad0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5514034000 tx=0x7f551402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:43.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:43.622+0000 7f551d600640 1 -- 172.21.15.144:0/2224351015 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f550c01f020 con 0x7f55200d17f0 2024-05-30T16:49:44.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.005+0000 7f5512a00640 1 -- 172.21.15.144:0/2224351015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f55200d2480 con 0x7f55200d17f0 2024-05-30T16:49:44.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.006+0000 7f551d600640 1 -- 172.21.15.144:0/2224351015 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) ==== 80+0+0 (secure 0 0 0) 0x7f550c0172c0 con 0x7f55200d17f0 2024-05-30T16:49:44.007 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-05-30T16:49:44.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.009+0000 7f5512a00640 1 -- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f550006d610 msgr2=0x7f550006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.009+0000 7f5512a00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f550006d610 0x7f550006fad0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5514034000 tx=0x7f551402e000 comp rx=0 tx=0).stop 2024-05-30T16:49:44.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.010+0000 7f5512a00640 1 -- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55200d17f0 msgr2=0x7f55200c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.010+0000 7f5512a00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55200d17f0 0x7f55200c9480 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f550c00b470 tx=0x7f550c00b930 comp rx=0 tx=0).stop 2024-05-30T16:49:44.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.010+0000 7f5512a00640 1 -- 172.21.15.144:0/2224351015 shutdown_connections 2024-05-30T16:49:44.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.010+0000 7f5512a00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f550006d610 0x7f550006fad0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.010+0000 7f5512a00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55201f5df0 0x7f55200c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.010+0000 7f5512a00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55200d17f0 0x7f55200c9480 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.010+0000 7f5512a00640 1 --2- 172.21.15.144:0/2224351015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f552006ce40 0x7f55201f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.010+0000 7f5512a00640 1 -- 172.21.15.144:0/2224351015 >> 172.21.15.144:0/2224351015 conn(0x7f55200b67e0 msgr2=0x7f55200b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:44.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.011+0000 7f5512a00640 1 -- 172.21.15.144:0/2224351015 shutdown_connections 2024-05-30T16:49:44.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.012+0000 7f5512a00640 1 -- 172.21.15.144:0/2224351015 wait complete. 2024-05-30T16:49:44.041 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T16:49:44.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:44.042 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T16:49:44.163 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:49:44.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:49:44.163 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:49:44.234 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:49:44.234 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:49:44.235 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:44.294 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:49:44.294 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:49:44.294 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:49:44.294 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:44.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:49:44.342 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T16:49:44.342 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:49:44.342 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:44.382 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:49:44.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:44.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.546+0000 7f18bb000640 1 Processor -- start 2024-05-30T16:49:44.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.546+0000 7f18bb000640 1 -- start start 2024-05-30T16:49:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.547+0000 7f18bb000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18b40caf10 0x7f18b415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.547+0000 7f18bb000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f18b40cf8b0 0x7f18b40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.547+0000 7f18bb000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b415f500 con 0x7f18b40cb2f0 2024-05-30T16:49:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.547+0000 7f18bb000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f18b415f780 con 0x7f18b40caf10 2024-05-30T16:49:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.547+0000 7f18bb000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f18b415fa60 con 0x7f18b40cf8b0 2024-05-30T16:49:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.547+0000 7f18b9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18b40caf10 0x7f18b415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.547+0000 7f18b9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18b40caf10 0x7f18b415efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56596/0 (socket says 172.21.15.144:56596) 2024-05-30T16:49:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.547+0000 7f18b9c00640 1 -- 172.21.15.144:0/924097770 learned_addr learned my addr 172.21.15.144:0/924097770 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.548+0000 7f18b9c00640 1 -- 172.21.15.144:0/924097770 >> v2:172.21.15.149:3300/0 conn(0x7f18b40cf8b0 msgr2=0x7f18b40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.548+0000 7f18b9c00640 1 --2- 172.21.15.144:0/924097770 >> v2:172.21.15.149:3300/0 conn(0x7f18b40cf8b0 0x7f18b40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.548+0000 7f18b9c00640 1 -- 172.21.15.144:0/924097770 >> v1:172.21.15.149:6789/0 conn(0x7f18b40cb2f0 legacy=0x7f18b415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.548+0000 7f18b9c00640 1 -- 172.21.15.144:0/924097770 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b415fd40 con 0x7f18b40caf10 2024-05-30T16:49:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.549+0000 7f18b9c00640 1 --2- 172.21.15.144:0/924097770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40caf10 0x7f18b415efc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f18b40ce1f0 tx=0x7f18a802c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c352ff4feeaec77 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.549+0000 7f18b3e00640 1 -- 172.21.15.144:0/924097770 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8038070 con 0x7f18b40caf10 2024-05-30T16:49:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.549+0000 7f18b3e00640 1 -- 172.21.15.144:0/924097770 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a8031710 con 0x7f18b40caf10 2024-05-30T16:49:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.549+0000 7f18b3e00640 1 -- 172.21.15.144:0/924097770 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8031ae0 con 0x7f18b40caf10 2024-05-30T16:49:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.550+0000 7f18bb000640 1 -- 172.21.15.144:0/924097770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40caf10 msgr2=0x7f18b415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.550+0000 7f18bb000640 1 --2- 172.21.15.144:0/924097770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40caf10 0x7f18b415efc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f18b40ce1f0 tx=0x7f18a802c440 comp rx=0 tx=0).stop 2024-05-30T16:49:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.550+0000 7f18bb000640 1 -- 172.21.15.144:0/924097770 shutdown_connections 2024-05-30T16:49:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.550+0000 7f18bb000640 1 --2- 172.21.15.144:0/924097770 >> v2:172.21.15.149:3300/0 conn(0x7f18b40cf8b0 0x7f18b40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.550+0000 7f18bb000640 1 --2- 172.21.15.144:0/924097770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40caf10 0x7f18b415efc0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.550+0000 7f18bb000640 1 -- 172.21.15.144:0/924097770 >> 172.21.15.144:0/924097770 conn(0x7f18b40b20a0 msgr2=0x7f18b40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:44.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.550+0000 7f18bb000640 1 -- 172.21.15.144:0/924097770 shutdown_connections 2024-05-30T16:49:44.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.550+0000 7f18bb000640 1 -- 172.21.15.144:0/924097770 wait complete. 2024-05-30T16:49:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.551+0000 7f18bb000640 1 Processor -- start 2024-05-30T16:49:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.551+0000 7f18bb000640 1 -- start start 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.552+0000 7f18bb000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b40caf10 0x7f18b4148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.552+0000 7f18bb000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b40cb2f0 0x7f18b40ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.552+0000 7f18bb000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40cf8b0 0x7f18b41e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.552+0000 7f18bb000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f18b415bad0 con 0x7f18b40cf8b0 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.552+0000 7f18bb000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f18b415b950 con 0x7f18b40cb2f0 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.552+0000 7f18bb000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f18b40b3700 con 0x7f18b40caf10 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18ba600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40cf8b0 0x7f18b41e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18ba600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40cf8b0 0x7f18b41e57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56600/0 (socket says 172.21.15.144:56600) 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18ba600640 1 -- 172.21.15.144:0/64719975 learned_addr learned my addr 172.21.15.144:0/64719975 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18b9c00640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b40caf10 0x7f18b4148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18b9200640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b40cb2f0 0x7f18b40ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18ba600640 1 -- 172.21.15.144:0/64719975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b40caf10 msgr2=0x7f18b4148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18ba600640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b40caf10 0x7f18b4148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18ba600640 1 -- 172.21.15.144:0/64719975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b40cb2f0 msgr2=0x7f18b40ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18ba600640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b40cb2f0 0x7f18b40ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18ba600640 1 -- 172.21.15.144:0/64719975 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b41f1c60 con 0x7f18b40cf8b0 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18b9c00640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b40caf10 0x7f18b4148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.553+0000 7f18ba600640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40cf8b0 0x7f18b41e57f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b970 tx=0x7f18ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.554+0000 7f18b1600640 1 -- 172.21.15.144:0/64719975 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac019070 con 0x7f18b40cf8b0 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.554+0000 7f18b1600640 1 -- 172.21.15.144:0/64719975 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac00cb60 con 0x7f18b40cf8b0 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.554+0000 7f18b1600640 1 -- 172.21.15.144:0/64719975 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac014440 con 0x7f18b40cf8b0 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.554+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b41f1f40 con 0x7f18b40cf8b0 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.554+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b41f2500 con 0x7f18b40cf8b0 2024-05-30T16:49:44.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.555+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b4075570 con 0x7f18b40cf8b0 2024-05-30T16:49:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.556+0000 7f18b1600640 1 -- 172.21.15.144:0/64719975 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f18ac01c070 con 0x7f18b40cf8b0 2024-05-30T16:49:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.557+0000 7f18b1600640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f189406d5e0 0x7f189406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.557+0000 7f18b1600640 1 -- 172.21.15.144:0/64719975 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7f18ac08a2a0 con 0x7f18b40cf8b0 2024-05-30T16:49:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.557+0000 7f18b9c00640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f189406d5e0 0x7f189406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.558+0000 7f18b9c00640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f189406d5e0 0x7f189406faa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f18a8035000 tx=0x7f18a8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.561+0000 7f18b1600640 1 -- 172.21.15.144:0/64719975 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f18ac05a180 con 0x7f18b40cf8b0 2024-05-30T16:49:44.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.897+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18b40b5000 con 0x7f18b40cf8b0 2024-05-30T16:49:44.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.898+0000 7f18b1600640 1 -- 172.21.15.144:0/64719975 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5193 (secure 0 0 0) 0x7f18ac059a80 con 0x7f18b40cf8b0 2024-05-30T16:49:44.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:44.899 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/4221007288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4221007288},{"type":"v1","addr":"172.21.15.144:6837","nonce":4221007288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5155,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/2104436930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2104436930},{"type":"v1","addr":"172.21.15.149:6833","nonce":2104436930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2742911992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2742911992},{"type":"v1","addr":"172.21.15.149:6835","nonce":2742911992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:47:58.808544+0000","modified":"2024-05-30T16:48:01.886903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5808":{"gid":5808,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4146621541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4146621541},{"type":"v1","addr":"172.21.15.144:6835","nonce":4146621541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5808,"qdb_cluster":[5808]},"id":4}]} 2024-05-30T16:49:44.900 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 36 2024-05-30T16:49:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f189406d5e0 msgr2=0x7f189406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f189406d5e0 0x7f189406faa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f18a8035000 tx=0x7f18a8008030 comp rx=0 tx=0).stop 2024-05-30T16:49:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40cf8b0 msgr2=0x7f18b41e57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40cf8b0 0x7f18b41e57f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b970 tx=0x7f18ac00be30 comp rx=0 tx=0).stop 2024-05-30T16:49:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 shutdown_connections 2024-05-30T16:49:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f189406d5e0 0x7f189406faa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18b40cf8b0 0x7f18b41e57f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b40cb2f0 0x7f18b40ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 --2- 172.21.15.144:0/64719975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b40caf10 0x7f18b4148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:44.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.900+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 >> 172.21.15.144:0/64719975 conn(0x7f18b40b20a0 msgr2=0x7f18b40cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:44.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.901+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 shutdown_connections 2024-05-30T16:49:44.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:44.901+0000 7f18bb000640 1 -- 172.21.15.144:0/64719975 wait complete. 2024-05-30T16:49:44.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:45.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.090+0000 7fbdabe00640 1 Processor -- start 2024-05-30T16:49:45.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.090+0000 7fbdabe00640 1 -- start start 2024-05-30T16:49:45.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.091+0000 7fbdabe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac0caf10 0x7fbdac15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.091+0000 7fbdabe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdac15f500 con 0x7fbdac0cb2f0 2024-05-30T16:49:45.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.091+0000 7fbdabe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdac15f780 con 0x7fbdac0cf8b0 2024-05-30T16:49:45.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.091+0000 7fbdabe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbdac15fa60 con 0x7fbdac0caf10 2024-05-30T16:49:45.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbda3e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbdac0cb2f0 0x7fbdac15c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50768/0 (socket says 172.21.15.144:50768) 2024-05-30T16:49:45.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbda3e00640 1 -- 172.21.15.144:0/2864408762 learned_addr learned my addr 172.21.15.144:0/2864408762 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:45.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230920725 0 0) 0x7fbd94001110 con 0x7fbdac0cb2f0 2024-05-30T16:49:45.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaaa00640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac0caf10 0x7fbdac15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd90005730 con 0x7fbdac0cb2f0 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3820280147 0 0) 0x7fbd90005730 con 0x7fbdac0cb2f0 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac0caf10 msgr2=0x7fbdac15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac0caf10 0x7fbdac15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 >> v1:172.21.15.149:6789/0 conn(0x7fbdac0cf8b0 legacy=0x7fbdac0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac15fd40 con 0x7fbdac0cb2f0 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fbd94001840 con 0x7fbdac0cb2f0 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 >> v1:172.21.15.144:6789/0 conn(0x7fbdac0cb2f0 legacy=0x7fbdac15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90005bf0 0x7fbd90006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac0caf10 0x7fbd90006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbd900073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac15fa60 con 0x7fbd90006f50 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.092+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9000dd60 con 0x7fbd90005bf0 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.093+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9000df30 con 0x7fbdac0caf10 2024-05-30T16:49:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.093+0000 7fbdab400640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbd900073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.093+0000 7fbdaaa00640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90005bf0 0x7fbd90006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.093+0000 7fbdab400640 1 -- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac0caf10 msgr2=0x7fbd90006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.093+0000 7fbdab400640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac0caf10 0x7fbd90006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.093+0000 7fbdab400640 1 -- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90005bf0 msgr2=0x7fbd90006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.093+0000 7fbdab400640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90005bf0 0x7fbd90006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.093+0000 7fbdab400640 1 -- 172.21.15.144:0/2864408762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd90005730 con 0x7fbd90006f50 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.093+0000 7fbdaaa00640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90005bf0 0x7fbd90006010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.094+0000 7fbdab400640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbd900073d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbda4001e80 tx=0x7fbd90007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2545766b542270 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.094+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda4001a70 con 0x7fbd90006f50 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.094+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda402ae50 con 0x7fbd90006f50 2024-05-30T16:49:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.094+0000 7fbdaa000640 1 -- 172.21.15.144:0/2864408762 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda4003bb0 con 0x7fbd90006f50 2024-05-30T16:49:45.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.095+0000 7fbdabe00640 1 -- 172.21.15.144:0/2864408762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 msgr2=0x7fbd900073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.095+0000 7fbdabe00640 1 --2- 172.21.15.144:0/2864408762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbd900073d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbda4001e80 tx=0x7fbd90007a40 comp rx=0 tx=0).stop 2024-05-30T16:49:45.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.095+0000 7fbdab400640 1 -- 172.21.15.144:0/2864408762 reap_dead start 2024-05-30T16:49:45.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.095+0000 7fbdabe00640 1 -- 172.21.15.144:0/2864408762 shutdown_connections 2024-05-30T16:49:45.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.095+0000 7fbdabe00640 1 -- 172.21.15.144:0/2864408762 >> 172.21.15.144:0/2864408762 conn(0x7fbdac0b20a0 msgr2=0x7fbdac0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.095+0000 7fbdabe00640 1 -- 172.21.15.144:0/2864408762 shutdown_connections 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.095+0000 7fbdabe00640 1 -- 172.21.15.144:0/2864408762 wait complete. 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.097+0000 7fbdabe00640 1 Processor -- start 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.097+0000 7fbdabe00640 1 -- start start 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdabe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbdac145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdabe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac073740 0x7fbdac073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdabe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdac06f040 0x7fbdac06f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdabe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac15bad0 con 0x7fbd90006f50 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdabe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac15b950 con 0x7fbdac06f040 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdabe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbdac0b38d0 con 0x7fbdac073740 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdaaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbdac145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdaaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbdac145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36954/0 (socket says 172.21.15.144:36954) 2024-05-30T16:49:45.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdaaa00640 1 -- 172.21.15.144:0/2143351050 learned_addr learned my addr 172.21.15.144:0/2143351050 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdaaa00640 1 -- 172.21.15.144:0/2143351050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac073740 msgr2=0x7fbdac073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdaaa00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac073740 0x7fbdac073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdaaa00640 1 -- 172.21.15.144:0/2143351050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdac06f040 msgr2=0x7fbdac06f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdab400640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdac06f040 0x7fbdac06f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdaaa00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdac06f040 0x7fbdac06f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.098+0000 7fbdaaa00640 1 -- 172.21.15.144:0/2143351050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac152370 con 0x7fbd90006f50 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.099+0000 7fbdaaa00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbdac145560 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00e810 tx=0x7fbd9c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.099+0000 7fbda2a00640 1 -- 172.21.15.144:0/2143351050 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c017070 con 0x7fbd90006f50 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.099+0000 7fbda2a00640 1 -- 172.21.15.144:0/2143351050 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9c004020 con 0x7fbd90006f50 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.099+0000 7fbda2a00640 1 -- 172.21.15.144:0/2143351050 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00f040 con 0x7fbd90006f50 2024-05-30T16:49:45.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.099+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdac151db0 con 0x7fbd90006f50 2024-05-30T16:49:45.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.099+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdac0ad2d0 con 0x7fbd90006f50 2024-05-30T16:49:45.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.100+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdac075570 con 0x7fbd90006f50 2024-05-30T16:49:45.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.101+0000 7fbda2a00640 1 -- 172.21.15.144:0/2143351050 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fbd9c00c670 con 0x7fbd90006f50 2024-05-30T16:49:45.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.102+0000 7fbda2a00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbd8806d5e0 0x7fbd8806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.102+0000 7fbda2a00640 1 -- 172.21.15.144:0/2143351050 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7fbd9c08a0b0 con 0x7fbd90006f50 2024-05-30T16:49:45.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.102+0000 7fbda3e00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbd8806d5e0 0x7fbd8806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.103+0000 7fbda3e00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbd8806d5e0 0x7fbd8806faa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbd94001eb0 tx=0x7fbd940011e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.106+0000 7fbda2a00640 1 -- 172.21.15.144:0/2143351050 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbdac152370 con 0x7fbd90006f50 2024-05-30T16:49:45.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.326+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdac0b5000 con 0x7fbd90006f50 2024-05-30T16:49:45.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.327+0000 7fbda2a00640 1 -- 172.21.15.144:0/2143351050 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5193 (secure 0 0 0) 0x7fbd9c059f90 con 0x7fbd90006f50 2024-05-30T16:49:45.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:45.329 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/4221007288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4221007288},{"type":"v1","addr":"172.21.15.144:6837","nonce":4221007288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5155,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/2104436930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2104436930},{"type":"v1","addr":"172.21.15.149:6833","nonce":2104436930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2742911992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2742911992},{"type":"v1","addr":"172.21.15.149:6835","nonce":2742911992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:47:58.808544+0000","modified":"2024-05-30T16:48:01.886903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5808":{"gid":5808,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4146621541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4146621541},{"type":"v1","addr":"172.21.15.144:6835","nonce":4146621541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5808,"qdb_cluster":[5808]},"id":4}]} 2024-05-30T16:49:45.329 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 36 2024-05-30T16:49:45.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbd8806d5e0 msgr2=0x7fbd8806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbd8806d5e0 0x7fbd8806faa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbd94001eb0 tx=0x7fbd940011e0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 msgr2=0x7fbdac145560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbdac145560 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00e810 tx=0x7fbd9c00ecd0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 shutdown_connections 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbd8806d5e0 0x7fbd8806faa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdac06f040 0x7fbdac06f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdac073740 0x7fbdac073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 --2- 172.21.15.144:0/2143351050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd90006f50 0x7fbdac145560 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 >> 172.21.15.144:0/2143351050 conn(0x7fbdac0b20a0 msgr2=0x7fbdac15d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 shutdown_connections 2024-05-30T16:49:45.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.330+0000 7fbdabe00640 1 -- 172.21.15.144:0/2143351050 wait complete. 2024-05-30T16:49:45.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:45.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.534+0000 7fa815200640 1 Processor -- start 2024-05-30T16:49:45.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.534+0000 7fa815200640 1 -- start start 2024-05-30T16:49:45.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.536+0000 7fa815200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa81013f760 0x7fa81006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.536+0000 7fa815200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa81006ee80 con 0x7fa8100b5fd0 2024-05-30T16:49:45.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.536+0000 7fa815200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa810160730 con 0x7fa8100cec70 2024-05-30T16:49:45.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.536+0000 7fa815200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa8101612b0 con 0x7fa81013f760 2024-05-30T16:49:45.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.536+0000 7fa80de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa81013f760 0x7fa81006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.536+0000 7fa80e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa8100b5fd0 0x7fa810142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50784/0 (socket says 172.21.15.144:50784) 2024-05-30T16:49:45.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.536+0000 7fa80e800640 1 -- 172.21.15.144:0/740403725 learned_addr learned my addr 172.21.15.144:0/740403725 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:45.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.536+0000 7fa80ca00640 1 -- 172.21.15.144:0/740403725 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673544963 0 0) 0x7fa81006ee80 con 0x7fa8100b5fd0 2024-05-30T16:49:45.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.537+0000 7fa80ca00640 1 -- 172.21.15.144:0/740403725 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f4003520 con 0x7fa8100b5fd0 2024-05-30T16:49:45.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.537+0000 7fa80de00640 1 -- 172.21.15.144:0/740403725 >> v1:172.21.15.149:6789/0 conn(0x7fa8100cec70 legacy=0x7fa8100b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:45.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.537+0000 7fa80de00640 1 -- 172.21.15.144:0/740403725 >> v1:172.21.15.144:6789/0 conn(0x7fa8100b5fd0 legacy=0x7fa810142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.537+0000 7fa80de00640 1 -- 172.21.15.144:0/740403725 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa810160a10 con 0x7fa81013f760 2024-05-30T16:49:45.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.538+0000 7fa80de00640 1 --2- 172.21.15.144:0/740403725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa81013f760 0x7fa81006e940 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa8000097a0 tx=0x7fa80002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb515acaa73505a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.538+0000 7fa80ca00640 1 -- 172.21.15.144:0/740403725 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800037070 con 0x7fa81013f760 2024-05-30T16:49:45.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.538+0000 7fa80ca00640 1 -- 172.21.15.144:0/740403725 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa800032440 con 0x7fa81013f760 2024-05-30T16:49:45.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.538+0000 7fa80ca00640 1 -- 172.21.15.144:0/740403725 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8000327f0 con 0x7fa81013f760 2024-05-30T16:49:45.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.539+0000 7fa815200640 1 -- 172.21.15.144:0/740403725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa81013f760 msgr2=0x7fa81006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.539+0000 7fa815200640 1 --2- 172.21.15.144:0/740403725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa81013f760 0x7fa81006e940 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa8000097a0 tx=0x7fa80002a1e0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.539+0000 7fa815200640 1 -- 172.21.15.144:0/740403725 shutdown_connections 2024-05-30T16:49:45.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.539+0000 7fa815200640 1 --2- 172.21.15.144:0/740403725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa81013f760 0x7fa81006e940 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.539+0000 7fa815200640 1 -- 172.21.15.144:0/740403725 >> 172.21.15.144:0/740403725 conn(0x7fa81006bd00 msgr2=0x7fa81006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:45.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.539+0000 7fa815200640 1 -- 172.21.15.144:0/740403725 shutdown_connections 2024-05-30T16:49:45.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.539+0000 7fa815200640 1 -- 172.21.15.144:0/740403725 wait complete. 2024-05-30T16:49:45.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.540+0000 7fa815200640 1 Processor -- start 2024-05-30T16:49:45.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.541+0000 7fa815200640 1 -- start start 2024-05-30T16:49:45.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.541+0000 7fa815200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8100b5fd0 0x7fa8101e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.541+0000 7fa815200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8100cec70 0x7fa810153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.541+0000 7fa815200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa81013f760 0x7fa810153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.541+0000 7fa815200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa810160fd0 con 0x7fa8100b5fd0 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.541+0000 7fa815200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8100cf0d0 con 0x7fa8100cec70 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.541+0000 7fa815200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8100cf250 con 0x7fa81013f760 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.542+0000 7fa80de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8100b5fd0 0x7fa8101e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.542+0000 7fa80de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8100b5fd0 0x7fa8101e6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36960/0 (socket says 172.21.15.144:36960) 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.542+0000 7fa80de00640 1 -- 172.21.15.144:0/1346417608 learned_addr learned my addr 172.21.15.144:0/1346417608 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.542+0000 7fa80de00640 1 -- 172.21.15.144:0/1346417608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa81013f760 msgr2=0x7fa810153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.542+0000 7fa80de00640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa81013f760 0x7fa810153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.542+0000 7fa80de00640 1 -- 172.21.15.144:0/1346417608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8100cec70 msgr2=0x7fa810153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.542+0000 7fa80de00640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8100cec70 0x7fa810153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.542+0000 7fa80de00640 1 -- 172.21.15.144:0/1346417608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81013eda0 con 0x7fa8100b5fd0 2024-05-30T16:49:45.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.542+0000 7fa80de00640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8100b5fd0 0x7fa8101e6190 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa800000c00 tx=0x7fa8000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.543+0000 7fa806000640 1 -- 172.21.15.144:0/1346417608 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800037040 con 0x7fa8100b5fd0 2024-05-30T16:49:45.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.543+0000 7fa806000640 1 -- 172.21.15.144:0/1346417608 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa800042070 con 0x7fa8100b5fd0 2024-05-30T16:49:45.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.543+0000 7fa806000640 1 -- 172.21.15.144:0/1346417608 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800030900 con 0x7fa8100b5fd0 2024-05-30T16:49:45.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.543+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8101e66d0 con 0x7fa8100b5fd0 2024-05-30T16:49:45.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.543+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8101295a0 con 0x7fa8100b5fd0 2024-05-30T16:49:45.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.544+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa810160100 con 0x7fa8100b5fd0 2024-05-30T16:49:45.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.545+0000 7fa806000640 1 -- 172.21.15.144:0/1346417608 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fa800030aa0 con 0x7fa8100b5fd0 2024-05-30T16:49:45.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.545+0000 7fa806000640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa7f006d5e0 0x7fa7f006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:45.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.546+0000 7fa806000640 1 -- 172.21.15.144:0/1346417608 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7fa8000ab230 con 0x7fa8100b5fd0 2024-05-30T16:49:45.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.546+0000 7fa80d400640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa7f006d5e0 0x7fa7f006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:45.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.546+0000 7fa80d400640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa7f006d5e0 0x7fa7f006faa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8101eb430 tx=0x7fa7fc0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:45.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.550+0000 7fa806000640 1 -- 172.21.15.144:0/1346417608 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa810160100 con 0x7fa8100b5fd0 2024-05-30T16:49:45.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.903+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa810068b90 con 0x7fa8100b5fd0 2024-05-30T16:49:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.905+0000 7fa806000640 1 -- 172.21.15.144:0/1346417608 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16853 (secure 0 0 0) 0x7fa800045360 con 0x7fa8100b5fd0 2024-05-30T16:49:45.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:45.907 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":60,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:49:38.972320+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:47:56.670101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:47:57.798316+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":60,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:45.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.909+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa7f006d5e0 msgr2=0x7fa7f006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.909+0000 7fa815200640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa7f006d5e0 0x7fa7f006faa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8101eb430 tx=0x7fa7fc0079b0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.909+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8100b5fd0 msgr2=0x7fa8101e6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:45.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.909+0000 7fa815200640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8100b5fd0 0x7fa8101e6190 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa800000c00 tx=0x7fa8000046c0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.910+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 shutdown_connections 2024-05-30T16:49:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.910+0000 7fa815200640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa7f006d5e0 0x7fa7f006faa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.910+0000 7fa815200640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa81013f760 0x7fa810153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.910+0000 7fa815200640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8100cec70 0x7fa810153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.910+0000 7fa815200640 1 --2- 172.21.15.144:0/1346417608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8100b5fd0 0x7fa8101e6190 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.910+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 >> 172.21.15.144:0/1346417608 conn(0x7fa81006bd00 msgr2=0x7fa810141710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:45.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.911+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 shutdown_connections 2024-05-30T16:49:45.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:45.912+0000 7fa815200640 1 -- 172.21.15.144:0/1346417608 wait complete. 2024-05-30T16:49:45.941 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:49:45.941 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:46.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.134+0000 7f449d200640 1 Processor -- start 2024-05-30T16:49:46.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.134+0000 7f449d200640 1 -- start start 2024-05-30T16:49:46.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.135+0000 7f449d200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4498145150 0x7f44980cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.135+0000 7f449d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44980cfa70 0x7f449806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.135+0000 7f449d200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44980d00f0 con 0x7f449806f610 2024-05-30T16:49:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.135+0000 7f449d200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f44980cfeb0 con 0x7f4498145150 2024-05-30T16:49:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.135+0000 7f449d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f449815f140 con 0x7f44980cfa70 2024-05-30T16:49:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.136+0000 7f4495e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4498145150 0x7f44980cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.136+0000 7f4495400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44980cfa70 0x7f449806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.136+0000 7f4495e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4498145150 0x7f44980cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:49182/0 (socket says 172.21.15.144:49182) 2024-05-30T16:49:46.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.136+0000 7f4495e00640 1 -- 172.21.15.144:0/1782483186 learned_addr learned my addr 172.21.15.144:0/1782483186 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:46.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.137+0000 7f4495e00640 1 -- 172.21.15.144:0/1782483186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44980cfa70 msgr2=0x7f449806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:46.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.137+0000 7f4495e00640 1 --2- 172.21.15.144:0/1782483186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44980cfa70 0x7f449806f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.137+0000 7f4495e00640 1 -- 172.21.15.144:0/1782483186 >> v1:172.21.15.149:6789/0 conn(0x7f449806f610 legacy=0x7f4498072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.137+0000 7f4495e00640 1 -- 172.21.15.144:0/1782483186 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449815f390 con 0x7f4498145150 2024-05-30T16:49:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.138+0000 7f4495e00640 1 --2- 172.21.15.144:0/1782483186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4498145150 0x7f44980cf530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4488009870 tx=0x7f448802a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2988f63797964072 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.138+0000 7f4494a00640 1 -- 172.21.15.144:0/1782483186 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488037070 con 0x7f4498145150 2024-05-30T16:49:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.138+0000 7f4494a00640 1 -- 172.21.15.144:0/1782483186 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4488032440 con 0x7f4498145150 2024-05-30T16:49:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.138+0000 7f4494a00640 1 -- 172.21.15.144:0/1782483186 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488032810 con 0x7f4498145150 2024-05-30T16:49:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.139+0000 7f449d200640 1 -- 172.21.15.144:0/1782483186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4498145150 msgr2=0x7f44980cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.139+0000 7f449d200640 1 --2- 172.21.15.144:0/1782483186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4498145150 0x7f44980cf530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4488009870 tx=0x7f448802a1d0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.139+0000 7f449d200640 1 -- 172.21.15.144:0/1782483186 shutdown_connections 2024-05-30T16:49:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.139+0000 7f449d200640 1 --2- 172.21.15.144:0/1782483186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44980cfa70 0x7f449806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.139+0000 7f449d200640 1 --2- 172.21.15.144:0/1782483186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4498145150 0x7f44980cf530 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.139+0000 7f449d200640 1 -- 172.21.15.144:0/1782483186 >> 172.21.15.144:0/1782483186 conn(0x7f449806bd00 msgr2=0x7f449806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.139+0000 7f449d200640 1 -- 172.21.15.144:0/1782483186 shutdown_connections 2024-05-30T16:49:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.139+0000 7f449d200640 1 -- 172.21.15.144:0/1782483186 wait complete. 2024-05-30T16:49:46.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.141+0000 7f449d200640 1 Processor -- start 2024-05-30T16:49:46.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.141+0000 7f449d200640 1 -- start start 2024-05-30T16:49:46.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f449d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f449806f610 0x7f4498131480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f449d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44980cfa70 0x7f449815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f449d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4498145150 0x7f449815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f449d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f44980b64f0 con 0x7f44980cfa70 2024-05-30T16:49:46.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f449d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f449815f950 con 0x7f449806f610 2024-05-30T16:49:46.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f449d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f449815fe70 con 0x7f4498145150 2024-05-30T16:49:46.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f4495400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44980cfa70 0x7f449815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f4495400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44980cfa70 0x7f449815dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36970/0 (socket says 172.21.15.144:36970) 2024-05-30T16:49:46.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f4495400640 1 -- 172.21.15.144:0/1665421008 learned_addr learned my addr 172.21.15.144:0/1665421008 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:46.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.142+0000 7f4495e00640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f449806f610 0x7f4498131480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f4496800640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4498145150 0x7f449815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f4495400640 1 -- 172.21.15.144:0/1665421008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4498145150 msgr2=0x7f449815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f4495400640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4498145150 0x7f449815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f4495400640 1 -- 172.21.15.144:0/1665421008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f449806f610 msgr2=0x7f4498131480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f4495400640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f449806f610 0x7f4498131480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f4495400640 1 -- 172.21.15.144:0/1665421008 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4498131a60 con 0x7f44980cfa70 2024-05-30T16:49:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f4495400640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44980cfa70 0x7f449815dcb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f448000e9e0 tx=0x7f448000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f448e000640 1 -- 172.21.15.144:0/1665421008 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480017070 con 0x7f44980cfa70 2024-05-30T16:49:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f448e000640 1 -- 172.21.15.144:0/1665421008 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448000c9d0 con 0x7f44980cfa70 2024-05-30T16:49:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4498131d40 con 0x7f44980cfa70 2024-05-30T16:49:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f448e000640 1 -- 172.21.15.144:0/1665421008 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448000cdc0 con 0x7f44980cfa70 2024-05-30T16:49:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.143+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449815d820 con 0x7f44980cfa70 2024-05-30T16:49:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.145+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4498068b90 con 0x7f44980cfa70 2024-05-30T16:49:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.145+0000 7f448e000640 1 -- 172.21.15.144:0/1665421008 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f448001a070 con 0x7f44980cfa70 2024-05-30T16:49:46.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.146+0000 7f448e000640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f447406d5e0 0x7f447406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.146+0000 7f448e000640 1 -- 172.21.15.144:0/1665421008 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7f448008a910 con 0x7f44980cfa70 2024-05-30T16:49:46.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.147+0000 7f4495e00640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f447406d5e0 0x7f447406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.147+0000 7f4495e00640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f447406d5e0 0x7f447406faa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4488034000 tx=0x7f448802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.151+0000 7f448e000640 1 -- 172.21.15.144:0/1665421008 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f448005a7f0 con 0x7f44980cfa70 2024-05-30T16:49:46.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.372+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4498142310 con 0x7f44980cfa70 2024-05-30T16:49:46.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.373+0000 7f448e000640 1 -- 172.21.15.144:0/1665421008 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5193 (secure 0 0 0) 0x7f448005a0f0 con 0x7f44980cfa70 2024-05-30T16:49:46.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:46.375 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/4221007288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4221007288},{"type":"v1","addr":"172.21.15.144:6837","nonce":4221007288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5155,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/2104436930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2104436930},{"type":"v1","addr":"172.21.15.149:6833","nonce":2104436930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2742911992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2742911992},{"type":"v1","addr":"172.21.15.149:6835","nonce":2742911992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:47:58.808544+0000","modified":"2024-05-30T16:48:01.886903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5808":{"gid":5808,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4146621541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4146621541},{"type":"v1","addr":"172.21.15.144:6835","nonce":4146621541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5808,"qdb_cluster":[5808]},"id":4}]} 2024-05-30T16:49:46.375 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 36 2024-05-30T16:49:46.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f447406d5e0 msgr2=0x7f447406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f447406d5e0 0x7f447406faa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4488034000 tx=0x7f448802e000 comp rx=0 tx=0).stop 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44980cfa70 msgr2=0x7f449815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44980cfa70 0x7f449815dcb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f448000e9e0 tx=0x7f448000eea0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 shutdown_connections 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f447406d5e0 0x7f447406faa0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4498145150 0x7f449815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44980cfa70 0x7f449815dcb0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 --2- 172.21.15.144:0/1665421008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f449806f610 0x7f4498131480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 >> 172.21.15.144:0/1665421008 conn(0x7f449806bd00 msgr2=0x7f44981411c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 shutdown_connections 2024-05-30T16:49:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.376+0000 7f449d200640 1 -- 172.21.15.144:0/1665421008 wait complete. 2024-05-30T16:49:46.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:46.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.573+0000 7fc6bea00640 1 Processor -- start 2024-05-30T16:49:46.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.573+0000 7fc6bea00640 1 -- start start 2024-05-30T16:49:46.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc6b80cf300 0x7fc6b806b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6b80b4f00 0x7fc6b806be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bea00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b80cab30 con 0x7fc6b806f670 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bea00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b815b090 con 0x7fc6b80cf300 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b80b38d0 con 0x7fc6b80b4f00 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bcc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc6b80cf300 0x7fc6b806b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bcc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc6b80cf300 0x7fc6b806b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36986/0 (socket says 172.21.15.144:36986) 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bcc00640 1 -- 172.21.15.144:0/33461042 learned_addr learned my addr 172.21.15.144:0/33461042 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bcc00640 1 -- 172.21.15.144:0/33461042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6b80b4f00 msgr2=0x7fc6b806be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bcc00640 1 --2- 172.21.15.144:0/33461042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6b80b4f00 0x7fc6b806be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bcc00640 1 -- 172.21.15.144:0/33461042 >> v1:172.21.15.149:6789/0 conn(0x7fc6b806f670 legacy=0x7fc6b80b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:46.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.575+0000 7fc6bcc00640 1 -- 172.21.15.144:0/33461042 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b80cf950 con 0x7fc6b80cf300 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.576+0000 7fc6bcc00640 1 --2- 172.21.15.144:0/33461042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80cf300 0x7fc6b806b8e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009870 tx=0x7fc6a402b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dafd7f290562559 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6b7e00640 1 -- 172.21.15.144:0/33461042 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4038070 con 0x7fc6b80cf300 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6b7e00640 1 -- 172.21.15.144:0/33461042 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a4033640 con 0x7fc6b80cf300 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6b7e00640 1 -- 172.21.15.144:0/33461042 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4033a10 con 0x7fc6b80cf300 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6bea00640 1 -- 172.21.15.144:0/33461042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80cf300 msgr2=0x7fc6b806b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6bea00640 1 --2- 172.21.15.144:0/33461042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80cf300 0x7fc6b806b8e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009870 tx=0x7fc6a402b320 comp rx=0 tx=0).stop 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6bea00640 1 -- 172.21.15.144:0/33461042 shutdown_connections 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6bea00640 1 --2- 172.21.15.144:0/33461042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6b80b4f00 0x7fc6b806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6bea00640 1 --2- 172.21.15.144:0/33461042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80cf300 0x7fc6b806b8e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6bea00640 1 -- 172.21.15.144:0/33461042 >> 172.21.15.144:0/33461042 conn(0x7fc6b80b20a0 msgr2=0x7fc6b80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6bea00640 1 -- 172.21.15.144:0/33461042 shutdown_connections 2024-05-30T16:49:46.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.577+0000 7fc6bea00640 1 -- 172.21.15.144:0/33461042 wait complete. 2024-05-30T16:49:46.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.579+0000 7fc6bea00640 1 Processor -- start 2024-05-30T16:49:46.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.579+0000 7fc6bea00640 1 -- start start 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.580+0000 7fc6bea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6b806f670 0x7fc6b8149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.580+0000 7fc6bea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80b4f00 0x7fc6b814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.580+0000 7fc6bea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6b80cf300 0x7fc6b80adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.580+0000 7fc6bea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b815e730 con 0x7fc6b80b4f00 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.580+0000 7fc6bea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b80cff10 con 0x7fc6b80cf300 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.580+0000 7fc6bea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b80ca840 con 0x7fc6b806f670 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.580+0000 7fc6bcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80b4f00 0x7fc6b814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.580+0000 7fc6bcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80b4f00 0x7fc6b814d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37000/0 (socket says 172.21.15.144:37000) 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.580+0000 7fc6bcc00640 1 -- 172.21.15.144:0/4053932887 learned_addr learned my addr 172.21.15.144:0/4053932887 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6bcc00640 1 -- 172.21.15.144:0/4053932887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6b806f670 msgr2=0x7fc6b8149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6bcc00640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6b806f670 0x7fc6b8149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6bcc00640 1 -- 172.21.15.144:0/4053932887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6b80cf300 msgr2=0x7fc6b80adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6bcc00640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6b80cf300 0x7fc6b80adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6bcc00640 1 -- 172.21.15.144:0/4053932887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b814d8b0 con 0x7fc6b80b4f00 2024-05-30T16:49:46.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6bcc00640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80b4f00 0x7fc6b814d370 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000c00 tx=0x7fc6a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:46.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6b5600640 1 -- 172.21.15.144:0/4053932887 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4042020 con 0x7fc6b80b4f00 2024-05-30T16:49:46.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6b5600640 1 -- 172.21.15.144:0/4053932887 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a40318f0 con 0x7fc6b80b4f00 2024-05-30T16:49:46.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6b5600640 1 -- 172.21.15.144:0/4053932887 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4038040 con 0x7fc6b80b4f00 2024-05-30T16:49:46.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b815c110 con 0x7fc6b80b4f00 2024-05-30T16:49:46.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.581+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b815c6d0 con 0x7fc6b80b4f00 2024-05-30T16:49:46.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.582+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b8075570 con 0x7fc6b80b4f00 2024-05-30T16:49:46.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.583+0000 7fc6b5600640 1 -- 172.21.15.144:0/4053932887 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fc6a4045020 con 0x7fc6b80b4f00 2024-05-30T16:49:46.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.584+0000 7fc6b5600640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc69806d5e0 0x7fc69806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:46.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.585+0000 7fc6b5600640 1 -- 172.21.15.144:0/4053932887 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7fc6a40ab230 con 0x7fc6b80b4f00 2024-05-30T16:49:46.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.585+0000 7fc6bd600640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc69806d5e0 0x7fc69806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:46.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.585+0000 7fc6bd600640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc69806d5e0 0x7fc69806faa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac001560 tx=0x7fc6ac007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:46.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.589+0000 7fc6b5600640 1 -- 172.21.15.144:0/4053932887 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6a404c030 con 0x7fc6b80b4f00 2024-05-30T16:49:46.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.813+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6b80b47d0 con 0x7fc6b80b4f00 2024-05-30T16:49:46.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.815+0000 7fc6b5600640 1 -- 172.21.15.144:0/4053932887 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5193 (secure 0 0 0) 0x7fc6a407ae20 con 0x7fc6b80b4f00 2024-05-30T16:49:46.816 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:46.816 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/4221007288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4221007288},{"type":"v1","addr":"172.21.15.144:6837","nonce":4221007288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5155,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/2104436930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2104436930},{"type":"v1","addr":"172.21.15.149:6833","nonce":2104436930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2742911992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2742911992},{"type":"v1","addr":"172.21.15.149:6835","nonce":2742911992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:47:58.808544+0000","modified":"2024-05-30T16:48:01.886903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5808":{"gid":5808,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4146621541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4146621541},{"type":"v1","addr":"172.21.15.144:6835","nonce":4146621541}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5808,"qdb_cluster":[5808]},"id":4}]} 2024-05-30T16:49:46.817 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 36 2024-05-30T16:49:46.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc69806d5e0 msgr2=0x7fc69806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc69806d5e0 0x7fc69806faa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac001560 tx=0x7fc6ac007990 comp rx=0 tx=0).stop 2024-05-30T16:49:46.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80b4f00 msgr2=0x7fc6b814d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:46.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80b4f00 0x7fc6b814d370 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000c00 tx=0x7fc6a40046c0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 shutdown_connections 2024-05-30T16:49:46.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc69806d5e0 0x7fc69806faa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6b80cf300 0x7fc6b80adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6b80b4f00 0x7fc6b814d370 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 --2- 172.21.15.144:0/4053932887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6b806f670 0x7fc6b8149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:46.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 >> 172.21.15.144:0/4053932887 conn(0x7fc6b80b20a0 msgr2=0x7fc6b80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:46.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 shutdown_connections 2024-05-30T16:49:46.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:46.818+0000 7fc6bea00640 1 -- 172.21.15.144:0/4053932887 wait complete. 2024-05-30T16:49:46.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.026+0000 7ff74fe00640 1 Processor -- start 2024-05-30T16:49:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.026+0000 7ff74fe00640 1 -- start start 2024-05-30T16:49:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7500cfbe0 0x7ff750169820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff75015ed40 con 0x7ff75015e960 2024-05-30T16:49:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74fe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff750162ca0 con 0x7ff7500ba090 2024-05-30T16:49:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff7500d2b40 con 0x7ff7500cfbe0 2024-05-30T16:49:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff75015e960 0x7ff750162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50796/0 (socket says 172.21.15.144:50796) 2024-05-30T16:49:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74ea00640 1 -- 172.21.15.144:0/1552488894 learned_addr learned my addr 172.21.15.144:0/1552488894 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74f400640 1 --2- 172.21.15.144:0/1552488894 >> v2:172.21.15.144:3300/0 conn(0x7ff7500cfbe0 0x7ff750169820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74f400640 1 -- 172.21.15.144:0/1552488894 >> v1:172.21.15.149:6789/0 conn(0x7ff7500ba090 legacy=0x7ff7500cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74f400640 1 -- 172.21.15.144:0/1552488894 >> v1:172.21.15.144:6789/0 conn(0x7ff75015e960 legacy=0x7ff750162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.028+0000 7ff74f400640 1 -- 172.21.15.144:0/1552488894 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff750162f80 con 0x7ff7500cfbe0 2024-05-30T16:49:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.029+0000 7ff74f400640 1 --2- 172.21.15.144:0/1552488894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7500cfbe0 0x7ff750169820 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff748009d90 tx=0x7ff74802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d27f7aa414bf179 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74e000640 1 -- 172.21.15.144:0/1552488894 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748007740 con 0x7ff7500cfbe0 2024-05-30T16:49:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74e000640 1 -- 172.21.15.144:0/1552488894 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7480078e0 con 0x7ff7500cfbe0 2024-05-30T16:49:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74e000640 1 -- 172.21.15.144:0/1552488894 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748007cb0 con 0x7ff7500cfbe0 2024-05-30T16:49:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74fe00640 1 -- 172.21.15.144:0/1552488894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7500cfbe0 msgr2=0x7ff750169820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74fe00640 1 --2- 172.21.15.144:0/1552488894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7500cfbe0 0x7ff750169820 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff748009d90 tx=0x7ff74802a6a0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74fe00640 1 -- 172.21.15.144:0/1552488894 shutdown_connections 2024-05-30T16:49:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74fe00640 1 --2- 172.21.15.144:0/1552488894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7500cfbe0 0x7ff750169820 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74fe00640 1 -- 172.21.15.144:0/1552488894 >> 172.21.15.144:0/1552488894 conn(0x7ff7500d1360 msgr2=0x7ff7500d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74fe00640 1 -- 172.21.15.144:0/1552488894 shutdown_connections 2024-05-30T16:49:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.030+0000 7ff74fe00640 1 -- 172.21.15.144:0/1552488894 wait complete. 2024-05-30T16:49:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.032+0000 7ff74fe00640 1 Processor -- start 2024-05-30T16:49:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.032+0000 7ff74fe00640 1 -- start start 2024-05-30T16:49:47.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.033+0000 7ff74fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7500ba090 0x7ff75015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.033+0000 7ff74fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7500cfbe0 0x7ff750157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.033+0000 7ff74fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75015e960 0x7ff7500d4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.033+0000 7ff74fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff7500b78a0 con 0x7ff75015e960 2024-05-30T16:49:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.033+0000 7ff74fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff7500d2d90 con 0x7ff7500cfbe0 2024-05-30T16:49:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.033+0000 7ff74fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff7500d42c0 con 0x7ff7500ba090 2024-05-30T16:49:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.033+0000 7ff74f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75015e960 0x7ff7500d4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.033+0000 7ff74f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75015e960 0x7ff7500d4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37014/0 (socket says 172.21.15.144:37014) 2024-05-30T16:49:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.033+0000 7ff74f400640 1 -- 172.21.15.144:0/1381738756 learned_addr learned my addr 172.21.15.144:0/1381738756 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff746000640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7500cfbe0 0x7ff750157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff74ea00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7500ba090 0x7ff75015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff74f400640 1 -- 172.21.15.144:0/1381738756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7500ba090 msgr2=0x7ff75015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff74f400640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7500ba090 0x7ff75015a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff74f400640 1 -- 172.21.15.144:0/1381738756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7500cfbe0 msgr2=0x7ff750157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff74f400640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7500cfbe0 0x7ff750157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff74f400640 1 -- 172.21.15.144:0/1381738756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75015f010 con 0x7ff75015e960 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff746000640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7500cfbe0 0x7ff750157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff74f400640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75015e960 0x7ff7500d4950 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff748009d90 tx=0x7ff748004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff747e00640 1 -- 172.21.15.144:0/1381738756 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748040070 con 0x7ff75015e960 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff747e00640 1 -- 172.21.15.144:0/1381738756 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff748031c90 con 0x7ff75015e960 2024-05-30T16:49:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75015ace0 con 0x7ff75015e960 2024-05-30T16:49:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.034+0000 7ff747e00640 1 -- 172.21.15.144:0/1381738756 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74803c640 con 0x7ff75015e960 2024-05-30T16:49:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.035+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75015f590 con 0x7ff75015e960 2024-05-30T16:49:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.036+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7500cb5d0 con 0x7ff75015e960 2024-05-30T16:49:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.037+0000 7ff747e00640 1 -- 172.21.15.144:0/1381738756 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7ff748039040 con 0x7ff75015e960 2024-05-30T16:49:47.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.038+0000 7ff747e00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff72c06d5e0 0x7ff72c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.038+0000 7ff747e00640 1 -- 172.21.15.144:0/1381738756 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7ff7480abc60 con 0x7ff75015e960 2024-05-30T16:49:47.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.038+0000 7ff74ea00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff72c06d5e0 0x7ff72c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.039+0000 7ff74ea00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff72c06d5e0 0x7ff72c06faa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff740000f60 tx=0x7ff740009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.042+0000 7ff747e00640 1 -- 172.21.15.144:0/1381738756 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff7500cb5d0 con 0x7ff75015e960 2024-05-30T16:49:47.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.229+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff750075570 con 0x7ff75015e960 2024-05-30T16:49:47.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.231+0000 7ff747e00640 1 -- 172.21.15.144:0/1381738756 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16853 (secure 0 0 0) 0x7ff74807bba0 con 0x7ff75015e960 2024-05-30T16:49:47.233 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:47.233 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":60,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:49:38.972320+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:47:56.670101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T16:47:57.798316+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":60,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]},{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.233+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff72c06d5e0 msgr2=0x7ff72c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.233+0000 7ff74fe00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff72c06d5e0 0x7ff72c06faa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff740000f60 tx=0x7ff740009040 comp rx=0 tx=0).stop 2024-05-30T16:49:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.233+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75015e960 msgr2=0x7ff7500d4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.233+0000 7ff74fe00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75015e960 0x7ff7500d4950 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff748009d90 tx=0x7ff748004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.233+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 shutdown_connections 2024-05-30T16:49:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.234+0000 7ff74fe00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff72c06d5e0 0x7ff72c06faa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.234+0000 7ff74fe00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75015e960 0x7ff7500d4950 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.234+0000 7ff74fe00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7500cfbe0 0x7ff750157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.234+0000 7ff74fe00640 1 --2- 172.21.15.144:0/1381738756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7500ba090 0x7ff75015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.234+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 >> 172.21.15.144:0/1381738756 conn(0x7ff7500d1360 msgr2=0x7ff7500b8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:47.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.234+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 shutdown_connections 2024-05-30T16:49:47.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.234+0000 7ff74fe00640 1 -- 172.21.15.144:0/1381738756 wait complete. 2024-05-30T16:49:47.254 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T16:49:47.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.436+0000 7f37adc00640 1 Processor -- start 2024-05-30T16:49:47.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.437+0000 7f37adc00640 1 -- start start 2024-05-30T16:49:47.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.438+0000 7f37adc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a815e9a0 0x7f37a80d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.438+0000 7f37adc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f37a80cfb90 0x7f37a80d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.438+0000 7f37adc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a815ed80 con 0x7f37a80d14a0 2024-05-30T16:49:47.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.438+0000 7f37adc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f37a80d1a40 con 0x7f37a80cfb90 2024-05-30T16:49:47.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.438+0000 7f37adc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f37a80d1d20 con 0x7f37a815e9a0 2024-05-30T16:49:47.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.438+0000 7f37a7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f37a80d14a0 0x7f37a80cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50804/0 (socket says 172.21.15.144:50804) 2024-05-30T16:49:47.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.438+0000 7f37a7400640 1 -- 172.21.15.144:0/409620579 learned_addr learned my addr 172.21.15.144:0/409620579 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:47.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37ad200640 1 --2- 172.21.15.144:0/409620579 >> v2:172.21.15.149:3300/0 conn(0x7f37a80cfb90 0x7f37a80d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a7e00640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a815e9a0 0x7f37a80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201510993 0 0) 0x7f37a815ed80 con 0x7f37a80d14a0 2024-05-30T16:49:47.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3788003520 con 0x7f37a80d14a0 2024-05-30T16:49:47.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2057095676 0 0) 0x7f3788003520 con 0x7f37a80d14a0 2024-05-30T16:49:47.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a815e9a0 msgr2=0x7f37a80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a815e9a0 0x7f37a80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 >> v2:172.21.15.149:3300/0 conn(0x7f37a80cfb90 msgr2=0x7f37a80d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 --2- 172.21.15.144:0/409620579 >> v2:172.21.15.149:3300/0 conn(0x7f37a80cfb90 0x7f37a80d3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a80d2960 con 0x7f37a80d14a0 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f37900019f0 con 0x7f37a80d14a0 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 >> v1:172.21.15.144:6789/0 conn(0x7f37a80d14a0 legacy=0x7f37a80cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a815e9a0 0x7f37880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788003f30 0x7f3788004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3788004d40 0x7f37880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f37a80d1a40 con 0x7f3788004d40 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f37a80d1d20 con 0x7f3788003f30 2024-05-30T16:49:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.439+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f378800ba10 con 0x7f37a815e9a0 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.440+0000 7f37ad200640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3788004d40 0x7f37880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.440+0000 7f37a7400640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788003f30 0x7f3788004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.440+0000 7f37ad200640 1 -- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a815e9a0 msgr2=0x7f37880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.440+0000 7f37ad200640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a815e9a0 0x7f37880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.440+0000 7f37ad200640 1 -- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788003f30 msgr2=0x7f3788004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.440+0000 7f37ad200640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788003f30 0x7f3788004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.440+0000 7f37ad200640 1 -- 172.21.15.144:0/409620579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3788003520 con 0x7f3788004d40 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.440+0000 7f37a7400640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788003f30 0x7f3788004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.441+0000 7f37ad200640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3788004d40 0x7f37880051c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009ac0 tx=0x7f3788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddffad7c01b6abc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.441+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0036070 con 0x7f3788004d40 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.441+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a0031400 con 0x7f3788004d40 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.441+0000 7f37a6a00640 1 -- 172.21.15.144:0/409620579 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0009690 con 0x7f3788004d40 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.442+0000 7f37adc00640 1 -- 172.21.15.144:0/409620579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3788004d40 msgr2=0x7f37880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.442+0000 7f37adc00640 1 --2- 172.21.15.144:0/409620579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3788004d40 0x7f37880051c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009ac0 tx=0x7f3788005830 comp rx=0 tx=0).stop 2024-05-30T16:49:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.442+0000 7f37ad200640 1 -- 172.21.15.144:0/409620579 reap_dead start 2024-05-30T16:49:47.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.442+0000 7f37adc00640 1 -- 172.21.15.144:0/409620579 shutdown_connections 2024-05-30T16:49:47.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.442+0000 7f37adc00640 1 -- 172.21.15.144:0/409620579 >> 172.21.15.144:0/409620579 conn(0x7f37a806cbd0 msgr2=0x7f37a806cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:47.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.442+0000 7f37adc00640 1 -- 172.21.15.144:0/409620579 shutdown_connections 2024-05-30T16:49:47.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.442+0000 7f37adc00640 1 -- 172.21.15.144:0/409620579 wait complete. 2024-05-30T16:49:47.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.443+0000 7f37adc00640 1 Processor -- start 2024-05-30T16:49:47.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.444+0000 7f37adc00640 1 -- start start 2024-05-30T16:49:47.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.444+0000 7f37adc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788004d40 0x7f37a815e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.444+0000 7f37adc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a81f49f0 0x7f37a815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.444+0000 7f37adc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a81ea780 0x7f37a81eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.444+0000 7f37adc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f37a80d0f60 con 0x7f37a81f49f0 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.444+0000 7f37adc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f37a80ba200 con 0x7f3788004d40 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.444+0000 7f37adc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f37a80d10e0 con 0x7f37a81ea780 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a81f49f0 0x7f37a815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a81f49f0 0x7f37a815cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37040/0 (socket says 172.21.15.144:37040) 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7400640 1 -- 172.21.15.144:0/84566048 learned_addr learned my addr 172.21.15.144:0/84566048 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7e00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788004d40 0x7f37a815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7400640 1 -- 172.21.15.144:0/84566048 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a81ea780 msgr2=0x7f37a81eac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7400640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a81ea780 0x7f37a81eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7400640 1 -- 172.21.15.144:0/84566048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788004d40 msgr2=0x7f37a815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7400640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788004d40 0x7f37a815e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7400640 1 -- 172.21.15.144:0/84566048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a81f4e70 con 0x7f37a81f49f0 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.445+0000 7f37a7400640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a81f49f0 0x7f37a815cf70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f379000dfb0 tx=0x7f379000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.446+0000 7f379fe00640 1 -- 172.21.15.144:0/84566048 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790019070 con 0x7f37a81f49f0 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.446+0000 7f379fe00640 1 -- 172.21.15.144:0/84566048 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3790004d60 con 0x7f37a81f49f0 2024-05-30T16:49:47.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.446+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a81f5120 con 0x7f37a81f49f0 2024-05-30T16:49:47.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.446+0000 7f379fe00640 1 -- 172.21.15.144:0/84566048 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37900072d0 con 0x7f37a81f49f0 2024-05-30T16:49:47.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.446+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a81f56e0 con 0x7f37a81f49f0 2024-05-30T16:49:47.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.447+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a80cd6a0 con 0x7f37a81f49f0 2024-05-30T16:49:47.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.448+0000 7f379fe00640 1 -- 172.21.15.144:0/84566048 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f379001c070 con 0x7f37a81f49f0 2024-05-30T16:49:47.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.449+0000 7f379fe00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f378406d610 0x7f378406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.449+0000 7f379fe00640 1 -- 172.21.15.144:0/84566048 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5793+0+0 (secure 0 0 0) 0x7f379008a7c0 con 0x7f37a81f49f0 2024-05-30T16:49:47.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.449+0000 7f37a7e00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f378406d610 0x7f378406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.450+0000 7f37a7e00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f378406d610 0x7f378406fad0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3798006a90 tx=0x7f3798008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.454+0000 7f379fe00640 1 -- 172.21.15.144:0/84566048 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f37a80cd6a0 con 0x7f37a81f49f0 2024-05-30T16:49:47.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:49:47.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:49:47.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.693+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f37a8075570 con 0x7f37a81f49f0 2024-05-30T16:49:47.696 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-05-30T16:49:47.695+0000 7fd91d600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T16:49:47.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.699+0000 7f379fe00640 1 -- 172.21.15.144:0/84566048 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f379005a5b0 con 0x7f37a81f49f0 2024-05-30T16:49:47.701 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T16:49:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f378406d610 msgr2=0x7f378406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f378406d610 0x7f378406fad0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3798006a90 tx=0x7f3798008040 comp rx=0 tx=0).stop 2024-05-30T16:49:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a81f49f0 msgr2=0x7f37a815cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a81f49f0 0x7f37a815cf70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f379000dfb0 tx=0x7f379000b560 comp rx=0 tx=0).stop 2024-05-30T16:49:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 shutdown_connections 2024-05-30T16:49:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f378406d610 0x7f378406fad0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37a81ea780 0x7f37a81eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a81f49f0 0x7f37a815cf70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 --2- 172.21.15.144:0/84566048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3788004d40 0x7f37a815e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 >> 172.21.15.144:0/84566048 conn(0x7f37a806cbd0 msgr2=0x7f37a80ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:47.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.702+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 shutdown_connections 2024-05-30T16:49:47.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.703+0000 7f37adc00640 1 -- 172.21.15.144:0/84566048 wait complete. 2024-05-30T16:49:47.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T16:49:47.790 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-05-30T16:49:47.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.902+0000 7f6df0800640 1 Processor -- start 2024-05-30T16:49:47.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.902+0000 7f6df0800640 1 -- start start 2024-05-30T16:49:47.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.904+0000 7f6df0800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6de8141510 0x7f6de81418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.904+0000 7f6df0800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6de8144020 0x7f6de806e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.904+0000 7f6df0800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de80b3fd0 con 0x7f6de815f8f0 2024-05-30T16:49:47.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.904+0000 7f6df0800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6de806dfc0 con 0x7f6de8144020 2024-05-30T16:49:47.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.904+0000 7f6df0800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6de815fd80 con 0x7f6de8141510 2024-05-30T16:49:47.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.904+0000 7f6dee800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6de8144020 0x7f6de806e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.904+0000 7f6dee800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6de8144020 0x7f6de806e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37068/0 (socket says 172.21.15.144:37068) 2024-05-30T16:49:47.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.904+0000 7f6dee800640 1 -- 172.21.15.144:0/2458539169 learned_addr learned my addr 172.21.15.144:0/2458539169 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:47.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.904+0000 7f6dede00640 1 --2- 172.21.15.144:0/2458539169 >> v2:172.21.15.149:3300/0 conn(0x7f6de8141510 0x7f6de81418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.905+0000 7f6dee800640 1 -- 172.21.15.144:0/2458539169 >> v2:172.21.15.149:3300/0 conn(0x7f6de8141510 msgr2=0x7f6de81418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:47.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.905+0000 7f6dee800640 1 --2- 172.21.15.144:0/2458539169 >> v2:172.21.15.149:3300/0 conn(0x7f6de8141510 0x7f6de81418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.905+0000 7f6dee800640 1 -- 172.21.15.144:0/2458539169 >> v1:172.21.15.149:6789/0 conn(0x7f6de815f8f0 legacy=0x7f6de80b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:47.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.905+0000 7f6dee800640 1 -- 172.21.15.144:0/2458539169 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de8144790 con 0x7f6de8144020 2024-05-30T16:49:47.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.906+0000 7f6dee800640 1 --2- 172.21.15.144:0/2458539169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8144020 0x7f6de806e710 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6de8070180 tx=0x7f6de402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4896393bff31 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.906+0000 7f6deca00640 1 -- 172.21.15.144:0/2458539169 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4036070 con 0x7f6de8144020 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.906+0000 7f6deca00640 1 -- 172.21.15.144:0/2458539169 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de4031600 con 0x7f6de8144020 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.906+0000 7f6deca00640 1 -- 172.21.15.144:0/2458539169 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de40319d0 con 0x7f6de8144020 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.907+0000 7f6df0800640 1 -- 172.21.15.144:0/2458539169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8144020 msgr2=0x7f6de806e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.907+0000 7f6df0800640 1 --2- 172.21.15.144:0/2458539169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8144020 0x7f6de806e710 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6de8070180 tx=0x7f6de402a5d0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.907+0000 7f6df0800640 1 -- 172.21.15.144:0/2458539169 shutdown_connections 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.907+0000 7f6df0800640 1 --2- 172.21.15.144:0/2458539169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8144020 0x7f6de806e710 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.907+0000 7f6df0800640 1 --2- 172.21.15.144:0/2458539169 >> v2:172.21.15.149:3300/0 conn(0x7f6de8141510 0x7f6de81418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.907+0000 7f6df0800640 1 -- 172.21.15.144:0/2458539169 >> 172.21.15.144:0/2458539169 conn(0x7f6de806bd00 msgr2=0x7f6de806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.907+0000 7f6df0800640 1 -- 172.21.15.144:0/2458539169 shutdown_connections 2024-05-30T16:49:47.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.907+0000 7f6df0800640 1 -- 172.21.15.144:0/2458539169 wait complete. 2024-05-30T16:49:47.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.909+0000 7f6df0800640 1 Processor -- start 2024-05-30T16:49:47.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.909+0000 7f6df0800640 1 -- start start 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.910+0000 7f6df0800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8141510 0x7f6de813cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.910+0000 7f6df0800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de8144020 0x7f6de8139e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.910+0000 7f6df0800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6de815f8f0 0x7f6de81e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.910+0000 7f6df0800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6de806e210 con 0x7f6de8141510 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.910+0000 7f6df0800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6de8144d50 con 0x7f6de8144020 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.910+0000 7f6df0800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6de8144490 con 0x7f6de815f8f0 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.910+0000 7f6dede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8141510 0x7f6de813cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.910+0000 7f6dede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8141510 0x7f6de813cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37072/0 (socket says 172.21.15.144:37072) 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.910+0000 7f6dede00640 1 -- 172.21.15.144:0/1158435388 learned_addr learned my addr 172.21.15.144:0/1158435388 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6dede00640 1 -- 172.21.15.144:0/1158435388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6de815f8f0 msgr2=0x7f6de81e8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6dede00640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6de815f8f0 0x7f6de81e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6dede00640 1 -- 172.21.15.144:0/1158435388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de8144020 msgr2=0x7f6de8139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6dede00640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de8144020 0x7f6de8139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:47.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6dede00640 1 -- 172.21.15.144:0/1158435388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de8160db0 con 0x7f6de8141510 2024-05-30T16:49:47.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6dede00640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8141510 0x7f6de813cfb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00d620 tx=0x7f6ddc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6de2000640 1 -- 172.21.15.144:0/1158435388 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00b620 con 0x7f6de8141510 2024-05-30T16:49:47.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6de2000640 1 -- 172.21.15.144:0/1158435388 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ddc019070 con 0x7f6de8141510 2024-05-30T16:49:47.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6de2000640 1 -- 172.21.15.144:0/1158435388 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00ba00 con 0x7f6de8141510 2024-05-30T16:49:47.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de80b2a60 con 0x7f6de8141510 2024-05-30T16:49:47.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.911+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de80b3020 con 0x7f6de8141510 2024-05-30T16:49:47.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.912+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de8068b90 con 0x7f6de8141510 2024-05-30T16:49:47.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.914+0000 7f6de2000640 1 -- 172.21.15.144:0/1158435388 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f6ddc00bba0 con 0x7f6de8141510 2024-05-30T16:49:47.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.914+0000 7f6de2000640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6dcc06d5e0 0x7f6dcc06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:47.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.915+0000 7f6de2000640 1 -- 172.21.15.144:0/1158435388 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5823+0+0 (secure 0 0 0) 0x7f6ddc08abd0 con 0x7f6de8141510 2024-05-30T16:49:47.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.915+0000 7f6ded400640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6dcc06d5e0 0x7f6dcc06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:47.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.915+0000 7f6ded400640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6dcc06d5e0 0x7f6dcc06faa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6de81e9f60 tx=0x7f6dd80079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:47.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:47.919+0000 7f6de2000640 1 -- 172.21.15.144:0/1158435388 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6ddc05a820 con 0x7f6de8141510 2024-05-30T16:49:48.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.155+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6de8075830 con 0x7f6de8141510 2024-05-30T16:49:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.703+0000 7f6de2000640 1 -- 172.21.15.144:0/1158435388 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f6ddc05a120 con 0x7f6de8141510 2024-05-30T16:49:48.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6dcc06d5e0 msgr2=0x7f6dcc06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6dcc06d5e0 0x7f6dcc06faa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6de81e9f60 tx=0x7f6dd80079b0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8141510 msgr2=0x7f6de813cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8141510 0x7f6de813cfb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00d620 tx=0x7f6ddc00dae0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 shutdown_connections 2024-05-30T16:49:48.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6dcc06d5e0 0x7f6dcc06faa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6de815f8f0 0x7f6de81e8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de8144020 0x7f6de8139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 --2- 172.21.15.144:0/1158435388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6de8141510 0x7f6de813cfb0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.706+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 >> 172.21.15.144:0/1158435388 conn(0x7f6de806bd00 msgr2=0x7f6de8160230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:48.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.707+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 shutdown_connections 2024-05-30T16:49:48.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.707+0000 7f6df0800640 1 -- 172.21.15.144:0/1158435388 wait complete. 2024-05-30T16:49:48.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T16:49:48.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.983+0000 7fad95600640 1 Processor -- start 2024-05-30T16:49:48.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.983+0000 7fad95600640 1 -- start start 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad95600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad900cd780 0x7fad9006ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad95600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fad900cdb60 0x7fad9006f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad95600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad9015c8f0 con 0x7fad9015bbc0 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad95600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fad900d01e0 con 0x7fad900cd780 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad95600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fad900b3a70 con 0x7fad900cdb60 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad8fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad900cd780 0x7fad9006ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad8fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad900cd780 0x7fad9006ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37082/0 (socket says 172.21.15.144:37082) 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad8fe00640 1 -- 172.21.15.144:0/2831181176 learned_addr learned my addr 172.21.15.144:0/2831181176 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad8fe00640 1 -- 172.21.15.144:0/2831181176 >> v2:172.21.15.149:3300/0 conn(0x7fad900cdb60 msgr2=0x7fad9006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.985+0000 7fad8f400640 1 --2- 172.21.15.144:0/2831181176 >> v2:172.21.15.149:3300/0 conn(0x7fad900cdb60 0x7fad9006f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.986+0000 7fad8fe00640 1 --2- 172.21.15.144:0/2831181176 >> v2:172.21.15.149:3300/0 conn(0x7fad900cdb60 0x7fad9006f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.986+0000 7fad8fe00640 1 -- 172.21.15.144:0/2831181176 >> v1:172.21.15.144:6789/0 conn(0x7fad9015bbc0 legacy=0x7fad9015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.986+0000 7fad8fe00640 1 -- 172.21.15.144:0/2831181176 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad900cf420 con 0x7fad900cd780 2024-05-30T16:49:48.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.987+0000 7fad8fe00640 1 --2- 172.21.15.144:0/2831181176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 0x7fad9006ee90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fad80009870 tx=0x7fad8002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc15dd1d8e7bd7bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:48.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.987+0000 7fad8ea00640 1 -- 172.21.15.144:0/2831181176 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80037070 con 0x7fad900cd780 2024-05-30T16:49:48.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.987+0000 7fad8ea00640 1 -- 172.21.15.144:0/2831181176 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad80032440 con 0x7fad900cd780 2024-05-30T16:49:48.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.987+0000 7fad8ea00640 1 -- 172.21.15.144:0/2831181176 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80032810 con 0x7fad900cd780 2024-05-30T16:49:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.988+0000 7fad95600640 1 -- 172.21.15.144:0/2831181176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 msgr2=0x7fad9006ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.988+0000 7fad95600640 1 --2- 172.21.15.144:0/2831181176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 0x7fad9006ee90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fad80009870 tx=0x7fad8002a2a0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.988+0000 7fad95600640 1 -- 172.21.15.144:0/2831181176 shutdown_connections 2024-05-30T16:49:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.988+0000 7fad95600640 1 --2- 172.21.15.144:0/2831181176 >> v2:172.21.15.149:3300/0 conn(0x7fad900cdb60 0x7fad9006f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.988+0000 7fad95600640 1 --2- 172.21.15.144:0/2831181176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 0x7fad9006ee90 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.988+0000 7fad95600640 1 -- 172.21.15.144:0/2831181176 >> 172.21.15.144:0/2831181176 conn(0x7fad900b2160 msgr2=0x7fad900b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:48.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.988+0000 7fad95600640 1 -- 172.21.15.144:0/2831181176 shutdown_connections 2024-05-30T16:49:48.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.988+0000 7fad95600640 1 -- 172.21.15.144:0/2831181176 wait complete. 2024-05-30T16:49:48.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.989+0000 7fad95600640 1 Processor -- start 2024-05-30T16:49:48.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.990+0000 7fad95600640 1 -- start start 2024-05-30T16:49:48.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.990+0000 7fad95600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 0x7fad901f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.990+0000 7fad95600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900cdb60 0x7fad901f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.990+0000 7fad95600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad9015bbc0 0x7fad9015e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.990+0000 7fad95600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad900cfcc0 con 0x7fad900cd780 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.990+0000 7fad95600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fad900cf9e0 con 0x7fad9015bbc0 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.990+0000 7fad95600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fad9006dd80 con 0x7fad900cdb60 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 0x7fad901f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 0x7fad901f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37094/0 (socket says 172.21.15.144:37094) 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad8fe00640 1 -- 172.21.15.144:0/2634061906 learned_addr learned my addr 172.21.15.144:0/2634061906 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad94c00640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad9015bbc0 0x7fad9015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad8f400640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900cdb60 0x7fad901f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad8fe00640 1 -- 172.21.15.144:0/2634061906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900cdb60 msgr2=0x7fad901f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad8fe00640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900cdb60 0x7fad901f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad8fe00640 1 -- 172.21.15.144:0/2634061906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad9015bbc0 msgr2=0x7fad9015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad8fe00640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad9015bbc0 0x7fad9015e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.991+0000 7fad8fe00640 1 -- 172.21.15.144:0/2634061906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad901590b0 con 0x7fad900cd780 2024-05-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.992+0000 7fad8fe00640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 0x7fad901f5400 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fad80000c00 tx=0x7fad800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.992+0000 7fad87e00640 1 -- 172.21.15.144:0/2634061906 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80037040 con 0x7fad900cd780 2024-05-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.992+0000 7fad87e00640 1 -- 172.21.15.144:0/2634061906 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad80042070 con 0x7fad900cd780 2024-05-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.992+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad90159390 con 0x7fad900cd780 2024-05-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.992+0000 7fad87e00640 1 -- 172.21.15.144:0/2634061906 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80030bb0 con 0x7fad900cd780 2024-05-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.992+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad90157220 con 0x7fad900cd780 2024-05-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.993+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad90075570 con 0x7fad900cd780 2024-05-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.994+0000 7fad87e00640 1 -- 172.21.15.144:0/2634061906 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fad80047460 con 0x7fad900cd780 2024-05-30T16:49:48.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.995+0000 7fad87e00640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad7006d5e0 0x7fad7006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:48.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.995+0000 7fad87e00640 1 -- 172.21.15.144:0/2634061906 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5823+0+0 (secure 0 0 0) 0x7fad800ab490 con 0x7fad900cd780 2024-05-30T16:49:48.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.995+0000 7fad8f400640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad7006d5e0 0x7fad7006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.996+0000 7fad8f400640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad7006d5e0 0x7fad7006faa0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fad7c006fd0 tx=0x7fad7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:49.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:48.999+0000 7fad87e00640 1 -- 172.21.15.144:0/2634061906 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad80045360 con 0x7fad900cd780 2024-05-30T16:49:49.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:49.190+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fad901598b0 con 0x7fad900cd780 2024-05-30T16:49:50.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.072+0000 7fad87e00640 1 -- 172.21.15.144:0/2634061906 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) ==== 181+0+0 (secure 0 0 0) 0x7fad8007b0e0 con 0x7fad900cd780 2024-05-30T16:49:50.073 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-05-30T16:49:50.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.076+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad7006d5e0 msgr2=0x7fad7006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.076+0000 7fad95600640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad7006d5e0 0x7fad7006faa0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fad7c006fd0 tx=0x7fad7c008040 comp rx=0 tx=0).stop 2024-05-30T16:49:50.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.076+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 msgr2=0x7fad901f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.076+0000 7fad95600640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 0x7fad901f5400 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fad80000c00 tx=0x7fad800046c0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.077+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 shutdown_connections 2024-05-30T16:49:50.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.077+0000 7fad95600640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fad7006d5e0 0x7fad7006faa0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.077+0000 7fad95600640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad9015bbc0 0x7fad9015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.077+0000 7fad95600640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900cdb60 0x7fad901f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.077+0000 7fad95600640 1 --2- 172.21.15.144:0/2634061906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad900cd780 0x7fad901f5400 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.077+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 >> 172.21.15.144:0/2634061906 conn(0x7fad900b2160 msgr2=0x7fad9015efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:50.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.077+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 shutdown_connections 2024-05-30T16:49:50.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.077+0000 7fad95600640 1 -- 172.21.15.144:0/2634061906 wait complete. 2024-05-30T16:49:50.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T16:49:50.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.313+0000 7f3697e00640 1 Processor -- start 2024-05-30T16:49:50.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.313+0000 7f3697e00640 1 -- start start 2024-05-30T16:49:50.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.315+0000 7f3697e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f36980d1260 0x7f36980b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.315+0000 7f3697e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f36980d1640 0x7f36980d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.315+0000 7f3697e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980c7a50 0x7f36980b7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.315+0000 7f3697e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f36980cf330 con 0x7f36980d1640 2024-05-30T16:49:50.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.316+0000 7f3697e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f36980cf5d0 con 0x7f36980d1260 2024-05-30T16:49:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.316+0000 7f3697e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f36980cf8b0 con 0x7f36980c7a50 2024-05-30T16:49:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.316+0000 7f3696000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f36980d1640 0x7f36980d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.316+0000 7f3697400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980c7a50 0x7f36980b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.317+0000 7f3696000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f36980d1640 0x7f36980d0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37098/0 (socket says 172.21.15.144:37098) 2024-05-30T16:49:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.317+0000 7f3696000640 1 -- 172.21.15.144:0/573266172 learned_addr learned my addr 172.21.15.144:0/573266172 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.318+0000 7f3696000640 1 -- 172.21.15.144:0/573266172 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980c7a50 msgr2=0x7f36980b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.318+0000 7f3696000640 1 --2- 172.21.15.144:0/573266172 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980c7a50 0x7f36980b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.318+0000 7f3696000640 1 -- 172.21.15.144:0/573266172 >> v2:172.21.15.149:3300/0 conn(0x7f36980d1260 msgr2=0x7f36980b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:50.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.318+0000 7f3696000640 1 --2- 172.21.15.144:0/573266172 >> v2:172.21.15.149:3300/0 conn(0x7f36980d1260 0x7f36980b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.318+0000 7f3696000640 1 -- 172.21.15.144:0/573266172 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36980cfb90 con 0x7f36980d1640 2024-05-30T16:49:50.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.320+0000 7f3696000640 1 --2- 172.21.15.144:0/573266172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 0x7f36980d0650 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f369808e430 tx=0x7f368402a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472f4d94c860ba0a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:50.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.320+0000 7f3695600640 1 -- 172.21.15.144:0/573266172 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368402ade0 con 0x7f36980d1640 2024-05-30T16:49:50.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.320+0000 7f3695600640 1 -- 172.21.15.144:0/573266172 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3684004030 con 0x7f36980d1640 2024-05-30T16:49:50.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.320+0000 7f3695600640 1 -- 172.21.15.144:0/573266172 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3684004460 con 0x7f36980d1640 2024-05-30T16:49:50.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.321+0000 7f3697e00640 1 -- 172.21.15.144:0/573266172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 msgr2=0x7f36980d0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.321+0000 7f3697e00640 1 --2- 172.21.15.144:0/573266172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 0x7f36980d0650 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f369808e430 tx=0x7f368402a090 comp rx=0 tx=0).stop 2024-05-30T16:49:50.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.322+0000 7f3697e00640 1 -- 172.21.15.144:0/573266172 shutdown_connections 2024-05-30T16:49:50.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.322+0000 7f3697e00640 1 --2- 172.21.15.144:0/573266172 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980c7a50 0x7f36980b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.322+0000 7f3697e00640 1 --2- 172.21.15.144:0/573266172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 0x7f36980d0650 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.322+0000 7f3697e00640 1 --2- 172.21.15.144:0/573266172 >> v2:172.21.15.149:3300/0 conn(0x7f36980d1260 0x7f36980b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.322+0000 7f3697e00640 1 -- 172.21.15.144:0/573266172 >> 172.21.15.144:0/573266172 conn(0x7f369808bfc0 msgr2=0x7f36980d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:50.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.322+0000 7f3697e00640 1 -- 172.21.15.144:0/573266172 shutdown_connections 2024-05-30T16:49:50.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.322+0000 7f3697e00640 1 -- 172.21.15.144:0/573266172 wait complete. 2024-05-30T16:49:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.324+0000 7f3697e00640 1 Processor -- start 2024-05-30T16:49:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.324+0000 7f3697e00640 1 -- start start 2024-05-30T16:49:50.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.325+0000 7f3697e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36980c7a50 0x7f36981f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.325+0000 7f3697e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980d1260 0x7f3698165630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.325+0000 7f3697e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 0x7f36980c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.325+0000 7f3697e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36980b7ab0 con 0x7f36980d1640 2024-05-30T16:49:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.325+0000 7f3697e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36980d0150 con 0x7f36980c7a50 2024-05-30T16:49:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.325+0000 7f3697e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f36980b7c30 con 0x7f36980d1260 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.326+0000 7f3697400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 0x7f36980c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.326+0000 7f3697400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 0x7f36980c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37108/0 (socket says 172.21.15.144:37108) 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.326+0000 7f3697400640 1 -- 172.21.15.144:0/2236647422 learned_addr learned my addr 172.21.15.144:0/2236647422 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.326+0000 7f3696a00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36980c7a50 0x7f36981f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.326+0000 7f3696000640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980d1260 0x7f3698165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.327+0000 7f3697400640 1 -- 172.21.15.144:0/2236647422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980d1260 msgr2=0x7f3698165630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.327+0000 7f3697400640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980d1260 0x7f3698165630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.327+0000 7f3697400640 1 -- 172.21.15.144:0/2236647422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36980c7a50 msgr2=0x7f36981f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.327+0000 7f3697400640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36980c7a50 0x7f36981f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.327+0000 7f3697400640 1 -- 172.21.15.144:0/2236647422 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36980c8230 con 0x7f36980d1640 2024-05-30T16:49:50.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.327+0000 7f3697400640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 0x7f36980c9540 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f369000efc0 tx=0x7f369000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:50.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.328+0000 7f368ea00640 1 -- 172.21.15.144:0/2236647422 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690018020 con 0x7f36980d1640 2024-05-30T16:49:50.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.328+0000 7f368ea00640 1 -- 172.21.15.144:0/2236647422 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3690009b10 con 0x7f36980d1640 2024-05-30T16:49:50.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.328+0000 7f368ea00640 1 -- 172.21.15.144:0/2236647422 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36900146c0 con 0x7f36980d1640 2024-05-30T16:49:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.328+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36980c84d0 con 0x7f36980d1640 2024-05-30T16:49:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.328+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36980c8a90 con 0x7f36980d1640 2024-05-30T16:49:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.329+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3698075570 con 0x7f36980d1640 2024-05-30T16:49:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.330+0000 7f368ea00640 1 -- 172.21.15.144:0/2236647422 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f3690005d10 con 0x7f36980d1640 2024-05-30T16:49:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.331+0000 7f368ea00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f367806d5e0 0x7f367806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.331+0000 7f368ea00640 1 -- 172.21.15.144:0/2236647422 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5385+0+0 (secure 0 0 0) 0x7f369008b1b0 con 0x7f36980d1640 2024-05-30T16:49:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.331+0000 7f3696a00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f367806d5e0 0x7f367806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:50.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.332+0000 7f3696a00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f367806d5e0 0x7f367806faa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3688009970 tx=0x7f3688009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:50.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.336+0000 7f368ea00640 1 -- 172.21.15.144:0/2236647422 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3690022070 con 0x7f36980d1640 2024-05-30T16:49:50.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:50.537+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f36980ba6a0 con 0x7f36980d1640 2024-05-30T16:49:51.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.083+0000 7f368ea00640 1 -- 172.21.15.144:0/2236647422 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) ==== 169+0+0 (secure 0 0 0) 0x7f3690010040 con 0x7f36980d1640 2024-05-30T16:49:51.085 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-05-30T16:49:51.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f367806d5e0 msgr2=0x7f367806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f367806d5e0 0x7f367806faa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3688009970 tx=0x7f3688009110 comp rx=0 tx=0).stop 2024-05-30T16:49:51.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 msgr2=0x7f36980c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 0x7f36980c9540 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f369000efc0 tx=0x7f369000c490 comp rx=0 tx=0).stop 2024-05-30T16:49:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 shutdown_connections 2024-05-30T16:49:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f367806d5e0 0x7f367806faa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36980d1640 0x7f36980c9540 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36980d1260 0x7f3698165630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 --2- 172.21.15.144:0/2236647422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36980c7a50 0x7f36981f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 >> 172.21.15.144:0/2236647422 conn(0x7f369808bfc0 msgr2=0x7f36980d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.087+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 shutdown_connections 2024-05-30T16:49:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.088+0000 7f3697e00640 1 -- 172.21.15.144:0/2236647422 wait complete. 2024-05-30T16:49:51.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T16:49:51.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.313+0000 7fb7ede00640 1 Processor -- start 2024-05-30T16:49:51.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.313+0000 7fb7ede00640 1 -- start start 2024-05-30T16:49:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.314+0000 7fb7ede00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e813f760 0x7fb7e806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.314+0000 7fb7ede00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7e80cec70 0x7fb7e80b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.314+0000 7fb7ede00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e806ee80 con 0x7fb7e80b5e00 2024-05-30T16:49:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.314+0000 7fb7ede00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e81612b0 con 0x7fb7e80cec70 2024-05-30T16:49:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.314+0000 7fb7ede00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e813fb40 con 0x7fb7e813f760 2024-05-30T16:49:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.315+0000 7fb7dfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7e80cec70 0x7fb7e80b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.315+0000 7fb7dfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7e80cec70 0x7fb7e80b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37120/0 (socket says 172.21.15.144:37120) 2024-05-30T16:49:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.315+0000 7fb7dfe00640 1 -- 172.21.15.144:0/610725853 learned_addr learned my addr 172.21.15.144:0/610725853 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:51.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.315+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/610725853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e813f760 0x7fb7e806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.315+0000 7fb7dfe00640 1 -- 172.21.15.144:0/610725853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e813f760 msgr2=0x7fb7e806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:51.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.315+0000 7fb7dfe00640 1 --2- 172.21.15.144:0/610725853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e813f760 0x7fb7e806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.315+0000 7fb7dfe00640 1 -- 172.21.15.144:0/610725853 >> v1:172.21.15.149:6789/0 conn(0x7fb7e80b5e00 legacy=0x7fb7e8142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:51.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.315+0000 7fb7dfe00640 1 -- 172.21.15.144:0/610725853 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8160730 con 0x7fb7e80cec70 2024-05-30T16:49:51.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.315+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/610725853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e813f760 0x7fb7e806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:51.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.316+0000 7fb7dfe00640 1 --2- 172.21.15.144:0/610725853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80cec70 0x7fb7e80b58c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009870 tx=0x7fb7d002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d41ab9b2fcc9d86 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:51.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.316+0000 7fb7e6000640 1 -- 172.21.15.144:0/610725853 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0037070 con 0x7fb7e80cec70 2024-05-30T16:49:51.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7e6000640 1 -- 172.21.15.144:0/610725853 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d0032440 con 0x7fb7e80cec70 2024-05-30T16:49:51.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7e6000640 1 -- 172.21.15.144:0/610725853 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0032810 con 0x7fb7e80cec70 2024-05-30T16:49:51.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7ede00640 1 -- 172.21.15.144:0/610725853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80cec70 msgr2=0x7fb7e80b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7ede00640 1 --2- 172.21.15.144:0/610725853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80cec70 0x7fb7e80b58c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009870 tx=0x7fb7d002a2a0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7ede00640 1 -- 172.21.15.144:0/610725853 shutdown_connections 2024-05-30T16:49:51.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7ede00640 1 --2- 172.21.15.144:0/610725853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80cec70 0x7fb7e80b58c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7ede00640 1 --2- 172.21.15.144:0/610725853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e813f760 0x7fb7e806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7ede00640 1 -- 172.21.15.144:0/610725853 >> 172.21.15.144:0/610725853 conn(0x7fb7e806bd00 msgr2=0x7fb7e806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:51.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7ede00640 1 -- 172.21.15.144:0/610725853 shutdown_connections 2024-05-30T16:49:51.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.317+0000 7fb7ede00640 1 -- 172.21.15.144:0/610725853 wait complete. 2024-05-30T16:49:51.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.319+0000 7fb7ede00640 1 Processor -- start 2024-05-30T16:49:51.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.319+0000 7fb7ede00640 1 -- start start 2024-05-30T16:49:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.320+0000 7fb7ede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80b5e00 0x7fb7e81528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.320+0000 7fb7ede00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e80cec70 0x7fb7e80b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.320+0000 7fb7ede00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7e813f760 0x7fb7e81e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.320+0000 7fb7ede00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e8160fd0 con 0x7fb7e80b5e00 2024-05-30T16:49:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.320+0000 7fb7ede00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e8160cf0 con 0x7fb7e813f760 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.320+0000 7fb7ede00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e80cf0d0 con 0x7fb7e80cec70 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.320+0000 7fb7e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80b5e00 0x7fb7e81528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.320+0000 7fb7e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80b5e00 0x7fb7e81528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37124/0 (socket says 172.21.15.144:37124) 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.320+0000 7fb7e6a00640 1 -- 172.21.15.144:0/2900019890 learned_addr learned my addr 172.21.15.144:0/2900019890 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.321+0000 7fb7dfe00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e80cec70 0x7fb7e80b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.321+0000 7fb7e7400640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7e813f760 0x7fb7e81e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.321+0000 7fb7e6a00640 1 -- 172.21.15.144:0/2900019890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e80cec70 msgr2=0x7fb7e80b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.321+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e80cec70 0x7fb7e80b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.321+0000 7fb7e6a00640 1 -- 172.21.15.144:0/2900019890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7e813f760 msgr2=0x7fb7e81e6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.321+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7e813f760 0x7fb7e81e6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.321+0000 7fb7e6a00640 1 -- 172.21.15.144:0/2900019890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8152e00 con 0x7fb7e80b5e00 2024-05-30T16:49:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.321+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80b5e00 0x7fb7e81528c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c820 tx=0x7fb7d800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.321+0000 7fb7df400640 1 -- 172.21.15.144:0/2900019890 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8015070 con 0x7fb7e80b5e00 2024-05-30T16:49:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.322+0000 7fb7df400640 1 -- 172.21.15.144:0/2900019890 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d8007a30 con 0x7fb7e80b5e00 2024-05-30T16:49:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.322+0000 7fb7df400640 1 -- 172.21.15.144:0/2900019890 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8007de0 con 0x7fb7e80b5e00 2024-05-30T16:49:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.322+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e81f5800 con 0x7fb7e80b5e00 2024-05-30T16:49:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.322+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e81f5aa0 con 0x7fb7e80b5e00 2024-05-30T16:49:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.323+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e8068b90 con 0x7fb7e80b5e00 2024-05-30T16:49:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.324+0000 7fb7df400640 1 -- 172.21.15.144:0/2900019890 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fb7d8018070 con 0x7fb7e80b5e00 2024-05-30T16:49:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.325+0000 7fb7df400640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb7c406d5e0 0x7fb7c406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.325+0000 7fb7df400640 1 -- 172.21.15.144:0/2900019890 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7fb7d808a450 con 0x7fb7e80b5e00 2024-05-30T16:49:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.325+0000 7fb7dfe00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb7c406d5e0 0x7fb7c406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.326+0000 7fb7dfe00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb7c406d5e0 0x7fb7c406faa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0034000 tx=0x7fb7d002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:51.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.329+0000 7fb7df400640 1 -- 172.21.15.144:0/2900019890 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb7e8152e00 con 0x7fb7e80b5e00 2024-05-30T16:49:51.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.535+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb7e8160310 con 0x7fb7e80b5e00 2024-05-30T16:49:51.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.543+0000 7fb7df400640 1 -- 172.21.15.144:0/2900019890 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7fb7d805a2d0 con 0x7fb7e80b5e00 2024-05-30T16:49:51.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.545+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb7c406d5e0 msgr2=0x7fb7c406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.545+0000 7fb7ede00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb7c406d5e0 0x7fb7c406faa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0034000 tx=0x7fb7d002e000 comp rx=0 tx=0).stop 2024-05-30T16:49:51.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.545+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80b5e00 msgr2=0x7fb7e81528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.545+0000 7fb7ede00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80b5e00 0x7fb7e81528c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c820 tx=0x7fb7d800cce0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.546+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 shutdown_connections 2024-05-30T16:49:51.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.546+0000 7fb7ede00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb7c406d5e0 0x7fb7c406faa0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.546+0000 7fb7ede00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7e813f760 0x7fb7e81e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.546+0000 7fb7ede00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7e80cec70 0x7fb7e80b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.546+0000 7fb7ede00640 1 --2- 172.21.15.144:0/2900019890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80b5e00 0x7fb7e81528c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.546+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 >> 172.21.15.144:0/2900019890 conn(0x7fb7e806bd00 msgr2=0x7fb7e813fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:51.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.546+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 shutdown_connections 2024-05-30T16:49:51.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.546+0000 7fb7ede00640 1 -- 172.21.15.144:0/2900019890 wait complete. 2024-05-30T16:49:51.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_no_wait 2024-05-30T16:49:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.774+0000 7f02cf200640 1 Processor -- start 2024-05-30T16:49:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.774+0000 7f02cf200640 1 -- start start 2024-05-30T16:49:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.776+0000 7f02cf200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f02c813f760 0x7f02c806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.776+0000 7f02cf200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c806ee80 con 0x7f02c80b5fd0 2024-05-30T16:49:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.776+0000 7f02cf200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c8160730 con 0x7f02c80cec70 2024-05-30T16:49:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.776+0000 7f02cf200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f02c81612b0 con 0x7f02c813f760 2024-05-30T16:49:51.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.776+0000 7f02cd200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f02c80b5fd0 0x7f02c8142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50816/0 (socket says 172.21.15.144:50816) 2024-05-30T16:49:51.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.776+0000 7f02cd200640 1 -- 172.21.15.144:0/470744873 learned_addr learned my addr 172.21.15.144:0/470744873 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:51.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.776+0000 7f02c7e00640 1 --2- 172.21.15.144:0/470744873 >> v2:172.21.15.149:3300/0 conn(0x7f02c813f760 0x7f02c806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294631410 0 0) 0x7f02c806ee80 con 0x7f02c80b5fd0 2024-05-30T16:49:51.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02ac003520 con 0x7f02c80b5fd0 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 480004891 0 0) 0x7f02ac003520 con 0x7f02c80b5fd0 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 >> v2:172.21.15.149:3300/0 conn(0x7f02c813f760 msgr2=0x7f02c806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 --2- 172.21.15.144:0/470744873 >> v2:172.21.15.149:3300/0 conn(0x7f02c813f760 0x7f02c806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 >> v1:172.21.15.149:6789/0 conn(0x7f02c80cec70 legacy=0x7f02c80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c8160a10 con 0x7f02c80b5fd0 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f02c0001a10 con 0x7f02c80b5fd0 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 >> v1:172.21.15.144:6789/0 conn(0x7f02c80b5fd0 legacy=0x7f02c8142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02ac004800 0x7f02ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02ac0051c0 0x7f02ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02c81612b0 con 0x7f02ac0039b0 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac00c060 con 0x7f02ac0051c0 2024-05-30T16:49:51.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac00c260 con 0x7f02ac004800 2024-05-30T16:49:51.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.777+0000 7f02c7e00640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.778+0000 7f02c7e00640 1 -- 172.21.15.144:0/470744873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02ac004800 msgr2=0x7f02ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:51.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.778+0000 7f02cd200640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02ac0051c0 0x7f02ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.778+0000 7f02c7e00640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02ac004800 0x7f02ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.778+0000 7f02c7e00640 1 -- 172.21.15.144:0/470744873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02ac0051c0 msgr2=0x7f02ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:51.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.778+0000 7f02c7e00640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02ac0051c0 0x7f02ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.778+0000 7f02c7e00640 1 -- 172.21.15.144:0/470744873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac003520 con 0x7f02ac0039b0 2024-05-30T16:49:51.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.778+0000 7f02cd200640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02ac0051c0 0x7f02ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:51.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.778+0000 7f02cd200640 1 -- 172.21.15.144:0/470744873 reap_dead start 2024-05-30T16:49:51.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.779+0000 7f02c7e00640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02ac003dd0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009ac0 tx=0x7f02ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cf07a200c2cf05 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.779+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8036070 con 0x7f02ac0039b0 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.779+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b8031400 con 0x7f02ac0039b0 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.779+0000 7f02c7400640 1 -- 172.21.15.144:0/470744873 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8009690 con 0x7f02ac0039b0 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.780+0000 7f02cf200640 1 -- 172.21.15.144:0/470744873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 msgr2=0x7f02ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.780+0000 7f02cf200640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02ac003dd0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009ac0 tx=0x7f02ac005830 comp rx=0 tx=0).stop 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.780+0000 7f02cf200640 1 -- 172.21.15.144:0/470744873 shutdown_connections 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.780+0000 7f02cf200640 1 --2- 172.21.15.144:0/470744873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02ac003dd0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.780+0000 7f02cf200640 1 -- 172.21.15.144:0/470744873 >> 172.21.15.144:0/470744873 conn(0x7f02c806bd00 msgr2=0x7f02c806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.780+0000 7f02cf200640 1 -- 172.21.15.144:0/470744873 shutdown_connections 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.780+0000 7f02cf200640 1 -- 172.21.15.144:0/470744873 wait complete. 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.782+0000 7f02cf200640 1 Processor -- start 2024-05-30T16:49:51.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.782+0000 7f02cf200640 1 -- start start 2024-05-30T16:49:51.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02c8155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02cf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c8156e00 0x7f02c8136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02cf200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c80a96a0 0x7f02c813fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02cf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8160fd0 con 0x7f02ac0039b0 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02cf200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02c80cf0d0 con 0x7f02c80a96a0 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02cf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f02c80cf250 con 0x7f02c8156e00 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02c8155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02c8155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37154/0 (socket says 172.21.15.144:37154) 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02c7e00640 1 -- 172.21.15.144:0/3986482328 learned_addr learned my addr 172.21.15.144:0/3986482328 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02c7e00640 1 -- 172.21.15.144:0/3986482328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c8156e00 msgr2=0x7f02c8136dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02c7e00640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c8156e00 0x7f02c8136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02c7e00640 1 -- 172.21.15.144:0/3986482328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c80a96a0 msgr2=0x7f02c813fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02c7e00640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c80a96a0 0x7f02c813fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.783+0000 7f02c7e00640 1 -- 172.21.15.144:0/3986482328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c80a9b20 con 0x7f02ac0039b0 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.784+0000 7f02c7e00640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02c8155780 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f02b8034040 tx=0x7f02b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.784+0000 7f02c4c00640 1 -- 172.21.15.144:0/3986482328 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b803f020 con 0x7f02ac0039b0 2024-05-30T16:49:51.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.784+0000 7f02c4c00640 1 -- 172.21.15.144:0/3986482328 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b8037040 con 0x7f02ac0039b0 2024-05-30T16:49:51.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.784+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c8155d60 con 0x7f02ac0039b0 2024-05-30T16:49:51.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.784+0000 7f02c4c00640 1 -- 172.21.15.144:0/3986482328 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8036070 con 0x7f02ac0039b0 2024-05-30T16:49:51.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.784+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c8156320 con 0x7f02ac0039b0 2024-05-30T16:49:51.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.785+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c8068b90 con 0x7f02ac0039b0 2024-05-30T16:49:51.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.786+0000 7f02c4c00640 1 -- 172.21.15.144:0/3986482328 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f02b8042020 con 0x7f02ac0039b0 2024-05-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.787+0000 7f02c4c00640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f02a406d5e0 0x7f02a406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.787+0000 7f02c4c00640 1 -- 172.21.15.144:0/3986482328 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f02b80aa5f0 con 0x7f02ac0039b0 2024-05-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.787+0000 7f02bfe00640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f02a406d5e0 0x7f02a406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:51.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.788+0000 7f02bfe00640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f02a406d5e0 0x7f02a406faa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f02c813ee20 tx=0x7f02b0007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:51.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.791+0000 7f02c4c00640 1 -- 172.21.15.144:0/3986482328 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02b8049030 con 0x7f02ac0039b0 2024-05-30T16:49:51.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:51.994+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"} v 0) -- 0x7f02c815c840 con 0x7f02ac0039b0 2024-05-30T16:49:52.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.001+0000 7f02c4c00640 1 -- 172.21.15.144:0/3986482328 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"}]=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7f02b807a530 con 0x7f02ac0039b0 2024-05-30T16:49:52.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f02a406d5e0 msgr2=0x7f02a406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f02a406d5e0 0x7f02a406faa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f02c813ee20 tx=0x7f02b0007990 comp rx=0 tx=0).stop 2024-05-30T16:49:52.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 msgr2=0x7f02c8155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02c8155780 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f02b8034040 tx=0x7f02b8004730 comp rx=0 tx=0).stop 2024-05-30T16:49:52.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 shutdown_connections 2024-05-30T16:49:52.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f02a406d5e0 0x7f02a406faa0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c80a96a0 0x7f02c813fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c8156e00 0x7f02c8136dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 --2- 172.21.15.144:0/3986482328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02ac0039b0 0x7f02c8155780 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 >> 172.21.15.144:0/3986482328 conn(0x7f02c806bd00 msgr2=0x7f02c8072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:52.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 shutdown_connections 2024-05-30T16:49:52.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.005+0000 7f02cf200640 1 -- 172.21.15.144:0/3986482328 wait complete. 2024-05-30T16:49:52.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones' 2024-05-30T16:49:52.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.217+0000 7fb217200640 1 Processor -- start 2024-05-30T16:49:52.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.218+0000 7fb217200640 1 -- start start 2024-05-30T16:49:52.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.219+0000 7fb217200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2100ba090 0x7fb2100cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.219+0000 7fb217200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21015ed40 con 0x7fb2100cfa10 2024-05-30T16:49:52.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.219+0000 7fb217200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb210162ca0 con 0x7fb21015e960 2024-05-30T16:49:52.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.219+0000 7fb217200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb2100cfe80 con 0x7fb2100ba090 2024-05-30T16:49:52.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.219+0000 7fb216800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb2100cfa10 0x7fb2100d32b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50822/0 (socket says 172.21.15.144:50822) 2024-05-30T16:49:52.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.219+0000 7fb216800640 1 -- 172.21.15.144:0/1854891983 learned_addr learned my addr 172.21.15.144:0/1854891983 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb215400640 1 --2- 172.21.15.144:0/1854891983 >> v2:172.21.15.149:3300/0 conn(0x7fb2100ba090 0x7fb2100cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470808276 0 0) 0x7fb21015ed40 con 0x7fb2100cfa10 2024-05-30T16:49:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f8003520 con 0x7fb2100cfa10 2024-05-30T16:49:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1948691180 0 0) 0x7fb1f8003520 con 0x7fb2100cfa10 2024-05-30T16:49:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 >> v2:172.21.15.149:3300/0 conn(0x7fb2100ba090 msgr2=0x7fb2100cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 --2- 172.21.15.144:0/1854891983 >> v2:172.21.15.149:3300/0 conn(0x7fb2100ba090 0x7fb2100cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 >> v1:172.21.15.149:6789/0 conn(0x7fb21015e960 legacy=0x7fb210162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb210162f80 con 0x7fb2100cfa10 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fb20c0019f0 con 0x7fb2100cfa10 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 >> v1:172.21.15.144:6789/0 conn(0x7fb2100cfa10 legacy=0x7fb2100d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1f80039b0 0x7fb1f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1f80051c0 0x7fb1f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb2100cfe80 con 0x7fb1f8004800 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f800c060 con 0x7fb1f80039b0 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.220+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f800c260 con 0x7fb1f80051c0 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.221+0000 7fb215400640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.221+0000 7fb215e00640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1f80039b0 0x7fb1f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.221+0000 7fb215400640 1 -- 172.21.15.144:0/1854891983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1f80051c0 msgr2=0x7fb1f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.221+0000 7fb215400640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1f80051c0 0x7fb1f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.221+0000 7fb215400640 1 -- 172.21.15.144:0/1854891983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1f80039b0 msgr2=0x7fb1f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.221+0000 7fb215400640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1f80039b0 0x7fb1f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.221+0000 7fb216800640 1 -- 172.21.15.144:0/1854891983 reap_dead start 2024-05-30T16:49:52.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.221+0000 7fb215400640 1 -- 172.21.15.144:0/1854891983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f8003520 con 0x7fb1f8004800 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.222+0000 7fb215400640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb200009ac0 tx=0x7fb1f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff2c95b9939c206 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200036070 con 0x7fb1f8004800 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb200031400 con 0x7fb1f8004800 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb214a00640 1 -- 172.21.15.144:0/1854891983 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200009690 con 0x7fb1f8004800 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb217200640 1 -- 172.21.15.144:0/1854891983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f8004800 msgr2=0x7fb1f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb217200640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb200009ac0 tx=0x7fb1f8005830 comp rx=0 tx=0).stop 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb217200640 1 -- 172.21.15.144:0/1854891983 shutdown_connections 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb217200640 1 --2- 172.21.15.144:0/1854891983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb217200640 1 -- 172.21.15.144:0/1854891983 >> 172.21.15.144:0/1854891983 conn(0x7fb2100d1360 msgr2=0x7fb2100d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb217200640 1 -- 172.21.15.144:0/1854891983 shutdown_connections 2024-05-30T16:49:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.223+0000 7fb217200640 1 -- 172.21.15.144:0/1854891983 wait complete. 2024-05-30T16:49:52.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.225+0000 7fb217200640 1 Processor -- start 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.225+0000 7fb217200640 1 -- start start 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.226+0000 7fb217200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1f8004800 0x7fb21015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.226+0000 7fb217200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb210155e60 0x7fb2100ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.226+0000 7fb217200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2101598f0 0x7fb210156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.226+0000 7fb217200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb2100d2d90 con 0x7fb2101598f0 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.226+0000 7fb217200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb2100d2b40 con 0x7fb1f8004800 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.226+0000 7fb217200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb2100b78a0 con 0x7fb210155e60 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.226+0000 7fb216800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2101598f0 0x7fb210156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.226+0000 7fb216800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2101598f0 0x7fb210156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37176/0 (socket says 172.21.15.144:37176) 2024-05-30T16:49:52.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.226+0000 7fb216800640 1 -- 172.21.15.144:0/47564689 learned_addr learned my addr 172.21.15.144:0/47564689 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:52.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb215400640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb210155e60 0x7fb2100ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb216800640 1 -- 172.21.15.144:0/47564689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb210155e60 msgr2=0x7fb2100ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb215e00640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1f8004800 0x7fb21015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb216800640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb210155e60 0x7fb2100ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb216800640 1 -- 172.21.15.144:0/47564689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1f8004800 msgr2=0x7fb21015dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb216800640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1f8004800 0x7fb21015dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb216800640 1 -- 172.21.15.144:0/47564689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb210158bb0 con 0x7fb2101598f0 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb215400640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb210155e60 0x7fb2100ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb216800640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2101598f0 0x7fb210156ba0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb2100695d0 tx=0x7fb20c00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb20a000640 1 -- 172.21.15.144:0/47564689 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c007110 con 0x7fb2101598f0 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb20a000640 1 -- 172.21.15.144:0/47564689 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20c0072d0 con 0x7fb2101598f0 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb210158e30 con 0x7fb2101598f0 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.227+0000 7fb20a000640 1 -- 172.21.15.144:0/47564689 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0076c0 con 0x7fb2101598f0 2024-05-30T16:49:52.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.228+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2101590f0 con 0x7fb2101598f0 2024-05-30T16:49:52.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.229+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb210075570 con 0x7fb2101598f0 2024-05-30T16:49:52.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.230+0000 7fb20a000640 1 -- 172.21.15.144:0/47564689 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fb20c007860 con 0x7fb2101598f0 2024-05-30T16:49:52.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.231+0000 7fb20a000640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1f406d5e0 0x7fb1f406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:52.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.231+0000 7fb20a000640 1 -- 172.21.15.144:0/47564689 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7fb20c089f60 con 0x7fb2101598f0 2024-05-30T16:49:52.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.231+0000 7fb215e00640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1f406d5e0 0x7fb1f406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:52.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.231+0000 7fb215e00640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1f406d5e0 0x7fb1f406faa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb204001550 tx=0x7fb204009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:52.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.235+0000 7fb20a000640 1 -- 172.21.15.144:0/47564689 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb210158bb0 con 0x7fb2101598f0 2024-05-30T16:49:52.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:52.508+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]} v 0) -- 0x7fb2100d2410 con 0x7fb2101598f0 2024-05-30T16:49:53.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.096+0000 7fb20a000640 1 -- 172.21.15.144:0/47564689 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]}]=0 v351) ==== 162+0+0 (secure 0 0 0) 0x7fb20c059de0 con 0x7fb2101598f0 2024-05-30T16:49:53.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.099+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1f406d5e0 msgr2=0x7fb1f406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.099+0000 7fb217200640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1f406d5e0 0x7fb1f406faa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb204001550 tx=0x7fb204009040 comp rx=0 tx=0).stop 2024-05-30T16:49:53.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2101598f0 msgr2=0x7fb210156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2101598f0 0x7fb210156ba0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb2100695d0 tx=0x7fb20c00ce80 comp rx=0 tx=0).stop 2024-05-30T16:49:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 shutdown_connections 2024-05-30T16:49:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb1f406d5e0 0x7fb1f406faa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2101598f0 0x7fb210156ba0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb210155e60 0x7fb2100ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 --2- 172.21.15.144:0/47564689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1f8004800 0x7fb21015dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 >> 172.21.15.144:0/47564689 conn(0x7fb2100d1360 msgr2=0x7fb21006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 shutdown_connections 2024-05-30T16:49:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.100+0000 7fb217200640 1 -- 172.21.15.144:0/47564689 wait complete. 2024-05-30T16:49:53.126 INFO:tasks.cephfs_test_runner:Test that 2 progress bars are printed when number of clone jobs is ... ok 2024-05-30T16:49:53.126 INFO:tasks.cephfs_test_runner:Starting test: test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that progress indicated by progress bar for ongoing+pending clones 2024-05-30T16:49:53.126 INFO:tasks.cephfs_test_runner:test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:49:53.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.327+0000 7fed79c00640 1 Processor -- start 2024-05-30T16:49:53.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.328+0000 7fed79c00640 1 -- start start 2024-05-30T16:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.329+0000 7fed79c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed7415e960 0x7fed74162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.329+0000 7fed79c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740ba090 0x7fed740cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.329+0000 7fed79c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed740cfa10 0x7fed7406c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.329+0000 7fed79c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fed740d2b40 con 0x7fed740cfa10 2024-05-30T16:49:53.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.329+0000 7fed79c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fed7415ed40 con 0x7fed7415e960 2024-05-30T16:49:53.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.329+0000 7fed79c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fed741629d0 con 0x7fed740ba090 2024-05-30T16:49:53.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.329+0000 7fed79200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed740cfa10 0x7fed7406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.329+0000 7fed79200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed740cfa10 0x7fed7406c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37186/0 (socket says 172.21.15.144:37186) 2024-05-30T16:49:53.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.329+0000 7fed79200640 1 -- 172.21.15.144:0/3887629045 learned_addr learned my addr 172.21.15.144:0/3887629045 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.330+0000 7fed73e00640 1 --2- 172.21.15.144:0/3887629045 >> v2:172.21.15.149:3300/0 conn(0x7fed7415e960 0x7fed74162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.330+0000 7fed73400640 1 --2- 172.21.15.144:0/3887629045 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740ba090 0x7fed740cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.330+0000 7fed79200640 1 -- 172.21.15.144:0/3887629045 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740ba090 msgr2=0x7fed740cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.330+0000 7fed79200640 1 --2- 172.21.15.144:0/3887629045 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740ba090 0x7fed740cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.330+0000 7fed79200640 1 -- 172.21.15.144:0/3887629045 >> v2:172.21.15.149:3300/0 conn(0x7fed7415e960 msgr2=0x7fed74162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.330+0000 7fed79200640 1 --2- 172.21.15.144:0/3887629045 >> v2:172.21.15.149:3300/0 conn(0x7fed7415e960 0x7fed74162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.330+0000 7fed79200640 1 -- 172.21.15.144:0/3887629045 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed74162ca0 con 0x7fed740cfa10 2024-05-30T16:49:53.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.330+0000 7fed73400640 1 --2- 172.21.15.144:0/3887629045 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740ba090 0x7fed740cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:53.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.331+0000 7fed79200640 1 --2- 172.21.15.144:0/3887629045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed740cfa10 0x7fed7406c880 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fed740b7180 tx=0x7fed6c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a467c0faa08432 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.331+0000 7fed72a00640 1 -- 172.21.15.144:0/3887629045 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c036070 con 0x7fed740cfa10 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.331+0000 7fed72a00640 1 -- 172.21.15.144:0/3887629045 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed6c031600 con 0x7fed740cfa10 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.331+0000 7fed72a00640 1 -- 172.21.15.144:0/3887629045 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0319d0 con 0x7fed740cfa10 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.332+0000 7fed79c00640 1 -- 172.21.15.144:0/3887629045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed740cfa10 msgr2=0x7fed7406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.332+0000 7fed79c00640 1 --2- 172.21.15.144:0/3887629045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed740cfa10 0x7fed7406c880 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fed740b7180 tx=0x7fed6c02a6a0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.332+0000 7fed79c00640 1 -- 172.21.15.144:0/3887629045 shutdown_connections 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.332+0000 7fed79c00640 1 --2- 172.21.15.144:0/3887629045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed740cfa10 0x7fed7406c880 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.332+0000 7fed79c00640 1 --2- 172.21.15.144:0/3887629045 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740ba090 0x7fed740cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.332+0000 7fed79c00640 1 --2- 172.21.15.144:0/3887629045 >> v2:172.21.15.149:3300/0 conn(0x7fed7415e960 0x7fed74162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.332+0000 7fed79c00640 1 -- 172.21.15.144:0/3887629045 >> 172.21.15.144:0/3887629045 conn(0x7fed740d1360 msgr2=0x7fed740d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.332+0000 7fed79c00640 1 -- 172.21.15.144:0/3887629045 shutdown_connections 2024-05-30T16:49:53.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.332+0000 7fed79c00640 1 -- 172.21.15.144:0/3887629045 wait complete. 2024-05-30T16:49:53.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.334+0000 7fed79c00640 1 Processor -- start 2024-05-30T16:49:53.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.334+0000 7fed79c00640 1 -- start start 2024-05-30T16:49:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.335+0000 7fed79c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740ba090 0x7fed74159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.335+0000 7fed79c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740cfa10 0x7fed740ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.335+0000 7fed79c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7415e960 0x7fed740acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.335+0000 7fed79c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fed740d2d90 con 0x7fed7415e960 2024-05-30T16:49:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.335+0000 7fed79c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed74163260 con 0x7fed740ba090 2024-05-30T16:49:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.335+0000 7fed79c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fed740b78a0 con 0x7fed740cfa10 2024-05-30T16:49:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.335+0000 7fed79200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7415e960 0x7fed740acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.335+0000 7fed79200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7415e960 0x7fed740acfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37194/0 (socket says 172.21.15.144:37194) 2024-05-30T16:49:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.335+0000 7fed79200640 1 -- 172.21.15.144:0/213831484 learned_addr learned my addr 172.21.15.144:0/213831484 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed73e00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740ba090 0x7fed74159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed73400640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740cfa10 0x7fed740ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed79200640 1 -- 172.21.15.144:0/213831484 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740cfa10 msgr2=0x7fed740ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed79200640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740cfa10 0x7fed740ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed79200640 1 -- 172.21.15.144:0/213831484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740ba090 msgr2=0x7fed74159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed79200640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740ba090 0x7fed74159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed79200640 1 -- 172.21.15.144:0/213831484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed741f8e60 con 0x7fed7415e960 2024-05-30T16:49:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed79200640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7415e960 0x7fed740acfd0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fed6c034040 tx=0x7fed6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed6be00640 1 -- 172.21.15.144:0/213831484 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c041020 con 0x7fed7415e960 2024-05-30T16:49:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed6be00640 1 -- 172.21.15.144:0/213831484 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed6c0077a0 con 0x7fed7415e960 2024-05-30T16:49:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed6be00640 1 -- 172.21.15.144:0/213831484 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c036040 con 0x7fed7415e960 2024-05-30T16:49:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.336+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed741f85c0 con 0x7fed7415e960 2024-05-30T16:49:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.337+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed741f8b80 con 0x7fed7415e960 2024-05-30T16:49:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.338+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed74075570 con 0x7fed7415e960 2024-05-30T16:49:53.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.339+0000 7fed6be00640 1 -- 172.21.15.144:0/213831484 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fed6c044020 con 0x7fed7415e960 2024-05-30T16:49:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.340+0000 7fed6be00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed5006d5e0 0x7fed5006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.340+0000 7fed6be00640 1 -- 172.21.15.144:0/213831484 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7fed6c0ab940 con 0x7fed7415e960 2024-05-30T16:49:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.340+0000 7fed73e00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed5006d5e0 0x7fed5006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.341+0000 7fed73e00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed5006d5e0 0x7fed5006faa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fed5c006fd0 tx=0x7fed5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.345+0000 7fed6be00640 1 -- 172.21.15.144:0/213831484 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed6c04b020 con 0x7fed7415e960 2024-05-30T16:49:53.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.550+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed74161ac0 con 0x7fed7415e960 2024-05-30T16:49:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.552+0000 7fed6be00640 1 -- 172.21.15.144:0/213831484 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+13101 (secure 0 0 0) 0x7fed6c07b8e0 con 0x7fed7415e960 2024-05-30T16:49:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:53.554 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":64,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:49:51.073673+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/4146621541":"2024-05-31T16:49:47.696159+0000","172.21.15.144:6834/4146621541":"2024-05-31T16:49:47.696159+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:49:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.555+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed5006d5e0 msgr2=0x7fed5006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.555+0000 7fed79c00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed5006d5e0 0x7fed5006faa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fed5c006fd0 tx=0x7fed5c008040 comp rx=0 tx=0).stop 2024-05-30T16:49:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.555+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7415e960 msgr2=0x7fed740acfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.555+0000 7fed79c00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7415e960 0x7fed740acfd0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fed6c034040 tx=0x7fed6c004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.556+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 shutdown_connections 2024-05-30T16:49:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.556+0000 7fed79c00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fed5006d5e0 0x7fed5006faa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.556+0000 7fed79c00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7415e960 0x7fed740acfd0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.556+0000 7fed79c00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed740cfa10 0x7fed740ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.556+0000 7fed79c00640 1 --2- 172.21.15.144:0/213831484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740ba090 0x7fed74159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.556+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 >> 172.21.15.144:0/213831484 conn(0x7fed740d1360 msgr2=0x7fed7415ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.556+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 shutdown_connections 2024-05-30T16:49:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.556+0000 7fed79c00640 1 -- 172.21.15.144:0/213831484 wait complete. 2024-05-30T16:49:53.576 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T16:41:40.927129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T16:49:53.576 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T16:49:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.776+0000 7f91ace00640 1 Processor -- start 2024-05-30T16:49:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.777+0000 7f91ace00640 1 -- start start 2024-05-30T16:49:53.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.778+0000 7f91ace00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a8160990 0x7f91a80cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.778+0000 7f91ace00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91a806c3d0 0x7f91a806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.778+0000 7f91ace00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a80cd3e0 con 0x7f91a8145f10 2024-05-30T16:49:53.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.778+0000 7f91ace00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f91a806c860 con 0x7f91a806c3d0 2024-05-30T16:49:53.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.778+0000 7f91ace00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f91a8161100 con 0x7f91a8160990 2024-05-30T16:49:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.779+0000 7f91a7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91a806c3d0 0x7f91a806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.779+0000 7f91a7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91a806c3d0 0x7f91a806dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37204/0 (socket says 172.21.15.144:37204) 2024-05-30T16:49:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.779+0000 7f91a7400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f91a8145f10 0x7f91a8160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:42120/0 (socket says 172.21.15.144:42120) 2024-05-30T16:49:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.779+0000 7f91a7e00640 1 -- 172.21.15.144:0/1352150726 learned_addr learned my addr 172.21.15.144:0/1352150726 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.779+0000 7f919ea00640 1 --2- 172.21.15.144:0/1352150726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a8160990 0x7f91a80cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.780+0000 7f91a7e00640 1 -- 172.21.15.144:0/1352150726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a8160990 msgr2=0x7f91a80cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.780+0000 7f91a7e00640 1 --2- 172.21.15.144:0/1352150726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a8160990 0x7f91a80cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.780+0000 7f91a7e00640 1 -- 172.21.15.144:0/1352150726 >> v1:172.21.15.149:6789/0 conn(0x7f91a8145f10 legacy=0x7f91a8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.780+0000 7f91a7e00640 1 -- 172.21.15.144:0/1352150726 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a80cd6c0 con 0x7f91a806c3d0 2024-05-30T16:49:53.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.781+0000 7f91a7e00640 1 --2- 172.21.15.144:0/1352150726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a806c3d0 0x7f91a806dd30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009e50 tx=0x7f91a002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203b8cb8ca39bb31 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.781+0000 7f91a6a00640 1 -- 172.21.15.144:0/1352150726 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0036070 con 0x7f91a806c3d0 2024-05-30T16:49:53.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.781+0000 7f91a6a00640 1 -- 172.21.15.144:0/1352150726 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0031600 con 0x7f91a806c3d0 2024-05-30T16:49:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.781+0000 7f91a6a00640 1 -- 172.21.15.144:0/1352150726 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00319d0 con 0x7f91a806c3d0 2024-05-30T16:49:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.782+0000 7f91ace00640 1 -- 172.21.15.144:0/1352150726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a806c3d0 msgr2=0x7f91a806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.782+0000 7f91ace00640 1 --2- 172.21.15.144:0/1352150726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a806c3d0 0x7f91a806dd30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009e50 tx=0x7f91a002a710 comp rx=0 tx=0).stop 2024-05-30T16:49:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.782+0000 7f91ace00640 1 -- 172.21.15.144:0/1352150726 shutdown_connections 2024-05-30T16:49:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.782+0000 7f91ace00640 1 --2- 172.21.15.144:0/1352150726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a806c3d0 0x7f91a806dd30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.782+0000 7f91ace00640 1 --2- 172.21.15.144:0/1352150726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a8160990 0x7f91a80cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.782+0000 7f91ace00640 1 -- 172.21.15.144:0/1352150726 >> 172.21.15.144:0/1352150726 conn(0x7f91a806b8e0 msgr2=0x7f91a806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.782+0000 7f91ace00640 1 -- 172.21.15.144:0/1352150726 shutdown_connections 2024-05-30T16:49:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.782+0000 7f91ace00640 1 -- 172.21.15.144:0/1352150726 wait complete. 2024-05-30T16:49:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.784+0000 7f91ace00640 1 Processor -- start 2024-05-30T16:49:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.784+0000 7f91ace00640 1 -- start start 2024-05-30T16:49:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.785+0000 7f91ace00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a806c3d0 0x7f91a815fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.785+0000 7f91ace00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a8145f10 0x7f91a8156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.785+0000 7f91ace00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a8160990 0x7f91a8157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.785+0000 7f91ace00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f91a80cdf60 con 0x7f91a8160990 2024-05-30T16:49:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.785+0000 7f91ace00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91a80cdc80 con 0x7f91a8145f10 2024-05-30T16:49:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.785+0000 7f91ace00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f91a81462f0 con 0x7f91a806c3d0 2024-05-30T16:49:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f91a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a8160990 0x7f91a8157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f91a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a8160990 0x7f91a8157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37210/0 (socket says 172.21.15.144:37210) 2024-05-30T16:49:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f91a7e00640 1 -- 172.21.15.144:0/3524875923 learned_addr learned my addr 172.21.15.144:0/3524875923 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f91a7400640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a806c3d0 0x7f91a815fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f919ea00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a8145f10 0x7f91a8156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f91a7e00640 1 -- 172.21.15.144:0/3524875923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a806c3d0 msgr2=0x7f91a815fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f91a7e00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a806c3d0 0x7f91a815fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f91a7e00640 1 -- 172.21.15.144:0/3524875923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a8145f10 msgr2=0x7f91a8156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f91a7e00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a8145f10 0x7f91a8156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.786+0000 7f91a7e00640 1 -- 172.21.15.144:0/3524875923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a8158bc0 con 0x7f91a8160990 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.787+0000 7f91a7e00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a8160990 0x7f91a8157350 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009f70 tx=0x7f91a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.787+0000 7f919fe00640 1 -- 172.21.15.144:0/3524875923 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a003f020 con 0x7f91a8160990 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.787+0000 7f919fe00640 1 -- 172.21.15.144:0/3524875923 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0037040 con 0x7f91a8160990 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.787+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a8158ea0 con 0x7f91a8160990 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.787+0000 7f919fe00640 1 -- 172.21.15.144:0/3524875923 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0036070 con 0x7f91a8160990 2024-05-30T16:49:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.787+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a8159460 con 0x7f91a8160990 2024-05-30T16:49:53.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.788+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a80632f0 con 0x7f91a8160990 2024-05-30T16:49:53.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.790+0000 7f919fe00640 1 -- 172.21.15.144:0/3524875923 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f91a0042020 con 0x7f91a8160990 2024-05-30T16:49:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.791+0000 7f919fe00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f918406d610 0x7f918406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.791+0000 7f919fe00640 1 -- 172.21.15.144:0/3524875923 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f91a00aa9c0 con 0x7f91a8160990 2024-05-30T16:49:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.791+0000 7f91a7400640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f918406d610 0x7f918406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:53.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.792+0000 7f91a7400640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f918406d610 0x7f918406fad0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f91a80b2080 tx=0x7f9198007ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.796+0000 7f919fe00640 1 -- 172.21.15.144:0/3524875923 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91a0049030 con 0x7f91a8160990 2024-05-30T16:49:53.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.998+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f91a806ccf0 con 0x7f91a8160990 2024-05-30T16:49:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:53.999+0000 7f919fe00640 1 -- 172.21.15.144:0/3524875923 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7f91a007a230 con 0x7f91a8160990 2024-05-30T16:49:54.000 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-05-30T16:49:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.001+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f918406d610 msgr2=0x7f918406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.001+0000 7f91ace00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f918406d610 0x7f918406fad0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f91a80b2080 tx=0x7f9198007ce0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.001+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a8160990 msgr2=0x7f91a8157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.002+0000 7f91ace00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a8160990 0x7f91a8157350 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009f70 tx=0x7f91a0004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.002+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 shutdown_connections 2024-05-30T16:49:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.002+0000 7f91ace00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f918406d610 0x7f918406fad0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.002+0000 7f91ace00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91a8160990 0x7f91a8157350 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.002+0000 7f91ace00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91a8145f10 0x7f91a8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.002+0000 7f91ace00640 1 --2- 172.21.15.144:0/3524875923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91a806c3d0 0x7f91a815fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.002+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 >> 172.21.15.144:0/3524875923 conn(0x7f91a806b8e0 msgr2=0x7f91a806e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.002+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 shutdown_connections 2024-05-30T16:49:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.002+0000 7f91ace00640 1 -- 172.21.15.144:0/3524875923 wait complete. 2024-05-30T16:49:54.023 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added' 2024-05-30T16:49:54.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.221+0000 7f0967400640 1 Processor -- start 2024-05-30T16:49:54.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.222+0000 7f0967400640 1 -- start start 2024-05-30T16:49:54.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.223+0000 7f0967400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f09600b5150 0x7f096016d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.223+0000 7f0967400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096006fbf0 con 0x7f0960072210 2024-05-30T16:49:54.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.223+0000 7f0967400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09600cf050 con 0x7f096014c630 2024-05-30T16:49:54.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.223+0000 7f0967400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f09600cf330 con 0x7f09600b5150 2024-05-30T16:49:54.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f0957e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0960072210 0x7f0960072630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50826/0 (socket says 172.21.15.144:50826) 2024-05-30T16:49:54.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f0957e00640 1 -- 172.21.15.144:0/2421330396 learned_addr learned my addr 172.21.15.144:0/2421330396 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:54.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f0965400640 1 --2- 172.21.15.144:0/2421330396 >> v2:172.21.15.149:3300/0 conn(0x7f09600b5150 0x7f096016d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755937172 0 0) 0x7f096006fbf0 con 0x7f0960072210 2024-05-30T16:49:54.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0940003520 con 0x7f0960072210 2024-05-30T16:49:54.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 344447028 0 0) 0x7f0940003520 con 0x7f0960072210 2024-05-30T16:49:54.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 >> v2:172.21.15.149:3300/0 conn(0x7f09600b5150 msgr2=0x7f096016d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 --2- 172.21.15.144:0/2421330396 >> v2:172.21.15.149:3300/0 conn(0x7f09600b5150 0x7f096016d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 >> v1:172.21.15.149:6789/0 conn(0x7f096014c630 legacy=0x7f09600ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09600cf610 con 0x7f0960072210 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f0950001690 con 0x7f0960072210 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 >> v1:172.21.15.144:6789/0 conn(0x7f0960072210 legacy=0x7f0960072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.224+0000 7f095fe00640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09400039e0 0x7f0940003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f095fe00640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0940004800 0x7f0940004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f095fe00640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0940005210 0x7f094000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f09600cf330 con 0x7f0940004800 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f094000c120 con 0x7f09400039e0 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f094000c320 con 0x7f0940005210 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f0965400640 1 --2- 172.21.15.144:0/2421330396 >> v2:172.21.15.149:3300/0 conn(0x7f09600b5150 0x7f096016d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f0957e00640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0940004800 0x7f0940004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f0964a00640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09400039e0 0x7f0940003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f0957e00640 1 -- 172.21.15.144:0/2421330396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0940005210 msgr2=0x7f094000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f0957e00640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0940005210 0x7f094000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f0957e00640 1 -- 172.21.15.144:0/2421330396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09400039e0 msgr2=0x7f0940003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:54.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f0957e00640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09400039e0 0x7f0940003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f0957e00640 1 -- 172.21.15.144:0/2421330396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0940003520 con 0x7f0940004800 2024-05-30T16:49:54.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.225+0000 7f0965400640 1 -- 172.21.15.144:0/2421330396 reap_dead start 2024-05-30T16:49:54.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.226+0000 7f0957e00640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0940004800 0x7f0940004c80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0950007fd0 tx=0x7f0940005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d740ecce725f76 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950007d50 con 0x7f0940004800 2024-05-30T16:49:54.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09500058d0 con 0x7f0940004800 2024-05-30T16:49:54.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f095fe00640 1 -- 172.21.15.144:0/2421330396 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950005ca0 con 0x7f0940004800 2024-05-30T16:49:54.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f0967400640 1 -- 172.21.15.144:0/2421330396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0940004800 msgr2=0x7f0940004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f0967400640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0940004800 0x7f0940004c80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0950007fd0 tx=0x7f0940005830 comp rx=0 tx=0).stop 2024-05-30T16:49:54.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f0967400640 1 -- 172.21.15.144:0/2421330396 shutdown_connections 2024-05-30T16:49:54.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f0967400640 1 --2- 172.21.15.144:0/2421330396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0940004800 0x7f0940004c80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f0967400640 1 -- 172.21.15.144:0/2421330396 >> 172.21.15.144:0/2421330396 conn(0x7f096006bd00 msgr2=0x7f096006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:54.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f0967400640 1 -- 172.21.15.144:0/2421330396 shutdown_connections 2024-05-30T16:49:54.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.227+0000 7f0967400640 1 -- 172.21.15.144:0/2421330396 wait complete. 2024-05-30T16:49:54.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.229+0000 7f0967400640 1 Processor -- start 2024-05-30T16:49:54.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.229+0000 7f0967400640 1 -- start start 2024-05-30T16:49:54.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.230+0000 7f0967400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0940004800 0x7f09601632b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.230+0000 7f0967400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096013f2c0 0x7f09600aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.230+0000 7f0967400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096013f740 0x7f09600abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.230+0000 7f0967400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f096014ca10 con 0x7f096013f740 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.230+0000 7f0967400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f09600b3c20 con 0x7f0940004800 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.230+0000 7f0967400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f096014cb90 con 0x7f096013f2c0 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0965400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096013f740 0x7f09600abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0965400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096013f740 0x7f09600abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37226/0 (socket says 172.21.15.144:37226) 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0965400640 1 -- 172.21.15.144:0/3695755235 learned_addr learned my addr 172.21.15.144:0/3695755235 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0964a00640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0940004800 0x7f09601632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0957e00640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096013f2c0 0x7f09600aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0965400640 1 -- 172.21.15.144:0/3695755235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096013f2c0 msgr2=0x7f09600aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0965400640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096013f2c0 0x7f09600aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0965400640 1 -- 172.21.15.144:0/3695755235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0940004800 msgr2=0x7f09601632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0965400640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0940004800 0x7f09601632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:54.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.231+0000 7f0965400640 1 -- 172.21.15.144:0/3695755235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0960161f30 con 0x7f096013f740 2024-05-30T16:49:54.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.232+0000 7f0965400640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096013f740 0x7f09600abdd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f09600cd7a0 tx=0x7f095800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.232+0000 7f095d600640 1 -- 172.21.15.144:0/3695755235 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095801a070 con 0x7f096013f740 2024-05-30T16:49:54.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.232+0000 7f095d600640 1 -- 172.21.15.144:0/3695755235 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0958003990 con 0x7f096013f740 2024-05-30T16:49:54.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.232+0000 7f095d600640 1 -- 172.21.15.144:0/3695755235 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958003d80 con 0x7f096013f740 2024-05-30T16:49:54.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.232+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0960162210 con 0x7f096013f740 2024-05-30T16:49:54.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.232+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09601627d0 con 0x7f096013f740 2024-05-30T16:49:54.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.233+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09600ae280 con 0x7f096013f740 2024-05-30T16:49:54.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.234+0000 7f095d600640 1 -- 172.21.15.144:0/3695755235 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f095801d070 con 0x7f096013f740 2024-05-30T16:49:54.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.235+0000 7f095d600640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f093c06d5e0 0x7f093c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:54.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.235+0000 7f095d600640 1 -- 172.21.15.144:0/3695755235 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f095808a590 con 0x7f096013f740 2024-05-30T16:49:54.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.235+0000 7f0964a00640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f093c06d5e0 0x7f093c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:54.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.236+0000 7f0964a00640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f093c06d5e0 0x7f093c06faa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f09600746d0 tx=0x7f0948009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:54.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.239+0000 7f095d600640 1 -- 172.21.15.144:0/3695755235 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f09600ae280 con 0x7f096013f740 2024-05-30T16:49:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:54.510+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]} v 0) -- 0x7f0960068b90 con 0x7f096013f740 2024-05-30T16:49:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.108+0000 7f095d600640 1 -- 172.21.15.144:0/3695755235 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]}]=0 v353) ==== 177+0+0 (secure 0 0 0) 0x7f0958010070 con 0x7f096013f740 2024-05-30T16:49:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.111+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f093c06d5e0 msgr2=0x7f093c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.111+0000 7f0967400640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f093c06d5e0 0x7f093c06faa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f09600746d0 tx=0x7f0948009040 comp rx=0 tx=0).stop 2024-05-30T16:49:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.111+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096013f740 msgr2=0x7f09600abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.111+0000 7f0967400640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096013f740 0x7f09600abdd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f09600cd7a0 tx=0x7f095800d4a0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.111+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 shutdown_connections 2024-05-30T16:49:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.111+0000 7f0967400640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f093c06d5e0 0x7f093c06faa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.111+0000 7f0967400640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f096013f740 0x7f09600abdd0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.111+0000 7f0967400640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f096013f2c0 0x7f09600aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.111+0000 7f0967400640 1 --2- 172.21.15.144:0/3695755235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0940004800 0x7f09601632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.112+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 >> 172.21.15.144:0/3695755235 conn(0x7f096006bd00 msgr2=0x7f096006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.112+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 shutdown_connections 2024-05-30T16:49:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.112+0000 7f0967400640 1 -- 172.21.15.144:0/3695755235 wait complete. 2024-05-30T16:49:55.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:49:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.335+0000 7f66d8200640 1 Processor -- start 2024-05-30T16:49:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.335+0000 7f66d8200640 1 -- start start 2024-05-30T16:49:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.337+0000 7f66d8200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66d006ee20 0x7f66d015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.337+0000 7f66d8200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d00b3fd0 con 0x7f66d01418f0 2024-05-30T16:49:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.337+0000 7f66d8200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d0144790 con 0x7f66d0141510 2024-05-30T16:49:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.337+0000 7f66d8200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f66d006dfc0 con 0x7f66d006ee20 2024-05-30T16:49:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.337+0000 7f66d4e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f66d01418f0 0x7f66d006e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33816/0 (socket says 172.21.15.144:33816) 2024-05-30T16:49:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.337+0000 7f66d4e00640 1 -- 172.21.15.144:0/2532517496 learned_addr learned my addr 172.21.15.144:0/2532517496 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.337+0000 7f66d6200640 1 --2- 172.21.15.144:0/2532517496 >> v2:172.21.15.144:3300/0 conn(0x7f66d006ee20 0x7f66d015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.338+0000 7f66d6200640 1 -- 172.21.15.144:0/2532517496 >> v1:172.21.15.149:6789/0 conn(0x7f66d0141510 legacy=0x7f66d00b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.338+0000 7f66d6200640 1 -- 172.21.15.144:0/2532517496 >> v1:172.21.15.144:6789/0 conn(0x7f66d01418f0 legacy=0x7f66d006e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.338+0000 7f66d6200640 1 -- 172.21.15.144:0/2532517496 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d0144a70 con 0x7f66d006ee20 2024-05-30T16:49:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.339+0000 7f66d6200640 1 --2- 172.21.15.144:0/2532517496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d006ee20 0x7f66d015f8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009d90 tx=0x7f66c802a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1ff00ced156eae server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.339+0000 7f66cfe00640 1 -- 172.21.15.144:0/2532517496 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8007740 con 0x7f66d006ee20 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.339+0000 7f66cfe00640 1 -- 172.21.15.144:0/2532517496 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c80078e0 con 0x7f66d006ee20 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.339+0000 7f66cfe00640 1 -- 172.21.15.144:0/2532517496 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8007cb0 con 0x7f66d006ee20 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.339+0000 7f66d8200640 1 -- 172.21.15.144:0/2532517496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d006ee20 msgr2=0x7f66d015f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.339+0000 7f66d8200640 1 --2- 172.21.15.144:0/2532517496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d006ee20 0x7f66d015f8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009d90 tx=0x7f66c802a590 comp rx=0 tx=0).stop 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.340+0000 7f66d8200640 1 -- 172.21.15.144:0/2532517496 shutdown_connections 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.340+0000 7f66d8200640 1 --2- 172.21.15.144:0/2532517496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d006ee20 0x7f66d015f8f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.340+0000 7f66d8200640 1 -- 172.21.15.144:0/2532517496 >> 172.21.15.144:0/2532517496 conn(0x7f66d006bd00 msgr2=0x7f66d006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.340+0000 7f66d8200640 1 -- 172.21.15.144:0/2532517496 shutdown_connections 2024-05-30T16:49:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.340+0000 7f66d8200640 1 -- 172.21.15.144:0/2532517496 wait complete. 2024-05-30T16:49:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.341+0000 7f66d8200640 1 Processor -- start 2024-05-30T16:49:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.341+0000 7f66d8200640 1 -- start start 2024-05-30T16:49:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.342+0000 7f66d8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d006ee20 0x7f66d01f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.342+0000 7f66d8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d0141510 0x7f66d013ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.342+0000 7f66d8200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d01418f0 0x7f66d0160480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.342+0000 7f66d8200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00b5b50 con 0x7f66d01418f0 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.342+0000 7f66d8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f66d006e210 con 0x7f66d0141510 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.342+0000 7f66d8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f66d00b5cd0 con 0x7f66d006ee20 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d01418f0 0x7f66d0160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d01418f0 0x7f66d0160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59298/0 (socket says 172.21.15.144:59298) 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d6200640 1 -- 172.21.15.144:0/468108985 learned_addr learned my addr 172.21.15.144:0/468108985 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d5800640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d006ee20 0x7f66d01f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d4e00640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d0141510 0x7f66d013ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d6200640 1 -- 172.21.15.144:0/468108985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d006ee20 msgr2=0x7f66d01f83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d6200640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d006ee20 0x7f66d01f83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d6200640 1 -- 172.21.15.144:0/468108985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d0141510 msgr2=0x7f66d013ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d6200640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d0141510 0x7f66d013ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d6200640 1 -- 172.21.15.144:0/468108985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d0145d60 con 0x7f66d01418f0 2024-05-30T16:49:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.343+0000 7f66d6200640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d01418f0 0x7f66d0160480 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009d90 tx=0x7f66c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.344+0000 7f66cd600640 1 -- 172.21.15.144:0/468108985 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8040070 con 0x7f66d01418f0 2024-05-30T16:49:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.344+0000 7f66cd600640 1 -- 172.21.15.144:0/468108985 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c8031c90 con 0x7f66d01418f0 2024-05-30T16:49:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.344+0000 7f66cd600640 1 -- 172.21.15.144:0/468108985 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c803c640 con 0x7f66d01418f0 2024-05-30T16:49:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.344+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d0146040 con 0x7f66d01418f0 2024-05-30T16:49:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.344+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d0146600 con 0x7f66d01418f0 2024-05-30T16:49:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.345+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d0068b90 con 0x7f66d01418f0 2024-05-30T16:49:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.346+0000 7f66cd600640 1 -- 172.21.15.144:0/468108985 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f66c8039040 con 0x7f66d01418f0 2024-05-30T16:49:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.347+0000 7f66cd600640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f66b006d610 0x7f66b006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.347+0000 7f66cd600640 1 -- 172.21.15.144:0/468108985 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f66c80abba0 con 0x7f66d01418f0 2024-05-30T16:49:55.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.347+0000 7f66d5800640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f66b006d610 0x7f66b006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:55.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.348+0000 7f66d5800640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f66b006d610 0x7f66b006fad0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66c4004ea0 tx=0x7f66c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:55.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.352+0000 7f66cd600640 1 -- 172.21.15.144:0/468108985 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f66c804b340 con 0x7f66d01418f0 2024-05-30T16:49:55.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.550+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f66d006cf20 con 0x7f66d01418f0 2024-05-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.556+0000 7f66cd600640 1 -- 172.21.15.144:0/468108985 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f66c807bae0 con 0x7f66d01418f0 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f66b006d610 msgr2=0x7f66b006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f66b006d610 0x7f66b006fad0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66c4004ea0 tx=0x7f66c4009040 comp rx=0 tx=0).stop 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d01418f0 msgr2=0x7f66d0160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d01418f0 0x7f66d0160480 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009d90 tx=0x7f66c8004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 shutdown_connections 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f66b006d610 0x7f66b006fad0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d01418f0 0x7f66d0160480 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d0141510 0x7f66d013ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 --2- 172.21.15.144:0/468108985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d006ee20 0x7f66d01f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 >> 172.21.15.144:0/468108985 conn(0x7f66d006bd00 msgr2=0x7f66d00cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.559+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 shutdown_connections 2024-05-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:55.560+0000 7f66d8200640 1 -- 172.21.15.144:0/468108985 wait complete. 2024-05-30T16:49:55.579 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T16:49:55.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:49:55.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T16:49:55.806 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T16:49:55.807 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:49:55.807 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:55.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:49:55.863 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:49:55.863 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:55.923 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:49:55.923 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:49:55.923 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:55.981 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:49:55.982 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:49:55.982 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:49:56.039 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:49:56.039 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T16:49:56.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:49:56.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.246+0000 7f5d3f200640 1 Processor -- start 2024-05-30T16:49:56.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.246+0000 7f5d3f200640 1 -- start start 2024-05-30T16:49:56.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.248+0000 7f5d3f200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d400caf10 0x7f5d4015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.248+0000 7f5d3f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d400cf8b0 0x7f5d400b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.248+0000 7f5d3f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4015f500 con 0x7f5d400cb2f0 2024-05-30T16:49:56.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.248+0000 7f5d3f200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4015f780 con 0x7f5d400caf10 2024-05-30T16:49:56.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.248+0000 7f5d3f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4015fa60 con 0x7f5d400cf8b0 2024-05-30T16:49:56.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.248+0000 7f5d3d400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5d400cb2f0 0x7f5d4015c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33824/0 (socket says 172.21.15.144:33824) 2024-05-30T16:49:56.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.248+0000 7f5d3d400640 1 -- 172.21.15.144:0/2226205829 learned_addr learned my addr 172.21.15.144:0/2226205829 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:56.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3e800640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d400cf8b0 0x7f5d400b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095916708 0 0) 0x7f5d28001490 con 0x7f5d400cb2f0 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d20003520 con 0x7f5d400cb2f0 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3de00640 1 --2- 172.21.15.144:0/2226205829 >> v2:172.21.15.149:3300/0 conn(0x7f5d400caf10 0x7f5d4015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2754990119 0 0) 0x7f5d20003520 con 0x7f5d400cb2f0 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d400cf8b0 msgr2=0x7f5d400b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d400cf8b0 0x7f5d400b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 >> v2:172.21.15.149:3300/0 conn(0x7f5d400caf10 msgr2=0x7f5d4015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 --2- 172.21.15.144:0/2226205829 >> v2:172.21.15.149:3300/0 conn(0x7f5d400caf10 0x7f5d4015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4015fd40 con 0x7f5d400cb2f0 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f5d28001bc0 con 0x7f5d400cb2f0 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3de00640 1 --2- 172.21.15.144:0/2226205829 >> v2:172.21.15.149:3300/0 conn(0x7f5d400caf10 0x7f5d4015efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 >> v1:172.21.15.144:6789/0 conn(0x7f5d400cb2f0 legacy=0x7f5d4015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d400cf8b0 0x7f5d200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d20003f30 0x7f5d20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d20004d40 0x7f5d200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4015f780 con 0x7f5d20004d40 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4015fa60 con 0x7f5d20003f30 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.249+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2000dd00 con 0x7f5d400cf8b0 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.250+0000 7f5d3e800640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d20004d40 0x7f5d200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.250+0000 7f5d3d400640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d20003f30 0x7f5d20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.250+0000 7f5d3e800640 1 -- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d400cf8b0 msgr2=0x7f5d200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.250+0000 7f5d3e800640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d400cf8b0 0x7f5d200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.250+0000 7f5d3e800640 1 -- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d20003f30 msgr2=0x7f5d20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.250+0000 7f5d3e800640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d20003f30 0x7f5d20004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.250+0000 7f5d3e800640 1 -- 172.21.15.144:0/2226205829 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d20003520 con 0x7f5d20004d40 2024-05-30T16:49:56.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.251+0000 7f5d3e800640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d20004d40 0x7f5d200051c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009ac0 tx=0x7f5d20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a52fa70922f599 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.251+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d38036070 con 0x7f5d20004d40 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.251+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d38031400 con 0x7f5d20004d40 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.251+0000 7f5d3ca00640 1 -- 172.21.15.144:0/2226205829 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d38009690 con 0x7f5d20004d40 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.252+0000 7f5d3f200640 1 -- 172.21.15.144:0/2226205829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d20004d40 msgr2=0x7f5d200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.252+0000 7f5d3f200640 1 --2- 172.21.15.144:0/2226205829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d20004d40 0x7f5d200051c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009ac0 tx=0x7f5d20005830 comp rx=0 tx=0).stop 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.252+0000 7f5d3e800640 1 -- 172.21.15.144:0/2226205829 reap_dead start 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.252+0000 7f5d3f200640 1 -- 172.21.15.144:0/2226205829 shutdown_connections 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.252+0000 7f5d3f200640 1 -- 172.21.15.144:0/2226205829 >> 172.21.15.144:0/2226205829 conn(0x7f5d400b20a0 msgr2=0x7f5d400b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.252+0000 7f5d3f200640 1 -- 172.21.15.144:0/2226205829 shutdown_connections 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.252+0000 7f5d3f200640 1 -- 172.21.15.144:0/2226205829 wait complete. 2024-05-30T16:49:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.254+0000 7f5d3f200640 1 Processor -- start 2024-05-30T16:49:56.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.254+0000 7f5d3f200640 1 -- start start 2024-05-30T16:49:56.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d401f79d0 0x7f5d401f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d400adc30 0x7f5d400ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d4015a450 0x7f5d4015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4015bad0 con 0x7f5d400adc30 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4015b950 con 0x7f5d4015a450 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d400b31c0 con 0x7f5d401f79d0 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d400adc30 0x7f5d400ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d400adc30 0x7f5d400ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59324/0 (socket says 172.21.15.144:59324) 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3d400640 1 -- 172.21.15.144:0/772935666 learned_addr learned my addr 172.21.15.144:0/772935666 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3e800640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d4015a450 0x7f5d4015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3de00640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d401f79d0 0x7f5d401f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.255+0000 7f5d3d400640 1 -- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d401f79d0 msgr2=0x7f5d401f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d3d400640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d401f79d0 0x7f5d401f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d3d400640 1 -- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d4015a450 msgr2=0x7f5d4015a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d3d400640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d4015a450 0x7f5d4015a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d3d400640 1 -- 172.21.15.144:0/772935666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d400ae710 con 0x7f5d400adc30 2024-05-30T16:49:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d3e800640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d4015a450 0x7f5d4015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d3de00640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d401f79d0 0x7f5d401f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d3d400640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d400adc30 0x7f5d400ae0b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800dfd0 tx=0x7f5d2800b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d36000640 1 -- 172.21.15.144:0/772935666 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28019070 con 0x7f5d400adc30 2024-05-30T16:49:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d36000640 1 -- 172.21.15.144:0/772935666 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d280072d0 con 0x7f5d400adc30 2024-05-30T16:49:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d36000640 1 -- 172.21.15.144:0/772935666 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280076c0 con 0x7f5d400adc30 2024-05-30T16:49:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d40153be0 con 0x7f5d400adc30 2024-05-30T16:49:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.256+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d401541a0 con 0x7f5d400adc30 2024-05-30T16:49:56.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.257+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d400ca7f0 con 0x7f5d400adc30 2024-05-30T16:49:56.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.258+0000 7f5d36000640 1 -- 172.21.15.144:0/772935666 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f5d28007860 con 0x7f5d400adc30 2024-05-30T16:49:56.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.259+0000 7f5d36000640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d1c06d5e0 0x7f5d1c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.259+0000 7f5d36000640 1 -- 172.21.15.144:0/772935666 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f5d2808aea0 con 0x7f5d400adc30 2024-05-30T16:49:56.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.260+0000 7f5d3de00640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d1c06d5e0 0x7f5d1c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.260+0000 7f5d3de00640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d1c06d5e0 0x7f5d1c06faa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5d30006fd0 tx=0x7f5d30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.264+0000 7f5d36000640 1 -- 172.21.15.144:0/772935666 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5d400ca7f0 con 0x7f5d400adc30 2024-05-30T16:49:56.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.484+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d40075570 con 0x7f5d400adc30 2024-05-30T16:49:56.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.485+0000 7f5d36000640 1 -- 172.21.15.144:0/772935666 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+3881 (secure 0 0 0) 0x7f5d4015f500 con 0x7f5d400adc30 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/4221007288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":4221007288},{"type":"v1","addr":"172.21.15.144:6837","nonce":4221007288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5155,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/2104436930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2104436930},{"type":"v1","addr":"172.21.15.149:6833","nonce":2104436930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2742911992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2742911992},{"type":"v1","addr":"172.21.15.149:6835","nonce":2742911992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6351,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2873656704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2873656704},{"type":"v1","addr":"172.21.15.144:6835","nonce":2873656704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[]} 2024-05-30T16:49:56.487 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 38 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.487+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d1c06d5e0 msgr2=0x7f5d1c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.487+0000 7f5d3f200640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d1c06d5e0 0x7f5d1c06faa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5d30006fd0 tx=0x7f5d30008040 comp rx=0 tx=0).stop 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.487+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d400adc30 msgr2=0x7f5d400ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.487+0000 7f5d3f200640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d400adc30 0x7f5d400ae0b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800dfd0 tx=0x7f5d2800b560 comp rx=0 tx=0).stop 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.488+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 shutdown_connections 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.488+0000 7f5d3f200640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d1c06d5e0 0x7f5d1c06faa0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.488+0000 7f5d3f200640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d4015a450 0x7f5d4015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.488+0000 7f5d3f200640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d400adc30 0x7f5d400ae0b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.488+0000 7f5d3f200640 1 --2- 172.21.15.144:0/772935666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d401f79d0 0x7f5d401f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.488+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 >> 172.21.15.144:0/772935666 conn(0x7f5d400b20a0 msgr2=0x7f5d400b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.488+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 shutdown_connections 2024-05-30T16:49:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.488+0000 7f5d3f200640 1 -- 172.21.15.144:0/772935666 wait complete. 2024-05-30T16:49:56.506 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T16:49:56.506 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T16:49:56.507 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:49:56.507 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:56.507 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T16:49:56.507 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T16:49:56.507 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:49:56.507 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:56.507 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T16:49:56.508 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T16:49:56.508 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:49:56.508 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:56.508 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T16:49:56.508 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T16:49:56.508 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:49:56.508 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:49:56.526 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:49:56.526 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T16:49:56.528 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:49:56.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T16:49:56.529 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:49:56.529 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T16:49:56.530 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:49:56.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T16:49:56.573 INFO:tasks.ceph.mds.c:Started 2024-05-30T16:49:56.574 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:56.574 INFO:tasks.ceph.mds.b:Started 2024-05-30T16:49:56.575 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:56.578 INFO:tasks.ceph.mds.a:Started 2024-05-30T16:49:56.579 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:56.579 INFO:tasks.ceph.mds.d:Started 2024-05-30T16:49:56.579 DEBUG:teuthology.parallel:result is None 2024-05-30T16:49:56.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T16:49:56.713 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-05-30T16:49:56.717 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-05-30T16:49:56.724 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-05-30T16:49:56.729 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-05-30T16:49:56.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.749+0000 7fabc1e00640 1 Processor -- start 2024-05-30T16:49:56.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.749+0000 7fabc1e00640 1 -- start start 2024-05-30T16:49:56.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.751+0000 7fabc1e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fabbc15da50 0x7fabbc1604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.751+0000 7fabc1e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabbc15de60 con 0x7fabbc0ce390 2024-05-30T16:49:56.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.751+0000 7fabc1e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabbc160c40 con 0x7fabbc15e090 2024-05-30T16:49:56.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.751+0000 7fabc1e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fabbc160a00 con 0x7fabbc15da50 2024-05-30T16:49:56.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.751+0000 7fabbaa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fabbc0ce390 0x7fabbc0ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33852/0 (socket says 172.21.15.144:33852) 2024-05-30T16:49:56.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.751+0000 7fabbaa00640 1 -- 172.21.15.144:0/3149360383 learned_addr learned my addr 172.21.15.144:0/3149360383 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.751+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692312273 0 0) 0x7fabbc15de60 con 0x7fabbc0ce390 2024-05-30T16:49:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.751+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faba0003520 con 0x7fabbc0ce390 2024-05-30T16:49:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.751+0000 7fabbb400640 1 --2- 172.21.15.144:0/3149360383 >> v2:172.21.15.149:3300/0 conn(0x7fabbc15da50 0x7fabbc1604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1494529536 0 0) 0x7faba0003520 con 0x7fabbc0ce390 2024-05-30T16:49:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 >> v2:172.21.15.149:3300/0 conn(0x7fabbc15da50 msgr2=0x7fabbc1604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 --2- 172.21.15.144:0/3149360383 >> v2:172.21.15.149:3300/0 conn(0x7fabbc15da50 0x7fabbc1604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 >> v1:172.21.15.149:6789/0 conn(0x7fabbc15e090 legacy=0x7fabbc06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabbc160f20 con 0x7fabbc0ce390 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fabac0019f0 con 0x7fabbc0ce390 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 >> v1:172.21.15.144:6789/0 conn(0x7fabbc0ce390 legacy=0x7fabbc0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faba00039b0 0x7faba0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faba0004800 0x7faba0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba00099b0 0x7faba00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc160a00 con 0x7faba00099b0 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faba0014870 con 0x7faba00039b0 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faba0014a70 con 0x7faba0004800 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabbb400640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba00099b0 0x7faba00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabbaa00640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faba00039b0 0x7faba0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.752+0000 7fabba000640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faba0004800 0x7faba0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.753+0000 7fabbb400640 1 -- 172.21.15.144:0/3149360383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faba0004800 msgr2=0x7faba0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.753+0000 7fabbb400640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faba0004800 0x7faba0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.753+0000 7fabbb400640 1 -- 172.21.15.144:0/3149360383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faba00039b0 msgr2=0x7faba0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.753+0000 7fabbb400640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faba00039b0 0x7faba0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.753+0000 7fabbb400640 1 -- 172.21.15.144:0/3149360383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba0003520 con 0x7faba00099b0 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.753+0000 7fabbb400640 1 -- 172.21.15.144:0/3149360383 reap_dead start 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.754+0000 7fabbb400640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba00099b0 0x7faba00051e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009ac0 tx=0x7faba0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9945db2a0d5a40e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.754+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4009690 con 0x7faba00099b0 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.754+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb4004020 con 0x7faba00099b0 2024-05-30T16:49:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.754+0000 7fabb9600640 1 -- 172.21.15.144:0/3149360383 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4004410 con 0x7faba00099b0 2024-05-30T16:49:56.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.754+0000 7fabc1e00640 1 -- 172.21.15.144:0/3149360383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba00099b0 msgr2=0x7faba00051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.754+0000 7fabc1e00640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba00099b0 0x7faba00051e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009ac0 tx=0x7faba0005830 comp rx=0 tx=0).stop 2024-05-30T16:49:56.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.754+0000 7fabc1e00640 1 -- 172.21.15.144:0/3149360383 shutdown_connections 2024-05-30T16:49:56.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.754+0000 7fabc1e00640 1 --2- 172.21.15.144:0/3149360383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba00099b0 0x7faba00051e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.754+0000 7fabc1e00640 1 -- 172.21.15.144:0/3149360383 >> 172.21.15.144:0/3149360383 conn(0x7fabbc0629c0 msgr2=0x7fabbc06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:56.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.755+0000 7fabc1e00640 1 -- 172.21.15.144:0/3149360383 shutdown_connections 2024-05-30T16:49:56.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.755+0000 7fabc1e00640 1 -- 172.21.15.144:0/3149360383 wait complete. 2024-05-30T16:49:56.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.756+0000 7fabc1e00640 1 Processor -- start 2024-05-30T16:49:56.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.756+0000 7fabc1e00640 1 -- start start 2024-05-30T16:49:56.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.757+0000 7fabc1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabbc15a300 0x7fabbc0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.757+0000 7fabc1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc15c2a0 0x7fabbc0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.757+0000 7fabc1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabbc1eff50 0x7fabbc1f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.757+0000 7fabc1e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc143130 con 0x7fabbc15c2a0 2024-05-30T16:49:56.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.757+0000 7fabc1e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc06e550 con 0x7fabbc1eff50 2024-05-30T16:49:56.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.757+0000 7fabc1e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fabbc1432b0 con 0x7fabbc15a300 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.757+0000 7fabba000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc15c2a0 0x7fabbc0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabbb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabbc1eff50 0x7fabbc1f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabbaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabbc15a300 0x7fabbc0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabba000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc15c2a0 0x7fabbc0b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59378/0 (socket says 172.21.15.144:59378) 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabba000640 1 -- 172.21.15.144:0/1790298692 learned_addr learned my addr 172.21.15.144:0/1790298692 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabba000640 1 -- 172.21.15.144:0/1790298692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabbc15a300 msgr2=0x7fabbc0b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabba000640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabbc15a300 0x7fabbc0b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabba000640 1 -- 172.21.15.144:0/1790298692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabbc1eff50 msgr2=0x7fabbc1f03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabba000640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabbc1eff50 0x7fabbc1f03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabba000640 1 -- 172.21.15.144:0/1790298692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabbc15b500 con 0x7fabbc15c2a0 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabba000640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc15c2a0 0x7fabbc0b3570 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faba800f5f0 tx=0x7faba800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.758+0000 7fabb3400640 1 -- 172.21.15.144:0/1790298692 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba80052e0 con 0x7fabbc15c2a0 2024-05-30T16:49:56.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.759+0000 7fabb3400640 1 -- 172.21.15.144:0/1790298692 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba8018070 con 0x7fabbc15c2a0 2024-05-30T16:49:56.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.759+0000 7fabb3400640 1 -- 172.21.15.144:0/1790298692 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8003810 con 0x7fabbc15c2a0 2024-05-30T16:49:56.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.759+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabbc1f0920 con 0x7fabbc15c2a0 2024-05-30T16:49:56.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.759+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabbc15b7c0 con 0x7fabbc15c2a0 2024-05-30T16:49:56.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.760+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabbc06c870 con 0x7fabbc15c2a0 2024-05-30T16:49:56.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.761+0000 7fabb3400640 1 -- 172.21.15.144:0/1790298692 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7faba80039b0 con 0x7fabbc15c2a0 2024-05-30T16:49:56.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.762+0000 7fabb3400640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab9c06d5e0 0x7fab9c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:56.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.762+0000 7fabb3400640 1 -- 172.21.15.144:0/1790298692 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7faba808a4e0 con 0x7fabbc15c2a0 2024-05-30T16:49:56.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.762+0000 7fabbaa00640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab9c06d5e0 0x7fab9c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:56.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.763+0000 7fabbaa00640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab9c06d5e0 0x7fab9c06faa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fabac002050 tx=0x7fabac006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:56.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.766+0000 7fabb3400640 1 -- 172.21.15.144:0/1790298692 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faba8090030 con 0x7fabbc15c2a0 2024-05-30T16:49:56.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:56.976+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fabbc06ba10 con 0x7fabbc15c2a0 2024-05-30T16:49:57.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.142+0000 7fabb3400640 1 -- 172.21.15.144:0/1790298692 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) ==== 97+0+0 (secure 0 0 0) 0x7faba8059ac0 con 0x7fabbc15c2a0 2024-05-30T16:49:57.144 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-05-30T16:49:57.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab9c06d5e0 msgr2=0x7fab9c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab9c06d5e0 0x7fab9c06faa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fabac002050 tx=0x7fabac006040 comp rx=0 tx=0).stop 2024-05-30T16:49:57.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc15c2a0 msgr2=0x7fabbc0b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc15c2a0 0x7fabbc0b3570 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faba800f5f0 tx=0x7faba800fab0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 shutdown_connections 2024-05-30T16:49:57.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fab9c06d5e0 0x7fab9c06faa0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabbc1eff50 0x7fabbc1f03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabbc15c2a0 0x7fabbc0b3570 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 --2- 172.21.15.144:0/1790298692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabbc15a300 0x7fabbc0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.145+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 >> 172.21.15.144:0/1790298692 conn(0x7fabbc0629c0 msgr2=0x7fabbc15e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.146+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 shutdown_connections 2024-05-30T16:49:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.146+0000 7fabc1e00640 1 -- 172.21.15.144:0/1790298692 wait complete. 2024-05-30T16:49:57.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T16:49:57.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.358+0000 7f08a5600640 1 Processor -- start 2024-05-30T16:49:57.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.358+0000 7f08a5600640 1 -- start start 2024-05-30T16:49:57.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.360+0000 7f08a5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a013f760 0x7f08a006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.360+0000 7f08a5600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a006ee80 con 0x7f08a00b5fd0 2024-05-30T16:49:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.360+0000 7f08a5600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a0160730 con 0x7f08a00cec70 2024-05-30T16:49:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.360+0000 7f08a5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f08a01612b0 con 0x7f08a013f760 2024-05-30T16:49:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.360+0000 7f089f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f08a00b5fd0 0x7f08a0142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33864/0 (socket says 172.21.15.144:33864) 2024-05-30T16:49:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089f400640 1 -- 172.21.15.144:0/1784277917 learned_addr learned my addr 172.21.15.144:0/1784277917 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089ea00640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a013f760 0x7f08a006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4145060744 0 0) 0x7f08a006ee80 con 0x7f08a00b5fd0 2024-05-30T16:49:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0884003520 con 0x7f08a00b5fd0 2024-05-30T16:49:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1260651481 0 0) 0x7f0884003520 con 0x7f08a00b5fd0 2024-05-30T16:49:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a013f760 msgr2=0x7f08a006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089e000640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a013f760 0x7f08a006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 >> v1:172.21.15.149:6789/0 conn(0x7f08a00cec70 legacy=0x7f08a00b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a0160a10 con 0x7f08a00b5fd0 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f08980019f0 con 0x7f08a00b5fd0 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.361+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 >> v1:172.21.15.144:6789/0 conn(0x7f08a00b5fd0 legacy=0x7f08a0142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089e000640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08840039e0 0x7f0884003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089e000640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004800 0x7f0884004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089e000640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a013f760 0x7f08840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f08a01612b0 con 0x7f08840039e0 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f088400bb00 con 0x7f0884004800 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f088400bd00 con 0x7f08a013f760 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089ea00640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08840039e0 0x7f0884003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f0896000640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004800 0x7f0884004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089ea00640 1 -- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a013f760 msgr2=0x7f08840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089ea00640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a013f760 0x7f08840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089ea00640 1 -- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004800 msgr2=0x7f0884004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:57.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089ea00640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004800 0x7f0884004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.362+0000 7f089ea00640 1 -- 172.21.15.144:0/1784277917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0884003520 con 0x7f08840039e0 2024-05-30T16:49:57.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.363+0000 7f089ea00640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08840039e0 0x7f0884003e00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0890009a90 tx=0x7f0884005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e545bc4af59192e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890036070 con 0x7f08840039e0 2024-05-30T16:49:57.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0890031400 con 0x7f08840039e0 2024-05-30T16:49:57.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f089e000640 1 -- 172.21.15.144:0/1784277917 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890009690 con 0x7f08840039e0 2024-05-30T16:49:57.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f08a5600640 1 -- 172.21.15.144:0/1784277917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08840039e0 msgr2=0x7f0884003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f08a5600640 1 --2- 172.21.15.144:0/1784277917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08840039e0 0x7f0884003e00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0890009a90 tx=0x7f0884005830 comp rx=0 tx=0).stop 2024-05-30T16:49:57.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f089f400640 1 -- 172.21.15.144:0/1784277917 reap_dead start 2024-05-30T16:49:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f08a5600640 1 -- 172.21.15.144:0/1784277917 shutdown_connections 2024-05-30T16:49:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f08a5600640 1 -- 172.21.15.144:0/1784277917 >> 172.21.15.144:0/1784277917 conn(0x7f08a006bd00 msgr2=0x7f08a006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f08a5600640 1 -- 172.21.15.144:0/1784277917 shutdown_connections 2024-05-30T16:49:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.364+0000 7f08a5600640 1 -- 172.21.15.144:0/1784277917 wait complete. 2024-05-30T16:49:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.366+0000 7f08a5600640 1 Processor -- start 2024-05-30T16:49:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.366+0000 7f08a5600640 1 -- start start 2024-05-30T16:49:57.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.367+0000 7f08a5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08840039e0 0x7f08a015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.367+0000 7f08a5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a00b1300 0x7f08a00b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.367+0000 7f08a5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a01564f0 0x7f08a0156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.367+0000 7f08a5600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f08a0160fd0 con 0x7f08a00b1300 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.367+0000 7f08a5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f08a00cf0d0 con 0x7f08a01564f0 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.367+0000 7f08a5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f08a00cf250 con 0x7f08840039e0 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.367+0000 7f0896000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a00b1300 0x7f08a00b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.367+0000 7f0896000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a00b1300 0x7f08a00b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59394/0 (socket says 172.21.15.144:59394) 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.367+0000 7f0896000640 1 -- 172.21.15.144:0/200686195 learned_addr learned my addr 172.21.15.144:0/200686195 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f089ea00640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08840039e0 0x7f08a015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f089f400640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a01564f0 0x7f08a0156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f0896000640 1 -- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08840039e0 msgr2=0x7f08a015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f0896000640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08840039e0 0x7f08a015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f0896000640 1 -- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a01564f0 msgr2=0x7f08a0156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f0896000640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a01564f0 0x7f08a0156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f0896000640 1 -- 172.21.15.144:0/200686195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a00aa300 con 0x7f08a00b1300 2024-05-30T16:49:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f089f400640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a01564f0 0x7f08a0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f089ea00640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08840039e0 0x7f08a015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f0896000640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a00b1300 0x7f08a00b1780 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f088800e580 tx=0x7f088800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f0897400640 1 -- 172.21.15.144:0/200686195 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08880052e0 con 0x7f08a00b1300 2024-05-30T16:49:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f0897400640 1 -- 172.21.15.144:0/200686195 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0888018070 con 0x7f08a00b1300 2024-05-30T16:49:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a00b1e70 con 0x7f08a00b1300 2024-05-30T16:49:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f0897400640 1 -- 172.21.15.144:0/200686195 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888003810 con 0x7f08a00b1300 2024-05-30T16:49:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.368+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a00b2430 con 0x7f08a00b1300 2024-05-30T16:49:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.370+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a0068b90 con 0x7f08a00b1300 2024-05-30T16:49:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.371+0000 7f0897400640 1 -- 172.21.15.144:0/200686195 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f08880039b0 con 0x7f08a00b1300 2024-05-30T16:49:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.372+0000 7f0897400640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f087c06d5e0 0x7f087c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.372+0000 7f0897400640 1 -- 172.21.15.144:0/200686195 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4885+0+0 (secure 0 0 0) 0x7f088808a550 con 0x7f08a00b1300 2024-05-30T16:49:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.372+0000 7f089ea00640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f087c06d5e0 0x7f087c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.373+0000 7f089ea00640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f087c06d5e0 0x7f087c06faa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0890033000 tx=0x7f0890008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.377+0000 7f0897400640 1 -- 172.21.15.144:0/200686195 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f088805a120 con 0x7f08a00b1300 2024-05-30T16:49:57.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.644+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f08a00b2630 con 0x7f08a00b1300 2024-05-30T16:49:57.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.645+0000 7f0897400640 1 -- 172.21.15.144:0/200686195 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f0888059a20 con 0x7f08a00b1300 2024-05-30T16:49:57.646 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:57.646 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:49:57.646 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-05-30T16:49:57.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.646 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-05-30T16:49:57.646 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmF+/kKhAA0L6yP95TzJQ6K4jpCd5+tg==", 2024-05-30T16:49:57.646 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmn8xEDRAAjwGDHViLwz305wNijyo18g==", 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:49:57.647 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmuIxAORAA/N4DIL7c+EuojamnyYrt8Q==", 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmohxgGxAA4vjzBoeVO37nSNV38b13jQ==", 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAVrFhmdJ6TFxAAFhv8K0nLudGT9rT6oHmhvQ==", 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAYrFhmC1VXIhAAyyeKMhil2CcMD+5mm3xcvg==", 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAbrFhmid0VLRAA/StAYue0HlyInB/n42h3wg==", 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAerFhmJwCyNhAAkvkgyy7RRMOwwfYhyd19XA==", 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:57.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAlrFhm/8G1CxAAAlDJwijmpj2gS8x2BhgIpA==", 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAorFhmO1zgJhAAxdZsdLD/lBuyuhEdX2AF6g==", 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAsrFhmPtDmAxAA1+YfFHQ7XLtQQIOp4BLnwQ==", 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:57.653 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAvrFhmbqIVDxAAr6NR0hbs+v/4CP4/WRT1SA==", 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA==", 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmVgMROxAA2SCdaM/Q+v9jhyfF7SZoWg==", 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:49:57.655 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQARrFhmvzKvMBAAIPPum2n8LgNjGXjueMBuqQ==", 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQASrFhmdx2UCRAAFENiZ9XGo/B0vBmixV0k0A==", 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-05-30T16:49:57.657 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAPrFhmtLjtJBAAhR92wuSYl1aS8+gl0+zhcg==", 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhmn/cwIBAAc0kCDj+gFH2f0tY5cbGrjg==", 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-05-30T16:49:57.658 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAQrFhm8GMmFRAAtPZbiQkY1GfShaqCf3b4Zw==", 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-05-30T16:49:57.659 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f087c06d5e0 msgr2=0x7f087c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f087c06d5e0 0x7f087c06faa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0890033000 tx=0x7f0890008030 comp rx=0 tx=0).stop 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a00b1300 msgr2=0x7f08a00b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a00b1300 0x7f08a00b1780 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f088800e580 tx=0x7f088800ea40 comp rx=0 tx=0).stop 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 shutdown_connections 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f087c06d5e0 0x7f087c06faa0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a01564f0 0x7f08a0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08a00b1300 0x7f08a00b1780 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 --2- 172.21.15.144:0/200686195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08840039e0 0x7f08a015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 >> 172.21.15.144:0/200686195 conn(0x7f08a006bd00 msgr2=0x7f08a015c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 shutdown_connections 2024-05-30T16:49:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.647+0000 7f08a5600640 1 -- 172.21.15.144:0/200686195 wait complete. 2024-05-30T16:49:57.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T16:49:57.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.849+0000 7f393b800640 1 Processor -- start 2024-05-30T16:49:57.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.849+0000 7f393b800640 1 -- start start 2024-05-30T16:49:57.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.851+0000 7f393b800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f39340b5fd0 0x7f3934142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.851+0000 7f393b800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3934160730 con 0x7f39340cec70 2024-05-30T16:49:57.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.851+0000 7f393b800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3934160a10 con 0x7f393413f760 2024-05-30T16:49:57.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.851+0000 7f393b800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f39341612b0 con 0x7f39340b5fd0 2024-05-30T16:49:57.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.851+0000 7f3939800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f39340b5fd0 0x7f3934142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.851+0000 7f3933e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f39340cec70 0x7f39340b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33876/0 (socket says 172.21.15.144:33876) 2024-05-30T16:49:57.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.851+0000 7f3933e00640 1 -- 172.21.15.144:0/1033639158 learned_addr learned my addr 172.21.15.144:0/1033639158 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:57.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.851+0000 7f3939800640 1 -- 172.21.15.144:0/1033639158 >> v1:172.21.15.149:6789/0 conn(0x7f393413f760 legacy=0x7f393406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:57.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.851+0000 7f3939800640 1 -- 172.21.15.144:0/1033639158 >> v1:172.21.15.144:6789/0 conn(0x7f39340cec70 legacy=0x7f39340b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.852+0000 7f3939800640 1 -- 172.21.15.144:0/1033639158 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3934160cf0 con 0x7f39340b5fd0 2024-05-30T16:49:57.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.852+0000 7f3933400640 1 -- 172.21.15.144:0/1033639158 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793224377 0 0) 0x7f3934160730 con 0x7f39340cec70 2024-05-30T16:49:57.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.853+0000 7f3939800640 1 --2- 172.21.15.144:0/1033639158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39340b5fd0 0x7f3934142200 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f392c009d90 tx=0x7f392c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df85b7a409a814e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.853+0000 7f3933400640 1 -- 172.21.15.144:0/1033639158 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c007740 con 0x7f39340b5fd0 2024-05-30T16:49:57.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.853+0000 7f3933400640 1 -- 172.21.15.144:0/1033639158 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c0078e0 con 0x7f39340b5fd0 2024-05-30T16:49:57.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.853+0000 7f3933400640 1 -- 172.21.15.144:0/1033639158 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c007cb0 con 0x7f39340b5fd0 2024-05-30T16:49:57.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.854+0000 7f393b800640 1 -- 172.21.15.144:0/1033639158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39340b5fd0 msgr2=0x7f3934142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.854+0000 7f393b800640 1 --2- 172.21.15.144:0/1033639158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39340b5fd0 0x7f3934142200 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f392c009d90 tx=0x7f392c02a6a0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.854+0000 7f393b800640 1 -- 172.21.15.144:0/1033639158 shutdown_connections 2024-05-30T16:49:57.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.854+0000 7f393b800640 1 --2- 172.21.15.144:0/1033639158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39340b5fd0 0x7f3934142200 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.854+0000 7f393b800640 1 -- 172.21.15.144:0/1033639158 >> 172.21.15.144:0/1033639158 conn(0x7f393406bd00 msgr2=0x7f393406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:57.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.854+0000 7f393b800640 1 -- 172.21.15.144:0/1033639158 shutdown_connections 2024-05-30T16:49:57.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.854+0000 7f393b800640 1 -- 172.21.15.144:0/1033639158 wait complete. 2024-05-30T16:49:57.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.855+0000 7f393b800640 1 Processor -- start 2024-05-30T16:49:57.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.856+0000 7f393b800640 1 -- start start 2024-05-30T16:49:57.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f393b800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39340b5fd0 0x7f393413ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f393b800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39340cec70 0x7f39341f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f393b800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f393413f760 0x7f3934155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f393b800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f39340cf0d0 con 0x7f393413f760 2024-05-30T16:49:57.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f393b800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f39340cf250 con 0x7f39340b5fd0 2024-05-30T16:49:57.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f393b800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f39340ce6a0 con 0x7f39340cec70 2024-05-30T16:49:57.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3939800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f393413f760 0x7f3934155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3939800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f393413f760 0x7f3934155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59408/0 (socket says 172.21.15.144:59408) 2024-05-30T16:49:57.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3939800640 1 -- 172.21.15.144:0/3227200241 learned_addr learned my addr 172.21.15.144:0/3227200241 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3938e00640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39340b5fd0 0x7f393413ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3939800640 1 -- 172.21.15.144:0/3227200241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39340cec70 msgr2=0x7f39341f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3939800640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39340cec70 0x7f39341f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3939800640 1 -- 172.21.15.144:0/3227200241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39340b5fd0 msgr2=0x7f393413ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3939800640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39340b5fd0 0x7f393413ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3939800640 1 -- 172.21.15.144:0/3227200241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3934156790 con 0x7f393413f760 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.857+0000 7f3938e00640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39340b5fd0 0x7f393413ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.858+0000 7f3939800640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f393413f760 0x7f3934155ce0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f392c009d90 tx=0x7f392c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.858+0000 7f3930c00640 1 -- 172.21.15.144:0/3227200241 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c040070 con 0x7f393413f760 2024-05-30T16:49:57.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.858+0000 7f3930c00640 1 -- 172.21.15.144:0/3227200241 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c031c40 con 0x7f393413f760 2024-05-30T16:49:57.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.858+0000 7f3930c00640 1 -- 172.21.15.144:0/3227200241 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c003990 con 0x7f393413f760 2024-05-30T16:49:57.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.858+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39340b1030 con 0x7f393413f760 2024-05-30T16:49:57.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.858+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39340b15f0 con 0x7f393413f760 2024-05-30T16:49:57.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.859+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3934068b90 con 0x7f393413f760 2024-05-30T16:49:57.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.860+0000 7f3930c00640 1 -- 172.21.15.144:0/3227200241 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f392c039040 con 0x7f393413f760 2024-05-30T16:49:57.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.861+0000 7f3930c00640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f391406d5e0 0x7f391406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:57.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.861+0000 7f3930c00640 1 -- 172.21.15.144:0/3227200241 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4885+0+0 (secure 0 0 0) 0x7f392c0ab5d0 con 0x7f393413f760 2024-05-30T16:49:57.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.862+0000 7f3938e00640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f391406d5e0 0x7f391406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:57.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.862+0000 7f3938e00640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f391406d5e0 0x7f391406faa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f393413b580 tx=0x7f3928008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:57.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:57.866+0000 7f3930c00640 1 -- 172.21.15.144:0/3227200241 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f392c07b4b0 con 0x7f393413f760 2024-05-30T16:49:58.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.069+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f393415da60 con 0x7f393413f760 2024-05-30T16:49:58.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.069+0000 7f3930c00640 1 -- 172.21.15.144:0/3227200241 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7f392c07adb0 con 0x7f393413f760 2024-05-30T16:49:58.071 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:49:58.071 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:49:58.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:49:58.071 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-05-30T16:49:58.071 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-05-30T16:49:58.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:49:58.071 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f391406d5e0 msgr2=0x7f391406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f391406d5e0 0x7f391406faa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f393413b580 tx=0x7f3928008040 comp rx=0 tx=0).stop 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f393413f760 msgr2=0x7f3934155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f393413f760 0x7f3934155ce0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f392c009d90 tx=0x7f392c004a40 comp rx=0 tx=0).stop 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 shutdown_connections 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f391406d5e0 0x7f391406faa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f393413f760 0x7f3934155ce0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39340cec70 0x7f39341f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 --2- 172.21.15.144:0/3227200241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39340b5fd0 0x7f393413ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.072+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 >> 172.21.15.144:0/3227200241 conn(0x7f393406bd00 msgr2=0x7f393413fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:58.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.073+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 shutdown_connections 2024-05-30T16:49:58.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.073+0000 7f393b800640 1 -- 172.21.15.144:0/3227200241 wait complete. 2024-05-30T16:49:58.093 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T16:49:58.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T16:49:58.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.303+0000 7f46b4a00640 1 Processor -- start 2024-05-30T16:49:58.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.303+0000 7f46b4a00640 1 -- start start 2024-05-30T16:49:58.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.305+0000 7f46b4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46b00b8710 0x7f46b00b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.305+0000 7f46b4a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b00d2a90 con 0x7f46b00d1640 2024-05-30T16:49:58.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.305+0000 7f46b4a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b00d2d70 con 0x7f46b00d1260 2024-05-30T16:49:58.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.305+0000 7f46b4a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f46b00d36a0 con 0x7f46b00b8710 2024-05-30T16:49:58.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.305+0000 7f46aea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f46b00d1640 0x7f46b00cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33892/0 (socket says 172.21.15.144:33892) 2024-05-30T16:49:58.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.305+0000 7f46aea00640 1 -- 172.21.15.144:0/1485648787 learned_addr learned my addr 172.21.15.144:0/1485648787 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:49:58.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.305+0000 7f46afe00640 1 --2- 172.21.15.144:0/1485648787 >> v2:172.21.15.144:3300/0 conn(0x7f46b00b8710 0x7f46b00b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:58.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.305+0000 7f46ae000640 1 -- 172.21.15.144:0/1485648787 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561408333 0 0) 0x7f46b00d2a90 con 0x7f46b00d1640 2024-05-30T16:49:58.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.306+0000 7f46ae000640 1 -- 172.21.15.144:0/1485648787 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4694003520 con 0x7f46b00d1640 2024-05-30T16:49:58.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.306+0000 7f46afe00640 1 -- 172.21.15.144:0/1485648787 >> v1:172.21.15.149:6789/0 conn(0x7f46b00d1260 legacy=0x7f46b00d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:58.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.306+0000 7f46afe00640 1 -- 172.21.15.144:0/1485648787 >> v1:172.21.15.144:6789/0 conn(0x7f46b00d1640 legacy=0x7f46b00cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.306+0000 7f46afe00640 1 -- 172.21.15.144:0/1485648787 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b00d3050 con 0x7f46b00b8710 2024-05-30T16:49:58.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.307+0000 7f46afe00640 1 --2- 172.21.15.144:0/1485648787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 0x7f46b00b5470 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009d90 tx=0x7f46a802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a68999ba8d89e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:58.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.307+0000 7f46ae000640 1 -- 172.21.15.144:0/1485648787 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8007740 con 0x7f46b00b8710 2024-05-30T16:49:58.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.307+0000 7f46ae000640 1 -- 172.21.15.144:0/1485648787 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a80078e0 con 0x7f46b00b8710 2024-05-30T16:49:58.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.307+0000 7f46ae000640 1 -- 172.21.15.144:0/1485648787 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8007cb0 con 0x7f46b00b8710 2024-05-30T16:49:58.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.308+0000 7f46b4a00640 1 -- 172.21.15.144:0/1485648787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 msgr2=0x7f46b00b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.308+0000 7f46b4a00640 1 --2- 172.21.15.144:0/1485648787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 0x7f46b00b5470 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009d90 tx=0x7f46a802a6f0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.308+0000 7f46b4a00640 1 -- 172.21.15.144:0/1485648787 shutdown_connections 2024-05-30T16:49:58.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.308+0000 7f46b4a00640 1 --2- 172.21.15.144:0/1485648787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 0x7f46b00b5470 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.308+0000 7f46b4a00640 1 -- 172.21.15.144:0/1485648787 >> 172.21.15.144:0/1485648787 conn(0x7f46b008bfc0 msgr2=0x7f46b00d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:58.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.308+0000 7f46b4a00640 1 -- 172.21.15.144:0/1485648787 shutdown_connections 2024-05-30T16:49:58.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.308+0000 7f46b4a00640 1 -- 172.21.15.144:0/1485648787 wait complete. 2024-05-30T16:49:58.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.309+0000 7f46b4a00640 1 Processor -- start 2024-05-30T16:49:58.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.310+0000 7f46b4a00640 1 -- start start 2024-05-30T16:49:58.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46b4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 0x7f46b015ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46b4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46b00d1260 0x7f46b01572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46b4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46b00d1640 0x7f46b015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46b4a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f46b00cfc50 con 0x7f46b00b8710 2024-05-30T16:49:58.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46b4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f46b00cfad0 con 0x7f46b00d1260 2024-05-30T16:49:58.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46b4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f46b00cfdd0 con 0x7f46b00d1640 2024-05-30T16:49:58.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 0x7f46b015ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:58.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 0x7f46b015ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59422/0 (socket says 172.21.15.144:59422) 2024-05-30T16:49:58.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46af400640 1 -- 172.21.15.144:0/2224182020 learned_addr learned my addr 172.21.15.144:0/2224182020 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46af400640 1 -- 172.21.15.144:0/2224182020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46b00d1640 msgr2=0x7f46b015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46af400640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46b00d1640 0x7f46b015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46af400640 1 -- 172.21.15.144:0/2224182020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46b00d1260 msgr2=0x7f46b01572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46af400640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46b00d1260 0x7f46b01572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.311+0000 7f46af400640 1 -- 172.21.15.144:0/2224182020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b015b3c0 con 0x7f46b00b8710 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.312+0000 7f46af400640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 0x7f46b015ab70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f46a000c480 tx=0x7f46a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.312+0000 7f46a7400640 1 -- 172.21.15.144:0/2224182020 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a00052d0 con 0x7f46b00b8710 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.312+0000 7f46a7400640 1 -- 172.21.15.144:0/2224182020 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0005470 con 0x7f46b00b8710 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.312+0000 7f46a7400640 1 -- 172.21.15.144:0/2224182020 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0012870 con 0x7f46b00b8710 2024-05-30T16:49:58.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.312+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b015b6a0 con 0x7f46b00b8710 2024-05-30T16:49:58.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.312+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b0158da0 con 0x7f46b00b8710 2024-05-30T16:49:58.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.313+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b0158fa0 con 0x7f46b00b8710 2024-05-30T16:49:58.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.314+0000 7f46a7400640 1 -- 172.21.15.144:0/2224182020 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f46a0012a10 con 0x7f46b00b8710 2024-05-30T16:49:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.316+0000 7f46a7400640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f469006d610 0x7f469006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.316+0000 7f46a7400640 1 -- 172.21.15.144:0/2224182020 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4885+0+0 (secure 0 0 0) 0x7f46a008a2b0 con 0x7f46b00b8710 2024-05-30T16:49:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.316+0000 7f46aea00640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f469006d610 0x7f469006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:58.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.317+0000 7f46aea00640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f469006d610 0x7f469006fad0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f46b006e970 tx=0x7f469c007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:58.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.320+0000 7f46a7400640 1 -- 172.21.15.144:0/2224182020 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46b0158fa0 con 0x7f46b00b8710 2024-05-30T16:49:58.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:58.519+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f46b0075570 con 0x7f46b00b8710 2024-05-30T16:49:59.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.158+0000 7f46a7400640 1 -- 172.21.15.144:0/2224182020 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f46a005a130 con 0x7f46b00b8710 2024-05-30T16:49:59.160 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f469006d610 msgr2=0x7f469006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f469006d610 0x7f469006fad0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f46b006e970 tx=0x7f469c007930 comp rx=0 tx=0).stop 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 msgr2=0x7f46b015ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 0x7f46b015ab70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f46a000c480 tx=0x7f46a000c940 comp rx=0 tx=0).stop 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 shutdown_connections 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f469006d610 0x7f469006fad0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f46b00d1640 0x7f46b015cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46b00d1260 0x7f46b01572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 --2- 172.21.15.144:0/2224182020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b00b8710 0x7f46b015ab70 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.162+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 >> 172.21.15.144:0/2224182020 conn(0x7f46b008bfc0 msgr2=0x7f46b006d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:59.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.163+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 shutdown_connections 2024-05-30T16:49:59.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.163+0000 7f46b4a00640 1 -- 172.21.15.144:0/2224182020 wait complete. 2024-05-30T16:49:59.190 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T16:49:59.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.384+0000 7f9eaee00640 1 Processor -- start 2024-05-30T16:49:59.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.384+0000 7f9eaee00640 1 -- start start 2024-05-30T16:49:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.385+0000 7f9eaee00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9ea815eb80 0x7f9ea8162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.385+0000 7f9eaee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ea80ba2b0 0x7f9ea80cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.385+0000 7f9eaee00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea8163550 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.385+0000 7f9eaee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea815ef60 con 0x7f9ea80ba2b0 2024-05-30T16:49:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.385+0000 7f9eaee00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea80d4580 con 0x7f9ea815eb80 2024-05-30T16:49:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.386+0000 7f9e9f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ea80ba2b0 0x7f9ea80cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.386+0000 7f9e9f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ea80ba2b0 0x7f9ea80cf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59428/0 (socket says 172.21.15.144:59428) 2024-05-30T16:49:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.386+0000 7f9e9f400640 1 -- 172.21.15.144:0/500105324 learned_addr learned my addr 172.21.15.144:0/500105324 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.386+0000 7f9ea7e00640 1 --2- 172.21.15.144:0/500105324 >> v2:172.21.15.149:3300/0 conn(0x7f9ea815eb80 0x7f9ea8162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:59.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.386+0000 7f9e9f400640 1 -- 172.21.15.144:0/500105324 >> v2:172.21.15.149:3300/0 conn(0x7f9ea815eb80 msgr2=0x7f9ea8162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:59.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.386+0000 7f9e9f400640 1 --2- 172.21.15.144:0/500105324 >> v2:172.21.15.149:3300/0 conn(0x7f9ea815eb80 0x7f9ea8162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:59.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.386+0000 7f9e9f400640 1 -- 172.21.15.144:0/500105324 >> v1:172.21.15.149:6789/0 conn(0x7f9ea80cfaa0 legacy=0x7f9ea80b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:49:59.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.386+0000 7f9e9f400640 1 -- 172.21.15.144:0/500105324 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea8162f90 con 0x7f9ea80ba2b0 2024-05-30T16:49:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.387+0000 7f9e9f400640 1 --2- 172.21.15.144:0/500105324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80ba2b0 0x7f9ea80cf560 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9ea808cfe0 tx=0x7f9e9002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8cfc3ec3d68fd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.388+0000 7f9ea7400640 1 -- 172.21.15.144:0/500105324 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90037070 con 0x7f9ea80ba2b0 2024-05-30T16:49:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.388+0000 7f9ea7400640 1 -- 172.21.15.144:0/500105324 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e90032440 con 0x7f9ea80ba2b0 2024-05-30T16:49:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.388+0000 7f9ea7400640 1 -- 172.21.15.144:0/500105324 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90032810 con 0x7f9ea80ba2b0 2024-05-30T16:49:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.388+0000 7f9eaee00640 1 -- 172.21.15.144:0/500105324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80ba2b0 msgr2=0x7f9ea80cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.388+0000 7f9eaee00640 1 --2- 172.21.15.144:0/500105324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80ba2b0 0x7f9ea80cf560 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9ea808cfe0 tx=0x7f9e9002a230 comp rx=0 tx=0).stop 2024-05-30T16:49:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.389+0000 7f9eaee00640 1 -- 172.21.15.144:0/500105324 shutdown_connections 2024-05-30T16:49:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.389+0000 7f9eaee00640 1 --2- 172.21.15.144:0/500105324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80ba2b0 0x7f9ea80cf560 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.389+0000 7f9eaee00640 1 --2- 172.21.15.144:0/500105324 >> v2:172.21.15.149:3300/0 conn(0x7f9ea815eb80 0x7f9ea8162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.389+0000 7f9eaee00640 1 -- 172.21.15.144:0/500105324 >> 172.21.15.144:0/500105324 conn(0x7f9ea806cf40 msgr2=0x7f9ea806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:49:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.389+0000 7f9eaee00640 1 -- 172.21.15.144:0/500105324 shutdown_connections 2024-05-30T16:49:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.389+0000 7f9eaee00640 1 -- 172.21.15.144:0/500105324 wait complete. 2024-05-30T16:49:59.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.390+0000 7f9eaee00640 1 Processor -- start 2024-05-30T16:49:59.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.390+0000 7f9eaee00640 1 -- start start 2024-05-30T16:49:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.391+0000 7f9eaee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ea80ba2b0 0x7f9ea814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.391+0000 7f9eaee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80cfaa0 0x7f9ea81526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.391+0000 7f9eaee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ea815eb80 0x7f9ea80c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.391+0000 7f9eaee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80d3050 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.391+0000 7f9eaee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80d2d70 con 0x7f9ea80ba2b0 2024-05-30T16:49:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.391+0000 7f9eaee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea8162b80 con 0x7f9ea815eb80 2024-05-30T16:49:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9e9f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80cfaa0 0x7f9ea81526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9e9f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80cfaa0 0x7f9ea81526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59442/0 (socket says 172.21.15.144:59442) 2024-05-30T16:49:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9e9f400640 1 -- 172.21.15.144:0/2054333816 learned_addr learned my addr 172.21.15.144:0/2054333816 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9e9f400640 1 -- 172.21.15.144:0/2054333816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ea815eb80 msgr2=0x7f9ea80c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9eace00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ea815eb80 0x7f9ea80c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9e9f400640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ea815eb80 0x7f9ea80c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9e9f400640 1 -- 172.21.15.144:0/2054333816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ea80ba2b0 msgr2=0x7f9ea814f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9ea7e00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ea80ba2b0 0x7f9ea814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9e9f400640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ea80ba2b0 0x7f9ea814f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9e9f400640 1 -- 172.21.15.144:0/2054333816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea8153b40 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.392+0000 7f9eace00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ea815eb80 0x7f9ea80c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.393+0000 7f9e9f400640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80cfaa0 0x7f9ea81526f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9e9002a270 tx=0x7f9e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.393+0000 7f9ea4c00640 1 -- 172.21.15.144:0/2054333816 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90041070 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.393+0000 7f9ea4c00640 1 -- 172.21.15.144:0/2054333816 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9003c870 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.393+0000 7f9ea4c00640 1 -- 172.21.15.144:0/2054333816 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90037040 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.393+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea8153e20 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.393+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea814f760 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.394+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea8068b90 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.395+0000 7f9ea4c00640 1 -- 172.21.15.144:0/2054333816 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f9e90044070 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.397+0000 7f9ea4c00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9e8406d5e0 0x7f9e8406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:49:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.397+0000 7f9ea4c00640 1 -- 172.21.15.144:0/2054333816 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5255+0+0 (secure 0 0 0) 0x7f9e900ab210 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.397+0000 7f9ea7e00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9e8406d5e0 0x7f9e8406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:49:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.398+0000 7f9ea7e00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9e8406d5e0 0x7f9e8406faa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e98006fd0 tx=0x7f9e98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:49:59.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.402+0000 7f9ea4c00640 1 -- 172.21.15.144:0/2054333816 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9e900b3020 con 0x7f9ea80cfaa0 2024-05-30T16:49:59.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:49:59.604+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9ea80d25a0 con 0x7f9ea80cfaa0 2024-05-30T16:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.175+0000 7f9ea4c00640 1 -- 172.21.15.144:0/2054333816 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) ==== 170+0+0 (secure 0 0 0) 0x7f9e9007b210 con 0x7f9ea80cfaa0 2024-05-30T16:50:00.177 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-05-30T16:50:00.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9e8406d5e0 msgr2=0x7f9e8406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:00.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9e8406d5e0 0x7f9e8406faa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e98006fd0 tx=0x7f9e98008040 comp rx=0 tx=0).stop 2024-05-30T16:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80cfaa0 msgr2=0x7f9ea81526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80cfaa0 0x7f9ea81526f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9e9002a270 tx=0x7f9e900046c0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 shutdown_connections 2024-05-30T16:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9e8406d5e0 0x7f9e8406faa0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ea815eb80 0x7f9ea80c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea80cfaa0 0x7f9ea81526f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 --2- 172.21.15.144:0/2054333816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ea80ba2b0 0x7f9ea814f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 >> 172.21.15.144:0/2054333816 conn(0x7f9ea806cf40 msgr2=0x7f9ea81602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:00.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.179+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 shutdown_connections 2024-05-30T16:50:00.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.180+0000 7f9eaee00640 1 -- 172.21.15.144:0/2054333816 wait complete. 2024-05-30T16:50:00.215 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T16:50:00.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.391+0000 7f5b43c00640 1 Processor -- start 2024-05-30T16:50:00.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.391+0000 7f5b43c00640 1 -- start start 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.393+0000 7f5b43c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b3c145150 0x7f5b3c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.393+0000 7f5b43c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b3c0cfa70 0x7f5b3c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.393+0000 7f5b43c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b3c0d00f0 con 0x7f5b3c06f610 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.393+0000 7f5b43c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5b3c06fa80 con 0x7f5b3c145150 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.393+0000 7f5b43c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5b3c0cfeb0 con 0x7f5b3c0cfa70 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.393+0000 7f5b41200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b3c145150 0x7f5b3c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.393+0000 7f5b41200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b3c145150 0x7f5b3c0cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59452/0 (socket says 172.21.15.144:59452) 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.393+0000 7f5b41200640 1 -- 172.21.15.144:0/2499054572 learned_addr learned my addr 172.21.15.144:0/2499054572 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.394+0000 7f5b3be00640 1 --2- 172.21.15.144:0/2499054572 >> v2:172.21.15.149:3300/0 conn(0x7f5b3c0cfa70 0x7f5b3c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.394+0000 7f5b41200640 1 -- 172.21.15.144:0/2499054572 >> v2:172.21.15.149:3300/0 conn(0x7f5b3c0cfa70 msgr2=0x7f5b3c06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.394+0000 7f5b41200640 1 --2- 172.21.15.144:0/2499054572 >> v2:172.21.15.149:3300/0 conn(0x7f5b3c0cfa70 0x7f5b3c06f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.394+0000 7f5b41200640 1 -- 172.21.15.144:0/2499054572 >> v1:172.21.15.149:6789/0 conn(0x7f5b3c06f610 legacy=0x7f5b3c072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:00.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.394+0000 7f5b41200640 1 -- 172.21.15.144:0/2499054572 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c15f390 con 0x7f5b3c145150 2024-05-30T16:50:00.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.395+0000 7f5b41200640 1 --2- 172.21.15.144:0/2499054572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c145150 0x7f5b3c0cf530 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0b3b40 tx=0x7f5b2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57cf79888d5f6a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:00.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.395+0000 7f5b3b400640 1 -- 172.21.15.144:0/2499054572 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c037070 con 0x7f5b3c145150 2024-05-30T16:50:00.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.395+0000 7f5b3b400640 1 -- 172.21.15.144:0/2499054572 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c032440 con 0x7f5b3c145150 2024-05-30T16:50:00.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.395+0000 7f5b3b400640 1 -- 172.21.15.144:0/2499054572 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c032810 con 0x7f5b3c145150 2024-05-30T16:50:00.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.396+0000 7f5b43c00640 1 -- 172.21.15.144:0/2499054572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c145150 msgr2=0x7f5b3c0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:00.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.396+0000 7f5b43c00640 1 --2- 172.21.15.144:0/2499054572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c145150 0x7f5b3c0cf530 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0b3b40 tx=0x7f5b2c02a1a0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.396+0000 7f5b43c00640 1 -- 172.21.15.144:0/2499054572 shutdown_connections 2024-05-30T16:50:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.396+0000 7f5b43c00640 1 --2- 172.21.15.144:0/2499054572 >> v2:172.21.15.149:3300/0 conn(0x7f5b3c0cfa70 0x7f5b3c06f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.396+0000 7f5b43c00640 1 --2- 172.21.15.144:0/2499054572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c145150 0x7f5b3c0cf530 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.396+0000 7f5b43c00640 1 -- 172.21.15.144:0/2499054572 >> 172.21.15.144:0/2499054572 conn(0x7f5b3c06bd00 msgr2=0x7f5b3c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.396+0000 7f5b43c00640 1 -- 172.21.15.144:0/2499054572 shutdown_connections 2024-05-30T16:50:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.396+0000 7f5b43c00640 1 -- 172.21.15.144:0/2499054572 wait complete. 2024-05-30T16:50:00.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.398+0000 7f5b43c00640 1 Processor -- start 2024-05-30T16:50:00.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.398+0000 7f5b43c00640 1 -- start start 2024-05-30T16:50:00.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.399+0000 7f5b43c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c06f610 0x7f5b3c15e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:00.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.399+0000 7f5b43c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c0cfa70 0x7f5b3c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:00.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.399+0000 7f5b43c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c145150 0x7f5b3c15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:00.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.399+0000 7f5b43c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c15f950 con 0x7f5b3c06f610 2024-05-30T16:50:00.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.399+0000 7f5b43c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c15f140 con 0x7f5b3c0cfa70 2024-05-30T16:50:00.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.399+0000 7f5b43c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3c0b64f0 con 0x7f5b3c145150 2024-05-30T16:50:00.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.399+0000 7f5b41200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c06f610 0x7f5b3c15e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:00.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.399+0000 7f5b41200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c06f610 0x7f5b3c15e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59464/0 (socket says 172.21.15.144:59464) 2024-05-30T16:50:00.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.399+0000 7f5b41200640 1 -- 172.21.15.144:0/1301914821 learned_addr learned my addr 172.21.15.144:0/1301914821 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:00.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b3be00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c0cfa70 0x7f5b3c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:00.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b41c00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c145150 0x7f5b3c15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:00.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b41200640 1 -- 172.21.15.144:0/1301914821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c145150 msgr2=0x7f5b3c15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:00.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b41200640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c145150 0x7f5b3c15c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b41200640 1 -- 172.21.15.144:0/1301914821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c0cfa70 msgr2=0x7f5b3c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:00.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b41200640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c0cfa70 0x7f5b3c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:00.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b41200640 1 -- 172.21.15.144:0/1301914821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c15d4a0 con 0x7f5b3c06f610 2024-05-30T16:50:00.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b41200640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c06f610 0x7f5b3c15e540 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c000c00 tx=0x7f5b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:00.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b38c00640 1 -- 172.21.15.144:0/1301914821 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c041020 con 0x7f5b3c06f610 2024-05-30T16:50:00.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b38c00640 1 -- 172.21.15.144:0/1301914821 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0306c0 con 0x7f5b3c06f610 2024-05-30T16:50:00.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b38c00640 1 -- 172.21.15.144:0/1301914821 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c037040 con 0x7f5b3c06f610 2024-05-30T16:50:00.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.400+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3c15d780 con 0x7f5b3c06f610 2024-05-30T16:50:00.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.401+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b3c15dd40 con 0x7f5b3c06f610 2024-05-30T16:50:00.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.402+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b3c068b90 con 0x7f5b3c06f610 2024-05-30T16:50:00.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.403+0000 7f5b38c00640 1 -- 172.21.15.144:0/1301914821 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f5b2c044020 con 0x7f5b3c06f610 2024-05-30T16:50:00.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.404+0000 7f5b38c00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5b1806d5e0 0x7f5b1806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:00.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.404+0000 7f5b38c00640 1 -- 172.21.15.144:0/1301914821 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5637+0+0 (secure 0 0 0) 0x7f5b2c0ab0b0 con 0x7f5b3c06f610 2024-05-30T16:50:00.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.404+0000 7f5b3be00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5b1806d5e0 0x7f5b1806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:00.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.405+0000 7f5b3be00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5b1806d5e0 0x7f5b1806faa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c1410e0 tx=0x7f5b24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:00.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.409+0000 7f5b38c00640 1 -- 172.21.15.144:0/1301914821 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b2c0b4080 con 0x7f5b3c06f610 2024-05-30T16:50:00.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:00.645+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5b3c0cd7b0 con 0x7f5b3c06f610 2024-05-30T16:50:01.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.203+0000 7f5b38c00640 1 -- 172.21.15.144:0/1301914821 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v41) ==== 174+0+0 (secure 0 0 0) 0x7f5b2c04b030 con 0x7f5b3c06f610 2024-05-30T16:50:01.205 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 10 and data pool 11 2024-05-30T16:50:01.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.210+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5b1806d5e0 msgr2=0x7f5b1806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.211+0000 7f5b43c00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5b1806d5e0 0x7f5b1806faa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c1410e0 tx=0x7f5b24008040 comp rx=0 tx=0).stop 2024-05-30T16:50:01.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.211+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c06f610 msgr2=0x7f5b3c15e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.211+0000 7f5b43c00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c06f610 0x7f5b3c15e540 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c000c00 tx=0x7f5b2c0046c0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.215+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 shutdown_connections 2024-05-30T16:50:01.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.215+0000 7f5b43c00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5b1806d5e0 0x7f5b1806faa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.215+0000 7f5b43c00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c145150 0x7f5b3c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.215+0000 7f5b43c00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c0cfa70 0x7f5b3c15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.215+0000 7f5b43c00640 1 --2- 172.21.15.144:0/1301914821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b3c06f610 0x7f5b3c15e540 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.215+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 >> 172.21.15.144:0/1301914821 conn(0x7f5b3c06bd00 msgr2=0x7f5b3c141230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:01.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.216+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 shutdown_connections 2024-05-30T16:50:01.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.216+0000 7f5b43c00640 1 -- 172.21.15.144:0/1301914821 wait complete. 2024-05-30T16:50:01.245 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:50:01.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.412+0000 7fee86600640 1 Processor -- start 2024-05-30T16:50:01.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.412+0000 7fee86600640 1 -- start start 2024-05-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.413+0000 7fee86600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fee800caf10 0x7fee8015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.413+0000 7fee86600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fee800cf8b0 0x7fee800b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.413+0000 7fee86600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee8015f500 con 0x7fee800cb2f0 2024-05-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.413+0000 7fee86600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fee8015f780 con 0x7fee800caf10 2024-05-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.413+0000 7fee86600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fee8015fa60 con 0x7fee800cf8b0 2024-05-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.413+0000 7fee85200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fee800caf10 0x7fee8015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.413+0000 7fee85200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fee800caf10 0x7fee8015efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59472/0 (socket says 172.21.15.144:59472) 2024-05-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.413+0000 7fee85200640 1 -- 172.21.15.144:0/935078499 learned_addr learned my addr 172.21.15.144:0/935078499 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.414+0000 7fee85200640 1 -- 172.21.15.144:0/935078499 >> v2:172.21.15.149:3300/0 conn(0x7fee800cf8b0 msgr2=0x7fee800b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.414+0000 7fee85200640 1 --2- 172.21.15.144:0/935078499 >> v2:172.21.15.149:3300/0 conn(0x7fee800cf8b0 0x7fee800b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.414+0000 7fee85200640 1 -- 172.21.15.144:0/935078499 >> v1:172.21.15.149:6789/0 conn(0x7fee800cb2f0 legacy=0x7fee8015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.414+0000 7fee85200640 1 -- 172.21.15.144:0/935078499 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8015fd40 con 0x7fee800caf10 2024-05-30T16:50:01.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.415+0000 7fee85200640 1 --2- 172.21.15.144:0/935078499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800caf10 0x7fee8015efc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fee800ce1f0 tx=0x7fee7002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744270069a8974e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.415+0000 7fee7fe00640 1 -- 172.21.15.144:0/935078499 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70037070 con 0x7fee800caf10 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.415+0000 7fee7fe00640 1 -- 172.21.15.144:0/935078499 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee70032440 con 0x7fee800caf10 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.415+0000 7fee7fe00640 1 -- 172.21.15.144:0/935078499 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70032810 con 0x7fee800caf10 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.416+0000 7fee86600640 1 -- 172.21.15.144:0/935078499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800caf10 msgr2=0x7fee8015efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.416+0000 7fee86600640 1 --2- 172.21.15.144:0/935078499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800caf10 0x7fee8015efc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fee800ce1f0 tx=0x7fee7002a230 comp rx=0 tx=0).stop 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.416+0000 7fee86600640 1 -- 172.21.15.144:0/935078499 shutdown_connections 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.416+0000 7fee86600640 1 --2- 172.21.15.144:0/935078499 >> v2:172.21.15.149:3300/0 conn(0x7fee800cf8b0 0x7fee800b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.416+0000 7fee86600640 1 --2- 172.21.15.144:0/935078499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800caf10 0x7fee8015efc0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.416+0000 7fee86600640 1 -- 172.21.15.144:0/935078499 >> 172.21.15.144:0/935078499 conn(0x7fee800b20a0 msgr2=0x7fee800b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.416+0000 7fee86600640 1 -- 172.21.15.144:0/935078499 shutdown_connections 2024-05-30T16:50:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.416+0000 7fee86600640 1 -- 172.21.15.144:0/935078499 wait complete. 2024-05-30T16:50:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.417+0000 7fee86600640 1 Processor -- start 2024-05-30T16:50:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.418+0000 7fee86600640 1 -- start start 2024-05-30T16:50:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.418+0000 7fee86600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee800caf10 0x7fee8014d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.418+0000 7fee86600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee800cb2f0 0x7fee800ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.418+0000 7fee86600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800cf8b0 0x7fee8015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.418+0000 7fee86600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee8015bad0 con 0x7fee800cf8b0 2024-05-30T16:50:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.418+0000 7fee86600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee8015b950 con 0x7fee800cb2f0 2024-05-30T16:50:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.418+0000 7fee86600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee800b3700 con 0x7fee800caf10 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800cf8b0 0x7fee8015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800cf8b0 0x7fee8015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59488/0 (socket says 172.21.15.144:59488) 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85c00640 1 -- 172.21.15.144:0/4205824906 learned_addr learned my addr 172.21.15.144:0/4205824906 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85200640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee800caf10 0x7fee8014d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee77e00640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee800cb2f0 0x7fee800ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85c00640 1 -- 172.21.15.144:0/4205824906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee800caf10 msgr2=0x7fee8014d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85c00640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee800caf10 0x7fee8014d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85c00640 1 -- 172.21.15.144:0/4205824906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee800cb2f0 msgr2=0x7fee800ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85c00640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee800cb2f0 0x7fee800ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85c00640 1 -- 172.21.15.144:0/4205824906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee801f49e0 con 0x7fee800cf8b0 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85200640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee800caf10 0x7fee8014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.419+0000 7fee85c00640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800cf8b0 0x7fee8015a4a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fee7800b970 tx=0x7fee7800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:01.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.420+0000 7fee7d600640 1 -- 172.21.15.144:0/4205824906 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78019070 con 0x7fee800cf8b0 2024-05-30T16:50:01.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.420+0000 7fee7d600640 1 -- 172.21.15.144:0/4205824906 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7800cb00 con 0x7fee800cf8b0 2024-05-30T16:50:01.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.420+0000 7fee7d600640 1 -- 172.21.15.144:0/4205824906 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78014440 con 0x7fee800cf8b0 2024-05-30T16:50:01.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.420+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee801f4cc0 con 0x7fee800cf8b0 2024-05-30T16:50:01.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.420+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee801f5280 con 0x7fee800cf8b0 2024-05-30T16:50:01.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.421+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee801f7b60 con 0x7fee800cf8b0 2024-05-30T16:50:01.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.422+0000 7fee7d600640 1 -- 172.21.15.144:0/4205824906 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fee7801c070 con 0x7fee800cf8b0 2024-05-30T16:50:01.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.423+0000 7fee7d600640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fee5c06d5e0 0x7fee5c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.423+0000 7fee7d600640 1 -- 172.21.15.144:0/4205824906 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5737+0+0 (secure 0 0 0) 0x7fee7808a2f0 con 0x7fee800cf8b0 2024-05-30T16:50:01.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.423+0000 7fee85200640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fee5c06d5e0 0x7fee5c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.423+0000 7fee85200640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fee5c06d5e0 0x7fee5c06faa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fee70034000 tx=0x7fee7002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:01.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.427+0000 7fee7d600640 1 -- 172.21.15.144:0/4205824906 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fee801f7b60 con 0x7fee800cf8b0 2024-05-30T16:50:01.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.617+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee800b5000 con 0x7fee800cf8b0 2024-05-30T16:50:01.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.619+0000 7fee7d600640 1 -- 172.21.15.144:0/4205824906 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16760 (secure 0 0 0) 0x7fee7805a170 con 0x7fee800cf8b0 2024-05-30T16:50:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:01.621 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":71,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:50:00.647134+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:58.537507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:59.619855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:50:01.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fee5c06d5e0 msgr2=0x7fee5c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fee5c06d5e0 0x7fee5c06faa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fee70034000 tx=0x7fee7002e000 comp rx=0 tx=0).stop 2024-05-30T16:50:01.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800cf8b0 msgr2=0x7fee8015a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800cf8b0 0x7fee8015a4a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fee7800b970 tx=0x7fee7800be30 comp rx=0 tx=0).stop 2024-05-30T16:50:01.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 shutdown_connections 2024-05-30T16:50:01.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fee5c06d5e0 0x7fee5c06faa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee800cf8b0 0x7fee8015a4a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee800cb2f0 0x7fee800ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 --2- 172.21.15.144:0/4205824906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee800caf10 0x7fee8014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.621+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 >> 172.21.15.144:0/4205824906 conn(0x7fee800b20a0 msgr2=0x7fee800cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:01.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.622+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 shutdown_connections 2024-05-30T16:50:01.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.622+0000 7fee86600640 1 -- 172.21.15.144:0/4205824906 wait complete. 2024-05-30T16:50:01.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:50:01.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.823+0000 7f9d4be00640 1 Processor -- start 2024-05-30T16:50:01.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.823+0000 7f9d4be00640 1 -- start start 2024-05-30T16:50:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.825+0000 7f9d4be00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9d4c0b52f0 0x7f9d4c162ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.825+0000 7f9d4be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4c163220 con 0x7f9d4c0708d0 2024-05-30T16:50:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.825+0000 7f9d4be00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4c0aeb90 con 0x7f9d4c0af780 2024-05-30T16:50:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.825+0000 7f9d4be00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9d4c0b56d0 con 0x7f9d4c0b52f0 2024-05-30T16:50:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.825+0000 7f9d4b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9d4c0708d0 0x7f9d4c0ae480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33902/0 (socket says 172.21.15.144:33902) 2024-05-30T16:50:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.825+0000 7f9d4b400640 1 -- 172.21.15.144:0/466593365 learned_addr learned my addr 172.21.15.144:0/466593365 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d4aa00640 1 --2- 172.21.15.144:0/466593365 >> v2:172.21.15.149:3300/0 conn(0x7f9d4c0b52f0 0x7f9d4c162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915206174 0 0) 0x7f9d44001490 con 0x7f9d4c0708d0 2024-05-30T16:50:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d30003520 con 0x7f9d4c0708d0 2024-05-30T16:50:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 283325206 0 0) 0x7f9d30003520 con 0x7f9d4c0708d0 2024-05-30T16:50:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 >> v2:172.21.15.149:3300/0 conn(0x7f9d4c0b52f0 msgr2=0x7f9d4c162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 --2- 172.21.15.144:0/466593365 >> v2:172.21.15.149:3300/0 conn(0x7f9d4c0b52f0 0x7f9d4c162ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 >> v1:172.21.15.149:6789/0 conn(0x7f9d4c0af780 legacy=0x7f9d4c0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c15fc70 con 0x7f9d4c0708d0 2024-05-30T16:50:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f9d44001bc0 con 0x7f9d4c0708d0 2024-05-30T16:50:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 >> v1:172.21.15.144:6789/0 conn(0x7f9d4c0708d0 legacy=0x7f9d4c0ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d300039b0 0x7f9d30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d30004800 0x7f9d30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3000c130 con 0x7f9d300051c0 2024-05-30T16:50:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3000c2e0 con 0x7f9d30004800 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.826+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3000c4e0 con 0x7f9d300039b0 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.827+0000 7f9d4b400640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.827+0000 7f9d4aa00640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d300039b0 0x7f9d30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.827+0000 7f9d4b400640 1 -- 172.21.15.144:0/466593365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d300039b0 msgr2=0x7f9d30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.827+0000 7f9d4b400640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d300039b0 0x7f9d30003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.827+0000 7f9d4b400640 1 -- 172.21.15.144:0/466593365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d30004800 msgr2=0x7f9d30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.827+0000 7f9d4a000640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d30004800 0x7f9d30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.827+0000 7f9d4b400640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d30004800 0x7f9d30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.827+0000 7f9d4b400640 1 -- 172.21.15.144:0/466593365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d30003520 con 0x7f9d300051c0 2024-05-30T16:50:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.827+0000 7f9d4a000640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d30004800 0x7f9d30004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.828+0000 7f9d4b400640 1 -- 172.21.15.144:0/466593365 reap_dead start 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.829+0000 7f9d4b400640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d3000b9c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400aa30 tx=0x7f9d30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee9424c0c5c1a0a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.829+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400a650 con 0x7f9d300051c0 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.829+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4402f070 con 0x7f9d300051c0 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.829+0000 7f9d49600640 1 -- 172.21.15.144:0/466593365 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44034470 con 0x7f9d300051c0 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.830+0000 7f9d4be00640 1 -- 172.21.15.144:0/466593365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 msgr2=0x7f9d3000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.830+0000 7f9d4be00640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d3000b9c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400aa30 tx=0x7f9d30005830 comp rx=0 tx=0).stop 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.830+0000 7f9d4be00640 1 -- 172.21.15.144:0/466593365 shutdown_connections 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.830+0000 7f9d4be00640 1 --2- 172.21.15.144:0/466593365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d3000b9c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.830+0000 7f9d4be00640 1 -- 172.21.15.144:0/466593365 >> 172.21.15.144:0/466593365 conn(0x7f9d4c073400 msgr2=0x7f9d4c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.830+0000 7f9d4be00640 1 -- 172.21.15.144:0/466593365 shutdown_connections 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.830+0000 7f9d4be00640 1 -- 172.21.15.144:0/466593365 wait complete. 2024-05-30T16:50:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.832+0000 7f9d4be00640 1 Processor -- start 2024-05-30T16:50:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.832+0000 7f9d4be00640 1 -- start start 2024-05-30T16:50:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d4c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d4c14eed0 0x7f9d4c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d4c14f350 0x7f9d4c153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c15f3d0 con 0x7f9d300051c0 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c15f6b0 con 0x7f9d4c14f350 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9d4c15f990 con 0x7f9d4c14eed0 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d4c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d4c1443f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59518/0 (socket says 172.21.15.144:59518) 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4aa00640 1 -- 172.21.15.144:0/722686812 learned_addr learned my addr 172.21.15.144:0/722686812 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4aa00640 1 -- 172.21.15.144:0/722686812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d4c14eed0 msgr2=0x7f9d4c1539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4aa00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d4c14eed0 0x7f9d4c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4aa00640 1 -- 172.21.15.144:0/722686812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d4c14f350 msgr2=0x7f9d4c153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4aa00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d4c14f350 0x7f9d4c153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.833+0000 7f9d4aa00640 1 -- 172.21.15.144:0/722686812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c14f920 con 0x7f9d300051c0 2024-05-30T16:50:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.834+0000 7f9d4aa00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d4c1443f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0108c0 tx=0x7f9d3c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.834+0000 7f9d42a00640 1 -- 172.21.15.144:0/722686812 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00f040 con 0x7f9d300051c0 2024-05-30T16:50:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.834+0000 7f9d42a00640 1 -- 172.21.15.144:0/722686812 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3c00eb60 con 0x7f9d300051c0 2024-05-30T16:50:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.834+0000 7f9d42a00640 1 -- 172.21.15.144:0/722686812 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c01c400 con 0x7f9d300051c0 2024-05-30T16:50:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.834+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4c14fc00 con 0x7f9d300051c0 2024-05-30T16:50:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.834+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d4c1501c0 con 0x7f9d300051c0 2024-05-30T16:50:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.836+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4c075570 con 0x7f9d300051c0 2024-05-30T16:50:01.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.836+0000 7f9d42a00640 1 -- 172.21.15.144:0/722686812 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f9d3c01c5a0 con 0x7f9d300051c0 2024-05-30T16:50:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.838+0000 7f9d42a00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d2c06d5e0 0x7f9d2c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.838+0000 7f9d42a00640 1 -- 172.21.15.144:0/722686812 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5737+0+0 (secure 0 0 0) 0x7f9d3c08ac20 con 0x7f9d300051c0 2024-05-30T16:50:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.838+0000 7f9d4a000640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d2c06d5e0 0x7f9d2c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.838+0000 7f9d4a000640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d2c06d5e0 0x7f9d2c06faa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c159030 tx=0x7f9d38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:01.842+0000 7f9d42a00640 1 -- 172.21.15.144:0/722686812 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d3c018030 con 0x7f9d300051c0 2024-05-30T16:50:02.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.055+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d4c0d0950 con 0x7f9d300051c0 2024-05-30T16:50:02.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.058+0000 7f9d42a00640 1 -- 172.21.15.144:0/722686812 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16760 (secure 0 0 0) 0x7f9d3c05ab00 con 0x7f9d300051c0 2024-05-30T16:50:02.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:02.060 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":71,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:50:00.647134+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:58.537507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:59.619855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:50:02.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d2c06d5e0 msgr2=0x7f9d2c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d2c06d5e0 0x7f9d2c06faa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c159030 tx=0x7f9d38009040 comp rx=0 tx=0).stop 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 msgr2=0x7f9d4c1443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d4c1443f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0108c0 tx=0x7f9d3c010d80 comp rx=0 tx=0).stop 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 shutdown_connections 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9d2c06d5e0 0x7f9d2c06faa0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d4c14f350 0x7f9d4c153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d4c14eed0 0x7f9d4c1539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 --2- 172.21.15.144:0/722686812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d300051c0 0x7f9d4c1443f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 >> 172.21.15.144:0/722686812 conn(0x7f9d4c073400 msgr2=0x7f9d4c161f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 shutdown_connections 2024-05-30T16:50:02.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.061+0000 7f9d4be00640 1 -- 172.21.15.144:0/722686812 wait complete. 2024-05-30T16:50:02.082 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T16:50:02.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.286+0000 7fb97de00640 1 Processor -- start 2024-05-30T16:50:02.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.286+0000 7fb97de00640 1 -- start start 2024-05-30T16:50:02.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.287+0000 7fb97de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978145150 0x7fb9780cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:02.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.288+0000 7fb97de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9780d00f0 con 0x7fb9780cfa70 2024-05-30T16:50:02.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.288+0000 7fb97de00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97815f390 con 0x7fb97806f7e0 2024-05-30T16:50:02.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.288+0000 7fb97de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb9780cfeb0 con 0x7fb978145150 2024-05-30T16:50:02.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.288+0000 7fb976000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb9780cfa70 0x7fb97806f0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33916/0 (socket says 172.21.15.144:33916) 2024-05-30T16:50:02.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.288+0000 7fb976000640 1 -- 172.21.15.144:0/3028477152 learned_addr learned my addr 172.21.15.144:0/3028477152 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:02.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.288+0000 7fb976a00640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978145150 0x7fb9780cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:02.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.288+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990331271 0 0) 0x7fb9780d00f0 con 0x7fb9780cfa70 2024-05-30T16:50:02.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.288+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb95c003520 con 0x7fb9780cfa70 2024-05-30T16:50:02.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 875338824 0 0) 0x7fb95c003520 con 0x7fb9780cfa70 2024-05-30T16:50:02.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978145150 msgr2=0x7fb9780cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978145150 0x7fb9780cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 >> v1:172.21.15.149:6789/0 conn(0x7fb97806f7e0 legacy=0x7fb9780b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97815f670 con 0x7fb9780cfa70 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fb964001670 con 0x7fb9780cfa70 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 >> v1:172.21.15.144:6789/0 conn(0x7fb9780cfa70 legacy=0x7fb97806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb95c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978145150 0x7fb95c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c004d40 0x7fb95c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9780cfeb0 con 0x7fb95c0039e0 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c00bb50 con 0x7fb95c004d40 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb95c00bd50 con 0x7fb978145150 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.289+0000 7fb976a00640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb95c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.290+0000 7fb976000640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978145150 0x7fb95c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:02.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.290+0000 7fb976a00640 1 -- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978145150 msgr2=0x7fb95c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:02.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.290+0000 7fb976a00640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978145150 0x7fb95c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:02.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.290+0000 7fb976a00640 1 -- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c004d40 msgr2=0x7fb95c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:02.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.290+0000 7fb977400640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c004d40 0x7fb95c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:02.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.290+0000 7fb976a00640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c004d40 0x7fb95c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:02.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.290+0000 7fb976a00640 1 -- 172.21.15.144:0/3028477152 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c003520 con 0x7fb95c0039e0 2024-05-30T16:50:02.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.290+0000 7fb977400640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c004d40 0x7fb95c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:02.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.291+0000 7fb976a00640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb95c003e00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb968009ac0 tx=0x7fb95c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec8e0af110cdd97 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:02.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.291+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968036070 con 0x7fb95c0039e0 2024-05-30T16:50:02.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.291+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb968031400 con 0x7fb95c0039e0 2024-05-30T16:50:02.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.291+0000 7fb975600640 1 -- 172.21.15.144:0/3028477152 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968009690 con 0x7fb95c0039e0 2024-05-30T16:50:02.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.291+0000 7fb97de00640 1 -- 172.21.15.144:0/3028477152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 msgr2=0x7fb95c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:02.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.292+0000 7fb97de00640 1 --2- 172.21.15.144:0/3028477152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb95c003e00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb968009ac0 tx=0x7fb95c005830 comp rx=0 tx=0).stop 2024-05-30T16:50:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.292+0000 7fb977400640 1 -- 172.21.15.144:0/3028477152 reap_dead start 2024-05-30T16:50:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.292+0000 7fb97de00640 1 -- 172.21.15.144:0/3028477152 shutdown_connections 2024-05-30T16:50:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.292+0000 7fb97de00640 1 -- 172.21.15.144:0/3028477152 >> 172.21.15.144:0/3028477152 conn(0x7fb97806bd00 msgr2=0x7fb97806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.292+0000 7fb97de00640 1 -- 172.21.15.144:0/3028477152 shutdown_connections 2024-05-30T16:50:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.292+0000 7fb97de00640 1 -- 172.21.15.144:0/3028477152 wait complete. 2024-05-30T16:50:02.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.294+0000 7fb97de00640 1 Processor -- start 2024-05-30T16:50:02.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.294+0000 7fb97de00640 1 -- start start 2024-05-30T16:50:02.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb97de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb9780b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:02.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb97de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780aed80 0x7fb9780b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:02.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb97de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780ad8a0 0x7fb9780add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:02.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb97de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9780b64f0 con 0x7fb95c0039e0 2024-05-30T16:50:02.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb97de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb97815f140 con 0x7fb9780ad8a0 2024-05-30T16:50:02.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb97de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb97815fe70 con 0x7fb9780aed80 2024-05-30T16:50:02.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb976a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb9780b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:02.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb976a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb9780b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59526/0 (socket says 172.21.15.144:59526) 2024-05-30T16:50:02.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb976a00640 1 -- 172.21.15.144:0/1901807381 learned_addr learned my addr 172.21.15.144:0/1901807381 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:02.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb976000640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780aed80 0x7fb9780b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:02.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb976a00640 1 -- 172.21.15.144:0/1901807381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780aed80 msgr2=0x7fb9780b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:02.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb976a00640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780aed80 0x7fb9780b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:02.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb976a00640 1 -- 172.21.15.144:0/1901807381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780ad8a0 msgr2=0x7fb9780add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:02.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb976a00640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780ad8a0 0x7fb9780add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:02.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.295+0000 7fb976a00640 1 -- 172.21.15.144:0/1901807381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97815ac70 con 0x7fb95c0039e0 2024-05-30T16:50:02.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.296+0000 7fb976a00640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb9780b1250 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb968009ac0 tx=0x7fb968004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:02.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.296+0000 7fb96f400640 1 -- 172.21.15.144:0/1901807381 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968040020 con 0x7fb95c0039e0 2024-05-30T16:50:02.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.296+0000 7fb96f400640 1 -- 172.21.15.144:0/1901807381 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb968003c40 con 0x7fb95c0039e0 2024-05-30T16:50:02.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.296+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97815af50 con 0x7fb95c0039e0 2024-05-30T16:50:02.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.296+0000 7fb96f400640 1 -- 172.21.15.144:0/1901807381 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968036040 con 0x7fb95c0039e0 2024-05-30T16:50:02.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.296+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97815b510 con 0x7fb95c0039e0 2024-05-30T16:50:02.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.297+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb978068b90 con 0x7fb95c0039e0 2024-05-30T16:50:02.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.298+0000 7fb96f400640 1 -- 172.21.15.144:0/1901807381 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fb968043020 con 0x7fb95c0039e0 2024-05-30T16:50:02.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.299+0000 7fb96f400640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95806d5e0 0x7fb95806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:02.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.299+0000 7fb96f400640 1 -- 172.21.15.144:0/1901807381 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7fb9680aa8e0 con 0x7fb95c0039e0 2024-05-30T16:50:02.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.299+0000 7fb976000640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95806d5e0 0x7fb95806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.300+0000 7fb976000640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95806d5e0 0x7fb95806faa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb9781421f0 tx=0x7fb964009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:02.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.303+0000 7fb96f400640 1 -- 172.21.15.144:0/1901807381 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb96804a070 con 0x7fb95c0039e0 2024-05-30T16:50:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:02.543+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb9780b4280 con 0x7fb95c0039e0 2024-05-30T16:50:03.158 INFO:tasks.ceph.mds.b.smithi149.stderr:2024-05-30T16:50:03.157+0000 7f9588e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T16:50:03.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.223+0000 7fb96f400640 1 -- 172.21.15.144:0/1901807381 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) ==== 118+0+0 (secure 0 0 0) 0x7fb96807a6d0 con 0x7fb95c0039e0 2024-05-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95806d5e0 msgr2=0x7fb95806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95806d5e0 0x7fb95806faa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb9781421f0 tx=0x7fb964009040 comp rx=0 tx=0).stop 2024-05-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 msgr2=0x7fb9780b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb9780b1250 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb968009ac0 tx=0x7fb968004730 comp rx=0 tx=0).stop 2024-05-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 shutdown_connections 2024-05-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95806d5e0 0x7fb95806faa0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780ad8a0 0x7fb9780add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780aed80 0x7fb9780b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 --2- 172.21.15.144:0/1901807381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c0039e0 0x7fb9780b1250 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.227+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 >> 172.21.15.144:0/1901807381 conn(0x7fb97806bd00 msgr2=0x7fb9781439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.228+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 shutdown_connections 2024-05-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.228+0000 7fb97de00640 1 -- 172.21.15.144:0/1901807381 wait complete. 2024-05-30T16:50:03.251 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T16:50:03.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T16:50:03.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.445+0000 7fc5f7200640 1 Processor -- start 2024-05-30T16:50:03.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.446+0000 7fc5f7200640 1 -- start start 2024-05-30T16:50:03.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.447+0000 7fc5f7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5f8145f10 0x7fc5f80cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:03.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.447+0000 7fc5f7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5f806c3d0 0x7fc5f8160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:03.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.447+0000 7fc5f7200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc5f81607c0 0x7fc5f815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:03.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.447+0000 7fc5f7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f8160c50 con 0x7fc5f8145f10 2024-05-30T16:50:03.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.447+0000 7fc5f7200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f8161100 con 0x7fc5f81607c0 2024-05-30T16:50:03.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.447+0000 7fc5f7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f806c810 con 0x7fc5f806c3d0 2024-05-30T16:50:03.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.447+0000 7fc5f5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5f8145f10 0x7fc5f80cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:03.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.448+0000 7fc5f5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5f8145f10 0x7fc5f80cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59542/0 (socket says 172.21.15.144:59542) 2024-05-30T16:50:03.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.448+0000 7fc5f5e00640 1 -- 172.21.15.144:0/707396348 learned_addr learned my addr 172.21.15.144:0/707396348 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:03.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.448+0000 7fc5f6800640 1 --2- 172.21.15.144:0/707396348 >> v2:172.21.15.149:3300/0 conn(0x7fc5f81607c0 0x7fc5f815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:03.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.448+0000 7fc5f5e00640 1 -- 172.21.15.144:0/707396348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5f806c3d0 msgr2=0x7fc5f8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:03.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.448+0000 7fc5ed400640 1 --2- 172.21.15.144:0/707396348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5f806c3d0 0x7fc5f8160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:03.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.448+0000 7fc5f5e00640 1 --2- 172.21.15.144:0/707396348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5f806c3d0 0x7fc5f8160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.448+0000 7fc5f5e00640 1 -- 172.21.15.144:0/707396348 >> v2:172.21.15.149:3300/0 conn(0x7fc5f81607c0 msgr2=0x7fc5f815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:03.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.448+0000 7fc5f5e00640 1 --2- 172.21.15.144:0/707396348 >> v2:172.21.15.149:3300/0 conn(0x7fc5f81607c0 0x7fc5f815cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.448+0000 7fc5f5e00640 1 -- 172.21.15.144:0/707396348 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80cd3e0 con 0x7fc5f8145f10 2024-05-30T16:50:03.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.449+0000 7fc5f5e00640 1 --2- 172.21.15.144:0/707396348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f8145f10 0x7fc5f80cce00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc5f806dc50 tx=0x7fc5e802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4122731ff4dfaf03 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.449+0000 7fc5f5400640 1 -- 172.21.15.144:0/707396348 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8037070 con 0x7fc5f8145f10 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.449+0000 7fc5f5400640 1 -- 172.21.15.144:0/707396348 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8032440 con 0x7fc5f8145f10 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.449+0000 7fc5f5400640 1 -- 172.21.15.144:0/707396348 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8032810 con 0x7fc5f8145f10 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.450+0000 7fc5f7200640 1 -- 172.21.15.144:0/707396348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f8145f10 msgr2=0x7fc5f80cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.450+0000 7fc5f7200640 1 --2- 172.21.15.144:0/707396348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f8145f10 0x7fc5f80cce00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc5f806dc50 tx=0x7fc5e802a210 comp rx=0 tx=0).stop 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.450+0000 7fc5f7200640 1 -- 172.21.15.144:0/707396348 shutdown_connections 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.450+0000 7fc5f7200640 1 --2- 172.21.15.144:0/707396348 >> v2:172.21.15.149:3300/0 conn(0x7fc5f81607c0 0x7fc5f815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.450+0000 7fc5f7200640 1 --2- 172.21.15.144:0/707396348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5f806c3d0 0x7fc5f8160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.450+0000 7fc5f7200640 1 --2- 172.21.15.144:0/707396348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f8145f10 0x7fc5f80cce00 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.450+0000 7fc5f7200640 1 -- 172.21.15.144:0/707396348 >> 172.21.15.144:0/707396348 conn(0x7fc5f806b8e0 msgr2=0x7fc5f806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.450+0000 7fc5f7200640 1 -- 172.21.15.144:0/707396348 shutdown_connections 2024-05-30T16:50:03.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.450+0000 7fc5f7200640 1 -- 172.21.15.144:0/707396348 wait complete. 2024-05-30T16:50:03.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.452+0000 7fc5f7200640 1 Processor -- start 2024-05-30T16:50:03.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.452+0000 7fc5f7200640 1 -- start start 2024-05-30T16:50:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.453+0000 7fc5f7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f806c3d0 0x7fc5f815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.453+0000 7fc5f7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5f8145f10 0x7fc5f8141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.453+0000 7fc5f7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5f81607c0 0x7fc5f8141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.453+0000 7fc5f7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f80cdc80 con 0x7fc5f806c3d0 2024-05-30T16:50:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.453+0000 7fc5f7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f80cd9a0 con 0x7fc5f81607c0 2024-05-30T16:50:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.453+0000 7fc5f7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f80cdf60 con 0x7fc5f8145f10 2024-05-30T16:50:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.453+0000 7fc5f5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f806c3d0 0x7fc5f815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.453+0000 7fc5f5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f806c3d0 0x7fc5f815fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59556/0 (socket says 172.21.15.144:59556) 2024-05-30T16:50:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.453+0000 7fc5f5e00640 1 -- 172.21.15.144:0/1443330719 learned_addr learned my addr 172.21.15.144:0/1443330719 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:03.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.454+0000 7fc5f5e00640 1 -- 172.21.15.144:0/1443330719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5f8145f10 msgr2=0x7fc5f8141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:03.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.454+0000 7fc5f5e00640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5f8145f10 0x7fc5f8141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.454+0000 7fc5f5e00640 1 -- 172.21.15.144:0/1443330719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5f81607c0 msgr2=0x7fc5f8141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:03.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.454+0000 7fc5f5e00640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5f81607c0 0x7fc5f8141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:03.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.454+0000 7fc5f5e00640 1 -- 172.21.15.144:0/1443330719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80aca00 con 0x7fc5f806c3d0 2024-05-30T16:50:03.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.454+0000 7fc5f5e00640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f806c3d0 0x7fc5f815fd70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc5e802a250 tx=0x7fc5e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:03.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.454+0000 7fc5eea00640 1 -- 172.21.15.144:0/1443330719 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8037040 con 0x7fc5f806c3d0 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.455+0000 7fc5eea00640 1 -- 172.21.15.144:0/1443330719 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8042070 con 0x7fc5f806c3d0 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.455+0000 7fc5eea00640 1 -- 172.21.15.144:0/1443330719 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8030bd0 con 0x7fc5f806c3d0 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.455+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f80acca0 con 0x7fc5f806c3d0 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.455+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f813d2a0 con 0x7fc5f806c3d0 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.456+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f80632f0 con 0x7fc5f806c3d0 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.457+0000 7fc5eea00640 1 -- 172.21.15.144:0/1443330719 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fc5e8047460 con 0x7fc5f806c3d0 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.458+0000 7fc5eea00640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5d406d610 0x7fc5d406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.458+0000 7fc5eea00640 1 -- 172.21.15.144:0/1443330719 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7fc5e80ab400 con 0x7fc5f806c3d0 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.458+0000 7fc5ed400640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5d406d610 0x7fc5d406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.459+0000 7fc5ed400640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5d406d610 0x7fc5d406fad0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0006b10 tx=0x7fc5e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:03.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.463+0000 7fc5eea00640 1 -- 172.21.15.144:0/1443330719 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5e8045360 con 0x7fc5f806c3d0 2024-05-30T16:50:03.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:03.705+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc5f80b0620 con 0x7fc5f806c3d0 2024-05-30T16:50:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.239+0000 7fc5eea00640 1 -- 172.21.15.144:0/1443330719 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7fc5e807aff0 con 0x7fc5f806c3d0 2024-05-30T16:50:04.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5d406d610 msgr2=0x7fc5d406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5d406d610 0x7fc5d406fad0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0006b10 tx=0x7fc5e0008040 comp rx=0 tx=0).stop 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f806c3d0 msgr2=0x7fc5f815fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f806c3d0 0x7fc5f815fd70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc5e802a250 tx=0x7fc5e80046c0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 shutdown_connections 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5d406d610 0x7fc5d406fad0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5f81607c0 0x7fc5f8141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5f8145f10 0x7fc5f8141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 --2- 172.21.15.144:0/1443330719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f806c3d0 0x7fc5f815fd70 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 >> 172.21.15.144:0/1443330719 conn(0x7fc5f806b8e0 msgr2=0x7fc5f806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 shutdown_connections 2024-05-30T16:50:04.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.244+0000 7fc5f7200640 1 -- 172.21.15.144:0/1443330719 wait complete. 2024-05-30T16:50:04.268 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T16:50:04.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:50:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.466+0000 7f2f9da00640 1 Processor -- start 2024-05-30T16:50:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.466+0000 7f2f9da00640 1 -- start start 2024-05-30T16:50:04.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.467+0000 7f2f9da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f980ba090 0x7f2f980cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.467+0000 7f2f9da00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f980cfa10 0x7f2f980d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.467+0000 7f2f9da00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9815ed40 con 0x7f2f9815e960 2024-05-30T16:50:04.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.467+0000 7f2f9da00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2f980cfe80 con 0x7f2f980ba090 2024-05-30T16:50:04.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.467+0000 7f2f9da00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2f980d2b40 con 0x7f2f980cfa10 2024-05-30T16:50:04.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.468+0000 7f2f8f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f980ba090 0x7f2f980cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.468+0000 7f2f8f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f980ba090 0x7f2f980cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59568/0 (socket says 172.21.15.144:59568) 2024-05-30T16:50:04.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.468+0000 7f2f8f400640 1 -- 172.21.15.144:0/612311461 learned_addr learned my addr 172.21.15.144:0/612311461 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:04.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.468+0000 7f2f9d000640 1 --2- 172.21.15.144:0/612311461 >> v2:172.21.15.149:3300/0 conn(0x7f2f980cfa10 0x7f2f980d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.468+0000 7f2f8f400640 1 -- 172.21.15.144:0/612311461 >> v2:172.21.15.149:3300/0 conn(0x7f2f980cfa10 msgr2=0x7f2f980d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:04.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.468+0000 7f2f8f400640 1 --2- 172.21.15.144:0/612311461 >> v2:172.21.15.149:3300/0 conn(0x7f2f980cfa10 0x7f2f980d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.468+0000 7f2f8f400640 1 -- 172.21.15.144:0/612311461 >> v1:172.21.15.149:6789/0 conn(0x7f2f9815e960 legacy=0x7f2f98162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:04.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.468+0000 7f2f8f400640 1 -- 172.21.15.144:0/612311461 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f98162ca0 con 0x7f2f980ba090 2024-05-30T16:50:04.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.470+0000 7f2f8f400640 1 --2- 172.21.15.144:0/612311461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 0x7f2f980cf4d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2f980cf110 tx=0x7f2f8002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b7463f8df08db3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:04.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.470+0000 7f2f97400640 1 -- 172.21.15.144:0/612311461 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80037070 con 0x7f2f980ba090 2024-05-30T16:50:04.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.470+0000 7f2f97400640 1 -- 172.21.15.144:0/612311461 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f80032440 con 0x7f2f980ba090 2024-05-30T16:50:04.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.470+0000 7f2f97400640 1 -- 172.21.15.144:0/612311461 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80032810 con 0x7f2f980ba090 2024-05-30T16:50:04.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.471+0000 7f2f9da00640 1 -- 172.21.15.144:0/612311461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 msgr2=0x7f2f980cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.471+0000 7f2f9da00640 1 --2- 172.21.15.144:0/612311461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 0x7f2f980cf4d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2f980cf110 tx=0x7f2f8002a230 comp rx=0 tx=0).stop 2024-05-30T16:50:04.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.471+0000 7f2f9da00640 1 -- 172.21.15.144:0/612311461 shutdown_connections 2024-05-30T16:50:04.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.471+0000 7f2f9da00640 1 --2- 172.21.15.144:0/612311461 >> v2:172.21.15.149:3300/0 conn(0x7f2f980cfa10 0x7f2f980d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.471+0000 7f2f9da00640 1 --2- 172.21.15.144:0/612311461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 0x7f2f980cf4d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.471+0000 7f2f9da00640 1 -- 172.21.15.144:0/612311461 >> 172.21.15.144:0/612311461 conn(0x7f2f980d1360 msgr2=0x7f2f980d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:04.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.471+0000 7f2f9da00640 1 -- 172.21.15.144:0/612311461 shutdown_connections 2024-05-30T16:50:04.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.471+0000 7f2f9da00640 1 -- 172.21.15.144:0/612311461 wait complete. 2024-05-30T16:50:04.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.472+0000 7f2f9da00640 1 Processor -- start 2024-05-30T16:50:04.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.473+0000 7f2f9da00640 1 -- start start 2024-05-30T16:50:04.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.473+0000 7f2f9da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 0x7f2f98154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.473+0000 7f2f9da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f980cfa10 0x7f2f981f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f9da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f9815e960 0x7f2f980cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f9da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2f980d2d90 con 0x7f2f980ba090 2024-05-30T16:50:04.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f9da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f98163260 con 0x7f2f9815e960 2024-05-30T16:50:04.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f9da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f980b78a0 con 0x7f2f980cfa10 2024-05-30T16:50:04.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f97e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 0x7f2f98154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f97e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 0x7f2f98154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59570/0 (socket says 172.21.15.144:59570) 2024-05-30T16:50:04.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f97e00640 1 -- 172.21.15.144:0/1086198436 learned_addr learned my addr 172.21.15.144:0/1086198436 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:04.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f97e00640 1 -- 172.21.15.144:0/1086198436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f980cfa10 msgr2=0x7f2f981f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f97e00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f980cfa10 0x7f2f981f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f97e00640 1 -- 172.21.15.144:0/1086198436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f9815e960 msgr2=0x7f2f980cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f97e00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f9815e960 0x7f2f980cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f97e00640 1 -- 172.21.15.144:0/1086198436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f981f5000 con 0x7f2f980ba090 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.474+0000 7f2f97e00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 0x7f2f98154ca0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c7f0 tx=0x7f2f8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.475+0000 7f2f94c00640 1 -- 172.21.15.144:0/1086198436 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88016020 con 0x7f2f980ba090 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.475+0000 7f2f94c00640 1 -- 172.21.15.144:0/1086198436 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f8800aa50 con 0x7f2f980ba090 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.475+0000 7f2f94c00640 1 -- 172.21.15.144:0/1086198436 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800ae40 con 0x7f2f980ba090 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.475+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f981f4760 con 0x7f2f980ba090 2024-05-30T16:50:04.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.475+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f981f4d20 con 0x7f2f980ba090 2024-05-30T16:50:04.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.476+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f98075570 con 0x7f2f980ba090 2024-05-30T16:50:04.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.477+0000 7f2f94c00640 1 -- 172.21.15.144:0/1086198436 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f2f88019020 con 0x7f2f980ba090 2024-05-30T16:50:04.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.478+0000 7f2f94c00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2f7406d610 0x7f2f7406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.478+0000 7f2f94c00640 1 -- 172.21.15.144:0/1086198436 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f2f8808a2c0 con 0x7f2f980ba090 2024-05-30T16:50:04.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.478+0000 7f2f8f400640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2f7406d610 0x7f2f7406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.479+0000 7f2f8f400640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2f7406d610 0x7f2f7406fad0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2f80034000 tx=0x7f2f8002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:04.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.483+0000 7f2f94c00640 1 -- 172.21.15.144:0/1086198436 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f88020070 con 0x7f2f980ba090 2024-05-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.719+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f980d2410 con 0x7f2f980ba090 2024-05-30T16:50:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.721+0000 7f2f94c00640 1 -- 172.21.15.144:0/1086198436 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5195 (secure 0 0 0) 0x7f2f8805a140 con 0x7f2f980ba090 2024-05-30T16:50:04.722 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:04.722 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2114834818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2114834818},{"type":"v1","addr":"172.21.15.149:6835","nonce":2114834818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6435,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1242312372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1242312372},{"type":"v1","addr":"172.21.15.144:6835","nonce":1242312372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3989377290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3989377290},{"type":"v1","addr":"172.21.15.144:6837","nonce":3989377290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:50:00.647053+0000","modified":"2024-05-30T16:50:03.707309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6833/1951637959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1951637959},{"type":"v1","addr":"172.21.15.149:6833","nonce":1951637959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6447,"qdb_cluster":[6447]},"id":5}]} 2024-05-30T16:50:04.723 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 45 2024-05-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.723+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2f7406d610 msgr2=0x7f2f7406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.723+0000 7f2f9da00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2f7406d610 0x7f2f7406fad0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2f80034000 tx=0x7f2f8002c000 comp rx=0 tx=0).stop 2024-05-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.723+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 msgr2=0x7f2f98154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.723+0000 7f2f9da00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 0x7f2f98154ca0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c7f0 tx=0x7f2f8800ccb0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.724+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 shutdown_connections 2024-05-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.724+0000 7f2f9da00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2f7406d610 0x7f2f7406fad0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.724+0000 7f2f9da00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f9815e960 0x7f2f980cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.724+0000 7f2f9da00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f980cfa10 0x7f2f981f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.724+0000 7f2f9da00640 1 --2- 172.21.15.144:0/1086198436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f980ba090 0x7f2f98154ca0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.724+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 >> 172.21.15.144:0/1086198436 conn(0x7f2f980d1360 msgr2=0x7f2f9815d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:04.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.724+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 shutdown_connections 2024-05-30T16:50:04.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.724+0000 7f2f9da00640 1 -- 172.21.15.144:0/1086198436 wait complete. 2024-05-30T16:50:04.744 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:50:04.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.936+0000 7ffada200640 1 Processor -- start 2024-05-30T16:50:04.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.936+0000 7ffada200640 1 -- start start 2024-05-30T16:50:04.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.937+0000 7ffada200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffad40cfc40 0x7ffad406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.937+0000 7ffada200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffad406f610 0x7ffad40b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffada200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad40d00f0 con 0x7ffad4145150 2024-05-30T16:50:04.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffada200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffad406fa60 con 0x7ffad406f610 2024-05-30T16:50:04.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffada200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ffad415f140 con 0x7ffad40cfc40 2024-05-30T16:50:04.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffad3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffad406f610 0x7ffad40b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffad3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffad406f610 0x7ffad40b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42952/0 (socket says 172.21.15.144:42952) 2024-05-30T16:50:04.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffad3e00640 1 -- 172.21.15.144:0/3231637527 learned_addr learned my addr 172.21.15.144:0/3231637527 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:04.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffad2a00640 1 --2- 172.21.15.144:0/3231637527 >> v2:172.21.15.149:3300/0 conn(0x7ffad40cfc40 0x7ffad406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffad3e00640 1 -- 172.21.15.144:0/3231637527 >> v2:172.21.15.149:3300/0 conn(0x7ffad40cfc40 msgr2=0x7ffad406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:04.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffad3e00640 1 --2- 172.21.15.144:0/3231637527 >> v2:172.21.15.149:3300/0 conn(0x7ffad40cfc40 0x7ffad406f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffad3e00640 1 -- 172.21.15.144:0/3231637527 >> v1:172.21.15.144:6789/0 conn(0x7ffad4145150 legacy=0x7ffad40cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffad3e00640 1 -- 172.21.15.144:0/3231637527 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad415f390 con 0x7ffad406f610 2024-05-30T16:50:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.938+0000 7ffad2a00640 1 --2- 172.21.15.144:0/3231637527 >> v2:172.21.15.149:3300/0 conn(0x7ffad40cfc40 0x7ffad406f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.939+0000 7ffad3e00640 1 --2- 172.21.15.144:0/3231637527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 0x7ffad40b4930 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ffad40b3b40 tx=0x7ffacc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a15ec582249b29f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffad2000640 1 -- 172.21.15.144:0/3231637527 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc036070 con 0x7ffad406f610 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffad2000640 1 -- 172.21.15.144:0/3231637527 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffacc031600 con 0x7ffad406f610 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffad2000640 1 -- 172.21.15.144:0/3231637527 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0319d0 con 0x7ffad406f610 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffada200640 1 -- 172.21.15.144:0/3231637527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 msgr2=0x7ffad40b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffada200640 1 --2- 172.21.15.144:0/3231637527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 0x7ffad40b4930 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ffad40b3b40 tx=0x7ffacc02a6a0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffada200640 1 -- 172.21.15.144:0/3231637527 shutdown_connections 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffada200640 1 --2- 172.21.15.144:0/3231637527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 0x7ffad40b4930 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffada200640 1 --2- 172.21.15.144:0/3231637527 >> v2:172.21.15.149:3300/0 conn(0x7ffad40cfc40 0x7ffad406f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffada200640 1 -- 172.21.15.144:0/3231637527 >> 172.21.15.144:0/3231637527 conn(0x7ffad406bd00 msgr2=0x7ffad406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.940+0000 7ffada200640 1 -- 172.21.15.144:0/3231637527 shutdown_connections 2024-05-30T16:50:04.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.941+0000 7ffada200640 1 -- 172.21.15.144:0/3231637527 wait complete. 2024-05-30T16:50:04.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.942+0000 7ffada200640 1 Processor -- start 2024-05-30T16:50:04.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.942+0000 7ffada200640 1 -- start start 2024-05-30T16:50:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.943+0000 7ffada200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 0x7ffad415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.943+0000 7ffada200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffad40cfc40 0x7ffad40aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.943+0000 7ffada200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffad4145150 0x7ffad415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.943+0000 7ffada200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffad40b64f0 con 0x7ffad406f610 2024-05-30T16:50:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.943+0000 7ffada200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffad415f950 con 0x7ffad40cfc40 2024-05-30T16:50:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.943+0000 7ffada200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffad415fe70 con 0x7ffad4145150 2024-05-30T16:50:04.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.943+0000 7ffad3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 0x7ffad415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 0x7ffad415d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42954/0 (socket says 172.21.15.144:42954) 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3400640 1 -- 172.21.15.144:0/1539123519 learned_addr learned my addr 172.21.15.144:0/1539123519 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3e00640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffad4145150 0x7ffad415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad2a00640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffad40cfc40 0x7ffad40aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3400640 1 -- 172.21.15.144:0/1539123519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffad4145150 msgr2=0x7ffad415bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3400640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffad4145150 0x7ffad415bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3400640 1 -- 172.21.15.144:0/1539123519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffad40cfc40 msgr2=0x7ffad40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3400640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffad40cfc40 0x7ffad40aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3400640 1 -- 172.21.15.144:0/1539123519 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad415c520 con 0x7ffad406f610 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3e00640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffad4145150 0x7ffad415bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:50:04.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.944+0000 7ffad3400640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 0x7ffad415d5c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ffac400c3c0 tx=0x7ffac400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:04.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.945+0000 7ffacb400640 1 -- 172.21.15.144:0/1539123519 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac40052d0 con 0x7ffad406f610 2024-05-30T16:50:04.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.945+0000 7ffacb400640 1 -- 172.21.15.144:0/1539123519 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac4005490 con 0x7ffad406f610 2024-05-30T16:50:04.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.945+0000 7ffacb400640 1 -- 172.21.15.144:0/1539123519 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4007260 con 0x7ffad406f610 2024-05-30T16:50:04.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.945+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad415c860 con 0x7ffad406f610 2024-05-30T16:50:04.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.945+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad415d0a0 con 0x7ffad406f610 2024-05-30T16:50:04.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.946+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad4068b90 con 0x7ffad406f610 2024-05-30T16:50:04.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.947+0000 7ffacb400640 1 -- 172.21.15.144:0/1539123519 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7ffac4007400 con 0x7ffad406f610 2024-05-30T16:50:04.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.948+0000 7ffacb400640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffab406d5e0 0x7ffab406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:04.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.949+0000 7ffacb400640 1 -- 172.21.15.144:0/1539123519 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7ffac4089a90 con 0x7ffad406f610 2024-05-30T16:50:04.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.949+0000 7ffad2a00640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffab406d5e0 0x7ffab406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:04.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.949+0000 7ffad2a00640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffab406d5e0 0x7ffab406faa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ffad40afb10 tx=0x7ffac0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:04.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:04.953+0000 7ffacb400640 1 -- 172.21.15.144:0/1539123519 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffad415c860 con 0x7ffad406f610 2024-05-30T16:50:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.151+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffad40cde30 con 0x7ffad406f610 2024-05-30T16:50:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.153+0000 7ffacb400640 1 -- 172.21.15.144:0/1539123519 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16747 (secure 0 0 0) 0x7ffac4059910 con 0x7ffad406f610 2024-05-30T16:50:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:05.155 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":72,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:50:02.202654+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:58.537507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:59.619855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:50:05.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffab406d5e0 msgr2=0x7ffab406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffab406d5e0 0x7ffab406faa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ffad40afb10 tx=0x7ffac0008040 comp rx=0 tx=0).stop 2024-05-30T16:50:05.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 msgr2=0x7ffad415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 0x7ffad415d5c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ffac400c3c0 tx=0x7ffac400c880 comp rx=0 tx=0).stop 2024-05-30T16:50:05.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 shutdown_connections 2024-05-30T16:50:05.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffab406d5e0 0x7ffab406faa0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffad4145150 0x7ffad415bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffad40cfc40 0x7ffad40aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 --2- 172.21.15.144:0/1539123519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffad406f610 0x7ffad415d5c0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 >> 172.21.15.144:0/1539123519 conn(0x7ffad406bd00 msgr2=0x7ffad406ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:05.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 shutdown_connections 2024-05-30T16:50:05.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.156+0000 7ffada200640 1 -- 172.21.15.144:0/1539123519 wait complete. 2024-05-30T16:50:05.176 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:50:05.176 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:50:05.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.356+0000 7fad1d000640 1 Processor -- start 2024-05-30T16:50:05.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.356+0000 7fad1d000640 1 -- start start 2024-05-30T16:50:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.358+0000 7fad1d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad180cc0b0 0x7fad1815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.358+0000 7fad1d000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1815da70 con 0x7fad1806fcf0 2024-05-30T16:50:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.358+0000 7fad1d000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad18160ec0 con 0x7fad1806b8e0 2024-05-30T16:50:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.358+0000 7fad1d000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fad180ccd20 con 0x7fad180cc0b0 2024-05-30T16:50:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.358+0000 7fad17e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fad1806fcf0 0x7fad181607b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58938/0 (socket says 172.21.15.144:58938) 2024-05-30T16:50:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.358+0000 7fad17e00640 1 -- 172.21.15.144:0/3418214302 learned_addr learned my addr 172.21.15.144:0/3418214302 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:05.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.358+0000 7fad17400640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad180cc0b0 0x7fad1815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.358+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250595148 0 0) 0x7fad10001490 con 0x7fad1806fcf0 2024-05-30T16:50:05.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facfc003520 con 0x7fad1806fcf0 2024-05-30T16:50:05.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 371816788 0 0) 0x7facfc003520 con 0x7fad1806fcf0 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad180cc0b0 msgr2=0x7fad1815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad180cc0b0 0x7fad1815d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 >> v1:172.21.15.149:6789/0 conn(0x7fad1806b8e0 legacy=0x7fad181600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad180cd000 con 0x7fad1806fcf0 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fad10001bc0 con 0x7fad1806fcf0 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 >> v1:172.21.15.144:6789/0 conn(0x7fad1806fcf0 legacy=0x7fad181607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facfc0039e0 0x7facfc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad180cc0b0 0x7facfc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc004d40 0x7facfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad180ccd20 con 0x7facfc004d40 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7facfc00bba0 con 0x7facfc0039e0 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7facfc00bda0 con 0x7fad180cc0b0 2024-05-30T16:50:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.359+0000 7fad17e00640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc004d40 0x7facfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.360+0000 7fad17400640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facfc0039e0 0x7facfc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.360+0000 7fad17e00640 1 -- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad180cc0b0 msgr2=0x7facfc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.360+0000 7fad16a00640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad180cc0b0 0x7facfc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.360+0000 7fad17e00640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad180cc0b0 0x7facfc004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.360+0000 7fad17e00640 1 -- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facfc0039e0 msgr2=0x7facfc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.360+0000 7fad17e00640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facfc0039e0 0x7facfc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.360+0000 7fad17e00640 1 -- 172.21.15.144:0/3418214302 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc003520 con 0x7facfc004d40 2024-05-30T16:50:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.360+0000 7fad17400640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facfc0039e0 0x7facfc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.361+0000 7fad17e00640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc004d40 0x7facfc0051c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fad1000aa30 tx=0x7facfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab11580f531e961 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.361+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1000a650 con 0x7facfc004d40 2024-05-30T16:50:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.361+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1002f070 con 0x7facfc004d40 2024-05-30T16:50:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.361+0000 7fad16000640 1 -- 172.21.15.144:0/3418214302 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10034470 con 0x7facfc004d40 2024-05-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.361+0000 7fad1d000640 1 -- 172.21.15.144:0/3418214302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc004d40 msgr2=0x7facfc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.361+0000 7fad1d000640 1 --2- 172.21.15.144:0/3418214302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc004d40 0x7facfc0051c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fad1000aa30 tx=0x7facfc005830 comp rx=0 tx=0).stop 2024-05-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.361+0000 7fad17e00640 1 -- 172.21.15.144:0/3418214302 reap_dead start 2024-05-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.362+0000 7fad1d000640 1 -- 172.21.15.144:0/3418214302 shutdown_connections 2024-05-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.362+0000 7fad1d000640 1 -- 172.21.15.144:0/3418214302 >> 172.21.15.144:0/3418214302 conn(0x7fad180b20a0 msgr2=0x7fad180b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.362+0000 7fad1d000640 1 -- 172.21.15.144:0/3418214302 shutdown_connections 2024-05-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.362+0000 7fad1d000640 1 -- 172.21.15.144:0/3418214302 wait complete. 2024-05-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.363+0000 7fad1d000640 1 Processor -- start 2024-05-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.363+0000 7fad1d000640 1 -- start start 2024-05-30T16:50:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.364+0000 7fad1d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7facfc004d40 0x7fad180cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.364+0000 7fad1d000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad180b05b0 0x7fad180cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.364+0000 7fad1d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1815b7f0 0x7fad1815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.364+0000 7fad1d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad180cc9e0 con 0x7fad1815b7f0 2024-05-30T16:50:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.364+0000 7fad1d000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fad180cd5c0 con 0x7fad180b05b0 2024-05-30T16:50:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.364+0000 7fad1d000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fad180cc490 con 0x7facfc004d40 2024-05-30T16:50:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1815b7f0 0x7fad1815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1815b7f0 0x7fad1815bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42962/0 (socket says 172.21.15.144:42962) 2024-05-30T16:50:05.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17e00640 1 -- 172.21.15.144:0/3613618128 learned_addr learned my addr 172.21.15.144:0/3613618128 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17400640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7facfc004d40 0x7fad180cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad16a00640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad180b05b0 0x7fad180cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17e00640 1 -- 172.21.15.144:0/3613618128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7facfc004d40 msgr2=0x7fad180cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17e00640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7facfc004d40 0x7fad180cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17e00640 1 -- 172.21.15.144:0/3613618128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad180b05b0 msgr2=0x7fad180cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17e00640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad180b05b0 0x7fad180cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17e00640 1 -- 172.21.15.144:0/3613618128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad180b0a70 con 0x7fad1815b7f0 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad16a00640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad180b05b0 0x7fad180cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.365+0000 7fad17e00640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1815b7f0 0x7fad1815bca0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fad1000a0b0 tx=0x7fad1002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.366+0000 7fad0f400640 1 -- 172.21.15.144:0/3613618128 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1002be60 con 0x7fad1815b7f0 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.366+0000 7fad0f400640 1 -- 172.21.15.144:0/3613618128 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad10001250 con 0x7fad1815b7f0 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.366+0000 7fad0f400640 1 -- 172.21.15.144:0/3613618128 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10034670 con 0x7fad1815b7f0 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.366+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad180b0d50 con 0x7fad1815b7f0 2024-05-30T16:50:05.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.366+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad180b1310 con 0x7fad1815b7f0 2024-05-30T16:50:05.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.367+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad18075570 con 0x7fad1815b7f0 2024-05-30T16:50:05.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.368+0000 7fad0f400640 1 -- 172.21.15.144:0/3613618128 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fad10034810 con 0x7fad1815b7f0 2024-05-30T16:50:05.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.369+0000 7fad0f400640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7facf806d610 0x7facf806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.369+0000 7fad0f400640 1 -- 172.21.15.144:0/3613618128 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7fad100a9f40 con 0x7fad1815b7f0 2024-05-30T16:50:05.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.369+0000 7fad17400640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7facf806d610 0x7facf806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.369+0000 7fad17400640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7facf806d610 0x7facf806fad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:05.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.373+0000 7fad0f400640 1 -- 172.21.15.144:0/3613618128 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad10047020 con 0x7fad1815b7f0 2024-05-30T16:50:05.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.551+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad18156ca0 con 0x7facf806d610 2024-05-30T16:50:05.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.558+0000 7fad0f400640 1 -- 172.21.15.144:0/3613618128 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247926 (secure 0 0 0) 0x7fad18156ca0 con 0x7facf806d610 2024-05-30T16:50:05.563 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:05.565 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7facf806d610 msgr2=0x7facf806fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7facf806d610 0x7facf806fad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08008040 comp rx=0 tx=0).stop 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1815b7f0 msgr2=0x7fad1815bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1815b7f0 0x7fad1815bca0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fad1000a0b0 tx=0x7fad1002d070 comp rx=0 tx=0).stop 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 shutdown_connections 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7facf806d610 0x7facf806fad0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1815b7f0 0x7fad1815bca0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad180b05b0 0x7fad180cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 --2- 172.21.15.144:0/3613618128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7facfc004d40 0x7fad180cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 >> 172.21.15.144:0/3613618128 conn(0x7fad180b20a0 msgr2=0x7fad1806ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.565+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 shutdown_connections 2024-05-30T16:50:05.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.566+0000 7fad1d000640 1 -- 172.21.15.144:0/3613618128 wait complete. 2024-05-30T16:50:05.583 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-05-30T16:50:05.118541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":447412,"kb_used_data":7804,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754527308,"statfs":{"total":773094113280,"available":772635963392,"internally_reserved":0,"allocated":7991296,"data_stored":4056161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":450022963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.954488"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.210932+0000","last_change":"2024-05-30T16:50:01.210932+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.210932+0000","last_undegraded":"2024-05-30T16:50:01.210932+0000","last_fullsized":"2024-05-30T16:50:01.210932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.189821+0000","last_change":"2024-05-30T16:50:00.189821+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.189821+0000","last_undegraded":"2024-05-30T16:50:00.189821+0000","last_fullsized":"2024-05-30T16:50:00.189821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.221320+0000","last_change":"2024-05-30T16:50:01.216644+0000","last_active":"2024-05-30T16:50:01.221320+0000","last_peered":"2024-05-30T16:50:01.221320+0000","last_clean":"2024-05-30T16:50:01.221320+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:50:01.221320+0000","last_undegraded":"2024-05-30T16:50:01.221320+0000","last_fullsized":"2024-05-30T16:50:01.221320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:33:17.720209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.200613+0000","last_change":"2024-05-30T16:50:00.200613+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.200613+0000","last_undegraded":"2024-05-30T16:50:00.200613+0000","last_fullsized":"2024-05-30T16:50:00.200613+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192496+0000","last_change":"2024-05-30T16:50:00.192496+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192496+0000","last_undegraded":"2024-05-30T16:50:00.192496+0000","last_fullsized":"2024-05-30T16:50:00.192496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190684+0000","last_change":"2024-05-30T16:50:00.190684+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190684+0000","last_undegraded":"2024-05-30T16:50:00.190684+0000","last_fullsized":"2024-05-30T16:50:00.190684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.199237+0000","last_change":"2024-05-30T16:50:00.199237+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.199237+0000","last_undegraded":"2024-05-30T16:50:00.199237+0000","last_fullsized":"2024-05-30T16:50:00.199237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.198903+0000","last_change":"2024-05-30T16:50:00.198903+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.198903+0000","last_undegraded":"2024-05-30T16:50:00.198903+0000","last_fullsized":"2024-05-30T16:50:00.198903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.191812+0000","last_change":"2024-05-30T16:50:00.191812+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.191812+0000","last_undegraded":"2024-05-30T16:50:00.191812+0000","last_fullsized":"2024-05-30T16:50:00.191812+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194914+0000","last_change":"2024-05-30T16:50:00.194914+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194914+0000","last_undegraded":"2024-05-30T16:50:00.194914+0000","last_fullsized":"2024-05-30T16:50:00.194914+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.206010+0000","last_change":"2024-05-30T16:50:01.206010+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.206010+0000","last_undegraded":"2024-05-30T16:50:01.206010+0000","last_fullsized":"2024-05-30T16:50:01.206010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194759+0000","last_change":"2024-05-30T16:50:00.194759+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194759+0000","last_undegraded":"2024-05-30T16:50:00.194759+0000","last_fullsized":"2024-05-30T16:50:00.194759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222089+0000","last_change":"2024-05-30T16:50:01.213490+0000","last_active":"2024-05-30T16:50:01.222089+0000","last_peered":"2024-05-30T16:50:01.222089+0000","last_clean":"2024-05-30T16:50:01.222089+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:50:01.222089+0000","last_undegraded":"2024-05-30T16:50:01.222089+0000","last_fullsized":"2024-05-30T16:50:01.222089+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:03.170716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194029+0000","last_change":"2024-05-30T16:50:00.194029+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194029+0000","last_undegraded":"2024-05-30T16:50:00.194029+0000","last_fullsized":"2024-05-30T16:50:00.194029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222022+0000","last_change":"2024-05-30T16:50:01.213697+0000","last_active":"2024-05-30T16:50:01.222022+0000","last_peered":"2024-05-30T16:50:01.222022+0000","last_clean":"2024-05-30T16:50:01.222022+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:50:01.222022+0000","last_undegraded":"2024-05-30T16:50:01.222022+0000","last_fullsized":"2024-05-30T16:50:01.222022+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:54:18.805624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.186522+0000","last_change":"2024-05-30T16:50:00.186522+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.186522+0000","last_undegraded":"2024-05-30T16:50:00.186522+0000","last_fullsized":"2024-05-30T16:50:00.186522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190991+0000","last_change":"2024-05-30T16:50:00.190991+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190991+0000","last_undegraded":"2024-05-30T16:50:00.190991+0000","last_fullsized":"2024-05-30T16:50:00.190991+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.196764+0000","last_change":"2024-05-30T16:50:00.196764+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.196764+0000","last_undegraded":"2024-05-30T16:50:00.196764+0000","last_fullsized":"2024-05-30T16:50:00.196764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.188337+0000","last_change":"2024-05-30T16:50:00.188337+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.188337+0000","last_undegraded":"2024-05-30T16:50:00.188337+0000","last_fullsized":"2024-05-30T16:50:00.188337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225025+0000","last_change":"2024-05-30T16:50:01.223666+0000","last_active":"2024-05-30T16:50:01.225025+0000","last_peered":"2024-05-30T16:50:01.225025+0000","last_clean":"2024-05-30T16:50:01.225025+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:50:01.225025+0000","last_undegraded":"2024-05-30T16:50:01.225025+0000","last_fullsized":"2024-05-30T16:50:01.225025+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:15.642014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.199903+0000","last_change":"2024-05-30T16:50:00.199903+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.199903+0000","last_undegraded":"2024-05-30T16:50:00.199903+0000","last_fullsized":"2024-05-30T16:50:00.199903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192239+0000","last_change":"2024-05-30T16:50:00.192239+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192239+0000","last_undegraded":"2024-05-30T16:50:00.192239+0000","last_fullsized":"2024-05-30T16:50:00.192239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.209132+0000","last_change":"2024-05-30T16:50:01.209132+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.209132+0000","last_undegraded":"2024-05-30T16:50:01.209132+0000","last_fullsized":"2024-05-30T16:50:01.209132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.204097+0000","last_change":"2024-05-30T16:50:01.204097+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.204097+0000","last_undegraded":"2024-05-30T16:50:01.204097+0000","last_fullsized":"2024-05-30T16:50:01.204097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192551+0000","last_change":"2024-05-30T16:50:00.192551+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192551+0000","last_undegraded":"2024-05-30T16:50:00.192551+0000","last_fullsized":"2024-05-30T16:50:00.192551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.205607+0000","last_change":"2024-05-30T16:50:00.205607+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.205607+0000","last_undegraded":"2024-05-30T16:50:00.205607+0000","last_fullsized":"2024-05-30T16:50:00.205607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225568+0000","last_change":"2024-05-30T16:50:01.221359+0000","last_active":"2024-05-30T16:50:01.225568+0000","last_peered":"2024-05-30T16:50:01.225568+0000","last_clean":"2024-05-30T16:50:01.225568+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:50:01.225568+0000","last_undegraded":"2024-05-30T16:50:01.225568+0000","last_fullsized":"2024-05-30T16:50:01.225568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:16.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.193537+0000","last_change":"2024-05-30T16:50:00.193537+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.193537+0000","last_undegraded":"2024-05-30T16:50:00.193537+0000","last_fullsized":"2024-05-30T16:50:00.193537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.230837+0000","last_change":"2024-05-30T16:50:01.225500+0000","last_active":"2024-05-30T16:50:01.230837+0000","last_peered":"2024-05-30T16:50:01.230837+0000","last_clean":"2024-05-30T16:50:01.230837+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:50:01.230837+0000","last_undegraded":"2024-05-30T16:50:01.230837+0000","last_fullsized":"2024-05-30T16:50:01.230837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:43.760509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.199293+0000","last_change":"2024-05-30T16:50:00.199293+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.199293+0000","last_undegraded":"2024-05-30T16:50:00.199293+0000","last_fullsized":"2024-05-30T16:50:00.199293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.198363+0000","last_change":"2024-05-30T16:50:00.198363+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.198363+0000","last_undegraded":"2024-05-30T16:50:00.198363+0000","last_fullsized":"2024-05-30T16:50:00.198363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.188014+0000","last_change":"2024-05-30T16:50:00.188014+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.188014+0000","last_undegraded":"2024-05-30T16:50:00.188014+0000","last_fullsized":"2024-05-30T16:50:00.188014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.210278+0000","last_change":"2024-05-30T16:50:01.210278+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.210278+0000","last_undegraded":"2024-05-30T16:50:01.210278+0000","last_fullsized":"2024-05-30T16:50:01.210278+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.212200+0000","last_change":"2024-05-30T16:50:00.205578+0000","last_active":"2024-05-30T16:50:01.212200+0000","last_peered":"2024-05-30T16:50:01.212200+0000","last_clean":"2024-05-30T16:50:01.212200+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:50:01.212200+0000","last_undegraded":"2024-05-30T16:50:01.212200+0000","last_fullsized":"2024-05-30T16:50:01.212200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:09.041453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190169+0000","last_change":"2024-05-30T16:50:00.190169+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190169+0000","last_undegraded":"2024-05-30T16:50:00.190169+0000","last_fullsized":"2024-05-30T16:50:00.190169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.234294+0000","last_change":"2024-05-30T16:50:00.198543+0000","last_active":"2024-05-30T16:50:01.234294+0000","last_peered":"2024-05-30T16:50:01.234294+0000","last_clean":"2024-05-30T16:50:01.234294+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:50:01.234294+0000","last_undegraded":"2024-05-30T16:50:01.234294+0000","last_fullsized":"2024-05-30T16:50:01.234294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:06.670117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.197053+0000","last_change":"2024-05-30T16:50:00.197053+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.197053+0000","last_undegraded":"2024-05-30T16:50:00.197053+0000","last_fullsized":"2024-05-30T16:50:00.197053+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213525+0000","last_change":"2024-05-30T16:50:00.212444+0000","last_active":"2024-05-30T16:50:00.213525+0000","last_peered":"2024-05-30T16:50:00.213525+0000","last_clean":"2024-05-30T16:50:00.213525+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:50:00.213525+0000","last_undegraded":"2024-05-30T16:50:00.213525+0000","last_fullsized":"2024-05-30T16:50:00.213525+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:15.927433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.206369+0000","last_change":"2024-05-30T16:50:01.206369+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.206369+0000","last_undegraded":"2024-05-30T16:50:01.206369+0000","last_fullsized":"2024-05-30T16:50:01.206369+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213582+0000","last_change":"2024-05-30T16:50:00.210174+0000","last_active":"2024-05-30T16:50:00.213582+0000","last_peered":"2024-05-30T16:50:00.213582+0000","last_clean":"2024-05-30T16:50:00.213582+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:50:00.213582+0000","last_undegraded":"2024-05-30T16:50:00.213582+0000","last_fullsized":"2024-05-30T16:50:00.213582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:23:59.623653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.198805+0000","last_change":"2024-05-30T16:50:00.198805+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.198805+0000","last_undegraded":"2024-05-30T16:50:00.198805+0000","last_fullsized":"2024-05-30T16:50:00.198805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.233139+0000","last_change":"2024-05-30T16:50:00.205334+0000","last_active":"2024-05-30T16:50:01.233139+0000","last_peered":"2024-05-30T16:50:01.233139+0000","last_clean":"2024-05-30T16:50:01.233139+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:50:01.233139+0000","last_undegraded":"2024-05-30T16:50:01.233139+0000","last_fullsized":"2024-05-30T16:50:01.233139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:53.442543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.193038+0000","last_change":"2024-05-30T16:50:00.193038+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.193038+0000","last_undegraded":"2024-05-30T16:50:00.193038+0000","last_fullsized":"2024-05-30T16:50:00.193038+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207491+0000","last_change":"2024-05-30T16:50:00.205241+0000","last_active":"2024-05-30T16:50:00.207491+0000","last_peered":"2024-05-30T16:50:00.207491+0000","last_clean":"2024-05-30T16:50:00.207491+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:50:00.207491+0000","last_undegraded":"2024-05-30T16:50:00.207491+0000","last_fullsized":"2024-05-30T16:50:00.207491+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:25.844328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.187571+0000","last_change":"2024-05-30T16:50:00.187571+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.187571+0000","last_undegraded":"2024-05-30T16:50:00.187571+0000","last_fullsized":"2024-05-30T16:50:00.187571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.214357+0000","last_change":"2024-05-30T16:50:00.213769+0000","last_active":"2024-05-30T16:50:00.214357+0000","last_peered":"2024-05-30T16:50:00.214357+0000","last_clean":"2024-05-30T16:50:00.214357+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:50:00.214357+0000","last_undegraded":"2024-05-30T16:50:00.214357+0000","last_fullsized":"2024-05-30T16:50:00.214357+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:57:33.215066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222044+0000","last_change":"2024-05-30T16:50:01.214317+0000","last_active":"2024-05-30T16:50:01.222044+0000","last_peered":"2024-05-30T16:50:01.222044+0000","last_clean":"2024-05-30T16:50:01.222044+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:50:01.222044+0000","last_undegraded":"2024-05-30T16:50:01.222044+0000","last_fullsized":"2024-05-30T16:50:01.222044+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:29.637938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205601+0000","last_change":"2024-05-30T16:50:00.203638+0000","last_active":"2024-05-30T16:50:00.205601+0000","last_peered":"2024-05-30T16:50:00.205601+0000","last_clean":"2024-05-30T16:50:00.205601+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:50:00.205601+0000","last_undegraded":"2024-05-30T16:50:00.205601+0000","last_fullsized":"2024-05-30T16:50:00.205601+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:32:45.509834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.203130+0000","last_change":"2024-05-30T16:50:00.203130+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.203130+0000","last_undegraded":"2024-05-30T16:50:00.203130+0000","last_fullsized":"2024-05-30T16:50:00.203130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210687+0000","last_change":"2024-05-30T16:50:00.206844+0000","last_active":"2024-05-30T16:50:00.210687+0000","last_peered":"2024-05-30T16:50:00.210687+0000","last_clean":"2024-05-30T16:50:00.210687+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:50:00.210687+0000","last_undegraded":"2024-05-30T16:50:00.210687+0000","last_fullsized":"2024-05-30T16:50:00.210687+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:41:46.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.211217+0000","last_change":"2024-05-30T16:50:01.211217+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.211217+0000","last_undegraded":"2024-05-30T16:50:01.211217+0000","last_fullsized":"2024-05-30T16:50:01.211217+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213644+0000","last_change":"2024-05-30T16:50:00.210985+0000","last_active":"2024-05-30T16:50:00.213644+0000","last_peered":"2024-05-30T16:50:00.213644+0000","last_clean":"2024-05-30T16:50:00.213644+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:50:00.213644+0000","last_undegraded":"2024-05-30T16:50:00.213644+0000","last_fullsized":"2024-05-30T16:50:00.213644+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:17:54.630390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.196397+0000","last_change":"2024-05-30T16:50:00.196397+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.196397+0000","last_undegraded":"2024-05-30T16:50:00.196397+0000","last_fullsized":"2024-05-30T16:50:00.196397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.235056+0000","last_change":"2024-05-30T16:50:00.206599+0000","last_active":"2024-05-30T16:50:01.235056+0000","last_peered":"2024-05-30T16:50:01.235056+0000","last_clean":"2024-05-30T16:50:01.235056+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:50:01.235056+0000","last_undegraded":"2024-05-30T16:50:01.235056+0000","last_fullsized":"2024-05-30T16:50:01.235056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:50.078170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.191374+0000","last_change":"2024-05-30T16:50:00.191374+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.191374+0000","last_undegraded":"2024-05-30T16:50:00.191374+0000","last_fullsized":"2024-05-30T16:50:00.191374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210852+0000","last_change":"2024-05-30T16:50:00.208913+0000","last_active":"2024-05-30T16:50:00.210852+0000","last_peered":"2024-05-30T16:50:00.210852+0000","last_clean":"2024-05-30T16:50:00.210852+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:50:00.210852+0000","last_undegraded":"2024-05-30T16:50:00.210852+0000","last_fullsized":"2024-05-30T16:50:00.210852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:13:55.449885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.205235+0000","last_change":"2024-05-30T16:50:01.205235+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.205235+0000","last_undegraded":"2024-05-30T16:50:01.205235+0000","last_fullsized":"2024-05-30T16:50:01.205235+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.208822+0000","last_change":"2024-05-30T16:50:00.207072+0000","last_active":"2024-05-30T16:50:00.208822+0000","last_peered":"2024-05-30T16:50:00.208822+0000","last_clean":"2024-05-30T16:50:00.208822+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:50:00.208822+0000","last_undegraded":"2024-05-30T16:50:00.208822+0000","last_fullsized":"2024-05-30T16:50:00.208822+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:14.762635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.200429+0000","last_change":"2024-05-30T16:50:00.200429+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.200429+0000","last_undegraded":"2024-05-30T16:50:00.200429+0000","last_fullsized":"2024-05-30T16:50:00.200429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207508+0000","last_change":"2024-05-30T16:50:00.205457+0000","last_active":"2024-05-30T16:50:00.207508+0000","last_peered":"2024-05-30T16:50:00.207508+0000","last_clean":"2024-05-30T16:50:00.207508+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:50:00.207508+0000","last_undegraded":"2024-05-30T16:50:00.207508+0000","last_fullsized":"2024-05-30T16:50:00.207508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:08.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222198+0000","last_change":"2024-05-30T16:50:01.212311+0000","last_active":"2024-05-30T16:50:01.222198+0000","last_peered":"2024-05-30T16:50:01.222198+0000","last_clean":"2024-05-30T16:50:01.222198+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:50:01.222198+0000","last_undegraded":"2024-05-30T16:50:01.222198+0000","last_fullsized":"2024-05-30T16:50:01.222198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210859+0000","last_change":"2024-05-30T16:50:00.208941+0000","last_active":"2024-05-30T16:50:00.210859+0000","last_peered":"2024-05-30T16:50:00.210859+0000","last_clean":"2024-05-30T16:50:00.210859+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:50:00.210859+0000","last_undegraded":"2024-05-30T16:50:00.210859+0000","last_fullsized":"2024-05-30T16:50:00.210859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:11.531066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.187412+0000","last_change":"2024-05-30T16:50:00.187412+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.187412+0000","last_undegraded":"2024-05-30T16:50:00.187412+0000","last_fullsized":"2024-05-30T16:50:00.187412+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.197989+0000","last_change":"2024-05-30T16:50:00.196832+0000","last_active":"2024-05-30T16:50:00.197989+0000","last_peered":"2024-05-30T16:50:00.197989+0000","last_clean":"2024-05-30T16:50:00.197989+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:50:00.197989+0000","last_undegraded":"2024-05-30T16:50:00.197989+0000","last_fullsized":"2024-05-30T16:50:00.197989+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:08.366805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.191768+0000","last_change":"2024-05-30T16:50:00.191768+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.191768+0000","last_undegraded":"2024-05-30T16:50:00.191768+0000","last_fullsized":"2024-05-30T16:50:00.191768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207641+0000","last_change":"2024-05-30T16:50:00.206888+0000","last_active":"2024-05-30T16:50:00.207641+0000","last_peered":"2024-05-30T16:50:00.207641+0000","last_clean":"2024-05-30T16:50:00.207641+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:50:00.207641+0000","last_undegraded":"2024-05-30T16:50:00.207641+0000","last_fullsized":"2024-05-30T16:50:00.207641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:05.430319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.211852+0000","last_change":"2024-05-30T16:50:01.211852+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.211852+0000","last_undegraded":"2024-05-30T16:50:01.211852+0000","last_fullsized":"2024-05-30T16:50:01.211852+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205976+0000","last_change":"2024-05-30T16:50:00.201506+0000","last_active":"2024-05-30T16:50:00.205976+0000","last_peered":"2024-05-30T16:50:00.205976+0000","last_clean":"2024-05-30T16:50:00.205976+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:50:00.205976+0000","last_undegraded":"2024-05-30T16:50:00.205976+0000","last_fullsized":"2024-05-30T16:50:00.205976+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:30.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194115+0000","last_change":"2024-05-30T16:50:00.194115+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194115+0000","last_undegraded":"2024-05-30T16:50:00.194115+0000","last_fullsized":"2024-05-30T16:50:00.194115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205882+0000","last_change":"2024-05-30T16:50:00.201874+0000","last_active":"2024-05-30T16:50:00.205882+0000","last_peered":"2024-05-30T16:50:00.205882+0000","last_clean":"2024-05-30T16:50:00.205882+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:50:00.205882+0000","last_undegraded":"2024-05-30T16:50:00.205882+0000","last_fullsized":"2024-05-30T16:50:00.205882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:47.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.188938+0000","last_change":"2024-05-30T16:50:00.188938+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.188938+0000","last_undegraded":"2024-05-30T16:50:00.188938+0000","last_fullsized":"2024-05-30T16:50:00.188938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.207496+0000","last_change":"2024-05-30T16:50:00.202315+0000","last_active":"2024-05-30T16:50:01.207496+0000","last_peered":"2024-05-30T16:50:01.207496+0000","last_clean":"2024-05-30T16:50:01.207496+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:50:01.207496+0000","last_undegraded":"2024-05-30T16:50:01.207496+0000","last_fullsized":"2024-05-30T16:50:01.207496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:07.542490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222124+0000","last_change":"2024-05-30T16:50:01.217916+0000","last_active":"2024-05-30T16:50:01.222124+0000","last_peered":"2024-05-30T16:50:01.222124+0000","last_clean":"2024-05-30T16:50:01.222124+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:50:01.222124+0000","last_undegraded":"2024-05-30T16:50:01.222124+0000","last_fullsized":"2024-05-30T16:50:01.222124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:30:39.890355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207471+0000","last_change":"2024-05-30T16:50:00.204870+0000","last_active":"2024-05-30T16:50:00.207471+0000","last_peered":"2024-05-30T16:50:00.207471+0000","last_clean":"2024-05-30T16:50:00.207471+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:50:00.207471+0000","last_undegraded":"2024-05-30T16:50:00.207471+0000","last_fullsized":"2024-05-30T16:50:00.207471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:48.195369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225491+0000","last_change":"2024-05-30T16:50:01.219838+0000","last_active":"2024-05-30T16:50:01.225491+0000","last_peered":"2024-05-30T16:50:01.225491+0000","last_clean":"2024-05-30T16:50:01.225491+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:50:01.225491+0000","last_undegraded":"2024-05-30T16:50:01.225491+0000","last_fullsized":"2024-05-30T16:50:01.225491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:30.501139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210370+0000","last_change":"2024-05-30T16:50:00.207506+0000","last_active":"2024-05-30T16:50:00.210370+0000","last_peered":"2024-05-30T16:50:00.210370+0000","last_clean":"2024-05-30T16:50:00.210370+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:50:00.210370+0000","last_undegraded":"2024-05-30T16:50:00.210370+0000","last_fullsized":"2024-05-30T16:50:00.210370+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:48:16.720637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225517+0000","last_change":"2024-05-30T16:50:01.220513+0000","last_active":"2024-05-30T16:50:01.225517+0000","last_peered":"2024-05-30T16:50:01.225517+0000","last_clean":"2024-05-30T16:50:01.225517+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:50:01.225517+0000","last_undegraded":"2024-05-30T16:50:01.225517+0000","last_fullsized":"2024-05-30T16:50:01.225517+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:34.972283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.198378+0000","last_change":"2024-05-30T16:50:00.199775+0000","last_active":"2024-05-30T16:50:01.198378+0000","last_peered":"2024-05-30T16:50:01.198378+0000","last_clean":"2024-05-30T16:50:01.198378+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:50:01.198378+0000","last_undegraded":"2024-05-30T16:50:01.198378+0000","last_fullsized":"2024-05-30T16:50:01.198378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:11.926104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.221978+0000","last_change":"2024-05-30T16:50:01.212934+0000","last_active":"2024-05-30T16:50:01.221978+0000","last_peered":"2024-05-30T16:50:01.221978+0000","last_clean":"2024-05-30T16:50:01.221978+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:50:01.221978+0000","last_undegraded":"2024-05-30T16:50:01.221978+0000","last_fullsized":"2024-05-30T16:50:01.221978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:48:19.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207623+0000","last_change":"2024-05-30T16:50:00.206485+0000","last_active":"2024-05-30T16:50:00.207623+0000","last_peered":"2024-05-30T16:50:00.207623+0000","last_clean":"2024-05-30T16:50:00.207623+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:50:00.207623+0000","last_undegraded":"2024-05-30T16:50:00.207623+0000","last_fullsized":"2024-05-30T16:50:00.207623+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:10.490016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.202455+0000","last_change":"2024-05-30T16:50:00.202455+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.202455+0000","last_undegraded":"2024-05-30T16:50:00.202455+0000","last_fullsized":"2024-05-30T16:50:00.202455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.212289+0000","last_change":"2024-05-30T16:50:00.209889+0000","last_active":"2024-05-30T16:50:00.212289+0000","last_peered":"2024-05-30T16:50:00.212289+0000","last_clean":"2024-05-30T16:50:00.212289+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:50:00.212289+0000","last_undegraded":"2024-05-30T16:50:00.212289+0000","last_fullsized":"2024-05-30T16:50:00.212289+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:21.242822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.207240+0000","last_change":"2024-05-30T16:50:01.207240+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.207240+0000","last_undegraded":"2024-05-30T16:50:01.207240+0000","last_fullsized":"2024-05-30T16:50:01.207240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205195+0000","last_change":"2024-05-30T16:50:00.202834+0000","last_active":"2024-05-30T16:50:00.205195+0000","last_peered":"2024-05-30T16:50:00.205195+0000","last_clean":"2024-05-30T16:50:00.205195+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:50:00.205195+0000","last_undegraded":"2024-05-30T16:50:00.205195+0000","last_fullsized":"2024-05-30T16:50:00.205195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:04.052373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.206709+0000","last_change":"2024-05-30T16:50:01.206709+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.206709+0000","last_undegraded":"2024-05-30T16:50:01.206709+0000","last_fullsized":"2024-05-30T16:50:01.206709+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.200373+0000","last_change":"2024-05-30T16:50:00.204452+0000","last_active":"2024-05-30T16:50:01.200373+0000","last_peered":"2024-05-30T16:50:01.200373+0000","last_clean":"2024-05-30T16:50:01.200373+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:50:01.200373+0000","last_undegraded":"2024-05-30T16:50:01.200373+0000","last_fullsized":"2024-05-30T16:50:01.200373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:54.227101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192880+0000","last_change":"2024-05-30T16:50:00.192880+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192880+0000","last_undegraded":"2024-05-30T16:50:00.192880+0000","last_fullsized":"2024-05-30T16:50:00.192880+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.209984+0000","last_change":"2024-05-30T16:50:00.207741+0000","last_active":"2024-05-30T16:50:00.209984+0000","last_peered":"2024-05-30T16:50:00.209984+0000","last_clean":"2024-05-30T16:50:00.209984+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:50:00.209984+0000","last_undegraded":"2024-05-30T16:50:00.209984+0000","last_fullsized":"2024-05-30T16:50:00.209984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:16.131276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.189514+0000","last_change":"2024-05-30T16:50:00.189514+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.189514+0000","last_undegraded":"2024-05-30T16:50:00.189514+0000","last_fullsized":"2024-05-30T16:50:00.189514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213662+0000","last_change":"2024-05-30T16:50:00.213146+0000","last_active":"2024-05-30T16:50:00.213662+0000","last_peered":"2024-05-30T16:50:00.213662+0000","last_clean":"2024-05-30T16:50:00.213662+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:50:00.213662+0000","last_undegraded":"2024-05-30T16:50:00.213662+0000","last_fullsized":"2024-05-30T16:50:00.213662+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:47.728723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190938+0000","last_change":"2024-05-30T16:50:00.190938+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190938+0000","last_undegraded":"2024-05-30T16:50:00.190938+0000","last_fullsized":"2024-05-30T16:50:00.190938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.206713+0000","last_change":"2024-05-30T16:50:00.203989+0000","last_active":"2024-05-30T16:50:00.206713+0000","last_peered":"2024-05-30T16:50:00.206713+0000","last_clean":"2024-05-30T16:50:00.206713+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:50:00.206713+0000","last_undegraded":"2024-05-30T16:50:00.206713+0000","last_fullsized":"2024-05-30T16:50:00.206713+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:46.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.187004+0000","last_change":"2024-05-30T16:50:00.187004+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.187004+0000","last_undegraded":"2024-05-30T16:50:00.187004+0000","last_fullsized":"2024-05-30T16:50:00.187004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213616+0000","last_change":"2024-05-30T16:50:00.210481+0000","last_active":"2024-05-30T16:50:00.213616+0000","last_peered":"2024-05-30T16:50:00.213616+0000","last_clean":"2024-05-30T16:50:00.213616+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:50:00.213616+0000","last_undegraded":"2024-05-30T16:50:00.213616+0000","last_fullsized":"2024-05-30T16:50:00.213616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:23.160571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222755+0000","last_change":"2024-05-30T16:50:01.218627+0000","last_active":"2024-05-30T16:50:01.222755+0000","last_peered":"2024-05-30T16:50:01.222755+0000","last_clean":"2024-05-30T16:50:01.222755+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:50:01.222755+0000","last_undegraded":"2024-05-30T16:50:01.222755+0000","last_fullsized":"2024-05-30T16:50:01.222755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:31:09.263732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213551+0000","last_change":"2024-05-30T16:50:00.210033+0000","last_active":"2024-05-30T16:50:00.213551+0000","last_peered":"2024-05-30T16:50:00.213551+0000","last_clean":"2024-05-30T16:50:00.213551+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:50:00.213551+0000","last_undegraded":"2024-05-30T16:50:00.213551+0000","last_fullsized":"2024-05-30T16:50:00.213551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:32:51.864331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":265,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.206306+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:50:01.206306+0000","last_peered":"2024-05-30T16:50:01.206306+0000","last_clean":"2024-05-30T16:50:01.206306+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:50:01.206306+0000","last_undegraded":"2024-05-30T16:50:01.206306+0000","last_fullsized":"2024-05-30T16:50:01.206306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58960,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312880,"statfs":{"total":96636764160,"available":96576389120,"internally_reserved":0,"allocated":1445888,"data_stored":950584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54224,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54224,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54224,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50052,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321788,"statfs":{"total":96636764160,"available":96585510912,"internally_reserved":0,"allocated":839680,"data_stored":353913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58960,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312880,"statfs":{"total":96636764160,"available":96576389120,"internally_reserved":0,"allocated":1445888,"data_stored":950584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:50:05.587 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:50:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.821+0000 7f01f4c00640 1 Processor -- start 2024-05-30T16:50:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.821+0000 7f01f4c00640 1 -- start start 2024-05-30T16:50:05.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.822+0000 7f01f4c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f01f013f760 0x7f01f006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.822+0000 7f01f4c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f01f00b5fd0 0x7f01f0142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.822+0000 7f01f4c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f006ee80 con 0x7f01f00cec70 2024-05-30T16:50:05.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.822+0000 7f01f4c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f01f01612b0 con 0x7f01f00b5fd0 2024-05-30T16:50:05.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.822+0000 7f01f4c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f01f013fb40 con 0x7f01f013f760 2024-05-30T16:50:05.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.823+0000 7f01ee800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f01f00b5fd0 0x7f01f0142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.823+0000 7f01ee800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f01f00b5fd0 0x7f01f0142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42966/0 (socket says 172.21.15.144:42966) 2024-05-30T16:50:05.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.823+0000 7f01ee800640 1 -- 172.21.15.144:0/3128180987 learned_addr learned my addr 172.21.15.144:0/3128180987 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:05.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.823+0000 7f01ede00640 1 --2- 172.21.15.144:0/3128180987 >> v2:172.21.15.149:3300/0 conn(0x7f01f013f760 0x7f01f006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.823+0000 7f01ee800640 1 -- 172.21.15.144:0/3128180987 >> v2:172.21.15.149:3300/0 conn(0x7f01f013f760 msgr2=0x7f01f006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:05.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.823+0000 7f01ee800640 1 --2- 172.21.15.144:0/3128180987 >> v2:172.21.15.149:3300/0 conn(0x7f01f013f760 0x7f01f006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.823+0000 7f01ee800640 1 -- 172.21.15.144:0/3128180987 >> v1:172.21.15.144:6789/0 conn(0x7f01f00cec70 legacy=0x7f01f00b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.823+0000 7f01ee800640 1 -- 172.21.15.144:0/3128180987 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f0160730 con 0x7f01f00b5fd0 2024-05-30T16:50:05.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.824+0000 7f01ee800640 1 --2- 172.21.15.144:0/3128180987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 0x7f01f0142200 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f01f006e8a0 tx=0x7f01e802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83be283663c9546 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:05.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.824+0000 7f01eca00640 1 -- 172.21.15.144:0/3128180987 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8036070 con 0x7f01f00b5fd0 2024-05-30T16:50:05.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.824+0000 7f01eca00640 1 -- 172.21.15.144:0/3128180987 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e8031600 con 0x7f01f00b5fd0 2024-05-30T16:50:05.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.824+0000 7f01eca00640 1 -- 172.21.15.144:0/3128180987 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e80319d0 con 0x7f01f00b5fd0 2024-05-30T16:50:05.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.825+0000 7f01f4c00640 1 -- 172.21.15.144:0/3128180987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 msgr2=0x7f01f0142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.825+0000 7f01f4c00640 1 --2- 172.21.15.144:0/3128180987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 0x7f01f0142200 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f01f006e8a0 tx=0x7f01e802a730 comp rx=0 tx=0).stop 2024-05-30T16:50:05.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.825+0000 7f01f4c00640 1 -- 172.21.15.144:0/3128180987 shutdown_connections 2024-05-30T16:50:05.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.825+0000 7f01f4c00640 1 --2- 172.21.15.144:0/3128180987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 0x7f01f0142200 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.825+0000 7f01f4c00640 1 --2- 172.21.15.144:0/3128180987 >> v2:172.21.15.149:3300/0 conn(0x7f01f013f760 0x7f01f006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.825+0000 7f01f4c00640 1 -- 172.21.15.144:0/3128180987 >> 172.21.15.144:0/3128180987 conn(0x7f01f006bd00 msgr2=0x7f01f006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:05.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.825+0000 7f01f4c00640 1 -- 172.21.15.144:0/3128180987 shutdown_connections 2024-05-30T16:50:05.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.825+0000 7f01f4c00640 1 -- 172.21.15.144:0/3128180987 wait complete. 2024-05-30T16:50:05.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.827+0000 7f01f4c00640 1 Processor -- start 2024-05-30T16:50:05.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.827+0000 7f01f4c00640 1 -- start start 2024-05-30T16:50:05.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 0x7f01f00ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01f00cec70 0x7f01f00a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01f4c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f013f760 0x7f01f00b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01f4c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0160fd0 con 0x7f01f00b5fd0 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01f4c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0160cf0 con 0x7f01f013f760 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01f4c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f01f00cf0d0 con 0x7f01f00cec70 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01ede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 0x7f01f00ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01ede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 0x7f01f00ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42982/0 (socket says 172.21.15.144:42982) 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01ede00640 1 -- 172.21.15.144:0/2742926735 learned_addr learned my addr 172.21.15.144:0/2742926735 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01ede00640 1 -- 172.21.15.144:0/2742926735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01f00cec70 msgr2=0x7f01f00a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01ede00640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01f00cec70 0x7f01f00a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01ede00640 1 -- 172.21.15.144:0/2742926735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f013f760 msgr2=0x7f01f00b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:05.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.828+0000 7f01ede00640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f013f760 0x7f01f00b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:05.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.829+0000 7f01ede00640 1 -- 172.21.15.144:0/2742926735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f00b3bf0 con 0x7f01f00b5fd0 2024-05-30T16:50:05.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.829+0000 7f01ede00640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 0x7f01f00ae9b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f01e000d5f0 tx=0x7f01e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:05.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.829+0000 7f01e6000640 1 -- 172.21.15.144:0/2742926735 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e00125f0 con 0x7f01f00b5fd0 2024-05-30T16:50:05.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.829+0000 7f01e6000640 1 -- 172.21.15.144:0/2742926735 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e0019070 con 0x7f01f00b5fd0 2024-05-30T16:50:05.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.829+0000 7f01e6000640 1 -- 172.21.15.144:0/2742926735 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e00129d0 con 0x7f01f00b5fd0 2024-05-30T16:50:05.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.829+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f00b3e90 con 0x7f01f00b5fd0 2024-05-30T16:50:05.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.829+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f00b4450 con 0x7f01f00b5fd0 2024-05-30T16:50:05.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.830+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f0068b90 con 0x7f01f00b5fd0 2024-05-30T16:50:05.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.831+0000 7f01e6000640 1 -- 172.21.15.144:0/2742926735 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f01e0012b70 con 0x7f01f00b5fd0 2024-05-30T16:50:05.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.832+0000 7f01e6000640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01d006d5e0 0x7f01d006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:05.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.832+0000 7f01e6000640 1 -- 172.21.15.144:0/2742926735 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f01e008ac80 con 0x7f01f00b5fd0 2024-05-30T16:50:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.833+0000 7f01ed400640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01d006d5e0 0x7f01d006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.833+0000 7f01ed400640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01d006d5e0 0x7f01d006faa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f01f01365c0 tx=0x7f01dc007950 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:05.837+0000 7f01e6000640 1 -- 172.21.15.144:0/2742926735 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01e005a870 con 0x7f01f00b5fd0 2024-05-30T16:50:06.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.018+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01f00b5b10 con 0x7f01d006d5e0 2024-05-30T16:50:06.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.026+0000 7f01e6000640 1 -- 172.21.15.144:0/2742926735 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247926 (secure 0 0 0) 0x7f01f00b5b10 con 0x7f01d006d5e0 2024-05-30T16:50:06.029 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:06.032 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:50:06.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01d006d5e0 msgr2=0x7f01d006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01d006d5e0 0x7f01d006faa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f01f01365c0 tx=0x7f01dc007950 comp rx=0 tx=0).stop 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 msgr2=0x7f01f00ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 0x7f01f00ae9b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f01e000d5f0 tx=0x7f01e000dab0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 shutdown_connections 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f01d006d5e0 0x7f01d006faa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f013f760 0x7f01f00b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01f00cec70 0x7f01f00a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 --2- 172.21.15.144:0/2742926735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01f00b5fd0 0x7f01f00ae9b0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 >> 172.21.15.144:0/2742926735 conn(0x7f01f006bd00 msgr2=0x7f01f00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 shutdown_connections 2024-05-30T16:50:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.032+0000 7f01f4c00640 1 -- 172.21.15.144:0/2742926735 wait complete. 2024-05-30T16:50:06.051 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-05-30T16:50:05.118541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":447412,"kb_used_data":7804,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754527308,"statfs":{"total":773094113280,"available":772635963392,"internally_reserved":0,"allocated":7991296,"data_stored":4056161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":450022963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.954488"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.210932+0000","last_change":"2024-05-30T16:50:01.210932+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.210932+0000","last_undegraded":"2024-05-30T16:50:01.210932+0000","last_fullsized":"2024-05-30T16:50:01.210932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.189821+0000","last_change":"2024-05-30T16:50:00.189821+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.189821+0000","last_undegraded":"2024-05-30T16:50:00.189821+0000","last_fullsized":"2024-05-30T16:50:00.189821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.221320+0000","last_change":"2024-05-30T16:50:01.216644+0000","last_active":"2024-05-30T16:50:01.221320+0000","last_peered":"2024-05-30T16:50:01.221320+0000","last_clean":"2024-05-30T16:50:01.221320+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:50:01.221320+0000","last_undegraded":"2024-05-30T16:50:01.221320+0000","last_fullsized":"2024-05-30T16:50:01.221320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:33:17.720209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.200613+0000","last_change":"2024-05-30T16:50:00.200613+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.200613+0000","last_undegraded":"2024-05-30T16:50:00.200613+0000","last_fullsized":"2024-05-30T16:50:00.200613+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192496+0000","last_change":"2024-05-30T16:50:00.192496+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192496+0000","last_undegraded":"2024-05-30T16:50:00.192496+0000","last_fullsized":"2024-05-30T16:50:00.192496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190684+0000","last_change":"2024-05-30T16:50:00.190684+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190684+0000","last_undegraded":"2024-05-30T16:50:00.190684+0000","last_fullsized":"2024-05-30T16:50:00.190684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.199237+0000","last_change":"2024-05-30T16:50:00.199237+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.199237+0000","last_undegraded":"2024-05-30T16:50:00.199237+0000","last_fullsized":"2024-05-30T16:50:00.199237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.198903+0000","last_change":"2024-05-30T16:50:00.198903+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.198903+0000","last_undegraded":"2024-05-30T16:50:00.198903+0000","last_fullsized":"2024-05-30T16:50:00.198903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.191812+0000","last_change":"2024-05-30T16:50:00.191812+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.191812+0000","last_undegraded":"2024-05-30T16:50:00.191812+0000","last_fullsized":"2024-05-30T16:50:00.191812+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194914+0000","last_change":"2024-05-30T16:50:00.194914+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194914+0000","last_undegraded":"2024-05-30T16:50:00.194914+0000","last_fullsized":"2024-05-30T16:50:00.194914+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.206010+0000","last_change":"2024-05-30T16:50:01.206010+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.206010+0000","last_undegraded":"2024-05-30T16:50:01.206010+0000","last_fullsized":"2024-05-30T16:50:01.206010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194759+0000","last_change":"2024-05-30T16:50:00.194759+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194759+0000","last_undegraded":"2024-05-30T16:50:00.194759+0000","last_fullsized":"2024-05-30T16:50:00.194759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222089+0000","last_change":"2024-05-30T16:50:01.213490+0000","last_active":"2024-05-30T16:50:01.222089+0000","last_peered":"2024-05-30T16:50:01.222089+0000","last_clean":"2024-05-30T16:50:01.222089+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:50:01.222089+0000","last_undegraded":"2024-05-30T16:50:01.222089+0000","last_fullsized":"2024-05-30T16:50:01.222089+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:03.170716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194029+0000","last_change":"2024-05-30T16:50:00.194029+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194029+0000","last_undegraded":"2024-05-30T16:50:00.194029+0000","last_fullsized":"2024-05-30T16:50:00.194029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222022+0000","last_change":"2024-05-30T16:50:01.213697+0000","last_active":"2024-05-30T16:50:01.222022+0000","last_peered":"2024-05-30T16:50:01.222022+0000","last_clean":"2024-05-30T16:50:01.222022+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:50:01.222022+0000","last_undegraded":"2024-05-30T16:50:01.222022+0000","last_fullsized":"2024-05-30T16:50:01.222022+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:54:18.805624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.186522+0000","last_change":"2024-05-30T16:50:00.186522+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.186522+0000","last_undegraded":"2024-05-30T16:50:00.186522+0000","last_fullsized":"2024-05-30T16:50:00.186522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190991+0000","last_change":"2024-05-30T16:50:00.190991+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190991+0000","last_undegraded":"2024-05-30T16:50:00.190991+0000","last_fullsized":"2024-05-30T16:50:00.190991+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.196764+0000","last_change":"2024-05-30T16:50:00.196764+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.196764+0000","last_undegraded":"2024-05-30T16:50:00.196764+0000","last_fullsized":"2024-05-30T16:50:00.196764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.188337+0000","last_change":"2024-05-30T16:50:00.188337+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.188337+0000","last_undegraded":"2024-05-30T16:50:00.188337+0000","last_fullsized":"2024-05-30T16:50:00.188337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225025+0000","last_change":"2024-05-30T16:50:01.223666+0000","last_active":"2024-05-30T16:50:01.225025+0000","last_peered":"2024-05-30T16:50:01.225025+0000","last_clean":"2024-05-30T16:50:01.225025+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:50:01.225025+0000","last_undegraded":"2024-05-30T16:50:01.225025+0000","last_fullsized":"2024-05-30T16:50:01.225025+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:15.642014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.199903+0000","last_change":"2024-05-30T16:50:00.199903+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.199903+0000","last_undegraded":"2024-05-30T16:50:00.199903+0000","last_fullsized":"2024-05-30T16:50:00.199903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192239+0000","last_change":"2024-05-30T16:50:00.192239+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192239+0000","last_undegraded":"2024-05-30T16:50:00.192239+0000","last_fullsized":"2024-05-30T16:50:00.192239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.209132+0000","last_change":"2024-05-30T16:50:01.209132+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.209132+0000","last_undegraded":"2024-05-30T16:50:01.209132+0000","last_fullsized":"2024-05-30T16:50:01.209132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.204097+0000","last_change":"2024-05-30T16:50:01.204097+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.204097+0000","last_undegraded":"2024-05-30T16:50:01.204097+0000","last_fullsized":"2024-05-30T16:50:01.204097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192551+0000","last_change":"2024-05-30T16:50:00.192551+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192551+0000","last_undegraded":"2024-05-30T16:50:00.192551+0000","last_fullsized":"2024-05-30T16:50:00.192551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.205607+0000","last_change":"2024-05-30T16:50:00.205607+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.205607+0000","last_undegraded":"2024-05-30T16:50:00.205607+0000","last_fullsized":"2024-05-30T16:50:00.205607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225568+0000","last_change":"2024-05-30T16:50:01.221359+0000","last_active":"2024-05-30T16:50:01.225568+0000","last_peered":"2024-05-30T16:50:01.225568+0000","last_clean":"2024-05-30T16:50:01.225568+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:50:01.225568+0000","last_undegraded":"2024-05-30T16:50:01.225568+0000","last_fullsized":"2024-05-30T16:50:01.225568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:16.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.193537+0000","last_change":"2024-05-30T16:50:00.193537+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.193537+0000","last_undegraded":"2024-05-30T16:50:00.193537+0000","last_fullsized":"2024-05-30T16:50:00.193537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.230837+0000","last_change":"2024-05-30T16:50:01.225500+0000","last_active":"2024-05-30T16:50:01.230837+0000","last_peered":"2024-05-30T16:50:01.230837+0000","last_clean":"2024-05-30T16:50:01.230837+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:50:01.230837+0000","last_undegraded":"2024-05-30T16:50:01.230837+0000","last_fullsized":"2024-05-30T16:50:01.230837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:43.760509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.199293+0000","last_change":"2024-05-30T16:50:00.199293+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.199293+0000","last_undegraded":"2024-05-30T16:50:00.199293+0000","last_fullsized":"2024-05-30T16:50:00.199293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.198363+0000","last_change":"2024-05-30T16:50:00.198363+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.198363+0000","last_undegraded":"2024-05-30T16:50:00.198363+0000","last_fullsized":"2024-05-30T16:50:00.198363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.188014+0000","last_change":"2024-05-30T16:50:00.188014+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.188014+0000","last_undegraded":"2024-05-30T16:50:00.188014+0000","last_fullsized":"2024-05-30T16:50:00.188014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.210278+0000","last_change":"2024-05-30T16:50:01.210278+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.210278+0000","last_undegraded":"2024-05-30T16:50:01.210278+0000","last_fullsized":"2024-05-30T16:50:01.210278+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.212200+0000","last_change":"2024-05-30T16:50:00.205578+0000","last_active":"2024-05-30T16:50:01.212200+0000","last_peered":"2024-05-30T16:50:01.212200+0000","last_clean":"2024-05-30T16:50:01.212200+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:50:01.212200+0000","last_undegraded":"2024-05-30T16:50:01.212200+0000","last_fullsized":"2024-05-30T16:50:01.212200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:09.041453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190169+0000","last_change":"2024-05-30T16:50:00.190169+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190169+0000","last_undegraded":"2024-05-30T16:50:00.190169+0000","last_fullsized":"2024-05-30T16:50:00.190169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.234294+0000","last_change":"2024-05-30T16:50:00.198543+0000","last_active":"2024-05-30T16:50:01.234294+0000","last_peered":"2024-05-30T16:50:01.234294+0000","last_clean":"2024-05-30T16:50:01.234294+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:50:01.234294+0000","last_undegraded":"2024-05-30T16:50:01.234294+0000","last_fullsized":"2024-05-30T16:50:01.234294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:06.670117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.197053+0000","last_change":"2024-05-30T16:50:00.197053+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.197053+0000","last_undegraded":"2024-05-30T16:50:00.197053+0000","last_fullsized":"2024-05-30T16:50:00.197053+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213525+0000","last_change":"2024-05-30T16:50:00.212444+0000","last_active":"2024-05-30T16:50:00.213525+0000","last_peered":"2024-05-30T16:50:00.213525+0000","last_clean":"2024-05-30T16:50:00.213525+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:50:00.213525+0000","last_undegraded":"2024-05-30T16:50:00.213525+0000","last_fullsized":"2024-05-30T16:50:00.213525+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:15.927433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.206369+0000","last_change":"2024-05-30T16:50:01.206369+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.206369+0000","last_undegraded":"2024-05-30T16:50:01.206369+0000","last_fullsized":"2024-05-30T16:50:01.206369+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213582+0000","last_change":"2024-05-30T16:50:00.210174+0000","last_active":"2024-05-30T16:50:00.213582+0000","last_peered":"2024-05-30T16:50:00.213582+0000","last_clean":"2024-05-30T16:50:00.213582+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:50:00.213582+0000","last_undegraded":"2024-05-30T16:50:00.213582+0000","last_fullsized":"2024-05-30T16:50:00.213582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:23:59.623653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.198805+0000","last_change":"2024-05-30T16:50:00.198805+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.198805+0000","last_undegraded":"2024-05-30T16:50:00.198805+0000","last_fullsized":"2024-05-30T16:50:00.198805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.233139+0000","last_change":"2024-05-30T16:50:00.205334+0000","last_active":"2024-05-30T16:50:01.233139+0000","last_peered":"2024-05-30T16:50:01.233139+0000","last_clean":"2024-05-30T16:50:01.233139+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:50:01.233139+0000","last_undegraded":"2024-05-30T16:50:01.233139+0000","last_fullsized":"2024-05-30T16:50:01.233139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:53.442543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.193038+0000","last_change":"2024-05-30T16:50:00.193038+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.193038+0000","last_undegraded":"2024-05-30T16:50:00.193038+0000","last_fullsized":"2024-05-30T16:50:00.193038+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207491+0000","last_change":"2024-05-30T16:50:00.205241+0000","last_active":"2024-05-30T16:50:00.207491+0000","last_peered":"2024-05-30T16:50:00.207491+0000","last_clean":"2024-05-30T16:50:00.207491+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:50:00.207491+0000","last_undegraded":"2024-05-30T16:50:00.207491+0000","last_fullsized":"2024-05-30T16:50:00.207491+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:25.844328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.187571+0000","last_change":"2024-05-30T16:50:00.187571+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.187571+0000","last_undegraded":"2024-05-30T16:50:00.187571+0000","last_fullsized":"2024-05-30T16:50:00.187571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.214357+0000","last_change":"2024-05-30T16:50:00.213769+0000","last_active":"2024-05-30T16:50:00.214357+0000","last_peered":"2024-05-30T16:50:00.214357+0000","last_clean":"2024-05-30T16:50:00.214357+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:50:00.214357+0000","last_undegraded":"2024-05-30T16:50:00.214357+0000","last_fullsized":"2024-05-30T16:50:00.214357+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:57:33.215066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222044+0000","last_change":"2024-05-30T16:50:01.214317+0000","last_active":"2024-05-30T16:50:01.222044+0000","last_peered":"2024-05-30T16:50:01.222044+0000","last_clean":"2024-05-30T16:50:01.222044+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:50:01.222044+0000","last_undegraded":"2024-05-30T16:50:01.222044+0000","last_fullsized":"2024-05-30T16:50:01.222044+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:29.637938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205601+0000","last_change":"2024-05-30T16:50:00.203638+0000","last_active":"2024-05-30T16:50:00.205601+0000","last_peered":"2024-05-30T16:50:00.205601+0000","last_clean":"2024-05-30T16:50:00.205601+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:50:00.205601+0000","last_undegraded":"2024-05-30T16:50:00.205601+0000","last_fullsized":"2024-05-30T16:50:00.205601+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:32:45.509834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.203130+0000","last_change":"2024-05-30T16:50:00.203130+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.203130+0000","last_undegraded":"2024-05-30T16:50:00.203130+0000","last_fullsized":"2024-05-30T16:50:00.203130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210687+0000","last_change":"2024-05-30T16:50:00.206844+0000","last_active":"2024-05-30T16:50:00.210687+0000","last_peered":"2024-05-30T16:50:00.210687+0000","last_clean":"2024-05-30T16:50:00.210687+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:50:00.210687+0000","last_undegraded":"2024-05-30T16:50:00.210687+0000","last_fullsized":"2024-05-30T16:50:00.210687+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:41:46.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.211217+0000","last_change":"2024-05-30T16:50:01.211217+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.211217+0000","last_undegraded":"2024-05-30T16:50:01.211217+0000","last_fullsized":"2024-05-30T16:50:01.211217+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213644+0000","last_change":"2024-05-30T16:50:00.210985+0000","last_active":"2024-05-30T16:50:00.213644+0000","last_peered":"2024-05-30T16:50:00.213644+0000","last_clean":"2024-05-30T16:50:00.213644+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:50:00.213644+0000","last_undegraded":"2024-05-30T16:50:00.213644+0000","last_fullsized":"2024-05-30T16:50:00.213644+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:17:54.630390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.196397+0000","last_change":"2024-05-30T16:50:00.196397+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.196397+0000","last_undegraded":"2024-05-30T16:50:00.196397+0000","last_fullsized":"2024-05-30T16:50:00.196397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.235056+0000","last_change":"2024-05-30T16:50:00.206599+0000","last_active":"2024-05-30T16:50:01.235056+0000","last_peered":"2024-05-30T16:50:01.235056+0000","last_clean":"2024-05-30T16:50:01.235056+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:50:01.235056+0000","last_undegraded":"2024-05-30T16:50:01.235056+0000","last_fullsized":"2024-05-30T16:50:01.235056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:50.078170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.191374+0000","last_change":"2024-05-30T16:50:00.191374+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.191374+0000","last_undegraded":"2024-05-30T16:50:00.191374+0000","last_fullsized":"2024-05-30T16:50:00.191374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210852+0000","last_change":"2024-05-30T16:50:00.208913+0000","last_active":"2024-05-30T16:50:00.210852+0000","last_peered":"2024-05-30T16:50:00.210852+0000","last_clean":"2024-05-30T16:50:00.210852+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:50:00.210852+0000","last_undegraded":"2024-05-30T16:50:00.210852+0000","last_fullsized":"2024-05-30T16:50:00.210852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:13:55.449885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.205235+0000","last_change":"2024-05-30T16:50:01.205235+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.205235+0000","last_undegraded":"2024-05-30T16:50:01.205235+0000","last_fullsized":"2024-05-30T16:50:01.205235+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.208822+0000","last_change":"2024-05-30T16:50:00.207072+0000","last_active":"2024-05-30T16:50:00.208822+0000","last_peered":"2024-05-30T16:50:00.208822+0000","last_clean":"2024-05-30T16:50:00.208822+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:50:00.208822+0000","last_undegraded":"2024-05-30T16:50:00.208822+0000","last_fullsized":"2024-05-30T16:50:00.208822+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:14.762635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.200429+0000","last_change":"2024-05-30T16:50:00.200429+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.200429+0000","last_undegraded":"2024-05-30T16:50:00.200429+0000","last_fullsized":"2024-05-30T16:50:00.200429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207508+0000","last_change":"2024-05-30T16:50:00.205457+0000","last_active":"2024-05-30T16:50:00.207508+0000","last_peered":"2024-05-30T16:50:00.207508+0000","last_clean":"2024-05-30T16:50:00.207508+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:50:00.207508+0000","last_undegraded":"2024-05-30T16:50:00.207508+0000","last_fullsized":"2024-05-30T16:50:00.207508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:08.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222198+0000","last_change":"2024-05-30T16:50:01.212311+0000","last_active":"2024-05-30T16:50:01.222198+0000","last_peered":"2024-05-30T16:50:01.222198+0000","last_clean":"2024-05-30T16:50:01.222198+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:50:01.222198+0000","last_undegraded":"2024-05-30T16:50:01.222198+0000","last_fullsized":"2024-05-30T16:50:01.222198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210859+0000","last_change":"2024-05-30T16:50:00.208941+0000","last_active":"2024-05-30T16:50:00.210859+0000","last_peered":"2024-05-30T16:50:00.210859+0000","last_clean":"2024-05-30T16:50:00.210859+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:50:00.210859+0000","last_undegraded":"2024-05-30T16:50:00.210859+0000","last_fullsized":"2024-05-30T16:50:00.210859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:11.531066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.187412+0000","last_change":"2024-05-30T16:50:00.187412+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.187412+0000","last_undegraded":"2024-05-30T16:50:00.187412+0000","last_fullsized":"2024-05-30T16:50:00.187412+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.197989+0000","last_change":"2024-05-30T16:50:00.196832+0000","last_active":"2024-05-30T16:50:00.197989+0000","last_peered":"2024-05-30T16:50:00.197989+0000","last_clean":"2024-05-30T16:50:00.197989+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:50:00.197989+0000","last_undegraded":"2024-05-30T16:50:00.197989+0000","last_fullsized":"2024-05-30T16:50:00.197989+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:08.366805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.191768+0000","last_change":"2024-05-30T16:50:00.191768+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.191768+0000","last_undegraded":"2024-05-30T16:50:00.191768+0000","last_fullsized":"2024-05-30T16:50:00.191768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207641+0000","last_change":"2024-05-30T16:50:00.206888+0000","last_active":"2024-05-30T16:50:00.207641+0000","last_peered":"2024-05-30T16:50:00.207641+0000","last_clean":"2024-05-30T16:50:00.207641+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:50:00.207641+0000","last_undegraded":"2024-05-30T16:50:00.207641+0000","last_fullsized":"2024-05-30T16:50:00.207641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:05.430319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.211852+0000","last_change":"2024-05-30T16:50:01.211852+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.211852+0000","last_undegraded":"2024-05-30T16:50:01.211852+0000","last_fullsized":"2024-05-30T16:50:01.211852+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205976+0000","last_change":"2024-05-30T16:50:00.201506+0000","last_active":"2024-05-30T16:50:00.205976+0000","last_peered":"2024-05-30T16:50:00.205976+0000","last_clean":"2024-05-30T16:50:00.205976+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:50:00.205976+0000","last_undegraded":"2024-05-30T16:50:00.205976+0000","last_fullsized":"2024-05-30T16:50:00.205976+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:30.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194115+0000","last_change":"2024-05-30T16:50:00.194115+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194115+0000","last_undegraded":"2024-05-30T16:50:00.194115+0000","last_fullsized":"2024-05-30T16:50:00.194115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205882+0000","last_change":"2024-05-30T16:50:00.201874+0000","last_active":"2024-05-30T16:50:00.205882+0000","last_peered":"2024-05-30T16:50:00.205882+0000","last_clean":"2024-05-30T16:50:00.205882+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:50:00.205882+0000","last_undegraded":"2024-05-30T16:50:00.205882+0000","last_fullsized":"2024-05-30T16:50:00.205882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:47.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.188938+0000","last_change":"2024-05-30T16:50:00.188938+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.188938+0000","last_undegraded":"2024-05-30T16:50:00.188938+0000","last_fullsized":"2024-05-30T16:50:00.188938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.207496+0000","last_change":"2024-05-30T16:50:00.202315+0000","last_active":"2024-05-30T16:50:01.207496+0000","last_peered":"2024-05-30T16:50:01.207496+0000","last_clean":"2024-05-30T16:50:01.207496+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:50:01.207496+0000","last_undegraded":"2024-05-30T16:50:01.207496+0000","last_fullsized":"2024-05-30T16:50:01.207496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:07.542490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222124+0000","last_change":"2024-05-30T16:50:01.217916+0000","last_active":"2024-05-30T16:50:01.222124+0000","last_peered":"2024-05-30T16:50:01.222124+0000","last_clean":"2024-05-30T16:50:01.222124+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:50:01.222124+0000","last_undegraded":"2024-05-30T16:50:01.222124+0000","last_fullsized":"2024-05-30T16:50:01.222124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:30:39.890355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207471+0000","last_change":"2024-05-30T16:50:00.204870+0000","last_active":"2024-05-30T16:50:00.207471+0000","last_peered":"2024-05-30T16:50:00.207471+0000","last_clean":"2024-05-30T16:50:00.207471+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:50:00.207471+0000","last_undegraded":"2024-05-30T16:50:00.207471+0000","last_fullsized":"2024-05-30T16:50:00.207471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:48.195369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225491+0000","last_change":"2024-05-30T16:50:01.219838+0000","last_active":"2024-05-30T16:50:01.225491+0000","last_peered":"2024-05-30T16:50:01.225491+0000","last_clean":"2024-05-30T16:50:01.225491+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:50:01.225491+0000","last_undegraded":"2024-05-30T16:50:01.225491+0000","last_fullsized":"2024-05-30T16:50:01.225491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:30.501139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210370+0000","last_change":"2024-05-30T16:50:00.207506+0000","last_active":"2024-05-30T16:50:00.210370+0000","last_peered":"2024-05-30T16:50:00.210370+0000","last_clean":"2024-05-30T16:50:00.210370+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:50:00.210370+0000","last_undegraded":"2024-05-30T16:50:00.210370+0000","last_fullsized":"2024-05-30T16:50:00.210370+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:48:16.720637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225517+0000","last_change":"2024-05-30T16:50:01.220513+0000","last_active":"2024-05-30T16:50:01.225517+0000","last_peered":"2024-05-30T16:50:01.225517+0000","last_clean":"2024-05-30T16:50:01.225517+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:50:01.225517+0000","last_undegraded":"2024-05-30T16:50:01.225517+0000","last_fullsized":"2024-05-30T16:50:01.225517+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:34.972283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.198378+0000","last_change":"2024-05-30T16:50:00.199775+0000","last_active":"2024-05-30T16:50:01.198378+0000","last_peered":"2024-05-30T16:50:01.198378+0000","last_clean":"2024-05-30T16:50:01.198378+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:50:01.198378+0000","last_undegraded":"2024-05-30T16:50:01.198378+0000","last_fullsized":"2024-05-30T16:50:01.198378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:11.926104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.221978+0000","last_change":"2024-05-30T16:50:01.212934+0000","last_active":"2024-05-30T16:50:01.221978+0000","last_peered":"2024-05-30T16:50:01.221978+0000","last_clean":"2024-05-30T16:50:01.221978+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:50:01.221978+0000","last_undegraded":"2024-05-30T16:50:01.221978+0000","last_fullsized":"2024-05-30T16:50:01.221978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:48:19.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207623+0000","last_change":"2024-05-30T16:50:00.206485+0000","last_active":"2024-05-30T16:50:00.207623+0000","last_peered":"2024-05-30T16:50:00.207623+0000","last_clean":"2024-05-30T16:50:00.207623+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:50:00.207623+0000","last_undegraded":"2024-05-30T16:50:00.207623+0000","last_fullsized":"2024-05-30T16:50:00.207623+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:10.490016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.202455+0000","last_change":"2024-05-30T16:50:00.202455+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.202455+0000","last_undegraded":"2024-05-30T16:50:00.202455+0000","last_fullsized":"2024-05-30T16:50:00.202455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.212289+0000","last_change":"2024-05-30T16:50:00.209889+0000","last_active":"2024-05-30T16:50:00.212289+0000","last_peered":"2024-05-30T16:50:00.212289+0000","last_clean":"2024-05-30T16:50:00.212289+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:50:00.212289+0000","last_undegraded":"2024-05-30T16:50:00.212289+0000","last_fullsized":"2024-05-30T16:50:00.212289+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:21.242822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.207240+0000","last_change":"2024-05-30T16:50:01.207240+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.207240+0000","last_undegraded":"2024-05-30T16:50:01.207240+0000","last_fullsized":"2024-05-30T16:50:01.207240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205195+0000","last_change":"2024-05-30T16:50:00.202834+0000","last_active":"2024-05-30T16:50:00.205195+0000","last_peered":"2024-05-30T16:50:00.205195+0000","last_clean":"2024-05-30T16:50:00.205195+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:50:00.205195+0000","last_undegraded":"2024-05-30T16:50:00.205195+0000","last_fullsized":"2024-05-30T16:50:00.205195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:04.052373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.206709+0000","last_change":"2024-05-30T16:50:01.206709+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.206709+0000","last_undegraded":"2024-05-30T16:50:01.206709+0000","last_fullsized":"2024-05-30T16:50:01.206709+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.200373+0000","last_change":"2024-05-30T16:50:00.204452+0000","last_active":"2024-05-30T16:50:01.200373+0000","last_peered":"2024-05-30T16:50:01.200373+0000","last_clean":"2024-05-30T16:50:01.200373+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:50:01.200373+0000","last_undegraded":"2024-05-30T16:50:01.200373+0000","last_fullsized":"2024-05-30T16:50:01.200373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:54.227101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192880+0000","last_change":"2024-05-30T16:50:00.192880+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192880+0000","last_undegraded":"2024-05-30T16:50:00.192880+0000","last_fullsized":"2024-05-30T16:50:00.192880+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.209984+0000","last_change":"2024-05-30T16:50:00.207741+0000","last_active":"2024-05-30T16:50:00.209984+0000","last_peered":"2024-05-30T16:50:00.209984+0000","last_clean":"2024-05-30T16:50:00.209984+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:50:00.209984+0000","last_undegraded":"2024-05-30T16:50:00.209984+0000","last_fullsized":"2024-05-30T16:50:00.209984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:16.131276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.189514+0000","last_change":"2024-05-30T16:50:00.189514+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.189514+0000","last_undegraded":"2024-05-30T16:50:00.189514+0000","last_fullsized":"2024-05-30T16:50:00.189514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213662+0000","last_change":"2024-05-30T16:50:00.213146+0000","last_active":"2024-05-30T16:50:00.213662+0000","last_peered":"2024-05-30T16:50:00.213662+0000","last_clean":"2024-05-30T16:50:00.213662+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:50:00.213662+0000","last_undegraded":"2024-05-30T16:50:00.213662+0000","last_fullsized":"2024-05-30T16:50:00.213662+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:47.728723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190938+0000","last_change":"2024-05-30T16:50:00.190938+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190938+0000","last_undegraded":"2024-05-30T16:50:00.190938+0000","last_fullsized":"2024-05-30T16:50:00.190938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.206713+0000","last_change":"2024-05-30T16:50:00.203989+0000","last_active":"2024-05-30T16:50:00.206713+0000","last_peered":"2024-05-30T16:50:00.206713+0000","last_clean":"2024-05-30T16:50:00.206713+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:50:00.206713+0000","last_undegraded":"2024-05-30T16:50:00.206713+0000","last_fullsized":"2024-05-30T16:50:00.206713+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:46.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.187004+0000","last_change":"2024-05-30T16:50:00.187004+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.187004+0000","last_undegraded":"2024-05-30T16:50:00.187004+0000","last_fullsized":"2024-05-30T16:50:00.187004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213616+0000","last_change":"2024-05-30T16:50:00.210481+0000","last_active":"2024-05-30T16:50:00.213616+0000","last_peered":"2024-05-30T16:50:00.213616+0000","last_clean":"2024-05-30T16:50:00.213616+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:50:00.213616+0000","last_undegraded":"2024-05-30T16:50:00.213616+0000","last_fullsized":"2024-05-30T16:50:00.213616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:23.160571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222755+0000","last_change":"2024-05-30T16:50:01.218627+0000","last_active":"2024-05-30T16:50:01.222755+0000","last_peered":"2024-05-30T16:50:01.222755+0000","last_clean":"2024-05-30T16:50:01.222755+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:50:01.222755+0000","last_undegraded":"2024-05-30T16:50:01.222755+0000","last_fullsized":"2024-05-30T16:50:01.222755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:31:09.263732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213551+0000","last_change":"2024-05-30T16:50:00.210033+0000","last_active":"2024-05-30T16:50:00.213551+0000","last_peered":"2024-05-30T16:50:00.213551+0000","last_clean":"2024-05-30T16:50:00.213551+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:50:00.213551+0000","last_undegraded":"2024-05-30T16:50:00.213551+0000","last_fullsized":"2024-05-30T16:50:00.213551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:32:51.864331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":265,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.206306+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:50:01.206306+0000","last_peered":"2024-05-30T16:50:01.206306+0000","last_clean":"2024-05-30T16:50:01.206306+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:50:01.206306+0000","last_undegraded":"2024-05-30T16:50:01.206306+0000","last_fullsized":"2024-05-30T16:50:01.206306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58960,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312880,"statfs":{"total":96636764160,"available":96576389120,"internally_reserved":0,"allocated":1445888,"data_stored":950584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54224,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54224,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54224,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50052,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321788,"statfs":{"total":96636764160,"available":96585510912,"internally_reserved":0,"allocated":839680,"data_stored":353913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58960,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312880,"statfs":{"total":96636764160,"available":96576389120,"internally_reserved":0,"allocated":1445888,"data_stored":950584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:50:06.054 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:50:06.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.294+0000 7f74ba400640 1 Processor -- start 2024-05-30T16:50:06.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.294+0000 7f74ba400640 1 -- start start 2024-05-30T16:50:06.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.296+0000 7f74ba400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74b4141510 0x7f74b41418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.296+0000 7f74ba400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f74b415f8f0 0x7f74b4144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.296+0000 7f74ba400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 0x7f74b40b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.296+0000 7f74ba400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f74b4144560 con 0x7f74b4141510 2024-05-30T16:50:06.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.296+0000 7f74ba400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f74b406dfc0 con 0x7f74b415f8f0 2024-05-30T16:50:06.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.296+0000 7f74ba400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f74b40b3fd0 con 0x7f74b40b5440 2024-05-30T16:50:06.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.296+0000 7f74b3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74b4141510 0x7f74b41418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.296+0000 7f74b3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74b4141510 0x7f74b41418f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42992/0 (socket says 172.21.15.144:42992) 2024-05-30T16:50:06.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.296+0000 7f74b3400640 1 -- 172.21.15.144:0/4277165316 learned_addr learned my addr 172.21.15.144:0/4277165316 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.297+0000 7f74b2a00640 1 --2- 172.21.15.144:0/4277165316 >> v2:172.21.15.149:3300/0 conn(0x7f74b415f8f0 0x7f74b4144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.297+0000 7f74b3e00640 1 --2- 172.21.15.144:0/4277165316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 0x7f74b40b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.297+0000 7f74b3400640 1 -- 172.21.15.144:0/4277165316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 msgr2=0x7f74b40b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.297+0000 7f74b3400640 1 --2- 172.21.15.144:0/4277165316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 0x7f74b40b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.297+0000 7f74b3400640 1 -- 172.21.15.144:0/4277165316 >> v2:172.21.15.149:3300/0 conn(0x7f74b415f8f0 msgr2=0x7f74b4144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.297+0000 7f74b3400640 1 --2- 172.21.15.144:0/4277165316 >> v2:172.21.15.149:3300/0 conn(0x7f74b415f8f0 0x7f74b4144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.297+0000 7f74b3400640 1 -- 172.21.15.144:0/4277165316 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b415fd80 con 0x7f74b4141510 2024-05-30T16:50:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.297+0000 7f74b2a00640 1 --2- 172.21.15.144:0/4277165316 >> v2:172.21.15.149:3300/0 conn(0x7f74b415f8f0 0x7f74b4144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.298+0000 7f74b3400640 1 --2- 172.21.15.144:0/4277165316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b4141510 0x7f74b41418f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f74b4141e30 tx=0x7f74a402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a6e0aa653581e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.298+0000 7f74b2000640 1 -- 172.21.15.144:0/4277165316 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4037070 con 0x7f74b4141510 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74b2000640 1 -- 172.21.15.144:0/4277165316 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a402ae00 con 0x7f74b4141510 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74b2000640 1 -- 172.21.15.144:0/4277165316 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4032660 con 0x7f74b4141510 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74ba400640 1 -- 172.21.15.144:0/4277165316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b4141510 msgr2=0x7f74b41418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74ba400640 1 --2- 172.21.15.144:0/4277165316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b4141510 0x7f74b41418f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f74b4141e30 tx=0x7f74a402a0b0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74ba400640 1 -- 172.21.15.144:0/4277165316 shutdown_connections 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74ba400640 1 --2- 172.21.15.144:0/4277165316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 0x7f74b40b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74ba400640 1 --2- 172.21.15.144:0/4277165316 >> v2:172.21.15.149:3300/0 conn(0x7f74b415f8f0 0x7f74b4144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74ba400640 1 --2- 172.21.15.144:0/4277165316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b4141510 0x7f74b41418f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74ba400640 1 -- 172.21.15.144:0/4277165316 >> 172.21.15.144:0/4277165316 conn(0x7f74b406bd00 msgr2=0x7f74b406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74ba400640 1 -- 172.21.15.144:0/4277165316 shutdown_connections 2024-05-30T16:50:06.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.299+0000 7f74ba400640 1 -- 172.21.15.144:0/4277165316 wait complete. 2024-05-30T16:50:06.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.301+0000 7f74ba400640 1 Processor -- start 2024-05-30T16:50:06.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.301+0000 7f74ba400640 1 -- start start 2024-05-30T16:50:06.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.302+0000 7f74ba400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 0x7f74b4157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.302+0000 7f74ba400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b4141510 0x7f74b41f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.302+0000 7f74ba400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b415f8f0 0x7f74b41f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.302+0000 7f74ba400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4144d50 con 0x7f74b415f8f0 2024-05-30T16:50:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.302+0000 7f74ba400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4144a70 con 0x7f74b4141510 2024-05-30T16:50:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.302+0000 7f74ba400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f74b406e210 con 0x7f74b40b5440 2024-05-30T16:50:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.302+0000 7f74b3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b415f8f0 0x7f74b41f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.302+0000 7f74b3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b415f8f0 0x7f74b41f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43000/0 (socket says 172.21.15.144:43000) 2024-05-30T16:50:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.302+0000 7f74b3e00640 1 -- 172.21.15.144:0/1355270765 learned_addr learned my addr 172.21.15.144:0/1355270765 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:06.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74b3400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 0x7f74b4157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74b2a00640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b4141510 0x7f74b41f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74b3e00640 1 -- 172.21.15.144:0/1355270765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 msgr2=0x7f74b4157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74b3e00640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 0x7f74b4157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74b3e00640 1 -- 172.21.15.144:0/1355270765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b4141510 msgr2=0x7f74b41f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74b3e00640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b4141510 0x7f74b41f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74b3e00640 1 -- 172.21.15.144:0/1355270765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b41f50c0 con 0x7f74b415f8f0 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74b2a00640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b4141510 0x7f74b41f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74b3e00640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b415f8f0 0x7f74b41f46e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00cda0 tx=0x7f74ac00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.303+0000 7f74ab400640 1 -- 172.21.15.144:0/1355270765 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac003b90 con 0x7f74b415f8f0 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.304+0000 7f74ab400640 1 -- 172.21.15.144:0/1355270765 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ac003d30 con 0x7f74b415f8f0 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.304+0000 7f74ab400640 1 -- 172.21.15.144:0/1355270765 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac004240 con 0x7f74b415f8f0 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.304+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b41f53a0 con 0x7f74b415f8f0 2024-05-30T16:50:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.304+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b4158150 con 0x7f74b415f8f0 2024-05-30T16:50:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.305+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b4068b90 con 0x7f74b415f8f0 2024-05-30T16:50:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.306+0000 7f74ab400640 1 -- 172.21.15.144:0/1355270765 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f74ac0043e0 con 0x7f74b415f8f0 2024-05-30T16:50:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.307+0000 7f74ab400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f749406d5e0 0x7f749406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.307+0000 7f74ab400640 1 -- 172.21.15.144:0/1355270765 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f74ac08b100 con 0x7f74b415f8f0 2024-05-30T16:50:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.307+0000 7f74b3400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f749406d5e0 0x7f749406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.308+0000 7f74b3400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f749406d5e0 0x7f749406faa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74a4034000 tx=0x7f74a402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:06.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.311+0000 7f74ab400640 1 -- 172.21.15.144:0/1355270765 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74ac01d340 con 0x7f74b415f8f0 2024-05-30T16:50:06.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.509+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74b40b3720 con 0x7f749406d5e0 2024-05-30T16:50:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.521+0000 7f74ab400640 1 -- 172.21.15.144:0/1355270765 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247926 (secure 0 0 0) 0x7f74b40b3720 con 0x7f749406d5e0 2024-05-30T16:50:06.525 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:06.526 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f749406d5e0 msgr2=0x7f749406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f749406d5e0 0x7f749406faa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74a4034000 tx=0x7f74a402e000 comp rx=0 tx=0).stop 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b415f8f0 msgr2=0x7f74b41f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b415f8f0 0x7f74b41f46e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00cda0 tx=0x7f74ac00a660 comp rx=0 tx=0).stop 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 shutdown_connections 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f749406d5e0 0x7f749406faa0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b415f8f0 0x7f74b41f46e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b4141510 0x7f74b41f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 --2- 172.21.15.144:0/1355270765 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74b40b5440 0x7f74b4157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.525+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 >> 172.21.15.144:0/1355270765 conn(0x7f74b406bd00 msgr2=0x7f74b4143900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.526+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 shutdown_connections 2024-05-30T16:50:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.526+0000 7f74ba400640 1 -- 172.21.15.144:0/1355270765 wait complete. 2024-05-30T16:50:06.546 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-05-30T16:50:05.118541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":447412,"kb_used_data":7804,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754527308,"statfs":{"total":773094113280,"available":772635963392,"internally_reserved":0,"allocated":7991296,"data_stored":4056161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":450022963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.954488"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.210932+0000","last_change":"2024-05-30T16:50:01.210932+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.210932+0000","last_undegraded":"2024-05-30T16:50:01.210932+0000","last_fullsized":"2024-05-30T16:50:01.210932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.189821+0000","last_change":"2024-05-30T16:50:00.189821+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.189821+0000","last_undegraded":"2024-05-30T16:50:00.189821+0000","last_fullsized":"2024-05-30T16:50:00.189821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.221320+0000","last_change":"2024-05-30T16:50:01.216644+0000","last_active":"2024-05-30T16:50:01.221320+0000","last_peered":"2024-05-30T16:50:01.221320+0000","last_clean":"2024-05-30T16:50:01.221320+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:50:01.221320+0000","last_undegraded":"2024-05-30T16:50:01.221320+0000","last_fullsized":"2024-05-30T16:50:01.221320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:33:17.720209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.200613+0000","last_change":"2024-05-30T16:50:00.200613+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.200613+0000","last_undegraded":"2024-05-30T16:50:00.200613+0000","last_fullsized":"2024-05-30T16:50:00.200613+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192496+0000","last_change":"2024-05-30T16:50:00.192496+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192496+0000","last_undegraded":"2024-05-30T16:50:00.192496+0000","last_fullsized":"2024-05-30T16:50:00.192496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190684+0000","last_change":"2024-05-30T16:50:00.190684+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190684+0000","last_undegraded":"2024-05-30T16:50:00.190684+0000","last_fullsized":"2024-05-30T16:50:00.190684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.199237+0000","last_change":"2024-05-30T16:50:00.199237+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.199237+0000","last_undegraded":"2024-05-30T16:50:00.199237+0000","last_fullsized":"2024-05-30T16:50:00.199237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.198903+0000","last_change":"2024-05-30T16:50:00.198903+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.198903+0000","last_undegraded":"2024-05-30T16:50:00.198903+0000","last_fullsized":"2024-05-30T16:50:00.198903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.191812+0000","last_change":"2024-05-30T16:50:00.191812+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.191812+0000","last_undegraded":"2024-05-30T16:50:00.191812+0000","last_fullsized":"2024-05-30T16:50:00.191812+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194914+0000","last_change":"2024-05-30T16:50:00.194914+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194914+0000","last_undegraded":"2024-05-30T16:50:00.194914+0000","last_fullsized":"2024-05-30T16:50:00.194914+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.206010+0000","last_change":"2024-05-30T16:50:01.206010+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.206010+0000","last_undegraded":"2024-05-30T16:50:01.206010+0000","last_fullsized":"2024-05-30T16:50:01.206010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194759+0000","last_change":"2024-05-30T16:50:00.194759+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194759+0000","last_undegraded":"2024-05-30T16:50:00.194759+0000","last_fullsized":"2024-05-30T16:50:00.194759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222089+0000","last_change":"2024-05-30T16:50:01.213490+0000","last_active":"2024-05-30T16:50:01.222089+0000","last_peered":"2024-05-30T16:50:01.222089+0000","last_clean":"2024-05-30T16:50:01.222089+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:50:01.222089+0000","last_undegraded":"2024-05-30T16:50:01.222089+0000","last_fullsized":"2024-05-30T16:50:01.222089+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:55:03.170716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194029+0000","last_change":"2024-05-30T16:50:00.194029+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194029+0000","last_undegraded":"2024-05-30T16:50:00.194029+0000","last_fullsized":"2024-05-30T16:50:00.194029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222022+0000","last_change":"2024-05-30T16:50:01.213697+0000","last_active":"2024-05-30T16:50:01.222022+0000","last_peered":"2024-05-30T16:50:01.222022+0000","last_clean":"2024-05-30T16:50:01.222022+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:50:01.222022+0000","last_undegraded":"2024-05-30T16:50:01.222022+0000","last_fullsized":"2024-05-30T16:50:01.222022+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:54:18.805624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.186522+0000","last_change":"2024-05-30T16:50:00.186522+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.186522+0000","last_undegraded":"2024-05-30T16:50:00.186522+0000","last_fullsized":"2024-05-30T16:50:00.186522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190991+0000","last_change":"2024-05-30T16:50:00.190991+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190991+0000","last_undegraded":"2024-05-30T16:50:00.190991+0000","last_fullsized":"2024-05-30T16:50:00.190991+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.196764+0000","last_change":"2024-05-30T16:50:00.196764+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.196764+0000","last_undegraded":"2024-05-30T16:50:00.196764+0000","last_fullsized":"2024-05-30T16:50:00.196764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.188337+0000","last_change":"2024-05-30T16:50:00.188337+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.188337+0000","last_undegraded":"2024-05-30T16:50:00.188337+0000","last_fullsized":"2024-05-30T16:50:00.188337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225025+0000","last_change":"2024-05-30T16:50:01.223666+0000","last_active":"2024-05-30T16:50:01.225025+0000","last_peered":"2024-05-30T16:50:01.225025+0000","last_clean":"2024-05-30T16:50:01.225025+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:50:01.225025+0000","last_undegraded":"2024-05-30T16:50:01.225025+0000","last_fullsized":"2024-05-30T16:50:01.225025+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:15.642014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.199903+0000","last_change":"2024-05-30T16:50:00.199903+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.199903+0000","last_undegraded":"2024-05-30T16:50:00.199903+0000","last_fullsized":"2024-05-30T16:50:00.199903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192239+0000","last_change":"2024-05-30T16:50:00.192239+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192239+0000","last_undegraded":"2024-05-30T16:50:00.192239+0000","last_fullsized":"2024-05-30T16:50:00.192239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.209132+0000","last_change":"2024-05-30T16:50:01.209132+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.209132+0000","last_undegraded":"2024-05-30T16:50:01.209132+0000","last_fullsized":"2024-05-30T16:50:01.209132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.204097+0000","last_change":"2024-05-30T16:50:01.204097+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.204097+0000","last_undegraded":"2024-05-30T16:50:01.204097+0000","last_fullsized":"2024-05-30T16:50:01.204097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192551+0000","last_change":"2024-05-30T16:50:00.192551+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192551+0000","last_undegraded":"2024-05-30T16:50:00.192551+0000","last_fullsized":"2024-05-30T16:50:00.192551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.205607+0000","last_change":"2024-05-30T16:50:00.205607+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.205607+0000","last_undegraded":"2024-05-30T16:50:00.205607+0000","last_fullsized":"2024-05-30T16:50:00.205607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225568+0000","last_change":"2024-05-30T16:50:01.221359+0000","last_active":"2024-05-30T16:50:01.225568+0000","last_peered":"2024-05-30T16:50:01.225568+0000","last_clean":"2024-05-30T16:50:01.225568+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:50:01.225568+0000","last_undegraded":"2024-05-30T16:50:01.225568+0000","last_fullsized":"2024-05-30T16:50:01.225568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:16.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.193537+0000","last_change":"2024-05-30T16:50:00.193537+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.193537+0000","last_undegraded":"2024-05-30T16:50:00.193537+0000","last_fullsized":"2024-05-30T16:50:00.193537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.230837+0000","last_change":"2024-05-30T16:50:01.225500+0000","last_active":"2024-05-30T16:50:01.230837+0000","last_peered":"2024-05-30T16:50:01.230837+0000","last_clean":"2024-05-30T16:50:01.230837+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:50:01.230837+0000","last_undegraded":"2024-05-30T16:50:01.230837+0000","last_fullsized":"2024-05-30T16:50:01.230837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:43.760509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.199293+0000","last_change":"2024-05-30T16:50:00.199293+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.199293+0000","last_undegraded":"2024-05-30T16:50:00.199293+0000","last_fullsized":"2024-05-30T16:50:00.199293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.198363+0000","last_change":"2024-05-30T16:50:00.198363+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.198363+0000","last_undegraded":"2024-05-30T16:50:00.198363+0000","last_fullsized":"2024-05-30T16:50:00.198363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.188014+0000","last_change":"2024-05-30T16:50:00.188014+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.188014+0000","last_undegraded":"2024-05-30T16:50:00.188014+0000","last_fullsized":"2024-05-30T16:50:00.188014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.210278+0000","last_change":"2024-05-30T16:50:01.210278+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.210278+0000","last_undegraded":"2024-05-30T16:50:01.210278+0000","last_fullsized":"2024-05-30T16:50:01.210278+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.212200+0000","last_change":"2024-05-30T16:50:00.205578+0000","last_active":"2024-05-30T16:50:01.212200+0000","last_peered":"2024-05-30T16:50:01.212200+0000","last_clean":"2024-05-30T16:50:01.212200+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:50:01.212200+0000","last_undegraded":"2024-05-30T16:50:01.212200+0000","last_fullsized":"2024-05-30T16:50:01.212200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:09.041453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190169+0000","last_change":"2024-05-30T16:50:00.190169+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190169+0000","last_undegraded":"2024-05-30T16:50:00.190169+0000","last_fullsized":"2024-05-30T16:50:00.190169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.234294+0000","last_change":"2024-05-30T16:50:00.198543+0000","last_active":"2024-05-30T16:50:01.234294+0000","last_peered":"2024-05-30T16:50:01.234294+0000","last_clean":"2024-05-30T16:50:01.234294+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:50:01.234294+0000","last_undegraded":"2024-05-30T16:50:01.234294+0000","last_fullsized":"2024-05-30T16:50:01.234294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:06.670117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.197053+0000","last_change":"2024-05-30T16:50:00.197053+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.197053+0000","last_undegraded":"2024-05-30T16:50:00.197053+0000","last_fullsized":"2024-05-30T16:50:00.197053+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213525+0000","last_change":"2024-05-30T16:50:00.212444+0000","last_active":"2024-05-30T16:50:00.213525+0000","last_peered":"2024-05-30T16:50:00.213525+0000","last_clean":"2024-05-30T16:50:00.213525+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:50:00.213525+0000","last_undegraded":"2024-05-30T16:50:00.213525+0000","last_fullsized":"2024-05-30T16:50:00.213525+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:15.927433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.206369+0000","last_change":"2024-05-30T16:50:01.206369+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.206369+0000","last_undegraded":"2024-05-30T16:50:01.206369+0000","last_fullsized":"2024-05-30T16:50:01.206369+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213582+0000","last_change":"2024-05-30T16:50:00.210174+0000","last_active":"2024-05-30T16:50:00.213582+0000","last_peered":"2024-05-30T16:50:00.213582+0000","last_clean":"2024-05-30T16:50:00.213582+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:50:00.213582+0000","last_undegraded":"2024-05-30T16:50:00.213582+0000","last_fullsized":"2024-05-30T16:50:00.213582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:23:59.623653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.198805+0000","last_change":"2024-05-30T16:50:00.198805+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.198805+0000","last_undegraded":"2024-05-30T16:50:00.198805+0000","last_fullsized":"2024-05-30T16:50:00.198805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.233139+0000","last_change":"2024-05-30T16:50:00.205334+0000","last_active":"2024-05-30T16:50:01.233139+0000","last_peered":"2024-05-30T16:50:01.233139+0000","last_clean":"2024-05-30T16:50:01.233139+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:50:01.233139+0000","last_undegraded":"2024-05-30T16:50:01.233139+0000","last_fullsized":"2024-05-30T16:50:01.233139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:53.442543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.193038+0000","last_change":"2024-05-30T16:50:00.193038+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.193038+0000","last_undegraded":"2024-05-30T16:50:00.193038+0000","last_fullsized":"2024-05-30T16:50:00.193038+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207491+0000","last_change":"2024-05-30T16:50:00.205241+0000","last_active":"2024-05-30T16:50:00.207491+0000","last_peered":"2024-05-30T16:50:00.207491+0000","last_clean":"2024-05-30T16:50:00.207491+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:50:00.207491+0000","last_undegraded":"2024-05-30T16:50:00.207491+0000","last_fullsized":"2024-05-30T16:50:00.207491+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:25.844328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.187571+0000","last_change":"2024-05-30T16:50:00.187571+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.187571+0000","last_undegraded":"2024-05-30T16:50:00.187571+0000","last_fullsized":"2024-05-30T16:50:00.187571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.214357+0000","last_change":"2024-05-30T16:50:00.213769+0000","last_active":"2024-05-30T16:50:00.214357+0000","last_peered":"2024-05-30T16:50:00.214357+0000","last_clean":"2024-05-30T16:50:00.214357+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:50:00.214357+0000","last_undegraded":"2024-05-30T16:50:00.214357+0000","last_fullsized":"2024-05-30T16:50:00.214357+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:57:33.215066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222044+0000","last_change":"2024-05-30T16:50:01.214317+0000","last_active":"2024-05-30T16:50:01.222044+0000","last_peered":"2024-05-30T16:50:01.222044+0000","last_clean":"2024-05-30T16:50:01.222044+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:50:01.222044+0000","last_undegraded":"2024-05-30T16:50:01.222044+0000","last_fullsized":"2024-05-30T16:50:01.222044+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:35:29.637938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205601+0000","last_change":"2024-05-30T16:50:00.203638+0000","last_active":"2024-05-30T16:50:00.205601+0000","last_peered":"2024-05-30T16:50:00.205601+0000","last_clean":"2024-05-30T16:50:00.205601+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:50:00.205601+0000","last_undegraded":"2024-05-30T16:50:00.205601+0000","last_fullsized":"2024-05-30T16:50:00.205601+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:32:45.509834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.203130+0000","last_change":"2024-05-30T16:50:00.203130+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.203130+0000","last_undegraded":"2024-05-30T16:50:00.203130+0000","last_fullsized":"2024-05-30T16:50:00.203130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210687+0000","last_change":"2024-05-30T16:50:00.206844+0000","last_active":"2024-05-30T16:50:00.210687+0000","last_peered":"2024-05-30T16:50:00.210687+0000","last_clean":"2024-05-30T16:50:00.210687+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:50:00.210687+0000","last_undegraded":"2024-05-30T16:50:00.210687+0000","last_fullsized":"2024-05-30T16:50:00.210687+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:41:46.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.211217+0000","last_change":"2024-05-30T16:50:01.211217+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.211217+0000","last_undegraded":"2024-05-30T16:50:01.211217+0000","last_fullsized":"2024-05-30T16:50:01.211217+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213644+0000","last_change":"2024-05-30T16:50:00.210985+0000","last_active":"2024-05-30T16:50:00.213644+0000","last_peered":"2024-05-30T16:50:00.213644+0000","last_clean":"2024-05-30T16:50:00.213644+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:50:00.213644+0000","last_undegraded":"2024-05-30T16:50:00.213644+0000","last_fullsized":"2024-05-30T16:50:00.213644+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:17:54.630390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.196397+0000","last_change":"2024-05-30T16:50:00.196397+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.196397+0000","last_undegraded":"2024-05-30T16:50:00.196397+0000","last_fullsized":"2024-05-30T16:50:00.196397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.235056+0000","last_change":"2024-05-30T16:50:00.206599+0000","last_active":"2024-05-30T16:50:01.235056+0000","last_peered":"2024-05-30T16:50:01.235056+0000","last_clean":"2024-05-30T16:50:01.235056+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:50:01.235056+0000","last_undegraded":"2024-05-30T16:50:01.235056+0000","last_fullsized":"2024-05-30T16:50:01.235056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:50.078170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.191374+0000","last_change":"2024-05-30T16:50:00.191374+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.191374+0000","last_undegraded":"2024-05-30T16:50:00.191374+0000","last_fullsized":"2024-05-30T16:50:00.191374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210852+0000","last_change":"2024-05-30T16:50:00.208913+0000","last_active":"2024-05-30T16:50:00.210852+0000","last_peered":"2024-05-30T16:50:00.210852+0000","last_clean":"2024-05-30T16:50:00.210852+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:50:00.210852+0000","last_undegraded":"2024-05-30T16:50:00.210852+0000","last_fullsized":"2024-05-30T16:50:00.210852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:13:55.449885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.205235+0000","last_change":"2024-05-30T16:50:01.205235+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.205235+0000","last_undegraded":"2024-05-30T16:50:01.205235+0000","last_fullsized":"2024-05-30T16:50:01.205235+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.208822+0000","last_change":"2024-05-30T16:50:00.207072+0000","last_active":"2024-05-30T16:50:00.208822+0000","last_peered":"2024-05-30T16:50:00.208822+0000","last_clean":"2024-05-30T16:50:00.208822+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:50:00.208822+0000","last_undegraded":"2024-05-30T16:50:00.208822+0000","last_fullsized":"2024-05-30T16:50:00.208822+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:14.762635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.200429+0000","last_change":"2024-05-30T16:50:00.200429+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.200429+0000","last_undegraded":"2024-05-30T16:50:00.200429+0000","last_fullsized":"2024-05-30T16:50:00.200429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207508+0000","last_change":"2024-05-30T16:50:00.205457+0000","last_active":"2024-05-30T16:50:00.207508+0000","last_peered":"2024-05-30T16:50:00.207508+0000","last_clean":"2024-05-30T16:50:00.207508+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:50:00.207508+0000","last_undegraded":"2024-05-30T16:50:00.207508+0000","last_fullsized":"2024-05-30T16:50:00.207508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:08.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222198+0000","last_change":"2024-05-30T16:50:01.212311+0000","last_active":"2024-05-30T16:50:01.222198+0000","last_peered":"2024-05-30T16:50:01.222198+0000","last_clean":"2024-05-30T16:50:01.222198+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:50:01.222198+0000","last_undegraded":"2024-05-30T16:50:01.222198+0000","last_fullsized":"2024-05-30T16:50:01.222198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210859+0000","last_change":"2024-05-30T16:50:00.208941+0000","last_active":"2024-05-30T16:50:00.210859+0000","last_peered":"2024-05-30T16:50:00.210859+0000","last_clean":"2024-05-30T16:50:00.210859+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:50:00.210859+0000","last_undegraded":"2024-05-30T16:50:00.210859+0000","last_fullsized":"2024-05-30T16:50:00.210859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:00:11.531066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.187412+0000","last_change":"2024-05-30T16:50:00.187412+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.187412+0000","last_undegraded":"2024-05-30T16:50:00.187412+0000","last_fullsized":"2024-05-30T16:50:00.187412+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.197989+0000","last_change":"2024-05-30T16:50:00.196832+0000","last_active":"2024-05-30T16:50:00.197989+0000","last_peered":"2024-05-30T16:50:00.197989+0000","last_clean":"2024-05-30T16:50:00.197989+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:50:00.197989+0000","last_undegraded":"2024-05-30T16:50:00.197989+0000","last_fullsized":"2024-05-30T16:50:00.197989+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:08.366805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.191768+0000","last_change":"2024-05-30T16:50:00.191768+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.191768+0000","last_undegraded":"2024-05-30T16:50:00.191768+0000","last_fullsized":"2024-05-30T16:50:00.191768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207641+0000","last_change":"2024-05-30T16:50:00.206888+0000","last_active":"2024-05-30T16:50:00.207641+0000","last_peered":"2024-05-30T16:50:00.207641+0000","last_clean":"2024-05-30T16:50:00.207641+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:50:00.207641+0000","last_undegraded":"2024-05-30T16:50:00.207641+0000","last_fullsized":"2024-05-30T16:50:00.207641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:05.430319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.211852+0000","last_change":"2024-05-30T16:50:01.211852+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.211852+0000","last_undegraded":"2024-05-30T16:50:01.211852+0000","last_fullsized":"2024-05-30T16:50:01.211852+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205976+0000","last_change":"2024-05-30T16:50:00.201506+0000","last_active":"2024-05-30T16:50:00.205976+0000","last_peered":"2024-05-30T16:50:00.205976+0000","last_clean":"2024-05-30T16:50:00.205976+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:50:00.205976+0000","last_undegraded":"2024-05-30T16:50:00.205976+0000","last_fullsized":"2024-05-30T16:50:00.205976+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:30.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.194115+0000","last_change":"2024-05-30T16:50:00.194115+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.194115+0000","last_undegraded":"2024-05-30T16:50:00.194115+0000","last_fullsized":"2024-05-30T16:50:00.194115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205882+0000","last_change":"2024-05-30T16:50:00.201874+0000","last_active":"2024-05-30T16:50:00.205882+0000","last_peered":"2024-05-30T16:50:00.205882+0000","last_clean":"2024-05-30T16:50:00.205882+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:50:00.205882+0000","last_undegraded":"2024-05-30T16:50:00.205882+0000","last_fullsized":"2024-05-30T16:50:00.205882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:47.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.188938+0000","last_change":"2024-05-30T16:50:00.188938+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.188938+0000","last_undegraded":"2024-05-30T16:50:00.188938+0000","last_fullsized":"2024-05-30T16:50:00.188938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.207496+0000","last_change":"2024-05-30T16:50:00.202315+0000","last_active":"2024-05-30T16:50:01.207496+0000","last_peered":"2024-05-30T16:50:01.207496+0000","last_clean":"2024-05-30T16:50:01.207496+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:50:01.207496+0000","last_undegraded":"2024-05-30T16:50:01.207496+0000","last_fullsized":"2024-05-30T16:50:01.207496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:07.542490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222124+0000","last_change":"2024-05-30T16:50:01.217916+0000","last_active":"2024-05-30T16:50:01.222124+0000","last_peered":"2024-05-30T16:50:01.222124+0000","last_clean":"2024-05-30T16:50:01.222124+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:50:01.222124+0000","last_undegraded":"2024-05-30T16:50:01.222124+0000","last_fullsized":"2024-05-30T16:50:01.222124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:30:39.890355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207471+0000","last_change":"2024-05-30T16:50:00.204870+0000","last_active":"2024-05-30T16:50:00.207471+0000","last_peered":"2024-05-30T16:50:00.207471+0000","last_clean":"2024-05-30T16:50:00.207471+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:50:00.207471+0000","last_undegraded":"2024-05-30T16:50:00.207471+0000","last_fullsized":"2024-05-30T16:50:00.207471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:48.195369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225491+0000","last_change":"2024-05-30T16:50:01.219838+0000","last_active":"2024-05-30T16:50:01.225491+0000","last_peered":"2024-05-30T16:50:01.225491+0000","last_clean":"2024-05-30T16:50:01.225491+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:50:01.225491+0000","last_undegraded":"2024-05-30T16:50:01.225491+0000","last_fullsized":"2024-05-30T16:50:01.225491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:30.501139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.210370+0000","last_change":"2024-05-30T16:50:00.207506+0000","last_active":"2024-05-30T16:50:00.210370+0000","last_peered":"2024-05-30T16:50:00.210370+0000","last_clean":"2024-05-30T16:50:00.210370+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:50:00.210370+0000","last_undegraded":"2024-05-30T16:50:00.210370+0000","last_fullsized":"2024-05-30T16:50:00.210370+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:48:16.720637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.225517+0000","last_change":"2024-05-30T16:50:01.220513+0000","last_active":"2024-05-30T16:50:01.225517+0000","last_peered":"2024-05-30T16:50:01.225517+0000","last_clean":"2024-05-30T16:50:01.225517+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:50:01.225517+0000","last_undegraded":"2024-05-30T16:50:01.225517+0000","last_fullsized":"2024-05-30T16:50:01.225517+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:34.972283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.198378+0000","last_change":"2024-05-30T16:50:00.199775+0000","last_active":"2024-05-30T16:50:01.198378+0000","last_peered":"2024-05-30T16:50:01.198378+0000","last_clean":"2024-05-30T16:50:01.198378+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:50:01.198378+0000","last_undegraded":"2024-05-30T16:50:01.198378+0000","last_fullsized":"2024-05-30T16:50:01.198378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:11.926104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.221978+0000","last_change":"2024-05-30T16:50:01.212934+0000","last_active":"2024-05-30T16:50:01.221978+0000","last_peered":"2024-05-30T16:50:01.221978+0000","last_clean":"2024-05-30T16:50:01.221978+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:50:01.221978+0000","last_undegraded":"2024-05-30T16:50:01.221978+0000","last_fullsized":"2024-05-30T16:50:01.221978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:48:19.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.207623+0000","last_change":"2024-05-30T16:50:00.206485+0000","last_active":"2024-05-30T16:50:00.207623+0000","last_peered":"2024-05-30T16:50:00.207623+0000","last_clean":"2024-05-30T16:50:00.207623+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:50:00.207623+0000","last_undegraded":"2024-05-30T16:50:00.207623+0000","last_fullsized":"2024-05-30T16:50:00.207623+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:10.490016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.202455+0000","last_change":"2024-05-30T16:50:00.202455+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.202455+0000","last_undegraded":"2024-05-30T16:50:00.202455+0000","last_fullsized":"2024-05-30T16:50:00.202455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.212289+0000","last_change":"2024-05-30T16:50:00.209889+0000","last_active":"2024-05-30T16:50:00.212289+0000","last_peered":"2024-05-30T16:50:00.212289+0000","last_clean":"2024-05-30T16:50:00.212289+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:50:00.212289+0000","last_undegraded":"2024-05-30T16:50:00.212289+0000","last_fullsized":"2024-05-30T16:50:00.212289+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:21.242822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.207240+0000","last_change":"2024-05-30T16:50:01.207240+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.207240+0000","last_undegraded":"2024-05-30T16:50:01.207240+0000","last_fullsized":"2024-05-30T16:50:01.207240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.205195+0000","last_change":"2024-05-30T16:50:00.202834+0000","last_active":"2024-05-30T16:50:00.205195+0000","last_peered":"2024-05-30T16:50:00.205195+0000","last_clean":"2024-05-30T16:50:00.205195+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:50:00.205195+0000","last_undegraded":"2024-05-30T16:50:00.205195+0000","last_fullsized":"2024-05-30T16:50:00.205195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:46:04.052373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":3,"reported_epoch":71,"state":"creating+activating","last_fresh":"2024-05-30T16:50:01.206709+0000","last_change":"2024-05-30T16:50:01.206709+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:01.206709+0000","last_undegraded":"2024-05-30T16:50:01.206709+0000","last_fullsized":"2024-05-30T16:50:01.206709+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.200373+0000","last_change":"2024-05-30T16:50:00.204452+0000","last_active":"2024-05-30T16:50:01.200373+0000","last_peered":"2024-05-30T16:50:01.200373+0000","last_clean":"2024-05-30T16:50:01.200373+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:50:01.200373+0000","last_undegraded":"2024-05-30T16:50:01.200373+0000","last_fullsized":"2024-05-30T16:50:01.200373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:54.227101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.192880+0000","last_change":"2024-05-30T16:50:00.192880+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.192880+0000","last_undegraded":"2024-05-30T16:50:00.192880+0000","last_fullsized":"2024-05-30T16:50:00.192880+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.209984+0000","last_change":"2024-05-30T16:50:00.207741+0000","last_active":"2024-05-30T16:50:00.209984+0000","last_peered":"2024-05-30T16:50:00.209984+0000","last_clean":"2024-05-30T16:50:00.209984+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:50:00.209984+0000","last_undegraded":"2024-05-30T16:50:00.209984+0000","last_fullsized":"2024-05-30T16:50:00.209984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:53:16.131276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.189514+0000","last_change":"2024-05-30T16:50:00.189514+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.189514+0000","last_undegraded":"2024-05-30T16:50:00.189514+0000","last_fullsized":"2024-05-30T16:50:00.189514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213662+0000","last_change":"2024-05-30T16:50:00.213146+0000","last_active":"2024-05-30T16:50:00.213662+0000","last_peered":"2024-05-30T16:50:00.213662+0000","last_clean":"2024-05-30T16:50:00.213662+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:50:00.213662+0000","last_undegraded":"2024-05-30T16:50:00.213662+0000","last_fullsized":"2024-05-30T16:50:00.213662+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:47.728723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.190938+0000","last_change":"2024-05-30T16:50:00.190938+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.190938+0000","last_undegraded":"2024-05-30T16:50:00.190938+0000","last_fullsized":"2024-05-30T16:50:00.190938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.206713+0000","last_change":"2024-05-30T16:50:00.203989+0000","last_active":"2024-05-30T16:50:00.206713+0000","last_peered":"2024-05-30T16:50:00.206713+0000","last_clean":"2024-05-30T16:50:00.206713+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:50:00.206713+0000","last_undegraded":"2024-05-30T16:50:00.206713+0000","last_fullsized":"2024-05-30T16:50:00.206713+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:46.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-05-30T16:50:00.187004+0000","last_change":"2024-05-30T16:50:00.187004+0000","last_active":"2024-05-30T16:50:00.160556+0000","last_peered":"2024-05-30T16:50:00.160556+0000","last_clean":"2024-05-30T16:50:00.160556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T16:50:00.187004+0000","last_undegraded":"2024-05-30T16:50:00.187004+0000","last_fullsized":"2024-05-30T16:50:00.187004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213616+0000","last_change":"2024-05-30T16:50:00.210481+0000","last_active":"2024-05-30T16:50:00.213616+0000","last_peered":"2024-05-30T16:50:00.213616+0000","last_clean":"2024-05-30T16:50:00.213616+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:50:00.213616+0000","last_undegraded":"2024-05-30T16:50:00.213616+0000","last_fullsized":"2024-05-30T16:50:00.213616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:23.160571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.222755+0000","last_change":"2024-05-30T16:50:01.218627+0000","last_active":"2024-05-30T16:50:01.222755+0000","last_peered":"2024-05-30T16:50:01.222755+0000","last_clean":"2024-05-30T16:50:01.222755+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:50:01.222755+0000","last_undegraded":"2024-05-30T16:50:01.222755+0000","last_fullsized":"2024-05-30T16:50:01.222755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:31:09.263732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-30T16:50:00.213551+0000","last_change":"2024-05-30T16:50:00.210033+0000","last_active":"2024-05-30T16:50:00.213551+0000","last_peered":"2024-05-30T16:50:00.213551+0000","last_clean":"2024-05-30T16:50:00.213551+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:50:00.213551+0000","last_undegraded":"2024-05-30T16:50:00.213551+0000","last_fullsized":"2024-05-30T16:50:00.213551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:32:51.864331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":265,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-05-30T16:50:01.206306+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:50:01.206306+0000","last_peered":"2024-05-30T16:50:01.206306+0000","last_clean":"2024-05-30T16:50:01.206306+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:50:01.206306+0000","last_undegraded":"2024-05-30T16:50:01.206306+0000","last_fullsized":"2024-05-30T16:50:01.206306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58960,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312880,"statfs":{"total":96636764160,"available":96576389120,"internally_reserved":0,"allocated":1445888,"data_stored":950584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54224,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54224,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54224,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317616,"statfs":{"total":96636764160,"available":96581238784,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50052,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321788,"statfs":{"total":96636764160,"available":96585510912,"internally_reserved":0,"allocated":839680,"data_stored":353913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58384,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313456,"statfs":{"total":96636764160,"available":96576978944,"internally_reserved":0,"allocated":851968,"data_stored":360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58960,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312880,"statfs":{"total":96636764160,"available":96576389120,"internally_reserved":0,"allocated":1445888,"data_stored":950584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:50:06.549 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.210932+0000', 'last_change': '2024-05-30T16:50:01.210932+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.210932+0000', 'last_undegraded': '2024-05-30T16:50:01.210932+0000', 'last_fullsized': '2024-05-30T16:50:01.210932+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3e is not active+clean 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.189821+0000', 'last_change': '2024-05-30T16:50:00.189821+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.189821+0000', 'last_undegraded': '2024-05-30T16:50:00.189821+0000', 'last_fullsized': '2024-05-30T16:50:00.189821+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3c is not active+clean 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.200613+0000', 'last_change': '2024-05-30T16:50:00.200613+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.200613+0000', 'last_undegraded': '2024-05-30T16:50:00.200613+0000', 'last_fullsized': '2024-05-30T16:50:00.200613+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3b is not active+clean 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.192496+0000', 'last_change': '2024-05-30T16:50:00.192496+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.192496+0000', 'last_undegraded': '2024-05-30T16:50:00.192496+0000', 'last_fullsized': '2024-05-30T16:50:00.192496+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3a is not active+clean 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.190684+0000', 'last_change': '2024-05-30T16:50:00.190684+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.190684+0000', 'last_undegraded': '2024-05-30T16:50:00.190684+0000', 'last_fullsized': '2024-05-30T16:50:00.190684+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-05-30T16:50:06.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.199237+0000', 'last_change': '2024-05-30T16:50:00.199237+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.199237+0000', 'last_undegraded': '2024-05-30T16:50:00.199237+0000', 'last_fullsized': '2024-05-30T16:50:00.199237+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.38 is not active+clean 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.198903+0000', 'last_change': '2024-05-30T16:50:00.198903+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.198903+0000', 'last_undegraded': '2024-05-30T16:50:00.198903+0000', 'last_fullsized': '2024-05-30T16:50:00.198903+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.37 is not active+clean 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.191812+0000', 'last_change': '2024-05-30T16:50:00.191812+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.191812+0000', 'last_undegraded': '2024-05-30T16:50:00.191812+0000', 'last_fullsized': '2024-05-30T16:50:00.191812+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.36 is not active+clean 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.194914+0000', 'last_change': '2024-05-30T16:50:00.194914+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.194914+0000', 'last_undegraded': '2024-05-30T16:50:00.194914+0000', 'last_fullsized': '2024-05-30T16:50:00.194914+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.206010+0000', 'last_change': '2024-05-30T16:50:01.206010+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.206010+0000', 'last_undegraded': '2024-05-30T16:50:01.206010+0000', 'last_fullsized': '2024-05-30T16:50:01.206010+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.34 is not active+clean 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.194759+0000', 'last_change': '2024-05-30T16:50:00.194759+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.194759+0000', 'last_undegraded': '2024-05-30T16:50:00.194759+0000', 'last_fullsized': '2024-05-30T16:50:00.194759+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.32 is not active+clean 2024-05-30T16:50:06.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.194029+0000', 'last_change': '2024-05-30T16:50:00.194029+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.194029+0000', 'last_undegraded': '2024-05-30T16:50:00.194029+0000', 'last_fullsized': '2024-05-30T16:50:00.194029+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.186522+0000', 'last_change': '2024-05-30T16:50:00.186522+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.186522+0000', 'last_undegraded': '2024-05-30T16:50:00.186522+0000', 'last_fullsized': '2024-05-30T16:50:00.186522+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2f is not active+clean 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.190991+0000', 'last_change': '2024-05-30T16:50:00.190991+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.190991+0000', 'last_undegraded': '2024-05-30T16:50:00.190991+0000', 'last_fullsized': '2024-05-30T16:50:00.190991+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2e is not active+clean 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.196764+0000', 'last_change': '2024-05-30T16:50:00.196764+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.196764+0000', 'last_undegraded': '2024-05-30T16:50:00.196764+0000', 'last_fullsized': '2024-05-30T16:50:00.196764+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2d is not active+clean 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.188337+0000', 'last_change': '2024-05-30T16:50:00.188337+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.188337+0000', 'last_undegraded': '2024-05-30T16:50:00.188337+0000', 'last_fullsized': '2024-05-30T16:50:00.188337+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2b is not active+clean 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.199903+0000', 'last_change': '2024-05-30T16:50:00.199903+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.199903+0000', 'last_undegraded': '2024-05-30T16:50:00.199903+0000', 'last_fullsized': '2024-05-30T16:50:00.199903+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:50:06.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.192239+0000', 'last_change': '2024-05-30T16:50:00.192239+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.192239+0000', 'last_undegraded': '2024-05-30T16:50:00.192239+0000', 'last_fullsized': '2024-05-30T16:50:00.192239+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.209132+0000', 'last_change': '2024-05-30T16:50:01.209132+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.209132+0000', 'last_undegraded': '2024-05-30T16:50:01.209132+0000', 'last_fullsized': '2024-05-30T16:50:01.209132+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.204097+0000', 'last_change': '2024-05-30T16:50:01.204097+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.204097+0000', 'last_undegraded': '2024-05-30T16:50:01.204097+0000', 'last_fullsized': '2024-05-30T16:50:01.204097+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.27 is not active+clean 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.192551+0000', 'last_change': '2024-05-30T16:50:00.192551+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.192551+0000', 'last_undegraded': '2024-05-30T16:50:00.192551+0000', 'last_fullsized': '2024-05-30T16:50:00.192551+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.205607+0000', 'last_change': '2024-05-30T16:50:00.205607+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.205607+0000', 'last_undegraded': '2024-05-30T16:50:00.205607+0000', 'last_fullsized': '2024-05-30T16:50:00.205607+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.24 is not active+clean 2024-05-30T16:50:06.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.193537+0000', 'last_change': '2024-05-30T16:50:00.193537+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.193537+0000', 'last_undegraded': '2024-05-30T16:50:00.193537+0000', 'last_fullsized': '2024-05-30T16:50:00.193537+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.199293+0000', 'last_change': '2024-05-30T16:50:00.199293+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.199293+0000', 'last_undegraded': '2024-05-30T16:50:00.199293+0000', 'last_fullsized': '2024-05-30T16:50:00.199293+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.198363+0000', 'last_change': '2024-05-30T16:50:00.198363+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.198363+0000', 'last_undegraded': '2024-05-30T16:50:00.198363+0000', 'last_fullsized': '2024-05-30T16:50:00.198363+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.20 is not active+clean 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.188014+0000', 'last_change': '2024-05-30T16:50:00.188014+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.188014+0000', 'last_undegraded': '2024-05-30T16:50:00.188014+0000', 'last_fullsized': '2024-05-30T16:50:00.188014+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.210278+0000', 'last_change': '2024-05-30T16:50:01.210278+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.210278+0000', 'last_undegraded': '2024-05-30T16:50:01.210278+0000', 'last_fullsized': '2024-05-30T16:50:01.210278+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.190169+0000', 'last_change': '2024-05-30T16:50:00.190169+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.190169+0000', 'last_undegraded': '2024-05-30T16:50:00.190169+0000', 'last_fullsized': '2024-05-30T16:50:00.190169+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-05-30T16:50:06.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.197053+0000', 'last_change': '2024-05-30T16:50:00.197053+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.197053+0000', 'last_undegraded': '2024-05-30T16:50:00.197053+0000', 'last_fullsized': '2024-05-30T16:50:00.197053+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.206369+0000', 'last_change': '2024-05-30T16:50:01.206369+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.206369+0000', 'last_undegraded': '2024-05-30T16:50:01.206369+0000', 'last_fullsized': '2024-05-30T16:50:01.206369+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': ['7', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.198805+0000', 'last_change': '2024-05-30T16:50:00.198805+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.198805+0000', 'last_undegraded': '2024-05-30T16:50:00.198805+0000', 'last_fullsized': '2024-05-30T16:50:00.198805+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.193038+0000', 'last_change': '2024-05-30T16:50:00.193038+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.193038+0000', 'last_undegraded': '2024-05-30T16:50:00.193038+0000', 'last_fullsized': '2024-05-30T16:50:00.193038+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.187571+0000', 'last_change': '2024-05-30T16:50:00.187571+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.187571+0000', 'last_undegraded': '2024-05-30T16:50:00.187571+0000', 'last_fullsized': '2024-05-30T16:50:00.187571+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.203130+0000', 'last_change': '2024-05-30T16:50:00.203130+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.203130+0000', 'last_undegraded': '2024-05-30T16:50:00.203130+0000', 'last_fullsized': '2024-05-30T16:50:00.203130+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-05-30T16:50:06.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.211217+0000', 'last_change': '2024-05-30T16:50:01.211217+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.211217+0000', 'last_undegraded': '2024-05-30T16:50:01.211217+0000', 'last_fullsized': '2024-05-30T16:50:01.211217+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.196397+0000', 'last_change': '2024-05-30T16:50:00.196397+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.196397+0000', 'last_undegraded': '2024-05-30T16:50:00.196397+0000', 'last_fullsized': '2024-05-30T16:50:00.196397+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.191374+0000', 'last_change': '2024-05-30T16:50:00.191374+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.191374+0000', 'last_undegraded': '2024-05-30T16:50:00.191374+0000', 'last_fullsized': '2024-05-30T16:50:00.191374+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.205235+0000', 'last_change': '2024-05-30T16:50:01.205235+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.205235+0000', 'last_undegraded': '2024-05-30T16:50:01.205235+0000', 'last_fullsized': '2024-05-30T16:50:01.205235+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.200429+0000', 'last_change': '2024-05-30T16:50:00.200429+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.200429+0000', 'last_undegraded': '2024-05-30T16:50:00.200429+0000', 'last_fullsized': '2024-05-30T16:50:00.200429+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.187412+0000', 'last_change': '2024-05-30T16:50:00.187412+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.187412+0000', 'last_undegraded': '2024-05-30T16:50:00.187412+0000', 'last_fullsized': '2024-05-30T16:50:00.187412+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-05-30T16:50:06.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.191768+0000', 'last_change': '2024-05-30T16:50:00.191768+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.191768+0000', 'last_undegraded': '2024-05-30T16:50:00.191768+0000', 'last_fullsized': '2024-05-30T16:50:00.191768+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.211852+0000', 'last_change': '2024-05-30T16:50:01.211852+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.211852+0000', 'last_undegraded': '2024-05-30T16:50:01.211852+0000', 'last_fullsized': '2024-05-30T16:50:01.211852+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:PG 11.c is not active+clean 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.194115+0000', 'last_change': '2024-05-30T16:50:00.194115+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.194115+0000', 'last_undegraded': '2024-05-30T16:50:00.194115+0000', 'last_fullsized': '2024-05-30T16:50:00.194115+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.188938+0000', 'last_change': '2024-05-30T16:50:00.188938+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.188938+0000', 'last_undegraded': '2024-05-30T16:50:00.188938+0000', 'last_fullsized': '2024-05-30T16:50:00.188938+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.202455+0000', 'last_change': '2024-05-30T16:50:00.202455+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.202455+0000', 'last_undegraded': '2024-05-30T16:50:00.202455+0000', 'last_fullsized': '2024-05-30T16:50:00.202455+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.207240+0000', 'last_change': '2024-05-30T16:50:01.207240+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.207240+0000', 'last_undegraded': '2024-05-30T16:50:01.207240+0000', 'last_fullsized': '2024-05-30T16:50:01.207240+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-05-30T16:50:06.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 71, 'state': 'creating+activating', 'last_fresh': '2024-05-30T16:50:01.206709+0000', 'last_change': '2024-05-30T16:50:01.206709+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:01.206709+0000', 'last_undegraded': '2024-05-30T16:50:01.206709+0000', 'last_fullsized': '2024-05-30T16:50:01.206709+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T16:50:06.558 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-05-30T16:50:06.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.192880+0000', 'last_change': '2024-05-30T16:50:00.192880+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.192880+0000', 'last_undegraded': '2024-05-30T16:50:00.192880+0000', 'last_fullsized': '2024-05-30T16:50:00.192880+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T16:50:06.558 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-05-30T16:50:06.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.189514+0000', 'last_change': '2024-05-30T16:50:00.189514+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.189514+0000', 'last_undegraded': '2024-05-30T16:50:00.189514+0000', 'last_fullsized': '2024-05-30T16:50:00.189514+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:50:06.558 INFO:tasks.ceph.ceph_manager.ceph:PG 11.0 is not active+clean 2024-05-30T16:50:06.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.190938+0000', 'last_change': '2024-05-30T16:50:00.190938+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.190938+0000', 'last_undegraded': '2024-05-30T16:50:00.190938+0000', 'last_fullsized': '2024-05-30T16:50:00.190938+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T16:50:06.558 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1 is not active+clean 2024-05-30T16:50:06.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-05-30T16:50:00.187004+0000', 'last_change': '2024-05-30T16:50:00.187004+0000', 'last_active': '2024-05-30T16:50:00.160556+0000', 'last_peered': '2024-05-30T16:50:00.160556+0000', 'last_clean': '2024-05-30T16:50:00.160556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T16:50:00.187004+0000', 'last_undegraded': '2024-05-30T16:50:00.187004+0000', 'last_fullsized': '2024-05-30T16:50:00.187004+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'last_clean_scrub_stamp': '2024-05-30T16:50:00.160556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T16:50:06.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T16:50:06.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.787+0000 7ff5f1400640 1 Processor -- start 2024-05-30T16:50:06.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.788+0000 7ff5f1400640 1 -- start start 2024-05-30T16:50:06.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.789+0000 7ff5f1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5ec0cfbe0 0x7ff5ec169820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.789+0000 7ff5f1400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5ec15ed40 con 0x7ff5ec15e960 2024-05-30T16:50:06.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.789+0000 7ff5f1400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5ec162ca0 con 0x7ff5ec0ba090 2024-05-30T16:50:06.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.789+0000 7ff5f1400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5ec0d2b40 con 0x7ff5ec0cfbe0 2024-05-30T16:50:06.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.789+0000 7ff5ebe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff5ec15e960 0x7ff5ec162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58960/0 (socket says 172.21.15.144:58960) 2024-05-30T16:50:06.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.789+0000 7ff5ebe00640 1 -- 172.21.15.144:0/2385849378 learned_addr learned my addr 172.21.15.144:0/2385849378 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:06.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5f0a00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5ec0cfbe0 0x7ff5ec169820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807079286 0 0) 0x7ff5ec15ed40 con 0x7ff5ec15e960 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5d0003520 con 0x7ff5ec15e960 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1088260919 0 0) 0x7ff5d0003520 con 0x7ff5ec15e960 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5ec0cfbe0 msgr2=0x7ff5ec169820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5ec0cfbe0 0x7ff5ec169820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 >> v1:172.21.15.149:6789/0 conn(0x7ff5ec0ba090 legacy=0x7ff5ec0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ec162f80 con 0x7ff5ec15e960 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7ff5dc001670 con 0x7ff5ec15e960 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5f0a00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5ec0cfbe0 0x7ff5ec169820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 >> v1:172.21.15.144:6789/0 conn(0x7ff5ec15e960 legacy=0x7ff5ec162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5ec0cfbe0 0x7ff5d00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d0003fd0 0x7ff5d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5d0004d40 0x7ff5d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec0d2b40 con 0x7ff5d0004d40 2024-05-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d000bb20 con 0x7ff5d0003fd0 2024-05-30T16:50:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.790+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d000bd20 con 0x7ff5ec0cfbe0 2024-05-30T16:50:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.791+0000 7ff5f0a00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5d0004d40 0x7ff5d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.791+0000 7ff5ebe00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5ec0cfbe0 0x7ff5d00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.791+0000 7ff5eb400640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d0003fd0 0x7ff5d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.791+0000 7ff5f0a00640 1 -- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5ec0cfbe0 msgr2=0x7ff5d00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.791+0000 7ff5f0a00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5ec0cfbe0 0x7ff5d00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.791+0000 7ff5f0a00640 1 -- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d0003fd0 msgr2=0x7ff5d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.791+0000 7ff5f0a00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d0003fd0 0x7ff5d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.791+0000 7ff5f0a00640 1 -- 172.21.15.144:0/2385849378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d0003520 con 0x7ff5d0004d40 2024-05-30T16:50:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.792+0000 7ff5f0a00640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5d0004d40 0x7ff5d00051c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40073b0 tx=0x7ff5d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38d01e18ebbb50c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.792+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4009c80 con 0x7ff5d0004d40 2024-05-30T16:50:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.793+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e402e620 con 0x7ff5d0004d40 2024-05-30T16:50:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.793+0000 7ff5eaa00640 1 -- 172.21.15.144:0/2385849378 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e402e9d0 con 0x7ff5d0004d40 2024-05-30T16:50:06.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.793+0000 7ff5f1400640 1 -- 172.21.15.144:0/2385849378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5d0004d40 msgr2=0x7ff5d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.793+0000 7ff5f1400640 1 --2- 172.21.15.144:0/2385849378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5d0004d40 0x7ff5d00051c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40073b0 tx=0x7ff5d0005830 comp rx=0 tx=0).stop 2024-05-30T16:50:06.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.793+0000 7ff5f0a00640 1 -- 172.21.15.144:0/2385849378 reap_dead start 2024-05-30T16:50:06.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.793+0000 7ff5f1400640 1 -- 172.21.15.144:0/2385849378 shutdown_connections 2024-05-30T16:50:06.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.793+0000 7ff5f1400640 1 -- 172.21.15.144:0/2385849378 >> 172.21.15.144:0/2385849378 conn(0x7ff5ec0d1360 msgr2=0x7ff5ec0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:06.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.793+0000 7ff5f1400640 1 -- 172.21.15.144:0/2385849378 shutdown_connections 2024-05-30T16:50:06.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.793+0000 7ff5f1400640 1 -- 172.21.15.144:0/2385849378 wait complete. 2024-05-30T16:50:06.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.795+0000 7ff5f1400640 1 Processor -- start 2024-05-30T16:50:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.795+0000 7ff5f1400640 1 -- start start 2024-05-30T16:50:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.796+0000 7ff5f1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d0004d40 0x7ff5ec0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.796+0000 7ff5f1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5ec0cb7d0 0x7ff5ec0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.796+0000 7ff5f1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5ec0cd800 0x7ff5ec1f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.796+0000 7ff5f1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec0b78a0 con 0x7ff5ec0cd800 2024-05-30T16:50:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.796+0000 7ff5f1400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec0d2d90 con 0x7ff5ec0cb7d0 2024-05-30T16:50:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.796+0000 7ff5f1400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5ec0d42c0 con 0x7ff5d0004d40 2024-05-30T16:50:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.796+0000 7ff5f0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5ec0cd800 0x7ff5ec1f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.796+0000 7ff5f0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5ec0cd800 0x7ff5ec1f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43030/0 (socket says 172.21.15.144:43030) 2024-05-30T16:50:06.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.796+0000 7ff5f0a00640 1 -- 172.21.15.144:0/1722279401 learned_addr learned my addr 172.21.15.144:0/1722279401 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5ebe00640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d0004d40 0x7ff5ec0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5eb400640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5ec0cb7d0 0x7ff5ec0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5f0a00640 1 -- 172.21.15.144:0/1722279401 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d0004d40 msgr2=0x7ff5ec0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5f0a00640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d0004d40 0x7ff5ec0ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5f0a00640 1 -- 172.21.15.144:0/1722279401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5ec0cb7d0 msgr2=0x7ff5ec0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5f0a00640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5ec0cb7d0 0x7ff5ec0cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5f0a00640 1 -- 172.21.15.144:0/1722279401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ec0cc220 con 0x7ff5ec0cd800 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5eb400640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5ec0cb7d0 0x7ff5ec0cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5f0a00640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5ec0cd800 0x7ff5ec1f47f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40073b0 tx=0x7ff5e4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5e3e00640 1 -- 172.21.15.144:0/1722279401 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4009c80 con 0x7ff5ec0cd800 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5e3e00640 1 -- 172.21.15.144:0/1722279401 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e402e420 con 0x7ff5ec0cd800 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5e3e00640 1 -- 172.21.15.144:0/1722279401 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4038280 con 0x7ff5ec0cd800 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.797+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ec0cc500 con 0x7ff5ec0cd800 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.798+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ec0ccac0 con 0x7ff5ec0cd800 2024-05-30T16:50:06.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.799+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5ec075570 con 0x7ff5ec0cd800 2024-05-30T16:50:06.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.800+0000 7ff5e3e00640 1 -- 172.21.15.144:0/1722279401 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7ff5e4038650 con 0x7ff5ec0cd800 2024-05-30T16:50:06.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.801+0000 7ff5e3e00640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5c806d5e0 0x7ff5c806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:06.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.801+0000 7ff5e3e00640 1 -- 172.21.15.144:0/1722279401 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7ff5e40aaa00 con 0x7ff5ec0cd800 2024-05-30T16:50:06.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.801+0000 7ff5ebe00640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5c806d5e0 0x7ff5c806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:06.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.802+0000 7ff5ebe00640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5c806d5e0 0x7ff5c806faa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc001200 tx=0x7ff5dc001150 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:06.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:06.805+0000 7ff5e3e00640 1 -- 172.21.15.144:0/1722279401 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5e4032030 con 0x7ff5ec0cd800 2024-05-30T16:50:07.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.069+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff5ec06c920 con 0x7ff5ec0cd800 2024-05-30T16:50:07.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.069+0000 7ff5e3e00640 1 -- 172.21.15.144:0/1722279401 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1145 (secure 0 0 0) 0x7ff5e407a8e0 con 0x7ff5ec0cd800 2024-05-30T16:50:07.071 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:07.071 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":519,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":72,"num_osds":8,"num_up_osds":8,"osd_up_since":1717087300,"num_in_osds":8,"osd_in_since":1717087291,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":46},{"state_name":"creating+peering","count":40},{"state_name":"creating+activating","count":11}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590458,"bytes_used":458149888,"bytes_avail":772635963392,"bytes_total":773094113280,"inactive_pgs_ratio":0.52577316761016846,"write_bytes_sec":171,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":45,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6447}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-05-30T16:49:05.097167+0000","services":{}},"progress_events":{}} 2024-05-30T16:50:07.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5c806d5e0 msgr2=0x7ff5c806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5c806d5e0 0x7ff5c806faa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc001200 tx=0x7ff5dc001150 comp rx=0 tx=0).stop 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5ec0cd800 msgr2=0x7ff5ec1f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5ec0cd800 0x7ff5ec1f47f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40073b0 tx=0x7ff5e4004ab0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 shutdown_connections 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5c806d5e0 0x7ff5c806faa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5ec0cd800 0x7ff5ec1f47f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5ec0cb7d0 0x7ff5ec0cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 --2- 172.21.15.144:0/1722279401 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d0004d40 0x7ff5ec0ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 >> 172.21.15.144:0/1722279401 conn(0x7ff5ec0d1360 msgr2=0x7ff5ec0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 shutdown_connections 2024-05-30T16:50:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.072+0000 7ff5f1400640 1 -- 172.21.15.144:0/1722279401 wait complete. 2024-05-30T16:50:07.092 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-30T16:50:07.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:50:07.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.292+0000 7f23c2200640 1 Processor -- start 2024-05-30T16:50:07.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.292+0000 7f23c2200640 1 -- start start 2024-05-30T16:50:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.293+0000 7f23c2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23bc0caf10 0x7f23bc15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.293+0000 7f23c2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f23bc0cf8b0 0x7f23bc0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.293+0000 7f23c2200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc15f500 con 0x7f23bc0cb2f0 2024-05-30T16:50:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.293+0000 7f23c2200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f23bc15f780 con 0x7f23bc0cf8b0 2024-05-30T16:50:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.293+0000 7f23c2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc15fa60 con 0x7f23bc0caf10 2024-05-30T16:50:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.293+0000 7f23c1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f23bc0cf8b0 0x7f23bc0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.293+0000 7f23c1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f23bc0cf8b0 0x7f23bc0b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43046/0 (socket says 172.21.15.144:43046) 2024-05-30T16:50:07.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.293+0000 7f23c1800640 1 -- 172.21.15.144:0/2574405468 learned_addr learned my addr 172.21.15.144:0/2574405468 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:07.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.294+0000 7f23c0e00640 1 --2- 172.21.15.144:0/2574405468 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23bc0caf10 0x7f23bc15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:07.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.294+0000 7f23c1800640 1 -- 172.21.15.144:0/2574405468 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23bc0caf10 msgr2=0x7f23bc15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:07.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.294+0000 7f23c1800640 1 --2- 172.21.15.144:0/2574405468 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23bc0caf10 0x7f23bc15efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.294+0000 7f23c1800640 1 -- 172.21.15.144:0/2574405468 >> v1:172.21.15.149:6789/0 conn(0x7f23bc0cb2f0 legacy=0x7f23bc15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:07.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.294+0000 7f23c1800640 1 -- 172.21.15.144:0/2574405468 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc15fd40 con 0x7f23bc0cf8b0 2024-05-30T16:50:07.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.295+0000 7f23c1800640 1 --2- 172.21.15.144:0/2574405468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0cf8b0 0x7f23bc0b31c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f23b400d150 tx=0x7f23b402c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe8fb9dd21dfb6d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:07.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.295+0000 7f23bbe00640 1 -- 172.21.15.144:0/2574405468 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b400b2e0 con 0x7f23bc0cf8b0 2024-05-30T16:50:07.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.295+0000 7f23bbe00640 1 -- 172.21.15.144:0/2574405468 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b4009600 con 0x7f23bc0cf8b0 2024-05-30T16:50:07.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.295+0000 7f23bbe00640 1 -- 172.21.15.144:0/2574405468 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b400b480 con 0x7f23bc0cf8b0 2024-05-30T16:50:07.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.296+0000 7f23c2200640 1 -- 172.21.15.144:0/2574405468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0cf8b0 msgr2=0x7f23bc0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:07.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.296+0000 7f23c2200640 1 --2- 172.21.15.144:0/2574405468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0cf8b0 0x7f23bc0b31c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f23b400d150 tx=0x7f23b402c8e0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.296+0000 7f23c2200640 1 -- 172.21.15.144:0/2574405468 shutdown_connections 2024-05-30T16:50:07.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.296+0000 7f23c2200640 1 --2- 172.21.15.144:0/2574405468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0cf8b0 0x7f23bc0b31c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.296+0000 7f23c2200640 1 --2- 172.21.15.144:0/2574405468 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23bc0caf10 0x7f23bc15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.296+0000 7f23c2200640 1 -- 172.21.15.144:0/2574405468 >> 172.21.15.144:0/2574405468 conn(0x7f23bc0b20a0 msgr2=0x7f23bc0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:07.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.296+0000 7f23c2200640 1 -- 172.21.15.144:0/2574405468 shutdown_connections 2024-05-30T16:50:07.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.296+0000 7f23c2200640 1 -- 172.21.15.144:0/2574405468 wait complete. 2024-05-30T16:50:07.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.298+0000 7f23c2200640 1 Processor -- start 2024-05-30T16:50:07.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.298+0000 7f23c2200640 1 -- start start 2024-05-30T16:50:07.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0caf10 0x7f23bc15e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:07.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23bc0cb2f0 0x7f23bc14e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:07.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23bc0cf8b0 0x7f23bc14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:07.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c2200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc15bad0 con 0x7f23bc0caf10 2024-05-30T16:50:07.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc15b950 con 0x7f23bc0cb2f0 2024-05-30T16:50:07.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc0b3700 con 0x7f23bc0cf8b0 2024-05-30T16:50:07.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0caf10 0x7f23bc15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0caf10 0x7f23bc15e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43054/0 (socket says 172.21.15.144:43054) 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c0e00640 1 -- 172.21.15.144:0/1711838164 learned_addr learned my addr 172.21.15.144:0/1711838164 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c0e00640 1 -- 172.21.15.144:0/1711838164 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23bc0cf8b0 msgr2=0x7f23bc14e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c0e00640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23bc0cf8b0 0x7f23bc14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c0e00640 1 -- 172.21.15.144:0/1711838164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23bc0cb2f0 msgr2=0x7f23bc14e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c0e00640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23bc0cb2f0 0x7f23bc14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.299+0000 7f23c0e00640 1 -- 172.21.15.144:0/1711838164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc09e2d0 con 0x7f23bc0caf10 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.300+0000 7f23c0e00640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0caf10 0x7f23bc15e240 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f23a400c7f0 tx=0x7f23a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.300+0000 7f23b9600640 1 -- 172.21.15.144:0/1711838164 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4015070 con 0x7f23bc0caf10 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.300+0000 7f23b9600640 1 -- 172.21.15.144:0/1711838164 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a4004240 con 0x7f23bc0caf10 2024-05-30T16:50:07.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.300+0000 7f23b9600640 1 -- 172.21.15.144:0/1711838164 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4007620 con 0x7f23bc0caf10 2024-05-30T16:50:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.300+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc09dff0 con 0x7f23bc0caf10 2024-05-30T16:50:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.300+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc0ada40 con 0x7f23bc0caf10 2024-05-30T16:50:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.301+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23bc06fcf0 con 0x7f23bc0caf10 2024-05-30T16:50:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.302+0000 7f23b9600640 1 -- 172.21.15.144:0/1711838164 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f23a40079d0 con 0x7f23bc0caf10 2024-05-30T16:50:07.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.303+0000 7f23b9600640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f239806d5e0 0x7f239806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:07.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.303+0000 7f23b9600640 1 -- 172.21.15.144:0/1711838164 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f23a408acf0 con 0x7f23bc0caf10 2024-05-30T16:50:07.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.303+0000 7f23b3e00640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f239806d5e0 0x7f239806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:07.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.304+0000 7f23b3e00640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f239806d5e0 0x7f239806faa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f23bc155ef0 tx=0x7f23ac0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:07.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.307+0000 7f23b9600640 1 -- 172.21.15.144:0/1711838164 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23bc06fcf0 con 0x7f23bc0caf10 2024-05-30T16:50:07.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.503+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23bc073f40 con 0x7f239806d5e0 2024-05-30T16:50:07.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.511+0000 7f23b9600640 1 -- 172.21.15.144:0/1711838164 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f23bc073f40 con 0x7f239806d5e0 2024-05-30T16:50:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:50:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f239806d5e0 msgr2=0x7f239806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f239806d5e0 0x7f239806faa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f23bc155ef0 tx=0x7f23ac0079b0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0caf10 msgr2=0x7f23bc15e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0caf10 0x7f23bc15e240 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f23a400c7f0 tx=0x7f23a400ccb0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 shutdown_connections 2024-05-30T16:50:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f239806d5e0 0x7f239806faa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23bc0cf8b0 0x7f23bc14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23bc0cb2f0 0x7f23bc14e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 --2- 172.21.15.144:0/1711838164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23bc0caf10 0x7f23bc15e240 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 >> 172.21.15.144:0/1711838164 conn(0x7f23bc0b20a0 msgr2=0x7f23bc0cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 shutdown_connections 2024-05-30T16:50:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:07.516+0000 7f23c2200640 1 -- 172.21.15.144:0/1711838164 wait complete. 2024-05-30T16:50:07.536 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-05-30T16:50:07.119127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":447668,"kb_used_data":8072,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754527052,"statfs":{"total":773094113280,"available":772635701248,"internally_reserved":0,"allocated":8265728,"data_stored":4172332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":450022963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.939124"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526798+0000","last_change":"2024-05-30T16:50:01.226270+0000","last_active":"2024-05-30T16:50:03.526798+0000","last_peered":"2024-05-30T16:50:03.526798+0000","last_clean":"2024-05-30T16:50:03.526798+0000","last_became_active":"2024-05-30T16:50:01.225529+0000","last_became_peered":"2024-05-30T16:50:01.225529+0000","last_unstale":"2024-05-30T16:50:03.526798+0000","last_undegraded":"2024-05-30T16:50:03.526798+0000","last_fullsized":"2024-05-30T16:50:03.526798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221361+0000","last_change":"2024-05-30T16:50:01.205668+0000","last_active":"2024-05-30T16:50:02.221361+0000","last_peered":"2024-05-30T16:50:02.221361+0000","last_clean":"2024-05-30T16:50:02.221361+0000","last_became_active":"2024-05-30T16:50:01.205240+0000","last_became_peered":"2024-05-30T16:50:01.205240+0000","last_unstale":"2024-05-30T16:50:02.221361+0000","last_undegraded":"2024-05-30T16:50:02.221361+0000","last_fullsized":"2024-05-30T16:50:02.221361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264419+0000","last_change":"2024-05-30T16:50:01.216644+0000","last_active":"2024-05-30T16:50:03.264419+0000","last_peered":"2024-05-30T16:50:03.264419+0000","last_clean":"2024-05-30T16:50:03.264419+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:50:03.264419+0000","last_undegraded":"2024-05-30T16:50:03.264419+0000","last_fullsized":"2024-05-30T16:50:03.264419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:38.132245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219494+0000","last_change":"2024-05-30T16:50:01.208510+0000","last_active":"2024-05-30T16:50:02.219494+0000","last_peered":"2024-05-30T16:50:02.219494+0000","last_clean":"2024-05-30T16:50:02.219494+0000","last_became_active":"2024-05-30T16:50:01.207604+0000","last_became_peered":"2024-05-30T16:50:01.207604+0000","last_unstale":"2024-05-30T16:50:02.219494+0000","last_undegraded":"2024-05-30T16:50:02.219494+0000","last_fullsized":"2024-05-30T16:50:02.219494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:10.540613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524583+0000","last_change":"2024-05-30T16:50:01.220341+0000","last_active":"2024-05-30T16:50:03.524583+0000","last_peered":"2024-05-30T16:50:03.524583+0000","last_clean":"2024-05-30T16:50:03.524583+0000","last_became_active":"2024-05-30T16:50:01.219925+0000","last_became_peered":"2024-05-30T16:50:01.219925+0000","last_unstale":"2024-05-30T16:50:03.524583+0000","last_undegraded":"2024-05-30T16:50:03.524583+0000","last_fullsized":"2024-05-30T16:50:03.524583+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:48.744105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220086+0000","last_change":"2024-05-30T16:50:01.205902+0000","last_active":"2024-05-30T16:50:02.220086+0000","last_peered":"2024-05-30T16:50:02.220086+0000","last_clean":"2024-05-30T16:50:02.220086+0000","last_became_active":"2024-05-30T16:50:01.205620+0000","last_became_peered":"2024-05-30T16:50:01.205620+0000","last_unstale":"2024-05-30T16:50:02.220086+0000","last_undegraded":"2024-05-30T16:50:02.220086+0000","last_fullsized":"2024-05-30T16:50:02.220086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227753+0000","last_change":"2024-05-30T16:50:01.221623+0000","last_active":"2024-05-30T16:50:02.227753+0000","last_peered":"2024-05-30T16:50:02.227753+0000","last_clean":"2024-05-30T16:50:02.227753+0000","last_became_active":"2024-05-30T16:50:01.215828+0000","last_became_peered":"2024-05-30T16:50:01.215828+0000","last_unstale":"2024-05-30T16:50:02.227753+0000","last_undegraded":"2024-05-30T16:50:02.227753+0000","last_fullsized":"2024-05-30T16:50:02.227753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219457+0000","last_change":"2024-05-30T16:50:01.211114+0000","last_active":"2024-05-30T16:50:02.219457+0000","last_peered":"2024-05-30T16:50:02.219457+0000","last_clean":"2024-05-30T16:50:02.219457+0000","last_became_active":"2024-05-30T16:50:01.210863+0000","last_became_peered":"2024-05-30T16:50:01.210863+0000","last_unstale":"2024-05-30T16:50:02.219457+0000","last_undegraded":"2024-05-30T16:50:02.219457+0000","last_fullsized":"2024-05-30T16:50:02.219457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:22.258204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525028+0000","last_change":"2024-05-30T16:50:01.214939+0000","last_active":"2024-05-30T16:50:03.525028+0000","last_peered":"2024-05-30T16:50:03.525028+0000","last_clean":"2024-05-30T16:50:03.525028+0000","last_became_active":"2024-05-30T16:50:01.214609+0000","last_became_peered":"2024-05-30T16:50:01.214609+0000","last_unstale":"2024-05-30T16:50:03.525028+0000","last_undegraded":"2024-05-30T16:50:03.525028+0000","last_fullsized":"2024-05-30T16:50:03.525028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:09.411468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218884+0000","last_change":"2024-05-30T16:50:01.217788+0000","last_active":"2024-05-30T16:50:02.218884+0000","last_peered":"2024-05-30T16:50:02.218884+0000","last_clean":"2024-05-30T16:50:02.218884+0000","last_became_active":"2024-05-30T16:50:01.217506+0000","last_became_peered":"2024-05-30T16:50:01.217506+0000","last_unstale":"2024-05-30T16:50:02.218884+0000","last_undegraded":"2024-05-30T16:50:02.218884+0000","last_fullsized":"2024-05-30T16:50:02.218884+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526619+0000","last_change":"2024-05-30T16:50:01.218948+0000","last_active":"2024-05-30T16:50:03.526619+0000","last_peered":"2024-05-30T16:50:03.526619+0000","last_clean":"2024-05-30T16:50:03.526619+0000","last_became_active":"2024-05-30T16:50:01.218645+0000","last_became_peered":"2024-05-30T16:50:01.218645+0000","last_unstale":"2024-05-30T16:50:03.526619+0000","last_undegraded":"2024-05-30T16:50:03.526619+0000","last_fullsized":"2024-05-30T16:50:03.526619+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:16.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219768+0000","last_change":"2024-05-30T16:50:01.217317+0000","last_active":"2024-05-30T16:50:02.219768+0000","last_peered":"2024-05-30T16:50:02.219768+0000","last_clean":"2024-05-30T16:50:02.219768+0000","last_became_active":"2024-05-30T16:50:01.217020+0000","last_became_peered":"2024-05-30T16:50:01.217020+0000","last_unstale":"2024-05-30T16:50:02.219768+0000","last_undegraded":"2024-05-30T16:50:02.219768+0000","last_fullsized":"2024-05-30T16:50:02.219768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:31.180902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231640+0000","last_change":"2024-05-30T16:50:01.213490+0000","last_active":"2024-05-30T16:50:02.231640+0000","last_peered":"2024-05-30T16:50:02.231640+0000","last_clean":"2024-05-30T16:50:02.231640+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:50:02.231640+0000","last_undegraded":"2024-05-30T16:50:02.231640+0000","last_fullsized":"2024-05-30T16:50:02.231640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524590+0000","last_change":"2024-05-30T16:50:01.229142+0000","last_active":"2024-05-30T16:50:03.524590+0000","last_peered":"2024-05-30T16:50:03.524590+0000","last_clean":"2024-05-30T16:50:03.524590+0000","last_became_active":"2024-05-30T16:50:01.228163+0000","last_became_peered":"2024-05-30T16:50:01.228163+0000","last_unstale":"2024-05-30T16:50:03.524590+0000","last_undegraded":"2024-05-30T16:50:03.524590+0000","last_fullsized":"2024-05-30T16:50:03.524590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:57:34.230448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231337+0000","last_change":"2024-05-30T16:50:01.213697+0000","last_active":"2024-05-30T16:50:02.231337+0000","last_peered":"2024-05-30T16:50:02.231337+0000","last_clean":"2024-05-30T16:50:02.231337+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:50:02.231337+0000","last_undegraded":"2024-05-30T16:50:02.231337+0000","last_fullsized":"2024-05-30T16:50:02.231337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.217790+0000","last_change":"2024-05-30T16:50:01.215568+0000","last_active":"2024-05-30T16:50:02.217790+0000","last_peered":"2024-05-30T16:50:02.217790+0000","last_clean":"2024-05-30T16:50:02.217790+0000","last_became_active":"2024-05-30T16:50:01.208926+0000","last_became_peered":"2024-05-30T16:50:01.208926+0000","last_unstale":"2024-05-30T16:50:02.217790+0000","last_undegraded":"2024-05-30T16:50:02.217790+0000","last_fullsized":"2024-05-30T16:50:02.217790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525149+0000","last_change":"2024-05-30T16:50:01.215004+0000","last_active":"2024-05-30T16:50:03.525149+0000","last_peered":"2024-05-30T16:50:03.525149+0000","last_clean":"2024-05-30T16:50:03.525149+0000","last_became_active":"2024-05-30T16:50:01.211267+0000","last_became_peered":"2024-05-30T16:50:01.211267+0000","last_unstale":"2024-05-30T16:50:03.525149+0000","last_undegraded":"2024-05-30T16:50:03.525149+0000","last_fullsized":"2024-05-30T16:50:03.525149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:11.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219706+0000","last_change":"2024-05-30T16:50:01.209168+0000","last_active":"2024-05-30T16:50:02.219706+0000","last_peered":"2024-05-30T16:50:02.219706+0000","last_clean":"2024-05-30T16:50:02.219706+0000","last_became_active":"2024-05-30T16:50:01.207616+0000","last_became_peered":"2024-05-30T16:50:01.207616+0000","last_unstale":"2024-05-30T16:50:02.219706+0000","last_undegraded":"2024-05-30T16:50:02.219706+0000","last_fullsized":"2024-05-30T16:50:02.219706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:09.382187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221190+0000","last_change":"2024-05-30T16:50:01.213913+0000","last_active":"2024-05-30T16:50:02.221190+0000","last_peered":"2024-05-30T16:50:02.221190+0000","last_clean":"2024-05-30T16:50:02.221190+0000","last_became_active":"2024-05-30T16:50:01.213651+0000","last_became_peered":"2024-05-30T16:50:01.213651+0000","last_unstale":"2024-05-30T16:50:02.221190+0000","last_undegraded":"2024-05-30T16:50:02.221190+0000","last_fullsized":"2024-05-30T16:50:02.221190+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231751+0000","last_change":"2024-05-30T16:50:01.223666+0000","last_active":"2024-05-30T16:50:02.231751+0000","last_peered":"2024-05-30T16:50:02.231751+0000","last_clean":"2024-05-30T16:50:02.231751+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:50:02.231751+0000","last_undegraded":"2024-05-30T16:50:02.231751+0000","last_fullsized":"2024-05-30T16:50:02.231751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218151+0000","last_change":"2024-05-30T16:50:01.209725+0000","last_active":"2024-05-30T16:50:02.218151+0000","last_peered":"2024-05-30T16:50:02.218151+0000","last_clean":"2024-05-30T16:50:02.218151+0000","last_became_active":"2024-05-30T16:50:01.209453+0000","last_became_peered":"2024-05-30T16:50:01.209453+0000","last_unstale":"2024-05-30T16:50:02.218151+0000","last_undegraded":"2024-05-30T16:50:02.218151+0000","last_fullsized":"2024-05-30T16:50:02.218151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.217764+0000","last_change":"2024-05-30T16:50:01.217106+0000","last_active":"2024-05-30T16:50:02.217764+0000","last_peered":"2024-05-30T16:50:02.217764+0000","last_clean":"2024-05-30T16:50:02.217764+0000","last_became_active":"2024-05-30T16:50:01.216565+0000","last_became_peered":"2024-05-30T16:50:01.216565+0000","last_unstale":"2024-05-30T16:50:02.217764+0000","last_undegraded":"2024-05-30T16:50:02.217764+0000","last_fullsized":"2024-05-30T16:50:02.217764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526226+0000","last_change":"2024-05-30T16:50:01.230645+0000","last_active":"2024-05-30T16:50:03.526226+0000","last_peered":"2024-05-30T16:50:03.526226+0000","last_clean":"2024-05-30T16:50:03.526226+0000","last_became_active":"2024-05-30T16:50:01.230326+0000","last_became_peered":"2024-05-30T16:50:01.230326+0000","last_unstale":"2024-05-30T16:50:03.526226+0000","last_undegraded":"2024-05-30T16:50:03.526226+0000","last_fullsized":"2024-05-30T16:50:03.526226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:34.972283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525803+0000","last_change":"2024-05-30T16:50:01.222411+0000","last_active":"2024-05-30T16:50:03.525803+0000","last_peered":"2024-05-30T16:50:03.525803+0000","last_clean":"2024-05-30T16:50:03.525803+0000","last_became_active":"2024-05-30T16:50:01.221747+0000","last_became_peered":"2024-05-30T16:50:01.221747+0000","last_unstale":"2024-05-30T16:50:03.525803+0000","last_undegraded":"2024-05-30T16:50:03.525803+0000","last_fullsized":"2024-05-30T16:50:03.525803+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:31:09.263732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219365+0000","last_change":"2024-05-30T16:50:01.225335+0000","last_active":"2024-05-30T16:50:02.219365+0000","last_peered":"2024-05-30T16:50:02.219365+0000","last_clean":"2024-05-30T16:50:02.219365+0000","last_became_active":"2024-05-30T16:50:01.224947+0000","last_became_peered":"2024-05-30T16:50:01.224947+0000","last_unstale":"2024-05-30T16:50:02.219365+0000","last_undegraded":"2024-05-30T16:50:02.219365+0000","last_fullsized":"2024-05-30T16:50:02.219365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227676+0000","last_change":"2024-05-30T16:50:01.223725+0000","last_active":"2024-05-30T16:50:02.227676+0000","last_peered":"2024-05-30T16:50:02.227676+0000","last_clean":"2024-05-30T16:50:02.227676+0000","last_became_active":"2024-05-30T16:50:01.223128+0000","last_became_peered":"2024-05-30T16:50:01.223128+0000","last_unstale":"2024-05-30T16:50:02.227676+0000","last_undegraded":"2024-05-30T16:50:02.227676+0000","last_fullsized":"2024-05-30T16:50:02.227676+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:16:28.027255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264270+0000","last_change":"2024-05-30T16:50:01.221359+0000","last_active":"2024-05-30T16:50:03.264270+0000","last_peered":"2024-05-30T16:50:03.264270+0000","last_clean":"2024-05-30T16:50:03.264270+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:50:03.264270+0000","last_undegraded":"2024-05-30T16:50:03.264270+0000","last_fullsized":"2024-05-30T16:50:03.264270+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218269+0000","last_change":"2024-05-30T16:50:01.217815+0000","last_active":"2024-05-30T16:50:02.218269+0000","last_peered":"2024-05-30T16:50:02.218269+0000","last_clean":"2024-05-30T16:50:02.218269+0000","last_became_active":"2024-05-30T16:50:01.217568+0000","last_became_peered":"2024-05-30T16:50:01.217568+0000","last_unstale":"2024-05-30T16:50:02.218269+0000","last_undegraded":"2024-05-30T16:50:02.218269+0000","last_fullsized":"2024-05-30T16:50:02.218269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264318+0000","last_change":"2024-05-30T16:50:01.225500+0000","last_active":"2024-05-30T16:50:03.264318+0000","last_peered":"2024-05-30T16:50:03.264318+0000","last_clean":"2024-05-30T16:50:03.264318+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:50:03.264318+0000","last_undegraded":"2024-05-30T16:50:03.264318+0000","last_fullsized":"2024-05-30T16:50:03.264318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:24.044660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.228029+0000","last_change":"2024-05-30T16:50:01.227853+0000","last_active":"2024-05-30T16:50:02.228029+0000","last_peered":"2024-05-30T16:50:02.228029+0000","last_clean":"2024-05-30T16:50:02.228029+0000","last_became_active":"2024-05-30T16:50:01.227538+0000","last_became_peered":"2024-05-30T16:50:01.227538+0000","last_unstale":"2024-05-30T16:50:02.228029+0000","last_undegraded":"2024-05-30T16:50:02.228029+0000","last_fullsized":"2024-05-30T16:50:02.228029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.228128+0000","last_change":"2024-05-30T16:50:01.216098+0000","last_active":"2024-05-30T16:50:02.228128+0000","last_peered":"2024-05-30T16:50:02.228128+0000","last_clean":"2024-05-30T16:50:02.228128+0000","last_became_active":"2024-05-30T16:50:01.215541+0000","last_became_peered":"2024-05-30T16:50:01.215541+0000","last_unstale":"2024-05-30T16:50:02.228128+0000","last_undegraded":"2024-05-30T16:50:02.228128+0000","last_fullsized":"2024-05-30T16:50:02.228128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219877+0000","last_change":"2024-05-30T16:50:01.213699+0000","last_active":"2024-05-30T16:50:02.219877+0000","last_peered":"2024-05-30T16:50:02.219877+0000","last_clean":"2024-05-30T16:50:02.219877+0000","last_became_active":"2024-05-30T16:50:01.212747+0000","last_became_peered":"2024-05-30T16:50:01.212747+0000","last_unstale":"2024-05-30T16:50:02.219877+0000","last_undegraded":"2024-05-30T16:50:02.219877+0000","last_fullsized":"2024-05-30T16:50:02.219877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526746+0000","last_change":"2024-05-30T16:50:01.222131+0000","last_active":"2024-05-30T16:50:03.526746+0000","last_peered":"2024-05-30T16:50:03.526746+0000","last_clean":"2024-05-30T16:50:03.526746+0000","last_became_active":"2024-05-30T16:50:01.221781+0000","last_became_peered":"2024-05-30T16:50:01.221781+0000","last_unstale":"2024-05-30T16:50:03.526746+0000","last_undegraded":"2024-05-30T16:50:03.526746+0000","last_fullsized":"2024-05-30T16:50:03.526746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:54.069608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.527210+0000","last_change":"2024-05-30T16:50:00.205578+0000","last_active":"2024-05-30T16:50:03.527210+0000","last_peered":"2024-05-30T16:50:03.527210+0000","last_clean":"2024-05-30T16:50:03.527210+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:50:03.527210+0000","last_undegraded":"2024-05-30T16:50:03.527210+0000","last_fullsized":"2024-05-30T16:50:03.527210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:09.041453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525413+0000","last_change":"2024-05-30T16:50:01.208407+0000","last_active":"2024-05-30T16:50:03.525413+0000","last_peered":"2024-05-30T16:50:03.525413+0000","last_clean":"2024-05-30T16:50:03.525413+0000","last_became_active":"2024-05-30T16:50:01.208076+0000","last_became_peered":"2024-05-30T16:50:01.208076+0000","last_unstale":"2024-05-30T16:50:03.525413+0000","last_undegraded":"2024-05-30T16:50:03.525413+0000","last_fullsized":"2024-05-30T16:50:03.525413+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:06.445701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231882+0000","last_change":"2024-05-30T16:50:00.198543+0000","last_active":"2024-05-30T16:50:02.231882+0000","last_peered":"2024-05-30T16:50:02.231882+0000","last_clean":"2024-05-30T16:50:02.231882+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:50:02.231882+0000","last_undegraded":"2024-05-30T16:50:02.231882+0000","last_fullsized":"2024-05-30T16:50:02.231882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:06.670117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220837+0000","last_change":"2024-05-30T16:50:01.223695+0000","last_active":"2024-05-30T16:50:02.220837+0000","last_peered":"2024-05-30T16:50:02.220837+0000","last_clean":"2024-05-30T16:50:02.220837+0000","last_became_active":"2024-05-30T16:50:01.223375+0000","last_became_peered":"2024-05-30T16:50:01.223375+0000","last_unstale":"2024-05-30T16:50:02.220837+0000","last_undegraded":"2024-05-30T16:50:02.220837+0000","last_fullsized":"2024-05-30T16:50:02.220837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218620+0000","last_change":"2024-05-30T16:50:00.212444+0000","last_active":"2024-05-30T16:50:02.218620+0000","last_peered":"2024-05-30T16:50:02.218620+0000","last_clean":"2024-05-30T16:50:02.218620+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:50:02.218620+0000","last_undegraded":"2024-05-30T16:50:02.218620+0000","last_fullsized":"2024-05-30T16:50:02.218620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526779+0000","last_change":"2024-05-30T16:50:01.219674+0000","last_active":"2024-05-30T16:50:03.526779+0000","last_peered":"2024-05-30T16:50:03.526779+0000","last_clean":"2024-05-30T16:50:03.526779+0000","last_became_active":"2024-05-30T16:50:01.219382+0000","last_became_peered":"2024-05-30T16:50:01.219382+0000","last_unstale":"2024-05-30T16:50:03.526779+0000","last_undegraded":"2024-05-30T16:50:03.526779+0000","last_fullsized":"2024-05-30T16:50:03.526779+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220933+0000","last_change":"2024-05-30T16:50:00.210174+0000","last_active":"2024-05-30T16:50:02.220933+0000","last_peered":"2024-05-30T16:50:02.220933+0000","last_clean":"2024-05-30T16:50:02.220933+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:50:02.220933+0000","last_undegraded":"2024-05-30T16:50:02.220933+0000","last_fullsized":"2024-05-30T16:50:02.220933+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227728+0000","last_change":"2024-05-30T16:50:01.228355+0000","last_active":"2024-05-30T16:50:02.227728+0000","last_peered":"2024-05-30T16:50:02.227728+0000","last_clean":"2024-05-30T16:50:02.227728+0000","last_became_active":"2024-05-30T16:50:01.225437+0000","last_became_peered":"2024-05-30T16:50:01.225437+0000","last_unstale":"2024-05-30T16:50:02.227728+0000","last_undegraded":"2024-05-30T16:50:02.227728+0000","last_fullsized":"2024-05-30T16:50:02.227728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264245+0000","last_change":"2024-05-30T16:50:00.205334+0000","last_active":"2024-05-30T16:50:03.264245+0000","last_peered":"2024-05-30T16:50:03.264245+0000","last_clean":"2024-05-30T16:50:03.264245+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:50:03.264245+0000","last_undegraded":"2024-05-30T16:50:03.264245+0000","last_fullsized":"2024-05-30T16:50:03.264245+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:53.442543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218172+0000","last_change":"2024-05-30T16:50:01.213565+0000","last_active":"2024-05-30T16:50:02.218172+0000","last_peered":"2024-05-30T16:50:02.218172+0000","last_clean":"2024-05-30T16:50:02.218172+0000","last_became_active":"2024-05-30T16:50:01.213263+0000","last_became_peered":"2024-05-30T16:50:01.213263+0000","last_unstale":"2024-05-30T16:50:02.218172+0000","last_undegraded":"2024-05-30T16:50:02.218172+0000","last_fullsized":"2024-05-30T16:50:02.218172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220036+0000","last_change":"2024-05-30T16:50:00.205241+0000","last_active":"2024-05-30T16:50:02.220036+0000","last_peered":"2024-05-30T16:50:02.220036+0000","last_clean":"2024-05-30T16:50:02.220036+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:50:02.220036+0000","last_undegraded":"2024-05-30T16:50:02.220036+0000","last_fullsized":"2024-05-30T16:50:02.220036+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:11.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524031+0000","last_change":"2024-05-30T16:50:01.217809+0000","last_active":"2024-05-30T16:50:03.524031+0000","last_peered":"2024-05-30T16:50:03.524031+0000","last_clean":"2024-05-30T16:50:03.524031+0000","last_became_active":"2024-05-30T16:50:01.209406+0000","last_became_peered":"2024-05-30T16:50:01.209406+0000","last_unstale":"2024-05-30T16:50:03.524031+0000","last_undegraded":"2024-05-30T16:50:03.524031+0000","last_fullsized":"2024-05-30T16:50:03.524031+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:15.778017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219091+0000","last_change":"2024-05-30T16:50:00.213769+0000","last_active":"2024-05-30T16:50:02.219091+0000","last_peered":"2024-05-30T16:50:02.219091+0000","last_clean":"2024-05-30T16:50:02.219091+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:50:02.219091+0000","last_undegraded":"2024-05-30T16:50:02.219091+0000","last_fullsized":"2024-05-30T16:50:02.219091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:25.844328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231468+0000","last_change":"2024-05-30T16:50:01.214317+0000","last_active":"2024-05-30T16:50:02.231468+0000","last_peered":"2024-05-30T16:50:02.231468+0000","last_clean":"2024-05-30T16:50:02.231468+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:50:02.231468+0000","last_undegraded":"2024-05-30T16:50:02.231468+0000","last_fullsized":"2024-05-30T16:50:02.231468+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524015+0000","last_change":"2024-05-30T16:50:00.203638+0000","last_active":"2024-05-30T16:50:03.524015+0000","last_peered":"2024-05-30T16:50:03.524015+0000","last_clean":"2024-05-30T16:50:03.524015+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:50:03.524015+0000","last_undegraded":"2024-05-30T16:50:03.524015+0000","last_fullsized":"2024-05-30T16:50:03.524015+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:42:02.981126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227833+0000","last_change":"2024-05-30T16:50:01.223933+0000","last_active":"2024-05-30T16:50:02.227833+0000","last_peered":"2024-05-30T16:50:02.227833+0000","last_clean":"2024-05-30T16:50:02.227833+0000","last_became_active":"2024-05-30T16:50:01.223472+0000","last_became_peered":"2024-05-30T16:50:01.223472+0000","last_unstale":"2024-05-30T16:50:02.227833+0000","last_undegraded":"2024-05-30T16:50:02.227833+0000","last_fullsized":"2024-05-30T16:50:02.227833+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219547+0000","last_change":"2024-05-30T16:50:00.206844+0000","last_active":"2024-05-30T16:50:02.219547+0000","last_peered":"2024-05-30T16:50:02.219547+0000","last_clean":"2024-05-30T16:50:02.219547+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:50:02.219547+0000","last_undegraded":"2024-05-30T16:50:02.219547+0000","last_fullsized":"2024-05-30T16:50:02.219547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:52.154456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526871+0000","last_change":"2024-05-30T16:50:01.228709+0000","last_active":"2024-05-30T16:50:03.526871+0000","last_peered":"2024-05-30T16:50:03.526871+0000","last_clean":"2024-05-30T16:50:03.526871+0000","last_became_active":"2024-05-30T16:50:01.226510+0000","last_became_peered":"2024-05-30T16:50:01.226510+0000","last_unstale":"2024-05-30T16:50:03.526871+0000","last_undegraded":"2024-05-30T16:50:03.526871+0000","last_fullsized":"2024-05-30T16:50:03.526871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:23.546971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221419+0000","last_change":"2024-05-30T16:50:00.210985+0000","last_active":"2024-05-30T16:50:02.221419+0000","last_peered":"2024-05-30T16:50:02.221419+0000","last_clean":"2024-05-30T16:50:02.221419+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:50:02.221419+0000","last_undegraded":"2024-05-30T16:50:02.221419+0000","last_fullsized":"2024-05-30T16:50:02.221419+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221052+0000","last_change":"2024-05-30T16:50:01.205452+0000","last_active":"2024-05-30T16:50:02.221052+0000","last_peered":"2024-05-30T16:50:02.221052+0000","last_clean":"2024-05-30T16:50:02.221052+0000","last_became_active":"2024-05-30T16:50:01.205079+0000","last_became_peered":"2024-05-30T16:50:01.205079+0000","last_unstale":"2024-05-30T16:50:02.221052+0000","last_undegraded":"2024-05-30T16:50:02.221052+0000","last_fullsized":"2024-05-30T16:50:02.221052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264373+0000","last_change":"2024-05-30T16:50:00.206599+0000","last_active":"2024-05-30T16:50:03.264373+0000","last_peered":"2024-05-30T16:50:03.264373+0000","last_clean":"2024-05-30T16:50:03.264373+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:50:03.264373+0000","last_undegraded":"2024-05-30T16:50:03.264373+0000","last_fullsized":"2024-05-30T16:50:03.264373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:50.078170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524660+0000","last_change":"2024-05-30T16:50:01.217111+0000","last_active":"2024-05-30T16:50:03.524660+0000","last_peered":"2024-05-30T16:50:03.524660+0000","last_clean":"2024-05-30T16:50:03.524660+0000","last_became_active":"2024-05-30T16:50:01.216841+0000","last_became_peered":"2024-05-30T16:50:01.216841+0000","last_unstale":"2024-05-30T16:50:03.524660+0000","last_undegraded":"2024-05-30T16:50:03.524660+0000","last_fullsized":"2024-05-30T16:50:03.524660+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:49.210751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219783+0000","last_change":"2024-05-30T16:50:00.208913+0000","last_active":"2024-05-30T16:50:02.219783+0000","last_peered":"2024-05-30T16:50:02.219783+0000","last_clean":"2024-05-30T16:50:02.219783+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:50:02.219783+0000","last_undegraded":"2024-05-30T16:50:02.219783+0000","last_fullsized":"2024-05-30T16:50:02.219783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:48.195369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525850+0000","last_change":"2024-05-30T16:50:01.218900+0000","last_active":"2024-05-30T16:50:03.525850+0000","last_peered":"2024-05-30T16:50:03.525850+0000","last_clean":"2024-05-30T16:50:03.525850+0000","last_became_active":"2024-05-30T16:50:01.218601+0000","last_became_peered":"2024-05-30T16:50:01.218601+0000","last_unstale":"2024-05-30T16:50:03.525850+0000","last_undegraded":"2024-05-30T16:50:03.525850+0000","last_fullsized":"2024-05-30T16:50:03.525850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:30.501139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219469+0000","last_change":"2024-05-30T16:50:00.207072+0000","last_active":"2024-05-30T16:50:02.219469+0000","last_peered":"2024-05-30T16:50:02.219469+0000","last_clean":"2024-05-30T16:50:02.219469+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:50:02.219469+0000","last_undegraded":"2024-05-30T16:50:02.219469+0000","last_fullsized":"2024-05-30T16:50:02.219469+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:08.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227588+0000","last_change":"2024-05-30T16:50:01.223569+0000","last_active":"2024-05-30T16:50:02.227588+0000","last_peered":"2024-05-30T16:50:02.227588+0000","last_clean":"2024-05-30T16:50:02.227588+0000","last_became_active":"2024-05-30T16:50:01.223101+0000","last_became_peered":"2024-05-30T16:50:01.223101+0000","last_unstale":"2024-05-30T16:50:02.227588+0000","last_undegraded":"2024-05-30T16:50:02.227588+0000","last_fullsized":"2024-05-30T16:50:02.227588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:15.642014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220173+0000","last_change":"2024-05-30T16:50:00.205457+0000","last_active":"2024-05-30T16:50:02.220173+0000","last_peered":"2024-05-30T16:50:02.220173+0000","last_clean":"2024-05-30T16:50:02.220173+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:50:02.220173+0000","last_undegraded":"2024-05-30T16:50:02.220173+0000","last_fullsized":"2024-05-30T16:50:02.220173+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:09.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231179+0000","last_change":"2024-05-30T16:50:01.212311+0000","last_active":"2024-05-30T16:50:02.231179+0000","last_peered":"2024-05-30T16:50:02.231179+0000","last_clean":"2024-05-30T16:50:02.231179+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:50:02.231179+0000","last_undegraded":"2024-05-30T16:50:02.231179+0000","last_fullsized":"2024-05-30T16:50:02.231179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227643+0000","last_change":"2024-05-30T16:50:00.208941+0000","last_active":"2024-05-30T16:50:02.227643+0000","last_peered":"2024-05-30T16:50:02.227643+0000","last_clean":"2024-05-30T16:50:02.227643+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:50:02.227643+0000","last_undegraded":"2024-05-30T16:50:02.227643+0000","last_fullsized":"2024-05-30T16:50:02.227643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:04.700068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524370+0000","last_change":"2024-05-30T16:50:01.208878+0000","last_active":"2024-05-30T16:50:03.524370+0000","last_peered":"2024-05-30T16:50:03.524370+0000","last_clean":"2024-05-30T16:50:03.524370+0000","last_became_active":"2024-05-30T16:50:01.207140+0000","last_became_peered":"2024-05-30T16:50:01.207140+0000","last_unstale":"2024-05-30T16:50:03.524370+0000","last_undegraded":"2024-05-30T16:50:03.524370+0000","last_fullsized":"2024-05-30T16:50:03.524370+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:26.859710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.217582+0000","last_change":"2024-05-30T16:50:00.196832+0000","last_active":"2024-05-30T16:50:02.217582+0000","last_peered":"2024-05-30T16:50:02.217582+0000","last_clean":"2024-05-30T16:50:02.217582+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:50:02.217582+0000","last_undegraded":"2024-05-30T16:50:02.217582+0000","last_fullsized":"2024-05-30T16:50:02.217582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219032+0000","last_change":"2024-05-30T16:50:01.215257+0000","last_active":"2024-05-30T16:50:02.219032+0000","last_peered":"2024-05-30T16:50:02.219032+0000","last_clean":"2024-05-30T16:50:02.219032+0000","last_became_active":"2024-05-30T16:50:01.214868+0000","last_became_peered":"2024-05-30T16:50:01.214868+0000","last_unstale":"2024-05-30T16:50:02.219032+0000","last_undegraded":"2024-05-30T16:50:02.219032+0000","last_fullsized":"2024-05-30T16:50:02.219032+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221460+0000","last_change":"2024-05-30T16:50:00.206888+0000","last_active":"2024-05-30T16:50:02.221460+0000","last_peered":"2024-05-30T16:50:02.221460+0000","last_clean":"2024-05-30T16:50:02.221460+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:50:02.221460+0000","last_undegraded":"2024-05-30T16:50:02.221460+0000","last_fullsized":"2024-05-30T16:50:02.221460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:30.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.527302+0000","last_change":"2024-05-30T16:50:01.226504+0000","last_active":"2024-05-30T16:50:03.527302+0000","last_peered":"2024-05-30T16:50:03.527302+0000","last_clean":"2024-05-30T16:50:03.527302+0000","last_became_active":"2024-05-30T16:50:01.225825+0000","last_became_peered":"2024-05-30T16:50:01.225825+0000","last_unstale":"2024-05-30T16:50:03.527302+0000","last_undegraded":"2024-05-30T16:50:03.527302+0000","last_fullsized":"2024-05-30T16:50:03.527302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219146+0000","last_change":"2024-05-30T16:50:00.201506+0000","last_active":"2024-05-30T16:50:02.219146+0000","last_peered":"2024-05-30T16:50:02.219146+0000","last_clean":"2024-05-30T16:50:02.219146+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:50:02.219146+0000","last_undegraded":"2024-05-30T16:50:02.219146+0000","last_fullsized":"2024-05-30T16:50:02.219146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:47.529393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219670+0000","last_change":"2024-05-30T16:50:01.218092+0000","last_active":"2024-05-30T16:50:02.219670+0000","last_peered":"2024-05-30T16:50:02.219670+0000","last_clean":"2024-05-30T16:50:02.219670+0000","last_became_active":"2024-05-30T16:50:01.217748+0000","last_became_peered":"2024-05-30T16:50:01.217748+0000","last_unstale":"2024-05-30T16:50:02.219670+0000","last_undegraded":"2024-05-30T16:50:02.219670+0000","last_fullsized":"2024-05-30T16:50:02.219670+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:12.631874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220962+0000","last_change":"2024-05-30T16:50:00.201874+0000","last_active":"2024-05-30T16:50:02.220962+0000","last_peered":"2024-05-30T16:50:02.220962+0000","last_clean":"2024-05-30T16:50:02.220962+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:50:02.220962+0000","last_undegraded":"2024-05-30T16:50:02.220962+0000","last_fullsized":"2024-05-30T16:50:02.220962+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524599+0000","last_change":"2024-05-30T16:50:01.216958+0000","last_active":"2024-05-30T16:50:03.524599+0000","last_peered":"2024-05-30T16:50:03.524599+0000","last_clean":"2024-05-30T16:50:03.524599+0000","last_became_active":"2024-05-30T16:50:01.216443+0000","last_became_peered":"2024-05-30T16:50:01.216443+0000","last_unstale":"2024-05-30T16:50:03.524599+0000","last_undegraded":"2024-05-30T16:50:03.524599+0000","last_fullsized":"2024-05-30T16:50:03.524599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:13:56.465266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526307+0000","last_change":"2024-05-30T16:50:00.202315+0000","last_active":"2024-05-30T16:50:03.526307+0000","last_peered":"2024-05-30T16:50:03.526307+0000","last_clean":"2024-05-30T16:50:03.526307+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:50:03.526307+0000","last_undegraded":"2024-05-30T16:50:03.526307+0000","last_fullsized":"2024-05-30T16:50:03.526307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:07.542490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264141+0000","last_change":"2024-05-30T16:50:01.217916+0000","last_active":"2024-05-30T16:50:03.264141+0000","last_peered":"2024-05-30T16:50:03.264141+0000","last_clean":"2024-05-30T16:50:03.264141+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:50:03.264141+0000","last_undegraded":"2024-05-30T16:50:03.264141+0000","last_fullsized":"2024-05-30T16:50:03.264141+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220233+0000","last_change":"2024-05-30T16:50:00.204870+0000","last_active":"2024-05-30T16:50:02.220233+0000","last_peered":"2024-05-30T16:50:02.220233+0000","last_clean":"2024-05-30T16:50:02.220233+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:50:02.220233+0000","last_undegraded":"2024-05-30T16:50:02.220233+0000","last_fullsized":"2024-05-30T16:50:02.220233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:08.366805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.263849+0000","last_change":"2024-05-30T16:50:01.219838+0000","last_active":"2024-05-30T16:50:03.263849+0000","last_peered":"2024-05-30T16:50:03.263849+0000","last_clean":"2024-05-30T16:50:03.263849+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:50:03.263849+0000","last_undegraded":"2024-05-30T16:50:03.263849+0000","last_fullsized":"2024-05-30T16:50:03.263849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.228114+0000","last_change":"2024-05-30T16:50:00.207506+0000","last_active":"2024-05-30T16:50:02.228114+0000","last_peered":"2024-05-30T16:50:02.228114+0000","last_clean":"2024-05-30T16:50:02.228114+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:50:02.228114+0000","last_undegraded":"2024-05-30T16:50:02.228114+0000","last_fullsized":"2024-05-30T16:50:02.228114+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:47.941977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.263962+0000","last_change":"2024-05-30T16:50:01.220513+0000","last_active":"2024-05-30T16:50:03.263962+0000","last_peered":"2024-05-30T16:50:03.263962+0000","last_clean":"2024-05-30T16:50:03.263962+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:50:03.263962+0000","last_undegraded":"2024-05-30T16:50:03.263962+0000","last_fullsized":"2024-05-30T16:50:03.263962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:23.546971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.230974+0000","last_change":"2024-05-30T16:50:00.199775+0000","last_active":"2024-05-30T16:50:02.230974+0000","last_peered":"2024-05-30T16:50:02.230974+0000","last_clean":"2024-05-30T16:50:02.230974+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:50:02.230974+0000","last_undegraded":"2024-05-30T16:50:02.230974+0000","last_fullsized":"2024-05-30T16:50:02.230974+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:11.926104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231943+0000","last_change":"2024-05-30T16:50:01.212934+0000","last_active":"2024-05-30T16:50:02.231943+0000","last_peered":"2024-05-30T16:50:02.231943+0000","last_clean":"2024-05-30T16:50:02.231943+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:50:02.231943+0000","last_undegraded":"2024-05-30T16:50:02.231943+0000","last_fullsized":"2024-05-30T16:50:02.231943+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221599+0000","last_change":"2024-05-30T16:50:00.206485+0000","last_active":"2024-05-30T16:50:02.221599+0000","last_peered":"2024-05-30T16:50:02.221599+0000","last_clean":"2024-05-30T16:50:02.221599+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:50:02.221599+0000","last_undegraded":"2024-05-30T16:50:02.221599+0000","last_fullsized":"2024-05-30T16:50:02.221599+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:46.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227701+0000","last_change":"2024-05-30T16:50:01.225452+0000","last_active":"2024-05-30T16:50:02.227701+0000","last_peered":"2024-05-30T16:50:02.227701+0000","last_clean":"2024-05-30T16:50:02.227701+0000","last_became_active":"2024-05-30T16:50:01.224834+0000","last_became_peered":"2024-05-30T16:50:01.224834+0000","last_unstale":"2024-05-30T16:50:02.227701+0000","last_undegraded":"2024-05-30T16:50:02.227701+0000","last_fullsized":"2024-05-30T16:50:02.227701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227979+0000","last_change":"2024-05-30T16:50:00.209889+0000","last_active":"2024-05-30T16:50:02.227979+0000","last_peered":"2024-05-30T16:50:02.227979+0000","last_clean":"2024-05-30T16:50:02.227979+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:50:02.227979+0000","last_undegraded":"2024-05-30T16:50:02.227979+0000","last_fullsized":"2024-05-30T16:50:02.227979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:00.581262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526698+0000","last_change":"2024-05-30T16:50:01.222012+0000","last_active":"2024-05-30T16:50:03.526698+0000","last_peered":"2024-05-30T16:50:03.526698+0000","last_clean":"2024-05-30T16:50:03.526698+0000","last_became_active":"2024-05-30T16:50:01.221622+0000","last_became_peered":"2024-05-30T16:50:01.221622+0000","last_unstale":"2024-05-30T16:50:03.526698+0000","last_undegraded":"2024-05-30T16:50:03.526698+0000","last_fullsized":"2024-05-30T16:50:03.526698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:43.760509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524929+0000","last_change":"2024-05-30T16:50:00.202834+0000","last_active":"2024-05-30T16:50:03.524929+0000","last_peered":"2024-05-30T16:50:03.524929+0000","last_clean":"2024-05-30T16:50:03.524929+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:50:03.524929+0000","last_undegraded":"2024-05-30T16:50:03.524929+0000","last_fullsized":"2024-05-30T16:50:03.524929+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:19:37.632432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.527125+0000","last_change":"2024-05-30T16:50:01.224914+0000","last_active":"2024-05-30T16:50:03.527125+0000","last_peered":"2024-05-30T16:50:03.527125+0000","last_clean":"2024-05-30T16:50:03.527125+0000","last_became_active":"2024-05-30T16:50:01.224600+0000","last_became_peered":"2024-05-30T16:50:01.224600+0000","last_unstale":"2024-05-30T16:50:03.527125+0000","last_undegraded":"2024-05-30T16:50:03.527125+0000","last_fullsized":"2024-05-30T16:50:03.527125+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231605+0000","last_change":"2024-05-30T16:50:00.204452+0000","last_active":"2024-05-30T16:50:02.231605+0000","last_peered":"2024-05-30T16:50:02.231605+0000","last_clean":"2024-05-30T16:50:02.231605+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:50:02.231605+0000","last_undegraded":"2024-05-30T16:50:02.231605+0000","last_fullsized":"2024-05-30T16:50:02.231605+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:54.227101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524675+0000","last_change":"2024-05-30T16:50:01.214457+0000","last_active":"2024-05-30T16:50:03.524675+0000","last_peered":"2024-05-30T16:50:03.524675+0000","last_clean":"2024-05-30T16:50:03.524675+0000","last_became_active":"2024-05-30T16:50:01.214152+0000","last_became_peered":"2024-05-30T16:50:01.214152+0000","last_unstale":"2024-05-30T16:50:03.524675+0000","last_undegraded":"2024-05-30T16:50:03.524675+0000","last_fullsized":"2024-05-30T16:50:03.524675+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:48.139986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524514+0000","last_change":"2024-05-30T16:50:00.207741+0000","last_active":"2024-05-30T16:50:03.524514+0000","last_peered":"2024-05-30T16:50:03.524514+0000","last_clean":"2024-05-30T16:50:03.524514+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:50:03.524514+0000","last_undegraded":"2024-05-30T16:50:03.524514+0000","last_fullsized":"2024-05-30T16:50:03.524514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:44.907107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220429+0000","last_change":"2024-05-30T16:50:01.214782+0000","last_active":"2024-05-30T16:50:02.220429+0000","last_peered":"2024-05-30T16:50:02.220429+0000","last_clean":"2024-05-30T16:50:02.220429+0000","last_became_active":"2024-05-30T16:50:01.214454+0000","last_became_peered":"2024-05-30T16:50:01.214454+0000","last_unstale":"2024-05-30T16:50:02.220429+0000","last_undegraded":"2024-05-30T16:50:02.220429+0000","last_fullsized":"2024-05-30T16:50:02.220429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219255+0000","last_change":"2024-05-30T16:50:00.213146+0000","last_active":"2024-05-30T16:50:02.219255+0000","last_peered":"2024-05-30T16:50:02.219255+0000","last_clean":"2024-05-30T16:50:02.219255+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:50:02.219255+0000","last_undegraded":"2024-05-30T16:50:02.219255+0000","last_fullsized":"2024-05-30T16:50:02.219255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:47.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219083+0000","last_change":"2024-05-30T16:50:01.210290+0000","last_active":"2024-05-30T16:50:02.219083+0000","last_peered":"2024-05-30T16:50:02.219083+0000","last_clean":"2024-05-30T16:50:02.219083+0000","last_became_active":"2024-05-30T16:50:01.209939+0000","last_became_peered":"2024-05-30T16:50:01.209939+0000","last_unstale":"2024-05-30T16:50:02.219083+0000","last_undegraded":"2024-05-30T16:50:02.219083+0000","last_fullsized":"2024-05-30T16:50:02.219083+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:20:05.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.217570+0000","last_change":"2024-05-30T16:50:00.203989+0000","last_active":"2024-05-30T16:50:02.217570+0000","last_peered":"2024-05-30T16:50:02.217570+0000","last_clean":"2024-05-30T16:50:02.217570+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:50:02.217570+0000","last_undegraded":"2024-05-30T16:50:02.217570+0000","last_fullsized":"2024-05-30T16:50:02.217570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219709+0000","last_change":"2024-05-30T16:50:01.212225+0000","last_active":"2024-05-30T16:50:02.219709+0000","last_peered":"2024-05-30T16:50:02.219709+0000","last_clean":"2024-05-30T16:50:02.219709+0000","last_became_active":"2024-05-30T16:50:01.211630+0000","last_became_peered":"2024-05-30T16:50:01.211630+0000","last_unstale":"2024-05-30T16:50:02.219709+0000","last_undegraded":"2024-05-30T16:50:02.219709+0000","last_fullsized":"2024-05-30T16:50:02.219709+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220211+0000","last_change":"2024-05-30T16:50:00.210481+0000","last_active":"2024-05-30T16:50:02.220211+0000","last_peered":"2024-05-30T16:50:02.220211+0000","last_clean":"2024-05-30T16:50:02.220211+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:50:02.220211+0000","last_undegraded":"2024-05-30T16:50:02.220211+0000","last_fullsized":"2024-05-30T16:50:02.220211+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:41:46.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.263865+0000","last_change":"2024-05-30T16:50:01.218627+0000","last_active":"2024-05-30T16:50:03.263865+0000","last_peered":"2024-05-30T16:50:03.263865+0000","last_clean":"2024-05-30T16:50:03.263865+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:50:03.263865+0000","last_undegraded":"2024-05-30T16:50:03.263865+0000","last_fullsized":"2024-05-30T16:50:03.263865+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220571+0000","last_change":"2024-05-30T16:50:00.210033+0000","last_active":"2024-05-30T16:50:02.220571+0000","last_peered":"2024-05-30T16:50:02.220571+0000","last_clean":"2024-05-30T16:50:02.220571+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:50:02.220571+0000","last_undegraded":"2024-05-30T16:50:02.220571+0000","last_fullsized":"2024-05-30T16:50:02.220571+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:15.927433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":267,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525827+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:50:03.525827+0000","last_peered":"2024-05-30T16:50:03.525827+0000","last_clean":"2024-05-30T16:50:03.525827+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:50:03.525827+0000","last_undegraded":"2024-05-30T16:50:03.525827+0000","last_fullsized":"2024-05-30T16:50:03.525827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58992,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312848,"statfs":{"total":96636764160,"available":96576356352,"internally_reserved":0,"allocated":1478656,"data_stored":964331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54252,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317588,"statfs":{"total":96636764160,"available":96581210112,"internally_reserved":0,"allocated":884736,"data_stored":373439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54248,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317592,"statfs":{"total":96636764160,"available":96581214208,"internally_reserved":0,"allocated":880640,"data_stored":373437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54248,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317592,"statfs":{"total":96636764160,"available":96581214208,"internally_reserved":0,"allocated":880640,"data_stored":373417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58412,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313428,"statfs":{"total":96636764160,"available":96576950272,"internally_reserved":0,"allocated":884736,"data_stored":373459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574953,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50096,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321744,"statfs":{"total":96636764160,"available":96585465856,"internally_reserved":0,"allocated":888832,"data_stored":374959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58428,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313412,"statfs":{"total":96636764160,"available":96576933888,"internally_reserved":0,"allocated":897024,"data_stored":375575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58992,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312848,"statfs":{"total":96636764160,"available":96576356352,"internally_reserved":0,"allocated":1470464,"data_stored":963715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:50:10.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:50:10.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.754+0000 7f5643800640 1 Processor -- start 2024-05-30T16:50:10.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.755+0000 7f5643800640 1 -- start start 2024-05-30T16:50:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.756+0000 7f5643800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c0b5150 0x7f563c16d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.756+0000 7f5643800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f563c06fbf0 con 0x7f563c072210 2024-05-30T16:50:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.756+0000 7f5643800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f563c0cf050 con 0x7f563c14c630 2024-05-30T16:50:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.756+0000 7f5643800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f563c0cf330 con 0x7f563c0b5150 2024-05-30T16:50:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f5633e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f563c072210 0x7f563c072630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58968/0 (socket says 172.21.15.144:58968) 2024-05-30T16:50:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f5633e00640 1 -- 172.21.15.144:0/4121951031 learned_addr learned my addr 172.21.15.144:0/4121951031 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f5641800640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c0b5150 0x7f563c16d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228694823 0 0) 0x7f563c06fbf0 con 0x7f563c072210 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f561c003520 con 0x7f563c072210 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4024454885 0 0) 0x7f561c003520 con 0x7f563c072210 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c0b5150 msgr2=0x7f563c16d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c0b5150 0x7f563c16d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 >> v1:172.21.15.149:6789/0 conn(0x7f563c14c630 legacy=0x7f563c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c0cf610 con 0x7f563c072210 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f562c001690 con 0x7f563c072210 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 >> v1:172.21.15.144:6789/0 conn(0x7f563c072210 legacy=0x7f563c072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.757+0000 7f563be00640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0039e0 0x7f561c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f563be00640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f561c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f563be00640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c0b5150 0x7f561c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0cf330 con 0x7f561c004800 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f561c00bb80 con 0x7f561c0039e0 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f561c00bd80 con 0x7f563c0b5150 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f5633e00640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f561c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f5641800640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c0b5150 0x7f561c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f5640e00640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0039e0 0x7f561c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f5633e00640 1 -- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c0b5150 msgr2=0x7f561c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f5633e00640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c0b5150 0x7f561c005200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f5633e00640 1 -- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0039e0 msgr2=0x7f561c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f5633e00640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0039e0 0x7f561c003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.758+0000 7f5633e00640 1 -- 172.21.15.144:0/4121951031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c003520 con 0x7f561c004800 2024-05-30T16:50:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.759+0000 7f5633e00640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f561c004c80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c210 tx=0x7f561c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e5185d4fb2a4b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c007d30 con 0x7f561c004800 2024-05-30T16:50:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562c0058d0 con 0x7f561c004800 2024-05-30T16:50:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f563be00640 1 -- 172.21.15.144:0/4121951031 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c005ca0 con 0x7f561c004800 2024-05-30T16:50:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f5643800640 1 -- 172.21.15.144:0/4121951031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 msgr2=0x7f561c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f5643800640 1 --2- 172.21.15.144:0/4121951031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f561c004c80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c210 tx=0x7f561c005830 comp rx=0 tx=0).stop 2024-05-30T16:50:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f5641800640 1 -- 172.21.15.144:0/4121951031 reap_dead start 2024-05-30T16:50:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f5643800640 1 -- 172.21.15.144:0/4121951031 shutdown_connections 2024-05-30T16:50:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f5643800640 1 -- 172.21.15.144:0/4121951031 >> 172.21.15.144:0/4121951031 conn(0x7f563c06bd00 msgr2=0x7f563c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f5643800640 1 -- 172.21.15.144:0/4121951031 shutdown_connections 2024-05-30T16:50:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.760+0000 7f5643800640 1 -- 172.21.15.144:0/4121951031 wait complete. 2024-05-30T16:50:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.762+0000 7f5643800640 1 Processor -- start 2024-05-30T16:50:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.762+0000 7f5643800640 1 -- start start 2024-05-30T16:50:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.763+0000 7f5643800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f563c1e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.763+0000 7f5643800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f563c0a9490 0x7f563c1e76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.763+0000 7f5643800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c1e7c00 0x7f563c1e8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.763+0000 7f5643800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f563c14ca10 con 0x7f561c004800 2024-05-30T16:50:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.763+0000 7f5643800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0b3c20 con 0x7f563c0a9490 2024-05-30T16:50:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.763+0000 7f5643800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f563c14cb90 con 0x7f563c1e7c00 2024-05-30T16:50:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5640e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f563c1e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5640e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f563c1e8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43072/0 (socket says 172.21.15.144:43072) 2024-05-30T16:50:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5640e00640 1 -- 172.21.15.144:0/3878488232 learned_addr learned my addr 172.21.15.144:0/3878488232 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5633e00640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f563c0a9490 0x7f563c1e76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5641800640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c1e7c00 0x7f563c1e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5640e00640 1 -- 172.21.15.144:0/3878488232 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c1e7c00 msgr2=0x7f563c1e8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5640e00640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c1e7c00 0x7f563c1e8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5640e00640 1 -- 172.21.15.144:0/3878488232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f563c0a9490 msgr2=0x7f563c1e76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5640e00640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f563c0a9490 0x7f563c1e76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5640e00640 1 -- 172.21.15.144:0/3878488232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c1e3620 con 0x7f561c004800 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5633e00640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f563c0a9490 0x7f563c1e76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.764+0000 7f5640e00640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f563c1e8b70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f562400d5a0 tx=0x7f562400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.765+0000 7f5639600640 1 -- 172.21.15.144:0/3878488232 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624005480 con 0x7f561c004800 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.765+0000 7f5639600640 1 -- 172.21.15.144:0/3878488232 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5624017070 con 0x7f561c004800 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.765+0000 7f5639600640 1 -- 172.21.15.144:0/3878488232 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624003810 con 0x7f561c004800 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.765+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563c0a9950 con 0x7f561c004800 2024-05-30T16:50:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.765+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563c13a880 con 0x7f561c004800 2024-05-30T16:50:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.766+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f563c068b90 con 0x7f561c004800 2024-05-30T16:50:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.767+0000 7f5639600640 1 -- 172.21.15.144:0/3878488232 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f56240039b0 con 0x7f561c004800 2024-05-30T16:50:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.768+0000 7f5639600640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806d610 0x7f561806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.768+0000 7f5639600640 1 -- 172.21.15.144:0/3878488232 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f562408a5f0 con 0x7f561c004800 2024-05-30T16:50:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.768+0000 7f5633e00640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806d610 0x7f561806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.769+0000 7f5633e00640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806d610 0x7f561806fad0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f562c033000 tx=0x7f562c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.773+0000 7f5639600640 1 -- 172.21.15.144:0/3878488232 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f563c1e3620 con 0x7f561c004800 2024-05-30T16:50:10.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.968+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f563c075f70 con 0x7f561806d610 2024-05-30T16:50:10.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.987+0000 7f5639600640 1 -- 172.21.15.144:0/3878488232 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f562c0014d0 con 0x7f561806d610 2024-05-30T16:50:10.991 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:10.993 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:50:10.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806d610 msgr2=0x7f561806fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:10.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806d610 0x7f561806fad0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f562c033000 tx=0x7f562c02e000 comp rx=0 tx=0).stop 2024-05-30T16:50:10.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 msgr2=0x7f563c1e8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f563c1e8b70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f562400d5a0 tx=0x7f562400da60 comp rx=0 tx=0).stop 2024-05-30T16:50:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 shutdown_connections 2024-05-30T16:50:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f561806d610 0x7f561806fad0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f563c1e7c00 0x7f563c1e8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f563c0a9490 0x7f563c1e76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 --2- 172.21.15.144:0/3878488232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c004800 0x7f563c1e8b70 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 >> 172.21.15.144:0/3878488232 conn(0x7f563c06bd00 msgr2=0x7f563c0b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.992+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 shutdown_connections 2024-05-30T16:50:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:10.993+0000 7f5643800640 1 -- 172.21.15.144:0/3878488232 wait complete. 2024-05-30T16:50:11.014 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-05-30T16:50:09.120041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":447668,"kb_used_data":8072,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754527052,"statfs":{"total":773094113280,"available":772635701248,"internally_reserved":0,"allocated":8265728,"data_stored":4172332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":450022963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002916"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526798+0000","last_change":"2024-05-30T16:50:01.226270+0000","last_active":"2024-05-30T16:50:03.526798+0000","last_peered":"2024-05-30T16:50:03.526798+0000","last_clean":"2024-05-30T16:50:03.526798+0000","last_became_active":"2024-05-30T16:50:01.225529+0000","last_became_peered":"2024-05-30T16:50:01.225529+0000","last_unstale":"2024-05-30T16:50:03.526798+0000","last_undegraded":"2024-05-30T16:50:03.526798+0000","last_fullsized":"2024-05-30T16:50:03.526798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221361+0000","last_change":"2024-05-30T16:50:01.205668+0000","last_active":"2024-05-30T16:50:02.221361+0000","last_peered":"2024-05-30T16:50:02.221361+0000","last_clean":"2024-05-30T16:50:02.221361+0000","last_became_active":"2024-05-30T16:50:01.205240+0000","last_became_peered":"2024-05-30T16:50:01.205240+0000","last_unstale":"2024-05-30T16:50:02.221361+0000","last_undegraded":"2024-05-30T16:50:02.221361+0000","last_fullsized":"2024-05-30T16:50:02.221361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264419+0000","last_change":"2024-05-30T16:50:01.216644+0000","last_active":"2024-05-30T16:50:03.264419+0000","last_peered":"2024-05-30T16:50:03.264419+0000","last_clean":"2024-05-30T16:50:03.264419+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:50:03.264419+0000","last_undegraded":"2024-05-30T16:50:03.264419+0000","last_fullsized":"2024-05-30T16:50:03.264419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:38.132245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219494+0000","last_change":"2024-05-30T16:50:01.208510+0000","last_active":"2024-05-30T16:50:02.219494+0000","last_peered":"2024-05-30T16:50:02.219494+0000","last_clean":"2024-05-30T16:50:02.219494+0000","last_became_active":"2024-05-30T16:50:01.207604+0000","last_became_peered":"2024-05-30T16:50:01.207604+0000","last_unstale":"2024-05-30T16:50:02.219494+0000","last_undegraded":"2024-05-30T16:50:02.219494+0000","last_fullsized":"2024-05-30T16:50:02.219494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:10.540613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524583+0000","last_change":"2024-05-30T16:50:01.220341+0000","last_active":"2024-05-30T16:50:03.524583+0000","last_peered":"2024-05-30T16:50:03.524583+0000","last_clean":"2024-05-30T16:50:03.524583+0000","last_became_active":"2024-05-30T16:50:01.219925+0000","last_became_peered":"2024-05-30T16:50:01.219925+0000","last_unstale":"2024-05-30T16:50:03.524583+0000","last_undegraded":"2024-05-30T16:50:03.524583+0000","last_fullsized":"2024-05-30T16:50:03.524583+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:48.744105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220086+0000","last_change":"2024-05-30T16:50:01.205902+0000","last_active":"2024-05-30T16:50:02.220086+0000","last_peered":"2024-05-30T16:50:02.220086+0000","last_clean":"2024-05-30T16:50:02.220086+0000","last_became_active":"2024-05-30T16:50:01.205620+0000","last_became_peered":"2024-05-30T16:50:01.205620+0000","last_unstale":"2024-05-30T16:50:02.220086+0000","last_undegraded":"2024-05-30T16:50:02.220086+0000","last_fullsized":"2024-05-30T16:50:02.220086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227753+0000","last_change":"2024-05-30T16:50:01.221623+0000","last_active":"2024-05-30T16:50:02.227753+0000","last_peered":"2024-05-30T16:50:02.227753+0000","last_clean":"2024-05-30T16:50:02.227753+0000","last_became_active":"2024-05-30T16:50:01.215828+0000","last_became_peered":"2024-05-30T16:50:01.215828+0000","last_unstale":"2024-05-30T16:50:02.227753+0000","last_undegraded":"2024-05-30T16:50:02.227753+0000","last_fullsized":"2024-05-30T16:50:02.227753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219457+0000","last_change":"2024-05-30T16:50:01.211114+0000","last_active":"2024-05-30T16:50:02.219457+0000","last_peered":"2024-05-30T16:50:02.219457+0000","last_clean":"2024-05-30T16:50:02.219457+0000","last_became_active":"2024-05-30T16:50:01.210863+0000","last_became_peered":"2024-05-30T16:50:01.210863+0000","last_unstale":"2024-05-30T16:50:02.219457+0000","last_undegraded":"2024-05-30T16:50:02.219457+0000","last_fullsized":"2024-05-30T16:50:02.219457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:22.258204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525028+0000","last_change":"2024-05-30T16:50:01.214939+0000","last_active":"2024-05-30T16:50:03.525028+0000","last_peered":"2024-05-30T16:50:03.525028+0000","last_clean":"2024-05-30T16:50:03.525028+0000","last_became_active":"2024-05-30T16:50:01.214609+0000","last_became_peered":"2024-05-30T16:50:01.214609+0000","last_unstale":"2024-05-30T16:50:03.525028+0000","last_undegraded":"2024-05-30T16:50:03.525028+0000","last_fullsized":"2024-05-30T16:50:03.525028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:09.411468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218884+0000","last_change":"2024-05-30T16:50:01.217788+0000","last_active":"2024-05-30T16:50:02.218884+0000","last_peered":"2024-05-30T16:50:02.218884+0000","last_clean":"2024-05-30T16:50:02.218884+0000","last_became_active":"2024-05-30T16:50:01.217506+0000","last_became_peered":"2024-05-30T16:50:01.217506+0000","last_unstale":"2024-05-30T16:50:02.218884+0000","last_undegraded":"2024-05-30T16:50:02.218884+0000","last_fullsized":"2024-05-30T16:50:02.218884+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526619+0000","last_change":"2024-05-30T16:50:01.218948+0000","last_active":"2024-05-30T16:50:03.526619+0000","last_peered":"2024-05-30T16:50:03.526619+0000","last_clean":"2024-05-30T16:50:03.526619+0000","last_became_active":"2024-05-30T16:50:01.218645+0000","last_became_peered":"2024-05-30T16:50:01.218645+0000","last_unstale":"2024-05-30T16:50:03.526619+0000","last_undegraded":"2024-05-30T16:50:03.526619+0000","last_fullsized":"2024-05-30T16:50:03.526619+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:16.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219768+0000","last_change":"2024-05-30T16:50:01.217317+0000","last_active":"2024-05-30T16:50:02.219768+0000","last_peered":"2024-05-30T16:50:02.219768+0000","last_clean":"2024-05-30T16:50:02.219768+0000","last_became_active":"2024-05-30T16:50:01.217020+0000","last_became_peered":"2024-05-30T16:50:01.217020+0000","last_unstale":"2024-05-30T16:50:02.219768+0000","last_undegraded":"2024-05-30T16:50:02.219768+0000","last_fullsized":"2024-05-30T16:50:02.219768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:31.180902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231640+0000","last_change":"2024-05-30T16:50:01.213490+0000","last_active":"2024-05-30T16:50:02.231640+0000","last_peered":"2024-05-30T16:50:02.231640+0000","last_clean":"2024-05-30T16:50:02.231640+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:50:02.231640+0000","last_undegraded":"2024-05-30T16:50:02.231640+0000","last_fullsized":"2024-05-30T16:50:02.231640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524590+0000","last_change":"2024-05-30T16:50:01.229142+0000","last_active":"2024-05-30T16:50:03.524590+0000","last_peered":"2024-05-30T16:50:03.524590+0000","last_clean":"2024-05-30T16:50:03.524590+0000","last_became_active":"2024-05-30T16:50:01.228163+0000","last_became_peered":"2024-05-30T16:50:01.228163+0000","last_unstale":"2024-05-30T16:50:03.524590+0000","last_undegraded":"2024-05-30T16:50:03.524590+0000","last_fullsized":"2024-05-30T16:50:03.524590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:57:34.230448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231337+0000","last_change":"2024-05-30T16:50:01.213697+0000","last_active":"2024-05-30T16:50:02.231337+0000","last_peered":"2024-05-30T16:50:02.231337+0000","last_clean":"2024-05-30T16:50:02.231337+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:50:02.231337+0000","last_undegraded":"2024-05-30T16:50:02.231337+0000","last_fullsized":"2024-05-30T16:50:02.231337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.217790+0000","last_change":"2024-05-30T16:50:01.215568+0000","last_active":"2024-05-30T16:50:02.217790+0000","last_peered":"2024-05-30T16:50:02.217790+0000","last_clean":"2024-05-30T16:50:02.217790+0000","last_became_active":"2024-05-30T16:50:01.208926+0000","last_became_peered":"2024-05-30T16:50:01.208926+0000","last_unstale":"2024-05-30T16:50:02.217790+0000","last_undegraded":"2024-05-30T16:50:02.217790+0000","last_fullsized":"2024-05-30T16:50:02.217790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525149+0000","last_change":"2024-05-30T16:50:01.215004+0000","last_active":"2024-05-30T16:50:03.525149+0000","last_peered":"2024-05-30T16:50:03.525149+0000","last_clean":"2024-05-30T16:50:03.525149+0000","last_became_active":"2024-05-30T16:50:01.211267+0000","last_became_peered":"2024-05-30T16:50:01.211267+0000","last_unstale":"2024-05-30T16:50:03.525149+0000","last_undegraded":"2024-05-30T16:50:03.525149+0000","last_fullsized":"2024-05-30T16:50:03.525149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:11.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219706+0000","last_change":"2024-05-30T16:50:01.209168+0000","last_active":"2024-05-30T16:50:02.219706+0000","last_peered":"2024-05-30T16:50:02.219706+0000","last_clean":"2024-05-30T16:50:02.219706+0000","last_became_active":"2024-05-30T16:50:01.207616+0000","last_became_peered":"2024-05-30T16:50:01.207616+0000","last_unstale":"2024-05-30T16:50:02.219706+0000","last_undegraded":"2024-05-30T16:50:02.219706+0000","last_fullsized":"2024-05-30T16:50:02.219706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:09.382187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221190+0000","last_change":"2024-05-30T16:50:01.213913+0000","last_active":"2024-05-30T16:50:02.221190+0000","last_peered":"2024-05-30T16:50:02.221190+0000","last_clean":"2024-05-30T16:50:02.221190+0000","last_became_active":"2024-05-30T16:50:01.213651+0000","last_became_peered":"2024-05-30T16:50:01.213651+0000","last_unstale":"2024-05-30T16:50:02.221190+0000","last_undegraded":"2024-05-30T16:50:02.221190+0000","last_fullsized":"2024-05-30T16:50:02.221190+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231751+0000","last_change":"2024-05-30T16:50:01.223666+0000","last_active":"2024-05-30T16:50:02.231751+0000","last_peered":"2024-05-30T16:50:02.231751+0000","last_clean":"2024-05-30T16:50:02.231751+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:50:02.231751+0000","last_undegraded":"2024-05-30T16:50:02.231751+0000","last_fullsized":"2024-05-30T16:50:02.231751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218151+0000","last_change":"2024-05-30T16:50:01.209725+0000","last_active":"2024-05-30T16:50:02.218151+0000","last_peered":"2024-05-30T16:50:02.218151+0000","last_clean":"2024-05-30T16:50:02.218151+0000","last_became_active":"2024-05-30T16:50:01.209453+0000","last_became_peered":"2024-05-30T16:50:01.209453+0000","last_unstale":"2024-05-30T16:50:02.218151+0000","last_undegraded":"2024-05-30T16:50:02.218151+0000","last_fullsized":"2024-05-30T16:50:02.218151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.217764+0000","last_change":"2024-05-30T16:50:01.217106+0000","last_active":"2024-05-30T16:50:02.217764+0000","last_peered":"2024-05-30T16:50:02.217764+0000","last_clean":"2024-05-30T16:50:02.217764+0000","last_became_active":"2024-05-30T16:50:01.216565+0000","last_became_peered":"2024-05-30T16:50:01.216565+0000","last_unstale":"2024-05-30T16:50:02.217764+0000","last_undegraded":"2024-05-30T16:50:02.217764+0000","last_fullsized":"2024-05-30T16:50:02.217764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526226+0000","last_change":"2024-05-30T16:50:01.230645+0000","last_active":"2024-05-30T16:50:03.526226+0000","last_peered":"2024-05-30T16:50:03.526226+0000","last_clean":"2024-05-30T16:50:03.526226+0000","last_became_active":"2024-05-30T16:50:01.230326+0000","last_became_peered":"2024-05-30T16:50:01.230326+0000","last_unstale":"2024-05-30T16:50:03.526226+0000","last_undegraded":"2024-05-30T16:50:03.526226+0000","last_fullsized":"2024-05-30T16:50:03.526226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:34.972283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525803+0000","last_change":"2024-05-30T16:50:01.222411+0000","last_active":"2024-05-30T16:50:03.525803+0000","last_peered":"2024-05-30T16:50:03.525803+0000","last_clean":"2024-05-30T16:50:03.525803+0000","last_became_active":"2024-05-30T16:50:01.221747+0000","last_became_peered":"2024-05-30T16:50:01.221747+0000","last_unstale":"2024-05-30T16:50:03.525803+0000","last_undegraded":"2024-05-30T16:50:03.525803+0000","last_fullsized":"2024-05-30T16:50:03.525803+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:31:09.263732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219365+0000","last_change":"2024-05-30T16:50:01.225335+0000","last_active":"2024-05-30T16:50:02.219365+0000","last_peered":"2024-05-30T16:50:02.219365+0000","last_clean":"2024-05-30T16:50:02.219365+0000","last_became_active":"2024-05-30T16:50:01.224947+0000","last_became_peered":"2024-05-30T16:50:01.224947+0000","last_unstale":"2024-05-30T16:50:02.219365+0000","last_undegraded":"2024-05-30T16:50:02.219365+0000","last_fullsized":"2024-05-30T16:50:02.219365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227676+0000","last_change":"2024-05-30T16:50:01.223725+0000","last_active":"2024-05-30T16:50:02.227676+0000","last_peered":"2024-05-30T16:50:02.227676+0000","last_clean":"2024-05-30T16:50:02.227676+0000","last_became_active":"2024-05-30T16:50:01.223128+0000","last_became_peered":"2024-05-30T16:50:01.223128+0000","last_unstale":"2024-05-30T16:50:02.227676+0000","last_undegraded":"2024-05-30T16:50:02.227676+0000","last_fullsized":"2024-05-30T16:50:02.227676+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:16:28.027255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264270+0000","last_change":"2024-05-30T16:50:01.221359+0000","last_active":"2024-05-30T16:50:03.264270+0000","last_peered":"2024-05-30T16:50:03.264270+0000","last_clean":"2024-05-30T16:50:03.264270+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:50:03.264270+0000","last_undegraded":"2024-05-30T16:50:03.264270+0000","last_fullsized":"2024-05-30T16:50:03.264270+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218269+0000","last_change":"2024-05-30T16:50:01.217815+0000","last_active":"2024-05-30T16:50:02.218269+0000","last_peered":"2024-05-30T16:50:02.218269+0000","last_clean":"2024-05-30T16:50:02.218269+0000","last_became_active":"2024-05-30T16:50:01.217568+0000","last_became_peered":"2024-05-30T16:50:01.217568+0000","last_unstale":"2024-05-30T16:50:02.218269+0000","last_undegraded":"2024-05-30T16:50:02.218269+0000","last_fullsized":"2024-05-30T16:50:02.218269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264318+0000","last_change":"2024-05-30T16:50:01.225500+0000","last_active":"2024-05-30T16:50:03.264318+0000","last_peered":"2024-05-30T16:50:03.264318+0000","last_clean":"2024-05-30T16:50:03.264318+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:50:03.264318+0000","last_undegraded":"2024-05-30T16:50:03.264318+0000","last_fullsized":"2024-05-30T16:50:03.264318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:24.044660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.228029+0000","last_change":"2024-05-30T16:50:01.227853+0000","last_active":"2024-05-30T16:50:02.228029+0000","last_peered":"2024-05-30T16:50:02.228029+0000","last_clean":"2024-05-30T16:50:02.228029+0000","last_became_active":"2024-05-30T16:50:01.227538+0000","last_became_peered":"2024-05-30T16:50:01.227538+0000","last_unstale":"2024-05-30T16:50:02.228029+0000","last_undegraded":"2024-05-30T16:50:02.228029+0000","last_fullsized":"2024-05-30T16:50:02.228029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.228128+0000","last_change":"2024-05-30T16:50:01.216098+0000","last_active":"2024-05-30T16:50:02.228128+0000","last_peered":"2024-05-30T16:50:02.228128+0000","last_clean":"2024-05-30T16:50:02.228128+0000","last_became_active":"2024-05-30T16:50:01.215541+0000","last_became_peered":"2024-05-30T16:50:01.215541+0000","last_unstale":"2024-05-30T16:50:02.228128+0000","last_undegraded":"2024-05-30T16:50:02.228128+0000","last_fullsized":"2024-05-30T16:50:02.228128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219877+0000","last_change":"2024-05-30T16:50:01.213699+0000","last_active":"2024-05-30T16:50:02.219877+0000","last_peered":"2024-05-30T16:50:02.219877+0000","last_clean":"2024-05-30T16:50:02.219877+0000","last_became_active":"2024-05-30T16:50:01.212747+0000","last_became_peered":"2024-05-30T16:50:01.212747+0000","last_unstale":"2024-05-30T16:50:02.219877+0000","last_undegraded":"2024-05-30T16:50:02.219877+0000","last_fullsized":"2024-05-30T16:50:02.219877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526746+0000","last_change":"2024-05-30T16:50:01.222131+0000","last_active":"2024-05-30T16:50:03.526746+0000","last_peered":"2024-05-30T16:50:03.526746+0000","last_clean":"2024-05-30T16:50:03.526746+0000","last_became_active":"2024-05-30T16:50:01.221781+0000","last_became_peered":"2024-05-30T16:50:01.221781+0000","last_unstale":"2024-05-30T16:50:03.526746+0000","last_undegraded":"2024-05-30T16:50:03.526746+0000","last_fullsized":"2024-05-30T16:50:03.526746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:54.069608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.527210+0000","last_change":"2024-05-30T16:50:00.205578+0000","last_active":"2024-05-30T16:50:03.527210+0000","last_peered":"2024-05-30T16:50:03.527210+0000","last_clean":"2024-05-30T16:50:03.527210+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:50:03.527210+0000","last_undegraded":"2024-05-30T16:50:03.527210+0000","last_fullsized":"2024-05-30T16:50:03.527210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:09.041453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525413+0000","last_change":"2024-05-30T16:50:01.208407+0000","last_active":"2024-05-30T16:50:03.525413+0000","last_peered":"2024-05-30T16:50:03.525413+0000","last_clean":"2024-05-30T16:50:03.525413+0000","last_became_active":"2024-05-30T16:50:01.208076+0000","last_became_peered":"2024-05-30T16:50:01.208076+0000","last_unstale":"2024-05-30T16:50:03.525413+0000","last_undegraded":"2024-05-30T16:50:03.525413+0000","last_fullsized":"2024-05-30T16:50:03.525413+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:06.445701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231882+0000","last_change":"2024-05-30T16:50:00.198543+0000","last_active":"2024-05-30T16:50:02.231882+0000","last_peered":"2024-05-30T16:50:02.231882+0000","last_clean":"2024-05-30T16:50:02.231882+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:50:02.231882+0000","last_undegraded":"2024-05-30T16:50:02.231882+0000","last_fullsized":"2024-05-30T16:50:02.231882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:06.670117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220837+0000","last_change":"2024-05-30T16:50:01.223695+0000","last_active":"2024-05-30T16:50:02.220837+0000","last_peered":"2024-05-30T16:50:02.220837+0000","last_clean":"2024-05-30T16:50:02.220837+0000","last_became_active":"2024-05-30T16:50:01.223375+0000","last_became_peered":"2024-05-30T16:50:01.223375+0000","last_unstale":"2024-05-30T16:50:02.220837+0000","last_undegraded":"2024-05-30T16:50:02.220837+0000","last_fullsized":"2024-05-30T16:50:02.220837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218620+0000","last_change":"2024-05-30T16:50:00.212444+0000","last_active":"2024-05-30T16:50:02.218620+0000","last_peered":"2024-05-30T16:50:02.218620+0000","last_clean":"2024-05-30T16:50:02.218620+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:50:02.218620+0000","last_undegraded":"2024-05-30T16:50:02.218620+0000","last_fullsized":"2024-05-30T16:50:02.218620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526779+0000","last_change":"2024-05-30T16:50:01.219674+0000","last_active":"2024-05-30T16:50:03.526779+0000","last_peered":"2024-05-30T16:50:03.526779+0000","last_clean":"2024-05-30T16:50:03.526779+0000","last_became_active":"2024-05-30T16:50:01.219382+0000","last_became_peered":"2024-05-30T16:50:01.219382+0000","last_unstale":"2024-05-30T16:50:03.526779+0000","last_undegraded":"2024-05-30T16:50:03.526779+0000","last_fullsized":"2024-05-30T16:50:03.526779+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220933+0000","last_change":"2024-05-30T16:50:00.210174+0000","last_active":"2024-05-30T16:50:02.220933+0000","last_peered":"2024-05-30T16:50:02.220933+0000","last_clean":"2024-05-30T16:50:02.220933+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:50:02.220933+0000","last_undegraded":"2024-05-30T16:50:02.220933+0000","last_fullsized":"2024-05-30T16:50:02.220933+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227728+0000","last_change":"2024-05-30T16:50:01.228355+0000","last_active":"2024-05-30T16:50:02.227728+0000","last_peered":"2024-05-30T16:50:02.227728+0000","last_clean":"2024-05-30T16:50:02.227728+0000","last_became_active":"2024-05-30T16:50:01.225437+0000","last_became_peered":"2024-05-30T16:50:01.225437+0000","last_unstale":"2024-05-30T16:50:02.227728+0000","last_undegraded":"2024-05-30T16:50:02.227728+0000","last_fullsized":"2024-05-30T16:50:02.227728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264245+0000","last_change":"2024-05-30T16:50:00.205334+0000","last_active":"2024-05-30T16:50:03.264245+0000","last_peered":"2024-05-30T16:50:03.264245+0000","last_clean":"2024-05-30T16:50:03.264245+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:50:03.264245+0000","last_undegraded":"2024-05-30T16:50:03.264245+0000","last_fullsized":"2024-05-30T16:50:03.264245+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:53.442543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.218172+0000","last_change":"2024-05-30T16:50:01.213565+0000","last_active":"2024-05-30T16:50:02.218172+0000","last_peered":"2024-05-30T16:50:02.218172+0000","last_clean":"2024-05-30T16:50:02.218172+0000","last_became_active":"2024-05-30T16:50:01.213263+0000","last_became_peered":"2024-05-30T16:50:01.213263+0000","last_unstale":"2024-05-30T16:50:02.218172+0000","last_undegraded":"2024-05-30T16:50:02.218172+0000","last_fullsized":"2024-05-30T16:50:02.218172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220036+0000","last_change":"2024-05-30T16:50:00.205241+0000","last_active":"2024-05-30T16:50:02.220036+0000","last_peered":"2024-05-30T16:50:02.220036+0000","last_clean":"2024-05-30T16:50:02.220036+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:50:02.220036+0000","last_undegraded":"2024-05-30T16:50:02.220036+0000","last_fullsized":"2024-05-30T16:50:02.220036+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:11.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524031+0000","last_change":"2024-05-30T16:50:01.217809+0000","last_active":"2024-05-30T16:50:03.524031+0000","last_peered":"2024-05-30T16:50:03.524031+0000","last_clean":"2024-05-30T16:50:03.524031+0000","last_became_active":"2024-05-30T16:50:01.209406+0000","last_became_peered":"2024-05-30T16:50:01.209406+0000","last_unstale":"2024-05-30T16:50:03.524031+0000","last_undegraded":"2024-05-30T16:50:03.524031+0000","last_fullsized":"2024-05-30T16:50:03.524031+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:15.778017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219091+0000","last_change":"2024-05-30T16:50:00.213769+0000","last_active":"2024-05-30T16:50:02.219091+0000","last_peered":"2024-05-30T16:50:02.219091+0000","last_clean":"2024-05-30T16:50:02.219091+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:50:02.219091+0000","last_undegraded":"2024-05-30T16:50:02.219091+0000","last_fullsized":"2024-05-30T16:50:02.219091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:25.844328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231468+0000","last_change":"2024-05-30T16:50:01.214317+0000","last_active":"2024-05-30T16:50:02.231468+0000","last_peered":"2024-05-30T16:50:02.231468+0000","last_clean":"2024-05-30T16:50:02.231468+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:50:02.231468+0000","last_undegraded":"2024-05-30T16:50:02.231468+0000","last_fullsized":"2024-05-30T16:50:02.231468+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524015+0000","last_change":"2024-05-30T16:50:00.203638+0000","last_active":"2024-05-30T16:50:03.524015+0000","last_peered":"2024-05-30T16:50:03.524015+0000","last_clean":"2024-05-30T16:50:03.524015+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:50:03.524015+0000","last_undegraded":"2024-05-30T16:50:03.524015+0000","last_fullsized":"2024-05-30T16:50:03.524015+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:42:02.981126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227833+0000","last_change":"2024-05-30T16:50:01.223933+0000","last_active":"2024-05-30T16:50:02.227833+0000","last_peered":"2024-05-30T16:50:02.227833+0000","last_clean":"2024-05-30T16:50:02.227833+0000","last_became_active":"2024-05-30T16:50:01.223472+0000","last_became_peered":"2024-05-30T16:50:01.223472+0000","last_unstale":"2024-05-30T16:50:02.227833+0000","last_undegraded":"2024-05-30T16:50:02.227833+0000","last_fullsized":"2024-05-30T16:50:02.227833+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219547+0000","last_change":"2024-05-30T16:50:00.206844+0000","last_active":"2024-05-30T16:50:02.219547+0000","last_peered":"2024-05-30T16:50:02.219547+0000","last_clean":"2024-05-30T16:50:02.219547+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:50:02.219547+0000","last_undegraded":"2024-05-30T16:50:02.219547+0000","last_fullsized":"2024-05-30T16:50:02.219547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:52.154456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526871+0000","last_change":"2024-05-30T16:50:01.228709+0000","last_active":"2024-05-30T16:50:03.526871+0000","last_peered":"2024-05-30T16:50:03.526871+0000","last_clean":"2024-05-30T16:50:03.526871+0000","last_became_active":"2024-05-30T16:50:01.226510+0000","last_became_peered":"2024-05-30T16:50:01.226510+0000","last_unstale":"2024-05-30T16:50:03.526871+0000","last_undegraded":"2024-05-30T16:50:03.526871+0000","last_fullsized":"2024-05-30T16:50:03.526871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:23.546971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221419+0000","last_change":"2024-05-30T16:50:00.210985+0000","last_active":"2024-05-30T16:50:02.221419+0000","last_peered":"2024-05-30T16:50:02.221419+0000","last_clean":"2024-05-30T16:50:02.221419+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:50:02.221419+0000","last_undegraded":"2024-05-30T16:50:02.221419+0000","last_fullsized":"2024-05-30T16:50:02.221419+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221052+0000","last_change":"2024-05-30T16:50:01.205452+0000","last_active":"2024-05-30T16:50:02.221052+0000","last_peered":"2024-05-30T16:50:02.221052+0000","last_clean":"2024-05-30T16:50:02.221052+0000","last_became_active":"2024-05-30T16:50:01.205079+0000","last_became_peered":"2024-05-30T16:50:01.205079+0000","last_unstale":"2024-05-30T16:50:02.221052+0000","last_undegraded":"2024-05-30T16:50:02.221052+0000","last_fullsized":"2024-05-30T16:50:02.221052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264373+0000","last_change":"2024-05-30T16:50:00.206599+0000","last_active":"2024-05-30T16:50:03.264373+0000","last_peered":"2024-05-30T16:50:03.264373+0000","last_clean":"2024-05-30T16:50:03.264373+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:50:03.264373+0000","last_undegraded":"2024-05-30T16:50:03.264373+0000","last_fullsized":"2024-05-30T16:50:03.264373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:50.078170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524660+0000","last_change":"2024-05-30T16:50:01.217111+0000","last_active":"2024-05-30T16:50:03.524660+0000","last_peered":"2024-05-30T16:50:03.524660+0000","last_clean":"2024-05-30T16:50:03.524660+0000","last_became_active":"2024-05-30T16:50:01.216841+0000","last_became_peered":"2024-05-30T16:50:01.216841+0000","last_unstale":"2024-05-30T16:50:03.524660+0000","last_undegraded":"2024-05-30T16:50:03.524660+0000","last_fullsized":"2024-05-30T16:50:03.524660+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:49.210751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219783+0000","last_change":"2024-05-30T16:50:00.208913+0000","last_active":"2024-05-30T16:50:02.219783+0000","last_peered":"2024-05-30T16:50:02.219783+0000","last_clean":"2024-05-30T16:50:02.219783+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:50:02.219783+0000","last_undegraded":"2024-05-30T16:50:02.219783+0000","last_fullsized":"2024-05-30T16:50:02.219783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:48.195369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525850+0000","last_change":"2024-05-30T16:50:01.218900+0000","last_active":"2024-05-30T16:50:03.525850+0000","last_peered":"2024-05-30T16:50:03.525850+0000","last_clean":"2024-05-30T16:50:03.525850+0000","last_became_active":"2024-05-30T16:50:01.218601+0000","last_became_peered":"2024-05-30T16:50:01.218601+0000","last_unstale":"2024-05-30T16:50:03.525850+0000","last_undegraded":"2024-05-30T16:50:03.525850+0000","last_fullsized":"2024-05-30T16:50:03.525850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:30.501139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219469+0000","last_change":"2024-05-30T16:50:00.207072+0000","last_active":"2024-05-30T16:50:02.219469+0000","last_peered":"2024-05-30T16:50:02.219469+0000","last_clean":"2024-05-30T16:50:02.219469+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:50:02.219469+0000","last_undegraded":"2024-05-30T16:50:02.219469+0000","last_fullsized":"2024-05-30T16:50:02.219469+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:08.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227588+0000","last_change":"2024-05-30T16:50:01.223569+0000","last_active":"2024-05-30T16:50:02.227588+0000","last_peered":"2024-05-30T16:50:02.227588+0000","last_clean":"2024-05-30T16:50:02.227588+0000","last_became_active":"2024-05-30T16:50:01.223101+0000","last_became_peered":"2024-05-30T16:50:01.223101+0000","last_unstale":"2024-05-30T16:50:02.227588+0000","last_undegraded":"2024-05-30T16:50:02.227588+0000","last_fullsized":"2024-05-30T16:50:02.227588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:15.642014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220173+0000","last_change":"2024-05-30T16:50:00.205457+0000","last_active":"2024-05-30T16:50:02.220173+0000","last_peered":"2024-05-30T16:50:02.220173+0000","last_clean":"2024-05-30T16:50:02.220173+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:50:02.220173+0000","last_undegraded":"2024-05-30T16:50:02.220173+0000","last_fullsized":"2024-05-30T16:50:02.220173+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:09.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231179+0000","last_change":"2024-05-30T16:50:01.212311+0000","last_active":"2024-05-30T16:50:02.231179+0000","last_peered":"2024-05-30T16:50:02.231179+0000","last_clean":"2024-05-30T16:50:02.231179+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:50:02.231179+0000","last_undegraded":"2024-05-30T16:50:02.231179+0000","last_fullsized":"2024-05-30T16:50:02.231179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227643+0000","last_change":"2024-05-30T16:50:00.208941+0000","last_active":"2024-05-30T16:50:02.227643+0000","last_peered":"2024-05-30T16:50:02.227643+0000","last_clean":"2024-05-30T16:50:02.227643+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:50:02.227643+0000","last_undegraded":"2024-05-30T16:50:02.227643+0000","last_fullsized":"2024-05-30T16:50:02.227643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:04.700068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524370+0000","last_change":"2024-05-30T16:50:01.208878+0000","last_active":"2024-05-30T16:50:03.524370+0000","last_peered":"2024-05-30T16:50:03.524370+0000","last_clean":"2024-05-30T16:50:03.524370+0000","last_became_active":"2024-05-30T16:50:01.207140+0000","last_became_peered":"2024-05-30T16:50:01.207140+0000","last_unstale":"2024-05-30T16:50:03.524370+0000","last_undegraded":"2024-05-30T16:50:03.524370+0000","last_fullsized":"2024-05-30T16:50:03.524370+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:26.859710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.217582+0000","last_change":"2024-05-30T16:50:00.196832+0000","last_active":"2024-05-30T16:50:02.217582+0000","last_peered":"2024-05-30T16:50:02.217582+0000","last_clean":"2024-05-30T16:50:02.217582+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:50:02.217582+0000","last_undegraded":"2024-05-30T16:50:02.217582+0000","last_fullsized":"2024-05-30T16:50:02.217582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219032+0000","last_change":"2024-05-30T16:50:01.215257+0000","last_active":"2024-05-30T16:50:02.219032+0000","last_peered":"2024-05-30T16:50:02.219032+0000","last_clean":"2024-05-30T16:50:02.219032+0000","last_became_active":"2024-05-30T16:50:01.214868+0000","last_became_peered":"2024-05-30T16:50:01.214868+0000","last_unstale":"2024-05-30T16:50:02.219032+0000","last_undegraded":"2024-05-30T16:50:02.219032+0000","last_fullsized":"2024-05-30T16:50:02.219032+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221460+0000","last_change":"2024-05-30T16:50:00.206888+0000","last_active":"2024-05-30T16:50:02.221460+0000","last_peered":"2024-05-30T16:50:02.221460+0000","last_clean":"2024-05-30T16:50:02.221460+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:50:02.221460+0000","last_undegraded":"2024-05-30T16:50:02.221460+0000","last_fullsized":"2024-05-30T16:50:02.221460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:30.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.527302+0000","last_change":"2024-05-30T16:50:01.226504+0000","last_active":"2024-05-30T16:50:03.527302+0000","last_peered":"2024-05-30T16:50:03.527302+0000","last_clean":"2024-05-30T16:50:03.527302+0000","last_became_active":"2024-05-30T16:50:01.225825+0000","last_became_peered":"2024-05-30T16:50:01.225825+0000","last_unstale":"2024-05-30T16:50:03.527302+0000","last_undegraded":"2024-05-30T16:50:03.527302+0000","last_fullsized":"2024-05-30T16:50:03.527302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219146+0000","last_change":"2024-05-30T16:50:00.201506+0000","last_active":"2024-05-30T16:50:02.219146+0000","last_peered":"2024-05-30T16:50:02.219146+0000","last_clean":"2024-05-30T16:50:02.219146+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:50:02.219146+0000","last_undegraded":"2024-05-30T16:50:02.219146+0000","last_fullsized":"2024-05-30T16:50:02.219146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:47.529393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219670+0000","last_change":"2024-05-30T16:50:01.218092+0000","last_active":"2024-05-30T16:50:02.219670+0000","last_peered":"2024-05-30T16:50:02.219670+0000","last_clean":"2024-05-30T16:50:02.219670+0000","last_became_active":"2024-05-30T16:50:01.217748+0000","last_became_peered":"2024-05-30T16:50:01.217748+0000","last_unstale":"2024-05-30T16:50:02.219670+0000","last_undegraded":"2024-05-30T16:50:02.219670+0000","last_fullsized":"2024-05-30T16:50:02.219670+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:12.631874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220962+0000","last_change":"2024-05-30T16:50:00.201874+0000","last_active":"2024-05-30T16:50:02.220962+0000","last_peered":"2024-05-30T16:50:02.220962+0000","last_clean":"2024-05-30T16:50:02.220962+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:50:02.220962+0000","last_undegraded":"2024-05-30T16:50:02.220962+0000","last_fullsized":"2024-05-30T16:50:02.220962+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524599+0000","last_change":"2024-05-30T16:50:01.216958+0000","last_active":"2024-05-30T16:50:03.524599+0000","last_peered":"2024-05-30T16:50:03.524599+0000","last_clean":"2024-05-30T16:50:03.524599+0000","last_became_active":"2024-05-30T16:50:01.216443+0000","last_became_peered":"2024-05-30T16:50:01.216443+0000","last_unstale":"2024-05-30T16:50:03.524599+0000","last_undegraded":"2024-05-30T16:50:03.524599+0000","last_fullsized":"2024-05-30T16:50:03.524599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:13:56.465266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526307+0000","last_change":"2024-05-30T16:50:00.202315+0000","last_active":"2024-05-30T16:50:03.526307+0000","last_peered":"2024-05-30T16:50:03.526307+0000","last_clean":"2024-05-30T16:50:03.526307+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:50:03.526307+0000","last_undegraded":"2024-05-30T16:50:03.526307+0000","last_fullsized":"2024-05-30T16:50:03.526307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:07.542490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.264141+0000","last_change":"2024-05-30T16:50:01.217916+0000","last_active":"2024-05-30T16:50:03.264141+0000","last_peered":"2024-05-30T16:50:03.264141+0000","last_clean":"2024-05-30T16:50:03.264141+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:50:03.264141+0000","last_undegraded":"2024-05-30T16:50:03.264141+0000","last_fullsized":"2024-05-30T16:50:03.264141+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220233+0000","last_change":"2024-05-30T16:50:00.204870+0000","last_active":"2024-05-30T16:50:02.220233+0000","last_peered":"2024-05-30T16:50:02.220233+0000","last_clean":"2024-05-30T16:50:02.220233+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:50:02.220233+0000","last_undegraded":"2024-05-30T16:50:02.220233+0000","last_fullsized":"2024-05-30T16:50:02.220233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:08.366805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.263849+0000","last_change":"2024-05-30T16:50:01.219838+0000","last_active":"2024-05-30T16:50:03.263849+0000","last_peered":"2024-05-30T16:50:03.263849+0000","last_clean":"2024-05-30T16:50:03.263849+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:50:03.263849+0000","last_undegraded":"2024-05-30T16:50:03.263849+0000","last_fullsized":"2024-05-30T16:50:03.263849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.228114+0000","last_change":"2024-05-30T16:50:00.207506+0000","last_active":"2024-05-30T16:50:02.228114+0000","last_peered":"2024-05-30T16:50:02.228114+0000","last_clean":"2024-05-30T16:50:02.228114+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:50:02.228114+0000","last_undegraded":"2024-05-30T16:50:02.228114+0000","last_fullsized":"2024-05-30T16:50:02.228114+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:47.941977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.263962+0000","last_change":"2024-05-30T16:50:01.220513+0000","last_active":"2024-05-30T16:50:03.263962+0000","last_peered":"2024-05-30T16:50:03.263962+0000","last_clean":"2024-05-30T16:50:03.263962+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:50:03.263962+0000","last_undegraded":"2024-05-30T16:50:03.263962+0000","last_fullsized":"2024-05-30T16:50:03.263962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:23.546971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.230974+0000","last_change":"2024-05-30T16:50:00.199775+0000","last_active":"2024-05-30T16:50:02.230974+0000","last_peered":"2024-05-30T16:50:02.230974+0000","last_clean":"2024-05-30T16:50:02.230974+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:50:02.230974+0000","last_undegraded":"2024-05-30T16:50:02.230974+0000","last_fullsized":"2024-05-30T16:50:02.230974+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:11.926104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231943+0000","last_change":"2024-05-30T16:50:01.212934+0000","last_active":"2024-05-30T16:50:02.231943+0000","last_peered":"2024-05-30T16:50:02.231943+0000","last_clean":"2024-05-30T16:50:02.231943+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:50:02.231943+0000","last_undegraded":"2024-05-30T16:50:02.231943+0000","last_fullsized":"2024-05-30T16:50:02.231943+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.221599+0000","last_change":"2024-05-30T16:50:00.206485+0000","last_active":"2024-05-30T16:50:02.221599+0000","last_peered":"2024-05-30T16:50:02.221599+0000","last_clean":"2024-05-30T16:50:02.221599+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:50:02.221599+0000","last_undegraded":"2024-05-30T16:50:02.221599+0000","last_fullsized":"2024-05-30T16:50:02.221599+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:46.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227701+0000","last_change":"2024-05-30T16:50:01.225452+0000","last_active":"2024-05-30T16:50:02.227701+0000","last_peered":"2024-05-30T16:50:02.227701+0000","last_clean":"2024-05-30T16:50:02.227701+0000","last_became_active":"2024-05-30T16:50:01.224834+0000","last_became_peered":"2024-05-30T16:50:01.224834+0000","last_unstale":"2024-05-30T16:50:02.227701+0000","last_undegraded":"2024-05-30T16:50:02.227701+0000","last_fullsized":"2024-05-30T16:50:02.227701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.227979+0000","last_change":"2024-05-30T16:50:00.209889+0000","last_active":"2024-05-30T16:50:02.227979+0000","last_peered":"2024-05-30T16:50:02.227979+0000","last_clean":"2024-05-30T16:50:02.227979+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:50:02.227979+0000","last_undegraded":"2024-05-30T16:50:02.227979+0000","last_fullsized":"2024-05-30T16:50:02.227979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:00.581262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.526698+0000","last_change":"2024-05-30T16:50:01.222012+0000","last_active":"2024-05-30T16:50:03.526698+0000","last_peered":"2024-05-30T16:50:03.526698+0000","last_clean":"2024-05-30T16:50:03.526698+0000","last_became_active":"2024-05-30T16:50:01.221622+0000","last_became_peered":"2024-05-30T16:50:01.221622+0000","last_unstale":"2024-05-30T16:50:03.526698+0000","last_undegraded":"2024-05-30T16:50:03.526698+0000","last_fullsized":"2024-05-30T16:50:03.526698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:43.760509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524929+0000","last_change":"2024-05-30T16:50:00.202834+0000","last_active":"2024-05-30T16:50:03.524929+0000","last_peered":"2024-05-30T16:50:03.524929+0000","last_clean":"2024-05-30T16:50:03.524929+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:50:03.524929+0000","last_undegraded":"2024-05-30T16:50:03.524929+0000","last_fullsized":"2024-05-30T16:50:03.524929+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:19:37.632432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.527125+0000","last_change":"2024-05-30T16:50:01.224914+0000","last_active":"2024-05-30T16:50:03.527125+0000","last_peered":"2024-05-30T16:50:03.527125+0000","last_clean":"2024-05-30T16:50:03.527125+0000","last_became_active":"2024-05-30T16:50:01.224600+0000","last_became_peered":"2024-05-30T16:50:01.224600+0000","last_unstale":"2024-05-30T16:50:03.527125+0000","last_undegraded":"2024-05-30T16:50:03.527125+0000","last_fullsized":"2024-05-30T16:50:03.527125+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.231605+0000","last_change":"2024-05-30T16:50:00.204452+0000","last_active":"2024-05-30T16:50:02.231605+0000","last_peered":"2024-05-30T16:50:02.231605+0000","last_clean":"2024-05-30T16:50:02.231605+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:50:02.231605+0000","last_undegraded":"2024-05-30T16:50:02.231605+0000","last_fullsized":"2024-05-30T16:50:02.231605+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:54.227101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524675+0000","last_change":"2024-05-30T16:50:01.214457+0000","last_active":"2024-05-30T16:50:03.524675+0000","last_peered":"2024-05-30T16:50:03.524675+0000","last_clean":"2024-05-30T16:50:03.524675+0000","last_became_active":"2024-05-30T16:50:01.214152+0000","last_became_peered":"2024-05-30T16:50:01.214152+0000","last_unstale":"2024-05-30T16:50:03.524675+0000","last_undegraded":"2024-05-30T16:50:03.524675+0000","last_fullsized":"2024-05-30T16:50:03.524675+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:48.139986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.524514+0000","last_change":"2024-05-30T16:50:00.207741+0000","last_active":"2024-05-30T16:50:03.524514+0000","last_peered":"2024-05-30T16:50:03.524514+0000","last_clean":"2024-05-30T16:50:03.524514+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:50:03.524514+0000","last_undegraded":"2024-05-30T16:50:03.524514+0000","last_fullsized":"2024-05-30T16:50:03.524514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:44.907107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220429+0000","last_change":"2024-05-30T16:50:01.214782+0000","last_active":"2024-05-30T16:50:02.220429+0000","last_peered":"2024-05-30T16:50:02.220429+0000","last_clean":"2024-05-30T16:50:02.220429+0000","last_became_active":"2024-05-30T16:50:01.214454+0000","last_became_peered":"2024-05-30T16:50:01.214454+0000","last_unstale":"2024-05-30T16:50:02.220429+0000","last_undegraded":"2024-05-30T16:50:02.220429+0000","last_fullsized":"2024-05-30T16:50:02.220429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219255+0000","last_change":"2024-05-30T16:50:00.213146+0000","last_active":"2024-05-30T16:50:02.219255+0000","last_peered":"2024-05-30T16:50:02.219255+0000","last_clean":"2024-05-30T16:50:02.219255+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:50:02.219255+0000","last_undegraded":"2024-05-30T16:50:02.219255+0000","last_fullsized":"2024-05-30T16:50:02.219255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:47.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219083+0000","last_change":"2024-05-30T16:50:01.210290+0000","last_active":"2024-05-30T16:50:02.219083+0000","last_peered":"2024-05-30T16:50:02.219083+0000","last_clean":"2024-05-30T16:50:02.219083+0000","last_became_active":"2024-05-30T16:50:01.209939+0000","last_became_peered":"2024-05-30T16:50:01.209939+0000","last_unstale":"2024-05-30T16:50:02.219083+0000","last_undegraded":"2024-05-30T16:50:02.219083+0000","last_fullsized":"2024-05-30T16:50:02.219083+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:20:05.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.217570+0000","last_change":"2024-05-30T16:50:00.203989+0000","last_active":"2024-05-30T16:50:02.217570+0000","last_peered":"2024-05-30T16:50:02.217570+0000","last_clean":"2024-05-30T16:50:02.217570+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:50:02.217570+0000","last_undegraded":"2024-05-30T16:50:02.217570+0000","last_fullsized":"2024-05-30T16:50:02.217570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.219709+0000","last_change":"2024-05-30T16:50:01.212225+0000","last_active":"2024-05-30T16:50:02.219709+0000","last_peered":"2024-05-30T16:50:02.219709+0000","last_clean":"2024-05-30T16:50:02.219709+0000","last_became_active":"2024-05-30T16:50:01.211630+0000","last_became_peered":"2024-05-30T16:50:01.211630+0000","last_unstale":"2024-05-30T16:50:02.219709+0000","last_undegraded":"2024-05-30T16:50:02.219709+0000","last_fullsized":"2024-05-30T16:50:02.219709+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220211+0000","last_change":"2024-05-30T16:50:00.210481+0000","last_active":"2024-05-30T16:50:02.220211+0000","last_peered":"2024-05-30T16:50:02.220211+0000","last_clean":"2024-05-30T16:50:02.220211+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:50:02.220211+0000","last_undegraded":"2024-05-30T16:50:02.220211+0000","last_fullsized":"2024-05-30T16:50:02.220211+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:41:46.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.263865+0000","last_change":"2024-05-30T16:50:01.218627+0000","last_active":"2024-05-30T16:50:03.263865+0000","last_peered":"2024-05-30T16:50:03.263865+0000","last_clean":"2024-05-30T16:50:03.263865+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:50:03.263865+0000","last_undegraded":"2024-05-30T16:50:03.263865+0000","last_fullsized":"2024-05-30T16:50:03.263865+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:02.220571+0000","last_change":"2024-05-30T16:50:00.210033+0000","last_active":"2024-05-30T16:50:02.220571+0000","last_peered":"2024-05-30T16:50:02.220571+0000","last_clean":"2024-05-30T16:50:02.220571+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:50:02.220571+0000","last_undegraded":"2024-05-30T16:50:02.220571+0000","last_fullsized":"2024-05-30T16:50:02.220571+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:15.927433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":267,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-05-30T16:50:03.525827+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:50:03.525827+0000","last_peered":"2024-05-30T16:50:03.525827+0000","last_clean":"2024-05-30T16:50:03.525827+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:50:03.525827+0000","last_undegraded":"2024-05-30T16:50:03.525827+0000","last_fullsized":"2024-05-30T16:50:03.525827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58992,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312848,"statfs":{"total":96636764160,"available":96576356352,"internally_reserved":0,"allocated":1478656,"data_stored":964331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54252,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317588,"statfs":{"total":96636764160,"available":96581210112,"internally_reserved":0,"allocated":884736,"data_stored":373439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54248,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317592,"statfs":{"total":96636764160,"available":96581214208,"internally_reserved":0,"allocated":880640,"data_stored":373437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54248,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317592,"statfs":{"total":96636764160,"available":96581214208,"internally_reserved":0,"allocated":880640,"data_stored":373417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58412,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313428,"statfs":{"total":96636764160,"available":96576950272,"internally_reserved":0,"allocated":884736,"data_stored":373459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574953,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50096,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321744,"statfs":{"total":96636764160,"available":96585465856,"internally_reserved":0,"allocated":888832,"data_stored":374959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58428,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313412,"statfs":{"total":96636764160,"available":96576933888,"internally_reserved":0,"allocated":897024,"data_stored":375575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58992,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312848,"statfs":{"total":96636764160,"available":96576356352,"internally_reserved":0,"allocated":1470464,"data_stored":963715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:50:11.018 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:50:11.018 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T16:50:11.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.268+0000 7fca9fe00640 1 Processor -- start 2024-05-30T16:50:11.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.268+0000 7fca9fe00640 1 -- start start 2024-05-30T16:50:11.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.269+0000 7fca9fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcaa0146010 0x7fcaa01600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.269+0000 7fca9fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcaa0072470 0x7fcaa00cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa0160b90 con 0x7fcaa0160630 2024-05-30T16:50:11.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa0160e70 con 0x7fcaa0072470 2024-05-30T16:50:11.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9fe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa00cce00 con 0x7fcaa0146010 2024-05-30T16:50:11.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcaa0072470 0x7fcaa00cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcaa0072470 0x7fcaa00cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43076/0 (socket says 172.21.15.144:43076) 2024-05-30T16:50:11.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9f400640 1 -- 172.21.15.144:0/789014184 learned_addr learned my addr 172.21.15.144:0/789014184 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:11.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9ea00640 1 --2- 172.21.15.144:0/789014184 >> v2:172.21.15.149:3300/0 conn(0x7fcaa0146010 0x7fcaa01600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9f400640 1 -- 172.21.15.144:0/789014184 >> v2:172.21.15.149:3300/0 conn(0x7fcaa0146010 msgr2=0x7fcaa01600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:11.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9f400640 1 --2- 172.21.15.144:0/789014184 >> v2:172.21.15.149:3300/0 conn(0x7fcaa0146010 0x7fcaa01600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9f400640 1 -- 172.21.15.144:0/789014184 >> v1:172.21.15.144:6789/0 conn(0x7fcaa0160630 legacy=0x7fcaa0071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.270+0000 7fca9f400640 1 -- 172.21.15.144:0/789014184 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa00cd0e0 con 0x7fcaa0072470 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.271+0000 7fca9f400640 1 --2- 172.21.15.144:0/789014184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0072470 0x7fcaa00cd8e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcaa006c980 tx=0x7fca9802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c430b4ffa2b66a16 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.272+0000 7fca9e000640 1 -- 172.21.15.144:0/789014184 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98036070 con 0x7fcaa0072470 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.272+0000 7fca9e000640 1 -- 172.21.15.144:0/789014184 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca98031600 con 0x7fcaa0072470 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.272+0000 7fca9e000640 1 -- 172.21.15.144:0/789014184 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca980319d0 con 0x7fcaa0072470 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.272+0000 7fca9fe00640 1 -- 172.21.15.144:0/789014184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0072470 msgr2=0x7fcaa00cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.272+0000 7fca9fe00640 1 --2- 172.21.15.144:0/789014184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0072470 0x7fcaa00cd8e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcaa006c980 tx=0x7fca9802a730 comp rx=0 tx=0).stop 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.272+0000 7fca9fe00640 1 -- 172.21.15.144:0/789014184 shutdown_connections 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.272+0000 7fca9fe00640 1 --2- 172.21.15.144:0/789014184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0072470 0x7fcaa00cd8e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.272+0000 7fca9fe00640 1 --2- 172.21.15.144:0/789014184 >> v2:172.21.15.149:3300/0 conn(0x7fcaa0146010 0x7fcaa01600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.272+0000 7fca9fe00640 1 -- 172.21.15.144:0/789014184 >> 172.21.15.144:0/789014184 conn(0x7fcaa00b2160 msgr2=0x7fcaa00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.273+0000 7fca9fe00640 1 -- 172.21.15.144:0/789014184 shutdown_connections 2024-05-30T16:50:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.273+0000 7fca9fe00640 1 -- 172.21.15.144:0/789014184 wait complete. 2024-05-30T16:50:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.274+0000 7fca9fe00640 1 Processor -- start 2024-05-30T16:50:11.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.275+0000 7fca9fe00640 1 -- start start 2024-05-30T16:50:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaa0072470 0x7fcaa01f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaa0146010 0x7fcaa01350b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0160630 0x7fcaa015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa015cea0 con 0x7fcaa0160630 2024-05-30T16:50:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa015cd20 con 0x7fcaa0146010 2024-05-30T16:50:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa00cde20 con 0x7fcaa0072470 2024-05-30T16:50:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0160630 0x7fcaa015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0160630 0x7fcaa015f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43080/0 (socket says 172.21.15.144:43080) 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9f400640 1 -- 172.21.15.144:0/4213719217 learned_addr learned my addr 172.21.15.144:0/4213719217 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9ea00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaa0072470 0x7fcaa01f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca96000640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaa0146010 0x7fcaa01350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9f400640 1 -- 172.21.15.144:0/4213719217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaa0072470 msgr2=0x7fcaa01f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.276+0000 7fca9f400640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaa0072470 0x7fcaa01f4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.277+0000 7fca9f400640 1 -- 172.21.15.144:0/4213719217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaa0146010 msgr2=0x7fcaa01350b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.277+0000 7fca9f400640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaa0146010 0x7fcaa01350b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.277+0000 7fca9f400640 1 -- 172.21.15.144:0/4213719217 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa01f5240 con 0x7fcaa0160630 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.277+0000 7fca96000640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaa0146010 0x7fcaa01350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.277+0000 7fca9f400640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0160630 0x7fcaa015f0f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fca98034040 tx=0x7fca98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.278+0000 7fca97e00640 1 -- 172.21.15.144:0/4213719217 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98036050 con 0x7fcaa0160630 2024-05-30T16:50:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.278+0000 7fca97e00640 1 -- 172.21.15.144:0/4213719217 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca98042070 con 0x7fcaa0160630 2024-05-30T16:50:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.278+0000 7fca97e00640 1 -- 172.21.15.144:0/4213719217 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98009510 con 0x7fcaa0160630 2024-05-30T16:50:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.278+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa01f5520 con 0x7fcaa0160630 2024-05-30T16:50:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.278+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa01f5ae0 con 0x7fcaa0160630 2024-05-30T16:50:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.279+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa0075570 con 0x7fcaa0160630 2024-05-30T16:50:11.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.280+0000 7fca97e00640 1 -- 172.21.15.144:0/4213719217 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fca98007bf0 con 0x7fcaa0160630 2024-05-30T16:50:11.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.281+0000 7fca97e00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fca7c06d5e0 0x7fca7c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.281+0000 7fca97e00640 1 -- 172.21.15.144:0/4213719217 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7fca980ab4b0 con 0x7fcaa0160630 2024-05-30T16:50:11.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.281+0000 7fca9ea00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fca7c06d5e0 0x7fca7c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.282+0000 7fca9ea00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fca7c06d5e0 0x7fca7c06faa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.285+0000 7fca97e00640 1 -- 172.21.15.144:0/4213719217 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca9807b330 con 0x7fcaa0160630 2024-05-30T16:50:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.561+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fcaa006fc30 con 0x7fcaa0160630 2024-05-30T16:50:11.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.565+0000 7fca97e00640 1 -- 172.21.15.144:0/4213719217 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fca9807ac30 con 0x7fcaa0160630 2024-05-30T16:50:11.567 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-05-30T16:50:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQARrFhmvPgpJxAAgP19c9mqYiRdQ2RGtMIvgA== 2024-05-30T16:50:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-05-30T16:50:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-05-30T16:50:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T16:50:11.567 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-05-30T16:50:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.568+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fca7c06d5e0 msgr2=0x7fca7c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.568+0000 7fca9fe00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fca7c06d5e0 0x7fca7c06faa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca90008040 comp rx=0 tx=0).stop 2024-05-30T16:50:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.568+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0160630 msgr2=0x7fcaa015f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.568+0000 7fca9fe00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0160630 0x7fcaa015f0f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fca98034040 tx=0x7fca98004a40 comp rx=0 tx=0).stop 2024-05-30T16:50:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.569+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 shutdown_connections 2024-05-30T16:50:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.569+0000 7fca9fe00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fca7c06d5e0 0x7fca7c06faa0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.569+0000 7fca9fe00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaa0160630 0x7fcaa015f0f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.569+0000 7fca9fe00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaa0146010 0x7fcaa01350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.569+0000 7fca9fe00640 1 --2- 172.21.15.144:0/4213719217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaa0072470 0x7fcaa01f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.569+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 >> 172.21.15.144:0/4213719217 conn(0x7fcaa00b2160 msgr2=0x7fcaa006dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.569+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 shutdown_connections 2024-05-30T16:50:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.569+0000 7fca9fe00640 1 -- 172.21.15.144:0/4213719217 wait complete. 2024-05-30T16:50:11.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:50:11.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.788+0000 7f82d3400640 1 Processor -- start 2024-05-30T16:50:11.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.788+0000 7f82d3400640 1 -- start start 2024-05-30T16:50:11.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.790+0000 7f82d3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82cc1418f0 0x7f82cc15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.790+0000 7f82d3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc144020 0x7f82cc06e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.790+0000 7f82d3400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82cc0b3fd0 con 0x7f82cc141510 2024-05-30T16:50:11.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.790+0000 7f82d3400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f82cc06dfc0 con 0x7f82cc1418f0 2024-05-30T16:50:11.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.790+0000 7f82d3400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82cc144790 con 0x7f82cc144020 2024-05-30T16:50:11.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.790+0000 7f82cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82cc1418f0 0x7f82cc15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.790+0000 7f82cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82cc1418f0 0x7f82cc15f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43090/0 (socket says 172.21.15.144:43090) 2024-05-30T16:50:11.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.790+0000 7f82cbe00640 1 -- 172.21.15.144:0/3630437418 learned_addr learned my addr 172.21.15.144:0/3630437418 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:11.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.791+0000 7f82d1400640 1 --2- 172.21.15.144:0/3630437418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc144020 0x7f82cc06e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.791+0000 7f82cbe00640 1 -- 172.21.15.144:0/3630437418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc144020 msgr2=0x7f82cc06e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:11.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.791+0000 7f82cbe00640 1 --2- 172.21.15.144:0/3630437418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc144020 0x7f82cc06e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.791+0000 7f82cbe00640 1 -- 172.21.15.144:0/3630437418 >> v1:172.21.15.144:6789/0 conn(0x7f82cc141510 legacy=0x7f82cc0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.791+0000 7f82cbe00640 1 -- 172.21.15.144:0/3630437418 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82cc144a70 con 0x7f82cc1418f0 2024-05-30T16:50:11.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.791+0000 7f82d1400640 1 --2- 172.21.15.144:0/3630437418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc144020 0x7f82cc06e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:11.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.792+0000 7f82cbe00640 1 --2- 172.21.15.144:0/3630437418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc1418f0 0x7f82cc15f8f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009e50 tx=0x7f82b402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9f0503a38afed8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:11.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.792+0000 7f82cb400640 1 -- 172.21.15.144:0/3630437418 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4036070 con 0x7f82cc1418f0 2024-05-30T16:50:11.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82cb400640 1 -- 172.21.15.144:0/3630437418 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b4031600 con 0x7f82cc1418f0 2024-05-30T16:50:11.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82cb400640 1 -- 172.21.15.144:0/3630437418 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b40319d0 con 0x7f82cc1418f0 2024-05-30T16:50:11.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82d3400640 1 -- 172.21.15.144:0/3630437418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc1418f0 msgr2=0x7f82cc15f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82d3400640 1 --2- 172.21.15.144:0/3630437418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc1418f0 0x7f82cc15f8f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009e50 tx=0x7f82b402a610 comp rx=0 tx=0).stop 2024-05-30T16:50:11.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82d3400640 1 -- 172.21.15.144:0/3630437418 shutdown_connections 2024-05-30T16:50:11.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82d3400640 1 --2- 172.21.15.144:0/3630437418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc144020 0x7f82cc06e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82d3400640 1 --2- 172.21.15.144:0/3630437418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc1418f0 0x7f82cc15f8f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82d3400640 1 -- 172.21.15.144:0/3630437418 >> 172.21.15.144:0/3630437418 conn(0x7f82cc06bd00 msgr2=0x7f82cc06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:11.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82d3400640 1 -- 172.21.15.144:0/3630437418 shutdown_connections 2024-05-30T16:50:11.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.793+0000 7f82d3400640 1 -- 172.21.15.144:0/3630437418 wait complete. 2024-05-30T16:50:11.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.795+0000 7f82d3400640 1 Processor -- start 2024-05-30T16:50:11.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.795+0000 7f82d3400640 1 -- start start 2024-05-30T16:50:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.796+0000 7f82d3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc141510 0x7f82cc157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.796+0000 7f82d3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82cc1418f0 0x7f82cc0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.796+0000 7f82d3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc144020 0x7f82cc140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.796+0000 7f82d3400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc144490 con 0x7f82cc144020 2024-05-30T16:50:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.796+0000 7f82d3400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc06e210 con 0x7f82cc1418f0 2024-05-30T16:50:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.796+0000 7f82d3400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82cc0b5b50 con 0x7f82cc141510 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc144020 0x7f82cc140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc144020 0x7f82cc140030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43098/0 (socket says 172.21.15.144:43098) 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d1400640 1 -- 172.21.15.144:0/865785080 learned_addr learned my addr 172.21.15.144:0/865785080 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d0a00640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc141510 0x7f82cc157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82cbe00640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82cc1418f0 0x7f82cc0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d1400640 1 -- 172.21.15.144:0/865785080 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc141510 msgr2=0x7f82cc157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d1400640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc141510 0x7f82cc157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d1400640 1 -- 172.21.15.144:0/865785080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82cc1418f0 msgr2=0x7f82cc0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d1400640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82cc1418f0 0x7f82cc0b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d1400640 1 -- 172.21.15.144:0/865785080 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82cc1578c0 con 0x7f82cc144020 2024-05-30T16:50:11.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.797+0000 7f82d1400640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc144020 0x7f82cc140030 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c7f0 tx=0x7f82c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:11.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.798+0000 7f82c8c00640 1 -- 172.21.15.144:0/865785080 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c4015020 con 0x7f82cc144020 2024-05-30T16:50:11.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.798+0000 7f82c8c00640 1 -- 172.21.15.144:0/865785080 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c4004230 con 0x7f82cc144020 2024-05-30T16:50:11.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.798+0000 7f82c8c00640 1 -- 172.21.15.144:0/865785080 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c4007620 con 0x7f82cc144020 2024-05-30T16:50:11.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.798+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82cc157b60 con 0x7f82cc144020 2024-05-30T16:50:11.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.798+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82cc158120 con 0x7f82cc144020 2024-05-30T16:50:11.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.799+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82cc068b90 con 0x7f82cc144020 2024-05-30T16:50:11.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.800+0000 7f82c8c00640 1 -- 172.21.15.144:0/865785080 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f82c4018020 con 0x7f82cc144020 2024-05-30T16:50:11.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.801+0000 7f82c8c00640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82a806d5e0 0x7f82a806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:11.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.801+0000 7f82c8c00640 1 -- 172.21.15.144:0/865785080 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f82c408a830 con 0x7f82cc144020 2024-05-30T16:50:11.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.801+0000 7f82d0a00640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82a806d5e0 0x7f82a806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:11.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.802+0000 7f82d0a00640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82a806d5e0 0x7f82a806faa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f82bc001640 tx=0x7f82bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:11.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:11.805+0000 7f82c8c00640 1 -- 172.21.15.144:0/865785080 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f82c401f020 con 0x7f82cc144020 2024-05-30T16:50:12.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.026+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82cc0b64b0 con 0x7f82cc144020 2024-05-30T16:50:12.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.027+0000 7f82c8c00640 1 -- 172.21.15.144:0/865785080 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5195 (secure 0 0 0) 0x7f82c405a770 con 0x7f82cc144020 2024-05-30T16:50:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:12.029 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2114834818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2114834818},{"type":"v1","addr":"172.21.15.149:6835","nonce":2114834818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6435,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1242312372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1242312372},{"type":"v1","addr":"172.21.15.144:6835","nonce":1242312372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3989377290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3989377290},{"type":"v1","addr":"172.21.15.144:6837","nonce":3989377290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:50:00.647053+0000","modified":"2024-05-30T16:50:03.707309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6833/1951637959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1951637959},{"type":"v1","addr":"172.21.15.149:6833","nonce":1951637959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6447,"qdb_cluster":[6447]},"id":5}]} 2024-05-30T16:50:12.029 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 45 2024-05-30T16:50:12.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82a806d5e0 msgr2=0x7f82a806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82a806d5e0 0x7f82a806faa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f82bc001640 tx=0x7f82bc009040 comp rx=0 tx=0).stop 2024-05-30T16:50:12.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc144020 msgr2=0x7f82cc140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc144020 0x7f82cc140030 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c7f0 tx=0x7f82c400ccb0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 shutdown_connections 2024-05-30T16:50:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f82a806d5e0 0x7f82a806faa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc144020 0x7f82cc140030 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82cc1418f0 0x7f82cc0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 --2- 172.21.15.144:0/865785080 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82cc141510 0x7f82cc157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 >> 172.21.15.144:0/865785080 conn(0x7f82cc06bd00 msgr2=0x7f82cc141d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 shutdown_connections 2024-05-30T16:50:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.030+0000 7f82d3400640 1 -- 172.21.15.144:0/865785080 wait complete. 2024-05-30T16:50:12.453 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T16:50:00.647053+0000', 'modified': '2024-05-30T16:50:03.707309+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6447}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6447': {'gid': 6447, 'name': 'b', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6833/1951637959', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6832', 'nonce': 1951637959}, {'type': 'v1', 'addr': '172.21.15.149:6833', 'nonce': 1951637959}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6447, 'qdb_cluster': [6447]} 2024-05-30T16:50:12.453 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T16:50:12.453 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-30T16:50:12.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.661+0000 7efde2a00640 1 Processor -- start 2024-05-30T16:50:12.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.661+0000 7efde2a00640 1 -- start start 2024-05-30T16:50:12.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.662+0000 7efde2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efddc15eac0 0x7efddc0b9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.662+0000 7efde2a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efddc0b6150 0x7efddc0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.662+0000 7efde2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0d27e0 0x7efddc0d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.662+0000 7efde2a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efddc0b8da0 con 0x7efddc15eac0 2024-05-30T16:50:12.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.662+0000 7efde2a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7efddc0b9080 con 0x7efddc0b6150 2024-05-30T16:50:12.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.662+0000 7efde2a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efddc0b9360 con 0x7efddc0d27e0 2024-05-30T16:50:12.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde1600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efddc15eac0 0x7efddc0b9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde1600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efddc15eac0 0x7efddc0b9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43104/0 (socket says 172.21.15.144:43104) 2024-05-30T16:50:12.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde1600640 1 -- 172.21.15.144:0/585313052 learned_addr learned my addr 172.21.15.144:0/585313052 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:12.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde2000640 1 --2- 172.21.15.144:0/585313052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0d27e0 0x7efddc0d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde0c00640 1 --2- 172.21.15.144:0/585313052 >> v2:172.21.15.149:3300/0 conn(0x7efddc0b6150 0x7efddc0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde1600640 1 -- 172.21.15.144:0/585313052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0d27e0 msgr2=0x7efddc0d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde1600640 1 --2- 172.21.15.144:0/585313052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0d27e0 0x7efddc0d2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde1600640 1 -- 172.21.15.144:0/585313052 >> v2:172.21.15.149:3300/0 conn(0x7efddc0b6150 msgr2=0x7efddc0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde1600640 1 --2- 172.21.15.144:0/585313052 >> v2:172.21.15.149:3300/0 conn(0x7efddc0b6150 0x7efddc0b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.663+0000 7efde1600640 1 -- 172.21.15.144:0/585313052 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc0b9640 con 0x7efddc15eac0 2024-05-30T16:50:12.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.665+0000 7efde1600640 1 --2- 172.21.15.144:0/585313052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 0x7efddc0b9ff0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efddc0d1fe0 tx=0x7efdd002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357ed8805f7510d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.665+0000 7efddbe00640 1 -- 172.21.15.144:0/585313052 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0036070 con 0x7efddc15eac0 2024-05-30T16:50:12.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.665+0000 7efddbe00640 1 -- 172.21.15.144:0/585313052 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd0031600 con 0x7efddc15eac0 2024-05-30T16:50:12.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.665+0000 7efddbe00640 1 -- 172.21.15.144:0/585313052 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd00319d0 con 0x7efddc15eac0 2024-05-30T16:50:12.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.665+0000 7efde2a00640 1 -- 172.21.15.144:0/585313052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 msgr2=0x7efddc0b9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.665+0000 7efde2a00640 1 --2- 172.21.15.144:0/585313052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 0x7efddc0b9ff0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efddc0d1fe0 tx=0x7efdd002a730 comp rx=0 tx=0).stop 2024-05-30T16:50:12.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.666+0000 7efde2a00640 1 -- 172.21.15.144:0/585313052 shutdown_connections 2024-05-30T16:50:12.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.666+0000 7efde2a00640 1 --2- 172.21.15.144:0/585313052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0d27e0 0x7efddc0d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.666+0000 7efde2a00640 1 --2- 172.21.15.144:0/585313052 >> v2:172.21.15.149:3300/0 conn(0x7efddc0b6150 0x7efddc0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.666+0000 7efde2a00640 1 --2- 172.21.15.144:0/585313052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 0x7efddc0b9ff0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.666+0000 7efde2a00640 1 -- 172.21.15.144:0/585313052 >> 172.21.15.144:0/585313052 conn(0x7efddc06d050 msgr2=0x7efddc06d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:12.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.666+0000 7efde2a00640 1 -- 172.21.15.144:0/585313052 shutdown_connections 2024-05-30T16:50:12.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.666+0000 7efde2a00640 1 -- 172.21.15.144:0/585313052 wait complete. 2024-05-30T16:50:12.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.667+0000 7efde2a00640 1 Processor -- start 2024-05-30T16:50:12.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.668+0000 7efde2a00640 1 -- start start 2024-05-30T16:50:12.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.668+0000 7efde2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0b6150 0x7efddc14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.668+0000 7efde2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0d27e0 0x7efddc160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.668+0000 7efde2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 0x7efddc0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.668+0000 7efde2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efddc0ba6b0 con 0x7efddc15eac0 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.668+0000 7efde2a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efddc0ba530 con 0x7efddc0d27e0 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.668+0000 7efde2a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efddc0d3130 con 0x7efddc0b6150 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 0x7efddc0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 0x7efddc0ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43106/0 (socket says 172.21.15.144:43106) 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde2000640 1 -- 172.21.15.144:0/3022911758 learned_addr learned my addr 172.21.15.144:0/3022911758 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde1600640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0b6150 0x7efddc14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde0c00640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0d27e0 0x7efddc160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde2000640 1 -- 172.21.15.144:0/3022911758 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0b6150 msgr2=0x7efddc14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde2000640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0b6150 0x7efddc14ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde2000640 1 -- 172.21.15.144:0/3022911758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0d27e0 msgr2=0x7efddc160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde2000640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0d27e0 0x7efddc160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde2000640 1 -- 172.21.15.144:0/3022911758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc160a90 con 0x7efddc15eac0 2024-05-30T16:50:12.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.669+0000 7efde1600640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0b6150 0x7efddc14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:12.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.670+0000 7efde2000640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 0x7efddc0ca520 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c820 tx=0x7efdd400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.670+0000 7efdd9600640 1 -- 172.21.15.144:0/3022911758 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4015070 con 0x7efddc15eac0 2024-05-30T16:50:12.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.670+0000 7efdd9600640 1 -- 172.21.15.144:0/3022911758 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd4004020 con 0x7efddc15eac0 2024-05-30T16:50:12.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.670+0000 7efdd9600640 1 -- 172.21.15.144:0/3022911758 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4004410 con 0x7efddc15eac0 2024-05-30T16:50:12.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.670+0000 7efde2a00640 1 -- 172.21.15.144:0/3022911758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efddc160d70 con 0x7efddc15eac0 2024-05-30T16:50:12.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.670+0000 7efde2a00640 1 -- 172.21.15.144:0/3022911758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efddc161330 con 0x7efddc15eac0 2024-05-30T16:50:12.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.673+0000 7efdd9600640 1 -- 172.21.15.144:0/3022911758 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7efdd4007830 con 0x7efddc15eac0 2024-05-30T16:50:12.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.674+0000 7efdd9600640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efdbc06d5e0 0x7efdbc06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.674+0000 7efdd9600640 1 -- 172.21.15.144:0/3022911758 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7efdd408a3d0 con 0x7efddc15eac0 2024-05-30T16:50:12.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.674+0000 7efde1600640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efdbc06d5e0 0x7efdbc06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.675+0000 7efde6db5740 1 Processor -- start 2024-05-30T16:50:12.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.675+0000 7efde6db5740 1 -- start start 2024-05-30T16:50:12.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.675+0000 7efde1600640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efdbc06d5e0 0x7efdbc06faa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efdd0033000 tx=0x7efdd0009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde6db5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365443490 0x564365446c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde6db5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564365447150 0x564365463090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde6db5740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5643654635d0 0x564365463a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde6db5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564365380b10 con 0x564365447150 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde6db5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5643653272b0 con 0x564365443490 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde6db5740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56436537cad0 con 0x5643654635d0 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564365447150 0x564365463090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564365447150 0x564365463090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43112/0 (socket says 172.21.15.144:43112) 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde0c00640 1 -- 172.21.15.144:0/2703383356 learned_addr learned my addr 172.21.15.144:0/2703383356 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde0c00640 1 -- 172.21.15.144:0/2703383356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5643654635d0 msgr2=0x564365463a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde0c00640 1 --2- 172.21.15.144:0/2703383356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5643654635d0 0x564365463a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde0c00640 1 -- 172.21.15.144:0/2703383356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365443490 msgr2=0x564365446c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde0c00640 1 --2- 172.21.15.144:0/2703383356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365443490 0x564365446c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.676+0000 7efde0c00640 1 -- 172.21.15.144:0/2703383356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643650932d0 con 0x564365447150 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.677+0000 7efde0c00640 1 --2- 172.21.15.144:0/2703383356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564365447150 0x564365463090 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efdc800cab0 tx=0x7efdc800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88bcb4481702d80 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.677+0000 7efdcdc00640 1 -- 172.21.15.144:0/2703383356 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8016020 con 0x564365447150 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.677+0000 7efdcdc00640 1 -- 172.21.15.144:0/2703383356 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8004240 con 0x564365447150 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.677+0000 7efdcdc00640 1 -- 172.21.15.144:0/2703383356 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc800e990 con 0x564365447150 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.677+0000 7efde6db5740 1 -- 172.21.15.144:0/2703383356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564365447150 msgr2=0x564365463090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.677+0000 7efde6db5740 1 --2- 172.21.15.144:0/2703383356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564365447150 0x564365463090 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efdc800cab0 tx=0x7efdc800cf70 comp rx=0 tx=0).stop 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.678+0000 7efde6db5740 1 -- 172.21.15.144:0/2703383356 shutdown_connections 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.678+0000 7efde6db5740 1 --2- 172.21.15.144:0/2703383356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5643654635d0 0x564365463a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.678+0000 7efde6db5740 1 --2- 172.21.15.144:0/2703383356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564365447150 0x564365463090 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.678+0000 7efde6db5740 1 --2- 172.21.15.144:0/2703383356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365443490 0x564365446c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.678+0000 7efde6db5740 1 -- 172.21.15.144:0/2703383356 >> 172.21.15.144:0/2703383356 conn(0x564365419470 msgr2=0x56436541a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:12.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.678+0000 7efde6db5740 1 -- 172.21.15.144:0/2703383356 shutdown_connections 2024-05-30T16:50:12.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.678+0000 7efde6db5740 1 -- 172.21.15.144:0/2703383356 wait complete. 2024-05-30T16:50:12.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.678+0000 7efde6db5740 1 -- start start 2024-05-30T16:50:12.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.679+0000 7efde6db5740 1 Processor -- start 2024-05-30T16:50:12.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde6db5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x56436545db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde6db5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x56436545e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde6db5740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56436543f6f0 0x564365449b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde6db5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5643654172a0 con 0x5643654635d0 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde6db5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56436533a570 con 0x564365447150 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde6db5740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x564365417580 con 0x56436543f6f0 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde6db5740 10 client.0 _ll_register_callbacks cb 0x564365308fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x56436545e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x56436545e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43122/0 (socket says 172.21.15.144:43122) 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde0c00640 1 -- 172.21.15.144:0/2562889199 learned_addr learned my addr 172.21.15.144:0/2562889199 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde0c00640 1 -- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56436543f6f0 msgr2=0x564365449b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde0c00640 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56436543f6f0 0x564365449b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde1600640 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x56436545db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde0c00640 1 -- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 msgr2=0x56436545db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde0c00640 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x56436545db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.680+0000 7efde0c00640 1 -- 172.21.15.144:0/2562889199 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56436515d6b0 con 0x5643654635d0 2024-05-30T16:50:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.681+0000 7efde0c00640 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x56436545e070 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efdc800e660 tx=0x7efdc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f5ba342f5332c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.681+0000 7efdc2000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.681+0000 7efdc2000640 1 -- 172.21.15.144:0/2562889199 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8003a20 con 0x5643654635d0 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.681+0000 7efdc2000640 1 -- 172.21.15.144:0/2562889199 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7efdc8003bc0 con 0x5643654635d0 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.681+0000 7efde6db5740 1 -- 172.21.15.144:0/2562889199 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdc8004240 con 0x5643654635d0 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.681+0000 7efdc2000640 1 -- 172.21.15.144:0/2562889199 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7efdc8003dc0 con 0x5643654635d0 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.681+0000 7efde6db5740 10 client.6594 fetch_fsmap learned FSMap version 45 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.681+0000 7efde6db5740 1 -- 172.21.15.144:0/2562889199 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x564365448f00 con 0x5643654635d0 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.682+0000 7efdc2000640 1 -- 172.21.15.144:0/2562889199 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8004240 con 0x5643654635d0 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.682+0000 7efdc2000640 1 -- 172.21.15.144:0/2562889199 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 45) ==== 3494+0+0 (secure 0 0 0) 0x7efdc8032020 con 0x5643654635d0 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.682+0000 7efde6db5740 10 client.6594 fetch_fsmap finished waiting for FSMap version 45 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.682+0000 7efde6db5740 10 client.6594 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.682+0000 7efde6db5740 20 client.6594 populate_metadata read hostname 'smithi144' 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.682+0000 7efde6db5740 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] conn(0x5643654755c0 0x5643654759a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.682+0000 7efde6db5740 4 client.6594 mds_command: new command op to 6447 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T16:50:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.682+0000 7efde6db5740 1 -- 172.21.15.144:0/2562889199 --> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56436538e530 con 0x5643654755c0 2024-05-30T16:50:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.683+0000 7efde1600640 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] conn(0x5643654755c0 0x5643654759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.684+0000 7efde1600640 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] conn(0x5643654755c0 0x5643654759a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452a470f209684e1 server_cookie=bb9b6238be305d1b in_seq=0 out_seq=0 2024-05-30T16:50:12.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.684+0000 7efdc2000640 10 client.6594 ms_handle_connect on v2:172.21.15.149:6832/1951637959 2024-05-30T16:50:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.686+0000 7efdc2000640 1 -- 172.21.15.144:0/2562889199 <== mds.0 v2:172.21.15.149:6832/1951637959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56436538e530 con 0x5643654755c0 2024-05-30T16:50:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.686+0000 7efdc2000640 10 client.6594 handle_command_reply: tid=0 2024-05-30T16:50:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.686+0000 7efde6db5740 1 client.6594 shutdown 2024-05-30T16:50:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 -- 172.21.15.144:0/2562889199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 msgr2=0x56436545e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x56436545e070 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efdc800e660 tx=0x7efdc8004730 comp rx=0 tx=0).stop 2024-05-30T16:50:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 -- 172.21.15.144:0/2562889199 shutdown_connections 2024-05-30T16:50:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] conn(0x5643654755c0 0x5643654759a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56436543f6f0 0x564365449b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x56436545e070 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 --2- 172.21.15.144:0/2562889199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x56436545db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 -- 172.21.15.144:0/2562889199 >> 172.21.15.144:0/2562889199 conn(0x564365443490 msgr2=0x5643654161b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efdc2000640 0 client.6594 ms_handle_reset on v2:172.21.15.149:6832/1951637959 2024-05-30T16:50:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 -- 172.21.15.144:0/2562889199 shutdown_connections 2024-05-30T16:50:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 1 -- 172.21.15.144:0/2562889199 wait complete. 2024-05-30T16:50:12.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.687+0000 7efde6db5740 20 client.6594 trim_cache size 0 max 16384 2024-05-30T16:50:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.707+0000 7efde6db5740 1 Processor -- start 2024-05-30T16:50:12.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.707+0000 7efde6db5740 1 -- start start 2024-05-30T16:50:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde6db5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436543f6f0 0x5643654424b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde6db5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x56436541ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde6db5740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5643654635d0 0x56436541d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde6db5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efddc200d60 con 0x56436543f6f0 2024-05-30T16:50:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde6db5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efddc1fff00 con 0x564365447150 2024-05-30T16:50:12.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde6db5740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efddc0c88e0 con 0x5643654635d0 2024-05-30T16:50:12.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436543f6f0 0x5643654424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436543f6f0 0x5643654424b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43138/0 (socket says 172.21.15.144:43138) 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde1600640 1 -- 172.21.15.144:0/3541001004 learned_addr learned my addr 172.21.15.144:0/3541001004 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.708+0000 7efde2000640 1 --2- 172.21.15.144:0/3541001004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5643654635d0 0x56436541d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efde1600640 1 -- 172.21.15.144:0/3541001004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5643654635d0 msgr2=0x56436541d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efde1600640 1 --2- 172.21.15.144:0/3541001004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5643654635d0 0x56436541d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efde0c00640 1 --2- 172.21.15.144:0/3541001004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x56436541ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efde1600640 1 -- 172.21.15.144:0/3541001004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 msgr2=0x56436541ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efde1600640 1 --2- 172.21.15.144:0/3541001004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x56436541ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efde1600640 1 -- 172.21.15.144:0/3541001004 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643654625f0 con 0x56436543f6f0 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efde1600640 1 --2- 172.21.15.144:0/3541001004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436543f6f0 0x5643654424b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efdd002a770 tx=0x7efdd002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f16f3023afef4f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efdcd200640 1 -- 172.21.15.144:0/3541001004 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0050070 con 0x56436543f6f0 2024-05-30T16:50:12.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efdcd200640 1 -- 172.21.15.144:0/3541001004 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd003cac0 con 0x56436543f6f0 2024-05-30T16:50:12.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.709+0000 7efdcd200640 1 -- 172.21.15.144:0/3541001004 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0036040 con 0x56436543f6f0 2024-05-30T16:50:12.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.710+0000 7efde6db5740 1 -- 172.21.15.144:0/3541001004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436543f6f0 msgr2=0x5643654424b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.710+0000 7efde6db5740 1 --2- 172.21.15.144:0/3541001004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436543f6f0 0x5643654424b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efdd002a770 tx=0x7efdd002e000 comp rx=0 tx=0).stop 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.710+0000 7efde6db5740 1 -- 172.21.15.144:0/3541001004 shutdown_connections 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.710+0000 7efde6db5740 1 --2- 172.21.15.144:0/3541001004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5643654635d0 0x56436541d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.710+0000 7efde6db5740 1 --2- 172.21.15.144:0/3541001004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x56436541ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.710+0000 7efde6db5740 1 --2- 172.21.15.144:0/3541001004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436543f6f0 0x5643654424b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.710+0000 7efde6db5740 1 -- 172.21.15.144:0/3541001004 >> 172.21.15.144:0/3541001004 conn(0x564365443490 msgr2=0x5643654128d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.710+0000 7efde6db5740 1 -- 172.21.15.144:0/3541001004 shutdown_connections 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.710+0000 7efde6db5740 1 -- 172.21.15.144:0/3541001004 wait complete. 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.711+0000 7efde6db5740 1 -- start start 2024-05-30T16:50:12.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.711+0000 7efde6db5740 1 Processor -- start 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.712+0000 7efde6db5740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56436543f6f0 0x5643654db290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.712+0000 7efde6db5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x564365418250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.712+0000 7efde6db5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x564365418790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.712+0000 7efde6db5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5643654172a0 con 0x5643654635d0 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.712+0000 7efde6db5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efddc0c8f00 con 0x564365447150 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.712+0000 7efde6db5740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56436545c590 con 0x56436543f6f0 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.712+0000 7efde6db5740 10 client.0 _ll_register_callbacks cb 0x7efdc800c900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x564365418790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x564365418790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43154/0 (socket says 172.21.15.144:43154) 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde2000640 1 -- 172.21.15.144:0/544473394 learned_addr learned my addr 172.21.15.144:0/544473394 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde1600640 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56436543f6f0 0x5643654db290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde0c00640 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x564365418250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde2000640 1 -- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56436543f6f0 msgr2=0x5643654db290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde2000640 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56436543f6f0 0x5643654db290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde2000640 1 -- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 msgr2=0x564365418250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde2000640 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x564365418250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde2000640 1 -- 172.21.15.144:0/544473394 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56436545b690 con 0x5643654635d0 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.713+0000 7efde0c00640 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x564365418250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde2000640 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x564365418790 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efdd4062200 tx=0x7efdd40595a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3351f751c743bc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efdc2000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efdc2000640 1 -- 172.21.15.144:0/544473394 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4072020 con 0x5643654635d0 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efdc2000640 1 -- 172.21.15.144:0/544473394 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7efdd4007b20 con 0x5643654635d0 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde6db5740 1 -- 172.21.15.144:0/544473394 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdd003cac0 con 0x5643654635d0 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efdc2000640 1 -- 172.21.15.144:0/544473394 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7efdd401e070 con 0x5643654635d0 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde6db5740 10 client.6600 fetch_fsmap learned FSMap version 45 2024-05-30T16:50:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde6db5740 1 -- 172.21.15.144:0/544473394 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x5643654db930 con 0x5643654635d0 2024-05-30T16:50:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efdc2000640 1 -- 172.21.15.144:0/544473394 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd003cac0 con 0x5643654635d0 2024-05-30T16:50:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efdc2000640 1 -- 172.21.15.144:0/544473394 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 45) ==== 3494+0+0 (secure 0 0 0) 0x7efdd4060100 con 0x5643654635d0 2024-05-30T16:50:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde6db5740 10 client.6600 fetch_fsmap finished waiting for FSMap version 45 2024-05-30T16:50:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde6db5740 10 client.6600 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T16:50:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde6db5740 20 client.6600 populate_metadata read hostname 'smithi144' 2024-05-30T16:50:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde6db5740 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] conn(0x564365449b60 0x564365445880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde6db5740 4 client.6600 mds_command: new command op to 6447 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T16:50:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.714+0000 7efde6db5740 1 -- 172.21.15.144:0/544473394 --> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] -- command(tid 0: {"prefix": "status"}) -- 0x564365464bd0 con 0x564365449b60 2024-05-30T16:50:12.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.715+0000 7efde1600640 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] conn(0x564365449b60 0x564365445880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.716+0000 7efdc2000640 10 client.6600 ms_handle_connect on v2:172.21.15.149:6832/1951637959 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.716+0000 7efde1600640 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] conn(0x564365449b60 0x564365445880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=773b87fbedcd0564 server_cookie=541400de8a3b78a8 in_seq=0 out_seq=0 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efdc2000640 1 -- 172.21.15.144:0/544473394 <== mds.0 v2:172.21.15.149:6832/1951637959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x564365464bd0 con 0x564365449b60 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efdc2000640 10 client.6600 handle_command_reply: tid=0 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efde6db5740 1 client.6600 shutdown 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efde6db5740 1 -- 172.21.15.144:0/544473394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 msgr2=0x564365418790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efde6db5740 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x564365418790 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efdd4062200 tx=0x7efdd40595a0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efde6db5740 1 -- 172.21.15.144:0/544473394 shutdown_connections 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efde6db5740 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:6832/1951637959,v1:172.21.15.149:6833/1951637959] conn(0x564365449b60 0x564365445880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efde6db5740 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5643654635d0 0x564365418790 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efde6db5740 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564365447150 0x564365418250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efde6db5740 1 --2- 172.21.15.144:0/544473394 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56436543f6f0 0x5643654db290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efdc2000640 0 client.6600 ms_handle_reset on v2:172.21.15.149:6832/1951637959 2024-05-30T16:50:12.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.717+0000 7efde6db5740 1 -- 172.21.15.144:0/544473394 >> 172.21.15.144:0/544473394 conn(0x564365443490 msgr2=0x56436544a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.718+0000 7efde6db5740 1 -- 172.21.15.144:0/544473394 shutdown_connections 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.718+0000 7efde6db5740 1 -- 172.21.15.144:0/544473394 wait complete. 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.718+0000 7efde6db5740 20 client.6600 trim_cache size 0 max 16384 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 6447, 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-05-30T16:50:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-05-30T16:50:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 11.514212843999999, 2024-05-30T16:50:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 45, 2024-05-30T16:50:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 72, 2024-05-30T16:50:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 72, 2024-05-30T16:50:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 15.990046902 2024-05-30T16:50:12.722 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.718+0000 7efde2a00640 1 -- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efdbc06d5e0 msgr2=0x7efdbc06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.718+0000 7efde2a00640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efdbc06d5e0 0x7efdbc06faa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efdd0033000 tx=0x7efdd0009000 comp rx=0 tx=0).stop 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.718+0000 7efde2a00640 1 -- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 msgr2=0x7efddc0ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.718+0000 7efde2a00640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 0x7efddc0ca520 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c820 tx=0x7efdd400cce0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.719+0000 7efde2a00640 1 -- 172.21.15.144:0/3022911758 shutdown_connections 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.719+0000 7efde2a00640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efdbc06d5e0 0x7efdbc06faa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.719+0000 7efde2a00640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efddc15eac0 0x7efddc0ca520 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.719+0000 7efde2a00640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0d27e0 0x7efddc160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.719+0000 7efde2a00640 1 --2- 172.21.15.144:0/3022911758 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efddc0b6150 0x7efddc14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.719+0000 7efde2a00640 1 -- 172.21.15.144:0/3022911758 >> 172.21.15.144:0/3022911758 conn(0x7efddc06d050 msgr2=0x7efddc0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.719+0000 7efde2a00640 1 -- 172.21.15.144:0/3022911758 shutdown_connections 2024-05-30T16:50:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.719+0000 7efde2a00640 1 -- 172.21.15.144:0/3022911758 wait complete. 2024-05-30T16:50:12.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T16:50:12.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.917+0000 7fd54be00640 1 Processor -- start 2024-05-30T16:50:12.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.917+0000 7fd54be00640 1 -- start start 2024-05-30T16:50:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.918+0000 7fd54be00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd54c0cf8b0 0x7fd54c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.918+0000 7fd54be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c15f780 con 0x7fd54c0cb2f0 2024-05-30T16:50:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.919+0000 7fd54be00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c15fa60 con 0x7fd54c0caf10 2024-05-30T16:50:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.919+0000 7fd54be00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c15fd40 con 0x7fd54c0cf8b0 2024-05-30T16:50:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.919+0000 7fd542000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd54c0cb2f0 0x7fd54c15c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:59010/0 (socket says 172.21.15.144:59010) 2024-05-30T16:50:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.919+0000 7fd542000640 1 -- 172.21.15.144:0/1061927986 learned_addr learned my addr 172.21.15.144:0/1061927986 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:12.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.919+0000 7fd54b400640 1 --2- 172.21.15.144:0/1061927986 >> v2:172.21.15.149:3300/0 conn(0x7fd54c0cf8b0 0x7fd54c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.919+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620563294 0 0) 0x7fd54c15f780 con 0x7fd54c0cb2f0 2024-05-30T16:50:12.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.919+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd530005730 con 0x7fd54c0cb2f0 2024-05-30T16:50:12.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 559551681 0 0) 0x7fd530005730 con 0x7fd54c0cb2f0 2024-05-30T16:50:12.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 >> v2:172.21.15.149:3300/0 conn(0x7fd54c0cf8b0 msgr2=0x7fd54c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 --2- 172.21.15.144:0/1061927986 >> v2:172.21.15.149:3300/0 conn(0x7fd54c0cf8b0 0x7fd54c0b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 >> v1:172.21.15.149:6789/0 conn(0x7fd54c0caf10 legacy=0x7fd54c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c15c950 con 0x7fd54c0cb2f0 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fd534001670 con 0x7fd54c0cb2f0 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 >> v1:172.21.15.144:6789/0 conn(0x7fd54c0cb2f0 legacy=0x7fd54c15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd530005c10 0x7fd530006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd530006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd530007420 0x7fd53000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c15fd40 con 0x7fd530006a10 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd53000e370 con 0x7fd530007420 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd53000e570 con 0x7fd530005c10 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd54b400640 1 --2- 172.21.15.144:0/1061927986 >> v2:172.21.15.149:3300/0 conn(0x7fd54c0cf8b0 0x7fd54c0b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd542000640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd530006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.920+0000 7fd542000640 1 -- 172.21.15.144:0/1061927986 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd530005c10 msgr2=0x7fd530006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.921+0000 7fd542000640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd530005c10 0x7fd530006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.921+0000 7fd54b400640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd530007420 0x7fd53000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.921+0000 7fd542000640 1 -- 172.21.15.144:0/1061927986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd530007420 msgr2=0x7fd53000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.921+0000 7fd542000640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd530007420 0x7fd53000dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.921+0000 7fd542000640 1 -- 172.21.15.144:0/1061927986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd530005730 con 0x7fd530006a10 2024-05-30T16:50:12.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.921+0000 7fd54b400640 1 -- 172.21.15.144:0/1061927986 reap_dead start 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.922+0000 7fd542000640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd530006e90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd534007fd0 tx=0x7fd530007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2c2695d0845726 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.922+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534007c20 con 0x7fd530006a10 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.922+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd534005af0 con 0x7fd530006a10 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.922+0000 7fd54a000640 1 -- 172.21.15.144:0/1061927986 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534007070 con 0x7fd530006a10 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.922+0000 7fd54be00640 1 -- 172.21.15.144:0/1061927986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 msgr2=0x7fd530006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.922+0000 7fd54be00640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd530006e90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd534007fd0 tx=0x7fd530007a40 comp rx=0 tx=0).stop 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.922+0000 7fd54be00640 1 -- 172.21.15.144:0/1061927986 shutdown_connections 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.922+0000 7fd54be00640 1 --2- 172.21.15.144:0/1061927986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd530006e90 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.922+0000 7fd54be00640 1 -- 172.21.15.144:0/1061927986 >> 172.21.15.144:0/1061927986 conn(0x7fd54c0b20a0 msgr2=0x7fd54c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.923+0000 7fd54be00640 1 -- 172.21.15.144:0/1061927986 shutdown_connections 2024-05-30T16:50:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.923+0000 7fd54be00640 1 -- 172.21.15.144:0/1061927986 wait complete. 2024-05-30T16:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.924+0000 7fd54be00640 1 Processor -- start 2024-05-30T16:50:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.924+0000 7fd54be00640 1 -- start start 2024-05-30T16:50:12.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.925+0000 7fd54be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd54c14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.925+0000 7fd54be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd54c14abc0 0x7fd54c09a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.925+0000 7fd54be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd54c0b0e80 0x7fd54c0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.925+0000 7fd54be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c15c3c0 con 0x7fd530006a10 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.925+0000 7fd54be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c15c240 con 0x7fd54c0b0e80 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.925+0000 7fd54be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c15c540 con 0x7fd54c14abc0 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.926+0000 7fd54aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd54c14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.926+0000 7fd54aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd54c14d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43166/0 (socket says 172.21.15.144:43166) 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.926+0000 7fd54aa00640 1 -- 172.21.15.144:0/3742283964 learned_addr learned my addr 172.21.15.144:0/3742283964 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.926+0000 7fd54b400640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd54c0b0e80 0x7fd54c0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.926+0000 7fd54aa00640 1 -- 172.21.15.144:0/3742283964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd54c14abc0 msgr2=0x7fd54c09a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.926+0000 7fd54aa00640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd54c14abc0 0x7fd54c09a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.926+0000 7fd54aa00640 1 -- 172.21.15.144:0/3742283964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd54c0b0e80 msgr2=0x7fd54c0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.926+0000 7fd54aa00640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd54c0b0e80 0x7fd54c0b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.926+0000 7fd54aa00640 1 -- 172.21.15.144:0/3742283964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c09a7f0 con 0x7fd530006a10 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.927+0000 7fd54aa00640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd54c14d880 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00c530 tx=0x7fd53c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.927+0000 7fd543400640 1 -- 172.21.15.144:0/3742283964 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0052d0 con 0x7fd530006a10 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.927+0000 7fd543400640 1 -- 172.21.15.144:0/3742283964 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd53c005470 con 0x7fd530006a10 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.927+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c1f89b0 con 0x7fd530006a10 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.927+0000 7fd543400640 1 -- 172.21.15.144:0/3742283964 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c012870 con 0x7fd530006a10 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.927+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c14a3c0 con 0x7fd530006a10 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.928+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c0b1840 con 0x7fd530006a10 2024-05-30T16:50:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.929+0000 7fd543400640 1 -- 172.21.15.144:0/3742283964 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fd53c012a10 con 0x7fd530006a10 2024-05-30T16:50:12.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.930+0000 7fd543400640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd52806d5e0 0x7fd52806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:12.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.930+0000 7fd543400640 1 -- 172.21.15.144:0/3742283964 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7fd53c08a210 con 0x7fd530006a10 2024-05-30T16:50:12.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.930+0000 7fd542000640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd52806d5e0 0x7fd52806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:12.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.931+0000 7fd542000640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd52806d5e0 0x7fd52806faa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd534032000 tx=0x7fd534007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:12.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:12.934+0000 7fd543400640 1 -- 172.21.15.144:0/3742283964 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd53c05a090 con 0x7fd530006a10 2024-05-30T16:50:13.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.175+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd54c075570 con 0x7fd530006a10 2024-05-30T16:50:13.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.176+0000 7fd543400640 1 -- 172.21.15.144:0/3742283964 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) ==== 53+0+73 (secure 0 0 0) 0x7fd53c059990 con 0x7fd530006a10 2024-05-30T16:50:13.178 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T16:50:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.178+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd52806d5e0 msgr2=0x7fd52806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.178+0000 7fd54be00640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd52806d5e0 0x7fd52806faa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd534032000 tx=0x7fd534007000 comp rx=0 tx=0).stop 2024-05-30T16:50:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.178+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 msgr2=0x7fd54c14d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.179+0000 7fd54be00640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd54c14d880 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00c530 tx=0x7fd53c00c9f0 comp rx=0 tx=0).stop 2024-05-30T16:50:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.179+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 shutdown_connections 2024-05-30T16:50:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.179+0000 7fd54be00640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd52806d5e0 0x7fd52806faa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:13.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.179+0000 7fd54be00640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd54c0b0e80 0x7fd54c0b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:13.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.179+0000 7fd54be00640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd54c14abc0 0x7fd54c09a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:13.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.179+0000 7fd54be00640 1 --2- 172.21.15.144:0/3742283964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530006a10 0x7fd54c14d880 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:13.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.179+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 >> 172.21.15.144:0/3742283964 conn(0x7fd54c0b20a0 msgr2=0x7fd54c0b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:13.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.179+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 shutdown_connections 2024-05-30T16:50:13.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13.179+0000 7fd54be00640 1 -- 172.21.15.144:0/3742283964 wait complete. 2024-05-30T16:50:13.200 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T16:50:13.200 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T16:50:13.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-05-30T16:50:13.200 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T16:50:13.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T16:50:13.200 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T16:50:13.200 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T16:50:13.200 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T16:50:13.201 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:50:13.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:13.201 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-05-30T16:50:13.253 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T16:50:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-30T16:50:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42073sec preferred_lft 42073sec 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9019:bbff:fe7f:ed10/64 scope link 2024-05-30T16:50:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:50:13.257 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:50:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:4d:5a:40:b9:d1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:50:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9c4d:5aff:fe40:b9d1/64 scope link 2024-05-30T16:50:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:50:13.258 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T16:50:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 9e:dc:91:e3:69:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:50:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::9cdc:91ff:fee3:6906/64 scope link 2024-05-30T16:50:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-05-30T16:50:13.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:13.259 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T16:50:13.335 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-05-30T16:50:13.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:13.340 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-05-30T16:50:13.393 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-05-30T16:50:13.393 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T16:50:13.393 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T16:50:13.393 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T16:50:13.393 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T16:50:13.394 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T16:50:13.394 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-05-30T16:50:13.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T16:50:13.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T16:50:13.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T16:50:13.394 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-05-30T16:50:13.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T16:50:13.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:50:13.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:13.605 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:50:13.653 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:50:13.653 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:50:13.654 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:50:13.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:13.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-05-30T16:50:13.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:50:13.739 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T16:50:13.795 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T16:50:13.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T16:50:13.795 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:50:13.846 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T16:50:13.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:13.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:50:13.972 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:50:13.973 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:50:14.008 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T16:50:14.008 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T16:50:14.008 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-05-30T16:50:14.008 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@865cdc9a-e28b-4870-8751-0312b261bc38.cephfs=/ 2024-05-30T16:50:14.008 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-05-30T16:50:14.011 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-30T16:50:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-05-30T16:50:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-30T16:50:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-05-30T16:50:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-30T16:50:14.014 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T16:50:14.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:14.015 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T16:50:14.084 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T16:50:14.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T16:50:14.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T16:50:14.221 INFO:teuthology.orchestra.run.smithi144.stdout:client5512 2024-05-30T16:50:14.221 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:50:14.221 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:14.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T16:50:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.526+0000 7fb977200640 1 Processor -- start 2024-05-30T16:50:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.527+0000 7fb977200640 1 -- start start 2024-05-30T16:50:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.528+0000 7fb977200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb97815e8a0 0x7fb9780d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.528+0000 7fb977200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb9780d0540 0x7fb9780d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.528+0000 7fb977200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d1650 0x7fb9780cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.528+0000 7fb977200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb9780b7610 con 0x7fb9780d0540 2024-05-30T16:50:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.528+0000 7fb977200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb9780b78b0 con 0x7fb97815e8a0 2024-05-30T16:50:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.528+0000 7fb977200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb9780b7b90 con 0x7fb9780d1650 2024-05-30T16:50:14.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.528+0000 7fb96d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb9780d0540 0x7fb9780d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.528+0000 7fb96d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb9780d0540 0x7fb9780d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43174/0 (socket says 172.21.15.144:43174) 2024-05-30T16:50:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.529+0000 7fb96d400640 1 -- 172.21.15.144:0/2818341268 learned_addr learned my addr 172.21.15.144:0/2818341268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.529+0000 7fb976800640 1 --2- 172.21.15.144:0/2818341268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d1650 0x7fb9780cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.529+0000 7fb975e00640 1 --2- 172.21.15.144:0/2818341268 >> v2:172.21.15.149:3300/0 conn(0x7fb97815e8a0 0x7fb9780d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.529+0000 7fb96d400640 1 -- 172.21.15.144:0/2818341268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d1650 msgr2=0x7fb9780cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.529+0000 7fb96d400640 1 --2- 172.21.15.144:0/2818341268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d1650 0x7fb9780cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.529+0000 7fb96d400640 1 -- 172.21.15.144:0/2818341268 >> v2:172.21.15.149:3300/0 conn(0x7fb97815e8a0 msgr2=0x7fb9780d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.529+0000 7fb96d400640 1 --2- 172.21.15.144:0/2818341268 >> v2:172.21.15.149:3300/0 conn(0x7fb97815e8a0 0x7fb9780d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.529+0000 7fb96d400640 1 -- 172.21.15.144:0/2818341268 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97815ec80 con 0x7fb9780d0540 2024-05-30T16:50:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.530+0000 7fb96d400640 1 --2- 172.21.15.144:0/2818341268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780d0540 0x7fb9780d1110 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb97808e430 tx=0x7fb96002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23013795be035b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.531+0000 7fb975400640 1 -- 172.21.15.144:0/2818341268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb960004030 con 0x7fb9780d0540 2024-05-30T16:50:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.531+0000 7fb975400640 1 -- 172.21.15.144:0/2818341268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9600041d0 con 0x7fb9780d0540 2024-05-30T16:50:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.531+0000 7fb975400640 1 -- 172.21.15.144:0/2818341268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb960003610 con 0x7fb9780d0540 2024-05-30T16:50:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.531+0000 7fb977200640 1 -- 172.21.15.144:0/2818341268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780d0540 msgr2=0x7fb9780d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.531+0000 7fb977200640 1 --2- 172.21.15.144:0/2818341268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780d0540 0x7fb9780d1110 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb97808e430 tx=0x7fb96002a130 comp rx=0 tx=0).stop 2024-05-30T16:50:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.532+0000 7fb977200640 1 -- 172.21.15.144:0/2818341268 shutdown_connections 2024-05-30T16:50:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.532+0000 7fb977200640 1 --2- 172.21.15.144:0/2818341268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d1650 0x7fb9780cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.532+0000 7fb977200640 1 --2- 172.21.15.144:0/2818341268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780d0540 0x7fb9780d1110 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.532+0000 7fb977200640 1 --2- 172.21.15.144:0/2818341268 >> v2:172.21.15.149:3300/0 conn(0x7fb97815e8a0 0x7fb9780d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.532+0000 7fb977200640 1 -- 172.21.15.144:0/2818341268 >> 172.21.15.144:0/2818341268 conn(0x7fb97808bfc0 msgr2=0x7fb9780d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.532+0000 7fb977200640 1 -- 172.21.15.144:0/2818341268 shutdown_connections 2024-05-30T16:50:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.532+0000 7fb977200640 1 -- 172.21.15.144:0/2818341268 wait complete. 2024-05-30T16:50:14.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.534+0000 7fb977200640 1 Processor -- start 2024-05-30T16:50:14.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.534+0000 7fb977200640 1 -- start start 2024-05-30T16:50:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb977200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d0540 0x7fb9780c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb977200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780d1650 0x7fb9781f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb977200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb97815e8a0 0x7fb9780b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb977200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9780d33c0 con 0x7fb97815e8a0 2024-05-30T16:50:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb977200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb9780d3240 con 0x7fb9780d1650 2024-05-30T16:50:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb977200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb9780cf870 con 0x7fb9780d0540 2024-05-30T16:50:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb976800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb97815e8a0 0x7fb9780b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb976800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb97815e8a0 0x7fb9780b96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43190/0 (socket says 172.21.15.144:43190) 2024-05-30T16:50:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb976800640 1 -- 172.21.15.144:0/1183349272 learned_addr learned my addr 172.21.15.144:0/1183349272 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb975e00640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d0540 0x7fb9780c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.536+0000 7fb96d400640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780d1650 0x7fb9781f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb976800640 1 -- 172.21.15.144:0/1183349272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d0540 msgr2=0x7fb9780c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb976800640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d0540 0x7fb9780c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb976800640 1 -- 172.21.15.144:0/1183349272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780d1650 msgr2=0x7fb9781f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb976800640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780d1650 0x7fb9781f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb976800640 1 -- 172.21.15.144:0/1183349272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9780c8f00 con 0x7fb97815e8a0 2024-05-30T16:50:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb96d400640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780d1650 0x7fb9781f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb976800640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb97815e8a0 0x7fb9780b96c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb970007d40 tx=0x7fb97000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb96ea00640 1 -- 172.21.15.144:0/1183349272 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970014420 con 0x7fb97815e8a0 2024-05-30T16:50:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb96ea00640 1 -- 172.21.15.144:0/1183349272 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb970019070 con 0x7fb97815e8a0 2024-05-30T16:50:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb96ea00640 1 -- 172.21.15.144:0/1183349272 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970014820 con 0x7fb97815e8a0 2024-05-30T16:50:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97815f470 con 0x7fb97815e8a0 2024-05-30T16:50:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.537+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97815fa30 con 0x7fb97815e8a0 2024-05-30T16:50:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.539+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb978075570 con 0x7fb97815e8a0 2024-05-30T16:50:14.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.539+0000 7fb96ea00640 1 -- 172.21.15.144:0/1183349272 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fb9700149c0 con 0x7fb97815e8a0 2024-05-30T16:50:14.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.540+0000 7fb96ea00640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95406d5e0 0x7fb95406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:14.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.540+0000 7fb96ea00640 1 -- 172.21.15.144:0/1183349272 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7fb97008ad60 con 0x7fb97815e8a0 2024-05-30T16:50:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.541+0000 7fb975e00640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95406d5e0 0x7fb95406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.541+0000 7fb975e00640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95406d5e0 0x7fb95406faa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb96800b9f0 tx=0x7fb968008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.545+0000 7fb96ea00640 1 -- 172.21.15.144:0/1183349272 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb97005abe0 con 0x7fb97815e8a0 2024-05-30T16:50:14.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:14.788+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fb9780b5950 con 0x7fb97815e8a0 2024-05-30T16:50:15.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.728+0000 7fb96ea00640 1 -- 172.21.15.144:0/1183349272 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v46) ==== 136+0+0 (secure 0 0 0) 0x7fb97005a4e0 con 0x7fb97815e8a0 2024-05-30T16:50:15.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.731+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95406d5e0 msgr2=0x7fb95406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:15.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.731+0000 7fb977200640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95406d5e0 0x7fb95406faa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb96800b9f0 tx=0x7fb968008040 comp rx=0 tx=0).stop 2024-05-30T16:50:15.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.731+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb97815e8a0 msgr2=0x7fb9780b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:15.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.731+0000 7fb977200640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb97815e8a0 0x7fb9780b96c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb970007d40 tx=0x7fb97000e4b0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.732+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 shutdown_connections 2024-05-30T16:50:15.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.732+0000 7fb977200640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb95406d5e0 0x7fb95406faa0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.732+0000 7fb977200640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb97815e8a0 0x7fb9780b96c0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.732+0000 7fb977200640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9780d1650 0x7fb9781f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.732+0000 7fb977200640 1 --2- 172.21.15.144:0/1183349272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9780d0540 0x7fb9780c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.732+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 >> 172.21.15.144:0/1183349272 conn(0x7fb97808bfc0 msgr2=0x7fb9780cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:15.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.732+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 shutdown_connections 2024-05-30T16:50:15.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.732+0000 7fb977200640 1 -- 172.21.15.144:0/1183349272 wait complete. 2024-05-30T16:50:15.756 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:50:15.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.958+0000 7f7b2c200640 1 Processor -- start 2024-05-30T16:50:15.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.958+0000 7f7b2c200640 1 -- start start 2024-05-30T16:50:15.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.959+0000 7f7b2c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b2415da50 0x7f7b241604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:15.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.959+0000 7f7b2c200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2415de60 con 0x7f7b240ce390 2024-05-30T16:50:15.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.959+0000 7f7b2c200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b24160c40 con 0x7f7b2415e090 2024-05-30T16:50:15.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.959+0000 7f7b2c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7b24160a00 con 0x7f7b2415da50 2024-05-30T16:50:15.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.960+0000 7f7b29800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7b240ce390 0x7f7b240ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43728/0 (socket says 172.21.15.144:43728) 2024-05-30T16:50:15.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.960+0000 7f7b29800640 1 -- 172.21.15.144:0/3978260783 learned_addr learned my addr 172.21.15.144:0/3978260783 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.960+0000 7f7b2a200640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b2415da50 0x7f7b241604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.960+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330768015 0 0) 0x7f7b2415de60 con 0x7f7b240ce390 2024-05-30T16:50:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.960+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b0c003520 con 0x7f7b240ce390 2024-05-30T16:50:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2644890511 0 0) 0x7f7b0c003520 con 0x7f7b240ce390 2024-05-30T16:50:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b2415da50 msgr2=0x7f7b241604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b2415da50 0x7f7b241604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 >> v1:172.21.15.149:6789/0 conn(0x7f7b2415e090 legacy=0x7f7b2406ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b24160f20 con 0x7f7b240ce390 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f7b18001670 con 0x7f7b240ce390 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 >> v1:172.21.15.144:6789/0 conn(0x7f7b240ce390 legacy=0x7f7b240ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b2415da50 0x7f7b0c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b0c004010 0x7f7b0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0c004d40 0x7f7b0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24160a00 con 0x7f7b0c004d40 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c00bb80 con 0x7f7b0c004010 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0c00bd80 con 0x7f7b2415da50 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b2a200640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0c004d40 0x7f7b0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b29800640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b2415da50 0x7f7b0c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.961+0000 7f7b28e00640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b0c004010 0x7f7b0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.962+0000 7f7b2a200640 1 -- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b2415da50 msgr2=0x7f7b0c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:15.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.962+0000 7f7b2a200640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b2415da50 0x7f7b0c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.962+0000 7f7b2a200640 1 -- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b0c004010 msgr2=0x7f7b0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:15.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.962+0000 7f7b2a200640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b0c004010 0x7f7b0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.962+0000 7f7b2a200640 1 -- 172.21.15.144:0/3978260783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0c003520 con 0x7f7b0c004d40 2024-05-30T16:50:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.963+0000 7f7b2a200640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0c004d40 0x7f7b0c0051c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c007360 tx=0x7f7b0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2aaa7bc592d6afb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.963+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c009be0 con 0x7f7b0c004d40 2024-05-30T16:50:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.963+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c036600 con 0x7f7b0c004d40 2024-05-30T16:50:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.963+0000 7f7b23e00640 1 -- 172.21.15.144:0/3978260783 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0369d0 con 0x7f7b0c004d40 2024-05-30T16:50:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.963+0000 7f7b2c200640 1 -- 172.21.15.144:0/3978260783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0c004d40 msgr2=0x7f7b0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.963+0000 7f7b2c200640 1 --2- 172.21.15.144:0/3978260783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0c004d40 0x7f7b0c0051c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c007360 tx=0x7f7b0c005830 comp rx=0 tx=0).stop 2024-05-30T16:50:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.963+0000 7f7b2a200640 1 -- 172.21.15.144:0/3978260783 reap_dead start 2024-05-30T16:50:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.964+0000 7f7b2c200640 1 -- 172.21.15.144:0/3978260783 shutdown_connections 2024-05-30T16:50:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.964+0000 7f7b2c200640 1 -- 172.21.15.144:0/3978260783 >> 172.21.15.144:0/3978260783 conn(0x7f7b240629c0 msgr2=0x7f7b2406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.964+0000 7f7b2c200640 1 -- 172.21.15.144:0/3978260783 shutdown_connections 2024-05-30T16:50:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.964+0000 7f7b2c200640 1 -- 172.21.15.144:0/3978260783 wait complete. 2024-05-30T16:50:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.965+0000 7f7b2c200640 1 Processor -- start 2024-05-30T16:50:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.966+0000 7f7b2c200640 1 -- start start 2024-05-30T16:50:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.966+0000 7f7b2c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b0c004d40 0x7f7b24134c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.966+0000 7f7b2c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2413e6f0 0x7f7b2415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b2c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2415be50 0x7f7b2415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b2c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24143130 con 0x7f7b2413e6f0 2024-05-30T16:50:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b2c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2406e550 con 0x7f7b2415be50 2024-05-30T16:50:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b2c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7b241432b0 con 0x7f7b0c004d40 2024-05-30T16:50:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b28e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2413e6f0 0x7f7b2415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b28e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2413e6f0 0x7f7b2415b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60432/0 (socket says 172.21.15.144:60432) 2024-05-30T16:50:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b28e00640 1 -- 172.21.15.144:0/3147741818 learned_addr learned my addr 172.21.15.144:0/3147741818 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b28e00640 1 -- 172.21.15.144:0/3147741818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b0c004d40 msgr2=0x7f7b24134c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b28e00640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b0c004d40 0x7f7b24134c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b28e00640 1 -- 172.21.15.144:0/3147741818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2415be50 msgr2=0x7f7b2415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b28e00640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2415be50 0x7f7b2415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.967+0000 7f7b28e00640 1 -- 172.21.15.144:0/3147741818 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2413ef70 con 0x7f7b2413e6f0 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.968+0000 7f7b28e00640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2413e6f0 0x7f7b2415b910 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000e5b0 tx=0x7f7b1000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.968+0000 7f7b21600640 1 -- 172.21.15.144:0/3147741818 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b100052e0 con 0x7f7b2413e6f0 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.968+0000 7f7b21600640 1 -- 172.21.15.144:0/3147741818 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b10018070 con 0x7f7b2413e6f0 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.968+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b24150680 con 0x7f7b2413e6f0 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.968+0000 7f7b21600640 1 -- 172.21.15.144:0/3147741818 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10003810 con 0x7f7b2413e6f0 2024-05-30T16:50:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.968+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b24150c40 con 0x7f7b2413e6f0 2024-05-30T16:50:15.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.969+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2406c870 con 0x7f7b2413e6f0 2024-05-30T16:50:15.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.970+0000 7f7b21600640 1 -- 172.21.15.144:0/3147741818 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f7b100039b0 con 0x7f7b2413e6f0 2024-05-30T16:50:15.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.971+0000 7f7b21600640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7b0406d5e0 0x7f7b0406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:15.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.971+0000 7f7b21600640 1 -- 172.21.15.144:0/3147741818 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f7b1008a3f0 con 0x7f7b2413e6f0 2024-05-30T16:50:15.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.971+0000 7f7b29800640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7b0406d5e0 0x7f7b0406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:15.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.972+0000 7f7b29800640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7b0406d5e0 0x7f7b0406faa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7b18001050 tx=0x7f7b18001d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:15.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:15.976+0000 7f7b21600640 1 -- 172.21.15.144:0/3147741818 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b2413ef70 con 0x7f7b2413e6f0 2024-05-30T16:50:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.204+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f7b240cddd0 con 0x7f7b0406d5e0 2024-05-30T16:50:16.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.208+0000 7f7b21600640 1 -- 172.21.15.144:0/3147741818 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f7b240cddd0 con 0x7f7b0406d5e0 2024-05-30T16:50:16.209 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:50:16.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:50:16.209 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-05-30T16:50:16.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:50:16.209 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:50:16.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7b0406d5e0 msgr2=0x7f7b0406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7b0406d5e0 0x7f7b0406faa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7b18001050 tx=0x7f7b18001d80 comp rx=0 tx=0).stop 2024-05-30T16:50:16.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2413e6f0 msgr2=0x7f7b2415b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2413e6f0 0x7f7b2415b910 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000e5b0 tx=0x7f7b1000ea70 comp rx=0 tx=0).stop 2024-05-30T16:50:16.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 shutdown_connections 2024-05-30T16:50:16.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7b0406d5e0 0x7f7b0406faa0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2415be50 0x7f7b2415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2413e6f0 0x7f7b2415b910 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 --2- 172.21.15.144:0/3147741818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b0c004d40 0x7f7b24134c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.210+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 >> 172.21.15.144:0/3147741818 conn(0x7f7b240629c0 msgr2=0x7f7b24072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:16.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.211+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 shutdown_connections 2024-05-30T16:50:16.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.211+0000 7f7b2c200640 1 -- 172.21.15.144:0/3147741818 wait complete. 2024-05-30T16:50:16.232 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T16:50:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.429+0000 7fcf60a00640 1 Processor -- start 2024-05-30T16:50:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.429+0000 7fcf60a00640 1 -- start start 2024-05-30T16:50:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.430+0000 7fcf60a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcf5c0d2240 0x7fcf5c0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.430+0000 7fcf60a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5c0d2740 con 0x7fcf5c06e790 2024-05-30T16:50:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.430+0000 7fcf60a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5c0d2a20 con 0x7fcf5c0b66c0 2024-05-30T16:50:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.430+0000 7fcf60a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5c0d07c0 con 0x7fcf5c0d2240 2024-05-30T16:50:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.430+0000 7fcf5b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcf5c06e790 0x7fcf5c0d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43734/0 (socket says 172.21.15.144:43734) 2024-05-30T16:50:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.430+0000 7fcf5b400640 1 -- 172.21.15.144:0/2717807198 learned_addr learned my addr 172.21.15.144:0/2717807198 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:16.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.431+0000 7fcf53e00640 1 --2- 172.21.15.144:0/2717807198 >> v2:172.21.15.149:3300/0 conn(0x7fcf5c0d2240 0x7fcf5c0b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.431+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024878933 0 0) 0x7fcf5c0d2740 con 0x7fcf5c06e790 2024-05-30T16:50:16.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.431+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf40003520 con 0x7fcf5c06e790 2024-05-30T16:50:16.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.431+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2699111524 0 0) 0x7fcf40003520 con 0x7fcf5c06e790 2024-05-30T16:50:16.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.431+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 >> v2:172.21.15.149:3300/0 conn(0x7fcf5c0d2240 msgr2=0x7fcf5c0b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:16.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.431+0000 7fcf5aa00640 1 --2- 172.21.15.144:0/2717807198 >> v2:172.21.15.149:3300/0 conn(0x7fcf5c0d2240 0x7fcf5c0b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.431+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 >> v1:172.21.15.149:6789/0 conn(0x7fcf5c0b66c0 legacy=0x7fcf5c06ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.431+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c0d2d00 con 0x7fcf5c06e790 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.431+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fcf4c001670 con 0x7fcf5c06e790 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 >> v1:172.21.15.144:6789/0 conn(0x7fcf5c06e790 legacy=0x7fcf5c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5aa00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400039b0 0x7fcf40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5aa00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40004800 0x7fcf40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5aa00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf400051c0 0x7fcf4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0d07c0 con 0x7fcf400051c0 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4000c160 con 0x7fcf40004800 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4000c360 con 0x7fcf400039b0 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5be00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf400051c0 0x7fcf4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5b400640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400039b0 0x7fcf40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf53e00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40004800 0x7fcf40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5be00640 1 -- 172.21.15.144:0/2717807198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400039b0 msgr2=0x7fcf40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:16.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.432+0000 7fcf5be00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400039b0 0x7fcf40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.433+0000 7fcf5be00640 1 -- 172.21.15.144:0/2717807198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40004800 msgr2=0x7fcf40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:16.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.433+0000 7fcf5be00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40004800 0x7fcf40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.433+0000 7fcf5be00640 1 -- 172.21.15.144:0/2717807198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf40003520 con 0x7fcf400051c0 2024-05-30T16:50:16.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.433+0000 7fcf53e00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf40004800 0x7fcf40004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:16.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.433+0000 7fcf5be00640 1 -- 172.21.15.144:0/2717807198 reap_dead start 2024-05-30T16:50:16.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.434+0000 7fcf5be00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf400051c0 0x7fcf4000b9c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcf54001e50 tx=0x7fcf40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c970bf7c6c976e9b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:16.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.434+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54001a70 con 0x7fcf400051c0 2024-05-30T16:50:16.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.434+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf54003970 con 0x7fcf400051c0 2024-05-30T16:50:16.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.434+0000 7fcf5aa00640 1 -- 172.21.15.144:0/2717807198 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54003d60 con 0x7fcf400051c0 2024-05-30T16:50:16.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.434+0000 7fcf60a00640 1 -- 172.21.15.144:0/2717807198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf400051c0 msgr2=0x7fcf4000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.434+0000 7fcf60a00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf400051c0 0x7fcf4000b9c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcf54001e50 tx=0x7fcf40005830 comp rx=0 tx=0).stop 2024-05-30T16:50:16.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.435+0000 7fcf60a00640 1 -- 172.21.15.144:0/2717807198 shutdown_connections 2024-05-30T16:50:16.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.435+0000 7fcf60a00640 1 --2- 172.21.15.144:0/2717807198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf400051c0 0x7fcf4000b9c0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.435+0000 7fcf60a00640 1 -- 172.21.15.144:0/2717807198 >> 172.21.15.144:0/2717807198 conn(0x7fcf5c08bfc0 msgr2=0x7fcf5c0d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:16.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.435+0000 7fcf60a00640 1 -- 172.21.15.144:0/2717807198 shutdown_connections 2024-05-30T16:50:16.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.435+0000 7fcf60a00640 1 -- 172.21.15.144:0/2717807198 wait complete. 2024-05-30T16:50:16.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.436+0000 7fcf60a00640 1 Processor -- start 2024-05-30T16:50:16.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.437+0000 7fcf60a00640 1 -- start start 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.437+0000 7fcf60a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400051c0 0x7fcf5c0b9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf60a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf5c159e90 0x7fcf5c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf60a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c0b2550 0x7fcf5c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf60a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0b6180 con 0x7fcf5c159e90 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf60a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0d32c0 con 0x7fcf5c0b2550 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf60a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c0b6300 con 0x7fcf400051c0 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf53e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf5c159e90 0x7fcf5c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf53e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf5c159e90 0x7fcf5c0cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60448/0 (socket says 172.21.15.144:60448) 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf53e00640 1 -- 172.21.15.144:0/2570778283 learned_addr learned my addr 172.21.15.144:0/2570778283 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:16.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf5b400640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400051c0 0x7fcf5c0b9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf5be00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c0b2550 0x7fcf5c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf53e00640 1 -- 172.21.15.144:0/2570778283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400051c0 msgr2=0x7fcf5c0b9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf53e00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400051c0 0x7fcf5c0b9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf53e00640 1 -- 172.21.15.144:0/2570778283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c0b2550 msgr2=0x7fcf5c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf53e00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c0b2550 0x7fcf5c14f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf53e00640 1 -- 172.21.15.144:0/2570778283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c14e630 con 0x7fcf5c159e90 2024-05-30T16:50:16.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.438+0000 7fcf5be00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c0b2550 0x7fcf5c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:16.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.439+0000 7fcf53e00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf5c159e90 0x7fcf5c0cb740 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fcf440108b0 tx=0x7fcf44010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:16.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.439+0000 7fcf53400640 1 -- 172.21.15.144:0/2570778283 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400f040 con 0x7fcf5c159e90 2024-05-30T16:50:16.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.439+0000 7fcf53400640 1 -- 172.21.15.144:0/2570778283 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4400eb60 con 0x7fcf5c159e90 2024-05-30T16:50:16.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.439+0000 7fcf53400640 1 -- 172.21.15.144:0/2570778283 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4401c400 con 0x7fcf5c159e90 2024-05-30T16:50:16.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.439+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c14e910 con 0x7fcf5c159e90 2024-05-30T16:50:16.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.439+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c14eed0 con 0x7fcf5c159e90 2024-05-30T16:50:16.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.440+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5c075570 con 0x7fcf5c159e90 2024-05-30T16:50:16.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.441+0000 7fcf53400640 1 -- 172.21.15.144:0/2570778283 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fcf4401c5a0 con 0x7fcf5c159e90 2024-05-30T16:50:16.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.442+0000 7fcf53400640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf3806d5e0 0x7fcf3806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.442+0000 7fcf53400640 1 -- 172.21.15.144:0/2570778283 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7fcf4408acb0 con 0x7fcf5c159e90 2024-05-30T16:50:16.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.443+0000 7fcf5b400640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf3806d5e0 0x7fcf3806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.443+0000 7fcf5b400640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf3806d5e0 0x7fcf3806faa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c001050 tx=0x7fcf4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.447+0000 7fcf53400640 1 -- 172.21.15.144:0/2570778283 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf44018030 con 0x7fcf5c159e90 2024-05-30T16:50:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.648+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcf5c0ba580 con 0x7fcf5c159e90 2024-05-30T16:50:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.649+0000 7fcf53400640 1 -- 172.21.15.144:0/2570778283 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fcf4405ab30 con 0x7fcf5c159e90 2024-05-30T16:50:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.651+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf3806d5e0 msgr2=0x7fcf3806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.651+0000 7fcf60a00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf3806d5e0 0x7fcf3806faa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c001050 tx=0x7fcf4c009040 comp rx=0 tx=0).stop 2024-05-30T16:50:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.651+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf5c159e90 msgr2=0x7fcf5c0cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.651+0000 7fcf60a00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf5c159e90 0x7fcf5c0cb740 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fcf440108b0 tx=0x7fcf44010d70 comp rx=0 tx=0).stop 2024-05-30T16:50:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.651+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 shutdown_connections 2024-05-30T16:50:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.651+0000 7fcf60a00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcf3806d5e0 0x7fcf3806faa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.651+0000 7fcf60a00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c0b2550 0x7fcf5c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.651+0000 7fcf60a00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf5c159e90 0x7fcf5c0cb740 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.651+0000 7fcf60a00640 1 --2- 172.21.15.144:0/2570778283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf400051c0 0x7fcf5c0b9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.652+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 >> 172.21.15.144:0/2570778283 conn(0x7fcf5c08bfc0 msgr2=0x7fcf5c0b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:16.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.652+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 shutdown_connections 2024-05-30T16:50:16.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.652+0000 7fcf60a00640 1 -- 172.21.15.144:0/2570778283 wait complete. 2024-05-30T16:50:16.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-05-30T16:50:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.877+0000 7f4420600640 1 Processor -- start 2024-05-30T16:50:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.878+0000 7f4420600640 1 -- start start 2024-05-30T16:50:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.879+0000 7f4420600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44180cfd20 0x7f44180ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.879+0000 7f4420600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44180d4290 0x7f44180d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.879+0000 7f4420600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44180d46e0 con 0x7f441815eaa0 2024-05-30T16:50:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.879+0000 7f4420600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f44180d3f50 con 0x7f44180d4290 2024-05-30T16:50:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.879+0000 7f4420600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f44180d2c90 con 0x7f44180cfd20 2024-05-30T16:50:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.880+0000 7f441e600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44180d4290 0x7f44180d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.880+0000 7f441d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44180cfd20 0x7f44180ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.880+0000 7f441dc00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f441815eaa0 0x7f44180cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:51472/0 (socket says 172.21.15.144:51472) 2024-05-30T16:50:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.880+0000 7f441dc00640 1 -- 172.21.15.144:0/1712077819 learned_addr learned my addr 172.21.15.144:0/1712077819 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:16.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.881+0000 7f441e600640 1 -- 172.21.15.144:0/1712077819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44180cfd20 msgr2=0x7f44180ba1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:16.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.881+0000 7f441e600640 1 --2- 172.21.15.144:0/1712077819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44180cfd20 0x7f44180ba1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.881+0000 7f441e600640 1 -- 172.21.15.144:0/1712077819 >> v1:172.21.15.149:6789/0 conn(0x7f441815eaa0 legacy=0x7f44180cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.881+0000 7f441e600640 1 -- 172.21.15.144:0/1712077819 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441815ee80 con 0x7f44180d4290 2024-05-30T16:50:16.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.882+0000 7f441e600640 1 --2- 172.21.15.144:0/1712077819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44180d4290 0x7f44180d3a10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4410009d90 tx=0x7f441002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8520b6b338f4bcd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:16.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4417e00640 1 -- 172.21.15.144:0/1712077819 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410007740 con 0x7f44180d4290 2024-05-30T16:50:16.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4417e00640 1 -- 172.21.15.144:0/1712077819 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44100078e0 con 0x7f44180d4290 2024-05-30T16:50:16.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4417e00640 1 -- 172.21.15.144:0/1712077819 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410007cb0 con 0x7f44180d4290 2024-05-30T16:50:16.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4420600640 1 -- 172.21.15.144:0/1712077819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44180d4290 msgr2=0x7f44180d3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4420600640 1 --2- 172.21.15.144:0/1712077819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44180d4290 0x7f44180d3a10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4410009d90 tx=0x7f441002a660 comp rx=0 tx=0).stop 2024-05-30T16:50:16.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4420600640 1 -- 172.21.15.144:0/1712077819 shutdown_connections 2024-05-30T16:50:16.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4420600640 1 --2- 172.21.15.144:0/1712077819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44180d4290 0x7f44180d3a10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4420600640 1 --2- 172.21.15.144:0/1712077819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44180cfd20 0x7f44180ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4420600640 1 -- 172.21.15.144:0/1712077819 >> 172.21.15.144:0/1712077819 conn(0x7f44180d13c0 msgr2=0x7f44180d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:16.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4420600640 1 -- 172.21.15.144:0/1712077819 shutdown_connections 2024-05-30T16:50:16.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.883+0000 7f4420600640 1 -- 172.21.15.144:0/1712077819 wait complete. 2024-05-30T16:50:16.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.885+0000 7f4420600640 1 Processor -- start 2024-05-30T16:50:16.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.885+0000 7f4420600640 1 -- start start 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.886+0000 7f4420600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44180cfd20 0x7f44180b9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.886+0000 7f4420600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44180d4290 0x7f44180cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.886+0000 7f4420600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f441815eaa0 0x7f44180cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.886+0000 7f4420600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f44180d34f0 con 0x7f44180cfd20 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.886+0000 7f4420600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f44180d3210 con 0x7f44180d4290 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.886+0000 7f4420600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f44180ba880 con 0x7f441815eaa0 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.886+0000 7f441dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44180cfd20 0x7f44180b9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.886+0000 7f441dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44180cfd20 0x7f44180b9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60460/0 (socket says 172.21.15.144:60460) 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.887+0000 7f441dc00640 1 -- 172.21.15.144:0/1630428709 learned_addr learned my addr 172.21.15.144:0/1630428709 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.887+0000 7f441e600640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f441815eaa0 0x7f44180cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.887+0000 7f441d200640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44180d4290 0x7f44180cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.887+0000 7f441dc00640 1 -- 172.21.15.144:0/1630428709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f441815eaa0 msgr2=0x7f44180cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.887+0000 7f441dc00640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f441815eaa0 0x7f44180cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.887+0000 7f441dc00640 1 -- 172.21.15.144:0/1630428709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44180d4290 msgr2=0x7f44180cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.887+0000 7f441dc00640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44180d4290 0x7f44180cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.887+0000 7f441dc00640 1 -- 172.21.15.144:0/1630428709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44180cd7b0 con 0x7f44180cfd20 2024-05-30T16:50:16.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.887+0000 7f441dc00640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44180cfd20 0x7f44180b9630 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f440800c3f0 tx=0x7f440800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:16.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.888+0000 7f4415600640 1 -- 172.21.15.144:0/1630428709 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408017070 con 0x7f44180cfd20 2024-05-30T16:50:16.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.888+0000 7f4415600640 1 -- 172.21.15.144:0/1630428709 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4408005ce0 con 0x7f44180cfd20 2024-05-30T16:50:16.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.888+0000 7f4415600640 1 -- 172.21.15.144:0/1630428709 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080072f0 con 0x7f44180cfd20 2024-05-30T16:50:16.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.888+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44180cc710 con 0x7f44180cfd20 2024-05-30T16:50:16.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.888+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44180cccd0 con 0x7f44180cfd20 2024-05-30T16:50:16.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.889+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44180ba1f0 con 0x7f44180cfd20 2024-05-30T16:50:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.890+0000 7f4415600640 1 -- 172.21.15.144:0/1630428709 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f440801a070 con 0x7f44180cfd20 2024-05-30T16:50:16.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.891+0000 7f4415600640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f43f806d5e0 0x7f43f806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:16.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.891+0000 7f4415600640 1 -- 172.21.15.144:0/1630428709 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f44080899c0 con 0x7f44180cfd20 2024-05-30T16:50:16.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.892+0000 7f441d200640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f43f806d5e0 0x7f43f806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:16.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.892+0000 7f441d200640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f43f806d5e0 0x7f43f806faa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4418155f40 tx=0x7f4404008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:16.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:16.896+0000 7f4415600640 1 -- 172.21.15.144:0/1630428709 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f44180ba1f0 con 0x7f44180cfd20 2024-05-30T16:50:17.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.097+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f44180b7ba0 con 0x7f44180cfd20 2024-05-30T16:50:17.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.103+0000 7f4415600640 1 -- 172.21.15.144:0/1630428709 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v19)=0 v19) ==== 136+0+0 (secure 0 0 0) 0x7f44180d46e0 con 0x7f44180cfd20 2024-05-30T16:50:17.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f43f806d5e0 msgr2=0x7f43f806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f43f806d5e0 0x7f43f806faa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4418155f40 tx=0x7f4404008040 comp rx=0 tx=0).stop 2024-05-30T16:50:17.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44180cfd20 msgr2=0x7f44180b9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44180cfd20 0x7f44180b9630 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f440800c3f0 tx=0x7f440800c8b0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 shutdown_connections 2024-05-30T16:50:17.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f43f806d5e0 0x7f43f806faa0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f441815eaa0 0x7f44180cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44180d4290 0x7f44180cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 --2- 172.21.15.144:0/1630428709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44180cfd20 0x7f44180b9630 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 >> 172.21.15.144:0/1630428709 conn(0x7f44180d13c0 msgr2=0x7f44181610b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:17.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 shutdown_connections 2024-05-30T16:50:17.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.107+0000 7f4420600640 1 -- 172.21.15.144:0/1630428709 wait complete. 2024-05-30T16:50:17.128 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T16:50:17.129 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.127+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.129 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.127+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.129 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.127+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.129 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.127+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.129 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.127+0000 7fe1cb000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.310+0000 7f9794e00640 1 Processor -- start 2024-05-30T16:50:17.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.310+0000 7f9794e00640 1 -- start start 2024-05-30T16:50:17.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.312+0000 7f9794e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97900cfc40 0x7f979006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.312+0000 7f9794e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f979006f610 0x7f97900b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.312+0000 7f9794e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97900d00f0 con 0x7f9790145150 2024-05-30T16:50:17.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.312+0000 7f9794e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f979015f140 con 0x7f979006f610 2024-05-30T16:50:17.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.312+0000 7f9794e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f979015f390 con 0x7f97900cfc40 2024-05-30T16:50:17.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.312+0000 7f978de00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9790145150 0x7f97900cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43746/0 (socket says 172.21.15.144:43746) 2024-05-30T16:50:17.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.312+0000 7f978de00640 1 -- 172.21.15.144:0/2657211270 learned_addr learned my addr 172.21.15.144:0/2657211270 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:17.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978e800640 1 --2- 172.21.15.144:0/2657211270 >> v2:172.21.15.149:3300/0 conn(0x7f979006f610 0x7f97900b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870476718 0 0) 0x7f97900d00f0 con 0x7f9790145150 2024-05-30T16:50:17.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9774003520 con 0x7f9790145150 2024-05-30T16:50:17.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978d400640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97900cfc40 0x7f979006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 690197653 0 0) 0x7f9774003520 con 0x7f9790145150 2024-05-30T16:50:17.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97900cfc40 msgr2=0x7f979006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:17.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97900cfc40 0x7f979006f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 >> v2:172.21.15.149:3300/0 conn(0x7f979006f610 msgr2=0x7f97900b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 --2- 172.21.15.144:0/2657211270 >> v2:172.21.15.149:3300/0 conn(0x7f979006f610 0x7f97900b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979015f670 con 0x7f9790145150 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f9778001670 con 0x7f9790145150 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 >> v1:172.21.15.144:6789/0 conn(0x7f9790145150 legacy=0x7f97900cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97740039b0 0x7f9774003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.313+0000 7f978ca00640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97900cfc40 0x7f9774004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978ca00640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9774004d40 0x7f97740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f979015f140 con 0x7f97740039b0 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f979015f390 con 0x7f9774004d40 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f977400dc80 con 0x7f97900cfc40 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978de00640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97740039b0 0x7f9774003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978d400640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97900cfc40 0x7f9774004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978e800640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9774004d40 0x7f97740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978de00640 1 -- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97900cfc40 msgr2=0x7f9774004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:17.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978de00640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97900cfc40 0x7f9774004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978de00640 1 -- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9774004d40 msgr2=0x7f97740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:17.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978de00640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9774004d40 0x7f97740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978de00640 1 -- 172.21.15.144:0/2657211270 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9774003520 con 0x7f97740039b0 2024-05-30T16:50:17.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.314+0000 7f978e800640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9774004d40 0x7f97740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:17.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.315+0000 7f978de00640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97740039b0 0x7f9774003dd0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f977800c240 tx=0x7f9774005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9af69386f8f1f7d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:17.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977802e070 con 0x7f97740039b0 2024-05-30T16:50:17.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9778005af0 con 0x7f97740039b0 2024-05-30T16:50:17.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f978ca00640 1 -- 172.21.15.144:0/2657211270 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778007d30 con 0x7f97740039b0 2024-05-30T16:50:17.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f9794e00640 1 -- 172.21.15.144:0/2657211270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97740039b0 msgr2=0x7f9774003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f9794e00640 1 --2- 172.21.15.144:0/2657211270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97740039b0 0x7f9774003dd0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f977800c240 tx=0x7f9774005830 comp rx=0 tx=0).stop 2024-05-30T16:50:17.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f978e800640 1 -- 172.21.15.144:0/2657211270 reap_dead start 2024-05-30T16:50:17.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f9794e00640 1 -- 172.21.15.144:0/2657211270 shutdown_connections 2024-05-30T16:50:17.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f9794e00640 1 -- 172.21.15.144:0/2657211270 >> 172.21.15.144:0/2657211270 conn(0x7f979006bd00 msgr2=0x7f979006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:17.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f9794e00640 1 -- 172.21.15.144:0/2657211270 shutdown_connections 2024-05-30T16:50:17.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.316+0000 7f9794e00640 1 -- 172.21.15.144:0/2657211270 wait complete. 2024-05-30T16:50:17.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.318+0000 7f9794e00640 1 Processor -- start 2024-05-30T16:50:17.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.318+0000 7f9794e00640 1 -- start start 2024-05-30T16:50:17.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.319+0000 7f9794e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97740039b0 0x7f97900aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.319+0000 7f9794e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f979015db90 0x7f9790142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.319+0000 7f9794e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979013dac0 0x7f979013df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.319+0000 7f9794e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f979015fe70 con 0x7f979015db90 2024-05-30T16:50:17.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.319+0000 7f9794e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f97900b64f0 con 0x7f979013dac0 2024-05-30T16:50:17.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.319+0000 7f9794e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f979015fff0 con 0x7f97740039b0 2024-05-30T16:50:17.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.319+0000 7f978d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f979015db90 0x7f9790142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.319+0000 7f978d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f979015db90 0x7f9790142fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60494/0 (socket says 172.21.15.144:60494) 2024-05-30T16:50:17.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.319+0000 7f978d400640 1 -- 172.21.15.144:0/2689874039 learned_addr learned my addr 172.21.15.144:0/2689874039 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f978de00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97740039b0 0x7f97900aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f978d400640 1 -- 172.21.15.144:0/2689874039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97740039b0 msgr2=0x7f97900aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f978d400640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97740039b0 0x7f97900aaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f978e800640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979013dac0 0x7f979013df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f978d400640 1 -- 172.21.15.144:0/2689874039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979013dac0 msgr2=0x7f979013df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f978d400640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979013dac0 0x7f979013df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f978d400640 1 -- 172.21.15.144:0/2689874039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979013e480 con 0x7f979015db90 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f978de00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97740039b0 0x7f97900aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f978d400640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f979015db90 0x7f9790142fc0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9780009cb0 tx=0x7f9780007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f9786000640 1 -- 172.21.15.144:0/2689874039 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780014610 con 0x7f979015db90 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f9786000640 1 -- 172.21.15.144:0/2689874039 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9780019070 con 0x7f979015db90 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f9786000640 1 -- 172.21.15.144:0/2689874039 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97800149d0 con 0x7f979015db90 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.320+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979015e3e0 con 0x7f979015db90 2024-05-30T16:50:17.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.321+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979015e9a0 con 0x7f979015db90 2024-05-30T16:50:17.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.322+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9790068b90 con 0x7f979015db90 2024-05-30T16:50:17.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.323+0000 7f9786000640 1 -- 172.21.15.144:0/2689874039 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7f9780014b70 con 0x7f979015db90 2024-05-30T16:50:17.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.324+0000 7f9786000640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f976c06d5e0 0x7f976c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.324+0000 7f9786000640 1 -- 172.21.15.144:0/2689874039 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f978008b1b0 con 0x7f979015db90 2024-05-30T16:50:17.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.324+0000 7f978de00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f976c06d5e0 0x7f976c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.325+0000 7f978de00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f976c06d5e0 0x7f976c06faa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9778033000 tx=0x7f9778009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:17.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.328+0000 7f9786000640 1 -- 172.21.15.144:0/2689874039 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f978005ada0 con 0x7f979015db90 2024-05-30T16:50:17.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.563+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f979006e520 con 0x7f976c06d5e0 2024-05-30T16:50:17.577 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.576+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.577 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.576+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.577 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.576+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.577 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.576+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.577 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:17.576+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:17.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.641+0000 7f9786000640 1 -- 172.21.15.144:0/2689874039 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f979006e520 con 0x7f976c06d5e0 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f976c06d5e0 msgr2=0x7f976c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f976c06d5e0 0x7f976c06faa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9778033000 tx=0x7f9778009030 comp rx=0 tx=0).stop 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f979015db90 msgr2=0x7f9790142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f979015db90 0x7f9790142fc0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9780009cb0 tx=0x7f9780007700 comp rx=0 tx=0).stop 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 shutdown_connections 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f976c06d5e0 0x7f976c06faa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979013dac0 0x7f979013df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f979015db90 0x7f9790142fc0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 --2- 172.21.15.144:0/2689874039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97740039b0 0x7f97900aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.644+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 >> 172.21.15.144:0/2689874039 conn(0x7f979006bd00 msgr2=0x7f97900cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:17.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.645+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 shutdown_connections 2024-05-30T16:50:17.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.645+0000 7f9794e00640 1 -- 172.21.15.144:0/2689874039 wait complete. 2024-05-30T16:50:17.665 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:50:17.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:50:17.782 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:50:17.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.853+0000 7fea8fe00640 1 Processor -- start 2024-05-30T16:50:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.853+0000 7fea8fe00640 1 -- start start 2024-05-30T16:50:17.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea8fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea9006f7d0 0x7fea900b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea8fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea900cfa60 0x7fea900b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea8fe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9006e3f0 con 0x7fea9015eaa0 2024-05-30T16:50:17.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea8fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fea9006e110 con 0x7fea9006f7d0 2024-05-30T16:50:17.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea8fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fea900cd6c0 con 0x7fea900cfa60 2024-05-30T16:50:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea86000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea9006f7d0 0x7fea900b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea86000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea9006f7d0 0x7fea900b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60510/0 (socket says 172.21.15.144:60510) 2024-05-30T16:50:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea86000640 1 -- 172.21.15.144:0/2602071895 learned_addr learned my addr 172.21.15.144:0/2602071895 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea86000640 1 -- 172.21.15.144:0/2602071895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea900cfa60 msgr2=0x7fea900b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.855+0000 7fea86000640 1 --2- 172.21.15.144:0/2602071895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea900cfa60 0x7fea900b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.856+0000 7fea86000640 1 -- 172.21.15.144:0/2602071895 >> v1:172.21.15.149:6789/0 conn(0x7fea9015eaa0 legacy=0x7fea900cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.856+0000 7fea86000640 1 -- 172.21.15.144:0/2602071895 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea900cd9a0 con 0x7fea9006f7d0 2024-05-30T16:50:17.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.857+0000 7fea86000640 1 --2- 172.21.15.144:0/2602071895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea9006f7d0 0x7fea900b36a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fea78009870 tx=0x7fea7802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83840fe09878d93 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:17.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.857+0000 7fea8e000640 1 -- 172.21.15.144:0/2602071895 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78037070 con 0x7fea9006f7d0 2024-05-30T16:50:17.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.857+0000 7fea8e000640 1 -- 172.21.15.144:0/2602071895 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea78032440 con 0x7fea9006f7d0 2024-05-30T16:50:17.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.857+0000 7fea8e000640 1 -- 172.21.15.144:0/2602071895 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78032810 con 0x7fea9006f7d0 2024-05-30T16:50:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.857+0000 7fea8fe00640 1 -- 172.21.15.144:0/2602071895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea9006f7d0 msgr2=0x7fea900b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.857+0000 7fea8fe00640 1 --2- 172.21.15.144:0/2602071895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea9006f7d0 0x7fea900b36a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fea78009870 tx=0x7fea7802a180 comp rx=0 tx=0).stop 2024-05-30T16:50:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.858+0000 7fea8fe00640 1 -- 172.21.15.144:0/2602071895 shutdown_connections 2024-05-30T16:50:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.858+0000 7fea8fe00640 1 --2- 172.21.15.144:0/2602071895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea900cfa60 0x7fea900b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.858+0000 7fea8fe00640 1 --2- 172.21.15.144:0/2602071895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea9006f7d0 0x7fea900b36a0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.858+0000 7fea8fe00640 1 -- 172.21.15.144:0/2602071895 >> 172.21.15.144:0/2602071895 conn(0x7fea9006b8e0 msgr2=0x7fea9006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.858+0000 7fea8fe00640 1 -- 172.21.15.144:0/2602071895 shutdown_connections 2024-05-30T16:50:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.858+0000 7fea8fe00640 1 -- 172.21.15.144:0/2602071895 wait complete. 2024-05-30T16:50:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.859+0000 7fea8fe00640 1 Processor -- start 2024-05-30T16:50:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.859+0000 7fea8fe00640 1 -- start start 2024-05-30T16:50:17.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.860+0000 7fea8fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9006f7d0 0x7fea90149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.860+0000 7fea8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea900cfa60 0x7fea900b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.860+0000 7fea8fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9015eaa0 0x7fea900b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.860+0000 7fea8fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fea9006dd30 con 0x7fea900cfa60 2024-05-30T16:50:17.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.860+0000 7fea8fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea9015ee80 con 0x7fea9006f7d0 2024-05-30T16:50:17.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.860+0000 7fea8fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fea9006deb0 con 0x7fea9015eaa0 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea86000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea900cfa60 0x7fea900b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea86000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea900cfa60 0x7fea900b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60518/0 (socket says 172.21.15.144:60518) 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea86000640 1 -- 172.21.15.144:0/2854649376 learned_addr learned my addr 172.21.15.144:0/2854649376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea8ea00640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9006f7d0 0x7fea90149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea8f400640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9015eaa0 0x7fea900b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea86000640 1 -- 172.21.15.144:0/2854649376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9015eaa0 msgr2=0x7fea900b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea86000640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9015eaa0 0x7fea900b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea86000640 1 -- 172.21.15.144:0/2854649376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9006f7d0 msgr2=0x7fea90149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea86000640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9006f7d0 0x7fea90149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea86000640 1 -- 172.21.15.144:0/2854649376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9014a2e0 con 0x7fea900cfa60 2024-05-30T16:50:17.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.861+0000 7fea86000640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea900cfa60 0x7fea900b0770 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fea78009870 tx=0x7fea780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:17.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.862+0000 7fea87400640 1 -- 172.21.15.144:0/2854649376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78041070 con 0x7fea900cfa60 2024-05-30T16:50:17.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.862+0000 7fea87400640 1 -- 172.21.15.144:0/2854649376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7803c870 con 0x7fea900cfa60 2024-05-30T16:50:17.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.862+0000 7fea87400640 1 -- 172.21.15.144:0/2854649376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78037040 con 0x7fea900cfa60 2024-05-30T16:50:17.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.862+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea901f48d0 con 0x7fea900cfa60 2024-05-30T16:50:17.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.862+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea901f4e90 con 0x7fea900cfa60 2024-05-30T16:50:17.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.863+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea900632f0 con 0x7fea900cfa60 2024-05-30T16:50:17.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.864+0000 7fea87400640 1 -- 172.21.15.144:0/2854649376 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 92213+0+0 (secure 0 0 0) 0x7fea78044070 con 0x7fea900cfa60 2024-05-30T16:50:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.865+0000 7fea87400640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fea6c06d5e0 0x7fea6c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.865+0000 7fea87400640 1 -- 172.21.15.144:0/2854649376 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7fea780ab130 con 0x7fea900cfa60 2024-05-30T16:50:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.865+0000 7fea8ea00640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fea6c06d5e0 0x7fea6c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:17.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.866+0000 7fea8ea00640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fea6c06d5e0 0x7fea6c06faa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fea900b13e0 tx=0x7fea800094d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:17.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:17.869+0000 7fea87400640 1 -- 172.21.15.144:0/2854649376 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea780b3020 con 0x7fea900cfa60 2024-05-30T16:50:18.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.104+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fea90075570 con 0x7fea6c06d5e0 2024-05-30T16:50:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.110+0000 7fea87400640 1 -- 172.21.15.144:0/2854649376 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fea90075570 con 0x7fea6c06d5e0 2024-05-30T16:50:18.111 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270 2024-05-30T16:50:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fea6c06d5e0 msgr2=0x7fea6c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fea6c06d5e0 0x7fea6c06faa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fea900b13e0 tx=0x7fea800094d0 comp rx=0 tx=0).stop 2024-05-30T16:50:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea900cfa60 msgr2=0x7fea900b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea900cfa60 0x7fea900b0770 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fea78009870 tx=0x7fea780046c0 comp rx=0 tx=0).stop 2024-05-30T16:50:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 shutdown_connections 2024-05-30T16:50:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fea6c06d5e0 0x7fea6c06faa0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9015eaa0 0x7fea900b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea900cfa60 0x7fea900b0770 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:18.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 --2- 172.21.15.144:0/2854649376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9006f7d0 0x7fea90149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:18.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.112+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 >> 172.21.15.144:0/2854649376 conn(0x7fea9006b8e0 msgr2=0x7fea900b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:18.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.113+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 shutdown_connections 2024-05-30T16:50:18.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:18.113+0000 7fea8fe00640 1 -- 172.21.15.144:0/2854649376 wait complete. 2024-05-30T16:50:18.139 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270 2024-05-30T16:50:18.139 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:50:18.139 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:18.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:18.185 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:25.497 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:50:25.497 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:50:25.497 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.19913 s, 149 MB/s 2024-05-30T16:50:25.499 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:50:25.499 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:25.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:25.537 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:50:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:50:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.02333 s, 153 MB/s 2024-05-30T16:50:32.653 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:50:32.653 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:50:32.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:32.691 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T16:50:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records in 2024-05-30T16:50:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:1024+0 records out 2024-05-30T16:50:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.12344 s, 151 MB/s 2024-05-30T16:50:39.906 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T16:50:40.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.076+0000 7f5fade00640 1 Processor -- start 2024-05-30T16:50:40.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.076+0000 7f5fade00640 1 -- start start 2024-05-30T16:50:40.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.077+0000 7f5fade00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5fa80721f0 0x7f5fa80cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.077+0000 7f5fade00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa8160b90 con 0x7f5fa8146010 2024-05-30T16:50:40.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.077+0000 7f5fade00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa8160e70 con 0x7f5fa8071d60 2024-05-30T16:50:40.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.077+0000 7f5fade00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa80cce00 con 0x7f5fa80721f0 2024-05-30T16:50:40.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.078+0000 7f5faca00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5fa8146010 0x7f5fa81600f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48398/0 (socket says 172.21.15.144:48398) 2024-05-30T16:50:40.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.078+0000 7f5faca00640 1 -- 172.21.15.144:0/3492678388 learned_addr learned my addr 172.21.15.144:0/3492678388 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:40.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.078+0000 7f5fad400640 1 --2- 172.21.15.144:0/3492678388 >> v2:172.21.15.144:3300/0 conn(0x7f5fa80721f0 0x7f5fa80cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:40.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.078+0000 7f5fa7e00640 1 -- 172.21.15.144:0/3492678388 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902537394 0 0) 0x7f5fa8160b90 con 0x7f5fa8146010 2024-05-30T16:50:40.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.078+0000 7f5fa7e00640 1 -- 172.21.15.144:0/3492678388 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f8c003520 con 0x7f5fa8146010 2024-05-30T16:50:40.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.078+0000 7f5fad400640 1 -- 172.21.15.144:0/3492678388 >> v1:172.21.15.149:6789/0 conn(0x7f5fa8071d60 legacy=0x7f5fa80cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.078+0000 7f5fad400640 1 -- 172.21.15.144:0/3492678388 >> v1:172.21.15.144:6789/0 conn(0x7f5fa8146010 legacy=0x7f5fa81600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.078+0000 7f5fad400640 1 -- 172.21.15.144:0/3492678388 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa80cd0e0 con 0x7f5fa80721f0 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.079+0000 7f5fad400640 1 --2- 172.21.15.144:0/3492678388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa80721f0 0x7f5fa80cdff0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009d90 tx=0x7f5fa002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee2b458efd521d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.079+0000 7f5fa7e00640 1 -- 172.21.15.144:0/3492678388 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0007740 con 0x7f5fa80721f0 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.079+0000 7f5fa7e00640 1 -- 172.21.15.144:0/3492678388 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa00078e0 con 0x7f5fa80721f0 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.079+0000 7f5fa7e00640 1 -- 172.21.15.144:0/3492678388 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0007c90 con 0x7f5fa80721f0 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.080+0000 7f5fade00640 1 -- 172.21.15.144:0/3492678388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa80721f0 msgr2=0x7f5fa80cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.080+0000 7f5fade00640 1 --2- 172.21.15.144:0/3492678388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa80721f0 0x7f5fa80cdff0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009d90 tx=0x7f5fa002a6a0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.080+0000 7f5fade00640 1 -- 172.21.15.144:0/3492678388 shutdown_connections 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.080+0000 7f5fade00640 1 --2- 172.21.15.144:0/3492678388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa80721f0 0x7f5fa80cdff0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.080+0000 7f5fade00640 1 -- 172.21.15.144:0/3492678388 >> 172.21.15.144:0/3492678388 conn(0x7f5fa80b2160 msgr2=0x7f5fa80b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.080+0000 7f5fade00640 1 -- 172.21.15.144:0/3492678388 shutdown_connections 2024-05-30T16:50:40.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.080+0000 7f5fade00640 1 -- 172.21.15.144:0/3492678388 wait complete. 2024-05-30T16:50:40.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.082+0000 7f5fade00640 1 Processor -- start 2024-05-30T16:50:40.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.082+0000 7f5fade00640 1 -- start start 2024-05-30T16:50:40.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5fade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa8071d60 0x7f5fa813f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5fade00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa80721f0 0x7f5fa8140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5fade00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fa8146010 0x7f5fa81f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5fade00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa8160800 con 0x7f5fa8071d60 2024-05-30T16:50:40.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5fade00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa8072600 con 0x7f5fa80721f0 2024-05-30T16:50:40.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5fade00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa815cd20 con 0x7f5fa8146010 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5faca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa8071d60 0x7f5fa813f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5faca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa8071d60 0x7f5fa813f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49234/0 (socket says 172.21.15.144:49234) 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5faca00640 1 -- 172.21.15.144:0/1430112421 learned_addr learned my addr 172.21.15.144:0/1430112421 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5faca00640 1 -- 172.21.15.144:0/1430112421 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fa8146010 msgr2=0x7f5fa81f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5faca00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fa8146010 0x7f5fa81f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5faca00640 1 -- 172.21.15.144:0/1430112421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa80721f0 msgr2=0x7f5fa8140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5f9fe00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa80721f0 0x7f5fa8140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5faca00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa80721f0 0x7f5fa8140490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.083+0000 7f5faca00640 1 -- 172.21.15.144:0/1430112421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa81413c0 con 0x7f5fa8071d60 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.084+0000 7f5faca00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa8071d60 0x7f5fa813f400 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800c3c0 tx=0x7f5f9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.084+0000 7f5fa5600640 1 -- 172.21.15.144:0/1430112421 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98017070 con 0x7f5fa8071d60 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.084+0000 7f5fa5600640 1 -- 172.21.15.144:0/1430112421 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f98005ce0 con 0x7f5fa8071d60 2024-05-30T16:50:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.084+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa8140e00 con 0x7f5fa8071d60 2024-05-30T16:50:40.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.084+0000 7f5fa5600640 1 -- 172.21.15.144:0/1430112421 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f980072f0 con 0x7f5fa8071d60 2024-05-30T16:50:40.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.084+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa814b950 con 0x7f5fa8071d60 2024-05-30T16:50:40.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.085+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa8075570 con 0x7f5fa8071d60 2024-05-30T16:50:40.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.086+0000 7f5fa5600640 1 -- 172.21.15.144:0/1430112421 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 26) ==== 92315+0+0 (secure 0 0 0) 0x7f5f9801a070 con 0x7f5fa8071d60 2024-05-30T16:50:40.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.087+0000 7f5fa5600640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5f8406d700 0x7f5f8406fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.087+0000 7f5fa5600640 1 -- 172.21.15.144:0/1430112421 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f5f98089ce0 con 0x7f5fa8071d60 2024-05-30T16:50:40.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.087+0000 7f5f9fe00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5f8406d700 0x7f5f8406fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:40.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.088+0000 7f5f9fe00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5f8406d700 0x7f5f8406fbc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80750f0 tx=0x7f5f90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:40.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.091+0000 7f5fa5600640 1 -- 172.21.15.144:0/1430112421 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5f980598a0 con 0x7f5fa8071d60 2024-05-30T16:50:40.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.310+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f5fa8072dc0 con 0x7f5f8406d700 2024-05-30T16:50:40.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.338+0000 7f5fa5600640 1 -- 172.21.15.144:0/1430112421 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5fa8072dc0 con 0x7f5f8406d700 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5f8406d700 msgr2=0x7f5f8406fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5f8406d700 0x7f5f8406fbc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80750f0 tx=0x7f5f90009040 comp rx=0 tx=0).stop 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa8071d60 msgr2=0x7f5fa813f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa8071d60 0x7f5fa813f400 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800c3c0 tx=0x7f5f9800c880 comp rx=0 tx=0).stop 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 shutdown_connections 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5f8406d700 0x7f5f8406fbc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fa8146010 0x7f5fa81f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa80721f0 0x7f5fa8140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 --2- 172.21.15.144:0/1430112421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fa8071d60 0x7f5fa813f400 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.340+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 >> 172.21.15.144:0/1430112421 conn(0x7f5fa80b2160 msgr2=0x7f5fa806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:40.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.341+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 shutdown_connections 2024-05-30T16:50:40.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.341+0000 7f5fade00640 1 -- 172.21.15.144:0/1430112421 wait complete. 2024-05-30T16:50:40.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T16:50:40.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.547+0000 7fda15800640 1 Processor -- start 2024-05-30T16:50:40.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.547+0000 7fda15800640 1 -- start start 2024-05-30T16:50:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.549+0000 7fda15800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda100cec70 0x7fda100b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.549+0000 7fda15800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda10160730 con 0x7fda1013f760 2024-05-30T16:50:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.549+0000 7fda15800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda10160a10 con 0x7fda100b5e00 2024-05-30T16:50:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.549+0000 7fda15800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fda101612b0 con 0x7fda100cec70 2024-05-30T16:50:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.549+0000 7fda06000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda100cec70 0x7fda100b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.549+0000 7fda0ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fda1013f760 0x7fda1006e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48414/0 (socket says 172.21.15.144:48414) 2024-05-30T16:50:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.549+0000 7fda0ea00640 1 -- 172.21.15.144:0/1627775749 learned_addr learned my addr 172.21.15.144:0/1627775749 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.550+0000 7fda06000640 1 -- 172.21.15.144:0/1627775749 >> v1:172.21.15.149:6789/0 conn(0x7fda100b5e00 legacy=0x7fda10142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.550+0000 7fda06000640 1 -- 172.21.15.144:0/1627775749 >> v1:172.21.15.144:6789/0 conn(0x7fda1013f760 legacy=0x7fda1006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.550+0000 7fda06000640 1 -- 172.21.15.144:0/1627775749 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda10160cf0 con 0x7fda100cec70 2024-05-30T16:50:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.550+0000 7fda0e000640 1 -- 172.21.15.144:0/1627775749 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212028229 0 0) 0x7fda10160730 con 0x7fda1013f760 2024-05-30T16:50:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.551+0000 7fda06000640 1 --2- 172.21.15.144:0/1627775749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 0x7fda100b58c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80097a0 tx=0x7fd9f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6ae08fc7d1ba26 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.551+0000 7fda0e000640 1 -- 172.21.15.144:0/1627775749 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8037070 con 0x7fda100cec70 2024-05-30T16:50:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.551+0000 7fda0e000640 1 -- 172.21.15.144:0/1627775749 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f8032440 con 0x7fda100cec70 2024-05-30T16:50:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.551+0000 7fda0e000640 1 -- 172.21.15.144:0/1627775749 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8032810 con 0x7fda100cec70 2024-05-30T16:50:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.552+0000 7fda15800640 1 -- 172.21.15.144:0/1627775749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 msgr2=0x7fda100b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.552+0000 7fda15800640 1 --2- 172.21.15.144:0/1627775749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 0x7fda100b58c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80097a0 tx=0x7fd9f802a270 comp rx=0 tx=0).stop 2024-05-30T16:50:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.552+0000 7fda15800640 1 -- 172.21.15.144:0/1627775749 shutdown_connections 2024-05-30T16:50:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.552+0000 7fda15800640 1 --2- 172.21.15.144:0/1627775749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 0x7fda100b58c0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.552+0000 7fda15800640 1 -- 172.21.15.144:0/1627775749 >> 172.21.15.144:0/1627775749 conn(0x7fda1006bd00 msgr2=0x7fda1006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.552+0000 7fda15800640 1 -- 172.21.15.144:0/1627775749 shutdown_connections 2024-05-30T16:50:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.552+0000 7fda15800640 1 -- 172.21.15.144:0/1627775749 wait complete. 2024-05-30T16:50:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.553+0000 7fda15800640 1 Processor -- start 2024-05-30T16:50:40.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.554+0000 7fda15800640 1 -- start start 2024-05-30T16:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.554+0000 7fda15800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda100b5e00 0x7fda100ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda15800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 0x7fda100a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda15800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda1013f760 0x7fda1013be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda15800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fda100cf0d0 con 0x7fda100cec70 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda15800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fda100cf250 con 0x7fda1013f760 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda15800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fda100ce6a0 con 0x7fda100b5e00 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda06000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 0x7fda100a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda06000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 0x7fda100a9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49254/0 (socket says 172.21.15.144:49254) 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda06000640 1 -- 172.21.15.144:0/3985128571 learned_addr learned my addr 172.21.15.144:0/3985128571 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda06000640 1 -- 172.21.15.144:0/3985128571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda100b5e00 msgr2=0x7fda100ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda06000640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda100b5e00 0x7fda100ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda06000640 1 -- 172.21.15.144:0/3985128571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda1013f760 msgr2=0x7fda1013be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda0f400640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda1013f760 0x7fda1013be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda06000640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda1013f760 0x7fda1013be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.555+0000 7fda06000640 1 -- 172.21.15.144:0/3985128571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda100a9ff0 con 0x7fda100cec70 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.556+0000 7fda06000640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 0x7fda100a9530 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80097a0 tx=0x7fd9f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.556+0000 7fda07400640 1 -- 172.21.15.144:0/3985128571 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8041070 con 0x7fda100cec70 2024-05-30T16:50:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.556+0000 7fda07400640 1 -- 172.21.15.144:0/3985128571 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f803c870 con 0x7fda100cec70 2024-05-30T16:50:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.556+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda100aa2d0 con 0x7fda100cec70 2024-05-30T16:50:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.556+0000 7fda07400640 1 -- 172.21.15.144:0/3985128571 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8037040 con 0x7fda100cec70 2024-05-30T16:50:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.556+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda100b02d0 con 0x7fda100cec70 2024-05-30T16:50:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.557+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda10075430 con 0x7fda100cec70 2024-05-30T16:50:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.558+0000 7fda07400640 1 -- 172.21.15.144:0/3985128571 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 26) ==== 92315+0+0 (secure 0 0 0) 0x7fd9f8044070 con 0x7fda100cec70 2024-05-30T16:50:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.559+0000 7fda07400640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9ec06d700 0x7fd9ec06fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.559+0000 7fda07400640 1 -- 172.21.15.144:0/3985128571 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fd9f80ab480 con 0x7fda100cec70 2024-05-30T16:50:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.559+0000 7fda0ea00640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9ec06d700 0x7fd9ec06fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:40.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.560+0000 7fda0ea00640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9ec06d700 0x7fd9ec06fbc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fda00007fd0 tx=0x7fda00007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.563+0000 7fda07400640 1 -- 172.21.15.144:0/3985128571 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda10075430 con 0x7fda100cec70 2024-05-30T16:50:40.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.777+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fda100acf10 con 0x7fd9ec06d700 2024-05-30T16:50:40.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.786+0000 7fda07400640 1 -- 172.21.15.144:0/3985128571 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fda000070d0 con 0x7fd9ec06d700 2024-05-30T16:50:40.788 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9ec06d700 msgr2=0x7fd9ec06fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9ec06d700 0x7fd9ec06fbc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fda00007fd0 tx=0x7fda00007960 comp rx=0 tx=0).stop 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 msgr2=0x7fda100a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 0x7fda100a9530 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80097a0 tx=0x7fd9f80046c0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 shutdown_connections 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd9ec06d700 0x7fd9ec06fbc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda1013f760 0x7fda1013be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda100cec70 0x7fda100a9530 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 --2- 172.21.15.144:0/3985128571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda100b5e00 0x7fda100ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:40.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 >> 172.21.15.144:0/3985128571 conn(0x7fda1006bd00 msgr2=0x7fda1015ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:40.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.789+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 shutdown_connections 2024-05-30T16:50:40.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:40.790+0000 7fda15800640 1 -- 172.21.15.144:0/3985128571 wait complete. 2024-05-30T16:50:40.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:40.869 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270 2024-05-30T16:50:40.869 DEBUG:teuthology.orchestra.run.smithi144:> ) 2024-05-30T16:50:40.926 INFO:teuthology.orchestra.run.smithi144.stdout:# file: volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270 2024-05-30T16:50:40.926 INFO:teuthology.orchestra.run.smithi144.stdout:ceph.dir.rbytes="2972172288" 2024-05-30T16:50:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:40.927 INFO:tasks.cephfs.test_volumes:r_size = 2972172288 exp_size = 3221225472 2024-05-30T16:50:42.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:50:42.928 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270 2024-05-30T16:50:42.928 DEBUG:teuthology.orchestra.run.smithi144:> ) 2024-05-30T16:50:42.987 INFO:teuthology.orchestra.run.smithi144.stdout:# file: volumes/_nogroup/sv1/7a7e7d2b-9329-4a3a-8f74-e9f945999270 2024-05-30T16:50:42.987 INFO:teuthology.orchestra.run.smithi144.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T16:50:42.988 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:42.989 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T16:50:42.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone8311 2024-05-30T16:50:43.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.201+0000 7f1b83600640 1 Processor -- start 2024-05-30T16:50:43.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.202+0000 7f1b83600640 1 -- start start 2024-05-30T16:50:43.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.203+0000 7f1b83600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b7c06b8e0 0x7f1b7c1639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.203+0000 7f1b83600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7c06c050 con 0x7f1b7c163ef0 2024-05-30T16:50:43.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.203+0000 7f1b83600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7c06c330 con 0x7f1b7c1635d0 2024-05-30T16:50:43.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.203+0000 7f1b83600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c0b5480 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.204+0000 7f1b7be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b7c06b8e0 0x7f1b7c1639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.204+0000 7f1b81600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1b7c163ef0 0x7f1b7c16c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48416/0 (socket says 172.21.15.144:48416) 2024-05-30T16:50:43.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.204+0000 7f1b81600640 1 -- 172.21.15.144:0/683852196 learned_addr learned my addr 172.21.15.144:0/683852196 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:43.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.204+0000 7f1b7be00640 1 --2- 172.21.15.144:0/683852196 >> v2:172.21.15.144:3300/0 conn(0x7f1b7c06b8e0 0x7f1b7c1639b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49266/0 (socket says 172.21.15.144:49266) 2024-05-30T16:50:43.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.204+0000 7f1b7be00640 1 -- 172.21.15.144:0/683852196 >> v1:172.21.15.149:6789/0 conn(0x7f1b7c1635d0 legacy=0x7f1b7c0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:43.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.204+0000 7f1b7be00640 1 -- 172.21.15.144:0/683852196 >> v1:172.21.15.144:6789/0 conn(0x7f1b7c163ef0 legacy=0x7f1b7c16c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.204+0000 7f1b7be00640 1 -- 172.21.15.144:0/683852196 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c06c610 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.204+0000 7f1b7b400640 1 -- 172.21.15.144:0/683852196 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558719733 0 0) 0x7f1b7c06c050 con 0x7f1b7c163ef0 2024-05-30T16:50:43.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.205+0000 7f1b7be00640 1 --2- 172.21.15.144:0/683852196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 0x7f1b7c1639b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f1b640097a0 tx=0x7f1b6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32a9c4ef85156fd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:43.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.206+0000 7f1b7b400640 1 -- 172.21.15.144:0/683852196 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64037070 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.206+0000 7f1b7b400640 1 -- 172.21.15.144:0/683852196 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b64032440 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.206+0000 7f1b7b400640 1 -- 172.21.15.144:0/683852196 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64032810 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.206+0000 7f1b83600640 1 -- 172.21.15.144:0/683852196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 msgr2=0x7f1b7c1639b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.206+0000 7f1b83600640 1 --2- 172.21.15.144:0/683852196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 0x7f1b7c1639b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f1b640097a0 tx=0x7f1b6402a270 comp rx=0 tx=0).stop 2024-05-30T16:50:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.207+0000 7f1b83600640 1 -- 172.21.15.144:0/683852196 shutdown_connections 2024-05-30T16:50:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.207+0000 7f1b83600640 1 --2- 172.21.15.144:0/683852196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 0x7f1b7c1639b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.207+0000 7f1b83600640 1 -- 172.21.15.144:0/683852196 >> 172.21.15.144:0/683852196 conn(0x7f1b7c0d1130 msgr2=0x7f1b7c0d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.207+0000 7f1b83600640 1 -- 172.21.15.144:0/683852196 shutdown_connections 2024-05-30T16:50:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.207+0000 7f1b83600640 1 -- 172.21.15.144:0/683852196 wait complete. 2024-05-30T16:50:43.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.208+0000 7f1b83600640 1 Processor -- start 2024-05-30T16:50:43.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.208+0000 7f1b83600640 1 -- start start 2024-05-30T16:50:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.209+0000 7f1b83600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 0x7f1b7c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.209+0000 7f1b83600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c1635d0 0x7f1b7c14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.209+0000 7f1b83600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c163ef0 0x7f1b7c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.209+0000 7f1b83600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c06bd40 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.209+0000 7f1b83600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c15d810 con 0x7f1b7c1635d0 2024-05-30T16:50:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.209+0000 7f1b83600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c06d0f0 con 0x7f1b7c163ef0 2024-05-30T16:50:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.210+0000 7f1b80c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 0x7f1b7c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.210+0000 7f1b80c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 0x7f1b7c0b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49276/0 (socket says 172.21.15.144:49276) 2024-05-30T16:50:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.210+0000 7f1b80c00640 1 -- 172.21.15.144:0/149232561 learned_addr learned my addr 172.21.15.144:0/149232561 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.210+0000 7f1b7be00640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c1635d0 0x7f1b7c14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.210+0000 7f1b80c00640 1 -- 172.21.15.144:0/149232561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c163ef0 msgr2=0x7f1b7c14d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.210+0000 7f1b80c00640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c163ef0 0x7f1b7c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.210+0000 7f1b80c00640 1 -- 172.21.15.144:0/149232561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c1635d0 msgr2=0x7f1b7c14cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.210+0000 7f1b80c00640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c1635d0 0x7f1b7c14cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.210+0000 7f1b80c00640 1 -- 172.21.15.144:0/149232561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c14fb90 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.211+0000 7f1b80c00640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 0x7f1b7c0b1b30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00c430 tx=0x7f1b6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.211+0000 7f1b78c00640 1 -- 172.21.15.144:0/149232561 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c011790 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.211+0000 7f1b78c00640 1 -- 172.21.15.144:0/149232561 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6c017070 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.211+0000 7f1b78c00640 1 -- 172.21.15.144:0/149232561 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c011bb0 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.211+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c14fe50 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.211+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7c150410 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.212+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7c068b90 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.213+0000 7f1b78c00640 1 -- 172.21.15.144:0/149232561 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 26) ==== 92315+0+0 (secure 0 0 0) 0x7f1b6c01c460 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.214+0000 7f1b78c00640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b5806d700 0x7f1b5806fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.214+0000 7f1b78c00640 1 -- 172.21.15.144:0/149232561 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f1b6c08a8b0 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.214+0000 7f1b7be00640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b5806d700 0x7f1b5806fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.215+0000 7f1b7be00640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b5806d700 0x7f1b5806fbc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1b64034000 tx=0x7f1b6402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:43.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.219+0000 7f1b78c00640 1 -- 172.21.15.144:0/149232561 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b6c05a330 con 0x7f1b7c06b8e0 2024-05-30T16:50:43.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.448+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone8311", "target": ["mon-mgr", ""]}) -- 0x7f1b7c075f70 con 0x7f1b5806d700 2024-05-30T16:50:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.602+0000 7f1b78c00640 1 -- 172.21.15.144:0/149232561 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1b64032610 con 0x7f1b5806d700 2024-05-30T16:50:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b5806d700 msgr2=0x7f1b5806fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b5806d700 0x7f1b5806fbc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1b64034000 tx=0x7f1b6402e000 comp rx=0 tx=0).stop 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 msgr2=0x7f1b7c0b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 0x7f1b7c0b1b30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00c430 tx=0x7f1b6c00c8f0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 shutdown_connections 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f1b5806d700 0x7f1b5806fbc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c163ef0 0x7f1b7c14d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c1635d0 0x7f1b7c14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 --2- 172.21.15.144:0/149232561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7c06b8e0 0x7f1b7c0b1b30 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 >> 172.21.15.144:0/149232561 conn(0x7f1b7c0d1130 msgr2=0x7f1b7c0d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 shutdown_connections 2024-05-30T16:50:43.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.605+0000 7f1b83600640 1 -- 172.21.15.144:0/149232561 wait complete. 2024-05-30T16:50:43.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.609+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.609+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.609+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.609+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.609+0000 7fe1d0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.627 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone8312 2024-05-30T16:50:43.637 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.636+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.637 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.636+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.637 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.636+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.637 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.636+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.637 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:43.636+0000 7fe1cf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:43.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.815+0000 7f9477e00640 1 Processor -- start 2024-05-30T16:50:43.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.815+0000 7f9477e00640 1 -- start start 2024-05-30T16:50:43.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.816+0000 7f9477e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9478142f50 0x7f94780cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.816+0000 7f9477e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94780cdd10 0x7f94781438c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.816+0000 7f9477e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94780cf080 con 0x7f9478143e00 2024-05-30T16:50:43.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.816+0000 7f9477e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f94780ce500 con 0x7f9478142f50 2024-05-30T16:50:43.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.816+0000 7f9477e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94780ce7e0 con 0x7f94780cdd10 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.817+0000 7f9477400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9478143e00 0x7f9478144260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48426/0 (socket says 172.21.15.144:48426) 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.817+0000 7f9477400640 1 -- 172.21.15.144:0/1855737751 learned_addr learned my addr 172.21.15.144:0/1855737751 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.817+0000 7f9476a00640 1 --2- 172.21.15.144:0/1855737751 >> v2:172.21.15.149:3300/0 conn(0x7f9478142f50 0x7f94780cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.817+0000 7f9476000640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94780cdd10 0x7f94781438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.817+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153349682 0 0) 0x7f94780cf080 con 0x7f9478143e00 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.817+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f945c003520 con 0x7f9478143e00 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.817+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4069181341 0 0) 0x7f945c003520 con 0x7f9478143e00 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.817+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94780cdd10 msgr2=0x7f94781438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94780cdd10 0x7f94781438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 >> v2:172.21.15.149:3300/0 conn(0x7f9478142f50 msgr2=0x7f94780cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 --2- 172.21.15.144:0/1855737751 >> v2:172.21.15.149:3300/0 conn(0x7f9478142f50 0x7f94780cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94780ceac0 con 0x7f9478143e00 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f94700019f0 con 0x7f9478143e00 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 >> v1:172.21.15.144:6789/0 conn(0x7f9478143e00 legacy=0x7f9478144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f945c0039b0 0x7f945c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94780cdd10 0x7f945c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f945c004d40 0x7f945c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f94780ce500 con 0x7f945c004d40 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94780ce7e0 con 0x7f945c0039b0 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f945c00b9c0 con 0x7f94780cdd10 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9477400640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f945c004d40 0x7f945c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9476a00640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f945c0039b0 0x7f945c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9477400640 1 -- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94780cdd10 msgr2=0x7f945c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9477400640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94780cdd10 0x7f945c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9477400640 1 -- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f945c0039b0 msgr2=0x7f945c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9477400640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f945c0039b0 0x7f945c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.818+0000 7f9477400640 1 -- 172.21.15.144:0/1855737751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c003520 con 0x7f945c004d40 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.819+0000 7f9477400640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f945c004d40 0x7f945c0051c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f947000a920 tx=0x7f945c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850ff3a6a04cf5a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947000a4c0 con 0x7f945c004d40 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947002f070 con 0x7f945c004d40 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9475600640 1 -- 172.21.15.144:0/1855737751 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947002bd00 con 0x7f945c004d40 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9477e00640 1 -- 172.21.15.144:0/1855737751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f945c004d40 msgr2=0x7f945c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9477e00640 1 --2- 172.21.15.144:0/1855737751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f945c004d40 0x7f945c0051c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f947000a920 tx=0x7f945c005830 comp rx=0 tx=0).stop 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9477400640 1 -- 172.21.15.144:0/1855737751 reap_dead start 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9477e00640 1 -- 172.21.15.144:0/1855737751 shutdown_connections 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9477e00640 1 -- 172.21.15.144:0/1855737751 >> 172.21.15.144:0/1855737751 conn(0x7f947806b8e0 msgr2=0x7f947806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9477e00640 1 -- 172.21.15.144:0/1855737751 shutdown_connections 2024-05-30T16:50:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.820+0000 7f9477e00640 1 -- 172.21.15.144:0/1855737751 wait complete. 2024-05-30T16:50:43.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.822+0000 7f9477e00640 1 Processor -- start 2024-05-30T16:50:43.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.822+0000 7f9477e00640 1 -- start start 2024-05-30T16:50:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.823+0000 7f9477e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f945c004d40 0x7f94780b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.823+0000 7f9477e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94780b3560 0x7f94780ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.823+0000 7f9477e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f947813e8e0 0x7f947813ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.823+0000 7f9477e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f94780ce150 con 0x7f94780b3560 2024-05-30T16:50:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.823+0000 7f9477e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9478144970 con 0x7f945c004d40 2024-05-30T16:50:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.823+0000 7f9477e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f947813f2d0 con 0x7f947813e8e0 2024-05-30T16:50:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94780b3560 0x7f94780ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94780b3560 0x7f94780ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49334/0 (socket says 172.21.15.144:49334) 2024-05-30T16:50:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476000640 1 -- 172.21.15.144:0/3694121583 learned_addr learned my addr 172.21.15.144:0/3694121583 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476000640 1 -- 172.21.15.144:0/3694121583 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f947813e8e0 msgr2=0x7f947813ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476000640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f947813e8e0 0x7f947813ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476a00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f945c004d40 0x7f94780b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476000640 1 -- 172.21.15.144:0/3694121583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f945c004d40 msgr2=0x7f94780b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476000640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f945c004d40 0x7f94780b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476000640 1 -- 172.21.15.144:0/3694121583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94780b3d40 con 0x7f94780b3560 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.824+0000 7f9476000640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94780b3560 0x7f94780ae350 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f946400e820 tx=0x7f946400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.825+0000 7f946ea00640 1 -- 172.21.15.144:0/3694121583 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9464017070 con 0x7f94780b3560 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.825+0000 7f946ea00640 1 -- 172.21.15.144:0/3694121583 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946400c8c0 con 0x7f94780b3560 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.825+0000 7f946ea00640 1 -- 172.21.15.144:0/3694121583 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946400cc90 con 0x7f94780b3560 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.825+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94780b4020 con 0x7f94780b3560 2024-05-30T16:50:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.825+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94780b45e0 con 0x7f94780b3560 2024-05-30T16:50:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.826+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9478075570 con 0x7f94780b3560 2024-05-30T16:50:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.827+0000 7f946ea00640 1 -- 172.21.15.144:0/3694121583 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 26) ==== 92315+0+0 (secure 0 0 0) 0x7f946401a070 con 0x7f94780b3560 2024-05-30T16:50:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.828+0000 7f946ea00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f945806d730 0x7f945806fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.828+0000 7f946ea00640 1 -- 172.21.15.144:0/3694121583 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f946408aa40 con 0x7f94780b3560 2024-05-30T16:50:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.828+0000 7f9476a00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f945806d730 0x7f945806fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:43.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.829+0000 7f9476a00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f945806d730 0x7f945806fbf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9468009990 tx=0x7f9468008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:43.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:43.833+0000 7f946ea00640 1 -- 172.21.15.144:0/3694121583 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f946405a600 con 0x7f94780b3560 2024-05-30T16:50:44.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.056+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone8312", "target": ["mon-mgr", ""]}) -- 0x7f947806f080 con 0x7f945806d730 2024-05-30T16:50:44.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.608+0000 7fe18aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.608+0000 7fe18aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.608+0000 7fe18aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.608+0000 7fe18aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.610 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.608+0000 7fe18aa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.818+0000 7f946ea00640 1 -- 172.21.15.144:0/3694121583 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f947806f080 con 0x7f945806d730 2024-05-30T16:50:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.821+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f945806d730 msgr2=0x7f945806fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.821+0000 7f9477e00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f945806d730 0x7f945806fbf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9468009990 tx=0x7f9468008040 comp rx=0 tx=0).stop 2024-05-30T16:50:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.821+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94780b3560 msgr2=0x7f94780ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:44.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.821+0000 7f9477e00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94780b3560 0x7f94780ae350 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f946400e820 tx=0x7f946400ece0 comp rx=0 tx=0).stop 2024-05-30T16:50:44.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.824+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 shutdown_connections 2024-05-30T16:50:44.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.824+0000 7f9477e00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f945806d730 0x7f945806fbf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:44.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.824+0000 7f9477e00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f947813e8e0 0x7f947813ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:44.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.824+0000 7f9477e00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94780b3560 0x7f94780ae350 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:44.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.824+0000 7f9477e00640 1 --2- 172.21.15.144:0/3694121583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f945c004d40 0x7f94780b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:44.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.824+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 >> 172.21.15.144:0/3694121583 conn(0x7f947806b8e0 msgr2=0x7f9478141ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:44.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.824+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 shutdown_connections 2024-05-30T16:50:44.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:44.824+0000 7f9477e00640 1 -- 172.21.15.144:0/3694121583 wait complete. 2024-05-30T16:50:44.839 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.838+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.839 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.838+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.839 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.838+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.839 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.838+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.839 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:44.838+0000 7fe1d0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:44.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone8313 2024-05-30T16:50:45.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.265+0000 7fb537800640 1 Processor -- start 2024-05-30T16:50:45.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.266+0000 7fb537800640 1 -- start start 2024-05-30T16:50:45.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.269+0000 7fb537800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb530141510 0x7fb530071df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:45.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.269+0000 7fb537800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb5300b5390 0x7fb530072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:45.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.269+0000 7fb537800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb530162420 con 0x7fb5301418f0 2024-05-30T16:50:45.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.269+0000 7fb537800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb53015fe40 con 0x7fb5300b5390 2024-05-30T16:50:45.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.269+0000 7fb537800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb530162700 con 0x7fb530141510 2024-05-30T16:50:45.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.269+0000 7fb535800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb5301418f0 0x7fb5301442f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42104/0 (socket says 172.21.15.144:42104) 2024-05-30T16:50:45.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.269+0000 7fb535800640 1 -- 172.21.15.144:0/2444544094 learned_addr learned my addr 172.21.15.144:0/2444544094 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:45.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.269+0000 7fb52fe00640 1 --2- 172.21.15.144:0/2444544094 >> v2:172.21.15.144:3300/0 conn(0x7fb5300b5390 0x7fb530072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:45.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.269+0000 7fb534e00640 1 --2- 172.21.15.144:0/2444544094 >> v2:172.21.15.149:3300/0 conn(0x7fb530141510 0x7fb530071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:45.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.270+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012974736 0 0) 0x7fb530162420 con 0x7fb5301418f0 2024-05-30T16:50:45.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.270+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb518003520 con 0x7fb5301418f0 2024-05-30T16:50:45.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1393206533 0 0) 0x7fb518003520 con 0x7fb5301418f0 2024-05-30T16:50:45.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 >> v2:172.21.15.149:3300/0 conn(0x7fb530141510 msgr2=0x7fb530071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:45.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 --2- 172.21.15.144:0/2444544094 >> v2:172.21.15.149:3300/0 conn(0x7fb530141510 0x7fb530071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:45.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 >> v2:172.21.15.144:3300/0 conn(0x7fb5300b5390 msgr2=0x7fb530072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:45.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 --2- 172.21.15.144:0/2444544094 >> v2:172.21.15.144:3300/0 conn(0x7fb5300b5390 0x7fb530072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5301629e0 con 0x7fb5301418f0 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fb5280019f0 con 0x7fb5301418f0 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 >> v1:172.21.15.144:6789/0 conn(0x7fb5301418f0 legacy=0x7fb5301442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 --2- 172.21.15.144:0/2444544094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180039b0 0x7fb518003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 --2- 172.21.15.144:0/2444544094 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb518004800 0x7fb518004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 --2- 172.21.15.144:0/2444544094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180051c0 0x7fb51800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb530162700 con 0x7fb5180051c0 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb51800bf80 con 0x7fb5180039b0 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.271+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb51800c180 con 0x7fb518004800 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.272+0000 7fb535800640 1 --2- 172.21.15.144:0/2444544094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180051c0 0x7fb51800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.274+0000 7fb535800640 1 -- 172.21.15.144:0/2444544094 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb518004800 msgr2=0x7fb518004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:45.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.274+0000 7fb535800640 1 --2- 172.21.15.144:0/2444544094 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb518004800 0x7fb518004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:45.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.274+0000 7fb535800640 1 -- 172.21.15.144:0/2444544094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180039b0 msgr2=0x7fb518003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:50:45.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.274+0000 7fb535800640 1 --2- 172.21.15.144:0/2444544094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180039b0 0x7fb518003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:45.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.274+0000 7fb535800640 1 -- 172.21.15.144:0/2444544094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5301629e0 con 0x7fb5180051c0 2024-05-30T16:50:45.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.275+0000 7fb535800640 1 -- 172.21.15.144:0/2444544094 reap_dead start 2024-05-30T16:50:45.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.277+0000 7fb535800640 1 --2- 172.21.15.144:0/2444544094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180051c0 0x7fb51800b9c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb528014230 tx=0x7fb518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d937c7d25563e9a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:45.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.278+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528012da0 con 0x7fb5180051c0 2024-05-30T16:50:45.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.278+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5280122d0 con 0x7fb5180051c0 2024-05-30T16:50:45.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.278+0000 7fb52f400640 1 -- 172.21.15.144:0/2444544094 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5280126a0 con 0x7fb5180051c0 2024-05-30T16:50:45.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.279+0000 7fb537800640 1 -- 172.21.15.144:0/2444544094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180051c0 msgr2=0x7fb51800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:45.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.279+0000 7fb537800640 1 --2- 172.21.15.144:0/2444544094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180051c0 0x7fb51800b9c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb528014230 tx=0x7fb518005830 comp rx=0 tx=0).stop 2024-05-30T16:50:45.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.280+0000 7fb537800640 1 -- 172.21.15.144:0/2444544094 shutdown_connections 2024-05-30T16:50:45.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.280+0000 7fb537800640 1 --2- 172.21.15.144:0/2444544094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180051c0 0x7fb51800b9c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:45.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.280+0000 7fb537800640 1 -- 172.21.15.144:0/2444544094 >> 172.21.15.144:0/2444544094 conn(0x7fb530070050 msgr2=0x7fb53006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:45.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.280+0000 7fb537800640 1 -- 172.21.15.144:0/2444544094 shutdown_connections 2024-05-30T16:50:45.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.281+0000 7fb537800640 1 -- 172.21.15.144:0/2444544094 wait complete. 2024-05-30T16:50:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.284+0000 7fb537800640 1 Processor -- start 2024-05-30T16:50:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.284+0000 7fb537800640 1 -- start start 2024-05-30T16:50:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.286+0000 7fb537800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180051c0 0x7fb530138240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.286+0000 7fb537800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb530153fe0 0x7fb530153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.286+0000 7fb537800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5301389d0 0x7fb530138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.286+0000 7fb537800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb530071df0 con 0x7fb530153fe0 2024-05-30T16:50:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.286+0000 7fb537800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb530162fa0 con 0x7fb5180051c0 2024-05-30T16:50:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.286+0000 7fb537800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb530071f70 con 0x7fb5301389d0 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.287+0000 7fb52fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb530153fe0 0x7fb530153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.287+0000 7fb52fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb530153fe0 0x7fb530153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58520/0 (socket says 172.21.15.144:58520) 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.287+0000 7fb52fe00640 1 -- 172.21.15.144:0/929335924 learned_addr learned my addr 172.21.15.144:0/929335924 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.287+0000 7fb534e00640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180051c0 0x7fb530138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.287+0000 7fb52fe00640 1 -- 172.21.15.144:0/929335924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5301389d0 msgr2=0x7fb530138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.287+0000 7fb52fe00640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5301389d0 0x7fb530138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.287+0000 7fb52fe00640 1 -- 172.21.15.144:0/929335924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180051c0 msgr2=0x7fb530138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.287+0000 7fb52fe00640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180051c0 0x7fb530138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.287+0000 7fb52fe00640 1 -- 172.21.15.144:0/929335924 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb530138780 con 0x7fb530153fe0 2024-05-30T16:50:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.288+0000 7fb52fe00640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb530153fe0 0x7fb530153580 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00e7f0 tx=0x7fb51c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.288+0000 7fb52cc00640 1 -- 172.21.15.144:0/929335924 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c017070 con 0x7fb530153fe0 2024-05-30T16:50:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.288+0000 7fb52cc00640 1 -- 172.21.15.144:0/929335924 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c00c860 con 0x7fb530153fe0 2024-05-30T16:50:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.288+0000 7fb52cc00640 1 -- 172.21.15.144:0/929335924 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00cc50 con 0x7fb530153fe0 2024-05-30T16:50:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.288+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb530154470 con 0x7fb530153fe0 2024-05-30T16:50:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.288+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb530154a30 con 0x7fb530153fe0 2024-05-30T16:50:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.289+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb530068b90 con 0x7fb530153fe0 2024-05-30T16:50:45.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.292+0000 7fb52cc00640 1 -- 172.21.15.144:0/929335924 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 26) ==== 92315+0+0 (secure 0 0 0) 0x7fb51c01a070 con 0x7fb530153fe0 2024-05-30T16:50:45.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.293+0000 7fb52cc00640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb51006d700 0x7fb51006fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:45.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.293+0000 7fb52cc00640 1 -- 172.21.15.144:0/929335924 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fb51c08aa00 con 0x7fb530153fe0 2024-05-30T16:50:45.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.294+0000 7fb534e00640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb51006d700 0x7fb51006fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:45.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.295+0000 7fb534e00640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb51006d700 0x7fb51006fbc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb524009a50 tx=0x7fb524008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:45.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.306+0000 7fb52cc00640 1 -- 172.21.15.144:0/929335924 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb530138780 con 0x7fb530153fe0 2024-05-30T16:50:45.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.867+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone8313", "target": ["mon-mgr", ""]}) -- 0x7fb5301425c0 con 0x7fb51006d700 2024-05-30T16:50:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:45.986+0000 7fb52cc00640 1 -- 172.21.15.144:0/929335924 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 27) ==== 92519+0+0 (secure 0 0 0) 0x7fb51c056590 con 0x7fb530153fe0 2024-05-30T16:50:46.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.469+0000 7fb52cc00640 1 -- 172.21.15.144:0/929335924 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb5301425c0 con 0x7fb51006d700 2024-05-30T16:50:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.474+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb51006d700 msgr2=0x7fb51006fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.474+0000 7fb537800640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb51006d700 0x7fb51006fbc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb524009a50 tx=0x7fb524008040 comp rx=0 tx=0).stop 2024-05-30T16:50:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.474+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb530153fe0 msgr2=0x7fb530153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.474+0000 7fb537800640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb530153fe0 0x7fb530153580 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00e7f0 tx=0x7fb51c00ecb0 comp rx=0 tx=0).stop 2024-05-30T16:50:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.475+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 shutdown_connections 2024-05-30T16:50:46.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.475+0000 7fb537800640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb51006d700 0x7fb51006fbc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.475+0000 7fb537800640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5301389d0 0x7fb530138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.475+0000 7fb537800640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb530153fe0 0x7fb530153580 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.475+0000 7fb537800640 1 --2- 172.21.15.144:0/929335924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180051c0 0x7fb530138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.475+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 >> 172.21.15.144:0/929335924 conn(0x7fb530070050 msgr2=0x7fb530143880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.475+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 shutdown_connections 2024-05-30T16:50:46.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.476+0000 7fb537800640 1 -- 172.21.15.144:0/929335924 wait complete. 2024-05-30T16:50:46.545 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone8314 2024-05-30T16:50:46.607 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:46.604+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:46.607 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:46.604+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:46.607 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:46.604+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:46.607 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:46.604+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:46.607 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:50:46.604+0000 7fe1cec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:50:46.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.972+0000 7fb3a3200640 1 Processor -- start 2024-05-30T16:50:46.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.972+0000 7fb3a3200640 1 -- start start 2024-05-30T16:50:46.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.974+0000 7fb3a3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb39c14c630 0x7fb39c0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:46.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.974+0000 7fb3a3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c06fbf0 con 0x7fb39c072920 2024-05-30T16:50:46.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.974+0000 7fb3a3200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c0cf050 con 0x7fb39c0cea10 2024-05-30T16:50:46.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.974+0000 7fb3a3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb39c0cee30 con 0x7fb39c14c630 2024-05-30T16:50:46.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.975+0000 7fb3a1200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb39c072920 0x7fb39c0b4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42120/0 (socket says 172.21.15.144:42120) 2024-05-30T16:50:46.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.975+0000 7fb3a1200640 1 -- 172.21.15.144:0/1194644870 learned_addr learned my addr 172.21.15.144:0/1194644870 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:46.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.975+0000 7fb39be00640 1 --2- 172.21.15.144:0/1194644870 >> v2:172.21.15.144:3300/0 conn(0x7fb39c14c630 0x7fb39c0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:46.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.976+0000 7fb39be00640 1 -- 172.21.15.144:0/1194644870 >> v1:172.21.15.149:6789/0 conn(0x7fb39c0cea10 legacy=0x7fb39c072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:46.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.976+0000 7fb39be00640 1 -- 172.21.15.144:0/1194644870 >> v1:172.21.15.144:6789/0 conn(0x7fb39c072920 legacy=0x7fb39c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:46.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.976+0000 7fb39be00640 1 -- 172.21.15.144:0/1194644870 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c0cf330 con 0x7fb39c14c630 2024-05-30T16:50:46.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.978+0000 7fb39be00640 1 --2- 172.21.15.144:0/1194644870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c14c630 0x7fb39c0ce4d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0b6870 tx=0x7fb38c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e3f8be5c306f35 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:46.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.979+0000 7fb39aa00640 1 -- 172.21.15.144:0/1194644870 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38c037070 con 0x7fb39c14c630 2024-05-30T16:50:46.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.979+0000 7fb39aa00640 1 -- 172.21.15.144:0/1194644870 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb38c032440 con 0x7fb39c14c630 2024-05-30T16:50:46.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.979+0000 7fb39aa00640 1 -- 172.21.15.144:0/1194644870 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38c032810 con 0x7fb39c14c630 2024-05-30T16:50:46.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.980+0000 7fb3a3200640 1 -- 172.21.15.144:0/1194644870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c14c630 msgr2=0x7fb39c0ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:46.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.980+0000 7fb3a3200640 1 --2- 172.21.15.144:0/1194644870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c14c630 0x7fb39c0ce4d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0b6870 tx=0x7fb38c02a1a0 comp rx=0 tx=0).stop 2024-05-30T16:50:46.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.980+0000 7fb3a3200640 1 -- 172.21.15.144:0/1194644870 shutdown_connections 2024-05-30T16:50:46.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.980+0000 7fb3a3200640 1 --2- 172.21.15.144:0/1194644870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c14c630 0x7fb39c0ce4d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:46.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.980+0000 7fb3a3200640 1 -- 172.21.15.144:0/1194644870 >> 172.21.15.144:0/1194644870 conn(0x7fb39c06bd00 msgr2=0x7fb39c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:46.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.980+0000 7fb3a3200640 1 -- 172.21.15.144:0/1194644870 shutdown_connections 2024-05-30T16:50:46.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.980+0000 7fb3a3200640 1 -- 172.21.15.144:0/1194644870 wait complete. 2024-05-30T16:50:46.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.983+0000 7fb3a3200640 1 Processor -- start 2024-05-30T16:50:46.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.983+0000 7fb3a3200640 1 -- start start 2024-05-30T16:50:46.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.984+0000 7fb3a3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb39c072920 0x7fb39c1e9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.984+0000 7fb3a3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c0cea10 0x7fb39c1ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.984+0000 7fb3a3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb39c14c630 0x7fb39c139fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.984+0000 7fb3a3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c0b3c20 con 0x7fb39c0cea10 2024-05-30T16:50:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.984+0000 7fb3a3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c0cf8f0 con 0x7fb39c072920 2024-05-30T16:50:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.984+0000 7fb3a3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb39c14ca10 con 0x7fb39c14c630 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.985+0000 7fb39b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c0cea10 0x7fb39c1ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.985+0000 7fb39b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c0cea10 0x7fb39c1ea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58560/0 (socket says 172.21.15.144:58560) 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.985+0000 7fb39b400640 1 -- 172.21.15.144:0/602628638 learned_addr learned my addr 172.21.15.144:0/602628638 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.985+0000 7fb39b400640 1 -- 172.21.15.144:0/602628638 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb39c14c630 msgr2=0x7fb39c139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.985+0000 7fb39b400640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb39c14c630 0x7fb39c139fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.985+0000 7fb39b400640 1 -- 172.21.15.144:0/602628638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb39c072920 msgr2=0x7fb39c1e9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.985+0000 7fb39b400640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb39c072920 0x7fb39c1e9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.985+0000 7fb39b400640 1 -- 172.21.15.144:0/602628638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c1ea660 con 0x7fb39c0cea10 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.986+0000 7fb39b400640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c0cea10 0x7fb39c1ea120 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c430 tx=0x7fb38400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.986+0000 7fb393e00640 1 -- 172.21.15.144:0/602628638 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384011790 con 0x7fb39c0cea10 2024-05-30T16:50:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.986+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb39c0af350 con 0x7fb39c0cea10 2024-05-30T16:50:46.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.986+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb39c138180 con 0x7fb39c0cea10 2024-05-30T16:50:46.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.986+0000 7fb393e00640 1 -- 172.21.15.144:0/602628638 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb384017070 con 0x7fb39c0cea10 2024-05-30T16:50:46.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.986+0000 7fb393e00640 1 -- 172.21.15.144:0/602628638 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384011bb0 con 0x7fb39c0cea10 2024-05-30T16:50:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.988+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb374005290 con 0x7fb39c0cea10 2024-05-30T16:50:46.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.991+0000 7fb393e00640 1 -- 172.21.15.144:0/602628638 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 92519+0+0 (secure 0 0 0) 0x7fb38401c460 con 0x7fb39c0cea10 2024-05-30T16:50:46.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.993+0000 7fb393e00640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb37806d940 0x7fb37806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:46.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:46.994+0000 7fb393e00640 1 -- 172.21.15.144:0/602628638 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fb38408a8f0 con 0x7fb39c0cea10 2024-05-30T16:50:47.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:47.004+0000 7fb39be00640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb37806d940 0x7fb37806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:47.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:47.005+0000 7fb393e00640 1 -- 172.21.15.144:0/602628638 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb38405a400 con 0x7fb39c0cea10 2024-05-30T16:50:47.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:47.008+0000 7fb39be00640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb37806d940 0x7fb37806fe00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb38c034000 tx=0x7fb38c02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:47.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:47.485+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone8314", "target": ["mon-mgr", ""]}) -- 0x7fb374000c80 con 0x7fb37806d940 2024-05-30T16:50:47.905 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:50:47.914 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:50:48.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.044+0000 7fb393e00640 1 -- 172.21.15.144:0/602628638 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7fb384056370 con 0x7fb39c0cea10 2024-05-30T16:50:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.408+0000 7fb393e00640 1 -- 172.21.15.144:0/602628638 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb374000c80 con 0x7fb37806d940 2024-05-30T16:50:48.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.418+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb37806d940 msgr2=0x7fb37806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:48.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.418+0000 7fb3a3200640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb37806d940 0x7fb37806fe00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb38c034000 tx=0x7fb38c02c000 comp rx=0 tx=0).stop 2024-05-30T16:50:48.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.418+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c0cea10 msgr2=0x7fb39c1ea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:48.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.418+0000 7fb3a3200640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c0cea10 0x7fb39c1ea120 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c430 tx=0x7fb38400c8f0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.419+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 shutdown_connections 2024-05-30T16:50:48.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.419+0000 7fb3a3200640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb37806d940 0x7fb37806fe00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.419+0000 7fb3a3200640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb39c14c630 0x7fb39c139fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.420+0000 7fb3a3200640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb39c0cea10 0x7fb39c1ea120 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.420+0000 7fb3a3200640 1 --2- 172.21.15.144:0/602628638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb39c072920 0x7fb39c1e9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.420+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 >> 172.21.15.144:0/602628638 conn(0x7fb39c06bd00 msgr2=0x7fb39c0b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:48.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.420+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 shutdown_connections 2024-05-30T16:50:48.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.421+0000 7fb3a3200640 1 -- 172.21.15.144:0/602628638 wait complete. 2024-05-30T16:50:48.457 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone8315 2024-05-30T16:50:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.861+0000 7f8dee400640 1 Processor -- start 2024-05-30T16:50:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.862+0000 7f8dee400640 1 -- start start 2024-05-30T16:50:48.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.863+0000 7f8dee400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de814c630 0x7f8de80ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:48.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.864+0000 7f8dee400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8de8072920 0x7f8de80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:48.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.864+0000 7f8dee400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de806fbf0 con 0x7f8de80cea10 2024-05-30T16:50:48.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.864+0000 7f8dee400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8de80cf050 con 0x7f8de8072920 2024-05-30T16:50:48.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.864+0000 7f8dee400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8de80cf330 con 0x7f8de814c630 2024-05-30T16:50:48.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.865+0000 7f8de6a00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8de80cea10 0x7f8de8072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:36572/0 (socket says 172.21.15.144:36572) 2024-05-30T16:50:48.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.865+0000 7f8de6a00640 1 -- 172.21.15.144:0/2536001499 learned_addr learned my addr 172.21.15.144:0/2536001499 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:48.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.865+0000 7f8de7400640 1 --2- 172.21.15.144:0/2536001499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de814c630 0x7f8de80ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:48.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.865+0000 7f8de7e00640 1 --2- 172.21.15.144:0/2536001499 >> v2:172.21.15.144:3300/0 conn(0x7f8de8072920 0x7f8de80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:48.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.866+0000 7f8de7e00640 1 -- 172.21.15.144:0/2536001499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de814c630 msgr2=0x7f8de80ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:48.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.866+0000 7f8de7e00640 1 --2- 172.21.15.144:0/2536001499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de814c630 0x7f8de80ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.866+0000 7f8de7e00640 1 -- 172.21.15.144:0/2536001499 >> v1:172.21.15.149:6789/0 conn(0x7f8de80cea10 legacy=0x7f8de8072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:48.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.867+0000 7f8de7e00640 1 -- 172.21.15.144:0/2536001499 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de80cf610 con 0x7f8de8072920 2024-05-30T16:50:48.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.868+0000 7f8de7e00640 1 --2- 172.21.15.144:0/2536001499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 0x7f8de80b4140 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8de000b050 tx=0x7f8de002a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d1b3e295ae1d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:48.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.869+0000 7f8de6000640 1 -- 172.21.15.144:0/2536001499 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0034020 con 0x7f8de8072920 2024-05-30T16:50:48.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.869+0000 7f8de6000640 1 -- 172.21.15.144:0/2536001499 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de002c040 con 0x7f8de8072920 2024-05-30T16:50:48.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.871+0000 7f8dee400640 1 -- 172.21.15.144:0/2536001499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 msgr2=0x7f8de80b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:48.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.871+0000 7f8dee400640 1 --2- 172.21.15.144:0/2536001499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 0x7f8de80b4140 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8de000b050 tx=0x7f8de002a960 comp rx=0 tx=0).stop 2024-05-30T16:50:48.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.869+0000 7f8de6000640 1 -- 172.21.15.144:0/2536001499 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0034020 con 0x7f8de8072920 2024-05-30T16:50:48.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.873+0000 7f8dee400640 1 -- 172.21.15.144:0/2536001499 shutdown_connections 2024-05-30T16:50:48.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.873+0000 7f8dee400640 1 --2- 172.21.15.144:0/2536001499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 0x7f8de80b4140 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.873+0000 7f8dee400640 1 --2- 172.21.15.144:0/2536001499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de814c630 0x7f8de80ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.873+0000 7f8dee400640 1 -- 172.21.15.144:0/2536001499 >> 172.21.15.144:0/2536001499 conn(0x7f8de806bd00 msgr2=0x7f8de806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:48.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.874+0000 7f8dee400640 1 -- 172.21.15.144:0/2536001499 shutdown_connections 2024-05-30T16:50:48.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.875+0000 7f8dee400640 1 -- 172.21.15.144:0/2536001499 wait complete. 2024-05-30T16:50:48.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.879+0000 7f8dee400640 1 Processor -- start 2024-05-30T16:50:48.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.879+0000 7f8dee400640 1 -- start start 2024-05-30T16:50:48.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.883+0000 7f8dee400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 0x7f8de80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:48.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.883+0000 7f8dee400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de80cea10 0x7f8de81ebf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:48.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.883+0000 7f8dee400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8de814c630 0x7f8de81ec470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:48.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.883+0000 7f8dee400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8de814ca10 con 0x7f8de8072920 2024-05-30T16:50:48.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.883+0000 7f8dee400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8de80b3c20 con 0x7f8de814c630 2024-05-30T16:50:48.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.883+0000 7f8dee400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8de814cb90 con 0x7f8de80cea10 2024-05-30T16:50:48.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.884+0000 7f8de7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 0x7f8de80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:48.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.885+0000 7f8de7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 0x7f8de80aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58572/0 (socket says 172.21.15.144:58572) 2024-05-30T16:50:48.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.885+0000 7f8de7400640 1 -- 172.21.15.144:0/2540320713 learned_addr learned my addr 172.21.15.144:0/2540320713 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:48.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.886+0000 7f8de7400640 1 -- 172.21.15.144:0/2540320713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de80cea10 msgr2=0x7f8de81ebf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:48.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.886+0000 7f8de7400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de80cea10 0x7f8de81ebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.886+0000 7f8de7400640 1 -- 172.21.15.144:0/2540320713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8de814c630 msgr2=0x7f8de81ec470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:48.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.886+0000 7f8de7400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8de814c630 0x7f8de81ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:48.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.886+0000 7f8de7400640 1 -- 172.21.15.144:0/2540320713 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de81630b0 con 0x7f8de8072920 2024-05-30T16:50:48.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.887+0000 7f8de7400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 0x7f8de80aebb0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800ebe0 tx=0x7f8dd800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:48.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.888+0000 7f8ddf400640 1 -- 172.21.15.144:0/2540320713 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8017070 con 0x7f8de8072920 2024-05-30T16:50:48.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.888+0000 7f8ddf400640 1 -- 172.21.15.144:0/2540320713 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd800ecd0 con 0x7f8de8072920 2024-05-30T16:50:48.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.888+0000 7f8ddf400640 1 -- 172.21.15.144:0/2540320713 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800ce50 con 0x7f8de8072920 2024-05-30T16:50:48.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.888+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de8163390 con 0x7f8de8072920 2024-05-30T16:50:48.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.888+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de8163950 con 0x7f8de8072920 2024-05-30T16:50:48.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.891+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de8068b90 con 0x7f8de8072920 2024-05-30T16:50:48.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.896+0000 7f8ddf400640 1 -- 172.21.15.144:0/2540320713 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f8dd801a070 con 0x7f8de8072920 2024-05-30T16:50:48.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.899+0000 7f8ddf400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8dc406daa0 0x7f8dc406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:48.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.902+0000 7f8ddf400640 1 -- 172.21.15.144:0/2540320713 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f8dd808acf0 con 0x7f8de8072920 2024-05-30T16:50:48.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.910+0000 7f8ddf400640 1 -- 172.21.15.144:0/2540320713 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8dd805a830 con 0x7f8de8072920 2024-05-30T16:50:48.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.922+0000 7f8de6a00640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8dc406daa0 0x7f8dc406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:48.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:48.925+0000 7f8de6a00640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8dc406daa0 0x7f8dc406ff60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0000f60 tx=0x7f8dd0007a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:49.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:49.414+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone8315", "target": ["mon-mgr", ""]}) -- 0x7f8de8075f70 con 0x7f8dc406daa0 2024-05-30T16:50:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.338+0000 7f8ddf400640 1 -- 172.21.15.144:0/2540320713 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8dd0001240 con 0x7f8dc406daa0 2024-05-30T16:50:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.349+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8dc406daa0 msgr2=0x7f8dc406ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:50.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.349+0000 7f8dee400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8dc406daa0 0x7f8dc406ff60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0000f60 tx=0x7f8dd0007a80 comp rx=0 tx=0).stop 2024-05-30T16:50:50.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.349+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 msgr2=0x7f8de80aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:50.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.349+0000 7f8dee400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 0x7f8de80aebb0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800ebe0 tx=0x7f8dd800c520 comp rx=0 tx=0).stop 2024-05-30T16:50:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.355+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 shutdown_connections 2024-05-30T16:50:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.355+0000 7f8dee400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8dc406daa0 0x7f8dc406ff60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.355+0000 7f8dee400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8de814c630 0x7f8de81ec470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.355+0000 7f8dee400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de80cea10 0x7f8de81ebf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.355+0000 7f8dee400640 1 --2- 172.21.15.144:0/2540320713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8de8072920 0x7f8de80aebb0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.355+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 >> 172.21.15.144:0/2540320713 conn(0x7f8de806bd00 msgr2=0x7f8de80b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:50.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.359+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 shutdown_connections 2024-05-30T16:50:50.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.363+0000 7f8dee400640 1 -- 172.21.15.144:0/2540320713 wait complete. 2024-05-30T16:50:50.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:50:50.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.903+0000 7fe976400640 1 Processor -- start 2024-05-30T16:50:50.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.903+0000 7fe976400640 1 -- start start 2024-05-30T16:50:50.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.907+0000 7fe976400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9680df440 0x7fe968053280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:50.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.907+0000 7fe976400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe968006b10 con 0x7fe96804fab0 2024-05-30T16:50:50.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.907+0000 7fe976400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe968006df0 con 0x7fe9680392f0 2024-05-30T16:50:50.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.907+0000 7fe976400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9680068c0 con 0x7fe9680df440 2024-05-30T16:50:50.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.912+0000 7fe96fe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe9680392f0 0x7fe9680537c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:36580/0 (socket says 172.21.15.144:36580) 2024-05-30T16:50:50.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.912+0000 7fe96fe00640 1 -- 172.21.15.144:0/799559595 learned_addr learned my addr 172.21.15.144:0/799559595 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:50.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.915+0000 7fe96ea00640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9680df440 0x7fe968053280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:50.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.916+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395638825 0 0) 0x7fe968006df0 con 0x7fe9680392f0 2024-05-30T16:50:50.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.916+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe958005730 con 0x7fe9680392f0 2024-05-30T16:50:50.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.917+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723983821 0 0) 0x7fe968006b10 con 0x7fe96804fab0 2024-05-30T16:50:50.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.917+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe968006df0 con 0x7fe96804fab0 2024-05-30T16:50:50.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.918+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2788944582 0 0) 0x7fe968006df0 con 0x7fe96804fab0 2024-05-30T16:50:50.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9680df440 msgr2=0x7fe968053280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:50.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9680df440 0x7fe968053280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:50.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 >> v1:172.21.15.149:6789/0 conn(0x7fe9680392f0 legacy=0x7fe9680537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:50.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9680070d0 con 0x7fe96804fab0 2024-05-30T16:50:50.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fe964001650 con 0x7fe96804fab0 2024-05-30T16:50:50.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 >> v1:172.21.15.144:6789/0 conn(0x7fe96804fab0 legacy=0x7fe96804fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:50.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe958005d80 0x7fe9580061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:50.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe958006a10 0x7fe958006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:50.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9580073d0 0x7fe9580147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:50.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9680068c0 con 0x7fe9580073d0 2024-05-30T16:50:50.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe95800bbc0 con 0x7fe958005d80 2024-05-30T16:50:50.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.919+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe95800bdc0 con 0x7fe958006a10 2024-05-30T16:50:50.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.921+0000 7fe96fe00640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9580073d0 0x7fe9580147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:50.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.922+0000 7fe96ea00640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe958006a10 0x7fe958006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:50.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.922+0000 7fe96f400640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe958005d80 0x7fe9580061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:50.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.924+0000 7fe96fe00640 1 -- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe958006a10 msgr2=0x7fe958006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:50.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.924+0000 7fe96fe00640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe958006a10 0x7fe958006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:50.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.924+0000 7fe96fe00640 1 -- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe958005d80 msgr2=0x7fe9580061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:50.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.926+0000 7fe96fe00640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe958005d80 0x7fe9580061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:50.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.928+0000 7fe96fe00640 1 -- 172.21.15.144:0/799559595 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9680070d0 con 0x7fe9580073d0 2024-05-30T16:50:50.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.928+0000 7fe96f400640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe958005d80 0x7fe9580061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:50:50.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.930+0000 7fe96fe00640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9580073d0 0x7fe9580147c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe970074320 tx=0x7fe958007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7623e20403092295 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:50.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.931+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970050530 con 0x7fe9580073d0 2024-05-30T16:50:50.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.931+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9700aa070 con 0x7fe9580073d0 2024-05-30T16:50:50.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.932+0000 7fe96e000640 1 -- 172.21.15.144:0/799559595 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97006be00 con 0x7fe9580073d0 2024-05-30T16:50:50.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.933+0000 7fe976400640 1 -- 172.21.15.144:0/799559595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9580073d0 msgr2=0x7fe9580147c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:50.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.933+0000 7fe976400640 1 --2- 172.21.15.144:0/799559595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9580073d0 0x7fe9580147c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe970074320 tx=0x7fe958007a40 comp rx=0 tx=0).stop 2024-05-30T16:50:50.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.933+0000 7fe96fe00640 1 -- 172.21.15.144:0/799559595 reap_dead start 2024-05-30T16:50:50.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.934+0000 7fe976400640 1 -- 172.21.15.144:0/799559595 shutdown_connections 2024-05-30T16:50:50.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.934+0000 7fe976400640 1 -- 172.21.15.144:0/799559595 >> 172.21.15.144:0/799559595 conn(0x7fe968009fd0 msgr2=0x7fe96800a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:50.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.935+0000 7fe976400640 1 -- 172.21.15.144:0/799559595 shutdown_connections 2024-05-30T16:50:50.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.935+0000 7fe976400640 1 -- 172.21.15.144:0/799559595 wait complete. 2024-05-30T16:50:50.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.939+0000 7fe976400640 1 Processor -- start 2024-05-30T16:50:50.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.940+0000 7fe976400640 1 -- start start 2024-05-30T16:50:50.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.942+0000 7fe976400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9580073d0 0x7fe9680d1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:50.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.943+0000 7fe976400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9680d1e70 0x7fe968178480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:50.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.943+0000 7fe976400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9681789c0 0x7fe968178e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.944+0000 7fe96fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9681789c0 0x7fe968178e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.944+0000 7fe96fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9681789c0 0x7fe968178e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58586/0 (socket says 172.21.15.144:58586) 2024-05-30T16:50:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.944+0000 7fe976400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe968052ce0 con 0x7fe9681789c0 2024-05-30T16:50:50.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.944+0000 7fe976400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe968052b60 con 0x7fe9580073d0 2024-05-30T16:50:50.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.944+0000 7fe976400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe96800aac0 con 0x7fe9680d1e70 2024-05-30T16:50:50.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.944+0000 7fe96fe00640 1 -- 172.21.15.144:0/4043485451 learned_addr learned my addr 172.21.15.144:0/4043485451 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:50.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.946+0000 7fe96fe00640 1 -- 172.21.15.144:0/4043485451 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9680d1e70 msgr2=0x7fe968178480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:50:50.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.946+0000 7fe96fe00640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9680d1e70 0x7fe968178480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.946+0000 7fe96fe00640 1 -- 172.21.15.144:0/4043485451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9580073d0 msgr2=0x7fe9680d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.946+0000 7fe96fe00640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9580073d0 0x7fe9680d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.946+0000 7fe96fe00640 1 -- 172.21.15.144:0/4043485451 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe968175b20 con 0x7fe9681789c0 2024-05-30T16:50:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.947+0000 7fe96fe00640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9681789c0 0x7fe968178e50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fe970050f50 tx=0x7fe970069790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.947+0000 7fe963400640 1 -- 172.21.15.144:0/4043485451 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970050530 con 0x7fe9681789c0 2024-05-30T16:50:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.948+0000 7fe963400640 1 -- 172.21.15.144:0/4043485451 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9700b5070 con 0x7fe9681789c0 2024-05-30T16:50:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.948+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9680346e0 con 0x7fe9681789c0 2024-05-30T16:50:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.948+0000 7fe963400640 1 -- 172.21.15.144:0/4043485451 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9700a6b70 con 0x7fe9681789c0 2024-05-30T16:50:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.948+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9680d1ba0 con 0x7fe9681789c0 2024-05-30T16:50:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.953+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9680089f0 con 0x7fe9681789c0 2024-05-30T16:50:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.953+0000 7fe963400640 1 -- 172.21.15.144:0/4043485451 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7fe9700b7030 con 0x7fe9681789c0 2024-05-30T16:50:50.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.955+0000 7fe963400640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe95006daa0 0x7fe95006ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:50.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.956+0000 7fe963400640 1 -- 172.21.15.144:0/4043485451 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fe9701258f0 con 0x7fe9681789c0 2024-05-30T16:50:50.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.960+0000 7fe96f400640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe95006daa0 0x7fe95006ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:50.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.967+0000 7fe963400640 1 -- 172.21.15.144:0/4043485451 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe9700f5430 con 0x7fe9681789c0 2024-05-30T16:50:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:50.990+0000 7fe96f400640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe95006daa0 0x7fe95006ff60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe964001eb0 tx=0x7fe964009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:51.558 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:51.558 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:50:51.558 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:50:51.558 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:50:51.559 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 563, 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:50:51.560 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:50:51.561 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 982, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 3989736256, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 7765901312, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 765328211968, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "recovering_objects_per_sec": 0, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "recovering_bytes_per_sec": 4191779, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "recovering_keys_per_sec": 0, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects_recovered": 12, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "num_bytes_recovered": 50331648, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "num_keys_recovered": 0, 2024-05-30T16:50:51.562 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 71959642, 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 153368356, 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 17, 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 41 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:50:51.563 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:50:51.564 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 9, 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:49:05.097167+0000", 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "3 ongoing clones; Avg progress is 15.972% (3s)\n [====........................] (remaining: 16s)", 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.15972000360488892, 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:50:51.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:50:51.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:50:51.566 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:50:51.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.552+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe9680053b0 con 0x7fe9681789c0 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.555+0000 7fe963400640 1 -- 172.21.15.144:0/4043485451 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2371 (secure 0 0 0) 0x7fe9700f4d30 con 0x7fe9681789c0 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.561+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe95006daa0 msgr2=0x7fe95006ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.561+0000 7fe976400640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe95006daa0 0x7fe95006ff60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe964001eb0 tx=0x7fe964009040 comp rx=0 tx=0).stop 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.561+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9681789c0 msgr2=0x7fe968178e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.561+0000 7fe976400640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9681789c0 0x7fe968178e50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fe970050f50 tx=0x7fe970069790 comp rx=0 tx=0).stop 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.562+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 shutdown_connections 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.562+0000 7fe976400640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe95006daa0 0x7fe95006ff60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.562+0000 7fe976400640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9681789c0 0x7fe968178e50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.562+0000 7fe976400640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9680d1e70 0x7fe968178480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.562+0000 7fe976400640 1 --2- 172.21.15.144:0/4043485451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9580073d0 0x7fe9680d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.562+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 >> 172.21.15.144:0/4043485451 conn(0x7fe968009fd0 msgr2=0x7fe968053a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.562+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 shutdown_connections 2024-05-30T16:50:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:51.562+0000 7fe976400640 1 -- 172.21.15.144:0/4043485451 wait complete. 2024-05-30T16:50:52.617 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:50:53.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.045+0000 7f7621000640 1 Processor -- start 2024-05-30T16:50:53.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.046+0000 7f7621000640 1 -- start start 2024-05-30T16:50:53.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.048+0000 7f7621000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f761c162ac0 0x7f761c1673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:53.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.048+0000 7f7621000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c0b6180 0x7f761c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:53.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.049+0000 7f7621000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f761c0b69d0 con 0x7f761c162ea0 2024-05-30T16:50:53.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.049+0000 7f7621000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f761c0d22d0 con 0x7f761c162ac0 2024-05-30T16:50:53.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.049+0000 7f7621000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f761c0d2520 con 0x7f761c0b6180 2024-05-30T16:50:53.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.050+0000 7f761be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c0b6180 0x7f761c0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:53.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.054+0000 7f761be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c0b6180 0x7f761c0ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:44104/0 (socket says 172.21.15.144:44104) 2024-05-30T16:50:53.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.054+0000 7f761be00640 1 -- 172.21.15.144:0/2875392117 learned_addr learned my addr 172.21.15.144:0/2875392117 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:53.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.056+0000 7f761be00640 1 -- 172.21.15.144:0/2875392117 >> v2:172.21.15.149:3300/0 conn(0x7f761c162ac0 msgr2=0x7f761c1673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:53.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.056+0000 7f761b400640 1 --2- 172.21.15.144:0/2875392117 >> v2:172.21.15.149:3300/0 conn(0x7f761c162ac0 0x7f761c1673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.056+0000 7f761be00640 1 --2- 172.21.15.144:0/2875392117 >> v2:172.21.15.149:3300/0 conn(0x7f761c162ac0 0x7f761c1673d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.056+0000 7f761be00640 1 -- 172.21.15.144:0/2875392117 >> v1:172.21.15.144:6789/0 conn(0x7f761c162ea0 legacy=0x7f761c0d3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.056+0000 7f761be00640 1 -- 172.21.15.144:0/2875392117 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761c0d2800 con 0x7f761c0b6180 2024-05-30T16:50:53.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.063+0000 7f761be00640 1 --2- 172.21.15.144:0/2875392117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c0b6180 0x7f761c0ced50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7614009870 tx=0x7f761402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67853a2499452e7b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:53.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.067+0000 7f761a000640 1 -- 172.21.15.144:0/2875392117 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614037070 con 0x7f761c0b6180 2024-05-30T16:50:53.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.069+0000 7f761a000640 1 -- 172.21.15.144:0/2875392117 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7614032440 con 0x7f761c0b6180 2024-05-30T16:50:53.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.069+0000 7f761a000640 1 -- 172.21.15.144:0/2875392117 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614032850 con 0x7f761c0b6180 2024-05-30T16:50:53.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.071+0000 7f7621000640 1 -- 172.21.15.144:0/2875392117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c0b6180 msgr2=0x7f761c0ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:53.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.071+0000 7f7621000640 1 --2- 172.21.15.144:0/2875392117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c0b6180 0x7f761c0ced50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7614009870 tx=0x7f761402a1a0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.074+0000 7f7621000640 1 -- 172.21.15.144:0/2875392117 shutdown_connections 2024-05-30T16:50:53.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.074+0000 7f7621000640 1 --2- 172.21.15.144:0/2875392117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c0b6180 0x7f761c0ced50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.074+0000 7f7621000640 1 --2- 172.21.15.144:0/2875392117 >> v2:172.21.15.149:3300/0 conn(0x7f761c162ac0 0x7f761c1673d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.074+0000 7f7621000640 1 -- 172.21.15.144:0/2875392117 >> 172.21.15.144:0/2875392117 conn(0x7f761c0d1360 msgr2=0x7f761c0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:53.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.075+0000 7f7621000640 1 -- 172.21.15.144:0/2875392117 shutdown_connections 2024-05-30T16:50:53.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.075+0000 7f7621000640 1 -- 172.21.15.144:0/2875392117 wait complete. 2024-05-30T16:50:53.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.079+0000 7f7621000640 1 Processor -- start 2024-05-30T16:50:53.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.080+0000 7f7621000640 1 -- start start 2024-05-30T16:50:53.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.086+0000 7f7621000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0b6180 0x7f761c1655c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:53.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.087+0000 7f7621000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c162ac0 0x7f761c0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:53.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.087+0000 7f7621000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f761c162ea0 0x7f761c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:53.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.088+0000 7f761b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0b6180 0x7f761c1655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:53.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.088+0000 7f761b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0b6180 0x7f761c1655c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:49722/0 (socket says 172.21.15.144:49722) 2024-05-30T16:50:53.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.089+0000 7f761aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c162ac0 0x7f761c0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:53.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.090+0000 7f7621000640 1 -- 172.21.15.144:0/1436159428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f761c0b6720 con 0x7f761c162ea0 2024-05-30T16:50:53.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.090+0000 7f7621000640 1 -- 172.21.15.144:0/1436159428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f761c0b65a0 con 0x7f761c0b6180 2024-05-30T16:50:53.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.090+0000 7f7621000640 1 -- 172.21.15.144:0/1436159428 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f761c0cf290 con 0x7f761c162ac0 2024-05-30T16:50:53.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.089+0000 7f761b400640 1 -- 172.21.15.144:0/1436159428 learned_addr learned my addr 172.21.15.144:0/1436159428 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:53.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.091+0000 7f761be00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f761c162ea0 0x7f761c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:53.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.091+0000 7f761b400640 1 -- 172.21.15.144:0/1436159428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c162ac0 msgr2=0x7f761c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:53.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.091+0000 7f761b400640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c162ac0 0x7f761c0cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.091+0000 7f761b400640 1 -- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f761c162ea0 msgr2=0x7f761c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:53.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.091+0000 7f761b400640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f761c162ea0 0x7f761c0cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.091+0000 7f761b400640 1 -- 172.21.15.144:0/1436159428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761c164520 con 0x7f761c0b6180 2024-05-30T16:50:53.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.091+0000 7f761be00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f761c162ea0 0x7f761c0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.094+0000 7f761b400640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0b6180 0x7f761c1655c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f760c00ce10 tx=0x7f760c00a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.097+0000 7f7613400640 1 -- 172.21.15.144:0/1436159428 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c003b90 con 0x7f761c0b6180 2024-05-30T16:50:53.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.097+0000 7f7621000640 1 -- 172.21.15.144:0/1436159428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761c164800 con 0x7f761c0b6180 2024-05-30T16:50:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.097+0000 7f7621000640 1 -- 172.21.15.144:0/1436159428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761c164dc0 con 0x7f761c0b6180 2024-05-30T16:50:53.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.099+0000 7f7613400640 1 -- 172.21.15.144:0/1436159428 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f760c003d30 con 0x7f761c0b6180 2024-05-30T16:50:53.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.099+0000 7f7613400640 1 -- 172.21.15.144:0/1436159428 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c004240 con 0x7f761c0b6180 2024-05-30T16:50:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.108+0000 7f7610c00640 1 -- 172.21.15.144:0/1436159428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761c075570 con 0x7f761c0b6180 2024-05-30T16:50:53.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.114+0000 7f7613400640 1 -- 172.21.15.144:0/1436159428 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f760c0043e0 con 0x7f761c0b6180 2024-05-30T16:50:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.118+0000 7f7613400640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75fc06daa0 0x7f75fc06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.118+0000 7f7613400640 1 -- 172.21.15.144:0/1436159428 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f760c08b030 con 0x7f761c0b6180 2024-05-30T16:50:53.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.120+0000 7f7613400640 1 -- 172.21.15.144:0/1436159428 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f760c05aeb0 con 0x7f761c0b6180 2024-05-30T16:50:53.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.124+0000 7f761aa00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75fc06daa0 0x7f75fc06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:53.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.127+0000 7f761aa00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75fc06daa0 0x7f75fc06ff60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f761c068d60 tx=0x7f7608009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.735+0000 7f7610c00640 1 -- 172.21.15.144:0/1436159428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f761c0d1ac0 con 0x7f761c0b6180 2024-05-30T16:50:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.736+0000 7f7613400640 1 -- 172.21.15.144:0/1436159428 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2634 (secure 0 0 0) 0x7f760c061080 con 0x7f761c0b6180 2024-05-30T16:50:53.738 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:50:53.738 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:50:53.738 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:50:53.738 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:50:53.738 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:50:53.738 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:50:53.738 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 565, 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:50:53.739 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:50:53.740 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 1785, 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 7345450171, 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 14458015744, 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 758636097536, 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "recovering_objects_per_sec": 0, 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "recovering_bytes_per_sec": 4190554, 2024-05-30T16:50:53.741 INFO:teuthology.orchestra.run.smithi144.stdout: "recovering_keys_per_sec": 0, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects_recovered": 12, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "num_bytes_recovered": 50331648, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "num_keys_recovered": 0, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 357945338, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 401291558, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 87, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 109 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:50:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:50:53.743 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 9, 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:49:05.097167+0000", 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "5 ongoing+pending clones; Avg progress is 28.385% (0s)\n [=======.....................] ", 2024-05-30T16:50:53.744 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.28385001420974731, 2024-05-30T16:50:53.745 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:50:53.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:50:53.745 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:50:53.745 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 34.44% (7s)\n [=========...................] (remaining: 14s)", 2024-05-30T16:50:53.745 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.34439998865127563, 2024-05-30T16:50:53.745 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:50:53.745 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:50:53.745 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:50:53.745 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 -- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75fc06daa0 msgr2=0x7f75fc06ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75fc06daa0 0x7f75fc06ff60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f761c068d60 tx=0x7f7608009060 comp rx=0 tx=0).stop 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 -- 172.21.15.144:0/1436159428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0b6180 msgr2=0x7f761c1655c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0b6180 0x7f761c1655c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f760c00ce10 tx=0x7f760c00a660 comp rx=0 tx=0).stop 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 -- 172.21.15.144:0/1436159428 shutdown_connections 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f75fc06daa0 0x7f75fc06ff60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f761c162ea0 0x7f761c0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761c162ac0 0x7f761c0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 --2- 172.21.15.144:0/1436159428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0b6180 0x7f761c1655c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.740+0000 7f7610c00640 1 -- 172.21.15.144:0/1436159428 >> 172.21.15.144:0/1436159428 conn(0x7f761c0d1360 msgr2=0x7f761c0c9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.741+0000 7f7610c00640 1 -- 172.21.15.144:0/1436159428 shutdown_connections 2024-05-30T16:50:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:53.741+0000 7f7610c00640 1 -- 172.21.15.144:0/1436159428 wait complete. 2024-05-30T16:50:53.810 INFO:tasks.cephfs.test_volumes:pevs - {'46be8519-7604-4393-8d97-360d59b2a338': {'message': '5 ongoing+pending clones; Avg progress is 28.385% (0s)\n [=======.....................] ', 'progress': 0.2838500142097473, 'add_to_ceph_s': True}, 'db1fc475-de45-4c8e-92b3-78f1b62bc0b7': {'message': '4 ongoing clones; Avg progress is 34.44% (7s)\n [=========...................] (remaining: 14s)', 'progress': 0.34439998865127563, 'add_to_ceph_s': True}} 2024-05-30T16:50:53.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone8316 2024-05-30T16:50:54.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.254+0000 7fcd8e000640 1 Processor -- start 2024-05-30T16:50:54.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.255+0000 7fcd8e000640 1 -- start start 2024-05-30T16:50:54.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.258+0000 7fcd8e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd8814c630 0x7fcd880ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:54.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.258+0000 7fcd8e000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd880cea10 0x7fcd88072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.259+0000 7fcd8e000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8806fbf0 con 0x7fcd88072750 2024-05-30T16:50:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.259+0000 7fcd8e000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fcd880cf050 con 0x7fcd880cea10 2024-05-30T16:50:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.259+0000 7fcd8e000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd880cf330 con 0x7fcd8814c630 2024-05-30T16:50:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.259+0000 7fcd87400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd8814c630 0x7fcd880ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:54.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.261+0000 7fcd86a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd880cea10 0x7fcd88072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:54.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.261+0000 7fcd86a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd880cea10 0x7fcd88072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:49724/0 (socket says 172.21.15.144:49724) 2024-05-30T16:50:54.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.261+0000 7fcd86a00640 1 -- 172.21.15.144:0/3113876426 learned_addr learned my addr 172.21.15.144:0/3113876426 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.260+0000 7fcd87e00640 1 --1- 172.21.15.144:0/3113876426 >> v1:172.21.15.144:6789/0 conn(0x7fcd88072750 0x7fcd8806dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42142/0 (socket says 172.21.15.144:42142) 2024-05-30T16:50:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.265+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 300933359 0 0) 0x7fcd8806fbf0 con 0x7fcd88072750 2024-05-30T16:50:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.265+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd6c003520 con 0x7fcd88072750 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 218237560 0 0) 0x7fcd6c003520 con 0x7fcd88072750 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd8814c630 msgr2=0x7fcd880ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd8814c630 0x7fcd880ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 >> v2:172.21.15.149:3300/0 conn(0x7fcd880cea10 msgr2=0x7fcd88072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 --2- 172.21.15.144:0/3113876426 >> v2:172.21.15.149:3300/0 conn(0x7fcd880cea10 0x7fcd88072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880cf610 con 0x7fcd88072750 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fcd80001a10 con 0x7fcd88072750 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 >> v1:172.21.15.144:6789/0 conn(0x7fcd88072750 legacy=0x7fcd8806dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd6c0039b0 0x7fcd6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd6c004800 0x7fcd6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd8814c630 0x7fcd6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880cf050 con 0x7fcd6c0039b0 2024-05-30T16:50:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880cf330 con 0x7fcd6c004800 2024-05-30T16:50:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.266+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd6c00b9f0 con 0x7fcd8814c630 2024-05-30T16:50:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.268+0000 7fcd86a00640 1 --2- 172.21.15.144:0/3113876426 >> v2:172.21.15.149:3300/0 conn(0x7fcd880cea10 0x7fcd88072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:50:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.268+0000 7fcd87400640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd6c0039b0 0x7fcd6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.268+0000 7fcd87e00640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd8814c630 0x7fcd6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.269+0000 7fcd87400640 1 -- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd8814c630 msgr2=0x7fcd6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.269+0000 7fcd87400640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd8814c630 0x7fcd6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.269+0000 7fcd87400640 1 -- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd6c004800 msgr2=0x7fcd6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.269+0000 7fcd87400640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd6c004800 0x7fcd6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.269+0000 7fcd87400640 1 -- 172.21.15.144:0/3113876426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c003520 con 0x7fcd6c0039b0 2024-05-30T16:50:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.269+0000 7fcd87e00640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd8814c630 0x7fcd6c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:50:54.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.272+0000 7fcd87400640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd6c0039b0 0x7fcd6c003dd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009ac0 tx=0x7fcd6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653a1de10018761e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:54.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.273+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78036070 con 0x7fcd6c0039b0 2024-05-30T16:50:54.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.273+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd78031400 con 0x7fcd6c0039b0 2024-05-30T16:50:54.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.273+0000 7fcd86000640 1 -- 172.21.15.144:0/3113876426 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78009690 con 0x7fcd6c0039b0 2024-05-30T16:50:54.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.274+0000 7fcd8e000640 1 -- 172.21.15.144:0/3113876426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd6c0039b0 msgr2=0x7fcd6c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:54.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.274+0000 7fcd8e000640 1 --2- 172.21.15.144:0/3113876426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd6c0039b0 0x7fcd6c003dd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009ac0 tx=0x7fcd6c005830 comp rx=0 tx=0).stop 2024-05-30T16:50:54.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.275+0000 7fcd87e00640 1 -- 172.21.15.144:0/3113876426 reap_dead start 2024-05-30T16:50:54.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.275+0000 7fcd8e000640 1 -- 172.21.15.144:0/3113876426 shutdown_connections 2024-05-30T16:50:54.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.275+0000 7fcd8e000640 1 -- 172.21.15.144:0/3113876426 >> 172.21.15.144:0/3113876426 conn(0x7fcd8806bd00 msgr2=0x7fcd8806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:54.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.276+0000 7fcd8e000640 1 -- 172.21.15.144:0/3113876426 shutdown_connections 2024-05-30T16:50:54.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.276+0000 7fcd8e000640 1 -- 172.21.15.144:0/3113876426 wait complete. 2024-05-30T16:50:54.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.279+0000 7fcd8e000640 1 Processor -- start 2024-05-30T16:50:54.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.280+0000 7fcd8e000640 1 -- start start 2024-05-30T16:50:54.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.281+0000 7fcd8e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd88165a30 0x7fcd880caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:54.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.281+0000 7fcd8e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd880cb470 0x7fcd880c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:54.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.281+0000 7fcd8e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd880c8800 0x7fcd880ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:54.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.281+0000 7fcd8e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8814ca10 con 0x7fcd880c8800 2024-05-30T16:50:54.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.281+0000 7fcd8e000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880b3c20 con 0x7fcd880cb470 2024-05-30T16:50:54.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.281+0000 7fcd8e000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8814cb90 con 0x7fcd88165a30 2024-05-30T16:50:54.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.282+0000 7fcd87e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd880c8800 0x7fcd880ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:54.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.282+0000 7fcd87e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd880c8800 0x7fcd880ac900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58614/0 (socket says 172.21.15.144:58614) 2024-05-30T16:50:54.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.282+0000 7fcd87e00640 1 -- 172.21.15.144:0/163175851 learned_addr learned my addr 172.21.15.144:0/163175851 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:54.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.282+0000 7fcd86a00640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd880cb470 0x7fcd880c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.283+0000 7fcd87e00640 1 -- 172.21.15.144:0/163175851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd88165a30 msgr2=0x7fcd880caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.283+0000 7fcd87e00640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd88165a30 0x7fcd880caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.283+0000 7fcd87e00640 1 -- 172.21.15.144:0/163175851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd880cb470 msgr2=0x7fcd880c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.283+0000 7fcd87e00640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd880cb470 0x7fcd880c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.283+0000 7fcd87e00640 1 -- 172.21.15.144:0/163175851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880cbaf0 con 0x7fcd880c8800 2024-05-30T16:50:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.283+0000 7fcd87e00640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd880c8800 0x7fcd880ac900 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fcd8806fdc0 tx=0x7fcd800079c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.284+0000 7fcd7f400640 1 -- 172.21.15.144:0/163175851 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000e950 con 0x7fcd880c8800 2024-05-30T16:50:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.284+0000 7fcd7f400640 1 -- 172.21.15.144:0/163175851 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8000eaf0 con 0x7fcd880c8800 2024-05-30T16:50:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.284+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd880cbdd0 con 0x7fcd880c8800 2024-05-30T16:50:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.284+0000 7fcd7f400640 1 -- 172.21.15.144:0/163175851 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80014430 con 0x7fcd880c8800 2024-05-30T16:50:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.284+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd880cc390 con 0x7fcd880c8800 2024-05-30T16:50:54.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.286+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd880cb850 con 0x7fcd880c8800 2024-05-30T16:50:54.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.288+0000 7fcd7f400640 1 -- 172.21.15.144:0/163175851 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7fcd800145d0 con 0x7fcd880c8800 2024-05-30T16:50:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.290+0000 7fcd7f400640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd6806daa0 0x7fcd6806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.290+0000 7fcd7f400640 1 -- 172.21.15.144:0/163175851 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fcd8008a0e0 con 0x7fcd880c8800 2024-05-30T16:50:54.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.292+0000 7fcd87400640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd6806daa0 0x7fcd6806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.294+0000 7fcd87400640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd6806daa0 0x7fcd6806ff60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd78033000 tx=0x7fcd7802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.296+0000 7fcd7f400640 1 -- 172.21.15.144:0/163175851 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcd80059910 con 0x7fcd880c8800 2024-05-30T16:50:54.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:54.738+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone8316", "target": ["mon-mgr", ""]}) -- 0x7fcd88075f70 con 0x7fcd6806daa0 2024-05-30T16:50:55.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.600+0000 7fcd7f400640 1 -- 172.21.15.144:0/163175851 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcd78004030 con 0x7fcd6806daa0 2024-05-30T16:50:55.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd6806daa0 msgr2=0x7fcd6806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:55.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd6806daa0 0x7fcd6806ff60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcd78033000 tx=0x7fcd7802e000 comp rx=0 tx=0).stop 2024-05-30T16:50:55.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd880c8800 msgr2=0x7fcd880ac900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd880c8800 0x7fcd880ac900 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fcd8806fdc0 tx=0x7fcd800079c0 comp rx=0 tx=0).stop 2024-05-30T16:50:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 shutdown_connections 2024-05-30T16:50:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd6806daa0 0x7fcd6806ff60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd880c8800 0x7fcd880ac900 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd880cb470 0x7fcd880c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 --2- 172.21.15.144:0/163175851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd88165a30 0x7fcd880caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.611+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 >> 172.21.15.144:0/163175851 conn(0x7fcd8806bd00 msgr2=0x7fcd880b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:55.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.616+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 shutdown_connections 2024-05-30T16:50:55.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:55.617+0000 7fcd8e000640 1 -- 172.21.15.144:0/163175851 wait complete. 2024-05-30T16:50:55.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone8317 2024-05-30T16:50:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.185+0000 7ff969800640 1 Processor -- start 2024-05-30T16:50:56.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.186+0000 7ff969800640 1 -- start start 2024-05-30T16:50:56.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.189+0000 7ff969800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640d3b70 0x7ff9640ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.189+0000 7ff969800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9640b91c0 con 0x7ff96415ea90 2024-05-30T16:50:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.189+0000 7ff969800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9640b94a0 con 0x7ff9640b6a10 2024-05-30T16:50:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.189+0000 7ff969800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff9640b9dd0 con 0x7ff9640d3b70 2024-05-30T16:50:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.190+0000 7ff962a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff96415ea90 0x7ff9640b6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34496/0 (socket says 172.21.15.144:34496) 2024-05-30T16:50:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.190+0000 7ff962a00640 1 -- 172.21.15.144:0/4185326343 learned_addr learned my addr 172.21.15.144:0/4185326343 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:50:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.192+0000 7ff963400640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640d3b70 0x7ff9640ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.192+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981686281 0 0) 0x7ff9640b91c0 con 0x7ff96415ea90 2024-05-30T16:50:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.192+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff948003520 con 0x7ff96415ea90 2024-05-30T16:50:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.192+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3397935614 0 0) 0x7ff9640b94a0 con 0x7ff9640b6a10 2024-05-30T16:50:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.192+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9640b91c0 con 0x7ff9640b6a10 2024-05-30T16:50:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.193+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 278720437 0 0) 0x7ff9640b91c0 con 0x7ff9640b6a10 2024-05-30T16:50:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640d3b70 msgr2=0x7ff9640ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640d3b70 0x7ff9640ba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 >> v1:172.21.15.144:6789/0 conn(0x7ff96415ea90 legacy=0x7ff9640b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9640b9780 con 0x7ff9640b6a10 2024-05-30T16:50:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7ff954001670 con 0x7ff9640b6a10 2024-05-30T16:50:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 >> v1:172.21.15.149:6789/0 conn(0x7ff9640b6a10 legacy=0x7ff9640b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948004bd0 0x7ff948004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9480037a0 0x7ff948003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948004160 0x7ff948005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff948005ed0 con 0x7ff948004bd0 2024-05-30T16:50:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff948006080 con 0x7ff948004160 2024-05-30T16:50:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.194+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff948006280 con 0x7ff9480037a0 2024-05-30T16:50:56.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.196+0000 7ff963400640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948004160 0x7ff948005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:56.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.196+0000 7ff962a00640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948004bd0 0x7ff948004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.197+0000 7ff962a00640 1 -- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9480037a0 msgr2=0x7ff948003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.197+0000 7ff962a00640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9480037a0 0x7ff948003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:56.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.198+0000 7ff962a00640 1 -- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948004160 msgr2=0x7ff948005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:56.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.198+0000 7ff962a00640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948004160 0x7ff948005990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:56.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.198+0000 7ff962a00640 1 -- 172.21.15.144:0/4185326343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9640b9780 con 0x7ff948004bd0 2024-05-30T16:50:56.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.201+0000 7ff962a00640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948004bd0 0x7ff948004fb0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00a7e0 tx=0x7ff948005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d17798fcc39e2d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:56.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.202+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00a3b0 con 0x7ff948004bd0 2024-05-30T16:50:56.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.202+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff95c02f030 con 0x7ff948004bd0 2024-05-30T16:50:56.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.202+0000 7ff961600640 1 -- 172.21.15.144:0/4185326343 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c02bc50 con 0x7ff948004bd0 2024-05-30T16:50:56.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.205+0000 7ff969800640 1 -- 172.21.15.144:0/4185326343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948004bd0 msgr2=0x7ff948004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:56.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.205+0000 7ff969800640 1 --2- 172.21.15.144:0/4185326343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948004bd0 0x7ff948004fb0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00a7e0 tx=0x7ff948005830 comp rx=0 tx=0).stop 2024-05-30T16:50:56.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.206+0000 7ff963400640 1 -- 172.21.15.144:0/4185326343 reap_dead start 2024-05-30T16:50:56.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.206+0000 7ff969800640 1 -- 172.21.15.144:0/4185326343 shutdown_connections 2024-05-30T16:50:56.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.206+0000 7ff969800640 1 -- 172.21.15.144:0/4185326343 >> 172.21.15.144:0/4185326343 conn(0x7ff9640627b0 msgr2=0x7ff964062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:56.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.207+0000 7ff969800640 1 -- 172.21.15.144:0/4185326343 shutdown_connections 2024-05-30T16:50:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.208+0000 7ff969800640 1 -- 172.21.15.144:0/4185326343 wait complete. 2024-05-30T16:50:56.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.224+0000 7ff969800640 1 Processor -- start 2024-05-30T16:50:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.224+0000 7ff969800640 1 -- start start 2024-05-30T16:50:56.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.236+0000 7ff969800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641586a0 0x7ff96415ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:56.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.236+0000 7ff969800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640caef0 0x7ff9641f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:56.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.237+0000 7ff969800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9640cd960 0x7ff9640cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:56.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.237+0000 7ff969800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff9640ba330 con 0x7ff9640cd960 2024-05-30T16:50:56.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.238+0000 7ff969800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff96415ee70 con 0x7ff9641586a0 2024-05-30T16:50:56.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.238+0000 7ff969800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff9640ba4b0 con 0x7ff9640caef0 2024-05-30T16:50:56.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.238+0000 7ff962a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641586a0 0x7ff96415ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.239+0000 7ff962a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641586a0 0x7ff96415ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:50652/0 (socket says 172.21.15.144:50652) 2024-05-30T16:50:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.239+0000 7ff962a00640 1 -- 172.21.15.144:0/1789164145 learned_addr learned my addr 172.21.15.144:0/1789164145 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.239+0000 7ff962000640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640caef0 0x7ff9641f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.240+0000 7ff963400640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9640cd960 0x7ff9640cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.240+0000 7ff962a00640 1 -- 172.21.15.144:0/1789164145 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640caef0 msgr2=0x7ff9641f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.240+0000 7ff962a00640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640caef0 0x7ff9641f0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.240+0000 7ff962a00640 1 -- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9640cd960 msgr2=0x7ff9640cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.241+0000 7ff962a00640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9640cd960 0x7ff9640cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.241+0000 7ff962a00640 1 -- 172.21.15.144:0/1789164145 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9641f0f80 con 0x7ff9641586a0 2024-05-30T16:50:56.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.243+0000 7ff962000640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640caef0 0x7ff9641f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:56.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.245+0000 7ff963400640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9640cd960 0x7ff9640cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:50:56.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.248+0000 7ff962a00640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641586a0 0x7ff96415ff20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00a7e0 tx=0x7ff95c001b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.251+0000 7ff95aa00640 1 -- 172.21.15.144:0/1789164145 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00a3b0 con 0x7ff9641586a0 2024-05-30T16:50:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.251+0000 7ff95aa00640 1 -- 172.21.15.144:0/1789164145 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff95c02bba0 con 0x7ff9641586a0 2024-05-30T16:50:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.251+0000 7ff95aa00640 1 -- 172.21.15.144:0/1789164145 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0070d0 con 0x7ff9641586a0 2024-05-30T16:50:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.251+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9641f1260 con 0x7ff9641586a0 2024-05-30T16:50:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.251+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9641598e0 con 0x7ff9641586a0 2024-05-30T16:50:56.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.253+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff964068b90 con 0x7ff9641586a0 2024-05-30T16:50:56.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.257+0000 7ff95aa00640 1 -- 172.21.15.144:0/1789164145 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7ff95c063a10 con 0x7ff9641586a0 2024-05-30T16:50:56.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.260+0000 7ff95aa00640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff94406dad0 0x7ff94406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:56.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.260+0000 7ff95aa00640 1 -- 172.21.15.144:0/1789164145 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7ff95c0ab020 con 0x7ff9641586a0 2024-05-30T16:50:56.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.261+0000 7ff962000640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff94406dad0 0x7ff94406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:56.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.264+0000 7ff962000640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff94406dad0 0x7ff94406ff90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff964162260 tx=0x7ff954009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:56.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.266+0000 7ff95aa00640 1 -- 172.21.15.144:0/1789164145 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff95c07afc0 con 0x7ff9641586a0 2024-05-30T16:50:56.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:56.683+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone8317", "target": ["mon-mgr", ""]}) -- 0x7ff964075f70 con 0x7ff94406dad0 2024-05-30T16:50:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.789+0000 7ff95aa00640 1 -- 172.21.15.144:0/1789164145 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff95400d9a0 con 0x7ff94406dad0 2024-05-30T16:50:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff94406dad0 msgr2=0x7ff94406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff94406dad0 0x7ff94406ff90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff964162260 tx=0x7ff954009040 comp rx=0 tx=0).stop 2024-05-30T16:50:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641586a0 msgr2=0x7ff96415ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641586a0 0x7ff96415ff20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00a7e0 tx=0x7ff95c001b10 comp rx=0 tx=0).stop 2024-05-30T16:50:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 shutdown_connections 2024-05-30T16:50:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff94406dad0 0x7ff94406ff90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9640cd960 0x7ff9640cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9640caef0 0x7ff9641f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 --2- 172.21.15.144:0/1789164145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641586a0 0x7ff96415ff20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.795+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 >> 172.21.15.144:0/1789164145 conn(0x7ff9640627b0 msgr2=0x7ff9640d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.797+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 shutdown_connections 2024-05-30T16:50:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:57.797+0000 7ff969800640 1 -- 172.21.15.144:0/1789164145 wait complete. 2024-05-30T16:50:57.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone8318 2024-05-30T16:50:58.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.319+0000 7fbe69a00640 1 Processor -- start 2024-05-30T16:50:58.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.319+0000 7fbe69a00640 1 -- start start 2024-05-30T16:50:58.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.322+0000 7fbe69a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe6414c630 0x7fbe640ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:58.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.322+0000 7fbe69a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbe64072920 0x7fbe640b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:58.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.322+0000 7fbe69a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe6406fbf0 con 0x7fbe640cea10 2024-05-30T16:50:58.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.322+0000 7fbe69a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbe640cee30 con 0x7fbe6414c630 2024-05-30T16:50:58.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.322+0000 7fbe69a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fbe640cf050 con 0x7fbe64072920 2024-05-30T16:50:58.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.323+0000 7fbe62a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe6414c630 0x7fbe640ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:58.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.323+0000 7fbe62a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe6414c630 0x7fbe640ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42870/0 (socket says 172.21.15.144:42870) 2024-05-30T16:50:58.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.323+0000 7fbe62a00640 1 -- 172.21.15.144:0/378584969 learned_addr learned my addr 172.21.15.144:0/378584969 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:58.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.324+0000 7fbe62a00640 1 -- 172.21.15.144:0/378584969 >> v2:172.21.15.149:3300/0 conn(0x7fbe64072920 msgr2=0x7fbe640b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:58.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.324+0000 7fbe62a00640 1 --2- 172.21.15.144:0/378584969 >> v2:172.21.15.149:3300/0 conn(0x7fbe64072920 0x7fbe640b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:58.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.324+0000 7fbe62a00640 1 -- 172.21.15.144:0/378584969 >> v1:172.21.15.149:6789/0 conn(0x7fbe640cea10 legacy=0x7fbe64072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:50:58.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.324+0000 7fbe62a00640 1 -- 172.21.15.144:0/378584969 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe640cf330 con 0x7fbe6414c630 2024-05-30T16:50:58.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.327+0000 7fbe62a00640 1 --2- 172.21.15.144:0/378584969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe6414c630 0x7fbe640ce4d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbe6406fdc0 tx=0x7fbe5402a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02098767773258c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:58.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.328+0000 7fbe62000640 1 -- 172.21.15.144:0/378584969 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54036070 con 0x7fbe6414c630 2024-05-30T16:50:58.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.329+0000 7fbe62000640 1 -- 172.21.15.144:0/378584969 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe54031600 con 0x7fbe6414c630 2024-05-30T16:50:58.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.329+0000 7fbe62000640 1 -- 172.21.15.144:0/378584969 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe540319d0 con 0x7fbe6414c630 2024-05-30T16:50:58.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.331+0000 7fbe69a00640 1 -- 172.21.15.144:0/378584969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe6414c630 msgr2=0x7fbe640ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:58.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.331+0000 7fbe69a00640 1 --2- 172.21.15.144:0/378584969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe6414c630 0x7fbe640ce4d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbe6406fdc0 tx=0x7fbe5402a470 comp rx=0 tx=0).stop 2024-05-30T16:50:58.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.331+0000 7fbe69a00640 1 -- 172.21.15.144:0/378584969 shutdown_connections 2024-05-30T16:50:58.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.331+0000 7fbe69a00640 1 --2- 172.21.15.144:0/378584969 >> v2:172.21.15.149:3300/0 conn(0x7fbe64072920 0x7fbe640b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:58.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.331+0000 7fbe69a00640 1 --2- 172.21.15.144:0/378584969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe6414c630 0x7fbe640ce4d0 secure :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbe6406fdc0 tx=0x7fbe5402a470 comp rx=0 tx=0).stop 2024-05-30T16:50:58.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.331+0000 7fbe69a00640 1 -- 172.21.15.144:0/378584969 >> 172.21.15.144:0/378584969 conn(0x7fbe6406bd00 msgr2=0x7fbe6406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.333+0000 7fbe69a00640 1 -- 172.21.15.144:0/378584969 shutdown_connections 2024-05-30T16:50:58.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.333+0000 7fbe69a00640 1 -- 172.21.15.144:0/378584969 wait complete. 2024-05-30T16:50:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.336+0000 7fbe69a00640 1 Processor -- start 2024-05-30T16:50:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.337+0000 7fbe69a00640 1 -- start start 2024-05-30T16:50:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.338+0000 7fbe69a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe64072920 0x7fbe641481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.338+0000 7fbe69a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe640cea10 0x7fbe641563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.338+0000 7fbe69a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe641568e0 0x7fbe64145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.338+0000 7fbe69a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe640b3c20 con 0x7fbe640cea10 2024-05-30T16:50:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.338+0000 7fbe69a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe640cf8f0 con 0x7fbe64072920 2024-05-30T16:50:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.338+0000 7fbe69a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe6414ca10 con 0x7fbe641568e0 2024-05-30T16:50:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.339+0000 7fbe5be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe640cea10 0x7fbe641563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.340+0000 7fbe5be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe640cea10 0x7fbe641563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42886/0 (socket says 172.21.15.144:42886) 2024-05-30T16:50:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.340+0000 7fbe5be00640 1 -- 172.21.15.144:0/1982961591 learned_addr learned my addr 172.21.15.144:0/1982961591 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:50:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.340+0000 7fbe5be00640 1 -- 172.21.15.144:0/1982961591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe641568e0 msgr2=0x7fbe64145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.340+0000 7fbe5be00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe641568e0 0x7fbe64145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.340+0000 7fbe5be00640 1 -- 172.21.15.144:0/1982961591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe64072920 msgr2=0x7fbe641481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.340+0000 7fbe5be00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe64072920 0x7fbe641481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.340+0000 7fbe5be00640 1 -- 172.21.15.144:0/1982961591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe64156df0 con 0x7fbe640cea10 2024-05-30T16:50:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.341+0000 7fbe5be00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe640cea10 0x7fbe641563a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c470 tx=0x7fbe4c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.341+0000 7fbe5aa00640 1 -- 172.21.15.144:0/1982961591 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c017070 con 0x7fbe640cea10 2024-05-30T16:50:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.342+0000 7fbe5aa00640 1 -- 172.21.15.144:0/1982961591 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c0035f0 con 0x7fbe640cea10 2024-05-30T16:50:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.342+0000 7fbe5aa00640 1 -- 172.21.15.144:0/1982961591 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0039e0 con 0x7fbe640cea10 2024-05-30T16:50:58.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.342+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe641570d0 con 0x7fbe640cea10 2024-05-30T16:50:58.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.342+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe64157690 con 0x7fbe640cea10 2024-05-30T16:50:58.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.346+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe3c005290 con 0x7fbe640cea10 2024-05-30T16:50:58.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.348+0000 7fbe5aa00640 1 -- 172.21.15.144:0/1982961591 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7fbe4c01a070 con 0x7fbe640cea10 2024-05-30T16:50:58.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.350+0000 7fbe5aa00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe4006dad0 0x7fbe4006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:50:58.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.350+0000 7fbe5aa00640 1 -- 172.21.15.144:0/1982961591 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fbe4c089d90 con 0x7fbe640cea10 2024-05-30T16:50:58.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.351+0000 7fbe62a00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe4006dad0 0x7fbe4006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:50:58.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.352+0000 7fbe62a00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe4006dad0 0x7fbe4006ff90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbe54033000 tx=0x7fbe5402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:50:58.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:58.355+0000 7fbe5aa00640 1 -- 172.21.15.144:0/1982961591 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe4c0598d0 con 0x7fbe640cea10 2024-05-30T16:50:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.000+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone8318", "target": ["mon-mgr", ""]}) -- 0x7fbe3c000c80 con 0x7fbe4006dad0 2024-05-30T16:50:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.874+0000 7fbe5aa00640 1 -- 172.21.15.144:0/1982961591 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbe3c000c80 con 0x7fbe4006dad0 2024-05-30T16:50:59.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.880+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe4006dad0 msgr2=0x7fbe4006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.880+0000 7fbe69a00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe4006dad0 0x7fbe4006ff90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbe54033000 tx=0x7fbe5402e000 comp rx=0 tx=0).stop 2024-05-30T16:50:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.880+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe640cea10 msgr2=0x7fbe641563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:50:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.880+0000 7fbe69a00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe640cea10 0x7fbe641563a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c470 tx=0x7fbe4c00c930 comp rx=0 tx=0).stop 2024-05-30T16:50:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.881+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 shutdown_connections 2024-05-30T16:50:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.881+0000 7fbe69a00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbe4006dad0 0x7fbe4006ff90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.881+0000 7fbe69a00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe641568e0 0x7fbe64145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:59.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.881+0000 7fbe69a00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe640cea10 0x7fbe641563a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:59.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.881+0000 7fbe69a00640 1 --2- 172.21.15.144:0/1982961591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe64072920 0x7fbe641481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:50:59.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.881+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 >> 172.21.15.144:0/1982961591 conn(0x7fbe6406bd00 msgr2=0x7fbe640b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:50:59.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.882+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 shutdown_connections 2024-05-30T16:50:59.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:50:59.882+0000 7fbe69a00640 1 -- 172.21.15.144:0/1982961591 wait complete. 2024-05-30T16:50:59.913 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone8319 2024-05-30T16:51:00.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.306+0000 7f63eb200640 1 Processor -- start 2024-05-30T16:51:00.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.306+0000 7f63eb200640 1 -- start start 2024-05-30T16:51:00.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.308+0000 7f63eb200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f63ec0b5a10 0x7f63ec0d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:00.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.308+0000 7f63eb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5df0 0x7f63ec0d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:00.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.308+0000 7f63eb200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63ec0d0860 0x7f63ec0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:00.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.308+0000 7f63eb200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f63ec0cfe90 con 0x7f63ec0d0860 2024-05-30T16:51:00.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.308+0000 7f63eb200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f63ec0d3760 con 0x7f63ec0b5a10 2024-05-30T16:51:00.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.308+0000 7f63eb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f63ec0cf560 con 0x7f63ec0b5df0 2024-05-30T16:51:00.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.309+0000 7f63ea800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63ec0d0860 0x7f63ec0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:00.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.310+0000 7f63ea800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63ec0d0860 0x7f63ec0d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42894/0 (socket says 172.21.15.144:42894) 2024-05-30T16:51:00.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.310+0000 7f63ea800640 1 -- 172.21.15.144:0/1021585487 learned_addr learned my addr 172.21.15.144:0/1021585487 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:00.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.310+0000 7f63e9e00640 1 --2- 172.21.15.144:0/1021585487 >> v2:172.21.15.149:3300/0 conn(0x7f63ec0b5a10 0x7f63ec0d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:00.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.310+0000 7f63e9400640 1 --2- 172.21.15.144:0/1021585487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5df0 0x7f63ec0d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:00.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.311+0000 7f63ea800640 1 -- 172.21.15.144:0/1021585487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5df0 msgr2=0x7f63ec0d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:00.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.311+0000 7f63ea800640 1 --2- 172.21.15.144:0/1021585487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5df0 0x7f63ec0d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:00.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.311+0000 7f63ea800640 1 -- 172.21.15.144:0/1021585487 >> v2:172.21.15.149:3300/0 conn(0x7f63ec0b5a10 msgr2=0x7f63ec0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:00.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.311+0000 7f63ea800640 1 --2- 172.21.15.144:0/1021585487 >> v2:172.21.15.149:3300/0 conn(0x7f63ec0b5a10 0x7f63ec0d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:00.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.311+0000 7f63ea800640 1 -- 172.21.15.144:0/1021585487 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec0cf840 con 0x7f63ec0d0860 2024-05-30T16:51:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.313+0000 7f63ea800640 1 --2- 172.21.15.144:0/1021585487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0d0860 0x7f63ec0d1010 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f63ec08e5f0 tx=0x7f63e402a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f1cb84c70d61da server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:00.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.314+0000 7f63e8a00640 1 -- 172.21.15.144:0/1021585487 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4036070 con 0x7f63ec0d0860 2024-05-30T16:51:00.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.314+0000 7f63e8a00640 1 -- 172.21.15.144:0/1021585487 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e4031600 con 0x7f63ec0d0860 2024-05-30T16:51:00.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.314+0000 7f63e8a00640 1 -- 172.21.15.144:0/1021585487 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e40319d0 con 0x7f63ec0d0860 2024-05-30T16:51:00.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.317+0000 7f63eb200640 1 -- 172.21.15.144:0/1021585487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0d0860 msgr2=0x7f63ec0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:00.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.317+0000 7f63eb200640 1 --2- 172.21.15.144:0/1021585487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0d0860 0x7f63ec0d1010 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f63ec08e5f0 tx=0x7f63e402a690 comp rx=0 tx=0).stop 2024-05-30T16:51:00.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.317+0000 7f63eb200640 1 -- 172.21.15.144:0/1021585487 shutdown_connections 2024-05-30T16:51:00.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.317+0000 7f63eb200640 1 --2- 172.21.15.144:0/1021585487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0d0860 0x7f63ec0d1010 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:00.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.317+0000 7f63eb200640 1 --2- 172.21.15.144:0/1021585487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5df0 0x7f63ec0d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:00.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.317+0000 7f63eb200640 1 --2- 172.21.15.144:0/1021585487 >> v2:172.21.15.149:3300/0 conn(0x7f63ec0b5a10 0x7f63ec0d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:00.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.317+0000 7f63eb200640 1 -- 172.21.15.144:0/1021585487 >> 172.21.15.144:0/1021585487 conn(0x7f63ec08bfc0 msgr2=0x7f63ec0d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:00.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.320+0000 7f63eb200640 1 -- 172.21.15.144:0/1021585487 shutdown_connections 2024-05-30T16:51:00.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.320+0000 7f63eb200640 1 -- 172.21.15.144:0/1021585487 wait complete. 2024-05-30T16:51:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.328+0000 7f63eb200640 1 Processor -- start 2024-05-30T16:51:00.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.329+0000 7f63eb200640 1 -- start start 2024-05-30T16:51:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.331+0000 7f63eb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5a10 0x7f63ec15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.331+0000 7f63eb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0b5df0 0x7f63ec15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.332+0000 7f63eb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63ec15cc30 0x7f63ec15e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.332+0000 7f63eb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec0c7bd0 con 0x7f63ec0b5df0 2024-05-30T16:51:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.332+0000 7f63eb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec0c7a50 con 0x7f63ec15cc30 2024-05-30T16:51:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.332+0000 7f63eb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f63ec0c7d50 con 0x7f63ec0b5a10 2024-05-30T16:51:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.332+0000 7f63e9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0b5df0 0x7f63ec15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.332+0000 7f63e9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0b5df0 0x7f63ec15c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42902/0 (socket says 172.21.15.144:42902) 2024-05-30T16:51:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.332+0000 7f63e9400640 1 -- 172.21.15.144:0/1070202151 learned_addr learned my addr 172.21.15.144:0/1070202151 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:00.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.333+0000 7f63e9e00640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5a10 0x7f63ec15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.333+0000 7f63e9400640 1 -- 172.21.15.144:0/1070202151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5a10 msgr2=0x7f63ec15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.334+0000 7f63e9400640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5a10 0x7f63ec15bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.334+0000 7f63e9400640 1 -- 172.21.15.144:0/1070202151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63ec15cc30 msgr2=0x7f63ec15e850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:51:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.334+0000 7f63e9400640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63ec15cc30 0x7f63ec15e850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.334+0000 7f63e9400640 1 -- 172.21.15.144:0/1070202151 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec15f610 con 0x7f63ec0b5df0 2024-05-30T16:51:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.335+0000 7f63e9400640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0b5df0 0x7f63ec15c6f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00d620 tx=0x7f63dc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.336+0000 7f63e2000640 1 -- 172.21.15.144:0/1070202151 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00b620 con 0x7f63ec0b5df0 2024-05-30T16:51:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.337+0000 7f63e2000640 1 -- 172.21.15.144:0/1070202151 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63dc019070 con 0x7f63ec0b5df0 2024-05-30T16:51:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.337+0000 7f63e2000640 1 -- 172.21.15.144:0/1070202151 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00ba00 con 0x7f63ec0b5df0 2024-05-30T16:51:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.337+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ec15f8f0 con 0x7f63ec0b5df0 2024-05-30T16:51:00.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.338+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ec0cc860 con 0x7f63ec0b5df0 2024-05-30T16:51:00.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.345+0000 7f63e2000640 1 -- 172.21.15.144:0/1070202151 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f63dc00bba0 con 0x7f63ec0b5df0 2024-05-30T16:51:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.348+0000 7f63e2000640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f63cc06da20 0x7f63cc06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.348+0000 7f63e2000640 1 -- 172.21.15.144:0/1070202151 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f63dc08aa70 con 0x7f63ec0b5df0 2024-05-30T16:51:00.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.348+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c4005290 con 0x7f63ec0b5df0 2024-05-30T16:51:00.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.349+0000 7f63e9e00640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f63cc06da20 0x7f63cc06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:00.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.350+0000 7f63e9e00640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f63cc06da20 0x7f63cc06fee0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f63d800b740 tx=0x7f63d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:00.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.357+0000 7f63e2000640 1 -- 172.21.15.144:0/1070202151 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f63dc05a930 con 0x7f63ec0b5df0 2024-05-30T16:51:00.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:00.792+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone8319", "target": ["mon-mgr", ""]}) -- 0x7f63c4000c80 con 0x7f63cc06da20 2024-05-30T16:51:01.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.457+0000 7f63e2000640 1 -- 172.21.15.144:0/1070202151 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63c4000c80 con 0x7f63cc06da20 2024-05-30T16:51:01.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f63cc06da20 msgr2=0x7f63cc06fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f63cc06da20 0x7f63cc06fee0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f63d800b740 tx=0x7f63d8008040 comp rx=0 tx=0).stop 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0b5df0 msgr2=0x7f63ec15c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0b5df0 0x7f63ec15c6f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00d620 tx=0x7f63dc00dae0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 shutdown_connections 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f63cc06da20 0x7f63cc06fee0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63ec15cc30 0x7f63ec15e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0b5df0 0x7f63ec15c6f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 --2- 172.21.15.144:0/1070202151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63ec0b5a10 0x7f63ec15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 >> 172.21.15.144:0/1070202151 conn(0x7f63ec08bfc0 msgr2=0x7f63ec0b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 shutdown_connections 2024-05-30T16:51:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.460+0000 7f63eb200640 1 -- 172.21.15.144:0/1070202151 wait complete. 2024-05-30T16:51:01.518 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83110 2024-05-30T16:51:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.841+0000 7fcd52e00640 1 Processor -- start 2024-05-30T16:51:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.841+0000 7fcd52e00640 1 -- start start 2024-05-30T16:51:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.847+0000 7fcd52e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd4c14c630 0x7fcd4c0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.847+0000 7fcd52e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4c0cea10 0x7fcd4c072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.847+0000 7fcd52e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd4c06fbf0 con 0x7fcd4c072750 2024-05-30T16:51:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.847+0000 7fcd52e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c0cf050 con 0x7fcd4c14c630 2024-05-30T16:51:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.847+0000 7fcd52e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c0cf330 con 0x7fcd4c0cea10 2024-05-30T16:51:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.849+0000 7fcd4be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd4c14c630 0x7fcd4c0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.850+0000 7fcd50e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcd4c072750 0x7fcd4c06dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34506/0 (socket says 172.21.15.144:34506) 2024-05-30T16:51:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.850+0000 7fcd50e00640 1 -- 172.21.15.144:0/561810980 learned_addr learned my addr 172.21.15.144:0/561810980 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:01.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.852+0000 7fcd4be00640 1 -- 172.21.15.144:0/561810980 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4c0cea10 msgr2=0x7fcd4c072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.852+0000 7fcd4be00640 1 --2- 172.21.15.144:0/561810980 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4c0cea10 0x7fcd4c072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.852+0000 7fcd4be00640 1 -- 172.21.15.144:0/561810980 >> v1:172.21.15.144:6789/0 conn(0x7fcd4c072750 legacy=0x7fcd4c06dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.853+0000 7fcd4be00640 1 -- 172.21.15.144:0/561810980 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c0cf610 con 0x7fcd4c14c630 2024-05-30T16:51:01.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.855+0000 7fcd4be00640 1 --2- 172.21.15.144:0/561810980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c14c630 0x7fcd4c0ce4d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fcd340097a0 tx=0x7fcd3402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42b34e41091b216 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.856+0000 7fcd4b400640 1 -- 172.21.15.144:0/561810980 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34037070 con 0x7fcd4c14c630 2024-05-30T16:51:01.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.857+0000 7fcd4b400640 1 -- 172.21.15.144:0/561810980 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd34032440 con 0x7fcd4c14c630 2024-05-30T16:51:01.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.857+0000 7fcd4b400640 1 -- 172.21.15.144:0/561810980 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34037070 con 0x7fcd4c14c630 2024-05-30T16:51:01.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.861+0000 7fcd52e00640 1 -- 172.21.15.144:0/561810980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c14c630 msgr2=0x7fcd4c0ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:01.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.861+0000 7fcd52e00640 1 --2- 172.21.15.144:0/561810980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c14c630 0x7fcd4c0ce4d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fcd340097a0 tx=0x7fcd3402a210 comp rx=0 tx=0).stop 2024-05-30T16:51:01.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.862+0000 7fcd52e00640 1 -- 172.21.15.144:0/561810980 shutdown_connections 2024-05-30T16:51:01.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.862+0000 7fcd52e00640 1 --2- 172.21.15.144:0/561810980 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4c0cea10 0x7fcd4c072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.862+0000 7fcd52e00640 1 --2- 172.21.15.144:0/561810980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c14c630 0x7fcd4c0ce4d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.862+0000 7fcd52e00640 1 -- 172.21.15.144:0/561810980 >> 172.21.15.144:0/561810980 conn(0x7fcd4c06bd00 msgr2=0x7fcd4c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:01.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.863+0000 7fcd52e00640 1 -- 172.21.15.144:0/561810980 shutdown_connections 2024-05-30T16:51:01.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.863+0000 7fcd52e00640 1 -- 172.21.15.144:0/561810980 wait complete. 2024-05-30T16:51:01.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.867+0000 7fcd52e00640 1 Processor -- start 2024-05-30T16:51:01.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.867+0000 7fcd52e00640 1 -- start start 2024-05-30T16:51:01.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.869+0000 7fcd52e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4c072750 0x7fcd4c1656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:01.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.869+0000 7fcd52e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c0cea10 0x7fcd4c0c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:01.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.869+0000 7fcd52e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd4c14c630 0x7fcd4c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:01.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.869+0000 7fcd52e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c14ca10 con 0x7fcd4c0cea10 2024-05-30T16:51:01.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.869+0000 7fcd52e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0b3c20 con 0x7fcd4c14c630 2024-05-30T16:51:01.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.869+0000 7fcd52e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c14cb90 con 0x7fcd4c072750 2024-05-30T16:51:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.870+0000 7fcd43e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c0cea10 0x7fcd4c0c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.870+0000 7fcd43e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c0cea10 0x7fcd4c0c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42934/0 (socket says 172.21.15.144:42934) 2024-05-30T16:51:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.870+0000 7fcd43e00640 1 -- 172.21.15.144:0/572025472 learned_addr learned my addr 172.21.15.144:0/572025472 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.871+0000 7fcd43e00640 1 -- 172.21.15.144:0/572025472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4c072750 msgr2=0x7fcd4c1656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.871+0000 7fcd43e00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4c072750 0x7fcd4c1656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.871+0000 7fcd43e00640 1 -- 172.21.15.144:0/572025472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd4c14c630 msgr2=0x7fcd4c0b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.871+0000 7fcd43e00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd4c14c630 0x7fcd4c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.871+0000 7fcd43e00640 1 -- 172.21.15.144:0/572025472 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c0c6980 con 0x7fcd4c0cea10 2024-05-30T16:51:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.872+0000 7fcd43e00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c0cea10 0x7fcd4c0c5f00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00b4a0 tx=0x7fcd3c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.873+0000 7fcd48c00640 1 -- 172.21.15.144:0/572025472 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c014070 con 0x7fcd4c0cea10 2024-05-30T16:51:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.873+0000 7fcd48c00640 1 -- 172.21.15.144:0/572025472 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3c010610 con 0x7fcd4c0cea10 2024-05-30T16:51:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.873+0000 7fcd48c00640 1 -- 172.21.15.144:0/572025472 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c010a00 con 0x7fcd4c0cea10 2024-05-30T16:51:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.873+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c0c6c60 con 0x7fcd4c0cea10 2024-05-30T16:51:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.873+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1f8d90 con 0x7fcd4c0cea10 2024-05-30T16:51:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.878+0000 7fcd48c00640 1 -- 172.21.15.144:0/572025472 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7fcd3c017070 con 0x7fcd4c0cea10 2024-05-30T16:51:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.879+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c1f8f90 con 0x7fcd4c0cea10 2024-05-30T16:51:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.879+0000 7fcd48c00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd2806daa0 0x7fcd2806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.879+0000 7fcd48c00640 1 -- 172.21.15.144:0/572025472 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fcd3c08a510 con 0x7fcd4c0cea10 2024-05-30T16:51:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.881+0000 7fcd4be00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd2806daa0 0x7fcd2806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:01.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.888+0000 7fcd48c00640 1 -- 172.21.15.144:0/572025472 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcd4c1f8f90 con 0x7fcd4c0cea10 2024-05-30T16:51:01.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:01.891+0000 7fcd4be00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd2806daa0 0x7fcd2806ff60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcd34034000 tx=0x7fcd3402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:02.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:02.385+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83110", "target": ["mon-mgr", ""]}) -- 0x7fcd4c068b90 con 0x7fcd2806daa0 2024-05-30T16:51:03.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.914+0000 7fcd48c00640 1 -- 172.21.15.144:0/572025472 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcd4c068b90 con 0x7fcd2806daa0 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd2806daa0 msgr2=0x7fcd2806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd2806daa0 0x7fcd2806ff60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcd34034000 tx=0x7fcd3402c000 comp rx=0 tx=0).stop 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c0cea10 msgr2=0x7fcd4c0c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c0cea10 0x7fcd4c0c5f00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00b4a0 tx=0x7fcd3c00b960 comp rx=0 tx=0).stop 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 shutdown_connections 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcd2806daa0 0x7fcd2806ff60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd4c14c630 0x7fcd4c0b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd4c0cea10 0x7fcd4c0c5f00 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 --2- 172.21.15.144:0/572025472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4c072750 0x7fcd4c1656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 >> 172.21.15.144:0/572025472 conn(0x7fcd4c06bd00 msgr2=0x7fcd4c14ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 shutdown_connections 2024-05-30T16:51:03.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:03.917+0000 7fcd52e00640 1 -- 172.21.15.144:0/572025472 wait complete. 2024-05-30T16:51:03.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83111 2024-05-30T16:51:04.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.411+0000 7f0530200640 1 Processor -- start 2024-05-30T16:51:04.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.411+0000 7f0530200640 1 -- start start 2024-05-30T16:51:04.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.414+0000 7f0530200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f052816fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:04.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.414+0000 7f0530200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05280b5ba0 0x7f05280b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:04.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.414+0000 7f0530200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0528170070 con 0x7f05280cc7a0 2024-05-30T16:51:04.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.414+0000 7f0530200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f052816bad0 con 0x7f05280b5ba0 2024-05-30T16:51:04.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.414+0000 7f0530200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f05280b66a0 con 0x7f0528071df0 2024-05-30T16:51:04.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.415+0000 7f052e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05280b5ba0 0x7f05280b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:04.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.415+0000 7f052d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f052816fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:04.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.415+0000 7f052d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f052816fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:41296/0 (socket says 172.21.15.144:41296) 2024-05-30T16:51:04.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.415+0000 7f052d800640 1 -- 172.21.15.144:0/4231050371 learned_addr learned my addr 172.21.15.144:0/4231050371 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:04.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.416+0000 7f052e200640 1 -- 172.21.15.144:0/4231050371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 msgr2=0x7f052816fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:04.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.416+0000 7f052e200640 1 --2- 172.21.15.144:0/4231050371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f052816fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:04.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.416+0000 7f052e200640 1 -- 172.21.15.144:0/4231050371 >> v1:172.21.15.149:6789/0 conn(0x7f05280cc7a0 legacy=0x7f05280721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:04.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.416+0000 7f052e200640 1 -- 172.21.15.144:0/4231050371 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05280ccd60 con 0x7f05280b5ba0 2024-05-30T16:51:04.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.418+0000 7f052e200640 1 --2- 172.21.15.144:0/4231050371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280b5ba0 0x7f05280b47a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0520009d90 tx=0x7f052002a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec031db5d147c64 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:04.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.418+0000 7f0527e00640 1 -- 172.21.15.144:0/4231050371 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520007740 con 0x7f05280b5ba0 2024-05-30T16:51:04.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.418+0000 7f0527e00640 1 -- 172.21.15.144:0/4231050371 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05200078e0 con 0x7f05280b5ba0 2024-05-30T16:51:04.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.418+0000 7f0527e00640 1 -- 172.21.15.144:0/4231050371 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520007cb0 con 0x7f05280b5ba0 2024-05-30T16:51:04.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.420+0000 7f0530200640 1 -- 172.21.15.144:0/4231050371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280b5ba0 msgr2=0x7f05280b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:04.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.420+0000 7f0530200640 1 --2- 172.21.15.144:0/4231050371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280b5ba0 0x7f05280b47a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0520009d90 tx=0x7f052002a530 comp rx=0 tx=0).stop 2024-05-30T16:51:04.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.421+0000 7f0530200640 1 -- 172.21.15.144:0/4231050371 shutdown_connections 2024-05-30T16:51:04.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.421+0000 7f0530200640 1 --2- 172.21.15.144:0/4231050371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280b5ba0 0x7f05280b47a0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:04.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.421+0000 7f0530200640 1 --2- 172.21.15.144:0/4231050371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f052816fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:04.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.421+0000 7f0530200640 1 -- 172.21.15.144:0/4231050371 >> 172.21.15.144:0/4231050371 conn(0x7f0528070050 msgr2=0x7f052806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:04.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.421+0000 7f0530200640 1 -- 172.21.15.144:0/4231050371 shutdown_connections 2024-05-30T16:51:04.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.421+0000 7f0530200640 1 -- 172.21.15.144:0/4231050371 wait complete. 2024-05-30T16:51:04.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.426+0000 7f0530200640 1 Processor -- start 2024-05-30T16:51:04.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.426+0000 7f0530200640 1 -- start start 2024-05-30T16:51:04.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.427+0000 7f0530200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f05280b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:04.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.428+0000 7f0530200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05280b5ba0 0x7f0528214760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:04.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.428+0000 7f0530200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280cc7a0 0x7f0528214ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:04.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.428+0000 7f0530200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05280b39f0 con 0x7f05280cc7a0 2024-05-30T16:51:04.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.428+0000 7f0530200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f05280b63c0 con 0x7f05280b5ba0 2024-05-30T16:51:04.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.428+0000 7f0530200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f05280b4ce0 con 0x7f0528071df0 2024-05-30T16:51:04.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.429+0000 7f052d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f05280b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:04.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.429+0000 7f052d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f05280b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:41300/0 (socket says 172.21.15.144:41300) 2024-05-30T16:51:04.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.429+0000 7f052d800640 1 -- 172.21.15.144:0/1072868376 learned_addr learned my addr 172.21.15.144:0/1072868376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:04.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.429+0000 7f052e200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280cc7a0 0x7f0528214ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:04.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.430+0000 7f052ce00640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05280b5ba0 0x7f0528214760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:04.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.433+0000 7f052e200640 1 -- 172.21.15.144:0/1072868376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 msgr2=0x7f05280b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:04.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.433+0000 7f052e200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f05280b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:04.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.433+0000 7f052e200640 1 -- 172.21.15.144:0/1072868376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05280b5ba0 msgr2=0x7f0528214760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:04.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.433+0000 7f052e200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05280b5ba0 0x7f0528214760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:04.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.433+0000 7f052e200640 1 -- 172.21.15.144:0/1072868376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052817a4f0 con 0x7f05280cc7a0 2024-05-30T16:51:04.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.433+0000 7f052ce00640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05280b5ba0 0x7f0528214760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:04.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.433+0000 7f052d800640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f05280b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:04.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.434+0000 7f052e200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280cc7a0 0x7f0528214ca0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0520031000 tx=0x7f0520004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.435+0000 7f0525600640 1 -- 172.21.15.144:0/1072868376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520040070 con 0x7f05280cc7a0 2024-05-30T16:51:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.435+0000 7f0525600640 1 -- 172.21.15.144:0/1072868376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0520031c40 con 0x7f05280cc7a0 2024-05-30T16:51:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.435+0000 7f0525600640 1 -- 172.21.15.144:0/1072868376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520045460 con 0x7f05280cc7a0 2024-05-30T16:51:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.435+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0528213cc0 con 0x7f05280cc7a0 2024-05-30T16:51:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.435+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05280b0840 con 0x7f05280cc7a0 2024-05-30T16:51:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.438+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052806c870 con 0x7f05280cc7a0 2024-05-30T16:51:04.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.441+0000 7f0525600640 1 -- 172.21.15.144:0/1072868376 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f0520039040 con 0x7f05280cc7a0 2024-05-30T16:51:04.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.445+0000 7f0525600640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f050c06d9d0 0x7f050c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:04.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.447+0000 7f0525600640 1 -- 172.21.15.144:0/1072868376 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f05200ac470 con 0x7f05280cc7a0 2024-05-30T16:51:04.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.450+0000 7f0525600640 1 -- 172.21.15.144:0/1072868376 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0520054080 con 0x7f05280cc7a0 2024-05-30T16:51:04.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.462+0000 7f052d800640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f050c06d9d0 0x7f050c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:04.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.483+0000 7f052d800640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f050c06d9d0 0x7f050c06fe90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0518006a90 tx=0x7f0518008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:04.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:04.904+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83111", "target": ["mon-mgr", ""]}) -- 0x7f0528161cb0 con 0x7f050c06d9d0 2024-05-30T16:51:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.605+0000 7f0525600640 1 -- 172.21.15.144:0/1072868376 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0518011d70 con 0x7f050c06d9d0 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.610+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f050c06d9d0 msgr2=0x7f050c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.610+0000 7f0530200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f050c06d9d0 0x7f050c06fe90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0518006a90 tx=0x7f0518008040 comp rx=0 tx=0).stop 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.610+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280cc7a0 msgr2=0x7f0528214ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.610+0000 7f0530200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280cc7a0 0x7f0528214ca0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0520031000 tx=0x7f0520004a40 comp rx=0 tx=0).stop 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.611+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 shutdown_connections 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.611+0000 7f0530200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f050c06d9d0 0x7f050c06fe90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.611+0000 7f0530200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05280cc7a0 0x7f0528214ca0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.611+0000 7f0530200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05280b5ba0 0x7f0528214760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.611+0000 7f0530200640 1 --2- 172.21.15.144:0/1072868376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0528071df0 0x7f05280b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.611+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 >> 172.21.15.144:0/1072868376 conn(0x7f0528070050 msgr2=0x7f052816f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.611+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 shutdown_connections 2024-05-30T16:51:05.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:05.611+0000 7f0530200640 1 -- 172.21.15.144:0/1072868376 wait complete. 2024-05-30T16:51:05.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83112 2024-05-30T16:51:06.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.105+0000 7ff60be00640 1 Processor -- start 2024-05-30T16:51:06.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.106+0000 7ff60be00640 1 -- start start 2024-05-30T16:51:06.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.115+0000 7ff60be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff60c0d0540 0x7ff60c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:06.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.116+0000 7ff60be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d1650 0x7ff60c0b8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:06.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.118+0000 7ff60a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff60c0d0540 0x7ff60c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:06.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.119+0000 7ff60be00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60c0d3410 con 0x7ff60c15e8a0 2024-05-30T16:51:06.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.119+0000 7ff60be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff60c0b7610 con 0x7ff60c0d0540 2024-05-30T16:51:06.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.119+0000 7ff60be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff60c0b78b0 con 0x7ff60c0d1650 2024-05-30T16:51:06.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.118+0000 7ff60aa00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff60c15e8a0 0x7ff60c0d2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:42636/0 (socket says 172.21.15.144:42636) 2024-05-30T16:51:06.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.120+0000 7ff60aa00640 1 -- 172.21.15.144:0/4272234722 learned_addr learned my addr 172.21.15.144:0/4272234722 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:06.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.122+0000 7ff60a000640 1 -- 172.21.15.144:0/4272234722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d1650 msgr2=0x7ff60c0b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:06.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.122+0000 7ff60a000640 1 --2- 172.21.15.144:0/4272234722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d1650 0x7ff60c0b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:06.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.122+0000 7ff60a000640 1 -- 172.21.15.144:0/4272234722 >> v1:172.21.15.149:6789/0 conn(0x7ff60c15e8a0 legacy=0x7ff60c0d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:06.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.122+0000 7ff60a000640 1 -- 172.21.15.144:0/4272234722 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60c0b7b90 con 0x7ff60c0d0540 2024-05-30T16:51:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.128+0000 7ff60a000640 1 --2- 172.21.15.144:0/4272234722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c0d0540 0x7ff60c0d1110 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009790 tx=0x7ff5fc02a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d6c9de2f63ef51 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.131+0000 7ff609600640 1 -- 172.21.15.144:0/4272234722 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc037070 con 0x7ff60c0d0540 2024-05-30T16:51:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.132+0000 7ff609600640 1 -- 172.21.15.144:0/4272234722 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5fc02ada0 con 0x7ff60c0d0540 2024-05-30T16:51:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.132+0000 7ff609600640 1 -- 172.21.15.144:0/4272234722 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc032660 con 0x7ff60c0d0540 2024-05-30T16:51:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.137+0000 7ff60be00640 1 -- 172.21.15.144:0/4272234722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c0d0540 msgr2=0x7ff60c0d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.137+0000 7ff60be00640 1 --2- 172.21.15.144:0/4272234722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c0d0540 0x7ff60c0d1110 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009790 tx=0x7ff5fc02a090 comp rx=0 tx=0).stop 2024-05-30T16:51:06.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.138+0000 7ff60be00640 1 -- 172.21.15.144:0/4272234722 shutdown_connections 2024-05-30T16:51:06.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.138+0000 7ff60be00640 1 --2- 172.21.15.144:0/4272234722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d1650 0x7ff60c0b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:06.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.138+0000 7ff60be00640 1 --2- 172.21.15.144:0/4272234722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c0d0540 0x7ff60c0d1110 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:06.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.138+0000 7ff60be00640 1 -- 172.21.15.144:0/4272234722 >> 172.21.15.144:0/4272234722 conn(0x7ff60c08bfc0 msgr2=0x7ff60c0d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:06.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.138+0000 7ff60be00640 1 -- 172.21.15.144:0/4272234722 shutdown_connections 2024-05-30T16:51:06.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.138+0000 7ff60be00640 1 -- 172.21.15.144:0/4272234722 wait complete. 2024-05-30T16:51:06.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.141+0000 7ff60be00640 1 Processor -- start 2024-05-30T16:51:06.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.142+0000 7ff60be00640 1 -- start start 2024-05-30T16:51:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.144+0000 7ff60be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d0540 0x7ff60c14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.145+0000 7ff60be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60c0d1650 0x7ff60c09f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.145+0000 7ff60be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c15e8a0 0x7ff60c09fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.145+0000 7ff60be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c0d3820 con 0x7ff60c15e8a0 2024-05-30T16:51:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.146+0000 7ff60be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c0d36a0 con 0x7ff60c0d1650 2024-05-30T16:51:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.146+0000 7ff60b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c15e8a0 0x7ff60c09fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.146+0000 7ff60be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff60c0b88d0 con 0x7ff60c0d0540 2024-05-30T16:51:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.146+0000 7ff60aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d0540 0x7ff60c14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.146+0000 7ff60aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d0540 0x7ff60c14db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35760/0 (socket says 172.21.15.144:35760) 2024-05-30T16:51:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.146+0000 7ff60b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c15e8a0 0x7ff60c09fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42776/0 (socket says 172.21.15.144:42776) 2024-05-30T16:51:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.146+0000 7ff60b400640 1 -- 172.21.15.144:0/3264031380 learned_addr learned my addr 172.21.15.144:0/3264031380 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.146+0000 7ff60a000640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60c0d1650 0x7ff60c09f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.153+0000 7ff60b400640 1 -- 172.21.15.144:0/3264031380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d0540 msgr2=0x7ff60c14db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.153+0000 7ff60b400640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d0540 0x7ff60c14db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.153+0000 7ff60b400640 1 -- 172.21.15.144:0/3264031380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60c0d1650 msgr2=0x7ff60c09f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.154+0000 7ff60b400640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60c0d1650 0x7ff60c09f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:06.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.154+0000 7ff60b400640 1 -- 172.21.15.144:0/3264031380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60c14e070 con 0x7ff60c15e8a0 2024-05-30T16:51:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.155+0000 7ff60b400640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c15e8a0 0x7ff60c09fc30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff60400ba10 tx=0x7ff60400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:06.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.156+0000 7ff602a00640 1 -- 172.21.15.144:0/3264031380 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604019070 con 0x7ff60c15e8a0 2024-05-30T16:51:06.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.156+0000 7ff60be00640 1 -- 172.21.15.144:0/3264031380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff60c15f270 con 0x7ff60c15e8a0 2024-05-30T16:51:06.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.157+0000 7ff602a00640 1 -- 172.21.15.144:0/3264031380 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60400cae0 con 0x7ff60c15e8a0 2024-05-30T16:51:06.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.157+0000 7ff602a00640 1 -- 172.21.15.144:0/3264031380 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604014440 con 0x7ff60c15e8a0 2024-05-30T16:51:06.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.160+0000 7ff60be00640 1 -- 172.21.15.144:0/3264031380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff60c15f830 con 0x7ff60c15e8a0 2024-05-30T16:51:06.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.164+0000 7ff602a00640 1 -- 172.21.15.144:0/3264031380 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7ff60401c070 con 0x7ff60c15e8a0 2024-05-30T16:51:06.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.167+0000 7ff602a00640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5ec06d9d0 0x7ff5ec06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:06.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.166+0000 7ff5f7e00640 1 -- 172.21.15.144:0/3264031380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e0005290 con 0x7ff60c15e8a0 2024-05-30T16:51:06.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.168+0000 7ff602a00640 1 -- 172.21.15.144:0/3264031380 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7ff60408a610 con 0x7ff60c15e8a0 2024-05-30T16:51:06.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.168+0000 7ff60aa00640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5ec06d9d0 0x7ff5ec06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:06.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.170+0000 7ff60aa00640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5ec06d9d0 0x7ff5ec06fe90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8007c90 tx=0x7ff5f8007be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:06.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.178+0000 7ff602a00640 1 -- 172.21.15.144:0/3264031380 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff604059900 con 0x7ff60c15e8a0 2024-05-30T16:51:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:06.728+0000 7ff5f7e00640 1 -- 172.21.15.144:0/3264031380 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83112", "target": ["mon-mgr", ""]}) -- 0x7ff5e0000c80 con 0x7ff5ec06d9d0 2024-05-30T16:51:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.392+0000 7ff602a00640 1 -- 172.21.15.144:0/3264031380 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff5e0000c80 con 0x7ff5ec06d9d0 2024-05-30T16:51:07.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.401+0000 7ff5f7e00640 1 -- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5ec06d9d0 msgr2=0x7ff5ec06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:07.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.401+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5ec06d9d0 0x7ff5ec06fe90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8007c90 tx=0x7ff5f8007be0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.401+0000 7ff5f7e00640 1 -- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c15e8a0 msgr2=0x7ff60c09fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:07.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.401+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c15e8a0 0x7ff60c09fc30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff60400ba10 tx=0x7ff60400bed0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.402+0000 7ff5f7e00640 1 -- 172.21.15.144:0/3264031380 shutdown_connections 2024-05-30T16:51:07.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.402+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff5ec06d9d0 0x7ff5ec06fe90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.402+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff60c15e8a0 0x7ff60c09fc30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.402+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60c0d1650 0x7ff60c09f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.402+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/3264031380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff60c0d0540 0x7ff60c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.402+0000 7ff5f7e00640 1 -- 172.21.15.144:0/3264031380 >> 172.21.15.144:0/3264031380 conn(0x7ff60c08bfc0 msgr2=0x7ff60c0ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:07.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.403+0000 7ff5f7e00640 1 -- 172.21.15.144:0/3264031380 shutdown_connections 2024-05-30T16:51:07.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.403+0000 7ff5f7e00640 1 -- 172.21.15.144:0/3264031380 wait complete. 2024-05-30T16:51:07.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83113 2024-05-30T16:51:07.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.939+0000 7f1455800640 1 Processor -- start 2024-05-30T16:51:07.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.939+0000 7f1455800640 1 -- start start 2024-05-30T16:51:07.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.945+0000 7f1455800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f145014ba40 0x7f14500727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:07.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.945+0000 7f1455800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f14500cf1e0 0x7f145006dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:07.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.945+0000 7f1455800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14500d0020 con 0x7f14500cf670 2024-05-30T16:51:07.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.945+0000 7f1455800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f14500ce4d0 con 0x7f14500cf1e0 2024-05-30T16:51:07.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.945+0000 7f1455800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f14500d0300 con 0x7f145014ba40 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.946+0000 7f144ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f145014ba40 0x7f14500727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.946+0000 7f144ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f145014ba40 0x7f14500727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36676/0 (socket says 172.21.15.144:36676) 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.946+0000 7f144ea00640 1 -- 172.21.15.144:0/1737835184 learned_addr learned my addr 172.21.15.144:0/1737835184 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.947+0000 7f144e000640 1 --2- 172.21.15.144:0/1737835184 >> v2:172.21.15.144:3300/0 conn(0x7f14500cf1e0 0x7f145006dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.950+0000 7f144e000640 1 -- 172.21.15.144:0/1737835184 >> v2:172.21.15.149:3300/0 conn(0x7f145014ba40 msgr2=0x7f14500727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.950+0000 7f144e000640 1 --2- 172.21.15.144:0/1737835184 >> v2:172.21.15.149:3300/0 conn(0x7f145014ba40 0x7f14500727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.950+0000 7f144e000640 1 -- 172.21.15.144:0/1737835184 >> v1:172.21.15.144:6789/0 conn(0x7f14500cf670 legacy=0x7f14500b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.950+0000 7f144e000640 1 -- 172.21.15.144:0/1737835184 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14500ce700 con 0x7f14500cf1e0 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.952+0000 7f144e000640 1 --2- 172.21.15.144:0/1737835184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf1e0 0x7f145006dfc0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f145006f480 tx=0x7f144002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f6232b8526b755 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.953+0000 7f144d600640 1 -- 172.21.15.144:0/1737835184 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1440037070 con 0x7f14500cf1e0 2024-05-30T16:51:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.953+0000 7f144d600640 1 -- 172.21.15.144:0/1737835184 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144002ad60 con 0x7f14500cf1e0 2024-05-30T16:51:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.954+0000 7f1455800640 1 -- 172.21.15.144:0/1737835184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf1e0 msgr2=0x7f145006dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.954+0000 7f1455800640 1 --2- 172.21.15.144:0/1737835184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf1e0 0x7f145006dfc0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f145006f480 tx=0x7f144002a0d0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.956+0000 7f1455800640 1 -- 172.21.15.144:0/1737835184 shutdown_connections 2024-05-30T16:51:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.956+0000 7f1455800640 1 --2- 172.21.15.144:0/1737835184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf1e0 0x7f145006dfc0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.956+0000 7f1455800640 1 --2- 172.21.15.144:0/1737835184 >> v2:172.21.15.149:3300/0 conn(0x7f145014ba40 0x7f14500727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.956+0000 7f1455800640 1 -- 172.21.15.144:0/1737835184 >> 172.21.15.144:0/1737835184 conn(0x7f1450070050 msgr2=0x7f145006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:07.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.956+0000 7f1455800640 1 -- 172.21.15.144:0/1737835184 shutdown_connections 2024-05-30T16:51:07.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.956+0000 7f1455800640 1 -- 172.21.15.144:0/1737835184 wait complete. 2024-05-30T16:51:07.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.960+0000 7f1455800640 1 Processor -- start 2024-05-30T16:51:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.962+0000 7f1455800640 1 -- start start 2024-05-30T16:51:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.963+0000 7f1455800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14500cf1e0 0x7f1450143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:07.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.963+0000 7f1455800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf670 0x7f1450146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:07.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.964+0000 7f1455800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f145014ba40 0x7f145013bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:07.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.964+0000 7f1455800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1450072cf0 con 0x7f14500cf670 2024-05-30T16:51:07.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.964+0000 7f1455800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f14500cecc0 con 0x7f14500cf1e0 2024-05-30T16:51:07.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.964+0000 7f1455800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f145014c8b0 con 0x7f145014ba40 2024-05-30T16:51:07.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.964+0000 7f144e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf670 0x7f1450146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:07.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.964+0000 7f144e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf670 0x7f1450146f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42798/0 (socket says 172.21.15.144:42798) 2024-05-30T16:51:07.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.964+0000 7f144e000640 1 -- 172.21.15.144:0/3327977627 learned_addr learned my addr 172.21.15.144:0/3327977627 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:07.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.965+0000 7f144ea00640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14500cf1e0 0x7f1450143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:07.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.965+0000 7f144e000640 1 -- 172.21.15.144:0/3327977627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f145014ba40 msgr2=0x7f145013bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:07.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.965+0000 7f144e000640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f145014ba40 0x7f145013bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.965+0000 7f144e000640 1 -- 172.21.15.144:0/3327977627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14500cf1e0 msgr2=0x7f1450143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:07.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.965+0000 7f144e000640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14500cf1e0 0x7f1450143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:07.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.965+0000 7f144e000640 1 -- 172.21.15.144:0/3327977627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145013c3e0 con 0x7f14500cf670 2024-05-30T16:51:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.966+0000 7f144e000640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf670 0x7f1450146f90 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1440009890 tx=0x7f14400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:07.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.968+0000 7f1446a00640 1 -- 172.21.15.144:0/3327977627 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1440041070 con 0x7f14500cf670 2024-05-30T16:51:07.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.969+0000 7f1446a00640 1 -- 172.21.15.144:0/3327977627 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144003d850 con 0x7f14500cf670 2024-05-30T16:51:07.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.969+0000 7f1446a00640 1 -- 172.21.15.144:0/3327977627 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1440006e10 con 0x7f14500cf670 2024-05-30T16:51:07.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.972+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1450144690 con 0x7f14500cf670 2024-05-30T16:51:07.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.974+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1450144c50 con 0x7f14500cf670 2024-05-30T16:51:07.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.985+0000 7f1446a00640 1 -- 172.21.15.144:0/3327977627 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f144002ab60 con 0x7f14500cf670 2024-05-30T16:51:07.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.988+0000 7f1446a00640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f143006da20 0x7f143006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:07.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.988+0000 7f1446a00640 1 -- 172.21.15.144:0/3327977627 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f1440077790 con 0x7f14500cf670 2024-05-30T16:51:07.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:07.989+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1450068b90 con 0x7f14500cf670 2024-05-30T16:51:08.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:08.010+0000 7f1446a00640 1 -- 172.21.15.144:0/3327977627 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1440079df0 con 0x7f14500cf670 2024-05-30T16:51:08.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:08.015+0000 7f144ea00640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f143006da20 0x7f143006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:08.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:08.017+0000 7f144ea00640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f143006da20 0x7f143006fee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f143c009ac0 tx=0x7f143c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:08.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:08.487+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83113", "target": ["mon-mgr", ""]}) -- 0x7f1450075f70 con 0x7f143006da20 2024-05-30T16:51:09.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.849+0000 7f1446a00640 1 -- 172.21.15.144:0/3327977627 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f143c009710 con 0x7f143006da20 2024-05-30T16:51:09.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f143006da20 msgr2=0x7f143006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:09.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f143006da20 0x7f143006fee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f143c009ac0 tx=0x7f143c008040 comp rx=0 tx=0).stop 2024-05-30T16:51:09.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf670 msgr2=0x7f1450146f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:09.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf670 0x7f1450146f90 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1440009890 tx=0x7f14400046c0 comp rx=0 tx=0).stop 2024-05-30T16:51:09.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 shutdown_connections 2024-05-30T16:51:09.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f143006da20 0x7f143006fee0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:09.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f145014ba40 0x7f145013bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:09.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14500cf670 0x7f1450146f90 secure :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1440009890 tx=0x7f14400046c0 comp rx=0 tx=0).stop 2024-05-30T16:51:09.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 --2- 172.21.15.144:0/3327977627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14500cf1e0 0x7f1450143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:09.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.859+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 >> 172.21.15.144:0/3327977627 conn(0x7f1450070050 msgr2=0x7f145013ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:09.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.862+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 shutdown_connections 2024-05-30T16:51:09.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:09.863+0000 7f1455800640 1 -- 172.21.15.144:0/3327977627 wait complete. 2024-05-30T16:51:09.924 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83114 2024-05-30T16:51:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.392+0000 7fb79f800640 1 Processor -- start 2024-05-30T16:51:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.393+0000 7fb79f800640 1 -- start start 2024-05-30T16:51:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.395+0000 7fb79f800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb7980b6a10 0x7fb7980ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.395+0000 7fb79f800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7980b91c0 con 0x7fb79815ea90 2024-05-30T16:51:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.395+0000 7fb79f800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7980b94a0 con 0x7fb7980d3b70 2024-05-30T16:51:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.395+0000 7fb79f800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb7980b9dd0 con 0x7fb7980b6a10 2024-05-30T16:51:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.396+0000 7fb79ce00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb79815ea90 0x7fb7980b6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50084/0 (socket says 172.21.15.144:50084) 2024-05-30T16:51:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.396+0000 7fb79ce00640 1 -- 172.21.15.144:0/264292979 learned_addr learned my addr 172.21.15.144:0/264292979 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.397+0000 7fb797e00640 1 --2- 172.21.15.144:0/264292979 >> v2:172.21.15.149:3300/0 conn(0x7fb7980b6a10 0x7fb7980ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.397+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501452489 0 0) 0x7fb7980b91c0 con 0x7fb79815ea90 2024-05-30T16:51:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.397+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb780003520 con 0x7fb79815ea90 2024-05-30T16:51:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220085988 0 0) 0x7fb7980b94a0 con 0x7fb7980d3b70 2024-05-30T16:51:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7980b91c0 con 0x7fb7980d3b70 2024-05-30T16:51:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 420778197 0 0) 0x7fb780003520 con 0x7fb79815ea90 2024-05-30T16:51:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 >> v2:172.21.15.149:3300/0 conn(0x7fb7980b6a10 msgr2=0x7fb7980ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 --2- 172.21.15.144:0/264292979 >> v2:172.21.15.149:3300/0 conn(0x7fb7980b6a10 0x7fb7980ba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 >> v1:172.21.15.149:6789/0 conn(0x7fb7980d3b70 legacy=0x7fb7980b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7980b9780 con 0x7fb79815ea90 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fb78c001670 con 0x7fb79815ea90 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 >> v1:172.21.15.144:6789/0 conn(0x7fb79815ea90 legacy=0x7fb7980b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb780003b40 0x7fb780003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb780004800 0x7fb780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7800051c0 0x7fb7800141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7800147f0 con 0x7fb7800051c0 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb7800149a0 con 0x7fb780004800 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.398+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb780014ba0 con 0x7fb780003b40 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.399+0000 7fb797e00640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb780004800 0x7fb780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.399+0000 7fb79d800640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7800051c0 0x7fb7800141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.399+0000 7fb79ce00640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb780003b40 0x7fb780003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.400+0000 7fb79d800640 1 -- 172.21.15.144:0/264292979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb780003b40 msgr2=0x7fb780003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.400+0000 7fb79d800640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb780003b40 0x7fb780003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.400+0000 7fb79d800640 1 -- 172.21.15.144:0/264292979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb780004800 msgr2=0x7fb780004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.400+0000 7fb79d800640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb780004800 0x7fb780004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.400+0000 7fb79d800640 1 -- 172.21.15.144:0/264292979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb780003520 con 0x7fb7800051c0 2024-05-30T16:51:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.400+0000 7fb797e00640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb780004800 0x7fb780004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.401+0000 7fb79d800640 1 -- 172.21.15.144:0/264292979 reap_dead start 2024-05-30T16:51:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.401+0000 7fb79d800640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7800051c0 0x7fb7800141d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb790002010 tx=0x7fb780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ade20ce6eff8467 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.402+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784009690 con 0x7fb7800051c0 2024-05-30T16:51:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.403+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb790003b70 con 0x7fb7800051c0 2024-05-30T16:51:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.403+0000 7fb797400640 1 -- 172.21.15.144:0/264292979 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790001be0 con 0x7fb7800051c0 2024-05-30T16:51:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.404+0000 7fb79f800640 1 -- 172.21.15.144:0/264292979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7800051c0 msgr2=0x7fb7800141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.404+0000 7fb79f800640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7800051c0 0x7fb7800141d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb790002010 tx=0x7fb780005830 comp rx=0 tx=0).stop 2024-05-30T16:51:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.405+0000 7fb79f800640 1 -- 172.21.15.144:0/264292979 shutdown_connections 2024-05-30T16:51:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.405+0000 7fb79f800640 1 --2- 172.21.15.144:0/264292979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7800051c0 0x7fb7800141d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.405+0000 7fb79f800640 1 -- 172.21.15.144:0/264292979 >> 172.21.15.144:0/264292979 conn(0x7fb7980627b0 msgr2=0x7fb798062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.406+0000 7fb79f800640 1 -- 172.21.15.144:0/264292979 shutdown_connections 2024-05-30T16:51:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.406+0000 7fb79f800640 1 -- 172.21.15.144:0/264292979 wait complete. 2024-05-30T16:51:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.410+0000 7fb79f800640 1 Processor -- start 2024-05-30T16:51:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.410+0000 7fb79f800640 1 -- start start 2024-05-30T16:51:10.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.412+0000 7fb79f800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800051c0 0x7fb798152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.412+0000 7fb79f800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7980cdd80 0x7fb7980ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.412+0000 7fb79f800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7980c9fb0 0x7fb7980ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.412+0000 7fb79f800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7980ba330 con 0x7fb7980c9fb0 2024-05-30T16:51:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.412+0000 7fb79f800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb79815ee70 con 0x7fb7800051c0 2024-05-30T16:51:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.412+0000 7fb79f800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb7980ba4b0 con 0x7fb7980cdd80 2024-05-30T16:51:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.413+0000 7fb79d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7980c9fb0 0x7fb7980ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.414+0000 7fb79d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7980c9fb0 0x7fb7980ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42822/0 (socket says 172.21.15.144:42822) 2024-05-30T16:51:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.414+0000 7fb79d800640 1 -- 172.21.15.144:0/466219392 learned_addr learned my addr 172.21.15.144:0/466219392 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:10.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.415+0000 7fb79d800640 1 -- 172.21.15.144:0/466219392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7980cdd80 msgr2=0x7fb7980ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:10.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.415+0000 7fb79d800640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7980cdd80 0x7fb7980ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:10.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.416+0000 7fb79ce00640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800051c0 0x7fb798152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:10.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.416+0000 7fb79d800640 1 -- 172.21.15.144:0/466219392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800051c0 msgr2=0x7fb798152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:10.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.416+0000 7fb79d800640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800051c0 0x7fb798152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:10.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.417+0000 7fb79d800640 1 -- 172.21.15.144:0/466219392 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7980cada0 con 0x7fb7980c9fb0 2024-05-30T16:51:10.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.417+0000 7fb79ce00640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800051c0 0x7fb798152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:10.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.418+0000 7fb79d800640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7980c9fb0 0x7fb7980ca440 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb79002aab0 tx=0x7fb790001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:10.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.420+0000 7fb794c00640 1 -- 172.21.15.144:0/466219392 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790006b50 con 0x7fb7980c9fb0 2024-05-30T16:51:10.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.420+0000 7fb794c00640 1 -- 172.21.15.144:0/466219392 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb790006cf0 con 0x7fb7980c9fb0 2024-05-30T16:51:10.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.420+0000 7fb794c00640 1 -- 172.21.15.144:0/466219392 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790007230 con 0x7fb7980c9fb0 2024-05-30T16:51:10.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.422+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7980cb080 con 0x7fb7980c9fb0 2024-05-30T16:51:10.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.423+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7980c88e0 con 0x7fb7980c9fb0 2024-05-30T16:51:10.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.427+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb798068b90 con 0x7fb7980c9fb0 2024-05-30T16:51:10.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.427+0000 7fb794c00640 1 -- 172.21.15.144:0/466219392 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7fb7900073d0 con 0x7fb7980c9fb0 2024-05-30T16:51:10.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.430+0000 7fb794c00640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb77806da50 0x7fb77806ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:10.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.431+0000 7fb794c00640 1 -- 172.21.15.144:0/466219392 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fb7900aa080 con 0x7fb7980c9fb0 2024-05-30T16:51:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.445+0000 7fb794c00640 1 -- 172.21.15.144:0/466219392 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb790079f40 con 0x7fb7980c9fb0 2024-05-30T16:51:10.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.452+0000 7fb79ce00640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb77806da50 0x7fb77806ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:10.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:10.499+0000 7fb79ce00640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb77806da50 0x7fb77806ff10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0017e0 tx=0x7fb78c000f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:11.000+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83114", "target": ["mon-mgr", ""]}) -- 0x7fb7980cb250 con 0x7fb77806da50 2024-05-30T16:51:12.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.054+0000 7fb794c00640 1 -- 172.21.15.144:0/466219392 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb7980cb250 con 0x7fb77806da50 2024-05-30T16:51:12.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb77806da50 msgr2=0x7fb77806ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:12.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb77806da50 0x7fb77806ff10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0017e0 tx=0x7fb78c000f30 comp rx=0 tx=0).stop 2024-05-30T16:51:12.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7980c9fb0 msgr2=0x7fb7980ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:12.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7980c9fb0 0x7fb7980ca440 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb79002aab0 tx=0x7fb790001630 comp rx=0 tx=0).stop 2024-05-30T16:51:12.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 shutdown_connections 2024-05-30T16:51:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb77806da50 0x7fb77806ff10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7980c9fb0 0x7fb7980ca440 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7980cdd80 0x7fb7980ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 --2- 172.21.15.144:0/466219392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800051c0 0x7fb798152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 >> 172.21.15.144:0/466219392 conn(0x7fb7980627b0 msgr2=0x7fb7980b8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 shutdown_connections 2024-05-30T16:51:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.058+0000 7fb79f800640 1 -- 172.21.15.144:0/466219392 wait complete. 2024-05-30T16:51:12.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83115 2024-05-30T16:51:12.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.505+0000 7fb2b6000640 1 Processor -- start 2024-05-30T16:51:12.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.505+0000 7fb2b6000640 1 -- start start 2024-05-30T16:51:12.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.507+0000 7fb2b6000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2b014c630 0x7fb2b00ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:12.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.507+0000 7fb2b6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb2b0072920 0x7fb2b00b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:12.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.507+0000 7fb2b6000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b006fbf0 con 0x7fb2b00cea10 2024-05-30T16:51:12.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.508+0000 7fb2b6000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b00cee30 con 0x7fb2b0072920 2024-05-30T16:51:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.508+0000 7fb2b6000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b00cf050 con 0x7fb2b014c630 2024-05-30T16:51:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.508+0000 7fb2af400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2b014c630 0x7fb2b00ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.509+0000 7fb2af400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2b014c630 0x7fb2b00ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36728/0 (socket says 172.21.15.144:36728) 2024-05-30T16:51:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.509+0000 7fb2af400640 1 -- 172.21.15.144:0/3970670247 learned_addr learned my addr 172.21.15.144:0/3970670247 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.509+0000 7fb2afe00640 1 --2- 172.21.15.144:0/3970670247 >> v2:172.21.15.144:3300/0 conn(0x7fb2b0072920 0x7fb2b00b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.510+0000 7fb2af400640 1 -- 172.21.15.144:0/3970670247 >> v2:172.21.15.144:3300/0 conn(0x7fb2b0072920 msgr2=0x7fb2b00b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.510+0000 7fb2af400640 1 --2- 172.21.15.144:0/3970670247 >> v2:172.21.15.144:3300/0 conn(0x7fb2b0072920 0x7fb2b00b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.510+0000 7fb2af400640 1 -- 172.21.15.144:0/3970670247 >> v1:172.21.15.149:6789/0 conn(0x7fb2b00cea10 legacy=0x7fb2b0072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:12.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.510+0000 7fb2af400640 1 -- 172.21.15.144:0/3970670247 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b00cf330 con 0x7fb2b014c630 2024-05-30T16:51:12.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.510+0000 7fb2afe00640 1 --2- 172.21.15.144:0/3970670247 >> v2:172.21.15.144:3300/0 conn(0x7fb2b0072920 0x7fb2b00b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.512+0000 7fb2af400640 1 --2- 172.21.15.144:0/3970670247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b014c630 0x7fb2b00ce4d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2b006fdc0 tx=0x7fb2a002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f800c69615e576e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.514+0000 7fb2ae000640 1 -- 172.21.15.144:0/3970670247 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0037070 con 0x7fb2b014c630 2024-05-30T16:51:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.515+0000 7fb2ae000640 1 -- 172.21.15.144:0/3970670247 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a0032440 con 0x7fb2b014c630 2024-05-30T16:51:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.515+0000 7fb2ae000640 1 -- 172.21.15.144:0/3970670247 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0032810 con 0x7fb2b014c630 2024-05-30T16:51:12.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.516+0000 7fb2b6000640 1 -- 172.21.15.144:0/3970670247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b014c630 msgr2=0x7fb2b00ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:12.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.516+0000 7fb2b6000640 1 --2- 172.21.15.144:0/3970670247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b014c630 0x7fb2b00ce4d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2b006fdc0 tx=0x7fb2a002a270 comp rx=0 tx=0).stop 2024-05-30T16:51:12.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.517+0000 7fb2b6000640 1 -- 172.21.15.144:0/3970670247 shutdown_connections 2024-05-30T16:51:12.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.517+0000 7fb2b6000640 1 --2- 172.21.15.144:0/3970670247 >> v2:172.21.15.144:3300/0 conn(0x7fb2b0072920 0x7fb2b00b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:12.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.517+0000 7fb2b6000640 1 --2- 172.21.15.144:0/3970670247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b014c630 0x7fb2b00ce4d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:12.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.517+0000 7fb2b6000640 1 -- 172.21.15.144:0/3970670247 >> 172.21.15.144:0/3970670247 conn(0x7fb2b006bd00 msgr2=0x7fb2b006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:12.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.518+0000 7fb2b6000640 1 -- 172.21.15.144:0/3970670247 shutdown_connections 2024-05-30T16:51:12.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.518+0000 7fb2b6000640 1 -- 172.21.15.144:0/3970670247 wait complete. 2024-05-30T16:51:12.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.525+0000 7fb2b6000640 1 Processor -- start 2024-05-30T16:51:12.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.526+0000 7fb2b6000640 1 -- start start 2024-05-30T16:51:12.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.527+0000 7fb2b6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2b0072920 0x7fb2b013ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:12.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.528+0000 7fb2b6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b00cea10 0x7fb2b013b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:12.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.528+0000 7fb2b6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2b014c630 0x7fb2b00ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:12.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.528+0000 7fb2b6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b00b3c20 con 0x7fb2b0072920 2024-05-30T16:51:12.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.528+0000 7fb2b6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b00cf8f0 con 0x7fb2b00cea10 2024-05-30T16:51:12.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.528+0000 7fb2b6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b014ca10 con 0x7fb2b014c630 2024-05-30T16:51:12.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.529+0000 7fb2afe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2b014c630 0x7fb2b00ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:12.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.529+0000 7fb2afe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2b014c630 0x7fb2b00ab220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:35786/0 (socket says 172.21.15.144:35786) 2024-05-30T16:51:12.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.530+0000 7fb2afe00640 1 -- 172.21.15.144:0/2630628848 learned_addr learned my addr 172.21.15.144:0/2630628848 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:12.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.530+0000 7fb2af400640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2b0072920 0x7fb2b013ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:12.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.531+0000 7fb2aea00640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b00cea10 0x7fb2b013b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:12.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.531+0000 7fb2af400640 1 -- 172.21.15.144:0/2630628848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2b014c630 msgr2=0x7fb2b00ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:12.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.531+0000 7fb2af400640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2b014c630 0x7fb2b00ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:12.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.531+0000 7fb2af400640 1 -- 172.21.15.144:0/2630628848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b00cea10 msgr2=0x7fb2b013b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.531+0000 7fb2af400640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b00cea10 0x7fb2b013b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.531+0000 7fb2af400640 1 -- 172.21.15.144:0/2630628848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b00abf10 con 0x7fb2b0072920 2024-05-30T16:51:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.531+0000 7fb2aea00640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b00cea10 0x7fb2b013b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.532+0000 7fb2af400640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2b0072920 0x7fb2b013ab60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0031000 tx=0x7fb2a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.533+0000 7fb2a7400640 1 -- 172.21.15.144:0/2630628848 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0041030 con 0x7fb2b0072920 2024-05-30T16:51:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.533+0000 7fb2a7400640 1 -- 172.21.15.144:0/2630628848 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a0030500 con 0x7fb2b0072920 2024-05-30T16:51:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.533+0000 7fb2a7400640 1 -- 172.21.15.144:0/2630628848 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0037040 con 0x7fb2b0072920 2024-05-30T16:51:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.533+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b0135660 con 0x7fb2b0072920 2024-05-30T16:51:12.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.533+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b0135c20 con 0x7fb2b0072920 2024-05-30T16:51:12.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.536+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b0068b90 con 0x7fb2b0072920 2024-05-30T16:51:12.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.537+0000 7fb2a7400640 1 -- 172.21.15.144:0/2630628848 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7fb2a0044070 con 0x7fb2b0072920 2024-05-30T16:51:12.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.538+0000 7fb2a7400640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb29006da20 0x7fb29006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:12.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.538+0000 7fb2a7400640 1 -- 172.21.15.144:0/2630628848 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fb2a00aaf10 con 0x7fb2b0072920 2024-05-30T16:51:12.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.545+0000 7fb2a7400640 1 -- 172.21.15.144:0/2630628848 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2a007aa90 con 0x7fb2b0072920 2024-05-30T16:51:12.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.553+0000 7fb2aea00640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb29006da20 0x7fb29006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:12.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:12.595+0000 7fb2aea00640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb29006da20 0x7fb29006fee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb2b01668b0 tx=0x7fb29c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:13.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:13.061+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83115", "target": ["mon-mgr", ""]}) -- 0x7fb2b0075f70 con 0x7fb29006da20 2024-05-30T16:51:14.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.578+0000 7fb2a7400640 1 -- 172.21.15.144:0/2630628848 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb29c0067d0 con 0x7fb29006da20 2024-05-30T16:51:14.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.583+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb29006da20 msgr2=0x7fb29006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:14.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.583+0000 7fb2b6000640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb29006da20 0x7fb29006fee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb2b01668b0 tx=0x7fb29c009040 comp rx=0 tx=0).stop 2024-05-30T16:51:14.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.583+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2b0072920 msgr2=0x7fb2b013ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:14.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.583+0000 7fb2b6000640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2b0072920 0x7fb2b013ab60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0031000 tx=0x7fb2a00046c0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.584+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 shutdown_connections 2024-05-30T16:51:14.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.584+0000 7fb2b6000640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb29006da20 0x7fb29006fee0 secure :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb2b01668b0 tx=0x7fb29c009040 comp rx=0 tx=0).stop 2024-05-30T16:51:14.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.584+0000 7fb2b6000640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2b014c630 0x7fb2b00ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.584+0000 7fb2b6000640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2b00cea10 0x7fb2b013b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.584+0000 7fb2b6000640 1 --2- 172.21.15.144:0/2630628848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2b0072920 0x7fb2b013ab60 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:14.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.584+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 >> 172.21.15.144:0/2630628848 conn(0x7fb2b006bd00 msgr2=0x7fb2b00b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:14.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.584+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 shutdown_connections 2024-05-30T16:51:14.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:14.585+0000 7fb2b6000640 1 -- 172.21.15.144:0/2630628848 wait complete. 2024-05-30T16:51:14.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83116 2024-05-30T16:51:15.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.153+0000 7f5db1800640 1 Processor -- start 2024-05-30T16:51:15.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.153+0000 7f5db1800640 1 -- start start 2024-05-30T16:51:15.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.157+0000 7f5db1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dac0b6a10 0x7f5dac0ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.158+0000 7f5da2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5dac15ea90 0x7f5dac0b6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56216/0 (socket says 172.21.15.144:56216) 2024-05-30T16:51:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.158+0000 7f5db1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac0d3b70 0x7f5dac0b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.159+0000 7f5db1800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dac0b91c0 con 0x7f5dac15ea90 2024-05-30T16:51:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.159+0000 7f5db1800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5dac0b9dd0 con 0x7f5dac0b6a10 2024-05-30T16:51:15.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.159+0000 7f5db1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5dac0b8f00 con 0x7f5dac0d3b70 2024-05-30T16:51:15.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.159+0000 7f5da2a00640 1 -- 172.21.15.144:0/3992116696 learned_addr learned my addr 172.21.15.144:0/3992116696 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:15.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.159+0000 7f5daaa00640 1 --2- 172.21.15.144:0/3992116696 >> v2:172.21.15.144:3300/0 conn(0x7f5dac0b6a10 0x7f5dac0ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:15.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.160+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664603838 0 0) 0x7f5dac0b91c0 con 0x7f5dac15ea90 2024-05-30T16:51:15.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.161+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d90003520 con 0x7f5dac15ea90 2024-05-30T16:51:15.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.161+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1103392315 0 0) 0x7f5d90003520 con 0x7f5dac15ea90 2024-05-30T16:51:15.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.161+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac0d3b70 msgr2=0x7f5dac0b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.161+0000 7f5daa000640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac0d3b70 0x7f5dac0b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.161+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 >> v2:172.21.15.144:3300/0 conn(0x7f5dac0b6a10 msgr2=0x7f5dac0ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.161+0000 7f5daa000640 1 --2- 172.21.15.144:0/3992116696 >> v2:172.21.15.144:3300/0 conn(0x7f5dac0b6a10 0x7f5dac0ba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.161+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac0b94a0 con 0x7f5dac15ea90 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.161+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f5d9c001670 con 0x7f5dac15ea90 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.161+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 >> v1:172.21.15.144:6789/0 conn(0x7f5dac15ea90 legacy=0x7f5dac0b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.162+0000 7f5daa000640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d900039b0 0x7f5d90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.162+0000 7f5daa000640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d90004800 0x7f5d90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.162+0000 7f5daa000640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d900051c0 0x7f5d900141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.162+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac0b8f00 con 0x7f5d90004800 2024-05-30T16:51:15.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.162+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900147c0 con 0x7f5d900039b0 2024-05-30T16:51:15.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.162+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d900149c0 con 0x7f5d900051c0 2024-05-30T16:51:15.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.167+0000 7f5da2a00640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d900039b0 0x7f5d90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:15.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.168+0000 7f5dab400640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d900051c0 0x7f5d900141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:15.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.168+0000 7f5daaa00640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d90004800 0x7f5d90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:15.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.169+0000 7f5dab400640 1 -- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d900039b0 msgr2=0x7f5d90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:15.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.172+0000 7f5dab400640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d900039b0 0x7f5d90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:15.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.172+0000 7f5dab400640 1 -- 172.21.15.144:0/3992116696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d90004800 msgr2=0x7f5d90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:15.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.172+0000 7f5dab400640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d90004800 0x7f5d90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:15.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.172+0000 7f5dab400640 1 -- 172.21.15.144:0/3992116696 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac0b94a0 con 0x7f5d900051c0 2024-05-30T16:51:15.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.173+0000 7f5da2a00640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d900039b0 0x7f5d90003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:15.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.173+0000 7f5daaa00640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d90004800 0x7f5d90004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.183+0000 7f5dab400640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d900051c0 0x7f5d900141d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0d3f50 tx=0x7f5d90005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95095a125dcde544 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:15.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.186+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4009a10 con 0x7f5d900051c0 2024-05-30T16:51:15.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.186+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da4036070 con 0x7f5d900051c0 2024-05-30T16:51:15.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.186+0000 7f5daa000640 1 -- 172.21.15.144:0/3992116696 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4031900 con 0x7f5d900051c0 2024-05-30T16:51:15.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.191+0000 7f5db1800640 1 -- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d900051c0 msgr2=0x7f5d900141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:15.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.191+0000 7f5db1800640 1 --2- 172.21.15.144:0/3992116696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d900051c0 0x7f5d900141d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0d3f50 tx=0x7f5d90005830 comp rx=0 tx=0).stop 2024-05-30T16:51:15.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.191+0000 7f5dab400640 1 -- 172.21.15.144:0/3992116696 reap_dead start 2024-05-30T16:51:15.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.191+0000 7f5db1800640 1 -- 172.21.15.144:0/3992116696 shutdown_connections 2024-05-30T16:51:15.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.191+0000 7f5db1800640 1 -- 172.21.15.144:0/3992116696 >> 172.21.15.144:0/3992116696 conn(0x7f5dac0627b0 msgr2=0x7f5dac062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:15.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.191+0000 7f5db1800640 1 -- 172.21.15.144:0/3992116696 shutdown_connections 2024-05-30T16:51:15.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.191+0000 7f5db1800640 1 -- 172.21.15.144:0/3992116696 wait complete. 2024-05-30T16:51:15.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.197+0000 7f5db1800640 1 Processor -- start 2024-05-30T16:51:15.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.197+0000 7f5db1800640 1 -- start start 2024-05-30T16:51:15.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.199+0000 7f5db1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900051c0 0x7f5dac0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:15.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.201+0000 7f5db1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac158870 0x7f5dac0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:15.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.201+0000 7f5db1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac1479f0 0x7f5dac147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:15.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.201+0000 7f5db1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac15ee70 con 0x7f5d900051c0 2024-05-30T16:51:15.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.201+0000 7f5db1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac0b9a60 con 0x7f5dac158870 2024-05-30T16:51:15.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.201+0000 7f5db1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5dac0b79b0 con 0x7f5dac1479f0 2024-05-30T16:51:15.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.202+0000 7f5da2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900051c0 0x7f5dac0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:15.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.202+0000 7f5daaa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac158870 0x7f5dac0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:15.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.202+0000 7f5daaa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac158870 0x7f5dac0b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:32924/0 (socket says 172.21.15.144:32924) 2024-05-30T16:51:15.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.202+0000 7f5daaa00640 1 -- 172.21.15.144:0/2692917979 learned_addr learned my addr 172.21.15.144:0/2692917979 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:15.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.203+0000 7f5dab400640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac1479f0 0x7f5dac147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:15.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.208+0000 7f5da2a00640 1 -- 172.21.15.144:0/2692917979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac1479f0 msgr2=0x7f5dac147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:15.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.208+0000 7f5da2a00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac1479f0 0x7f5dac147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:15.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.208+0000 7f5da2a00640 1 -- 172.21.15.144:0/2692917979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac158870 msgr2=0x7f5dac0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:15.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.208+0000 7f5da2a00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac158870 0x7f5dac0b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:15.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.208+0000 7f5da2a00640 1 -- 172.21.15.144:0/2692917979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac161b70 con 0x7f5d900051c0 2024-05-30T16:51:15.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.209+0000 7f5da2a00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900051c0 0x7f5dac0b4470 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00db30 tx=0x7f5d9c00b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:15.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.211+0000 7f5da3400640 1 -- 172.21.15.144:0/2692917979 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c019070 con 0x7f5d900051c0 2024-05-30T16:51:15.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.211+0000 7f5db1800640 1 -- 172.21.15.144:0/2692917979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dac161e50 con 0x7f5d900051c0 2024-05-30T16:51:15.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.212+0000 7f5db1800640 1 -- 172.21.15.144:0/2692917979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac145b60 con 0x7f5d900051c0 2024-05-30T16:51:15.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.212+0000 7f5da3400640 1 -- 172.21.15.144:0/2692917979 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c0072d0 con 0x7f5d900051c0 2024-05-30T16:51:15.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.212+0000 7f5da3400640 1 -- 172.21.15.144:0/2692917979 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00b8a0 con 0x7f5d900051c0 2024-05-30T16:51:15.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.223+0000 7f5da3400640 1 -- 172.21.15.144:0/2692917979 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f5d9c01c070 con 0x7f5d900051c0 2024-05-30T16:51:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.225+0000 7f5da3400640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806daa0 0x7f5d8806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.225+0000 7f5da3400640 1 -- 172.21.15.144:0/2692917979 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f5d9c08a5a0 con 0x7f5d900051c0 2024-05-30T16:51:15.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.229+0000 7f5d9be00640 1 -- 172.21.15.144:0/2692917979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dac0cb610 con 0x7f5d900051c0 2024-05-30T16:51:15.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.258+0000 7f5da3400640 1 -- 172.21.15.144:0/2692917979 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5dac0cb610 con 0x7f5d900051c0 2024-05-30T16:51:15.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.265+0000 7f5daaa00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806daa0 0x7f5d8806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:15.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.366+0000 7f5daaa00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806daa0 0x7f5d8806ff60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5dac072cf0 tx=0x7f5d94009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:15.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:15.875+0000 7f5d9be00640 1 -- 172.21.15.144:0/2692917979 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83116", "target": ["mon-mgr", ""]}) -- 0x7f5dac075f70 con 0x7f5d8806daa0 2024-05-30T16:51:17.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.064+0000 7f5da3400640 1 -- 172.21.15.144:0/2692917979 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5d94015420 con 0x7f5d8806daa0 2024-05-30T16:51:17.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.077+0000 7f5d9be00640 1 -- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806daa0 msgr2=0x7f5d8806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:17.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.077+0000 7f5d9be00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806daa0 0x7f5d8806ff60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5dac072cf0 tx=0x7f5d94009190 comp rx=0 tx=0).stop 2024-05-30T16:51:17.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.077+0000 7f5d9be00640 1 -- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900051c0 msgr2=0x7f5dac0b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:17.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.077+0000 7f5d9be00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900051c0 0x7f5dac0b4470 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00db30 tx=0x7f5d9c00b0d0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.078+0000 7f5d9be00640 1 -- 172.21.15.144:0/2692917979 shutdown_connections 2024-05-30T16:51:17.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.078+0000 7f5d9be00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5d8806daa0 0x7f5d8806ff60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.078+0000 7f5d9be00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dac1479f0 0x7f5dac147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.078+0000 7f5d9be00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dac158870 0x7f5dac0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.078+0000 7f5d9be00640 1 --2- 172.21.15.144:0/2692917979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d900051c0 0x7f5dac0b4470 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.078+0000 7f5d9be00640 1 -- 172.21.15.144:0/2692917979 >> 172.21.15.144:0/2692917979 conn(0x7f5dac0627b0 msgr2=0x7f5dac0cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:17.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.078+0000 7f5d9be00640 1 -- 172.21.15.144:0/2692917979 shutdown_connections 2024-05-30T16:51:17.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.078+0000 7f5d9be00640 1 -- 172.21.15.144:0/2692917979 wait complete. 2024-05-30T16:51:17.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83117 2024-05-30T16:51:17.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.570+0000 7f3d9a200640 1 Processor -- start 2024-05-30T16:51:17.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.570+0000 7f3d9a200640 1 -- start start 2024-05-30T16:51:17.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.573+0000 7f3d9a200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3d9406e6d0 0x7f3d940b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:17.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.573+0000 7f3d9a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d940d0020 con 0x7f3d9414ba40 2024-05-30T16:51:17.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.573+0000 7f3d9a200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d940ce700 con 0x7f3d940cf1e0 2024-05-30T16:51:17.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.573+0000 7f3d9a200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3d940ce4d0 con 0x7f3d9406e6d0 2024-05-30T16:51:17.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.574+0000 7f3d93400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3d9414ba40 0x7f3d940727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56218/0 (socket says 172.21.15.144:56218) 2024-05-30T16:51:17.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.574+0000 7f3d93400640 1 -- 172.21.15.144:0/1700511470 learned_addr learned my addr 172.21.15.144:0/1700511470 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.575+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 304372021 0 0) 0x7f3d940d0020 con 0x7f3d9414ba40 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.576+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d78003520 con 0x7f3d9414ba40 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.576+0000 7f3d93e00640 1 --2- 172.21.15.144:0/1700511470 >> v2:172.21.15.149:3300/0 conn(0x7f3d9406e6d0 0x7f3d940b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2712766589 0 0) 0x7f3d78003520 con 0x7f3d9414ba40 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 >> v2:172.21.15.149:3300/0 conn(0x7f3d9406e6d0 msgr2=0x7f3d940b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 --2- 172.21.15.144:0/1700511470 >> v2:172.21.15.149:3300/0 conn(0x7f3d9406e6d0 0x7f3d940b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 >> v1:172.21.15.149:6789/0 conn(0x7f3d940cf1e0 legacy=0x7f3d9406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d940ce9e0 con 0x7f3d9414ba40 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f3d84001670 con 0x7f3d9414ba40 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 >> v1:172.21.15.144:6789/0 conn(0x7f3d9414ba40 legacy=0x7f3d940727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:17.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 --2- 172.21.15.144:0/1700511470 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d780039b0 0x7f3d78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:17.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 --2- 172.21.15.144:0/1700511470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d78004800 0x7f3d78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:17.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 --2- 172.21.15.144:0/1700511470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d780052e0 0x7f3d7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:17.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7800c180 con 0x7f3d780052e0 2024-05-30T16:51:17.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7800c330 con 0x7f3d78004800 2024-05-30T16:51:17.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.577+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7800c530 con 0x7f3d780039b0 2024-05-30T16:51:17.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.578+0000 7f3d93e00640 1 --2- 172.21.15.144:0/1700511470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d780052e0 0x7f3d7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.579+0000 7f3d93e00640 1 -- 172.21.15.144:0/1700511470 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d780039b0 msgr2=0x7f3d78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.579+0000 7f3d93e00640 1 --2- 172.21.15.144:0/1700511470 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d780039b0 0x7f3d78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.579+0000 7f3d93e00640 1 -- 172.21.15.144:0/1700511470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d78004800 msgr2=0x7f3d78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.579+0000 7f3d93e00640 1 --2- 172.21.15.144:0/1700511470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d78004800 0x7f3d78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.579+0000 7f3d93e00640 1 -- 172.21.15.144:0/1700511470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d940ce9e0 con 0x7f3d780052e0 2024-05-30T16:51:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.582+0000 7f3d93e00640 1 -- 172.21.15.144:0/1700511470 reap_dead start 2024-05-30T16:51:17.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.584+0000 7f3d93e00640 1 --2- 172.21.15.144:0/1700511470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d780052e0 0x7f3d7800b9c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c007330 tx=0x7f3d78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa73b8979d05d6e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:17.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.585+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c009be0 con 0x7f3d780052e0 2024-05-30T16:51:17.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.585+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8c003b90 con 0x7f3d780052e0 2024-05-30T16:51:17.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.585+0000 7f3d92000640 1 -- 172.21.15.144:0/1700511470 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c004020 con 0x7f3d780052e0 2024-05-30T16:51:17.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.587+0000 7f3d9a200640 1 -- 172.21.15.144:0/1700511470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d780052e0 msgr2=0x7f3d7800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:17.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.587+0000 7f3d9a200640 1 --2- 172.21.15.144:0/1700511470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d780052e0 0x7f3d7800b9c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c007330 tx=0x7f3d78005830 comp rx=0 tx=0).stop 2024-05-30T16:51:17.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.587+0000 7f3d9a200640 1 -- 172.21.15.144:0/1700511470 shutdown_connections 2024-05-30T16:51:17.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.587+0000 7f3d9a200640 1 --2- 172.21.15.144:0/1700511470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d780052e0 0x7f3d7800b9c0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.587+0000 7f3d9a200640 1 -- 172.21.15.144:0/1700511470 >> 172.21.15.144:0/1700511470 conn(0x7f3d94070050 msgr2=0x7f3d9406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:17.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.588+0000 7f3d9a200640 1 -- 172.21.15.144:0/1700511470 shutdown_connections 2024-05-30T16:51:17.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.588+0000 7f3d9a200640 1 -- 172.21.15.144:0/1700511470 wait complete. 2024-05-30T16:51:17.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.592+0000 7f3d9a200640 1 Processor -- start 2024-05-30T16:51:17.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.593+0000 7f3d9a200640 1 -- start start 2024-05-30T16:51:17.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.594+0000 7f3d9a200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d780052e0 0x7f3d940a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:17.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.594+0000 7f3d9a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d941662a0 0x7f3d940ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:17.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.594+0000 7f3d9a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d940ad650 0x7f3d941f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:17.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.594+0000 7f3d9a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9414c8b0 con 0x7f3d941662a0 2024-05-30T16:51:17.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.594+0000 7f3d9a200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3d940d0300 con 0x7f3d780052e0 2024-05-30T16:51:17.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.594+0000 7f3d9a200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3d940cfcb0 con 0x7f3d940ad650 2024-05-30T16:51:17.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.596+0000 7f3d92a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d941662a0 0x7f3d940ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:17.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.596+0000 7f3d93400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d780052e0 0x7f3d940a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:17.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.596+0000 7f3d93400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d780052e0 0x7f3d940a9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:32962/0 (socket says 172.21.15.144:32962) 2024-05-30T16:51:17.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.596+0000 7f3d93400640 1 -- 172.21.15.144:0/3437832613 learned_addr learned my addr 172.21.15.144:0/3437832613 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:17.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.597+0000 7f3d93e00640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d940ad650 0x7f3d941f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:17.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.599+0000 7f3d92a00640 1 -- 172.21.15.144:0/3437832613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d940ad650 msgr2=0x7f3d941f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:17.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.599+0000 7f3d92a00640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d940ad650 0x7f3d941f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.599+0000 7f3d92a00640 1 -- 172.21.15.144:0/3437832613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d780052e0 msgr2=0x7f3d940a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:17.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.599+0000 7f3d92a00640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d780052e0 0x7f3d940a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:17.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.599+0000 7f3d92a00640 1 -- 172.21.15.144:0/3437832613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d940aa7a0 con 0x7f3d941662a0 2024-05-30T16:51:17.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.599+0000 7f3d92a00640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d941662a0 0x7f3d940ad110 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c3c0 tx=0x7f3d8000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:17.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.600+0000 7f3d8b400640 1 -- 172.21.15.144:0/3437832613 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80017070 con 0x7f3d941662a0 2024-05-30T16:51:17.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.600+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d940aaa80 con 0x7f3d941662a0 2024-05-30T16:51:17.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.600+0000 7f3d8b400640 1 -- 172.21.15.144:0/3437832613 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d800052f0 con 0x7f3d941662a0 2024-05-30T16:51:17.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.600+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d940ab040 con 0x7f3d941662a0 2024-05-30T16:51:17.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.600+0000 7f3d8b400640 1 -- 172.21.15.144:0/3437832613 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80003830 con 0x7f3d941662a0 2024-05-30T16:51:17.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.602+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6c005290 con 0x7f3d941662a0 2024-05-30T16:51:17.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.610+0000 7f3d8b400640 1 -- 172.21.15.144:0/3437832613 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f3d8001a070 con 0x7f3d941662a0 2024-05-30T16:51:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.613+0000 7f3d8b400640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3d7406da00 0x7f3d7406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.613+0000 7f3d8b400640 1 -- 172.21.15.144:0/3437832613 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f3d80089ec0 con 0x7f3d941662a0 2024-05-30T16:51:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.615+0000 7f3d8b400640 1 -- 172.21.15.144:0/3437832613 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d80021080 con 0x7f3d941662a0 2024-05-30T16:51:17.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.630+0000 7f3d93400640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3d7406da00 0x7f3d7406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:17.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:17.708+0000 7f3d93400640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3d7406da00 0x7f3d7406fec0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001050 tx=0x7f3d84001b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:18.141 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:51:18.151 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:51:18.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.218+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83117", "target": ["mon-mgr", ""]}) -- 0x7f3d6c000c80 con 0x7f3d7406da00 2024-05-30T16:51:18.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.864+0000 7f3d8b400640 1 -- 172.21.15.144:0/3437832613 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3d6c000c80 con 0x7f3d7406da00 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3d7406da00 msgr2=0x7f3d7406fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3d7406da00 0x7f3d7406fec0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001050 tx=0x7f3d84001b20 comp rx=0 tx=0).stop 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d941662a0 msgr2=0x7f3d940ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d941662a0 0x7f3d940ad110 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c3c0 tx=0x7f3d8000c880 comp rx=0 tx=0).stop 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 shutdown_connections 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3d7406da00 0x7f3d7406fec0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d940ad650 0x7f3d941f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d941662a0 0x7f3d940ad110 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 --2- 172.21.15.144:0/3437832613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d780052e0 0x7f3d940a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 >> 172.21.15.144:0/3437832613 conn(0x7f3d94070050 msgr2=0x7f3d94074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:18.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 shutdown_connections 2024-05-30T16:51:18.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:18.867+0000 7f3d9a200640 1 -- 172.21.15.144:0/3437832613 wait complete. 2024-05-30T16:51:18.893 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83118 2024-05-30T16:51:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.238+0000 7f591e400640 1 Processor -- start 2024-05-30T16:51:19.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.239+0000 7f591e400640 1 -- start start 2024-05-30T16:51:19.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.246+0000 7f591e400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f591815d470 0x7f5918163340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.249+0000 7f591e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b5b90 0x7f59180ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.249+0000 7f591e400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59180b40a0 con 0x7f59180b3a10 2024-05-30T16:51:19.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.250+0000 7f5917e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b5b90 0x7f59180ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.250+0000 7f5917e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b5b90 0x7f59180ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:36374/0 (socket says 172.21.15.144:36374) 2024-05-30T16:51:19.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.250+0000 7f5917e00640 1 -- 172.21.15.144:0/3201568161 learned_addr learned my addr 172.21.15.144:0/3201568161 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:19.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.250+0000 7f591e400640 1 -- 172.21.15.144:0/3201568161 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f591815d850 con 0x7f591815d470 2024-05-30T16:51:19.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.251+0000 7f591e400640 1 -- 172.21.15.144:0/3201568161 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f59180b4380 con 0x7f59180b5b90 2024-05-30T16:51:19.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.251+0000 7f5917400640 1 --2- 172.21.15.144:0/3201568161 >> v2:172.21.15.144:3300/0 conn(0x7f591815d470 0x7f5918163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.253+0000 7f5916a00640 1 -- 172.21.15.144:0/3201568161 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475222369 0 0) 0x7f59180b40a0 con 0x7f59180b3a10 2024-05-30T16:51:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.253+0000 7f5916a00640 1 -- 172.21.15.144:0/3201568161 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58fc003520 con 0x7f59180b3a10 2024-05-30T16:51:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.254+0000 7f5917e00640 1 -- 172.21.15.144:0/3201568161 >> v2:172.21.15.144:3300/0 conn(0x7f591815d470 msgr2=0x7f5918163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.254+0000 7f5917e00640 1 --2- 172.21.15.144:0/3201568161 >> v2:172.21.15.144:3300/0 conn(0x7f591815d470 0x7f5918163340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.254+0000 7f5917e00640 1 -- 172.21.15.144:0/3201568161 >> v1:172.21.15.149:6789/0 conn(0x7f59180b3a10 legacy=0x7f59180b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.254+0000 7f5917e00640 1 -- 172.21.15.144:0/3201568161 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59180b4660 con 0x7f59180b5b90 2024-05-30T16:51:19.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.256+0000 7f5917e00640 1 --2- 172.21.15.144:0/3201568161 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b5b90 0x7f59180ce930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5910009e50 tx=0x7f591002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94c18ad509ff84b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:19.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.256+0000 7f5916a00640 1 -- 172.21.15.144:0/3201568161 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910036070 con 0x7f59180b5b90 2024-05-30T16:51:19.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.256+0000 7f5916a00640 1 -- 172.21.15.144:0/3201568161 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5910031600 con 0x7f59180b5b90 2024-05-30T16:51:19.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.256+0000 7f5916a00640 1 -- 172.21.15.144:0/3201568161 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910036070 con 0x7f59180b5b90 2024-05-30T16:51:19.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.257+0000 7f591e400640 1 -- 172.21.15.144:0/3201568161 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b5b90 msgr2=0x7f59180ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.257+0000 7f591e400640 1 --2- 172.21.15.144:0/3201568161 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b5b90 0x7f59180ce930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5910009e50 tx=0x7f591002a6d0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.258+0000 7f591e400640 1 -- 172.21.15.144:0/3201568161 shutdown_connections 2024-05-30T16:51:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.258+0000 7f591e400640 1 --2- 172.21.15.144:0/3201568161 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b5b90 0x7f59180ce930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.258+0000 7f591e400640 1 --2- 172.21.15.144:0/3201568161 >> v2:172.21.15.144:3300/0 conn(0x7f591815d470 0x7f5918163340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.258+0000 7f591e400640 1 -- 172.21.15.144:0/3201568161 >> 172.21.15.144:0/3201568161 conn(0x7f591806b8e0 msgr2=0x7f591806bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:19.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.261+0000 7f591e400640 1 -- 172.21.15.144:0/3201568161 shutdown_connections 2024-05-30T16:51:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.261+0000 7f591e400640 1 -- 172.21.15.144:0/3201568161 wait complete. 2024-05-30T16:51:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.266+0000 7f591e400640 1 Processor -- start 2024-05-30T16:51:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.266+0000 7f591e400640 1 -- start start 2024-05-30T16:51:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.267+0000 7f591e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b3a10 0x7f591814bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.267+0000 7f591e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180b5b90 0x7f5918158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.267+0000 7f591e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591815d470 0x7f5918158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.267+0000 7f591e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59180b5140 con 0x7f59180b5b90 2024-05-30T16:51:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.267+0000 7f591e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f59180b4c20 con 0x7f591815d470 2024-05-30T16:51:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.267+0000 7f591e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f591814c130 con 0x7f59180b3a10 2024-05-30T16:51:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.268+0000 7f5917e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591815d470 0x7f5918158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.268+0000 7f5917e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591815d470 0x7f5918158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:32964/0 (socket says 172.21.15.144:32964) 2024-05-30T16:51:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.268+0000 7f5917e00640 1 -- 172.21.15.144:0/3194779603 learned_addr learned my addr 172.21.15.144:0/3194779603 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:19.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.269+0000 7f590fe00640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180b5b90 0x7f5918158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.270+0000 7f5917e00640 1 -- 172.21.15.144:0/3194779603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b3a10 msgr2=0x7f591814bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.270+0000 7f5917e00640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b3a10 0x7f591814bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.270+0000 7f5917e00640 1 -- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180b5b90 msgr2=0x7f5918158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.270+0000 7f5917e00640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180b5b90 0x7f5918158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.270+0000 7f5917e00640 1 -- 172.21.15.144:0/3194779603 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591815bcd0 con 0x7f591815d470 2024-05-30T16:51:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.272+0000 7f5917e00640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591815d470 0x7f5918158ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5910009f70 tx=0x7f5910004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:19.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.274+0000 7f590f400640 1 -- 172.21.15.144:0/3194779603 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591003f030 con 0x7f591815d470 2024-05-30T16:51:19.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.274+0000 7f590f400640 1 -- 172.21.15.144:0/3194779603 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5910037040 con 0x7f591815d470 2024-05-30T16:51:19.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.274+0000 7f590f400640 1 -- 172.21.15.144:0/3194779603 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910036070 con 0x7f591815d470 2024-05-30T16:51:19.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.276+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591815bfb0 con 0x7f591815d470 2024-05-30T16:51:19.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.277+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591815c570 con 0x7f591815d470 2024-05-30T16:51:19.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.284+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5918068b90 con 0x7f591815d470 2024-05-30T16:51:19.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.284+0000 7f590f400640 1 -- 172.21.15.144:0/3194779603 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f5910042070 con 0x7f591815d470 2024-05-30T16:51:19.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.285+0000 7f590f400640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f58f406d9d0 0x7f58f406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:19.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.286+0000 7f590f400640 1 -- 172.21.15.144:0/3194779603 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f59100778f0 con 0x7f591815d470 2024-05-30T16:51:19.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.295+0000 7f590f400640 1 -- 172.21.15.144:0/3194779603 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5910079f50 con 0x7f591815d470 2024-05-30T16:51:19.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.320+0000 7f5917400640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f58f406d9d0 0x7f58f406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:19.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.349+0000 7f5917400640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f58f406d9d0 0x7f58f406fe90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5908006a90 tx=0x7f5908006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:19.756+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83118", "target": ["mon-mgr", ""]}) -- 0x7f5918075f70 con 0x7f58f406d9d0 2024-05-30T16:51:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.305+0000 7f590f400640 1 -- 172.21.15.144:0/3194779603 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5908009620 con 0x7f58f406d9d0 2024-05-30T16:51:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.309+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f58f406d9d0 msgr2=0x7f58f406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.310+0000 7f591e400640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f58f406d9d0 0x7f58f406fe90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5908006a90 tx=0x7f5908006a20 comp rx=0 tx=0).stop 2024-05-30T16:51:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.310+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591815d470 msgr2=0x7f5918158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.310+0000 7f591e400640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591815d470 0x7f5918158ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5910009f70 tx=0x7f5910004a40 comp rx=0 tx=0).stop 2024-05-30T16:51:21.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.311+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 shutdown_connections 2024-05-30T16:51:21.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.311+0000 7f591e400640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f58f406d9d0 0x7f58f406fe90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:21.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.311+0000 7f591e400640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591815d470 0x7f5918158ba0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:21.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.311+0000 7f591e400640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59180b5b90 0x7f5918158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:21.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.311+0000 7f591e400640 1 --2- 172.21.15.144:0/3194779603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59180b3a10 0x7f591814bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:21.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.311+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 >> 172.21.15.144:0/3194779603 conn(0x7f591806b8e0 msgr2=0x7f59181598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:21.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.311+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 shutdown_connections 2024-05-30T16:51:21.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.312+0000 7f591e400640 1 -- 172.21.15.144:0/3194779603 wait complete. 2024-05-30T16:51:21.349 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83119 2024-05-30T16:51:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.708+0000 7f6a42600640 1 Processor -- start 2024-05-30T16:51:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.708+0000 7f6a42600640 1 -- start start 2024-05-30T16:51:21.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.710+0000 7f6a42600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a3c142f50 0x7f6a3c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.711+0000 7f6a42600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6a3c06ed40 0x7f6a3c06f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.711+0000 7f6a42600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a3c0cf080 con 0x7f6a3c0cdd10 2024-05-30T16:51:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.711+0000 7f6a42600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3c0ce500 con 0x7f6a3c142f50 2024-05-30T16:51:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.711+0000 7f6a42600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3c0ce7e0 con 0x7f6a3c06ed40 2024-05-30T16:51:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.711+0000 7f6a41200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a3c142f50 0x7f6a3c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.711+0000 7f6a41200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a3c142f50 0x7f6a3c0cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38028/0 (socket says 172.21.15.144:38028) 2024-05-30T16:51:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.711+0000 7f6a41200640 1 -- 172.21.15.144:0/380888539 learned_addr learned my addr 172.21.15.144:0/380888539 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.712+0000 7f6a41200640 1 -- 172.21.15.144:0/380888539 >> v2:172.21.15.149:3300/0 conn(0x7f6a3c06ed40 msgr2=0x7f6a3c06f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.712+0000 7f6a41200640 1 --2- 172.21.15.144:0/380888539 >> v2:172.21.15.149:3300/0 conn(0x7f6a3c06ed40 0x7f6a3c06f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.712+0000 7f6a41200640 1 -- 172.21.15.144:0/380888539 >> v1:172.21.15.149:6789/0 conn(0x7f6a3c0cdd10 legacy=0x7f6a3c1438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.712+0000 7f6a41200640 1 -- 172.21.15.144:0/380888539 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c0ceac0 con 0x7f6a3c142f50 2024-05-30T16:51:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.714+0000 7f6a41200640 1 --2- 172.21.15.144:0/380888539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c142f50 0x7f6a3c0cd7d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c071c60 tx=0x7f6a3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e881a35c8c154ede server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.716+0000 7f6a3b400640 1 -- 172.21.15.144:0/380888539 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a30037070 con 0x7f6a3c142f50 2024-05-30T16:51:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.716+0000 7f6a3b400640 1 -- 172.21.15.144:0/380888539 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a30032440 con 0x7f6a3c142f50 2024-05-30T16:51:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.716+0000 7f6a3b400640 1 -- 172.21.15.144:0/380888539 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a30032810 con 0x7f6a3c142f50 2024-05-30T16:51:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.718+0000 7f6a42600640 1 -- 172.21.15.144:0/380888539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c142f50 msgr2=0x7f6a3c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.718+0000 7f6a42600640 1 --2- 172.21.15.144:0/380888539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c142f50 0x7f6a3c0cd7d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c071c60 tx=0x7f6a3002a270 comp rx=0 tx=0).stop 2024-05-30T16:51:21.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.719+0000 7f6a42600640 1 -- 172.21.15.144:0/380888539 shutdown_connections 2024-05-30T16:51:21.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.719+0000 7f6a42600640 1 --2- 172.21.15.144:0/380888539 >> v2:172.21.15.149:3300/0 conn(0x7f6a3c06ed40 0x7f6a3c06f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:21.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.719+0000 7f6a42600640 1 --2- 172.21.15.144:0/380888539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c142f50 0x7f6a3c0cd7d0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:21.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.719+0000 7f6a42600640 1 -- 172.21.15.144:0/380888539 >> 172.21.15.144:0/380888539 conn(0x7f6a3c06b8e0 msgr2=0x7f6a3c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:21.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.719+0000 7f6a42600640 1 -- 172.21.15.144:0/380888539 shutdown_connections 2024-05-30T16:51:21.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.720+0000 7f6a42600640 1 -- 172.21.15.144:0/380888539 wait complete. 2024-05-30T16:51:21.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.723+0000 7f6a42600640 1 Processor -- start 2024-05-30T16:51:21.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.724+0000 7f6a42600640 1 -- start start 2024-05-30T16:51:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.725+0000 7f6a42600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c06ed40 0x7f6a3c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.725+0000 7f6a42600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3c0cdd10 0x7f6a3c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.725+0000 7f6a42600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a3c142f50 0x7f6a3c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.725+0000 7f6a42600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c0ce150 con 0x7f6a3c06ed40 2024-05-30T16:51:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.725+0000 7f6a42600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c143fd0 con 0x7f6a3c0cdd10 2024-05-30T16:51:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.725+0000 7f6a42600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c140c80 con 0x7f6a3c142f50 2024-05-30T16:51:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.726+0000 7f6a41200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c06ed40 0x7f6a3c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.726+0000 7f6a41200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c06ed40 0x7f6a3c153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38030/0 (socket says 172.21.15.144:38030) 2024-05-30T16:51:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.726+0000 7f6a41200640 1 -- 172.21.15.144:0/45421625 learned_addr learned my addr 172.21.15.144:0/45421625 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.726+0000 7f6a3be00640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3c0cdd10 0x7f6a3c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.727+0000 7f6a41c00640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a3c142f50 0x7f6a3c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.727+0000 7f6a41200640 1 -- 172.21.15.144:0/45421625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a3c142f50 msgr2=0x7f6a3c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.727+0000 7f6a41200640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a3c142f50 0x7f6a3c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.727+0000 7f6a41200640 1 -- 172.21.15.144:0/45421625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3c0cdd10 msgr2=0x7f6a3c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.727+0000 7f6a41200640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3c0cdd10 0x7f6a3c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.727+0000 7f6a41200640 1 -- 172.21.15.144:0/45421625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c1f14a0 con 0x7f6a3c06ed40 2024-05-30T16:51:21.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.729+0000 7f6a41200640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c06ed40 0x7f6a3c153f70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009960 tx=0x7f6a300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:21.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.732+0000 7f6a38c00640 1 -- 172.21.15.144:0/45421625 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a30041070 con 0x7f6a3c06ed40 2024-05-30T16:51:21.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.732+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3c154600 con 0x7f6a3c06ed40 2024-05-30T16:51:21.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.732+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a3c140ed0 con 0x7f6a3c06ed40 2024-05-30T16:51:21.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.732+0000 7f6a38c00640 1 -- 172.21.15.144:0/45421625 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3003c950 con 0x7f6a3c06ed40 2024-05-30T16:51:21.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.732+0000 7f6a38c00640 1 -- 172.21.15.144:0/45421625 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a30037040 con 0x7f6a3c06ed40 2024-05-30T16:51:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.735+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a3c075570 con 0x7f6a3c06ed40 2024-05-30T16:51:21.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.739+0000 7f6a38c00640 1 -- 172.21.15.144:0/45421625 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f6a30044070 con 0x7f6a3c06ed40 2024-05-30T16:51:21.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.741+0000 7f6a38c00640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a1c06da20 0x7f6a1c06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:21.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.741+0000 7f6a38c00640 1 -- 172.21.15.144:0/45421625 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f6a300ab5b0 con 0x7f6a3c06ed40 2024-05-30T16:51:21.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.750+0000 7f6a3be00640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a1c06da20 0x7f6a1c06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:21.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.750+0000 7f6a38c00640 1 -- 172.21.15.144:0/45421625 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a3007abc0 con 0x7f6a3c06ed40 2024-05-30T16:51:21.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:21.770+0000 7f6a3be00640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a1c06da20 0x7f6a1c06fee0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c15fff0 tx=0x7f6a28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:22.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:22.272+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83119", "target": ["mon-mgr", ""]}) -- 0x7f6a3c154b20 con 0x7f6a1c06da20 2024-05-30T16:51:23.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.223+0000 7f6a38c00640 1 -- 172.21.15.144:0/45421625 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6a28001d30 con 0x7f6a1c06da20 2024-05-30T16:51:23.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a1c06da20 msgr2=0x7f6a1c06fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:23.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a1c06da20 0x7f6a1c06fee0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c15fff0 tx=0x7f6a28009040 comp rx=0 tx=0).stop 2024-05-30T16:51:23.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c06ed40 msgr2=0x7f6a3c153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:23.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c06ed40 0x7f6a3c153f70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009960 tx=0x7f6a300046c0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 shutdown_connections 2024-05-30T16:51:23.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6a1c06da20 0x7f6a1c06fee0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a3c142f50 0x7f6a3c15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3c0cdd10 0x7f6a3c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 --2- 172.21.15.144:0/45421625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3c06ed40 0x7f6a3c153f70 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.228+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 >> 172.21.15.144:0/45421625 conn(0x7f6a3c06b8e0 msgr2=0x7f6a3c152110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:23.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.230+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 shutdown_connections 2024-05-30T16:51:23.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.230+0000 7f6a42600640 1 -- 172.21.15.144:0/45421625 wait complete. 2024-05-30T16:51:23.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone83120 2024-05-30T16:51:23.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.769+0000 7f9abfe00640 1 Processor -- start 2024-05-30T16:51:23.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.769+0000 7f9abfe00640 1 -- start start 2024-05-30T16:51:23.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.778+0000 7f9abfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9ab80ccef0 0x7f9ab815b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:23.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.779+0000 7f9abca00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9ab80b4000 0x7f9ab815e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56226/0 (socket says 172.21.15.144:56226) 2024-05-30T16:51:23.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.779+0000 7f9abca00640 1 -- 172.21.15.144:0/1177525670 learned_addr learned my addr 172.21.15.144:0/1177525670 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:23.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.779+0000 7f9abfe00640 1 -- 172.21.15.144:0/1177525670 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab815edc0 con 0x7f9ab80b4000 2024-05-30T16:51:23.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.780+0000 7f9abfe00640 1 -- 172.21.15.144:0/1177525670 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab815f0a0 con 0x7f9ab8072360 2024-05-30T16:51:23.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.781+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036572054 0 0) 0x7f9ab815f0a0 con 0x7f9ab8072360 2024-05-30T16:51:23.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.781+0000 7f9abfe00640 1 -- 172.21.15.144:0/1177525670 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab815f380 con 0x7f9ab80ccef0 2024-05-30T16:51:23.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.781+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aa0004630 con 0x7f9ab8072360 2024-05-30T16:51:23.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.781+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589155066 0 0) 0x7f9ab815edc0 con 0x7f9ab80b4000 2024-05-30T16:51:23.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.781+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab815f0a0 con 0x7f9ab80b4000 2024-05-30T16:51:23.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.782+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 64394183 0 0) 0x7f9ab815f0a0 con 0x7f9ab80b4000 2024-05-30T16:51:23.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.782+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 >> v2:172.21.15.149:3300/0 conn(0x7f9ab80ccef0 msgr2=0x7f9ab815b890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:51:23.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.782+0000 7f9ab7e00640 1 --2- 172.21.15.144:0/1177525670 >> v2:172.21.15.149:3300/0 conn(0x7f9ab80ccef0 0x7f9ab815b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.782+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 >> v1:172.21.15.149:6789/0 conn(0x7f9ab8072360 legacy=0x7f9ab80b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:23.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.783+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab815b090 con 0x7f9ab80b4000 2024-05-30T16:51:23.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.783+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f9ab0005050 con 0x7f9ab80b4000 2024-05-30T16:51:23.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.783+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 >> v1:172.21.15.144:6789/0 conn(0x7f9ab80b4000 legacy=0x7f9ab815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:23.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.784+0000 7f9ab7e00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aa0005cb0 0x7f9aa0006090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:23.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.784+0000 7f9ab7e00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9aa00048b0 0x7f9aa0004d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:23.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.784+0000 7f9ab7e00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9aa0003440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:23.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.785+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab815f380 con 0x7f9aa00048b0 2024-05-30T16:51:23.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.785+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa0003ae0 con 0x7f9aa0005cb0 2024-05-30T16:51:23.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.785+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa0003ce0 con 0x7f9aa0005270 2024-05-30T16:51:23.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.785+0000 7f9abca00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9aa00048b0 0x7f9aa0004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:23.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.785+0000 7f9abde00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9aa0003440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:23.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.786+0000 7f9abde00640 1 -- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aa0005cb0 msgr2=0x7f9aa0006090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:51:23.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.787+0000 7f9abd400640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aa0005cb0 0x7f9aa0006090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:23.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.788+0000 7f9abde00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aa0005cb0 0x7f9aa0006090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.788+0000 7f9abde00640 1 -- 172.21.15.144:0/1177525670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9aa00048b0 msgr2=0x7f9aa0004d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:23.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.788+0000 7f9abde00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9aa00048b0 0x7f9aa0004d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.788+0000 7f9abde00640 1 -- 172.21.15.144:0/1177525670 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab815f0a0 con 0x7f9aa0005270 2024-05-30T16:51:23.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.790+0000 7f9abde00640 1 -- 172.21.15.144:0/1177525670 reap_dead start 2024-05-30T16:51:23.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.791+0000 7f9abd400640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aa0005cb0 0x7f9aa0006090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:23.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.791+0000 7f9abca00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9aa00048b0 0x7f9aa0004d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:23.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.793+0000 7f9abde00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9aa0003440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9aac001900 tx=0x7f9aa0006940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f813bae1ce597bee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:23.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.795+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac001520 con 0x7f9aa0005270 2024-05-30T16:51:23.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.796+0000 7f9ab7e00640 1 -- 172.21.15.144:0/1177525670 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac02acb0 con 0x7f9aa0005270 2024-05-30T16:51:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.797+0000 7f9abfe00640 1 -- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 msgr2=0x7f9aa0003440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.797+0000 7f9abfe00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9aa0003440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9aac001900 tx=0x7f9aa0006940 comp rx=0 tx=0).stop 2024-05-30T16:51:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.801+0000 7f9abfe00640 1 -- 172.21.15.144:0/1177525670 shutdown_connections 2024-05-30T16:51:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.801+0000 7f9abfe00640 1 --2- 172.21.15.144:0/1177525670 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9aa0003440 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.801+0000 7f9abfe00640 1 -- 172.21.15.144:0/1177525670 >> 172.21.15.144:0/1177525670 conn(0x7f9ab806bd00 msgr2=0x7f9ab806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.801+0000 7f9abfe00640 1 -- 172.21.15.144:0/1177525670 shutdown_connections 2024-05-30T16:51:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.802+0000 7f9abfe00640 1 -- 172.21.15.144:0/1177525670 wait complete. 2024-05-30T16:51:23.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.805+0000 7f9abfe00640 1 Processor -- start 2024-05-30T16:51:23.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.805+0000 7f9abfe00640 1 -- start start 2024-05-30T16:51:23.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.808+0000 7f9abfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9ab814a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:23.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.809+0000 7f9abfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8153450 0x7f9ab80b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:23.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.809+0000 7f9abfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab81538d0 0x7f9ab80b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:23.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.809+0000 7f9abfe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8070060 con 0x7f9ab81538d0 2024-05-30T16:51:23.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.809+0000 7f9abfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab806fee0 con 0x7f9ab8153450 2024-05-30T16:51:23.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.809+0000 7f9abfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab80727f0 con 0x7f9aa0005270 2024-05-30T16:51:23.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.811+0000 7f9abd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9ab814a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:23.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.811+0000 7f9abd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9ab814a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:36412/0 (socket says 172.21.15.144:36412) 2024-05-30T16:51:23.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.811+0000 7f9abd400640 1 -- 172.21.15.144:0/3639550706 learned_addr learned my addr 172.21.15.144:0/3639550706 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:23.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.814+0000 7f9abde00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab81538d0 0x7f9ab80b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:23.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.815+0000 7f9abd400640 1 -- 172.21.15.144:0/3639550706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8153450 msgr2=0x7f9ab80b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:23.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.815+0000 7f9abd400640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8153450 0x7f9ab80b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.815+0000 7f9abd400640 1 -- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab81538d0 msgr2=0x7f9ab80b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:23.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.815+0000 7f9abd400640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab81538d0 0x7f9ab80b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:23.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.816+0000 7f9abd400640 1 -- 172.21.15.144:0/3639550706 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab80b1af0 con 0x7f9aa0005270 2024-05-30T16:51:23.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.816+0000 7f9abde00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab81538d0 0x7f9ab80b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:23.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.817+0000 7f9abd400640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9ab814a110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c4c0 tx=0x7f9aa400c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:23.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.818+0000 7f9ab5600640 1 -- 172.21.15.144:0/3639550706 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4015070 con 0x7f9aa0005270 2024-05-30T16:51:23.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.819+0000 7f9ab5600640 1 -- 172.21.15.144:0/3639550706 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa4011820 con 0x7f9aa0005270 2024-05-30T16:51:23.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.821+0000 7f9ab5600640 1 -- 172.21.15.144:0/3639550706 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4011c10 con 0x7f9aa0005270 2024-05-30T16:51:23.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.821+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab80b1dd0 con 0x7f9aa0005270 2024-05-30T16:51:23.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.821+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab80b2390 con 0x7f9aa0005270 2024-05-30T16:51:23.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.823+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab8068b90 con 0x7f9aa0005270 2024-05-30T16:51:23.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.827+0000 7f9ab5600640 1 -- 172.21.15.144:0/3639550706 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f9aa4018070 con 0x7f9aa0005270 2024-05-30T16:51:23.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.829+0000 7f9ab5600640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9a9806dad0 0x7f9a9806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:23.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.830+0000 7f9ab5600640 1 -- 172.21.15.144:0/3639550706 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f9aa408ac00 con 0x7f9aa0005270 2024-05-30T16:51:23.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.837+0000 7f9ab5600640 1 -- 172.21.15.144:0/3639550706 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9aa401f030 con 0x7f9aa0005270 2024-05-30T16:51:23.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.845+0000 7f9abca00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9a9806dad0 0x7f9a9806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:23.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:23.860+0000 7f9abca00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9a9806dad0 0x7f9a9806ff90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00019c0 tx=0x7f9ab000a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:24.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:24.432+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone83120", "target": ["mon-mgr", ""]}) -- 0x7f9ab8075f70 con 0x7f9a9806dad0 2024-05-30T16:51:25.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.531+0000 7f9ab5600640 1 -- 172.21.15.144:0/3639550706 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9ab00080d0 con 0x7f9a9806dad0 2024-05-30T16:51:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9a9806dad0 msgr2=0x7f9a9806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9a9806dad0 0x7f9a9806ff90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00019c0 tx=0x7f9ab000a040 comp rx=0 tx=0).stop 2024-05-30T16:51:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 msgr2=0x7f9ab814a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9ab814a110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c4c0 tx=0x7f9aa400c980 comp rx=0 tx=0).stop 2024-05-30T16:51:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 shutdown_connections 2024-05-30T16:51:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f9a9806dad0 0x7f9a9806ff90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab81538d0 0x7f9ab80b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8153450 0x7f9ab80b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 --2- 172.21.15.144:0/3639550706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0005270 0x7f9ab814a110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:25.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.548+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 >> 172.21.15.144:0/3639550706 conn(0x7f9ab806bd00 msgr2=0x7f9ab815a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:25.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.549+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 shutdown_connections 2024-05-30T16:51:25.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:25.550+0000 7f9abfe00640 1 -- 172.21.15.144:0/3639550706 wait complete. 2024-05-30T16:51:27.617 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:51:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.029+0000 7f7a4fe00640 1 Processor -- start 2024-05-30T16:51:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.030+0000 7f7a4fe00640 1 -- start start 2024-05-30T16:51:28.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.032+0000 7f7a4fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a500cfbe0 0x7f7a50169820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:28.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.032+0000 7f7a4fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5015ed40 con 0x7f7a500ba090 2024-05-30T16:51:28.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.032+0000 7f7a4fe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a50162ca0 con 0x7f7a5015e960 2024-05-30T16:51:28.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.032+0000 7f7a4fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7a500d2b40 con 0x7f7a500cfbe0 2024-05-30T16:51:28.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.032+0000 7f7a4e000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7a500ba090 0x7f7a500cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33872/0 (socket says 172.21.15.144:33872) 2024-05-30T16:51:28.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.032+0000 7f7a4e000640 1 -- 172.21.15.144:0/3717923222 learned_addr learned my addr 172.21.15.144:0/3717923222 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:28.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.033+0000 7f7a4f400640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a500cfbe0 0x7f7a50169820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:28.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.034+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826452266 0 0) 0x7f7a5015ed40 con 0x7f7a500ba090 2024-05-30T16:51:28.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.034+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a34003520 con 0x7f7a500ba090 2024-05-30T16:51:28.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.034+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786099401 0 0) 0x7f7a50162ca0 con 0x7f7a5015e960 2024-05-30T16:51:28.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.034+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a5015ed40 con 0x7f7a5015e960 2024-05-30T16:51:28.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.035+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 71503654 0 0) 0x7f7a34003520 con 0x7f7a500ba090 2024-05-30T16:51:28.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.035+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a500cfbe0 msgr2=0x7f7a50169820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:28.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.035+0000 7f7a4d600640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a500cfbe0 0x7f7a50169820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:28.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.035+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 >> v1:172.21.15.149:6789/0 conn(0x7f7a5015e960 legacy=0x7f7a50162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:28.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.035+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50162f80 con 0x7f7a500ba090 2024-05-30T16:51:28.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.035+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f7a40001670 con 0x7f7a500ba090 2024-05-30T16:51:28.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.035+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 >> v1:172.21.15.144:6789/0 conn(0x7f7a500ba090 legacy=0x7f7a500cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:28.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.036+0000 7f7a4d600640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a34004c00 0x7f7a34004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:28.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.036+0000 7f7a4d600640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a340037a0 0x7f7a34003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:28.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.036+0000 7f7a4d600640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a500cfbe0 0x7f7a34004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:28.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.036+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7a500d2b40 con 0x7f7a34004c00 2024-05-30T16:51:28.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.036+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3400ba20 con 0x7f7a340037a0 2024-05-30T16:51:28.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.036+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3400bc20 con 0x7f7a500cfbe0 2024-05-30T16:51:28.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.036+0000 7f7a4ea00640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a34004c00 0x7f7a34004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:28.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.037+0000 7f7a4e000640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a340037a0 0x7f7a34003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:28.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.039+0000 7f7a4f400640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a500cfbe0 0x7f7a34004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:28.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.040+0000 7f7a4ea00640 1 -- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a500cfbe0 msgr2=0x7f7a34004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:28.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.040+0000 7f7a4ea00640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a500cfbe0 0x7f7a34004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:28.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.040+0000 7f7a4ea00640 1 -- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a340037a0 msgr2=0x7f7a34003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:28.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.040+0000 7f7a4ea00640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a340037a0 0x7f7a34003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:28.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.040+0000 7f7a4ea00640 1 -- 172.21.15.144:0/3717923222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50162f80 con 0x7f7a34004c00 2024-05-30T16:51:28.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.045+0000 7f7a4ea00640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a34004c00 0x7f7a34004fe0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c007ed0 tx=0x7f7a34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429cb70872f74b3c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:28.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.046+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c007ad0 con 0x7f7a34004c00 2024-05-30T16:51:28.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.046+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3c005290 con 0x7f7a34004c00 2024-05-30T16:51:28.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.046+0000 7f7a4d600640 1 -- 172.21.15.144:0/3717923222 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c003830 con 0x7f7a34004c00 2024-05-30T16:51:28.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.047+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3717923222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a34004c00 msgr2=0x7f7a34004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:28.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.047+0000 7f7a4fe00640 1 --2- 172.21.15.144:0/3717923222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a34004c00 0x7f7a34004fe0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c007ed0 tx=0x7f7a34005830 comp rx=0 tx=0).stop 2024-05-30T16:51:28.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.047+0000 7f7a4f400640 1 -- 172.21.15.144:0/3717923222 reap_dead start 2024-05-30T16:51:28.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.047+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3717923222 shutdown_connections 2024-05-30T16:51:28.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.047+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3717923222 >> 172.21.15.144:0/3717923222 conn(0x7f7a500d1360 msgr2=0x7f7a500d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:28.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.050+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3717923222 shutdown_connections 2024-05-30T16:51:28.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.052+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3717923222 wait complete. 2024-05-30T16:51:28.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.056+0000 7f7a4fe00640 1 Processor -- start 2024-05-30T16:51:28.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.057+0000 7f7a4fe00640 1 -- start start 2024-05-30T16:51:28.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.060+0000 7f7a4fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a501548e0 0x7f7a5015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:28.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.060+0000 7f7a4fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a501f8320 0x7f7a50157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:28.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.061+0000 7f7a4fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a50154cc0 0x7f7a501f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:28.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.061+0000 7f7a4fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7a500b78a0 con 0x7f7a50154cc0 2024-05-30T16:51:28.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.061+0000 7f7a4fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7a500d2d90 con 0x7f7a501548e0 2024-05-30T16:51:28.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.061+0000 7f7a4fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7a500d42c0 con 0x7f7a501f8320 2024-05-30T16:51:28.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.062+0000 7f7a4ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a501548e0 0x7f7a5015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:28.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.062+0000 7f7a4ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a501548e0 0x7f7a5015ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:56880/0 (socket says 172.21.15.144:56880) 2024-05-30T16:51:28.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.062+0000 7f7a4ea00640 1 -- 172.21.15.144:0/3172330580 learned_addr learned my addr 172.21.15.144:0/3172330580 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:28.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.062+0000 7f7a4f400640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a50154cc0 0x7f7a501f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:28.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.064+0000 7f7a4e000640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a501f8320 0x7f7a50157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:28.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.065+0000 7f7a4f400640 1 -- 172.21.15.144:0/3172330580 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a501f8320 msgr2=0x7f7a50157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:28.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.065+0000 7f7a4f400640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a501f8320 0x7f7a50157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:28.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.065+0000 7f7a4f400640 1 -- 172.21.15.144:0/3172330580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a501548e0 msgr2=0x7f7a5015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:28.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.065+0000 7f7a4f400640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a501548e0 0x7f7a5015ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:28.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.065+0000 7f7a4f400640 1 -- 172.21.15.144:0/3172330580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a501584e0 con 0x7f7a50154cc0 2024-05-30T16:51:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.065+0000 7f7a4f400640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a50154cc0 0x7f7a501f7760 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f7a5008cb50 tx=0x7f7a48011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.066+0000 7f7a47400640 1 -- 172.21.15.144:0/3172330580 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48011ea0 con 0x7f7a50154cc0 2024-05-30T16:51:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.066+0000 7f7a47400640 1 -- 172.21.15.144:0/3172330580 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4801b070 con 0x7f7a50154cc0 2024-05-30T16:51:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.066+0000 7f7a47400640 1 -- 172.21.15.144:0/3172330580 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48003990 con 0x7f7a50154cc0 2024-05-30T16:51:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.066+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a500cc650 con 0x7f7a50154cc0 2024-05-30T16:51:28.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.066+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a500ccc10 con 0x7f7a50154cc0 2024-05-30T16:51:28.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.069+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a28005290 con 0x7f7a50154cc0 2024-05-30T16:51:28.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.070+0000 7f7a47400640 1 -- 172.21.15.144:0/3172330580 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f7a48005d10 con 0x7f7a50154cc0 2024-05-30T16:51:28.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.072+0000 7f7a47400640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7a3006da50 0x7f7a3006ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:28.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.072+0000 7f7a47400640 1 -- 172.21.15.144:0/3172330580 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f7a4808ab60 con 0x7f7a50154cc0 2024-05-30T16:51:28.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.076+0000 7f7a47400640 1 -- 172.21.15.144:0/3172330580 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a4801d310 con 0x7f7a50154cc0 2024-05-30T16:51:28.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.092+0000 7f7a4ea00640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7a3006da50 0x7f7a3006ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:28.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.121+0000 7f7a4ea00640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7a3006da50 0x7f7a3006ff10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a50160c30 tx=0x7f7a3c02d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:28.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.619+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7a28005850 con 0x7f7a50154cc0 2024-05-30T16:51:28.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.621+0000 7f7a47400640 1 -- 172.21.15.144:0/3172330580 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2420 (secure 0 0 0) 0x7f7a4805aa20 con 0x7f7a50154cc0 2024-05-30T16:51:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:51:28.623 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:51:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:51:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:51:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 600, 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:51:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 7362, 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 30667686982, 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 61124001792, 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 711970111488, 2024-05-30T16:51:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 809664262, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 812186742, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 196, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 217 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:51:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:51:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "11 ongoing+pending clones; Avg progress is 15.649% (30s)\n [====........................] (remaining: 2m)", 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.15648999810218811, 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:51:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 16.081% (37s)\n [====........................] (remaining: 3m)", 2024-05-30T16:51:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.16080999374389648, 2024-05-30T16:51:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:51:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:51:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:51:28.630 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:51:28.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7a3006da50 msgr2=0x7f7a3006ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:28.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7a3006da50 0x7f7a3006ff10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a50160c30 tx=0x7f7a3c02d000 comp rx=0 tx=0).stop 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a50154cc0 msgr2=0x7f7a501f7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a50154cc0 0x7f7a501f7760 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f7a5008cb50 tx=0x7f7a48011660 comp rx=0 tx=0).stop 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 shutdown_connections 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7a3006da50 0x7f7a3006ff10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a50154cc0 0x7f7a501f7760 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a501f8320 0x7f7a50157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 --2- 172.21.15.144:0/3172330580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a501548e0 0x7f7a5015ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.635+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 >> 172.21.15.144:0/3172330580 conn(0x7f7a500d1360 msgr2=0x7f7a5006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.636+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 shutdown_connections 2024-05-30T16:51:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:28.636+0000 7f7a4fe00640 1 -- 172.21.15.144:0/3172330580 wait complete. 2024-05-30T16:51:28.679 INFO:tasks.cephfs.test_volumes:pevs - {'46be8519-7604-4393-8d97-360d59b2a338': {'message': '11 ongoing+pending clones; Avg progress is 15.649% (30s)\n [====........................] (remaining: 2m)', 'progress': 0.1564899981021881, 'add_to_ceph_s': True}, 'db1fc475-de45-4c8e-92b3-78f1b62bc0b7': {'message': '4 ongoing clones; Avg progress is 16.081% (37s)\n [====........................] (remaining: 3m)', 'progress': 0.16080999374389648, 'add_to_ceph_s': True}} 2024-05-30T16:51:28.679 INFO:tasks.cephfs.test_volumes:new_onpen_p is less than onpen_p. 2024-05-30T16:51:28.679 INFO:tasks.cephfs.test_volumes:new_onpen_p = 0.1564899981021881; onpen_p = 0.2838500142097473 2024-05-30T16:51:28.680 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone8311 2024-05-30T16:51:29.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.022+0000 7f5a93000640 1 Processor -- start 2024-05-30T16:51:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.023+0000 7f5a93000640 1 -- start start 2024-05-30T16:51:29.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.026+0000 7f5a93000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5a8c06f7c0 0x7f5a8c0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:29.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.027+0000 7f5a93000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c0723e0 0x7f5a8c0ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:29.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.027+0000 7f5a93000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c06fba0 con 0x7f5a8c163c10 2024-05-30T16:51:29.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.027+0000 7f5a93000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5a8c06dd30 con 0x7f5a8c06f7c0 2024-05-30T16:51:29.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.027+0000 7f5a93000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8c0b4d60 con 0x7f5a8c0723e0 2024-05-30T16:51:29.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.028+0000 7f5a91c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5a8c06f7c0 0x7f5a8c0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.030+0000 7f5a91200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5a8c163c10 0x7f5a8c071cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:49608/0 (socket says 172.21.15.144:49608) 2024-05-30T16:51:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.030+0000 7f5a91200640 1 -- 172.21.15.144:0/3147858471 learned_addr learned my addr 172.21.15.144:0/3147858471 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.031+0000 7f5a8be00640 1 -- 172.21.15.144:0/3147858471 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823214853 0 0) 0x7f5a8c06fba0 con 0x7f5a8c163c10 2024-05-30T16:51:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.032+0000 7f5a8be00640 1 -- 172.21.15.144:0/3147858471 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a74003520 con 0x7f5a8c163c10 2024-05-30T16:51:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.033+0000 7f5a91c00640 1 -- 172.21.15.144:0/3147858471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c0723e0 msgr2=0x7f5a8c0ce6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:51:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.033+0000 7f5a91c00640 1 --2- 172.21.15.144:0/3147858471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c0723e0 0x7f5a8c0ce6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.033+0000 7f5a91c00640 1 -- 172.21.15.144:0/3147858471 >> v1:172.21.15.149:6789/0 conn(0x7f5a8c163c10 legacy=0x7f5a8c071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.033+0000 7f5a91c00640 1 -- 172.21.15.144:0/3147858471 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c0b5040 con 0x7f5a8c06f7c0 2024-05-30T16:51:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.036+0000 7f5a91c00640 1 --2- 172.21.15.144:0/3147858471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a8c06f7c0 0x7f5a8c0b4780 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0097a0 tx=0x7f5a7c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39a7a9bf7680a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.037+0000 7f5a8be00640 1 -- 172.21.15.144:0/3147858471 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c037070 con 0x7f5a8c06f7c0 2024-05-30T16:51:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.037+0000 7f5a8be00640 1 -- 172.21.15.144:0/3147858471 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7c032440 con 0x7f5a8c06f7c0 2024-05-30T16:51:29.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.037+0000 7f5a8be00640 1 -- 172.21.15.144:0/3147858471 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c037070 con 0x7f5a8c06f7c0 2024-05-30T16:51:29.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.039+0000 7f5a93000640 1 -- 172.21.15.144:0/3147858471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a8c06f7c0 msgr2=0x7f5a8c0b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:29.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.039+0000 7f5a93000640 1 --2- 172.21.15.144:0/3147858471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a8c06f7c0 0x7f5a8c0b4780 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0097a0 tx=0x7f5a7c02a1a0 comp rx=0 tx=0).stop 2024-05-30T16:51:29.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.040+0000 7f5a93000640 1 -- 172.21.15.144:0/3147858471 shutdown_connections 2024-05-30T16:51:29.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.040+0000 7f5a93000640 1 --2- 172.21.15.144:0/3147858471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c0723e0 0x7f5a8c0ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:29.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.040+0000 7f5a93000640 1 --2- 172.21.15.144:0/3147858471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a8c06f7c0 0x7f5a8c0b4780 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:29.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.040+0000 7f5a93000640 1 -- 172.21.15.144:0/3147858471 >> 172.21.15.144:0/3147858471 conn(0x7f5a8c0b2160 msgr2=0x7f5a8c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:29.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.041+0000 7f5a93000640 1 -- 172.21.15.144:0/3147858471 shutdown_connections 2024-05-30T16:51:29.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.041+0000 7f5a93000640 1 -- 172.21.15.144:0/3147858471 wait complete. 2024-05-30T16:51:29.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.044+0000 7f5a93000640 1 Processor -- start 2024-05-30T16:51:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.045+0000 7f5a93000640 1 -- start start 2024-05-30T16:51:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.047+0000 7f5a93000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c06f7c0 0x7f5a8c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.047+0000 7f5a93000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a8c0723e0 0x7f5a8c06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.047+0000 7f5a93000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a8c163c10 0x7f5a8c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.047+0000 7f5a93000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c0ce190 con 0x7f5a8c163c10 2024-05-30T16:51:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.047+0000 7f5a93000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c0b5600 con 0x7f5a8c0723e0 2024-05-30T16:51:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.047+0000 7f5a93000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8c164070 con 0x7f5a8c06f7c0 2024-05-30T16:51:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.048+0000 7f5a91c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c06f7c0 0x7f5a8c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.048+0000 7f5a92600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a8c163c10 0x7f5a8c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.048+0000 7f5a92600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a8c163c10 0x7f5a8c06e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46512/0 (socket says 172.21.15.144:46512) 2024-05-30T16:51:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.048+0000 7f5a92600640 1 -- 172.21.15.144:0/3499956703 learned_addr learned my addr 172.21.15.144:0/3499956703 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.048+0000 7f5a91c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c06f7c0 0x7f5a8c1589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:38662/0 (socket says 172.21.15.144:38662) 2024-05-30T16:51:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.050+0000 7f5a92600640 1 -- 172.21.15.144:0/3499956703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c06f7c0 msgr2=0x7f5a8c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.050+0000 7f5a92600640 1 --2- 172.21.15.144:0/3499956703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c06f7c0 0x7f5a8c1589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.050+0000 7f5a92600640 1 -- 172.21.15.144:0/3499956703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a8c0723e0 msgr2=0x7f5a8c06deb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:51:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.050+0000 7f5a92600640 1 --2- 172.21.15.144:0/3499956703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a8c0723e0 0x7f5a8c06deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.050+0000 7f5a92600640 1 -- 172.21.15.144:0/3499956703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c158ee0 con 0x7f5a8c163c10 2024-05-30T16:51:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.051+0000 7f5a91c00640 1 --2- 172.21.15.144:0/3499956703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8c06f7c0 0x7f5a8c1589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:29.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.052+0000 7f5a92600640 1 --2- 172.21.15.144:0/3499956703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a8c163c10 0x7f5a8c06e3f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400b9e0 tx=0x7f5a8400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.057+0000 7f5a89600640 1 -- 172.21.15.144:0/3499956703 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a84019070 con 0x7f5a8c163c10 2024-05-30T16:51:29.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.057+0000 7f5a89600640 1 -- 172.21.15.144:0/3499956703 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a8400cb20 con 0x7f5a8c163c10 2024-05-30T16:51:29.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.057+0000 7f5a89600640 1 -- 172.21.15.144:0/3499956703 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a84014440 con 0x7f5a8c163c10 2024-05-30T16:51:29.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.060+0000 7f5a93000640 1 -- 172.21.15.144:0/3499956703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8c15dd20 con 0x7f5a8c163c10 2024-05-30T16:51:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.064+0000 7f5a93000640 1 -- 172.21.15.144:0/3499956703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8c15dfe0 con 0x7f5a8c163c10 2024-05-30T16:51:29.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.066+0000 7f5a93000640 1 -- 172.21.15.144:0/3499956703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8c075570 con 0x7f5a8c163c10 2024-05-30T16:51:29.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.070+0000 7f5a89600640 1 -- 172.21.15.144:0/3499956703 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f5a8401c070 con 0x7f5a8c163c10 2024-05-30T16:51:29.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.073+0000 7f5a89600640 1 --2- 172.21.15.144:0/3499956703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5a7006da20 0x7f5a7006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:29.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.073+0000 7f5a89600640 1 -- 172.21.15.144:0/3499956703 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f5a8408ab50 con 0x7f5a8c163c10 2024-05-30T16:51:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.084+0000 7f5a89600640 1 -- 172.21.15.144:0/3499956703 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a84023020 con 0x7f5a8c163c10 2024-05-30T16:51:29.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.112+0000 7f5a91c00640 1 --2- 172.21.15.144:0/3499956703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5a7006da20 0x7f5a7006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:29.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.176+0000 7f5a91c00640 1 --2- 172.21.15.144:0/3499956703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f5a7006da20 0x7f5a7006fee0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c034000 tx=0x7f5a7c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:29.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:29.615+0000 7f5a93000640 1 -- 172.21.15.144:0/3499956703 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone8311", "target": ["mon-mgr", ""]}) -- 0x7f5a8c0cea60 con 0x7f5a7006da20 2024-05-30T16:51:30.017 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:30.017+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:30.017 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:30.017+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:30.017 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:30.017+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:30.017 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:30.017+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:30.018 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:30.017+0000 7fe1c9200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T16:51:30.480 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:30.479+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:30.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.479+0000 7f5a89600640 1 -- 172.21.15.144:0/3499956703 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f5a8c0cea60 con 0x7f5a7006da20 2024-05-30T16:51:30.483 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:30.504 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:30.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone8312 2024-05-30T16:51:30.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.913+0000 7f34be800640 1 Processor -- start 2024-05-30T16:51:30.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.914+0000 7f34be800640 1 -- start start 2024-05-30T16:51:30.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.928+0000 7f34be800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f34b80d0710 0x7f34b815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:30.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.928+0000 7f34be800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34b80d0af0 0x7f34b80d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:30.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.929+0000 7f34b7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f34b8160400 0x7f34b8160890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33876/0 (socket says 172.21.15.144:33876) 2024-05-30T16:51:30.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.929+0000 7f34b7e00640 1 -- 172.21.15.144:0/2690037366 learned_addr learned my addr 172.21.15.144:0/2690037366 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:30.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.929+0000 7f34b6a00640 1 --2- 172.21.15.144:0/2690037366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34b80d0af0 0x7f34b80d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:30.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.929+0000 7f34be800640 1 -- 172.21.15.144:0/2690037366 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b815ccd0 con 0x7f34b8160400 2024-05-30T16:51:30.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.931+0000 7f34be800640 1 -- 172.21.15.144:0/2690037366 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f34b80ce1b0 con 0x7f34b80d0710 2024-05-30T16:51:30.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.931+0000 7f34b7400640 1 --2- 172.21.15.144:0/2690037366 >> v2:172.21.15.149:3300/0 conn(0x7f34b80d0710 0x7f34b815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:30.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.932+0000 7f34b6000640 1 -- 172.21.15.144:0/2690037366 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383204719 0 0) 0x7f34b815ccd0 con 0x7f34b8160400 2024-05-30T16:51:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.934+0000 7f34be800640 1 -- 172.21.15.144:0/2690037366 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34b809aa30 con 0x7f34b80d0af0 2024-05-30T16:51:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.935+0000 7f34b6000640 1 -- 172.21.15.144:0/2690037366 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f349c003520 con 0x7f34b8160400 2024-05-30T16:51:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.935+0000 7f34b7400640 1 -- 172.21.15.144:0/2690037366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34b80d0af0 msgr2=0x7f34b80d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.935+0000 7f34b7400640 1 --2- 172.21.15.144:0/2690037366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34b80d0af0 0x7f34b80d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.935+0000 7f34b7400640 1 -- 172.21.15.144:0/2690037366 >> v1:172.21.15.144:6789/0 conn(0x7f34b8160400 legacy=0x7f34b8160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.936+0000 7f34b7400640 1 -- 172.21.15.144:0/2690037366 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b809ad10 con 0x7f34b80d0710 2024-05-30T16:51:30.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.942+0000 7f34b7400640 1 --2- 172.21.15.144:0/2690037366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b80d0710 0x7f34b815d910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f34a40097a0 tx=0x7f34a402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55e8f68b0b81c3e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:30.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.947+0000 7f34b6000640 1 -- 172.21.15.144:0/2690037366 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4037070 con 0x7f34b80d0710 2024-05-30T16:51:30.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.947+0000 7f34b6000640 1 -- 172.21.15.144:0/2690037366 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a4032440 con 0x7f34b80d0710 2024-05-30T16:51:30.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.947+0000 7f34b6000640 1 -- 172.21.15.144:0/2690037366 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4032850 con 0x7f34b80d0710 2024-05-30T16:51:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.948+0000 7f34be800640 1 -- 172.21.15.144:0/2690037366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b80d0710 msgr2=0x7f34b815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.948+0000 7f34be800640 1 --2- 172.21.15.144:0/2690037366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b80d0710 0x7f34b815d910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f34a40097a0 tx=0x7f34a402a250 comp rx=0 tx=0).stop 2024-05-30T16:51:30.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.952+0000 7f34be800640 1 -- 172.21.15.144:0/2690037366 shutdown_connections 2024-05-30T16:51:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.952+0000 7f34be800640 1 --2- 172.21.15.144:0/2690037366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34b80d0af0 0x7f34b80d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.952+0000 7f34be800640 1 --2- 172.21.15.144:0/2690037366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b80d0710 0x7f34b815d910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.952+0000 7f34be800640 1 -- 172.21.15.144:0/2690037366 >> 172.21.15.144:0/2690037366 conn(0x7f34b80b4180 msgr2=0x7f34b80b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.952+0000 7f34be800640 1 -- 172.21.15.144:0/2690037366 shutdown_connections 2024-05-30T16:51:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.953+0000 7f34be800640 1 -- 172.21.15.144:0/2690037366 wait complete. 2024-05-30T16:51:30.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.958+0000 7f34be800640 1 Processor -- start 2024-05-30T16:51:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.958+0000 7f34be800640 1 -- start start 2024-05-30T16:51:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.959+0000 7f34be800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b80d0710 0x7f34b80b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.959+0000 7f34be800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34b80d0af0 0x7f34b814f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.959+0000 7f34be800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b8160400 0x7f34b80c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.959+0000 7f34be800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34b809b5b0 con 0x7f34b80d0710 2024-05-30T16:51:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.959+0000 7f34be800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34b809b2d0 con 0x7f34b8160400 2024-05-30T16:51:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.959+0000 7f34be800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34b80d1470 con 0x7f34b80d0af0 2024-05-30T16:51:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.961+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b8160400 0x7f34b80c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.961+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b8160400 0x7f34b80c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:56896/0 (socket says 172.21.15.144:56896) 2024-05-30T16:51:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.961+0000 7f34b7e00640 1 -- 172.21.15.144:0/2928891242 learned_addr learned my addr 172.21.15.144:0/2928891242 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:30.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.962+0000 7f34b6a00640 1 --2- 172.21.15.144:0/2928891242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34b80d0af0 0x7f34b814f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:30.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.967+0000 7f34b7e00640 1 -- 172.21.15.144:0/2928891242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34b80d0af0 msgr2=0x7f34b814f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:30.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.967+0000 7f34b7e00640 1 --2- 172.21.15.144:0/2928891242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34b80d0af0 0x7f34b814f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:30.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.968+0000 7f34b7400640 1 --2- 172.21.15.144:0/2928891242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b80d0710 0x7f34b80b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.981+0000 7f34b7e00640 1 -- 172.21.15.144:0/2928891242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b80d0710 msgr2=0x7f34b80b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.981+0000 7f34b7e00640 1 --2- 172.21.15.144:0/2928891242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b80d0710 0x7f34b80b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.981+0000 7f34b7e00640 1 -- 172.21.15.144:0/2928891242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b80c7110 con 0x7f34b8160400 2024-05-30T16:51:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.982+0000 7f34b7400640 1 --2- 172.21.15.144:0/2928891242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b80d0710 0x7f34b80b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:30.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.983+0000 7f34b7e00640 1 --2- 172.21.15.144:0/2928891242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b8160400 0x7f34b80c6bd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f34b000cb70 tx=0x7f34b000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.991+0000 7f34af400640 1 -- 172.21.15.144:0/2928891242 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0017070 con 0x7f34b8160400 2024-05-30T16:51:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.992+0000 7f34af400640 1 -- 172.21.15.144:0/2928891242 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b000ad40 con 0x7f34b8160400 2024-05-30T16:51:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.992+0000 7f34be800640 1 -- 172.21.15.144:0/2928891242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b80c7880 con 0x7f34b8160400 2024-05-30T16:51:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.992+0000 7f34be800640 1 -- 172.21.15.144:0/2928891242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b80c7e40 con 0x7f34b8160400 2024-05-30T16:51:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.992+0000 7f34af400640 1 -- 172.21.15.144:0/2928891242 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0012620 con 0x7f34b8160400 2024-05-30T16:51:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:30.999+0000 7f34be800640 1 -- 172.21.15.144:0/2928891242 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3490005290 con 0x7f34b8160400 2024-05-30T16:51:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.001+0000 7f34af400640 1 -- 172.21.15.144:0/2928891242 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 28) ==== 92570+0+0 (secure 0 0 0) 0x7f34b001a070 con 0x7f34b8160400 2024-05-30T16:51:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.004+0000 7f34af400640 1 --2- 172.21.15.144:0/2928891242 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f349806daa0 0x7f349806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.005+0000 7f34af400640 1 -- 172.21.15.144:0/2928891242 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f34b008a960 con 0x7f34b8160400 2024-05-30T16:51:31.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.011+0000 7f34b7400640 1 --2- 172.21.15.144:0/2928891242 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f349806daa0 0x7f349806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.022+0000 7f34af400640 1 -- 172.21.15.144:0/2928891242 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34b005a410 con 0x7f34b8160400 2024-05-30T16:51:31.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.056+0000 7f34b7400640 1 --2- 172.21.15.144:0/2928891242 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f349806daa0 0x7f349806ff60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f34a4034000 tx=0x7f34a402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.412+0000 7f34af400640 1 -- 172.21.15.144:0/2928891242 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mgrmap(e 29) ==== 92621+0+0 (secure 0 0 0) 0x7f34b0056380 con 0x7f34b8160400 2024-05-30T16:51:31.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.439+0000 7f34be800640 1 -- 172.21.15.144:0/2928891242 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone8312", "target": ["mon-mgr", ""]}) -- 0x7f3490000bc0 con 0x7f349806daa0 2024-05-30T16:51:31.462 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:31.461+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:31.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.467+0000 7f34af400640 1 -- 172.21.15.144:0/2928891242 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f3490000bc0 con 0x7f349806daa0 2024-05-30T16:51:31.471 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:31.514 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:31.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone8313 2024-05-30T16:51:31.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.962+0000 7f8bf9600640 1 Processor -- start 2024-05-30T16:51:31.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.963+0000 7f8bf9600640 1 -- start start 2024-05-30T16:51:31.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.965+0000 7f8bf9600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8bec0e1090 0x7f8bec038630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:31.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.965+0000 7f8bf9600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8bec03a5d0 0x7f8bec005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:31.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.965+0000 7f8bf9600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bec04f540 con 0x7f8bec050dd0 2024-05-30T16:51:31.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.965+0000 7f8bf9600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8bec04f820 con 0x7f8bec0e1090 2024-05-30T16:51:31.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.965+0000 7f8bf9600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f8bec04fb00 con 0x7f8bec03a5d0 2024-05-30T16:51:31.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.967+0000 7f8bf3400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8bec03a5d0 0x7f8bec005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:31.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.967+0000 7f8bf3400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8bec03a5d0 0x7f8bec005f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:56902/0 (socket says 172.21.15.144:56902) 2024-05-30T16:51:31.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.967+0000 7f8bf3400640 1 -- 172.21.15.144:0/968909195 learned_addr learned my addr 172.21.15.144:0/968909195 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.967+0000 7f8bf2a00640 1 --2- 172.21.15.144:0/968909195 >> v2:172.21.15.144:3300/0 conn(0x7f8bec0e1090 0x7f8bec038630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.968+0000 7f8bf1600640 1 -- 172.21.15.144:0/968909195 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198231167 0 0) 0x7f8bec04f540 con 0x7f8bec050dd0 2024-05-30T16:51:31.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.968+0000 7f8bf1600640 1 -- 172.21.15.144:0/968909195 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bd8003520 con 0x7f8bec050dd0 2024-05-30T16:51:31.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.969+0000 7f8bf2a00640 1 -- 172.21.15.144:0/968909195 >> v2:172.21.15.149:3300/0 conn(0x7f8bec03a5d0 msgr2=0x7f8bec005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:31.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.969+0000 7f8bf2a00640 1 --2- 172.21.15.144:0/968909195 >> v2:172.21.15.149:3300/0 conn(0x7f8bec03a5d0 0x7f8bec005f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.969+0000 7f8bf2a00640 1 -- 172.21.15.144:0/968909195 >> v1:172.21.15.149:6789/0 conn(0x7f8bec050dd0 legacy=0x7f8bec039ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:31.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.969+0000 7f8bf2a00640 1 -- 172.21.15.144:0/968909195 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec04fde0 con 0x7f8bec0e1090 2024-05-30T16:51:31.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.973+0000 7f8bf2a00640 1 --2- 172.21.15.144:0/968909195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bec0e1090 0x7f8bec038630 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8bf402db50 tx=0x7f8bf40a5d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0dad3ba59a8945 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:31.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.977+0000 7f8bf1600640 1 -- 172.21.15.144:0/968909195 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40b3070 con 0x7f8bec0e1090 2024-05-30T16:51:31.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.977+0000 7f8bf1600640 1 -- 172.21.15.144:0/968909195 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40a6b30 con 0x7f8bec0e1090 2024-05-30T16:51:31.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.977+0000 7f8bf1600640 1 -- 172.21.15.144:0/968909195 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40ae440 con 0x7f8bec0e1090 2024-05-30T16:51:31.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.978+0000 7f8bf9600640 1 -- 172.21.15.144:0/968909195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bec0e1090 msgr2=0x7f8bec038630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:31.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.978+0000 7f8bf9600640 1 --2- 172.21.15.144:0/968909195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bec0e1090 0x7f8bec038630 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8bf402db50 tx=0x7f8bf40a5d60 comp rx=0 tx=0).stop 2024-05-30T16:51:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.980+0000 7f8bf9600640 1 -- 172.21.15.144:0/968909195 shutdown_connections 2024-05-30T16:51:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.980+0000 7f8bf9600640 1 --2- 172.21.15.144:0/968909195 >> v2:172.21.15.149:3300/0 conn(0x7f8bec03a5d0 0x7f8bec005f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.980+0000 7f8bf9600640 1 --2- 172.21.15.144:0/968909195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bec0e1090 0x7f8bec038630 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.980+0000 7f8bf9600640 1 -- 172.21.15.144:0/968909195 >> 172.21.15.144:0/968909195 conn(0x7f8bec009fb0 msgr2=0x7f8bec00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:31.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.980+0000 7f8bf9600640 1 -- 172.21.15.144:0/968909195 shutdown_connections 2024-05-30T16:51:31.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.981+0000 7f8bf9600640 1 -- 172.21.15.144:0/968909195 wait complete. 2024-05-30T16:51:31.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:31.996+0000 7f8bf9600640 1 Processor -- start 2024-05-30T16:51:32.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.001+0000 7f8bf9600640 1 -- start start 2024-05-30T16:51:32.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.016+0000 7f8bf9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bec03a5d0 0x7f8bec04e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:32.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.017+0000 7f8bf9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bec050dd0 0x7f8bec0dc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:32.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.018+0000 7f8bf2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bec03a5d0 0x7f8bec04e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:32.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.019+0000 7f8bf2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bec03a5d0 0x7f8bec04e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46566/0 (socket says 172.21.15.144:46566) 2024-05-30T16:51:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.019+0000 7f8bf2a00640 1 -- 172.21.15.144:0/4052797221 learned_addr learned my addr 172.21.15.144:0/4052797221 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.020+0000 7f8bf9600640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bec0e1090 0x7f8bec0355a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.020+0000 7f8bf2000640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bec050dd0 0x7f8bec0dc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.020+0000 7f8bf9600640 1 -- 172.21.15.144:0/4052797221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec0064d0 con 0x7f8bec03a5d0 2024-05-30T16:51:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.020+0000 7f8bf9600640 1 -- 172.21.15.144:0/4052797221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec0503a0 con 0x7f8bec0e1090 2024-05-30T16:51:32.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.021+0000 7f8bf3400640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bec0e1090 0x7f8bec0355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:32.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.021+0000 7f8bf9600640 1 -- 172.21.15.144:0/4052797221 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8bec006650 con 0x7f8bec050dd0 2024-05-30T16:51:32.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.022+0000 7f8bf2a00640 1 -- 172.21.15.144:0/4052797221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bec050dd0 msgr2=0x7f8bec0dc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:32.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.022+0000 7f8bf2a00640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bec050dd0 0x7f8bec0dc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:32.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.022+0000 7f8bf2a00640 1 -- 172.21.15.144:0/4052797221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bec0e1090 msgr2=0x7f8bec0355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:32.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.022+0000 7f8bf2a00640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bec0e1090 0x7f8bec0355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:32.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.022+0000 7f8bf2a00640 1 -- 172.21.15.144:0/4052797221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec048ac0 con 0x7f8bec03a5d0 2024-05-30T16:51:32.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.023+0000 7f8bf2000640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bec050dd0 0x7f8bec0dc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:32.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.023+0000 7f8bf3400640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bec0e1090 0x7f8bec0355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:32.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.023+0000 7f8bf2a00640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bec03a5d0 0x7f8bec04e880 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40690c0 tx=0x7f8bf4069790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:32.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.024+0000 7f8beaa00640 1 -- 172.21.15.144:0/4052797221 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40b3050 con 0x7f8bec03a5d0 2024-05-30T16:51:32.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.025+0000 7f8beaa00640 1 -- 172.21.15.144:0/4052797221 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40b4040 con 0x7f8bec03a5d0 2024-05-30T16:51:32.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.025+0000 7f8bf9600640 1 -- 172.21.15.144:0/4052797221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bec048da0 con 0x7f8bec03a5d0 2024-05-30T16:51:32.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.026+0000 7f8bf9600640 1 -- 172.21.15.144:0/4052797221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bec049360 con 0x7f8bec03a5d0 2024-05-30T16:51:32.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.028+0000 7f8beaa00640 1 -- 172.21.15.144:0/4052797221 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40ba650 con 0x7f8bec03a5d0 2024-05-30T16:51:32.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.034+0000 7f8beaa00640 1 -- 172.21.15.144:0/4052797221 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 92621+0+0 (secure 0 0 0) 0x7f8bf40c1070 con 0x7f8bec03a5d0 2024-05-30T16:51:32.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.036+0000 7f8bf9600640 1 -- 172.21.15.144:0/4052797221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc005290 con 0x7f8bec03a5d0 2024-05-30T16:51:32.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.037+0000 7f8beaa00640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8bd406db30 0x7f8bd406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:32.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.038+0000 7f8beaa00640 1 -- 172.21.15.144:0/4052797221 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f8bf4126640 con 0x7f8bec03a5d0 2024-05-30T16:51:32.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.047+0000 7f8bf2000640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8bd406db30 0x7f8bd406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:32.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.050+0000 7f8bf2000640 1 --2- 172.21.15.144:0/4052797221 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8bd406db30 0x7f8bd406fff0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8bec02c1c0 tx=0x7f8be4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:32.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.051+0000 7f8beaa00640 1 -- 172.21.15.144:0/4052797221 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8bf40f6170 con 0x7f8bec03a5d0 2024-05-30T16:51:32.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:32.626+0000 7f8bf9600640 1 -- 172.21.15.144:0/4052797221 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone8313", "target": ["mon-mgr", ""]}) -- 0x7f8bcc000bc0 con 0x7f8bd406db30 2024-05-30T16:51:33.144 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:33.142+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:33.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.179+0000 7f8beaa00640 1 -- 172.21.15.144:0/4052797221 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f8bcc000bc0 con 0x7f8bd406db30 2024-05-30T16:51:33.185 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:33.226 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:33.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone8314 2024-05-30T16:51:33.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.643+0000 7fa4d3600640 1 Processor -- start 2024-05-30T16:51:33.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.643+0000 7fa4d3600640 1 -- start start 2024-05-30T16:51:33.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.644+0000 7fa4d3600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4cc162d30 0x7fa4cc0d43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:33.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.645+0000 7fa4d3600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4cc0b6d00 0x7fa4cc0d1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:33.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.645+0000 7fa4d3600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4cc0d1c50 0x7fa4cc166980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:33.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.648+0000 7fa4d0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4cc162d30 0x7fa4cc0d43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:33.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.649+0000 7fa4d0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4cc162d30 0x7fa4cc0d43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:38722/0 (socket says 172.21.15.144:38722) 2024-05-30T16:51:33.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.649+0000 7fa4cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4cc0b6d00 0x7fa4cc0d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:33.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.649+0000 7fa4cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4cc0b6d00 0x7fa4cc0d1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46572/0 (socket says 172.21.15.144:46572) 2024-05-30T16:51:33.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.650+0000 7fa4d0c00640 1 -- 172.21.15.144:0/2636186923 learned_addr learned my addr 172.21.15.144:0/2636186923 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:33.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.650+0000 7fa4d1600640 1 --2- 172.21.15.144:0/2636186923 >> v2:172.21.15.149:3300/0 conn(0x7fa4cc0d1c50 0x7fa4cc166980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:33.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.653+0000 7fa4d3600640 1 -- 172.21.15.144:0/2636186923 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa4cc0d2070 con 0x7fa4cc0b6d00 2024-05-30T16:51:33.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.653+0000 7fa4d3600640 1 -- 172.21.15.144:0/2636186923 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa4cc0d4a30 con 0x7fa4cc0d1c50 2024-05-30T16:51:33.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.653+0000 7fa4d3600640 1 -- 172.21.15.144:0/2636186923 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc0d4d10 con 0x7fa4cc162d30 2024-05-30T16:51:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.658+0000 7fa4cbe00640 1 -- 172.21.15.144:0/2636186923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4cc162d30 msgr2=0x7fa4cc0d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.658+0000 7fa4cbe00640 1 --2- 172.21.15.144:0/2636186923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4cc162d30 0x7fa4cc0d43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.658+0000 7fa4cbe00640 1 -- 172.21.15.144:0/2636186923 >> v2:172.21.15.149:3300/0 conn(0x7fa4cc0d1c50 msgr2=0x7fa4cc166980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.658+0000 7fa4cbe00640 1 --2- 172.21.15.144:0/2636186923 >> v2:172.21.15.149:3300/0 conn(0x7fa4cc0d1c50 0x7fa4cc166980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.658+0000 7fa4cbe00640 1 -- 172.21.15.144:0/2636186923 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc0d4ff0 con 0x7fa4cc0b6d00 2024-05-30T16:51:33.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.661+0000 7fa4cbe00640 1 --2- 172.21.15.144:0/2636186923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0b6d00 0x7fa4cc0d1710 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0b6510 tx=0x7fa4c002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbae52dd1502bca server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:33.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.662+0000 7fa4cb400640 1 -- 172.21.15.144:0/2636186923 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0037070 con 0x7fa4cc0b6d00 2024-05-30T16:51:33.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.662+0000 7fa4cb400640 1 -- 172.21.15.144:0/2636186923 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c0032440 con 0x7fa4cc0b6d00 2024-05-30T16:51:33.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.662+0000 7fa4cb400640 1 -- 172.21.15.144:0/2636186923 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c002ae60 con 0x7fa4cc0b6d00 2024-05-30T16:51:33.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.663+0000 7fa4d3600640 1 -- 172.21.15.144:0/2636186923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0b6d00 msgr2=0x7fa4cc0d1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:33.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.663+0000 7fa4d3600640 1 --2- 172.21.15.144:0/2636186923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0b6d00 0x7fa4cc0d1710 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0b6510 tx=0x7fa4c002a110 comp rx=0 tx=0).stop 2024-05-30T16:51:33.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.665+0000 7fa4d3600640 1 -- 172.21.15.144:0/2636186923 shutdown_connections 2024-05-30T16:51:33.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.665+0000 7fa4d3600640 1 --2- 172.21.15.144:0/2636186923 >> v2:172.21.15.149:3300/0 conn(0x7fa4cc0d1c50 0x7fa4cc166980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:33.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.665+0000 7fa4d3600640 1 --2- 172.21.15.144:0/2636186923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0b6d00 0x7fa4cc0d1710 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:33.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.665+0000 7fa4d3600640 1 --2- 172.21.15.144:0/2636186923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4cc162d30 0x7fa4cc0d43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:33.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.665+0000 7fa4d3600640 1 -- 172.21.15.144:0/2636186923 >> 172.21.15.144:0/2636186923 conn(0x7fa4cc0627b0 msgr2=0x7fa4cc062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:33.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.666+0000 7fa4d3600640 1 -- 172.21.15.144:0/2636186923 shutdown_connections 2024-05-30T16:51:33.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.666+0000 7fa4d3600640 1 -- 172.21.15.144:0/2636186923 wait complete. 2024-05-30T16:51:33.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.671+0000 7fa4d3600640 1 Processor -- start 2024-05-30T16:51:33.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.671+0000 7fa4d3600640 1 -- start start 2024-05-30T16:51:33.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.674+0000 7fa4d3600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4cc0b6d00 0x7fa4cc165640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.675+0000 7fa4d3600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0d1c50 0x7fa4cc0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.675+0000 7fa4d3600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4cc162d30 0x7fa4cc1f9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.675+0000 7fa4d3600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc0d55b0 con 0x7fa4cc0d1c50 2024-05-30T16:51:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.675+0000 7fa4d3600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc0b7670 con 0x7fa4cc0b6d00 2024-05-30T16:51:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.675+0000 7fa4d3600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc0b7160 con 0x7fa4cc162d30 2024-05-30T16:51:33.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.677+0000 7fa4d1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4cc162d30 0x7fa4cc1f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:33.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.677+0000 7fa4cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0d1c50 0x7fa4cc0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:33.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.678+0000 7fa4d0c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4cc0b6d00 0x7fa4cc165640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:33.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.678+0000 7fa4cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0d1c50 0x7fa4cc0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46574/0 (socket says 172.21.15.144:46574) 2024-05-30T16:51:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.678+0000 7fa4cbe00640 1 -- 172.21.15.144:0/2116706812 learned_addr learned my addr 172.21.15.144:0/2116706812 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.680+0000 7fa4d1600640 1 -- 172.21.15.144:0/2116706812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4cc0b6d00 msgr2=0x7fa4cc165640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.680+0000 7fa4d1600640 1 --2- 172.21.15.144:0/2116706812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4cc0b6d00 0x7fa4cc165640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:33.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.680+0000 7fa4d1600640 1 -- 172.21.15.144:0/2116706812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0d1c50 msgr2=0x7fa4cc0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:33.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.680+0000 7fa4d1600640 1 --2- 172.21.15.144:0/2116706812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0d1c50 0x7fa4cc0ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:33.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.680+0000 7fa4d1600640 1 -- 172.21.15.144:0/2116706812 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc1f8370 con 0x7fa4cc162d30 2024-05-30T16:51:33.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.681+0000 7fa4d1600640 1 --2- 172.21.15.144:0/2116706812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4cc162d30 0x7fa4cc1f9530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4007dc0 tx=0x7fa4c400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:33.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.683+0000 7fa4c8c00640 1 -- 172.21.15.144:0/2116706812 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c400edd0 con 0x7fa4cc162d30 2024-05-30T16:51:33.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.683+0000 7fa4c8c00640 1 -- 172.21.15.144:0/2116706812 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c4003990 con 0x7fa4cc162d30 2024-05-30T16:51:33.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.683+0000 7fa4c8c00640 1 -- 172.21.15.144:0/2116706812 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4003d80 con 0x7fa4cc162d30 2024-05-30T16:51:33.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.684+0000 7fa4d3600640 1 -- 172.21.15.144:0/2116706812 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc163610 con 0x7fa4cc162d30 2024-05-30T16:51:33.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.684+0000 7fa4d3600640 1 -- 172.21.15.144:0/2116706812 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc163bd0 con 0x7fa4cc162d30 2024-05-30T16:51:33.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.689+0000 7fa4d3600640 1 -- 172.21.15.144:0/2116706812 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a8005290 con 0x7fa4cc162d30 2024-05-30T16:51:33.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.690+0000 7fa4c8c00640 1 -- 172.21.15.144:0/2116706812 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7fa4c401b020 con 0x7fa4cc162d30 2024-05-30T16:51:33.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.692+0000 7fa4c8c00640 1 --2- 172.21.15.144:0/2116706812 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa4ac06da20 0x7fa4ac06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:33.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.693+0000 7fa4c8c00640 1 -- 172.21.15.144:0/2116706812 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fa4c408a730 con 0x7fa4cc162d30 2024-05-30T16:51:33.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.694+0000 7fa4d0c00640 1 --2- 172.21.15.144:0/2116706812 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa4ac06da20 0x7fa4ac06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:33.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.708+0000 7fa4c8c00640 1 -- 172.21.15.144:0/2116706812 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa4c4059f60 con 0x7fa4cc162d30 2024-05-30T16:51:33.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:33.711+0000 7fa4d0c00640 1 --2- 172.21.15.144:0/2116706812 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa4ac06da20 0x7fa4ac06fee0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0d48b0 tx=0x7fa4b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:34.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:34.288+0000 7fa4d3600640 1 -- 172.21.15.144:0/2116706812 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone8314", "target": ["mon-mgr", ""]}) -- 0x7fa4a8000bc0 con 0x7fa4ac06da20 2024-05-30T16:51:34.821 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:34.820+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:34.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:34.820+0000 7fa4c8c00640 1 -- 172.21.15.144:0/2116706812 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fa4a8000bc0 con 0x7fa4ac06da20 2024-05-30T16:51:34.822 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:34.846 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:34.847 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone8315 2024-05-30T16:51:35.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.297+0000 7fb152200640 1 Processor -- start 2024-05-30T16:51:35.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.298+0000 7fb152200640 1 -- start start 2024-05-30T16:51:35.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.304+0000 7fb152200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1440e3260 0x7fb14404f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:35.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.304+0000 7fb152200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb144053380 0x7fb144037bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:35.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.305+0000 7fb152200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1440e3640 con 0x7fb14404fdb0 2024-05-30T16:51:35.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.305+0000 7fb152200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb144053930 con 0x7fb1440e3260 2024-05-30T16:51:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.305+0000 7fb152200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb144053c10 con 0x7fb144053380 2024-05-30T16:51:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.306+0000 7fb14aa00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb14404fdb0 0x7fb144052c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:36060/0 (socket says 172.21.15.144:36060) 2024-05-30T16:51:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.306+0000 7fb14aa00640 1 -- 172.21.15.144:0/3870465677 learned_addr learned my addr 172.21.15.144:0/3870465677 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.307+0000 7fb14be00640 1 --2- 172.21.15.144:0/3870465677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb144053380 0x7fb144037bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.307+0000 7fb14b400640 1 --2- 172.21.15.144:0/3870465677 >> v2:172.21.15.144:3300/0 conn(0x7fb1440e3260 0x7fb14404f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.308+0000 7fb14a000640 1 -- 172.21.15.144:0/3870465677 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785547896 0 0) 0x7fb1440e3640 con 0x7fb14404fdb0 2024-05-30T16:51:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.309+0000 7fb14a000640 1 -- 172.21.15.144:0/3870465677 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb134003520 con 0x7fb14404fdb0 2024-05-30T16:51:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.309+0000 7fb14be00640 1 -- 172.21.15.144:0/3870465677 >> v2:172.21.15.144:3300/0 conn(0x7fb1440e3260 msgr2=0x7fb14404f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.309+0000 7fb14be00640 1 --2- 172.21.15.144:0/3870465677 >> v2:172.21.15.144:3300/0 conn(0x7fb1440e3260 0x7fb14404f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.309+0000 7fb14be00640 1 -- 172.21.15.144:0/3870465677 >> v1:172.21.15.149:6789/0 conn(0x7fb14404fdb0 legacy=0x7fb144052c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.309+0000 7fb14be00640 1 -- 172.21.15.144:0/3870465677 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb144053ef0 con 0x7fb144053380 2024-05-30T16:51:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.317+0000 7fb14be00640 1 --2- 172.21.15.144:0/3870465677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb144053380 0x7fb144037bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb14c050f50 tx=0x7fb14c0a5d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a82d4216c5e957b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.318+0000 7fb14a000640 1 -- 172.21.15.144:0/3870465677 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0b3070 con 0x7fb144053380 2024-05-30T16:51:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.318+0000 7fb14a000640 1 -- 172.21.15.144:0/3870465677 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c0a6b50 con 0x7fb144053380 2024-05-30T16:51:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.318+0000 7fb14a000640 1 -- 172.21.15.144:0/3870465677 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0b3070 con 0x7fb144053380 2024-05-30T16:51:35.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.325+0000 7fb152200640 1 -- 172.21.15.144:0/3870465677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb144053380 msgr2=0x7fb144037bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:35.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.325+0000 7fb152200640 1 --2- 172.21.15.144:0/3870465677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb144053380 0x7fb144037bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb14c050f50 tx=0x7fb14c0a5d80 comp rx=0 tx=0).stop 2024-05-30T16:51:35.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.326+0000 7fb152200640 1 -- 172.21.15.144:0/3870465677 shutdown_connections 2024-05-30T16:51:35.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.326+0000 7fb152200640 1 --2- 172.21.15.144:0/3870465677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb144053380 0x7fb144037bb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:35.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.326+0000 7fb152200640 1 --2- 172.21.15.144:0/3870465677 >> v2:172.21.15.144:3300/0 conn(0x7fb1440e3260 0x7fb14404f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:35.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.326+0000 7fb152200640 1 -- 172.21.15.144:0/3870465677 >> 172.21.15.144:0/3870465677 conn(0x7fb144009fb0 msgr2=0x7fb14400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:35.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.335+0000 7fb152200640 1 -- 172.21.15.144:0/3870465677 shutdown_connections 2024-05-30T16:51:35.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.337+0000 7fb152200640 1 -- 172.21.15.144:0/3870465677 wait complete. 2024-05-30T16:51:35.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.349+0000 7fb152200640 1 Processor -- start 2024-05-30T16:51:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.350+0000 7fb152200640 1 -- start start 2024-05-30T16:51:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.352+0000 7fb152200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14404fdb0 0x7fb1440dd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.352+0000 7fb152200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb144053380 0x7fb1440e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.352+0000 7fb152200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1440e3260 0x7fb1440dd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.352+0000 7fb152200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1440380f0 con 0x7fb1440e3260 2024-05-30T16:51:35.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.352+0000 7fb152200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb1440544b0 con 0x7fb14404fdb0 2024-05-30T16:51:35.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.352+0000 7fb152200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb144038270 con 0x7fb144053380 2024-05-30T16:51:35.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.353+0000 7fb14be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1440e3260 0x7fb1440dd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:35.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.353+0000 7fb14be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1440e3260 0x7fb1440dd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47922/0 (socket says 172.21.15.144:47922) 2024-05-30T16:51:35.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.353+0000 7fb14be00640 1 -- 172.21.15.144:0/3441866240 learned_addr learned my addr 172.21.15.144:0/3441866240 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:35.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.353+0000 7fb14b400640 1 --2- 172.21.15.144:0/3441866240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14404fdb0 0x7fb1440dd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:35.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.355+0000 7fb14be00640 1 -- 172.21.15.144:0/3441866240 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb144053380 msgr2=0x7fb1440e53a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:51:35.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.365+0000 7fb14be00640 1 --2- 172.21.15.144:0/3441866240 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb144053380 0x7fb1440e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:35.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.365+0000 7fb14be00640 1 -- 172.21.15.144:0/3441866240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14404fdb0 msgr2=0x7fb1440dd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:35.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.365+0000 7fb14be00640 1 --2- 172.21.15.144:0/3441866240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14404fdb0 0x7fb1440dd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:35.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.365+0000 7fb14be00640 1 -- 172.21.15.144:0/3441866240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1440de0b0 con 0x7fb1440e3260 2024-05-30T16:51:35.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.367+0000 7fb14b400640 1 --2- 172.21.15.144:0/3441866240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14404fdb0 0x7fb1440dd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:35.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.368+0000 7fb14be00640 1 --2- 172.21.15.144:0/3441866240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1440e3260 0x7fb1440dd200 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb14c02db50 tx=0x7fb14c069790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:35.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.369+0000 7fb13f400640 1 -- 172.21.15.144:0/3441866240 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0bb020 con 0x7fb1440e3260 2024-05-30T16:51:35.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.370+0000 7fb13f400640 1 -- 172.21.15.144:0/3441866240 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c0b7610 con 0x7fb1440e3260 2024-05-30T16:51:35.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.370+0000 7fb13f400640 1 -- 172.21.15.144:0/3441866240 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0b3040 con 0x7fb1440e3260 2024-05-30T16:51:35.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.372+0000 7fb152200640 1 -- 172.21.15.144:0/3441866240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb144048800 con 0x7fb1440e3260 2024-05-30T16:51:35.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.373+0000 7fb152200640 1 -- 172.21.15.144:0/3441866240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb144048dc0 con 0x7fb1440e3260 2024-05-30T16:51:35.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.375+0000 7fb152200640 1 -- 172.21.15.144:0/3441866240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb144005390 con 0x7fb1440e3260 2024-05-30T16:51:35.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.378+0000 7fb13f400640 1 -- 172.21.15.144:0/3441866240 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7fb14c0be020 con 0x7fb1440e3260 2024-05-30T16:51:35.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.379+0000 7fb13f400640 1 --2- 172.21.15.144:0/3441866240 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb12c06da20 0x7fb12c06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.379+0000 7fb13f400640 1 -- 172.21.15.144:0/3441866240 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fb14c1266f0 con 0x7fb1440e3260 2024-05-30T16:51:35.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.394+0000 7fb13f400640 1 -- 172.21.15.144:0/3441866240 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb14c0c5070 con 0x7fb1440e3260 2024-05-30T16:51:35.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.407+0000 7fb14b400640 1 --2- 172.21.15.144:0/3441866240 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb12c06da20 0x7fb12c06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.492+0000 7fb14b400640 1 --2- 172.21.15.144:0/3441866240 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb12c06da20 0x7fb12c06fee0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb140009e90 tx=0x7fb140009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:35.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:35.915+0000 7fb152200640 1 -- 172.21.15.144:0/3441866240 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone8315", "target": ["mon-mgr", ""]}) -- 0x7fb144048f90 con 0x7fb12c06da20 2024-05-30T16:51:36.844 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:36.843+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:36.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:36.873+0000 7fb13f400640 1 -- 172.21.15.144:0/3441866240 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fb144048f90 con 0x7fb12c06da20 2024-05-30T16:51:36.874 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:36.924 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:36.925 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone8316 2024-05-30T16:51:37.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.395+0000 7efd1f200640 1 Processor -- start 2024-05-30T16:51:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.395+0000 7efd1f200640 1 -- start start 2024-05-30T16:51:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.398+0000 7efd1f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd181514c0 0x7efd181518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.398+0000 7efd1f200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd1806ed50 0x7efd180b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.398+0000 7efd1f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd1806df90 con 0x7efd180b5350 2024-05-30T16:51:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.398+0000 7efd1f200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7efd1806e270 con 0x7efd1806ed50 2024-05-30T16:51:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.398+0000 7efd1f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd1806e550 con 0x7efd181514c0 2024-05-30T16:51:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.399+0000 7efd1d200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efd180b5350 0x7efd18071d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44240/0 (socket says 172.21.15.144:44240) 2024-05-30T16:51:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.399+0000 7efd1d200640 1 -- 172.21.15.144:0/711191743 learned_addr learned my addr 172.21.15.144:0/711191743 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.399+0000 7efd17400640 1 --2- 172.21.15.144:0/711191743 >> v2:172.21.15.149:3300/0 conn(0x7efd1806ed50 0x7efd180b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.405+0000 7efd16a00640 1 -- 172.21.15.144:0/711191743 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774106316 0 0) 0x7efd1806df90 con 0x7efd180b5350 2024-05-30T16:51:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.405+0000 7efd16a00640 1 -- 172.21.15.144:0/711191743 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcfc003520 con 0x7efd180b5350 2024-05-30T16:51:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.406+0000 7efd17e00640 1 --2- 172.21.15.144:0/711191743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd181514c0 0x7efd181518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.407+0000 7efd17400640 1 -- 172.21.15.144:0/711191743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd181514c0 msgr2=0x7efd181518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.407+0000 7efd17400640 1 --2- 172.21.15.144:0/711191743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd181514c0 0x7efd181518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.407+0000 7efd17400640 1 -- 172.21.15.144:0/711191743 >> v1:172.21.15.144:6789/0 conn(0x7efd180b5350 legacy=0x7efd18071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.407+0000 7efd17400640 1 -- 172.21.15.144:0/711191743 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1806e830 con 0x7efd1806ed50 2024-05-30T16:51:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.409+0000 7efd17400640 1 --2- 172.21.15.144:0/711191743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd1806ed50 0x7efd180b4e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efd080087a0 tx=0x7efd0802c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad8872d8fc4bf6f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.410+0000 7efd16a00640 1 -- 172.21.15.144:0/711191743 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0803a070 con 0x7efd1806ed50 2024-05-30T16:51:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.410+0000 7efd16a00640 1 -- 172.21.15.144:0/711191743 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd08032480 con 0x7efd1806ed50 2024-05-30T16:51:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.410+0000 7efd16a00640 1 -- 172.21.15.144:0/711191743 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08032890 con 0x7efd1806ed50 2024-05-30T16:51:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.412+0000 7efd1f200640 1 -- 172.21.15.144:0/711191743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd1806ed50 msgr2=0x7efd180b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.412+0000 7efd1f200640 1 --2- 172.21.15.144:0/711191743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd1806ed50 0x7efd180b4e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efd080087a0 tx=0x7efd0802c6c0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.413+0000 7efd1f200640 1 -- 172.21.15.144:0/711191743 shutdown_connections 2024-05-30T16:51:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.413+0000 7efd1f200640 1 --2- 172.21.15.144:0/711191743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd1806ed50 0x7efd180b4e10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.413+0000 7efd1f200640 1 --2- 172.21.15.144:0/711191743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd181514c0 0x7efd181518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.413+0000 7efd1f200640 1 -- 172.21.15.144:0/711191743 >> 172.21.15.144:0/711191743 conn(0x7efd1806b8e0 msgr2=0x7efd1806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.414+0000 7efd1f200640 1 -- 172.21.15.144:0/711191743 shutdown_connections 2024-05-30T16:51:37.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.414+0000 7efd1f200640 1 -- 172.21.15.144:0/711191743 wait complete. 2024-05-30T16:51:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.416+0000 7efd1f200640 1 Processor -- start 2024-05-30T16:51:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.417+0000 7efd1f200640 1 -- start start 2024-05-30T16:51:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.419+0000 7efd1f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd1806ed50 0x7efd1814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.419+0000 7efd1f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd180b5350 0x7efd1815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.419+0000 7efd1f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181514c0 0x7efd1814fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.419+0000 7efd1f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd1806fe50 con 0x7efd181514c0 2024-05-30T16:51:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.419+0000 7efd1f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd180726c0 con 0x7efd1806ed50 2024-05-30T16:51:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.419+0000 7efd1f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd1806ffd0 con 0x7efd180b5350 2024-05-30T16:51:37.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.420+0000 7efd1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181514c0 0x7efd1814fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:37.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.420+0000 7efd1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181514c0 0x7efd1814fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47926/0 (socket says 172.21.15.144:47926) 2024-05-30T16:51:37.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.420+0000 7efd1d200640 1 -- 172.21.15.144:0/3341289241 learned_addr learned my addr 172.21.15.144:0/3341289241 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:37.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.421+0000 7efd1d200640 1 -- 172.21.15.144:0/3341289241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd180b5350 msgr2=0x7efd1815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:37.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.421+0000 7efd1d200640 1 --2- 172.21.15.144:0/3341289241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd180b5350 0x7efd1815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.421+0000 7efd1d200640 1 -- 172.21.15.144:0/3341289241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd1806ed50 msgr2=0x7efd1814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:37.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.421+0000 7efd1d200640 1 --2- 172.21.15.144:0/3341289241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd1806ed50 0x7efd1814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:37.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.421+0000 7efd1d200640 1 -- 172.21.15.144:0/3341289241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1815c070 con 0x7efd181514c0 2024-05-30T16:51:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.422+0000 7efd1d200640 1 --2- 172.21.15.144:0/3341289241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181514c0 0x7efd1814fcd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7efd1000cbc0 tx=0x7efd1000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.424+0000 7efd0fe00640 1 -- 172.21.15.144:0/3341289241 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10017070 con 0x7efd181514c0 2024-05-30T16:51:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.425+0000 7efd0fe00640 1 -- 172.21.15.144:0/3341289241 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1000aca0 con 0x7efd181514c0 2024-05-30T16:51:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.425+0000 7efd1f200640 1 -- 172.21.15.144:0/3341289241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd1815c350 con 0x7efd181514c0 2024-05-30T16:51:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.425+0000 7efd1f200640 1 -- 172.21.15.144:0/3341289241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1815c910 con 0x7efd181514c0 2024-05-30T16:51:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.425+0000 7efd0fe00640 1 -- 172.21.15.144:0/3341289241 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10012620 con 0x7efd181514c0 2024-05-30T16:51:37.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.430+0000 7efd1f200640 1 -- 172.21.15.144:0/3341289241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf0005290 con 0x7efd181514c0 2024-05-30T16:51:37.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.444+0000 7efd0fe00640 1 -- 172.21.15.144:0/3341289241 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7efd1001a070 con 0x7efd181514c0 2024-05-30T16:51:37.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.446+0000 7efd0fe00640 1 --2- 172.21.15.144:0/3341289241 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcf806dad0 0x7efcf806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:37.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.446+0000 7efd0fe00640 1 -- 172.21.15.144:0/3341289241 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7efd1008a9a0 con 0x7efd181514c0 2024-05-30T16:51:37.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.449+0000 7efd0fe00640 1 -- 172.21.15.144:0/3341289241 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd1005a3c0 con 0x7efd181514c0 2024-05-30T16:51:37.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.495+0000 7efd17e00640 1 --2- 172.21.15.144:0/3341289241 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcf806dad0 0x7efcf806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:37.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.580+0000 7efd17e00640 1 --2- 172.21.15.144:0/3341289241 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7efcf806dad0 0x7efcf806ff90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efd04006fd0 tx=0x7efd04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:37.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:37.987+0000 7efd1f200640 1 -- 172.21.15.144:0/3341289241 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone8316", "target": ["mon-mgr", ""]}) -- 0x7efcf0000bc0 con 0x7efcf806dad0 2024-05-30T16:51:38.193 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:38.192+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:38.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.197+0000 7efd0fe00640 1 -- 172.21.15.144:0/3341289241 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7efcf0000bc0 con 0x7efcf806dad0 2024-05-30T16:51:38.200 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:38.247 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:38.248 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone8317 2024-05-30T16:51:38.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.735+0000 7f2e94000640 1 Processor -- start 2024-05-30T16:51:38.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.736+0000 7f2e94000640 1 -- start start 2024-05-30T16:51:38.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.738+0000 7f2e94000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8c13f760 0x7f2e8c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:38.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.738+0000 7f2e94000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e8c0b5fd0 0x7f2e8c142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:38.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.738+0000 7f2e94000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8c06ee80 con 0x7f2e8c0cec70 2024-05-30T16:51:38.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.738+0000 7f2e94000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2e8c1612b0 con 0x7f2e8c0b5fd0 2024-05-30T16:51:38.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.738+0000 7f2e94000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c13fb40 con 0x7f2e8c13f760 2024-05-30T16:51:38.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.739+0000 7f2e90c00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2e8c0cec70 0x7f2e8c0b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:36072/0 (socket says 172.21.15.144:36072) 2024-05-30T16:51:38.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.739+0000 7f2e90c00640 1 -- 172.21.15.144:0/4273419531 learned_addr learned my addr 172.21.15.144:0/4273419531 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:38.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.739+0000 7f2e92000640 1 --2- 172.21.15.144:0/4273419531 >> v2:172.21.15.144:3300/0 conn(0x7f2e8c0b5fd0 0x7f2e8c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:38.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.739+0000 7f2e91600640 1 --2- 172.21.15.144:0/4273419531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8c13f760 0x7f2e8c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:38.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.740+0000 7f2e92000640 1 -- 172.21.15.144:0/4273419531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8c13f760 msgr2=0x7f2e8c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:38.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.740+0000 7f2e92000640 1 --2- 172.21.15.144:0/4273419531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8c13f760 0x7f2e8c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:38.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.740+0000 7f2e92000640 1 -- 172.21.15.144:0/4273419531 >> v1:172.21.15.149:6789/0 conn(0x7f2e8c0cec70 legacy=0x7f2e8c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:38.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.740+0000 7f2e92000640 1 -- 172.21.15.144:0/4273419531 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c160730 con 0x7f2e8c0b5fd0 2024-05-30T16:51:38.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.740+0000 7f2e91600640 1 --2- 172.21.15.144:0/4273419531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8c13f760 0x7f2e8c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:38.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.742+0000 7f2e92000640 1 --2- 172.21.15.144:0/4273419531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e8c0b5fd0 0x7f2e8c142200 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009d90 tx=0x7f2e8402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b325084fbbfa295 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:38.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.745+0000 7f2e8be00640 1 -- 172.21.15.144:0/4273419531 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84007740 con 0x7f2e8c0b5fd0 2024-05-30T16:51:38.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.745+0000 7f2e8be00640 1 -- 172.21.15.144:0/4273419531 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e840078e0 con 0x7f2e8c0b5fd0 2024-05-30T16:51:38.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.745+0000 7f2e8be00640 1 -- 172.21.15.144:0/4273419531 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84007cb0 con 0x7f2e8c0b5fd0 2024-05-30T16:51:38.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.746+0000 7f2e94000640 1 -- 172.21.15.144:0/4273419531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e8c0b5fd0 msgr2=0x7f2e8c142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:38.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.746+0000 7f2e94000640 1 --2- 172.21.15.144:0/4273419531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e8c0b5fd0 0x7f2e8c142200 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009d90 tx=0x7f2e8402a6f0 comp rx=0 tx=0).stop 2024-05-30T16:51:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.747+0000 7f2e94000640 1 -- 172.21.15.144:0/4273419531 shutdown_connections 2024-05-30T16:51:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.747+0000 7f2e94000640 1 --2- 172.21.15.144:0/4273419531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e8c0b5fd0 0x7f2e8c142200 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.747+0000 7f2e94000640 1 --2- 172.21.15.144:0/4273419531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8c13f760 0x7f2e8c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.747+0000 7f2e94000640 1 -- 172.21.15.144:0/4273419531 >> 172.21.15.144:0/4273419531 conn(0x7f2e8c06bd00 msgr2=0x7f2e8c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:38.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.748+0000 7f2e94000640 1 -- 172.21.15.144:0/4273419531 shutdown_connections 2024-05-30T16:51:38.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.749+0000 7f2e94000640 1 -- 172.21.15.144:0/4273419531 wait complete. 2024-05-30T16:51:38.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.751+0000 7f2e94000640 1 Processor -- start 2024-05-30T16:51:38.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.751+0000 7f2e94000640 1 -- start start 2024-05-30T16:51:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.752+0000 7f2e94000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e8c0b5fd0 0x7f2e8c0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.752+0000 7f2e94000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e8c0cec70 0x7f2e8c1f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.752+0000 7f2e94000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8c13f760 0x7f2e8c155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.752+0000 7f2e94000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c160fd0 con 0x7f2e8c0cec70 2024-05-30T16:51:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.752+0000 7f2e94000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c160cf0 con 0x7f2e8c0b5fd0 2024-05-30T16:51:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.752+0000 7f2e94000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c0cf0d0 con 0x7f2e8c13f760 2024-05-30T16:51:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.754+0000 7f2e91600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e8c0b5fd0 0x7f2e8c0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:38.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.755+0000 7f2e90c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e8c0cec70 0x7f2e8c1f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:38.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.755+0000 7f2e90c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e8c0cec70 0x7f2e8c1f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47944/0 (socket says 172.21.15.144:47944) 2024-05-30T16:51:38.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.755+0000 7f2e90c00640 1 -- 172.21.15.144:0/2853977469 learned_addr learned my addr 172.21.15.144:0/2853977469 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:38.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.756+0000 7f2e90c00640 1 -- 172.21.15.144:0/2853977469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8c13f760 msgr2=0x7f2e8c155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:38.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.756+0000 7f2e90c00640 1 --2- 172.21.15.144:0/2853977469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e8c13f760 0x7f2e8c155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:38.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.756+0000 7f2e90c00640 1 -- 172.21.15.144:0/2853977469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e8c0b5fd0 msgr2=0x7f2e8c0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:38.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.758+0000 7f2e90c00640 1 --2- 172.21.15.144:0/2853977469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e8c0b5fd0 0x7f2e8c0b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:38.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.758+0000 7f2e90c00640 1 -- 172.21.15.144:0/2853977469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c0b1bf0 con 0x7f2e8c0cec70 2024-05-30T16:51:38.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.758+0000 7f2e91600640 1 --2- 172.21.15.144:0/2853977469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e8c0b5fd0 0x7f2e8c0b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:38.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.758+0000 7f2e90c00640 1 --2- 172.21.15.144:0/2853977469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e8c0cec70 0x7f2e8c1f36c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000c4a0 tx=0x7f2e8000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:38.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.760+0000 7f2e89600640 1 -- 172.21.15.144:0/2853977469 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80017070 con 0x7f2e8c0cec70 2024-05-30T16:51:38.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.760+0000 7f2e89600640 1 -- 172.21.15.144:0/2853977469 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e80005ce0 con 0x7f2e8c0cec70 2024-05-30T16:51:38.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.760+0000 7f2e89600640 1 -- 172.21.15.144:0/2853977469 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80007270 con 0x7f2e8c0cec70 2024-05-30T16:51:38.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.761+0000 7f2e94000640 1 -- 172.21.15.144:0/2853977469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c0a9a60 con 0x7f2e8c0cec70 2024-05-30T16:51:38.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.761+0000 7f2e94000640 1 -- 172.21.15.144:0/2853977469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c13e7f0 con 0x7f2e8c0cec70 2024-05-30T16:51:38.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.768+0000 7f2e94000640 1 -- 172.21.15.144:0/2853977469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8c068b90 con 0x7f2e8c0cec70 2024-05-30T16:51:38.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.770+0000 7f2e89600640 1 -- 172.21.15.144:0/2853977469 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f2e8001a070 con 0x7f2e8c0cec70 2024-05-30T16:51:38.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.772+0000 7f2e89600640 1 --2- 172.21.15.144:0/2853977469 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2e6c06d9d0 0x7f2e6c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:38.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.772+0000 7f2e89600640 1 -- 172.21.15.144:0/2853977469 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f2e80089ba0 con 0x7f2e8c0cec70 2024-05-30T16:51:38.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.792+0000 7f2e89600640 1 -- 172.21.15.144:0/2853977469 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e800590f0 con 0x7f2e8c0cec70 2024-05-30T16:51:38.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.800+0000 7f2e91600640 1 --2- 172.21.15.144:0/2853977469 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2e6c06d9d0 0x7f2e6c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:38.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:38.808+0000 7f2e91600640 1 --2- 172.21.15.144:0/2853977469 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f2e6c06d9d0 0x7f2e6c06fe90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2e78006fd0 tx=0x7f2e78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:39.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:39.390+0000 7f2e94000640 1 -- 172.21.15.144:0/2853977469 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone8317", "target": ["mon-mgr", ""]}) -- 0x7f2e8c075f70 con 0x7f2e6c06d9d0 2024-05-30T16:51:39.639 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:39.637+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:39.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:39.639+0000 7f2e89600640 1 -- 172.21.15.144:0/2853977469 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f2e78008580 con 0x7f2e6c06d9d0 2024-05-30T16:51:39.647 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:39.668 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:39.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone8318 2024-05-30T16:51:40.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.083+0000 7f25e5600640 1 Processor -- start 2024-05-30T16:51:40.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.083+0000 7f25e5600640 1 -- start start 2024-05-30T16:51:40.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.089+0000 7f25e5600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25e0072210 0x7f25e0072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:40.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.090+0000 7f25e5600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e0072b70 con 0x7f25e014c630 2024-05-30T16:51:40.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.090+0000 7f25e5600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e006fbf0 con 0x7f25e00b4140 2024-05-30T16:51:40.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.090+0000 7f25e5600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f25e00cf050 con 0x7f25e0072210 2024-05-30T16:51:40.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.090+0000 7f25dea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f25e014c630 0x7f25e00ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44250/0 (socket says 172.21.15.144:44250) 2024-05-30T16:51:40.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.091+0000 7f25dea00640 1 -- 172.21.15.144:0/1698340210 learned_addr learned my addr 172.21.15.144:0/1698340210 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:40.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.092+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217571161 0 0) 0x7f25e0072b70 con 0x7f25e014c630 2024-05-30T16:51:40.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.092+0000 7f25de000640 1 --2- 172.21.15.144:0/1698340210 >> v2:172.21.15.149:3300/0 conn(0x7f25e0072210 0x7f25e0072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:40.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.092+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25c4003520 con 0x7f25e014c630 2024-05-30T16:51:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.095+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3019392645 0 0) 0x7f25c4003520 con 0x7f25e014c630 2024-05-30T16:51:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.095+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 >> v2:172.21.15.149:3300/0 conn(0x7f25e0072210 msgr2=0x7f25e0072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.095+0000 7f25dd600640 1 --2- 172.21.15.144:0/1698340210 >> v2:172.21.15.149:3300/0 conn(0x7f25e0072210 0x7f25e0072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.095+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 >> v1:172.21.15.149:6789/0 conn(0x7f25e00b4140 legacy=0x7f25e00b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.095+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e00cf330 con 0x7f25e014c630 2024-05-30T16:51:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.096+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f25d0001650 con 0x7f25e014c630 2024-05-30T16:51:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.096+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 >> v1:172.21.15.144:6789/0 conn(0x7f25e014c630 legacy=0x7f25e00ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.096+0000 7f25dd600640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c40039b0 0x7f25c4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.096+0000 7f25dd600640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c4004800 0x7f25c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.096+0000 7f25dd600640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25c40052c0 0x7f25c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.096+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f25e00cf050 con 0x7f25c40039b0 2024-05-30T16:51:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.096+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f25c400c290 con 0x7f25c4004800 2024-05-30T16:51:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.096+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f25c400c490 con 0x7f25c40052c0 2024-05-30T16:51:40.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.098+0000 7f25de000640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c4004800 0x7f25c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:40.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.099+0000 7f25dea00640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c40039b0 0x7f25c4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:40.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.099+0000 7f25de000640 1 -- 172.21.15.144:0/1698340210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25c40052c0 msgr2=0x7f25c400b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:51:40.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.099+0000 7f25de000640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25c40052c0 0x7f25c400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:40.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.099+0000 7f25de000640 1 -- 172.21.15.144:0/1698340210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c40039b0 msgr2=0x7f25c4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:40.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.099+0000 7f25de000640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c40039b0 0x7f25c4003df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:40.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.100+0000 7f25de000640 1 -- 172.21.15.144:0/1698340210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c4003520 con 0x7f25c4004800 2024-05-30T16:51:40.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.100+0000 7f25df400640 1 -- 172.21.15.144:0/1698340210 reap_dead start 2024-05-30T16:51:40.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.103+0000 7f25de000640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c4004800 0x7f25c4004c80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00a9a0 tx=0x7f25c4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d938e78668f02faf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:40.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.103+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc037070 con 0x7f25c4004800 2024-05-30T16:51:40.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.103+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc02ab70 con 0x7f25c4004800 2024-05-30T16:51:40.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.103+0000 7f25dd600640 1 -- 172.21.15.144:0/1698340210 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00a570 con 0x7f25c4004800 2024-05-30T16:51:40.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.106+0000 7f25e5600640 1 -- 172.21.15.144:0/1698340210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c4004800 msgr2=0x7f25c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:40.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.106+0000 7f25e5600640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c4004800 0x7f25c4004c80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00a9a0 tx=0x7f25c4005830 comp rx=0 tx=0).stop 2024-05-30T16:51:40.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.110+0000 7f25e5600640 1 -- 172.21.15.144:0/1698340210 shutdown_connections 2024-05-30T16:51:40.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.110+0000 7f25e5600640 1 --2- 172.21.15.144:0/1698340210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c4004800 0x7f25c4004c80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:40.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.110+0000 7f25e5600640 1 -- 172.21.15.144:0/1698340210 >> 172.21.15.144:0/1698340210 conn(0x7f25e006bd00 msgr2=0x7f25e006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:40.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.114+0000 7f25e5600640 1 -- 172.21.15.144:0/1698340210 shutdown_connections 2024-05-30T16:51:40.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.114+0000 7f25e5600640 1 -- 172.21.15.144:0/1698340210 wait complete. 2024-05-30T16:51:40.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.120+0000 7f25e5600640 1 Processor -- start 2024-05-30T16:51:40.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.121+0000 7f25e5600640 1 -- start start 2024-05-30T16:51:40.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.123+0000 7f25e5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25c4004800 0x7f25e01f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:40.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.123+0000 7f25e5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25e01ec8b0 0x7f25e01ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:40.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.123+0000 7f25e5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25e0154460 0x7f25e01548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:40.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.123+0000 7f25e5600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f25e00b3c20 con 0x7f25e01ec8b0 2024-05-30T16:51:40.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.123+0000 7f25e5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f25e00cf8f0 con 0x7f25e0154460 2024-05-30T16:51:40.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.123+0000 7f25e5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f25e014ca10 con 0x7f25c4004800 2024-05-30T16:51:40.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.124+0000 7f25dea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25c4004800 0x7f25e01f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:40.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.124+0000 7f25dea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25c4004800 0x7f25e01f8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:59064/0 (socket says 172.21.15.144:59064) 2024-05-30T16:51:40.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.124+0000 7f25dea00640 1 -- 172.21.15.144:0/297067153 learned_addr learned my addr 172.21.15.144:0/297067153 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:40.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.126+0000 7f25de000640 1 --2- 172.21.15.144:0/297067153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25e01ec8b0 0x7f25e01ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:40.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.129+0000 7f25de000640 1 -- 172.21.15.144:0/297067153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25c4004800 msgr2=0x7f25e01f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:40.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.129+0000 7f25de000640 1 --2- 172.21.15.144:0/297067153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25c4004800 0x7f25e01f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:40.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.129+0000 7f25de000640 1 -- 172.21.15.144:0/297067153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25e0154460 msgr2=0x7f25e01548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.129+0000 7f25de000640 1 --2- 172.21.15.144:0/297067153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25e0154460 0x7f25e01548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.129+0000 7f25de000640 1 -- 172.21.15.144:0/297067153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e01eb810 con 0x7f25e01ec8b0 2024-05-30T16:51:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.130+0000 7f25de000640 1 --2- 172.21.15.144:0/297067153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25e01ec8b0 0x7f25e01ecd30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f25cc031000 tx=0x7f25cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:40.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.131+0000 7f25d6a00640 1 -- 172.21.15.144:0/297067153 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc037050 con 0x7f25e01ec8b0 2024-05-30T16:51:40.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.131+0000 7f25d6a00640 1 -- 172.21.15.144:0/297067153 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc043070 con 0x7f25e01ec8b0 2024-05-30T16:51:40.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.131+0000 7f25d6a00640 1 -- 172.21.15.144:0/297067153 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc037050 con 0x7f25e01ec8b0 2024-05-30T16:51:40.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.131+0000 7f25e5600640 1 -- 172.21.15.144:0/297067153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e01ebaf0 con 0x7f25e01ec8b0 2024-05-30T16:51:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.132+0000 7f25e5600640 1 -- 172.21.15.144:0/297067153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01ec0b0 con 0x7f25e01ec8b0 2024-05-30T16:51:40.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.136+0000 7f25e5600640 1 -- 172.21.15.144:0/297067153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e0068b90 con 0x7f25e01ec8b0 2024-05-30T16:51:40.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.139+0000 7f25d6a00640 1 -- 172.21.15.144:0/297067153 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f25cc03c610 con 0x7f25e01ec8b0 2024-05-30T16:51:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.141+0000 7f25d6a00640 1 --2- 172.21.15.144:0/297067153 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f25c006dbd0 0x7f25c0070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.142+0000 7f25d6a00640 1 -- 172.21.15.144:0/297067153 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f25cc0aacb0 con 0x7f25e01ec8b0 2024-05-30T16:51:40.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.152+0000 7f25d6a00640 1 -- 172.21.15.144:0/297067153 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25cc07a4b0 con 0x7f25e01ec8b0 2024-05-30T16:51:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.157+0000 7f25dea00640 1 --2- 172.21.15.144:0/297067153 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f25c006dbd0 0x7f25c0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.159+0000 7f25dea00640 1 --2- 172.21.15.144:0/297067153 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f25c006dbd0 0x7f25c0070090 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f25d00011e0 tx=0x7f25d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.754+0000 7f25e5600640 1 -- 172.21.15.144:0/297067153 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone8318", "target": ["mon-mgr", ""]}) -- 0x7f25e01f8cd0 con 0x7f25c006dbd0 2024-05-30T16:51:40.930 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:40.928+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:40.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:40.929+0000 7f25d6a00640 1 -- 172.21.15.144:0/297067153 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f25e01f8cd0 con 0x7f25c006dbd0 2024-05-30T16:51:40.936 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:40.965 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:40.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone8319 2024-05-30T16:51:41.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.359+0000 7f133fe00640 1 Processor -- start 2024-05-30T16:51:41.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.359+0000 7f133fe00640 1 -- start start 2024-05-30T16:51:41.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.362+0000 7f133fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f133815bb00 0x7f1338140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:41.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.362+0000 7f133fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338071df0 0x7f1338072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:41.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.362+0000 7f133fe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13380b6310 con 0x7f1338070500 2024-05-30T16:51:41.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.362+0000 7f133fe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f1338072780 con 0x7f133815bb00 2024-05-30T16:51:41.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.362+0000 7f133fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f133815b040 con 0x7f1338071df0 2024-05-30T16:51:41.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.363+0000 7f133de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338071df0 0x7f1338072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:41.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.363+0000 7f133de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338071df0 0x7f1338072240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:59074/0 (socket says 172.21.15.144:59074) 2024-05-30T16:51:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.363+0000 7f133de00640 1 -- 172.21.15.144:0/2994818960 learned_addr learned my addr 172.21.15.144:0/2994818960 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.363+0000 7f133ca00640 1 --2- 172.21.15.144:0/2994818960 >> v2:172.21.15.149:3300/0 conn(0x7f133815bb00 0x7f1338140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.365+0000 7f133ca00640 1 -- 172.21.15.144:0/2994818960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338071df0 msgr2=0x7f1338072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.365+0000 7f133ca00640 1 --2- 172.21.15.144:0/2994818960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338071df0 0x7f1338072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.365+0000 7f133ca00640 1 -- 172.21.15.144:0/2994818960 >> v1:172.21.15.149:6789/0 conn(0x7f1338070500 legacy=0x7f133815ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.365+0000 7f133ca00640 1 -- 172.21.15.144:0/2994818960 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133815b320 con 0x7f133815bb00 2024-05-30T16:51:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.367+0000 7f133ca00640 1 --2- 172.21.15.144:0/2994818960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f133815bb00 0x7f1338140cb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f132c0097a0 tx=0x7f132c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c6b6a612e7e0a15 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.369+0000 7f1337e00640 1 -- 172.21.15.144:0/2994818960 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c037070 con 0x7f133815bb00 2024-05-30T16:51:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.369+0000 7f1337e00640 1 -- 172.21.15.144:0/2994818960 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c02ada0 con 0x7f133815bb00 2024-05-30T16:51:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.369+0000 7f1337e00640 1 -- 172.21.15.144:0/2994818960 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c032660 con 0x7f133815bb00 2024-05-30T16:51:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.371+0000 7f133fe00640 1 -- 172.21.15.144:0/2994818960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f133815bb00 msgr2=0x7f1338140cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.371+0000 7f133fe00640 1 --2- 172.21.15.144:0/2994818960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f133815bb00 0x7f1338140cb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f132c0097a0 tx=0x7f132c02a110 comp rx=0 tx=0).stop 2024-05-30T16:51:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.373+0000 7f133fe00640 1 -- 172.21.15.144:0/2994818960 shutdown_connections 2024-05-30T16:51:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.373+0000 7f133fe00640 1 --2- 172.21.15.144:0/2994818960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338071df0 0x7f1338072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.373+0000 7f133fe00640 1 --2- 172.21.15.144:0/2994818960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f133815bb00 0x7f1338140cb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.373+0000 7f133fe00640 1 -- 172.21.15.144:0/2994818960 >> 172.21.15.144:0/2994818960 conn(0x7f1338070050 msgr2=0x7f133806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.375+0000 7f133fe00640 1 -- 172.21.15.144:0/2994818960 shutdown_connections 2024-05-30T16:51:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.376+0000 7f133fe00640 1 -- 172.21.15.144:0/2994818960 wait complete. 2024-05-30T16:51:41.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.383+0000 7f133fe00640 1 Processor -- start 2024-05-30T16:51:41.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.384+0000 7f133fe00640 1 -- start start 2024-05-30T16:51:41.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.389+0000 7f133fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338070500 0x7f1338159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:41.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.391+0000 7f133fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1338071df0 0x7f13380ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:41.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.391+0000 7f133fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f133815bb00 0x7f13380cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:41.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.394+0000 7f133fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13381411f0 con 0x7f133815bb00 2024-05-30T16:51:41.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.394+0000 7f133fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13380b5fb0 con 0x7f1338071df0 2024-05-30T16:51:41.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.394+0000 7f133fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1338141370 con 0x7f1338070500 2024-05-30T16:51:41.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.394+0000 7f133de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f133815bb00 0x7f13380cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:41.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.394+0000 7f133de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f133815bb00 0x7f13380cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47956/0 (socket says 172.21.15.144:47956) 2024-05-30T16:51:41.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.394+0000 7f133de00640 1 -- 172.21.15.144:0/4026393948 learned_addr learned my addr 172.21.15.144:0/4026393948 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:41.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.392+0000 7f133d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338070500 0x7f1338159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:41.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.392+0000 7f133ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1338071df0 0x7f13380ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:41.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.398+0000 7f133de00640 1 -- 172.21.15.144:0/4026393948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338070500 msgr2=0x7f1338159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:41.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.398+0000 7f133de00640 1 --2- 172.21.15.144:0/4026393948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1338070500 0x7f1338159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:41.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.398+0000 7f133de00640 1 -- 172.21.15.144:0/4026393948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1338071df0 msgr2=0x7f13380ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:41.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.398+0000 7f133de00640 1 --2- 172.21.15.144:0/4026393948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1338071df0 0x7f13380ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:41.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.398+0000 7f133de00640 1 -- 172.21.15.144:0/4026393948 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1338154370 con 0x7f133815bb00 2024-05-30T16:51:41.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.398+0000 7f133de00640 1 --2- 172.21.15.144:0/4026393948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f133815bb00 0x7f13380cedf0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f133000efc0 tx=0x7f133000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:41.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.399+0000 7f1335600640 1 -- 172.21.15.144:0/4026393948 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133000ccc0 con 0x7f133815bb00 2024-05-30T16:51:41.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.400+0000 7f133fe00640 1 -- 172.21.15.144:0/4026393948 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1338158c70 con 0x7f133815bb00 2024-05-30T16:51:41.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.400+0000 7f1335600640 1 -- 172.21.15.144:0/4026393948 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1330003990 con 0x7f133815bb00 2024-05-30T16:51:41.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.400+0000 7f1335600640 1 -- 172.21.15.144:0/4026393948 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330003d80 con 0x7f133815bb00 2024-05-30T16:51:41.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.402+0000 7f133fe00640 1 -- 172.21.15.144:0/4026393948 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1338159230 con 0x7f133815bb00 2024-05-30T16:51:41.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.405+0000 7f133fe00640 1 -- 172.21.15.144:0/4026393948 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1338068b90 con 0x7f133815bb00 2024-05-30T16:51:41.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.408+0000 7f1335600640 1 -- 172.21.15.144:0/4026393948 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f1330012050 con 0x7f133815bb00 2024-05-30T16:51:41.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.412+0000 7f1335600640 1 --2- 172.21.15.144:0/4026393948 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f131806da20 0x7f131806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:41.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.417+0000 7f1335600640 1 -- 172.21.15.144:0/4026393948 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f1330057c70 con 0x7f133815bb00 2024-05-30T16:51:41.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.426+0000 7f133d400640 1 --2- 172.21.15.144:0/4026393948 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f131806da20 0x7f131806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.427+0000 7f1335600640 1 -- 172.21.15.144:0/4026393948 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1330010040 con 0x7f133815bb00 2024-05-30T16:51:41.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.432+0000 7f133d400640 1 --2- 172.21.15.144:0/4026393948 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f131806da20 0x7f131806fee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1324000f60 tx=0x7f1324009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:41.969+0000 7f133fe00640 1 -- 172.21.15.144:0/4026393948 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone8319", "target": ["mon-mgr", ""]}) -- 0x7f13380cded0 con 0x7f131806da20 2024-05-30T16:51:42.240 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:42.238+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:42.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.242+0000 7f1335600640 1 -- 172.21.15.144:0/4026393948 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f13380cded0 con 0x7f131806da20 2024-05-30T16:51:42.248 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:42.277 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:42.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83110 2024-05-30T16:51:42.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.645+0000 7f9111a00640 1 Processor -- start 2024-05-30T16:51:42.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.645+0000 7f9111a00640 1 -- start start 2024-05-30T16:51:42.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.653+0000 7f9111a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9104053380 0x7f9104038bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.653+0000 7f9111a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91040e3640 con 0x7f91040e3260 2024-05-30T16:51:42.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.653+0000 7f9111a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9104053930 con 0x7f910404ff80 2024-05-30T16:51:42.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.653+0000 7f9111a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9104053c10 con 0x7f9104053380 2024-05-30T16:51:42.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.653+0000 7f910be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f91040e3260 0x7f910404f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44260/0 (socket says 172.21.15.144:44260) 2024-05-30T16:51:42.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.653+0000 7f910be00640 1 -- 172.21.15.144:0/2130795692 learned_addr learned my addr 172.21.15.144:0/2130795692 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:42.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.654+0000 7f9111000640 1 --2- 172.21.15.144:0/2130795692 >> v2:172.21.15.144:3300/0 conn(0x7f9104053380 0x7f9104038bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.654+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968764480 0 0) 0x7f91040e3640 con 0x7f91040e3260 2024-05-30T16:51:42.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.654+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90f4003520 con 0x7f91040e3260 2024-05-30T16:51:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.655+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2664322941 0 0) 0x7f90f4003520 con 0x7f91040e3260 2024-05-30T16:51:42.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.655+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 >> v2:172.21.15.144:3300/0 conn(0x7f9104053380 msgr2=0x7f9104038bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.655+0000 7f910aa00640 1 --2- 172.21.15.144:0/2130795692 >> v2:172.21.15.144:3300/0 conn(0x7f9104053380 0x7f9104038bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.655+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 >> v1:172.21.15.149:6789/0 conn(0x7f910404ff80 legacy=0x7f9104052c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.655+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9104053ef0 con 0x7f91040e3260 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.655+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f9100001690 con 0x7f91040e3260 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.655+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 >> v1:172.21.15.144:6789/0 conn(0x7f91040e3260 legacy=0x7f910404f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.655+0000 7f910aa00640 1 --2- 172.21.15.144:0/2130795692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f40039b0 0x7f90f4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.655+0000 7f910aa00640 1 --2- 172.21.15.144:0/2130795692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f4004800 0x7f90f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910aa00640 1 --2- 172.21.15.144:0/2130795692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90f40051c0 0x7f90f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910b400640 1 --2- 172.21.15.144:0/2130795692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f4004800 0x7f90f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9104053c10 con 0x7f90f4004800 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f90f400c040 con 0x7f90f40039b0 2024-05-30T16:51:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f90f400c240 con 0x7f90f40051c0 2024-05-30T16:51:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910b400640 1 -- 172.21.15.144:0/2130795692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90f40051c0 msgr2=0x7f90f400b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:51:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910b400640 1 --2- 172.21.15.144:0/2130795692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90f40051c0 0x7f90f400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910b400640 1 -- 172.21.15.144:0/2130795692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f40039b0 msgr2=0x7f90f4003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:51:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910b400640 1 --2- 172.21.15.144:0/2130795692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f40039b0 0x7f90f4003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f910b400640 1 -- 172.21.15.144:0/2130795692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9104053ef0 con 0x7f90f4004800 2024-05-30T16:51:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.656+0000 7f9111000640 1 -- 172.21.15.144:0/2130795692 reap_dead start 2024-05-30T16:51:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.657+0000 7f910b400640 1 --2- 172.21.15.144:0/2130795692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f4004800 0x7f90f4004c80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f90f8001640 tx=0x7f90f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9d3e9ab27e2a41 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.658+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f8001240 con 0x7f90f4004800 2024-05-30T16:51:42.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.658+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f802e070 con 0x7f90f4004800 2024-05-30T16:51:42.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.658+0000 7f910aa00640 1 -- 172.21.15.144:0/2130795692 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f802a7a0 con 0x7f90f4004800 2024-05-30T16:51:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.659+0000 7f9111a00640 1 -- 172.21.15.144:0/2130795692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f4004800 msgr2=0x7f90f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.659+0000 7f9111a00640 1 --2- 172.21.15.144:0/2130795692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f4004800 0x7f90f4004c80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f90f8001640 tx=0x7f90f4005830 comp rx=0 tx=0).stop 2024-05-30T16:51:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.659+0000 7f9111a00640 1 -- 172.21.15.144:0/2130795692 shutdown_connections 2024-05-30T16:51:42.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.659+0000 7f9111a00640 1 --2- 172.21.15.144:0/2130795692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f4004800 0x7f90f4004c80 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.659+0000 7f9111a00640 1 -- 172.21.15.144:0/2130795692 >> 172.21.15.144:0/2130795692 conn(0x7f9104009fb0 msgr2=0x7f910400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:42.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.660+0000 7f9111a00640 1 -- 172.21.15.144:0/2130795692 shutdown_connections 2024-05-30T16:51:42.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.660+0000 7f9111a00640 1 -- 172.21.15.144:0/2130795692 wait complete. 2024-05-30T16:51:42.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.667+0000 7f9111a00640 1 Processor -- start 2024-05-30T16:51:42.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.668+0000 7f9111a00640 1 -- start start 2024-05-30T16:51:42.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.671+0000 7f9111a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90f4004800 0x7f91041802c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.671+0000 7f9111a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9104038100 0x7f9104038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.671+0000 7f9111a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9104048850 0x7f9104048cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.671+0000 7f9111a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9104052c70 con 0x7f9104048850 2024-05-30T16:51:42.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.671+0000 7f9111a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91040544b0 con 0x7f9104038100 2024-05-30T16:51:42.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.671+0000 7f9111a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9104052df0 con 0x7f90f4004800 2024-05-30T16:51:42.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.672+0000 7f9111000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9104048850 0x7f9104048cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.672+0000 7f9111000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9104048850 0x7f9104048cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47976/0 (socket says 172.21.15.144:47976) 2024-05-30T16:51:42.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.672+0000 7f9111000640 1 -- 172.21.15.144:0/3880447707 learned_addr learned my addr 172.21.15.144:0/3880447707 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:42.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.673+0000 7f9111000640 1 -- 172.21.15.144:0/3880447707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90f4004800 msgr2=0x7f91041802c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:51:42.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.673+0000 7f9111000640 1 --2- 172.21.15.144:0/3880447707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90f4004800 0x7f91041802c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.673+0000 7f9111000640 1 -- 172.21.15.144:0/3880447707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9104038100 msgr2=0x7f9104038580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T16:51:42.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.673+0000 7f9111000640 1 --2- 172.21.15.144:0/3880447707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9104038100 0x7f9104038580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:42.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.673+0000 7f9111000640 1 -- 172.21.15.144:0/3880447707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91040495c0 con 0x7f9104048850 2024-05-30T16:51:42.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.673+0000 7f9111000640 1 --2- 172.21.15.144:0/3880447707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9104048850 0x7f9104048cd0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f910c050f50 tx=0x7f910c0694f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:42.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.674+0000 7f90ffe00640 1 -- 172.21.15.144:0/3880447707 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c075540 con 0x7f9104048850 2024-05-30T16:51:42.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.674+0000 7f90ffe00640 1 -- 172.21.15.144:0/3880447707 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f910c075700 con 0x7f9104048850 2024-05-30T16:51:42.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.674+0000 7f90ffe00640 1 -- 172.21.15.144:0/3880447707 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c095680 con 0x7f9104048850 2024-05-30T16:51:42.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.674+0000 7f9111a00640 1 -- 172.21.15.144:0/3880447707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91040498a0 con 0x7f9104048850 2024-05-30T16:51:42.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.674+0000 7f9111a00640 1 -- 172.21.15.144:0/3880447707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9104049e60 con 0x7f9104048850 2024-05-30T16:51:42.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.681+0000 7f9111a00640 1 -- 172.21.15.144:0/3880447707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e8005290 con 0x7f9104048850 2024-05-30T16:51:42.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.686+0000 7f90ffe00640 1 -- 172.21.15.144:0/3880447707 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f910c068dc0 con 0x7f9104048850 2024-05-30T16:51:42.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.692+0000 7f90ffe00640 1 --2- 172.21.15.144:0/3880447707 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f90ec06daa0 0x7f90ec06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.694+0000 7f90ffe00640 1 -- 172.21.15.144:0/3880447707 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f910c105d40 con 0x7f9104048850 2024-05-30T16:51:42.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.698+0000 7f90ffe00640 1 -- 172.21.15.144:0/3880447707 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f910c106680 con 0x7f9104048850 2024-05-30T16:51:42.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.715+0000 7f910be00640 1 --2- 172.21.15.144:0/3880447707 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f90ec06daa0 0x7f90ec06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:42.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:42.757+0000 7f910be00640 1 --2- 172.21.15.144:0/3880447707 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f90ec06daa0 0x7f90ec06ff60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9104003e80 tx=0x7f91000015e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:43.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:43.181+0000 7f9111a00640 1 -- 172.21.15.144:0/3880447707 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83110", "target": ["mon-mgr", ""]}) -- 0x7f90e8000bc0 con 0x7f90ec06daa0 2024-05-30T16:51:43.590 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:43.588+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:43.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:43.588+0000 7f90ffe00640 1 -- 172.21.15.144:0/3880447707 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f90e8000bc0 con 0x7f90ec06daa0 2024-05-30T16:51:43.592 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:43.631 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:43.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83111 2024-05-30T16:51:44.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.021+0000 7fa06fc00640 1 Processor -- start 2024-05-30T16:51:44.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.021+0000 7fa06fc00640 1 -- start start 2024-05-30T16:51:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.023+0000 7fa06fc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0680d3b70 0x7fa0680ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.023+0000 7fa06fc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0680b91c0 con 0x7fa0680b6a10 2024-05-30T16:51:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.023+0000 7fa06fc00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0680b94a0 con 0x7fa06815ea90 2024-05-30T16:51:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.023+0000 7fa06fc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa0680b9dd0 con 0x7fa0680d3b70 2024-05-30T16:51:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.024+0000 7fa067e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa0680b6a10 0x7fa0680b79b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44276/0 (socket says 172.21.15.144:44276) 2024-05-30T16:51:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.024+0000 7fa067e00640 1 -- 172.21.15.144:0/587712711 learned_addr learned my addr 172.21.15.144:0/587712711 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.024+0000 7fa06dc00640 1 --2- 172.21.15.144:0/587712711 >> v2:172.21.15.144:3300/0 conn(0x7fa0680d3b70 0x7fa0680ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.024+0000 7fa067400640 1 -- 172.21.15.144:0/587712711 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122086835 0 0) 0x7fa0680b91c0 con 0x7fa0680b6a10 2024-05-30T16:51:44.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.024+0000 7fa067400640 1 -- 172.21.15.144:0/587712711 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa050003520 con 0x7fa0680b6a10 2024-05-30T16:51:44.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.024+0000 7fa067400640 1 -- 172.21.15.144:0/587712711 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331316686 0 0) 0x7fa0680b94a0 con 0x7fa06815ea90 2024-05-30T16:51:44.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.025+0000 7fa067400640 1 -- 172.21.15.144:0/587712711 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0680b91c0 con 0x7fa06815ea90 2024-05-30T16:51:44.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.025+0000 7fa06dc00640 1 -- 172.21.15.144:0/587712711 >> v1:172.21.15.149:6789/0 conn(0x7fa06815ea90 legacy=0x7fa0680b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:44.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.025+0000 7fa06dc00640 1 -- 172.21.15.144:0/587712711 >> v1:172.21.15.144:6789/0 conn(0x7fa0680b6a10 legacy=0x7fa0680b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:44.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.025+0000 7fa06dc00640 1 -- 172.21.15.144:0/587712711 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0680b9780 con 0x7fa0680d3b70 2024-05-30T16:51:44.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.027+0000 7fa06dc00640 1 --2- 172.21.15.144:0/587712711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0680d3b70 0x7fa0680ba330 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa060009d90 tx=0x7fa06002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f498a64ed157b01 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:44.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.029+0000 7fa067400640 1 -- 172.21.15.144:0/587712711 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060007740 con 0x7fa0680d3b70 2024-05-30T16:51:44.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.029+0000 7fa067400640 1 -- 172.21.15.144:0/587712711 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0600078e0 con 0x7fa0680d3b70 2024-05-30T16:51:44.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.029+0000 7fa067400640 1 -- 172.21.15.144:0/587712711 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060007cb0 con 0x7fa0680d3b70 2024-05-30T16:51:44.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.030+0000 7fa06fc00640 1 -- 172.21.15.144:0/587712711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0680d3b70 msgr2=0x7fa0680ba330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:44.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.030+0000 7fa06fc00640 1 --2- 172.21.15.144:0/587712711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0680d3b70 0x7fa0680ba330 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa060009d90 tx=0x7fa06002a6f0 comp rx=0 tx=0).stop 2024-05-30T16:51:44.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.031+0000 7fa06fc00640 1 -- 172.21.15.144:0/587712711 shutdown_connections 2024-05-30T16:51:44.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.031+0000 7fa06fc00640 1 --2- 172.21.15.144:0/587712711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0680d3b70 0x7fa0680ba330 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:44.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.032+0000 7fa06fc00640 1 -- 172.21.15.144:0/587712711 >> 172.21.15.144:0/587712711 conn(0x7fa0680627b0 msgr2=0x7fa068062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:44.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.033+0000 7fa06fc00640 1 -- 172.21.15.144:0/587712711 shutdown_connections 2024-05-30T16:51:44.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.033+0000 7fa06fc00640 1 -- 172.21.15.144:0/587712711 wait complete. 2024-05-30T16:51:44.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.037+0000 7fa06fc00640 1 Processor -- start 2024-05-30T16:51:44.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.037+0000 7fa06fc00640 1 -- start start 2024-05-30T16:51:44.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.039+0000 7fa06fc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0680b6a10 0x7fa0681613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:44.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.039+0000 7fa06fc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0680d3b70 0x7fa06815eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:44.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.039+0000 7fa06fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06815ea90 0x7fa0681599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:44.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.039+0000 7fa06fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa0681696a0 con 0x7fa06815ea90 2024-05-30T16:51:44.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.039+0000 7fa06fc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa06815ee70 con 0x7fa0680d3b70 2024-05-30T16:51:44.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.039+0000 7fa06fc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa068169820 con 0x7fa0680b6a10 2024-05-30T16:51:44.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.040+0000 7fa06dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06815ea90 0x7fa0681599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.040+0000 7fa06dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06815ea90 0x7fa0681599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47988/0 (socket says 172.21.15.144:47988) 2024-05-30T16:51:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.040+0000 7fa06dc00640 1 -- 172.21.15.144:0/1139030182 learned_addr learned my addr 172.21.15.144:0/1139030182 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.041+0000 7fa06dc00640 1 -- 172.21.15.144:0/1139030182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0680b6a10 msgr2=0x7fa0681613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.041+0000 7fa06dc00640 1 --2- 172.21.15.144:0/1139030182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0680b6a10 0x7fa0681613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.041+0000 7fa06dc00640 1 -- 172.21.15.144:0/1139030182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0680d3b70 msgr2=0x7fa06815eff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T16:51:44.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.042+0000 7fa067e00640 1 --2- 172.21.15.144:0/1139030182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0680d3b70 0x7fa06815eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:44.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.042+0000 7fa06dc00640 1 --2- 172.21.15.144:0/1139030182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0680d3b70 0x7fa06815eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:44.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.042+0000 7fa06dc00640 1 -- 172.21.15.144:0/1139030182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06815f530 con 0x7fa06815ea90 2024-05-30T16:51:44.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.043+0000 7fa06dc00640 1 --2- 172.21.15.144:0/1139030182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06815ea90 0x7fa0681599a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fa06002ace0 tx=0x7fa060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:44.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.044+0000 7fa064c00640 1 -- 172.21.15.144:0/1139030182 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060040070 con 0x7fa06815ea90 2024-05-30T16:51:44.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.044+0000 7fa064c00640 1 -- 172.21.15.144:0/1139030182 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa060031b40 con 0x7fa06815ea90 2024-05-30T16:51:44.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.044+0000 7fa064c00640 1 -- 172.21.15.144:0/1139030182 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060045460 con 0x7fa06815ea90 2024-05-30T16:51:44.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.045+0000 7fa06fc00640 1 -- 172.21.15.144:0/1139030182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06815f7d0 con 0x7fa06815ea90 2024-05-30T16:51:44.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.047+0000 7fa06fc00640 1 -- 172.21.15.144:0/1139030182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06815fd90 con 0x7fa06815ea90 2024-05-30T16:51:44.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.050+0000 7fa06fc00640 1 -- 172.21.15.144:0/1139030182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa068068b90 con 0x7fa06815ea90 2024-05-30T16:51:44.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.056+0000 7fa064c00640 1 -- 172.21.15.144:0/1139030182 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7fa060039040 con 0x7fa06815ea90 2024-05-30T16:51:44.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.059+0000 7fa064c00640 1 --2- 172.21.15.144:0/1139030182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa04806daa0 0x7fa04806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:44.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.060+0000 7fa064c00640 1 -- 172.21.15.144:0/1139030182 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fa0600ac190 con 0x7fa06815ea90 2024-05-30T16:51:44.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.062+0000 7fa06d200640 1 --2- 172.21.15.144:0/1139030182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa04806daa0 0x7fa04806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.065+0000 7fa06d200640 1 --2- 172.21.15.144:0/1139030182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa04806daa0 0x7fa04806ff60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0011e0 tx=0x7fa05c0078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:44.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.066+0000 7fa064c00640 1 -- 172.21.15.144:0/1139030182 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa06003ae60 con 0x7fa06815ea90 2024-05-30T16:51:44.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.619+0000 7fa06fc00640 1 -- 172.21.15.144:0/1139030182 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83111", "target": ["mon-mgr", ""]}) -- 0x7fa0680ba4d0 con 0x7fa04806daa0 2024-05-30T16:51:44.767 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-05-30T16:51:44.766+0000 7fe1c9200640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:44.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:44.766+0000 7fa064c00640 1 -- 172.21.15.144:0/1139030182 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fa0680ba4d0 con 0x7fa04806daa0 2024-05-30T16:51:44.768 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T16:51:44.791 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T16:51:44.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83112 2024-05-30T16:51:45.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.241+0000 7f4557200640 1 Processor -- start 2024-05-30T16:51:45.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.243+0000 7f4557200640 1 -- start start 2024-05-30T16:51:45.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.247+0000 7f4557200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f455004fa90 0x7f455004fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:45.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.247+0000 7f4557200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f45500df420 0x7f45500382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:45.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.249+0000 7f4557200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45500503b0 con 0x7f4550038800 2024-05-30T16:51:45.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.250+0000 7f4557200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f45500068a0 con 0x7f455004fa90 2024-05-30T16:51:45.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.250+0000 7f4557200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f4550006af0 con 0x7f45500df420 2024-05-30T16:51:45.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.250+0000 7f4555400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f45500df420 0x7f45500382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:45.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.250+0000 7f4555400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f45500df420 0x7f45500382c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:50778/0 (socket says 172.21.15.144:50778) 2024-05-30T16:51:45.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.250+0000 7f4555400640 1 -- 172.21.15.144:0/4199511228 learned_addr learned my addr 172.21.15.144:0/4199511228 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:45.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.251+0000 7f4555e00640 1 --2- 172.21.15.144:0/4199511228 >> v2:172.21.15.144:3300/0 conn(0x7f455004fa90 0x7f455004fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:45.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.252+0000 7f4555400640 1 -- 172.21.15.144:0/4199511228 >> v2:172.21.15.144:3300/0 conn(0x7f455004fa90 msgr2=0x7f455004fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:45.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.252+0000 7f4555400640 1 --2- 172.21.15.144:0/4199511228 >> v2:172.21.15.144:3300/0 conn(0x7f455004fa90 0x7f455004fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:45.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.252+0000 7f4555400640 1 -- 172.21.15.144:0/4199511228 >> v1:172.21.15.144:6789/0 conn(0x7f4550038800 legacy=0x7f4550038c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T16:51:45.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.253+0000 7f4555400640 1 -- 172.21.15.144:0/4199511228 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4550006dd0 con 0x7f45500df420 2024-05-30T16:51:45.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.253+0000 7f4555e00640 1 --2- 172.21.15.144:0/4199511228 >> v2:172.21.15.144:3300/0 conn(0x7f455004fa90 0x7f455004fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:45.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.258+0000 7f4555400640 1 --2- 172.21.15.144:0/4199511228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45500df420 0x7f45500382c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4550007a60 tx=0x7f454802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab5ad9690586504f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:45.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.262+0000 7f4554a00640 1 -- 172.21.15.144:0/4199511228 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548037070 con 0x7f45500df420 2024-05-30T16:51:45.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.262+0000 7f4554a00640 1 -- 172.21.15.144:0/4199511228 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4548032440 con 0x7f45500df420 2024-05-30T16:51:45.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.264+0000 7f4557200640 1 -- 172.21.15.144:0/4199511228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45500df420 msgr2=0x7f45500382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:45.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.264+0000 7f4557200640 1 --2- 172.21.15.144:0/4199511228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45500df420 0x7f45500382c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4550007a60 tx=0x7f454802a250 comp rx=0 tx=0).stop 2024-05-30T16:51:45.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.270+0000 7f4557200640 1 -- 172.21.15.144:0/4199511228 shutdown_connections 2024-05-30T16:51:45.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.270+0000 7f4557200640 1 --2- 172.21.15.144:0/4199511228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45500df420 0x7f45500382c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:45.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.270+0000 7f4557200640 1 --2- 172.21.15.144:0/4199511228 >> v2:172.21.15.144:3300/0 conn(0x7f455004fa90 0x7f455004fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:45.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.270+0000 7f4557200640 1 -- 172.21.15.144:0/4199511228 >> 172.21.15.144:0/4199511228 conn(0x7f4550009fb0 msgr2=0x7f455000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:45.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.270+0000 7f4557200640 1 -- 172.21.15.144:0/4199511228 shutdown_connections 2024-05-30T16:51:45.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.270+0000 7f4557200640 1 -- 172.21.15.144:0/4199511228 wait complete. 2024-05-30T16:51:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.275+0000 7f4557200640 1 Processor -- start 2024-05-30T16:51:45.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.276+0000 7f4557200640 1 -- start start 2024-05-30T16:51:45.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.283+0000 7f4557200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4550038800 0x7f45500dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.283+0000 7f4557200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455004fa90 0x7f45501889f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.284+0000 7f4557200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45500df420 0x7f4550049080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.284+0000 7f4557200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4550052b40 con 0x7f455004fa90 2024-05-30T16:51:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.284+0000 7f4557200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4550007390 con 0x7f45500df420 2024-05-30T16:51:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.284+0000 7f4555e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4550038800 0x7f45500dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.284+0000 7f4555e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4550038800 0x7f45500dbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:58962/0 (socket says 172.21.15.144:58962) 2024-05-30T16:51:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.284+0000 7f4555e00640 1 -- 172.21.15.144:0/1929880228 learned_addr learned my addr 172.21.15.144:0/1929880228 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.285+0000 7f4557200640 1 -- 172.21.15.144:0/1929880228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4550052cc0 con 0x7f4550038800 2024-05-30T16:51:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.285+0000 7f4556800640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45500df420 0x7f4550049080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.286+0000 7f4555400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455004fa90 0x7f45501889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.286+0000 7f4555e00640 1 -- 172.21.15.144:0/1929880228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45500df420 msgr2=0x7f4550049080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.286+0000 7f4555e00640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45500df420 0x7f4550049080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.289+0000 7f4555e00640 1 -- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455004fa90 msgr2=0x7f45501889f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.289+0000 7f4555e00640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455004fa90 0x7f45501889f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.289+0000 7f4555e00640 1 -- 172.21.15.144:0/1929880228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4550048910 con 0x7f4550038800 2024-05-30T16:51:45.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.289+0000 7f4555400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455004fa90 0x7f45501889f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:51:45.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.290+0000 7f4555e00640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4550038800 0x7f45500dbc40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4558074840 tx=0x7f45580694f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:45.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.291+0000 7f454e000640 1 -- 172.21.15.144:0/1929880228 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45580755c0 con 0x7f4550038800 2024-05-30T16:51:45.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.291+0000 7f4557200640 1 -- 172.21.15.144:0/1929880228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45500df9a0 con 0x7f4550038800 2024-05-30T16:51:45.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.293+0000 7f454e000640 1 -- 172.21.15.144:0/1929880228 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4558075760 con 0x7f4550038800 2024-05-30T16:51:45.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.293+0000 7f454e000640 1 -- 172.21.15.144:0/1929880228 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45580755c0 con 0x7f4550038800 2024-05-30T16:51:45.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.299+0000 7f4557200640 1 -- 172.21.15.144:0/1929880228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4550188f30 con 0x7f4550038800 2024-05-30T16:51:45.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.301+0000 7f454e000640 1 -- 172.21.15.144:0/1929880228 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f4558095440 con 0x7f4550038800 2024-05-30T16:51:45.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.302+0000 7f454e000640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f453806dbd0 0x7f4538070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:45.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.302+0000 7f4543400640 1 -- 172.21.15.144:0/1929880228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452c005290 con 0x7f4550038800 2024-05-30T16:51:45.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.303+0000 7f454e000640 1 -- 172.21.15.144:0/1929880228 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f4558105360 con 0x7f4550038800 2024-05-30T16:51:45.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.315+0000 7f4555400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f453806dbd0 0x7f4538070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:45.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.315+0000 7f454e000640 1 -- 172.21.15.144:0/1929880228 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45580d4d40 con 0x7f4550038800 2024-05-30T16:51:45.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.335+0000 7f4555400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f453806dbd0 0x7f4538070090 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4548034000 tx=0x7f454802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:45.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:45.926+0000 7f4543400640 1 -- 172.21.15.144:0/1929880228 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83112", "target": ["mon-mgr", ""]}) -- 0x7f452c000bc0 con 0x7f453806dbd0 2024-05-30T16:51:47.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.519+0000 7f454e000640 1 -- 172.21.15.144:0/1929880228 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f452c000bc0 con 0x7f453806dbd0 2024-05-30T16:51:47.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.526+0000 7f4543400640 1 -- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f453806dbd0 msgr2=0x7f4538070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:47.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.526+0000 7f4543400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f453806dbd0 0x7f4538070090 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4548034000 tx=0x7f454802e000 comp rx=0 tx=0).stop 2024-05-30T16:51:47.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.526+0000 7f4543400640 1 -- 172.21.15.144:0/1929880228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4550038800 msgr2=0x7f45500dbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:47.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.526+0000 7f4543400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4550038800 0x7f45500dbc40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4558074840 tx=0x7f45580694f0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.527+0000 7f4543400640 1 -- 172.21.15.144:0/1929880228 shutdown_connections 2024-05-30T16:51:47.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.527+0000 7f4543400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f453806dbd0 0x7f4538070090 secure :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4548034000 tx=0x7f454802e000 comp rx=0 tx=0).stop 2024-05-30T16:51:47.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.527+0000 7f4543400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45500df420 0x7f4550049080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.527+0000 7f4543400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455004fa90 0x7f45501889f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.527+0000 7f4543400640 1 --2- 172.21.15.144:0/1929880228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4550038800 0x7f45500dbc40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.527+0000 7f4543400640 1 -- 172.21.15.144:0/1929880228 >> 172.21.15.144:0/1929880228 conn(0x7f4550009fb0 msgr2=0x7f45500dda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:47.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.530+0000 7f4543400640 1 -- 172.21.15.144:0/1929880228 shutdown_connections 2024-05-30T16:51:47.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.530+0000 7f4543400640 1 -- 172.21.15.144:0/1929880228 wait complete. 2024-05-30T16:51:47.577 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83113 2024-05-30T16:51:47.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.976+0000 7f6e4de00640 1 Processor -- start 2024-05-30T16:51:47.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.976+0000 7f6e4de00640 1 -- start start 2024-05-30T16:51:47.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.978+0000 7f6e4de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e480cc7a0 0x7f6e480afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.978+0000 7f6e4de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e4806dfc0 0x7f6e4815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.978+0000 7f6e4de00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e480cd030 con 0x7f6e48072210 2024-05-30T16:51:47.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.978+0000 7f6e4de00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6e481413f0 con 0x7f6e4806dfc0 2024-05-30T16:51:47.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.978+0000 7f6e4de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6e480cd860 con 0x7f6e480cc7a0 2024-05-30T16:51:47.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.979+0000 7f6e46a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e480cc7a0 0x7f6e480afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:47.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.980+0000 7f6e46a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e480cc7a0 0x7f6e480afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:58978/0 (socket says 172.21.15.144:58978) 2024-05-30T16:51:47.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.980+0000 7f6e46a00640 1 -- 172.21.15.144:0/2183108315 learned_addr learned my addr 172.21.15.144:0/2183108315 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:47.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.980+0000 7f6e46000640 1 --2- 172.21.15.144:0/2183108315 >> v2:172.21.15.144:3300/0 conn(0x7f6e4806dfc0 0x7f6e4815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:47.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.981+0000 7f6e46000640 1 -- 172.21.15.144:0/2183108315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e480cc7a0 msgr2=0x7f6e480afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:47.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.981+0000 7f6e46000640 1 --2- 172.21.15.144:0/2183108315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e480cc7a0 0x7f6e480afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.981+0000 7f6e46000640 1 -- 172.21.15.144:0/2183108315 >> v1:172.21.15.149:6789/0 conn(0x7f6e48072210 legacy=0x7f6e48140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.981+0000 7f6e46000640 1 -- 172.21.15.144:0/2183108315 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4815c2d0 con 0x7f6e4806dfc0 2024-05-30T16:51:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.981+0000 7f6e46a00640 1 --2- 172.21.15.144:0/2183108315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e480cc7a0 0x7f6e480afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:47.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.983+0000 7f6e46000640 1 --2- 172.21.15.144:0/2183108315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e4806dfc0 0x7f6e4815bd90 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6e340097d0 tx=0x7f6e3402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10230b1318cc3eb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:47.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.987+0000 7f6e45600640 1 -- 172.21.15.144:0/2183108315 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34037070 con 0x7f6e4806dfc0 2024-05-30T16:51:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.987+0000 7f6e45600640 1 -- 172.21.15.144:0/2183108315 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e34032440 con 0x7f6e4806dfc0 2024-05-30T16:51:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.987+0000 7f6e45600640 1 -- 172.21.15.144:0/2183108315 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34032810 con 0x7f6e4806dfc0 2024-05-30T16:51:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.989+0000 7f6e4de00640 1 -- 172.21.15.144:0/2183108315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e4806dfc0 msgr2=0x7f6e4815bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.989+0000 7f6e4de00640 1 --2- 172.21.15.144:0/2183108315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e4806dfc0 0x7f6e4815bd90 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6e340097d0 tx=0x7f6e3402a160 comp rx=0 tx=0).stop 2024-05-30T16:51:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.992+0000 7f6e4de00640 1 -- 172.21.15.144:0/2183108315 shutdown_connections 2024-05-30T16:51:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.992+0000 7f6e4de00640 1 --2- 172.21.15.144:0/2183108315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e4806dfc0 0x7f6e4815bd90 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.992+0000 7f6e4de00640 1 --2- 172.21.15.144:0/2183108315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e480cc7a0 0x7f6e480afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.992+0000 7f6e4de00640 1 -- 172.21.15.144:0/2183108315 >> 172.21.15.144:0/2183108315 conn(0x7f6e4806bd00 msgr2=0x7f6e4806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:47.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.992+0000 7f6e4de00640 1 -- 172.21.15.144:0/2183108315 shutdown_connections 2024-05-30T16:51:47.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.992+0000 7f6e4de00640 1 -- 172.21.15.144:0/2183108315 wait complete. 2024-05-30T16:51:47.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.995+0000 7f6e4de00640 1 Processor -- start 2024-05-30T16:51:47.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.996+0000 7f6e4de00640 1 -- start start 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.997+0000 7f6e4de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4806dfc0 0x7f6e48132310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.998+0000 7f6e4de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e48072210 0x7f6e481559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.998+0000 7f6e4de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480cc7a0 0x7f6e48135f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.998+0000 7f6e4de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e480cd2a0 con 0x7f6e480cc7a0 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.998+0000 7f6e4de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6e480aff40 con 0x7f6e4806dfc0 2024-05-30T16:51:47.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.998+0000 7f6e4de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6e480cd580 con 0x7f6e48072210 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.998+0000 7f6e47400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480cc7a0 0x7f6e48135f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.998+0000 7f6e46a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4806dfc0 0x7f6e48132310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.998+0000 7f6e46a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4806dfc0 0x7f6e48132310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:50796/0 (socket says 172.21.15.144:50796) 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.998+0000 7f6e46a00640 1 -- 172.21.15.144:0/351664582 learned_addr learned my addr 172.21.15.144:0/351664582 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:48.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.999+0000 7f6e46000640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e48072210 0x7f6e481559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.999+0000 7f6e47400640 1 -- 172.21.15.144:0/351664582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e48072210 msgr2=0x7f6e481559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.999+0000 7f6e47400640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e48072210 0x7f6e481559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.999+0000 7f6e47400640 1 -- 172.21.15.144:0/351664582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4806dfc0 msgr2=0x7f6e48132310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.999+0000 7f6e47400640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4806dfc0 0x7f6e48132310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:48.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:47.999+0000 7f6e47400640 1 -- 172.21.15.144:0/351664582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e48134ee0 con 0x7f6e480cc7a0 2024-05-30T16:51:48.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.000+0000 7f6e47400640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480cc7a0 0x7f6e48135f80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000c440 tx=0x7f6e4000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.001+0000 7f6e3f400640 1 -- 172.21.15.144:0/351664582 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40017070 con 0x7f6e480cc7a0 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.001+0000 7f6e3f400640 1 -- 172.21.15.144:0/351664582 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e400035f0 con 0x7f6e480cc7a0 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.001+0000 7f6e3f400640 1 -- 172.21.15.144:0/351664582 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e400039e0 con 0x7f6e480cc7a0 2024-05-30T16:51:48.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.001+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e481351c0 con 0x7f6e480cc7a0 2024-05-30T16:51:48.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.002+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e48135780 con 0x7f6e480cc7a0 2024-05-30T16:51:48.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.006+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e48068b90 con 0x7f6e480cc7a0 2024-05-30T16:51:48.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.011+0000 7f6e3f400640 1 -- 172.21.15.144:0/351664582 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f6e4001a070 con 0x7f6e480cc7a0 2024-05-30T16:51:48.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.013+0000 7f6e3f400640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e2806daa0 0x7f6e2806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.014+0000 7f6e3f400640 1 -- 172.21.15.144:0/351664582 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f6e40089d80 con 0x7f6e480cc7a0 2024-05-30T16:51:48.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.017+0000 7f6e3f400640 1 -- 172.21.15.144:0/351664582 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e40059270 con 0x7f6e480cc7a0 2024-05-30T16:51:48.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.031+0000 7f6e46a00640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e2806daa0 0x7f6e2806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.059+0000 7f6e46a00640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e2806daa0 0x7f6e2806ff60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009c90 tx=0x7f6e3800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:48.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:51:48.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:51:48.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:48.576+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83113", "target": ["mon-mgr", ""]}) -- 0x7f6e48075f70 con 0x7f6e2806daa0 2024-05-30T16:51:49.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.470+0000 7f6e3f400640 1 -- 172.21.15.144:0/351664582 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6e38017440 con 0x7f6e2806daa0 2024-05-30T16:51:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.477+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e2806daa0 msgr2=0x7f6e2806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.477+0000 7f6e4de00640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e2806daa0 0x7f6e2806ff60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009c90 tx=0x7f6e3800b040 comp rx=0 tx=0).stop 2024-05-30T16:51:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.477+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480cc7a0 msgr2=0x7f6e48135f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.477+0000 7f6e4de00640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480cc7a0 0x7f6e48135f80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000c440 tx=0x7f6e4000c900 comp rx=0 tx=0).stop 2024-05-30T16:51:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.478+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 shutdown_connections 2024-05-30T16:51:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.478+0000 7f6e4de00640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e2806daa0 0x7f6e2806ff60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.478+0000 7f6e4de00640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480cc7a0 0x7f6e48135f80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.478+0000 7f6e4de00640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e48072210 0x7f6e481559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.478+0000 7f6e4de00640 1 --2- 172.21.15.144:0/351664582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4806dfc0 0x7f6e48132310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.478+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 >> 172.21.15.144:0/351664582 conn(0x7f6e4806bd00 msgr2=0x7f6e480b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:49.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.478+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 shutdown_connections 2024-05-30T16:51:49.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.479+0000 7f6e4de00640 1 -- 172.21.15.144:0/351664582 wait complete. 2024-05-30T16:51:49.523 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83114 2024-05-30T16:51:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.932+0000 7fd98be00640 1 Processor -- start 2024-05-30T16:51:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.932+0000 7fd98be00640 1 -- start start 2024-05-30T16:51:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.934+0000 7fd98be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9840afa00 0x7fd984140570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.934+0000 7fd98be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9840cd030 con 0x7fd9840cc7a0 2024-05-30T16:51:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.934+0000 7fd98be00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9840ceca0 con 0x7fd98406dfc0 2024-05-30T16:51:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.934+0000 7fd98be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd984072920 con 0x7fd9840afa00 2024-05-30T16:51:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.935+0000 7fd989400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd9840cc7a0 0x7fd98415bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60908/0 (socket says 172.21.15.144:60908) 2024-05-30T16:51:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.935+0000 7fd989400640 1 -- 172.21.15.144:0/2905147847 learned_addr learned my addr 172.21.15.144:0/2905147847 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:49.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.935+0000 7fd989e00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9840afa00 0x7fd984140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:49.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.935+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551657415 0 0) 0x7fd9840cd030 con 0x7fd9840cc7a0 2024-05-30T16:51:49.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd96c007930 con 0x7fd9840cc7a0 2024-05-30T16:51:49.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3198335178 0 0) 0x7fd96c007930 con 0x7fd9840cc7a0 2024-05-30T16:51:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9840afa00 msgr2=0x7fd984140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9840afa00 0x7fd984140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 >> v1:172.21.15.149:6789/0 conn(0x7fd98406dfc0 legacy=0x7fd984072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9840cd2a0 con 0x7fd9840cc7a0 2024-05-30T16:51:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fd9780019f0 con 0x7fd9840cc7a0 2024-05-30T16:51:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 >> v1:172.21.15.144:6789/0 conn(0x7fd9840cc7a0 legacy=0x7fd98415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd96c007df0 0x7fd96c0081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd96c008c10 0x7fd96c009090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd96c0095d0 0x7fd96c00fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd984072920 con 0x7fd96c008c10 2024-05-30T16:51:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c010440 con 0x7fd96c007df0 2024-05-30T16:51:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.936+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd96c010640 con 0x7fd96c0095d0 2024-05-30T16:51:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.937+0000 7fd988a00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd96c008c10 0x7fd96c009090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.937+0000 7fd989400640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd96c007df0 0x7fd96c0081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.938+0000 7fd988a00640 1 -- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd96c0095d0 msgr2=0x7fd96c00fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.938+0000 7fd988a00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd96c0095d0 0x7fd96c00fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.938+0000 7fd988a00640 1 -- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd96c007df0 msgr2=0x7fd96c0081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.938+0000 7fd988a00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd96c007df0 0x7fd96c0081f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.938+0000 7fd988a00640 1 -- 172.21.15.144:0/2905147847 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9840cd2a0 con 0x7fd96c008c10 2024-05-30T16:51:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.939+0000 7fd988a00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd96c008c10 0x7fd96c009090 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd970001670 tx=0x7fd96c009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a78603f4012d54 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:49.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.940+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970001240 con 0x7fd96c008c10 2024-05-30T16:51:49.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.940+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97002e070 con 0x7fd96c008c10 2024-05-30T16:51:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.940+0000 7fd983e00640 1 -- 172.21.15.144:0/2905147847 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97002a800 con 0x7fd96c008c10 2024-05-30T16:51:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.941+0000 7fd98be00640 1 -- 172.21.15.144:0/2905147847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd96c008c10 msgr2=0x7fd96c009090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.941+0000 7fd98be00640 1 --2- 172.21.15.144:0/2905147847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd96c008c10 0x7fd96c009090 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd970001670 tx=0x7fd96c009c40 comp rx=0 tx=0).stop 2024-05-30T16:51:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.941+0000 7fd989e00640 1 -- 172.21.15.144:0/2905147847 reap_dead start 2024-05-30T16:51:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.941+0000 7fd98be00640 1 -- 172.21.15.144:0/2905147847 shutdown_connections 2024-05-30T16:51:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.941+0000 7fd98be00640 1 -- 172.21.15.144:0/2905147847 >> 172.21.15.144:0/2905147847 conn(0x7fd98406bd00 msgr2=0x7fd98406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.941+0000 7fd98be00640 1 -- 172.21.15.144:0/2905147847 shutdown_connections 2024-05-30T16:51:49.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.942+0000 7fd98be00640 1 -- 172.21.15.144:0/2905147847 wait complete. 2024-05-30T16:51:49.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.944+0000 7fd98be00640 1 Processor -- start 2024-05-30T16:51:49.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.945+0000 7fd98be00640 1 -- start start 2024-05-30T16:51:49.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.946+0000 7fd98be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd96c008c10 0x7fd9841f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:49.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.946+0000 7fd98be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98413b160 0x7fd98413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:49.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.946+0000 7fd98be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9840b4940 0x7fd9840b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:49.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.946+0000 7fd98be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9840cd860 con 0x7fd98413b160 2024-05-30T16:51:49.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.946+0000 7fd98be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd9840afe70 con 0x7fd96c008c10 2024-05-30T16:51:49.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.946+0000 7fd98be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd9840ccc60 con 0x7fd9840b4940 2024-05-30T16:51:49.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.947+0000 7fd988a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98413b160 0x7fd98413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:49.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.947+0000 7fd988a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98413b160 0x7fd98413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57978/0 (socket says 172.21.15.144:57978) 2024-05-30T16:51:49.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.947+0000 7fd988a00640 1 -- 172.21.15.144:0/1433240984 learned_addr learned my addr 172.21.15.144:0/1433240984 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:49.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.947+0000 7fd989400640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd96c008c10 0x7fd9841f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:49.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.947+0000 7fd988a00640 1 -- 172.21.15.144:0/1433240984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9840b4940 msgr2=0x7fd9840b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:49.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.947+0000 7fd988a00640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9840b4940 0x7fd9840b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:49.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.947+0000 7fd988a00640 1 -- 172.21.15.144:0/1433240984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd96c008c10 msgr2=0x7fd9841f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:49.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.947+0000 7fd988a00640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd96c008c10 0x7fd9841f9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:49.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.947+0000 7fd988a00640 1 -- 172.21.15.144:0/1433240984 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9840b3b80 con 0x7fd98413b160 2024-05-30T16:51:49.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.948+0000 7fd988a00640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98413b160 0x7fd98413b5e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fd970001790 tx=0x7fd970000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:49.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.953+0000 7fd981600640 1 -- 172.21.15.144:0/1433240984 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970007a50 con 0x7fd98413b160 2024-05-30T16:51:49.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.953+0000 7fd981600640 1 -- 172.21.15.144:0/1433240984 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97002ae00 con 0x7fd98413b160 2024-05-30T16:51:49.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.953+0000 7fd981600640 1 -- 172.21.15.144:0/1433240984 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970007260 con 0x7fd98413b160 2024-05-30T16:51:49.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.953+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9840b3e60 con 0x7fd98413b160 2024-05-30T16:51:49.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.953+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9840b4420 con 0x7fd98413b160 2024-05-30T16:51:49.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.956+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd984068b90 con 0x7fd98413b160 2024-05-30T16:51:49.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.957+0000 7fd981600640 1 -- 172.21.15.144:0/1433240984 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7fd970045020 con 0x7fd98413b160 2024-05-30T16:51:49.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.958+0000 7fd981600640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd96406da50 0x7fd96406ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:49.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.958+0000 7fd981600640 1 -- 172.21.15.144:0/1433240984 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fd9700a9890 con 0x7fd98413b160 2024-05-30T16:51:49.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.958+0000 7fd989400640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd96406da50 0x7fd96406ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:49.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.959+0000 7fd989400640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd96406da50 0x7fd96406ff10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd98406c280 tx=0x7fd978009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:49.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:49.964+0000 7fd981600640 1 -- 172.21.15.144:0/1433240984 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd970079750 con 0x7fd98413b160 2024-05-30T16:51:50.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:50.527+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83114", "target": ["mon-mgr", ""]}) -- 0x7fd9840b3930 con 0x7fd96406da50 2024-05-30T16:51:51.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.939+0000 7fd981600640 1 -- 172.21.15.144:0/1433240984 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd9840b3930 con 0x7fd96406da50 2024-05-30T16:51:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.946+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd96406da50 msgr2=0x7fd96406ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.946+0000 7fd98be00640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd96406da50 0x7fd96406ff10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd98406c280 tx=0x7fd978009040 comp rx=0 tx=0).stop 2024-05-30T16:51:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.946+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98413b160 msgr2=0x7fd98413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.946+0000 7fd98be00640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98413b160 0x7fd98413b5e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fd970001790 tx=0x7fd970000fb0 comp rx=0 tx=0).stop 2024-05-30T16:51:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.946+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 shutdown_connections 2024-05-30T16:51:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.946+0000 7fd98be00640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fd96406da50 0x7fd96406ff10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.947+0000 7fd98be00640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9840b4940 0x7fd9840b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.947+0000 7fd98be00640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98413b160 0x7fd98413b5e0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.947+0000 7fd98be00640 1 --2- 172.21.15.144:0/1433240984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd96c008c10 0x7fd9841f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.947+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 >> 172.21.15.144:0/1433240984 conn(0x7fd98406bd00 msgr2=0x7fd9841548c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.947+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 shutdown_connections 2024-05-30T16:51:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:51.947+0000 7fd98be00640 1 -- 172.21.15.144:0/1433240984 wait complete. 2024-05-30T16:51:52.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83115 2024-05-30T16:51:52.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.367+0000 7f7254a00640 1 Processor -- start 2024-05-30T16:51:52.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.368+0000 7f7254a00640 1 -- start start 2024-05-30T16:51:52.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.370+0000 7f7254a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f725014c630 0x7f72500ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.370+0000 7f7254a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f72500cea10 0x7f7250072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.370+0000 7f7254a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725006fbf0 con 0x7f7250072750 2024-05-30T16:51:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.370+0000 7f7254a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f72500cee30 con 0x7f725014c630 2024-05-30T16:51:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.370+0000 7f7254a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f7250072bc0 con 0x7f72500cea10 2024-05-30T16:51:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.370+0000 7f724de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f725014c630 0x7f72500ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.370+0000 7f724de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f725014c630 0x7f72500ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57986/0 (socket says 172.21.15.144:57986) 2024-05-30T16:51:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.370+0000 7f724de00640 1 -- 172.21.15.144:0/32140643 learned_addr learned my addr 172.21.15.144:0/32140643 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.371+0000 7f724de00640 1 -- 172.21.15.144:0/32140643 >> v2:172.21.15.149:3300/0 conn(0x7f72500cea10 msgr2=0x7f7250072210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T16:51:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.371+0000 7f724de00640 1 --2- 172.21.15.144:0/32140643 >> v2:172.21.15.149:3300/0 conn(0x7f72500cea10 0x7f7250072210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.371+0000 7f724de00640 1 -- 172.21.15.144:0/32140643 >> v1:172.21.15.149:6789/0 conn(0x7f7250072750 legacy=0x7f725006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.371+0000 7f724de00640 1 -- 172.21.15.144:0/32140643 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72500cf050 con 0x7f725014c630 2024-05-30T16:51:52.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.376+0000 7f724de00640 1 --2- 172.21.15.144:0/32140643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f725014c630 0x7f72500ce4d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f72501668e0 tx=0x7f724002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85177b26fcd0e256 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.378+0000 7f724ca00640 1 -- 172.21.15.144:0/32140643 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240037070 con 0x7f725014c630 2024-05-30T16:51:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.378+0000 7f724ca00640 1 -- 172.21.15.144:0/32140643 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7240032440 con 0x7f725014c630 2024-05-30T16:51:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.378+0000 7f724ca00640 1 -- 172.21.15.144:0/32140643 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240032810 con 0x7f725014c630 2024-05-30T16:51:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.380+0000 7f7254a00640 1 -- 172.21.15.144:0/32140643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f725014c630 msgr2=0x7f72500ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:52.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.380+0000 7f7254a00640 1 --2- 172.21.15.144:0/32140643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f725014c630 0x7f72500ce4d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f72501668e0 tx=0x7f724002a250 comp rx=0 tx=0).stop 2024-05-30T16:51:52.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.381+0000 7f7254a00640 1 -- 172.21.15.144:0/32140643 shutdown_connections 2024-05-30T16:51:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.381+0000 7f7254a00640 1 --2- 172.21.15.144:0/32140643 >> v2:172.21.15.149:3300/0 conn(0x7f72500cea10 0x7f7250072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.381+0000 7f7254a00640 1 --2- 172.21.15.144:0/32140643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f725014c630 0x7f72500ce4d0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.381+0000 7f7254a00640 1 -- 172.21.15.144:0/32140643 >> 172.21.15.144:0/32140643 conn(0x7f725006bd00 msgr2=0x7f725006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.382+0000 7f7254a00640 1 -- 172.21.15.144:0/32140643 shutdown_connections 2024-05-30T16:51:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.382+0000 7f7254a00640 1 -- 172.21.15.144:0/32140643 wait complete. 2024-05-30T16:51:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.394+0000 7f7254a00640 1 Processor -- start 2024-05-30T16:51:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.402+0000 7f7254a00640 1 -- start start 2024-05-30T16:51:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.403+0000 7f7254a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7250072750 0x7f72500ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.403+0000 7f7254a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72500cea10 0x7f7250139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.403+0000 7f7254a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f725014c630 0x7f7250139e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.403+0000 7f7254a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f72500cf8f0 con 0x7f7250072750 2024-05-30T16:51:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.403+0000 7f7254a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f72500cf610 con 0x7f72500cea10 2024-05-30T16:51:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.403+0000 7f7254a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72500b3c20 con 0x7f725014c630 2024-05-30T16:51:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.404+0000 7f724de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7250072750 0x7f72500ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.404+0000 7f724de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7250072750 0x7f72500ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57996/0 (socket says 172.21.15.144:57996) 2024-05-30T16:51:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.404+0000 7f724de00640 1 -- 172.21.15.144:0/2248401506 learned_addr learned my addr 172.21.15.144:0/2248401506 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.407+0000 7f724d400640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72500cea10 0x7f7250139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.407+0000 7f724e800640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f725014c630 0x7f7250139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.408+0000 7f724de00640 1 -- 172.21.15.144:0/2248401506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f725014c630 msgr2=0x7f7250139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.408+0000 7f724de00640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f725014c630 0x7f7250139e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.408+0000 7f724de00640 1 -- 172.21.15.144:0/2248401506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72500cea10 msgr2=0x7f7250139920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.408+0000 7f724de00640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72500cea10 0x7f7250139920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.408+0000 7f724de00640 1 -- 172.21.15.144:0/2248401506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72500ac330 con 0x7f7250072750 2024-05-30T16:51:52.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.412+0000 7f724de00640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7250072750 0x7f72500ad3d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f7240000c00 tx=0x7f72400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:52.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.416+0000 7f7246000640 1 -- 172.21.15.144:0/2248401506 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240041070 con 0x7f7250072750 2024-05-30T16:51:52.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.418+0000 7f7246000640 1 -- 172.21.15.144:0/2248401506 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7240030990 con 0x7f7250072750 2024-05-30T16:51:52.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.418+0000 7f7246000640 1 -- 172.21.15.144:0/2248401506 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240037040 con 0x7f7250072750 2024-05-30T16:51:52.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.418+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72500ac610 con 0x7f7250072750 2024-05-30T16:51:52.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.418+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72500acbd0 con 0x7f7250072750 2024-05-30T16:51:52.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.426+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7250068b90 con 0x7f7250072750 2024-05-30T16:51:52.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.438+0000 7f7246000640 1 -- 172.21.15.144:0/2248401506 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f7240044070 con 0x7f7250072750 2024-05-30T16:51:52.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.441+0000 7f7246000640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f723006daa0 0x7f723006ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:52.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.442+0000 7f7246000640 1 -- 172.21.15.144:0/2248401506 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f72400ab530 con 0x7f7250072750 2024-05-30T16:51:52.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.463+0000 7f7246000640 1 -- 172.21.15.144:0/2248401506 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f724007b190 con 0x7f7250072750 2024-05-30T16:51:52.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.479+0000 7f724d400640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f723006daa0 0x7f723006ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.517+0000 7f724d400640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f723006daa0 0x7f723006ff60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f72500b4e60 tx=0x7f723c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:52.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:52.986+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83115", "target": ["mon-mgr", ""]}) -- 0x7f7250075f70 con 0x7f723006daa0 2024-05-30T16:51:53.869 INFO:tasks.ceph.mgr.y.smithi144.stderr:Exception in thread Thread-10: 2024-05-30T16:51:53.869 INFO:tasks.ceph.mgr.y.smithi144.stderr:Traceback (most recent call last): 2024-05-30T16:51:53.869 INFO:tasks.ceph.mgr.y.smithi144.stderr: File "/usr/lib64/python3.9/threading.py", line 980, in _bootstrap_inner 2024-05-30T16:51:53.894 INFO:tasks.ceph.mgr.y.smithi144.stderr: self.run() 2024-05-30T16:51:53.894 INFO:tasks.ceph.mgr.y.smithi144.stderr: File "/usr/share/ceph/mgr/mgr_util.py", line 82, in run 2024-05-30T16:51:53.894 INFO:tasks.ceph.mgr.y.smithi144.stderr: self.function(*self.args, **self.kwargs) 2024-05-30T16:51:53.894 INFO:tasks.ceph.mgr.y.smithi144.stderr: File "/usr/share/ceph/mgr/volumes/fs/stats_util.py", line 262, in _update_progress_bars 2024-05-30T16:51:53.895 INFO:tasks.ceph.mgr.y.smithi144.stderr: clones = self._get_info_for_all_clones() 2024-05-30T16:51:53.895 INFO:tasks.ceph.mgr.y.smithi144.stderr: File "/usr/share/ceph/mgr/volumes/fs/stats_util.py", line 150, in _get_info_for_all_clones 2024-05-30T16:51:53.895 INFO:tasks.ceph.mgr.y.smithi144.stderr: clone_entries = clone_index.list_entries_by_ctime_order() 2024-05-30T16:51:53.895 INFO:tasks.ceph.mgr.y.smithi144.stderr: File "/usr/share/ceph/mgr/volumes/fs/operations/clone_index.py", line 61, in list_entries_by_ctime_order 2024-05-30T16:51:53.895 INFO:tasks.ceph.mgr.y.smithi144.stderr: stb = self.fs.lstat(d_path) 2024-05-30T16:51:53.895 INFO:tasks.ceph.mgr.y.smithi144.stderr: File "cephfs.pyx", line 1997, in cephfs.LibCephFS.lstat 2024-05-30T16:51:53.895 INFO:tasks.ceph.mgr.y.smithi144.stderr: File "cephfs.pyx", line 1978, in cephfs.LibCephFS.stat 2024-05-30T16:51:53.896 INFO:tasks.ceph.mgr.y.smithi144.stderr:cephfs.ObjectNotFound: error in stat: /volumes/_index/clone/b476b009-d3c7-4104-a8e1-a67fd4759315: No such file or directory [Errno 2] 2024-05-30T16:51:53.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.993+0000 7f7246000640 1 -- 172.21.15.144:0/2248401506 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f723c00a3c0 con 0x7f723006daa0 2024-05-30T16:51:53.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.996+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f723006daa0 msgr2=0x7f723006ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.996+0000 7f7254a00640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f723006daa0 0x7f723006ff60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f72500b4e60 tx=0x7f723c008040 comp rx=0 tx=0).stop 2024-05-30T16:51:53.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.996+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7250072750 msgr2=0x7f72500ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:53.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.996+0000 7f7254a00640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7250072750 0x7f72500ad3d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f7240000c00 tx=0x7f72400046c0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.997+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 shutdown_connections 2024-05-30T16:51:53.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.997+0000 7f7254a00640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f723006daa0 0x7f723006ff60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:53.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.997+0000 7f7254a00640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f725014c630 0x7f7250139e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.997+0000 7f7254a00640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72500cea10 0x7f7250139920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.997+0000 7f7254a00640 1 --2- 172.21.15.144:0/2248401506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7250072750 0x7f72500ad3d0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.997+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 >> 172.21.15.144:0/2248401506 conn(0x7f725006bd00 msgr2=0x7f72500b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.997+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 shutdown_connections 2024-05-30T16:51:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:53.998+0000 7f7254a00640 1 -- 172.21.15.144:0/2248401506 wait complete. 2024-05-30T16:51:54.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83116 2024-05-30T16:51:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.513+0000 7f1382000640 1 Processor -- start 2024-05-30T16:51:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.513+0000 7f1382000640 1 -- start start 2024-05-30T16:51:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.514+0000 7f1382000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c0afa00 0x7f137c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.514+0000 7f1382000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f137c0cc7a0 0x7f137c140570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.514+0000 7f1382000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c0cd030 con 0x7f137c06dfc0 2024-05-30T16:51:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.514+0000 7f1382000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f137c1413f0 con 0x7f137c0cc7a0 2024-05-30T16:51:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.514+0000 7f1382000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f137c0cd860 con 0x7f137c0afa00 2024-05-30T16:51:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.515+0000 7f137be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f137c06dfc0 0x7f137c15e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60910/0 (socket says 172.21.15.144:60910) 2024-05-30T16:51:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.515+0000 7f137be00640 1 -- 172.21.15.144:0/3233035264 learned_addr learned my addr 172.21.15.144:0/3233035264 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.515+0000 7f137aa00640 1 --2- 172.21.15.144:0/3233035264 >> v2:172.21.15.149:3300/0 conn(0x7f137c0cc7a0 0x7f137c140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.515+0000 7f137b400640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c0afa00 0x7f137c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289145672 0 0) 0x7f137c0cd030 con 0x7f137c06dfc0 2024-05-30T16:51:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1360003520 con 0x7f137c06dfc0 2024-05-30T16:51:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1526669051 0 0) 0x7f1360003520 con 0x7f137c06dfc0 2024-05-30T16:51:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c0afa00 msgr2=0x7f137c15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c0afa00 0x7f137c15bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 >> v2:172.21.15.149:3300/0 conn(0x7f137c0cc7a0 msgr2=0x7f137c140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 --2- 172.21.15.144:0/3233035264 >> v2:172.21.15.149:3300/0 conn(0x7f137c0cc7a0 0x7f137c140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c15c2d0 con 0x7f137c06dfc0 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f13740019f0 con 0x7f137c06dfc0 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137b400640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c0afa00 0x7f137c15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 >> v1:172.21.15.144:6789/0 conn(0x7f137c06dfc0 legacy=0x7f137c15e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f1360003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1360004800 0x7f1360004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c0afa00 0x7f13600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f137c0cd860 con 0x7f13600039e0 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1360005990 con 0x7f1360004800 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1360005b90 con 0x7f137c0afa00 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.516+0000 7f137aa00640 1 --2- 172.21.15.144:0/3233035264 >> v2:172.21.15.149:3300/0 conn(0x7f137c0cc7a0 0x7f137c140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.517+0000 7f137b400640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f1360003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.517+0000 7f137b400640 1 -- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c0afa00 msgr2=0x7f13600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.517+0000 7f137b400640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c0afa00 0x7f13600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.517+0000 7f137b400640 1 -- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1360004800 msgr2=0x7f1360004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.517+0000 7f137b400640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1360004800 0x7f1360004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.517+0000 7f137b400640 1 -- 172.21.15.144:0/3233035264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1360003520 con 0x7f13600039e0 2024-05-30T16:51:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.519+0000 7f137b400640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f1360003e00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f136c009c90 tx=0x7f1360005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34d75b957a4672c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.519+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c036070 con 0x7f13600039e0 2024-05-30T16:51:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.519+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136c031400 con 0x7f13600039e0 2024-05-30T16:51:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.519+0000 7f137a000640 1 -- 172.21.15.144:0/3233035264 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c009860 con 0x7f13600039e0 2024-05-30T16:51:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.521+0000 7f1382000640 1 -- 172.21.15.144:0/3233035264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 msgr2=0x7f1360003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.521+0000 7f1382000640 1 --2- 172.21.15.144:0/3233035264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f1360003e00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f136c009c90 tx=0x7f1360005830 comp rx=0 tx=0).stop 2024-05-30T16:51:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.521+0000 7f137be00640 1 -- 172.21.15.144:0/3233035264 reap_dead start 2024-05-30T16:51:54.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.521+0000 7f1382000640 1 -- 172.21.15.144:0/3233035264 shutdown_connections 2024-05-30T16:51:54.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.521+0000 7f1382000640 1 -- 172.21.15.144:0/3233035264 >> 172.21.15.144:0/3233035264 conn(0x7f137c06bd00 msgr2=0x7f137c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:54.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.522+0000 7f1382000640 1 -- 172.21.15.144:0/3233035264 shutdown_connections 2024-05-30T16:51:54.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.522+0000 7f1382000640 1 -- 172.21.15.144:0/3233035264 wait complete. 2024-05-30T16:51:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.525+0000 7f1382000640 1 Processor -- start 2024-05-30T16:51:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.526+0000 7f1382000640 1 -- start start 2024-05-30T16:51:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.527+0000 7f1382000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f137c152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.528+0000 7f1382000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c1529d0 0x7f137c06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.528+0000 7f1382000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f137c06f1f0 0x7f137c0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.528+0000 7f1382000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f137c0cd580 con 0x7f13600039e0 2024-05-30T16:51:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.528+0000 7f1382000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f137c0cd2a0 con 0x7f137c06f1f0 2024-05-30T16:51:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.528+0000 7f1382000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f137c0ccc60 con 0x7f137c1529d0 2024-05-30T16:51:54.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.530+0000 7f137b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f137c152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.530+0000 7f137aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c1529d0 0x7f137c06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.530+0000 7f137be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f137c06f1f0 0x7f137c0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.530+0000 7f137b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f137c152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58014/0 (socket says 172.21.15.144:58014) 2024-05-30T16:51:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.530+0000 7f137b400640 1 -- 172.21.15.144:0/3745533182 learned_addr learned my addr 172.21.15.144:0/3745533182 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.532+0000 7f137b400640 1 -- 172.21.15.144:0/3745533182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c1529d0 msgr2=0x7f137c06ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.532+0000 7f137b400640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c1529d0 0x7f137c06ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.532+0000 7f137b400640 1 -- 172.21.15.144:0/3745533182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f137c06f1f0 msgr2=0x7f137c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.532+0000 7f137b400640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f137c06f1f0 0x7f137c0b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.532+0000 7f137b400640 1 -- 172.21.15.144:0/3745533182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c151cb0 con 0x7f13600039e0 2024-05-30T16:51:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.532+0000 7f137b400640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f137c152490 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f136c009d80 tx=0x7f136c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.533+0000 7f137aa00640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c1529d0 0x7f137c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:51:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.533+0000 7f1373400640 1 -- 172.21.15.144:0/3745533182 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c041020 con 0x7f13600039e0 2024-05-30T16:51:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.533+0000 7f1373400640 1 -- 172.21.15.144:0/3745533182 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136c009320 con 0x7f13600039e0 2024-05-30T16:51:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.533+0000 7f1373400640 1 -- 172.21.15.144:0/3745533182 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c036040 con 0x7f13600039e0 2024-05-30T16:51:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.533+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137c1f9690 con 0x7f13600039e0 2024-05-30T16:51:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.534+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137c151f70 con 0x7f13600039e0 2024-05-30T16:51:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.538+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137c152170 con 0x7f13600039e0 2024-05-30T16:51:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.539+0000 7f1373400640 1 -- 172.21.15.144:0/3745533182 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f136c044020 con 0x7f13600039e0 2024-05-30T16:51:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.541+0000 7f1373400640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f135c06d9d0 0x7f135c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:54.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.541+0000 7f1373400640 1 -- 172.21.15.144:0/3745533182 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f136c0aacb0 con 0x7f13600039e0 2024-05-30T16:51:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.555+0000 7f137aa00640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f135c06d9d0 0x7f135c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:54.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.559+0000 7f1373400640 1 -- 172.21.15.144:0/3745533182 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f137c152170 con 0x7f13600039e0 2024-05-30T16:51:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:54.565+0000 7f137aa00640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f135c06d9d0 0x7f135c06fe90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f137c06f8f0 tx=0x7f1368008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:55.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:55.118+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83116", "target": ["mon-mgr", ""]}) -- 0x7f137c068b90 con 0x7f135c06d9d0 2024-05-30T16:51:56.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.361+0000 7f1373400640 1 -- 172.21.15.144:0/3745533182 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f137c068b90 con 0x7f135c06d9d0 2024-05-30T16:51:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.369+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f135c06d9d0 msgr2=0x7f135c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.369+0000 7f1382000640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f135c06d9d0 0x7f135c06fe90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f137c06f8f0 tx=0x7f1368008040 comp rx=0 tx=0).stop 2024-05-30T16:51:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.369+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 msgr2=0x7f137c152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.369+0000 7f1382000640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f137c152490 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f136c009d80 tx=0x7f136c004730 comp rx=0 tx=0).stop 2024-05-30T16:51:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.370+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 shutdown_connections 2024-05-30T16:51:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.370+0000 7f1382000640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f135c06d9d0 0x7f135c06fe90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.370+0000 7f1382000640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f137c06f1f0 0x7f137c0b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.370+0000 7f1382000640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f137c1529d0 0x7f137c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.370+0000 7f1382000640 1 --2- 172.21.15.144:0/3745533182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13600039e0 0x7f137c152490 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.370+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 >> 172.21.15.144:0/3745533182 conn(0x7f137c06bd00 msgr2=0x7f137c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.371+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 shutdown_connections 2024-05-30T16:51:56.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.371+0000 7f1382000640 1 -- 172.21.15.144:0/3745533182 wait complete. 2024-05-30T16:51:56.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83117 2024-05-30T16:51:56.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.834+0000 7fb33d600640 1 Processor -- start 2024-05-30T16:51:56.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.836+0000 7fb33d600640 1 -- start start 2024-05-30T16:51:56.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.841+0000 7fb33d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb33814c630 0x7fb3380ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.841+0000 7fb33d600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb338072920 0x7fb3380b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.842+0000 7fb33d600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33806fbf0 con 0x7fb3380cea10 2024-05-30T16:51:56.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.843+0000 7fb336a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb33814c630 0x7fb3380ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:56.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.843+0000 7fb33d600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb3380cf050 con 0x7fb338072920 2024-05-30T16:51:56.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.843+0000 7fb33d600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb3380cf330 con 0x7fb33814c630 2024-05-30T16:51:56.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.843+0000 7fb337400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb338072920 0x7fb3380b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:56.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.843+0000 7fb32fe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb3380cea10 0x7fb338072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:35736/0 (socket says 172.21.15.144:35736) 2024-05-30T16:51:56.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.843+0000 7fb32fe00640 1 -- 172.21.15.144:0/912828768 learned_addr learned my addr 172.21.15.144:0/912828768 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:56.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.843+0000 7fb336a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb33814c630 0x7fb3380ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:43696/0 (socket says 172.21.15.144:43696) 2024-05-30T16:51:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.845+0000 7fb336000640 1 -- 172.21.15.144:0/912828768 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370770895 0 0) 0x7fb33806fbf0 con 0x7fb3380cea10 2024-05-30T16:51:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.845+0000 7fb336000640 1 -- 172.21.15.144:0/912828768 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb31c003520 con 0x7fb3380cea10 2024-05-30T16:51:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.845+0000 7fb337400640 1 -- 172.21.15.144:0/912828768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb33814c630 msgr2=0x7fb3380ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.845+0000 7fb337400640 1 --2- 172.21.15.144:0/912828768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb33814c630 0x7fb3380ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.845+0000 7fb337400640 1 -- 172.21.15.144:0/912828768 >> v1:172.21.15.149:6789/0 conn(0x7fb3380cea10 legacy=0x7fb338072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.845+0000 7fb337400640 1 -- 172.21.15.144:0/912828768 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3380cf610 con 0x7fb338072920 2024-05-30T16:51:56.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.847+0000 7fb337400640 1 --2- 172.21.15.144:0/912828768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb338072920 0x7fb3380b4140 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb330009d90 tx=0x7fb33002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdbd6a54462cc9be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:56.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.848+0000 7fb336a00640 1 --2- 172.21.15.144:0/912828768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb33814c630 0x7fb3380ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:51:56.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.853+0000 7fb336000640 1 -- 172.21.15.144:0/912828768 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330007740 con 0x7fb338072920 2024-05-30T16:51:56.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.853+0000 7fb336000640 1 -- 172.21.15.144:0/912828768 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3300078e0 con 0x7fb338072920 2024-05-30T16:51:56.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.853+0000 7fb336000640 1 -- 172.21.15.144:0/912828768 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330007c90 con 0x7fb338072920 2024-05-30T16:51:56.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.854+0000 7fb33d600640 1 -- 172.21.15.144:0/912828768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb338072920 msgr2=0x7fb3380b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.854+0000 7fb33d600640 1 --2- 172.21.15.144:0/912828768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb338072920 0x7fb3380b4140 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb330009d90 tx=0x7fb33002a710 comp rx=0 tx=0).stop 2024-05-30T16:51:56.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.854+0000 7fb33d600640 1 -- 172.21.15.144:0/912828768 shutdown_connections 2024-05-30T16:51:56.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.854+0000 7fb33d600640 1 --2- 172.21.15.144:0/912828768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb338072920 0x7fb3380b4140 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.854+0000 7fb33d600640 1 --2- 172.21.15.144:0/912828768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb33814c630 0x7fb3380ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.854+0000 7fb33d600640 1 -- 172.21.15.144:0/912828768 >> 172.21.15.144:0/912828768 conn(0x7fb33806bd00 msgr2=0x7fb33806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:56.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.855+0000 7fb33d600640 1 -- 172.21.15.144:0/912828768 shutdown_connections 2024-05-30T16:51:56.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.855+0000 7fb33d600640 1 -- 172.21.15.144:0/912828768 wait complete. 2024-05-30T16:51:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.858+0000 7fb33d600640 1 Processor -- start 2024-05-30T16:51:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.858+0000 7fb33d600640 1 -- start start 2024-05-30T16:51:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.860+0000 7fb33d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb338072920 0x7fb338165280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.861+0000 7fb33d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3380cea10 0x7fb3380c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.862+0000 7fb33d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33814c630 0x7fb3380c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.862+0000 7fb33d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb33814ca10 con 0x7fb33814c630 2024-05-30T16:51:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.862+0000 7fb33d600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3380b3c20 con 0x7fb338072920 2024-05-30T16:51:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.862+0000 7fb33d600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb33814cb90 con 0x7fb3380cea10 2024-05-30T16:51:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.862+0000 7fb337400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33814c630 0x7fb3380c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.862+0000 7fb337400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33814c630 0x7fb3380c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55526/0 (socket says 172.21.15.144:55526) 2024-05-30T16:51:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.862+0000 7fb337400640 1 -- 172.21.15.144:0/3908212591 learned_addr learned my addr 172.21.15.144:0/3908212591 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:56.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.863+0000 7fb336a00640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb338072920 0x7fb338165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:56.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.864+0000 7fb337400640 1 -- 172.21.15.144:0/3908212591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3380cea10 msgr2=0x7fb3380c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.864+0000 7fb337400640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3380cea10 0x7fb3380c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.864+0000 7fb337400640 1 -- 172.21.15.144:0/3908212591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb338072920 msgr2=0x7fb338165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.864+0000 7fb337400640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb338072920 0x7fb338165280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.864+0000 7fb337400640 1 -- 172.21.15.144:0/3908212591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3380c5e70 con 0x7fb33814c630 2024-05-30T16:51:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.864+0000 7fb337400640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33814c630 0x7fb3380c6f10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb330009eb0 tx=0x7fb330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.865+0000 7fb32ea00640 1 -- 172.21.15.144:0/3908212591 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330009450 con 0x7fb33814c630 2024-05-30T16:51:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.865+0000 7fb32ea00640 1 -- 172.21.15.144:0/3908212591 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb330004240 con 0x7fb33814c630 2024-05-30T16:51:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.865+0000 7fb32ea00640 1 -- 172.21.15.144:0/3908212591 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300045f0 con 0x7fb33814c630 2024-05-30T16:51:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.867+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3380c6150 con 0x7fb33814c630 2024-05-30T16:51:56.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.867+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3380c6710 con 0x7fb33814c630 2024-05-30T16:51:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.872+0000 7fb32ea00640 1 -- 172.21.15.144:0/3908212591 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7fb330039040 con 0x7fb33814c630 2024-05-30T16:51:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.873+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb338068b90 con 0x7fb33814c630 2024-05-30T16:51:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.874+0000 7fb32ea00640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb31406daa0 0x7fb31406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.875+0000 7fb32ea00640 1 -- 172.21.15.144:0/3908212591 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fb3300ac020 con 0x7fb33814c630 2024-05-30T16:51:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.886+0000 7fb336a00640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb31406daa0 0x7fb31406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:56.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.896+0000 7fb32ea00640 1 -- 172.21.15.144:0/3908212591 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb330040030 con 0x7fb33814c630 2024-05-30T16:51:56.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:56.931+0000 7fb336a00640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb31406daa0 0x7fb31406ff60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb328009560 tx=0x7fb328009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:57.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:57.414+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83117", "target": ["mon-mgr", ""]}) -- 0x7fb3380b5ca0 con 0x7fb31406daa0 2024-05-30T16:51:58.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.967+0000 7fb32ea00640 1 -- 172.21.15.144:0/3908212591 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb3380b5ca0 con 0x7fb31406daa0 2024-05-30T16:51:58.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb31406daa0 msgr2=0x7fb31406ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb31406daa0 0x7fb31406ff60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb328009560 tx=0x7fb328009190 comp rx=0 tx=0).stop 2024-05-30T16:51:58.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33814c630 msgr2=0x7fb3380c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:58.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33814c630 0x7fb3380c6f10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb330009eb0 tx=0x7fb330004a40 comp rx=0 tx=0).stop 2024-05-30T16:51:58.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 shutdown_connections 2024-05-30T16:51:58.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fb31406daa0 0x7fb31406ff60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33814c630 0x7fb3380c6f10 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3380cea10 0x7fb3380c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 --2- 172.21.15.144:0/3908212591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb338072920 0x7fb338165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:58.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 >> 172.21.15.144:0/3908212591 conn(0x7fb33806bd00 msgr2=0x7fb3380b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:58.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 shutdown_connections 2024-05-30T16:51:58.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:58.970+0000 7fb33d600640 1 -- 172.21.15.144:0/3908212591 wait complete. 2024-05-30T16:51:58.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83118 2024-05-30T16:51:59.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.383+0000 7ffba8200640 1 Processor -- start 2024-05-30T16:51:59.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.383+0000 7ffba8200640 1 -- start start 2024-05-30T16:51:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.386+0000 7ffba8200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffba00afa00 0x7ffba015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.386+0000 7ffba8200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffba00cc7a0 0x7ffba0140570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.386+0000 7ffba8200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba00cd030 con 0x7ffba006dfc0 2024-05-30T16:51:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.387+0000 7ffba8200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffba01413f0 con 0x7ffba00cc7a0 2024-05-30T16:51:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.387+0000 7ffba8200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ffba00cd860 con 0x7ffba00afa00 2024-05-30T16:51:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.387+0000 7ffba6200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ffba006dfc0 0x7ffba015e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.144:35752/0 (socket says 172.21.15.144:35752) 2024-05-30T16:51:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.387+0000 7ffba6200640 1 -- 172.21.15.144:0/1522694173 learned_addr learned my addr 172.21.15.144:0/1522694173 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:51:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.387+0000 7ffba4e00640 1 --2- 172.21.15.144:0/1522694173 >> v2:172.21.15.144:3300/0 conn(0x7ffba00cc7a0 0x7ffba0140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.388+0000 7ffba5800640 1 --2- 172.21.15.144:0/1522694173 >> v2:172.21.15.149:3300/0 conn(0x7ffba00afa00 0x7ffba015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.388+0000 7ffba4e00640 1 -- 172.21.15.144:0/1522694173 >> v2:172.21.15.149:3300/0 conn(0x7ffba00afa00 msgr2=0x7ffba015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:51:59.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.389+0000 7ffba4e00640 1 --2- 172.21.15.144:0/1522694173 >> v2:172.21.15.149:3300/0 conn(0x7ffba00afa00 0x7ffba015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.389+0000 7ffba4e00640 1 -- 172.21.15.144:0/1522694173 >> v1:172.21.15.149:6789/0 conn(0x7ffba006dfc0 legacy=0x7ffba015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.389+0000 7ffba4e00640 1 -- 172.21.15.144:0/1522694173 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba015c2d0 con 0x7ffba00cc7a0 2024-05-30T16:51:59.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.390+0000 7ffba5800640 1 --2- 172.21.15.144:0/1522694173 >> v2:172.21.15.149:3300/0 conn(0x7ffba00afa00 0x7ffba015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:51:59.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.391+0000 7ffba4e00640 1 --2- 172.21.15.144:0/1522694173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 0x7ffba0140570 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ffba0073250 tx=0x7ffb8c02b2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84772b9345e8e47 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:59.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.393+0000 7ffb9fe00640 1 -- 172.21.15.144:0/1522694173 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c038070 con 0x7ffba00cc7a0 2024-05-30T16:51:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.393+0000 7ffb9fe00640 1 -- 172.21.15.144:0/1522694173 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb8c033440 con 0x7ffba00cc7a0 2024-05-30T16:51:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.393+0000 7ffb9fe00640 1 -- 172.21.15.144:0/1522694173 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c033810 con 0x7ffba00cc7a0 2024-05-30T16:51:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.394+0000 7ffba8200640 1 -- 172.21.15.144:0/1522694173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 msgr2=0x7ffba0140570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.394+0000 7ffba8200640 1 --2- 172.21.15.144:0/1522694173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 0x7ffba0140570 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ffba0073250 tx=0x7ffb8c02b2f0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.395+0000 7ffba8200640 1 -- 172.21.15.144:0/1522694173 shutdown_connections 2024-05-30T16:51:59.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.396+0000 7ffba8200640 1 --2- 172.21.15.144:0/1522694173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 0x7ffba0140570 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.396+0000 7ffba8200640 1 --2- 172.21.15.144:0/1522694173 >> v2:172.21.15.149:3300/0 conn(0x7ffba00afa00 0x7ffba015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.396+0000 7ffba8200640 1 -- 172.21.15.144:0/1522694173 >> 172.21.15.144:0/1522694173 conn(0x7ffba006bd00 msgr2=0x7ffba006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:51:59.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.396+0000 7ffba8200640 1 -- 172.21.15.144:0/1522694173 shutdown_connections 2024-05-30T16:51:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.396+0000 7ffba8200640 1 -- 172.21.15.144:0/1522694173 wait complete. 2024-05-30T16:51:59.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.402+0000 7ffba8200640 1 Processor -- start 2024-05-30T16:51:59.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.403+0000 7ffba8200640 1 -- start start 2024-05-30T16:51:59.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.405+0000 7ffba8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba006dfc0 0x7ffba01e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.405+0000 7ffba8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba00afa00 0x7ffba013dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.406+0000 7ffba8200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 0x7ffba01588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.406+0000 7ffba8200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffba00ccc60 con 0x7ffba00cc7a0 2024-05-30T16:51:59.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.406+0000 7ffba8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffba00cd580 con 0x7ffba00afa00 2024-05-30T16:51:59.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.406+0000 7ffba8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffba00afde0 con 0x7ffba006dfc0 2024-05-30T16:51:59.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.409+0000 7ffba6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 0x7ffba01588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.409+0000 7ffba6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 0x7ffba01588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55552/0 (socket says 172.21.15.144:55552) 2024-05-30T16:51:59.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.409+0000 7ffba6200640 1 -- 172.21.15.144:0/3517817538 learned_addr learned my addr 172.21.15.144:0/3517817538 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:51:59.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.410+0000 7ffba6200640 1 -- 172.21.15.144:0/3517817538 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba006dfc0 msgr2=0x7ffba01e3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.410+0000 7ffba6200640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba006dfc0 0x7ffba01e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.410+0000 7ffba6200640 1 -- 172.21.15.144:0/3517817538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba00afa00 msgr2=0x7ffba013dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:51:59.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.410+0000 7ffba6200640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba00afa00 0x7ffba013dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:51:59.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.410+0000 7ffba6200640 1 -- 172.21.15.144:0/3517817538 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba01e4480 con 0x7ffba00cc7a0 2024-05-30T16:51:59.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.411+0000 7ffba6200640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 0x7ffba01588f0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c550 tx=0x7ffb9800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.413+0000 7ffb9d600640 1 -- 172.21.15.144:0/3517817538 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98018070 con 0x7ffba00cc7a0 2024-05-30T16:51:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.413+0000 7ffb9d600640 1 -- 172.21.15.144:0/3517817538 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb98007500 con 0x7ffba00cc7a0 2024-05-30T16:51:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.413+0000 7ffb9d600640 1 -- 172.21.15.144:0/3517817538 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98004a20 con 0x7ffba00cc7a0 2024-05-30T16:51:59.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.415+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba01e4720 con 0x7ffba00cc7a0 2024-05-30T16:51:59.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.416+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba01e4ce0 con 0x7ffba00cc7a0 2024-05-30T16:51:59.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.420+0000 7ffb9d600640 1 -- 172.21.15.144:0/3517817538 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7ffb9801b070 con 0x7ffba00cc7a0 2024-05-30T16:51:59.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.421+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba015bdc0 con 0x7ffba00cc7a0 2024-05-30T16:51:59.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.422+0000 7ffb9d600640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb8006da20 0x7ffb8006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:51:59.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.422+0000 7ffb9d600640 1 -- 172.21.15.144:0/3517817538 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7ffb98089f30 con 0x7ffba00cc7a0 2024-05-30T16:51:59.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.430+0000 7ffb9d600640 1 -- 172.21.15.144:0/3517817538 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffba015bdc0 con 0x7ffba00cc7a0 2024-05-30T16:51:59.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.434+0000 7ffba5800640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb8006da20 0x7ffb8006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:51:59.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.452+0000 7ffba5800640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb8006da20 0x7ffb8006fee0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffb94008ea0 tx=0x7ffb940083d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:51:59.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:51:59.960+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83118", "target": ["mon-mgr", ""]}) -- 0x7ffba0068b90 con 0x7ffb8006da20 2024-05-30T16:52:00.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.640+0000 7ffb9d600640 1 -- 172.21.15.144:0/3517817538 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ffba0068b90 con 0x7ffb8006da20 2024-05-30T16:52:00.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb8006da20 msgr2=0x7ffb8006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb8006da20 0x7ffb8006fee0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffb94008ea0 tx=0x7ffb940083d0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 msgr2=0x7ffba01588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:00.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 0x7ffba01588f0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c550 tx=0x7ffb9800ca10 comp rx=0 tx=0).stop 2024-05-30T16:52:00.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 shutdown_connections 2024-05-30T16:52:00.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ffb8006da20 0x7ffb8006fee0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cc7a0 0x7ffba01588f0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba00afa00 0x7ffba013dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 --2- 172.21.15.144:0/3517817538 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba006dfc0 0x7ffba01e3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:00.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.643+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 >> 172.21.15.144:0/3517817538 conn(0x7ffba006bd00 msgr2=0x7ffba006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:00.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.644+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 shutdown_connections 2024-05-30T16:52:00.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:00.644+0000 7ffba8200640 1 -- 172.21.15.144:0/3517817538 wait complete. 2024-05-30T16:52:00.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83119 2024-05-30T16:52:01.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.100+0000 7faa21a00640 1 Processor -- start 2024-05-30T16:52:01.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.101+0000 7faa21a00640 1 -- start start 2024-05-30T16:52:01.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.104+0000 7faa21a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.104+0000 7faa21a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa1c06c5e0 0x7faa1c0cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.105+0000 7faa1be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.105+0000 7faa21a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa1c0ce640 con 0x7faa1c0b39a0 2024-05-30T16:52:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.105+0000 7faa21a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7faa1c0ce920 con 0x7faa1c06c5e0 2024-05-30T16:52:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.105+0000 7faa21a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faa1c0cec00 con 0x7faa1c162c90 2024-05-30T16:52:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.105+0000 7faa1b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa1c06c5e0 0x7faa1c0cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.105+0000 7faa1b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa1c06c5e0 0x7faa1c0cf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:57116/0 (socket says 172.21.15.144:57116) 2024-05-30T16:52:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.106+0000 7faa1be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c0b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:43728/0 (socket says 172.21.15.144:43728) 2024-05-30T16:52:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.106+0000 7faa1be00640 1 -- 172.21.15.144:0/3739214257 learned_addr learned my addr 172.21.15.144:0/3739214257 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:01.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.106+0000 7faa1be00640 1 -- 172.21.15.144:0/3739214257 >> v2:172.21.15.149:3300/0 conn(0x7faa1c06c5e0 msgr2=0x7faa1c0cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:01.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.106+0000 7faa1be00640 1 --2- 172.21.15.144:0/3739214257 >> v2:172.21.15.149:3300/0 conn(0x7faa1c06c5e0 0x7faa1c0cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.106+0000 7faa1be00640 1 -- 172.21.15.144:0/3739214257 >> v1:172.21.15.144:6789/0 conn(0x7faa1c0b39a0 legacy=0x7faa1c166880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.106+0000 7faa1be00640 1 -- 172.21.15.144:0/3739214257 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c0ceee0 con 0x7faa1c162c90 2024-05-30T16:52:01.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.110+0000 7faa1be00640 1 --2- 172.21.15.144:0/3739214257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c0b3460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa08009870 tx=0x7faa0802a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96a1e71a6411c337 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:01.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.110+0000 7faa1aa00640 1 -- 172.21.15.144:0/3739214257 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08037070 con 0x7faa1c162c90 2024-05-30T16:52:01.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.111+0000 7faa1aa00640 1 -- 172.21.15.144:0/3739214257 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa08032440 con 0x7faa1c162c90 2024-05-30T16:52:01.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.111+0000 7faa1aa00640 1 -- 172.21.15.144:0/3739214257 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08037070 con 0x7faa1c162c90 2024-05-30T16:52:01.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.117+0000 7faa21a00640 1 -- 172.21.15.144:0/3739214257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 msgr2=0x7faa1c0b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.117+0000 7faa21a00640 1 --2- 172.21.15.144:0/3739214257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c0b3460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa08009870 tx=0x7faa0802a1f0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.120+0000 7faa21a00640 1 -- 172.21.15.144:0/3739214257 shutdown_connections 2024-05-30T16:52:01.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.120+0000 7faa21a00640 1 --2- 172.21.15.144:0/3739214257 >> v2:172.21.15.149:3300/0 conn(0x7faa1c06c5e0 0x7faa1c0cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.120+0000 7faa21a00640 1 --2- 172.21.15.144:0/3739214257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c0b3460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.120+0000 7faa21a00640 1 -- 172.21.15.144:0/3739214257 >> 172.21.15.144:0/3739214257 conn(0x7faa1c06b8e0 msgr2=0x7faa1c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:01.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.121+0000 7faa21a00640 1 -- 172.21.15.144:0/3739214257 shutdown_connections 2024-05-30T16:52:01.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.122+0000 7faa21a00640 1 -- 172.21.15.144:0/3739214257 wait complete. 2024-05-30T16:52:01.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.127+0000 7faa21a00640 1 Processor -- start 2024-05-30T16:52:01.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.129+0000 7faa21a00640 1 -- start start 2024-05-30T16:52:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.136+0000 7faa21a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa1c06c5e0 0x7faa1c160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.136+0000 7faa21a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0b39a0 0x7faa1c15f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.136+0000 7faa21a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c15fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.136+0000 7faa21a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c163070 con 0x7faa1c0b39a0 2024-05-30T16:52:01.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.136+0000 7faa21a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c0ce1d0 con 0x7faa1c06c5e0 2024-05-30T16:52:01.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.136+0000 7faa21a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faa1c159490 con 0x7faa1c162c90 2024-05-30T16:52:01.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.137+0000 7faa1be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa1c06c5e0 0x7faa1c160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.137+0000 7faa1be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa1c06c5e0 0x7faa1c160cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:57128/0 (socket says 172.21.15.144:57128) 2024-05-30T16:52:01.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.137+0000 7faa1be00640 1 -- 172.21.15.144:0/2325009566 learned_addr learned my addr 172.21.15.144:0/2325009566 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:01.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.137+0000 7faa1b400640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0b39a0 0x7faa1c15f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.138+0000 7faa1be00640 1 -- 172.21.15.144:0/2325009566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 msgr2=0x7faa1c15fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.138+0000 7faa21000640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c15fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.138+0000 7faa1be00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c15fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.138+0000 7faa1be00640 1 -- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0b39a0 msgr2=0x7faa1c15f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:01.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.139+0000 7faa1be00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0b39a0 0x7faa1c15f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.139+0000 7faa1be00640 1 -- 172.21.15.144:0/2325009566 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c158e80 con 0x7faa1c06c5e0 2024-05-30T16:52:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.141+0000 7faa21000640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c15fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:01.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.141+0000 7faa1b400640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0b39a0 0x7faa1c15f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:01.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.143+0000 7faa1be00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa1c06c5e0 0x7faa1c160cf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faa0802a230 tx=0x7faa080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.144+0000 7faa13e00640 1 -- 172.21.15.144:0/2325009566 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08037040 con 0x7faa1c06c5e0 2024-05-30T16:52:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.144+0000 7faa13e00640 1 -- 172.21.15.144:0/2325009566 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa08003cf0 con 0x7faa1c06c5e0 2024-05-30T16:52:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.144+0000 7faa13e00640 1 -- 172.21.15.144:0/2325009566 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08032810 con 0x7faa1c06c5e0 2024-05-30T16:52:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.144+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1c160440 con 0x7faa1c06c5e0 2024-05-30T16:52:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.144+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1c160720 con 0x7faa1c06c5e0 2024-05-30T16:52:01.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.150+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa1c0632f0 con 0x7faa1c06c5e0 2024-05-30T16:52:01.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.160+0000 7faa13e00640 1 -- 172.21.15.144:0/2325009566 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7faa080329b0 con 0x7faa1c06c5e0 2024-05-30T16:52:01.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.162+0000 7faa13e00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9fc06d9d0 0x7fa9fc06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:01.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.163+0000 7faa13e00640 1 -- 172.21.15.144:0/2325009566 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7faa080ab0b0 con 0x7faa1c06c5e0 2024-05-30T16:52:01.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.165+0000 7faa1b400640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9fc06d9d0 0x7fa9fc06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:01.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.167+0000 7faa1b400640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9fc06d9d0 0x7fa9fc06fe90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faa1c15bde0 tx=0x7faa0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:01.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.177+0000 7faa13e00640 1 -- 172.21.15.144:0/2325009566 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa08030e20 con 0x7faa1c06c5e0 2024-05-30T16:52:01.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:01.698+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83119", "target": ["mon-mgr", ""]}) -- 0x7faa1c075570 con 0x7fa9fc06d9d0 2024-05-30T16:52:02.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.131+0000 7faa13e00640 1 -- 172.21.15.144:0/2325009566 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faa1c075570 con 0x7fa9fc06d9d0 2024-05-30T16:52:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.133+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9fc06d9d0 msgr2=0x7fa9fc06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.133+0000 7faa21a00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9fc06d9d0 0x7fa9fc06fe90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faa1c15bde0 tx=0x7faa0c008040 comp rx=0 tx=0).stop 2024-05-30T16:52:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.133+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa1c06c5e0 msgr2=0x7faa1c160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.133+0000 7faa21a00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa1c06c5e0 0x7faa1c160cf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faa0802a230 tx=0x7faa080046c0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.134+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 shutdown_connections 2024-05-30T16:52:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.134+0000 7faa21a00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fa9fc06d9d0 0x7fa9fc06fe90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.134+0000 7faa21a00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faa1c162c90 0x7faa1c15fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.134+0000 7faa21a00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0b39a0 0x7faa1c15f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.134+0000 7faa21a00640 1 --2- 172.21.15.144:0/2325009566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa1c06c5e0 0x7faa1c160cf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.134+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 >> 172.21.15.144:0/2325009566 conn(0x7faa1c06b8e0 msgr2=0x7faa1c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.134+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 shutdown_connections 2024-05-30T16:52:02.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.134+0000 7faa21a00640 1 -- 172.21.15.144:0/2325009566 wait complete. 2024-05-30T16:52:02.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone83120 2024-05-30T16:52:02.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.414+0000 7f937da00640 1 Processor -- start 2024-05-30T16:52:02.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.414+0000 7f937da00640 1 -- start start 2024-05-30T16:52:02.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.415+0000 7f937da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f93780b5150 0x7f937816d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.415+0000 7f937da00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f937806fbf0 con 0x7f937814c630 2024-05-30T16:52:02.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.415+0000 7f937da00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93780cf050 con 0x7f9378072210 2024-05-30T16:52:02.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.415+0000 7f937da00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f93780cf330 con 0x7f93780b5150 2024-05-30T16:52:02.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.415+0000 7f9377400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f93780b5150 0x7f937816d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.415+0000 7f9376a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f937814c630 0x7f93780ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43062/0 (socket says 172.21.15.144:43062) 2024-05-30T16:52:02.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.415+0000 7f9376a00640 1 -- 172.21.15.144:0/3666825472 learned_addr learned my addr 172.21.15.144:0/3666825472 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:52:02.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.416+0000 7f9377400640 1 -- 172.21.15.144:0/3666825472 >> v1:172.21.15.149:6789/0 conn(0x7f9378072210 legacy=0x7f9378072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.416+0000 7f9377400640 1 -- 172.21.15.144:0/3666825472 >> v1:172.21.15.144:6789/0 conn(0x7f937814c630 legacy=0x7f93780ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.416+0000 7f9377400640 1 -- 172.21.15.144:0/3666825472 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93780cf610 con 0x7f93780b5150 2024-05-30T16:52:02.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.417+0000 7f9377400640 1 --2- 172.21.15.144:0/3666825472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93780b5150 0x7f937816d9f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9370009dc0 tx=0x7f937002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384e3c69cf8871b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:02.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.417+0000 7f9376000640 1 -- 172.21.15.144:0/3666825472 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370037070 con 0x7f93780b5150 2024-05-30T16:52:02.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.417+0000 7f9376000640 1 -- 172.21.15.144:0/3666825472 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9370007740 con 0x7f93780b5150 2024-05-30T16:52:02.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.417+0000 7f9376000640 1 -- 172.21.15.144:0/3666825472 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370007b10 con 0x7f93780b5150 2024-05-30T16:52:02.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.417+0000 7f937da00640 1 -- 172.21.15.144:0/3666825472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93780b5150 msgr2=0x7f937816d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.417+0000 7f937da00640 1 --2- 172.21.15.144:0/3666825472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93780b5150 0x7f937816d9f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9370009dc0 tx=0x7f937002a7c0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.418+0000 7f937da00640 1 -- 172.21.15.144:0/3666825472 shutdown_connections 2024-05-30T16:52:02.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.418+0000 7f937da00640 1 --2- 172.21.15.144:0/3666825472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93780b5150 0x7f937816d9f0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.418+0000 7f937da00640 1 -- 172.21.15.144:0/3666825472 >> 172.21.15.144:0/3666825472 conn(0x7f937806bd00 msgr2=0x7f937806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.418+0000 7f937da00640 1 -- 172.21.15.144:0/3666825472 shutdown_connections 2024-05-30T16:52:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.418+0000 7f937da00640 1 -- 172.21.15.144:0/3666825472 wait complete. 2024-05-30T16:52:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.419+0000 7f937da00640 1 Processor -- start 2024-05-30T16:52:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.419+0000 7f937da00640 1 -- start start 2024-05-30T16:52:02.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.420+0000 7f937da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378072210 0x7f93781f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.420+0000 7f937da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93780b5150 0x7f93780c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.420+0000 7f937da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937814c630 0x7f93780c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.420+0000 7f937da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f937814ca10 con 0x7f9378072210 2024-05-30T16:52:02.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.420+0000 7f937da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93780b3c20 con 0x7f93780b5150 2024-05-30T16:52:02.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.420+0000 7f937da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f937814cb90 con 0x7f937814c630 2024-05-30T16:52:02.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.420+0000 7f9376a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378072210 0x7f93781f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f9376a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378072210 0x7f93781f9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55574/0 (socket says 172.21.15.144:55574) 2024-05-30T16:52:02.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f9376a00640 1 -- 172.21.15.144:0/1867097361 learned_addr learned my addr 172.21.15.144:0/1867097361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f9377400640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937814c630 0x7f93780c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f936fe00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93780b5150 0x7f93780c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f9376a00640 1 -- 172.21.15.144:0/1867097361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937814c630 msgr2=0x7f93780c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f9376a00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937814c630 0x7f93780c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f9376a00640 1 -- 172.21.15.144:0/1867097361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93780b5150 msgr2=0x7f93780c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f9376a00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93780b5150 0x7f93780c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f9376a00640 1 -- 172.21.15.144:0/1867097361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93781fc540 con 0x7f9378072210 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f9376a00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378072210 0x7f93781f9830 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f936800c400 tx=0x7f936800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f936ea00640 1 -- 172.21.15.144:0/1867097361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368017070 con 0x7f9378072210 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.421+0000 7f936ea00640 1 -- 172.21.15.144:0/1867097361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9368005ce0 con 0x7f9378072210 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.422+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93781fc820 con 0x7f9378072210 2024-05-30T16:52:02.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.422+0000 7f936ea00640 1 -- 172.21.15.144:0/1867097361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368007310 con 0x7f9378072210 2024-05-30T16:52:02.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.422+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93781fcde0 con 0x7f9378072210 2024-05-30T16:52:02.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.423+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9378068b90 con 0x7f9378072210 2024-05-30T16:52:02.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.424+0000 7f936ea00640 1 -- 172.21.15.144:0/1867097361 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f936801a070 con 0x7f9378072210 2024-05-30T16:52:02.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.425+0000 7f936ea00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f935406d9d0 0x7f935406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:02.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.425+0000 7f936ea00640 1 -- 172.21.15.144:0/1867097361 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f9368089d30 con 0x7f9378072210 2024-05-30T16:52:02.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.427+0000 7f936fe00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f935406d9d0 0x7f935406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:02.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.427+0000 7f936fe00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f935406d9d0 0x7f935406fe90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f93780af7f0 tx=0x7f9360009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:02.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.433+0000 7f936ea00640 1 -- 172.21.15.144:0/1867097361 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9368059220 con 0x7f9378072210 2024-05-30T16:52:02.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:02.866+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone83120", "target": ["mon-mgr", ""]}) -- 0x7f9378075f70 con 0x7f935406d9d0 2024-05-30T16:52:03.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.052+0000 7f936ea00640 1 -- 172.21.15.144:0/1867097361 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9360001d30 con 0x7f935406d9d0 2024-05-30T16:52:03.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.054+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f935406d9d0 msgr2=0x7f935406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.054+0000 7f937da00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f935406d9d0 0x7f935406fe90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f93780af7f0 tx=0x7f9360009040 comp rx=0 tx=0).stop 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.054+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378072210 msgr2=0x7f93781f9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.054+0000 7f937da00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378072210 0x7f93781f9830 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f936800c400 tx=0x7f936800c8c0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.055+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 shutdown_connections 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.055+0000 7f937da00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f935406d9d0 0x7f935406fe90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.055+0000 7f937da00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937814c630 0x7f93780c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.055+0000 7f937da00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93780b5150 0x7f93780c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.055+0000 7f937da00640 1 --2- 172.21.15.144:0/1867097361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378072210 0x7f93781f9830 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.055+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 >> 172.21.15.144:0/1867097361 conn(0x7f937806bd00 msgr2=0x7f93780b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.055+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 shutdown_connections 2024-05-30T16:52:03.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.055+0000 7f937da00640 1 -- 172.21.15.144:0/1867097361 wait complete. 2024-05-30T16:52:03.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T16:52:03.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.247+0000 7f069fa00640 1 Processor -- start 2024-05-30T16:52:03.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.247+0000 7f069fa00640 1 -- start start 2024-05-30T16:52:03.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.249+0000 7f069fa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 0x7f06980b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.249+0000 7f069fa00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06980b6510 0x7f06980d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.249+0000 7f069fa00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069806def0 con 0x7f06980d2910 2024-05-30T16:52:03.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.249+0000 7f069fa00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f06980d2d80 con 0x7f06980b6510 2024-05-30T16:52:03.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.249+0000 7f069fa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0698162200 con 0x7f0698161e20 2024-05-30T16:52:03.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.250+0000 7f069d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 0x7f06980b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.250+0000 7f068fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06980b6510 0x7f06980d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.250+0000 7f069d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 0x7f06980b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:43752/0 (socket says 172.21.15.144:43752) 2024-05-30T16:52:03.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.250+0000 7f069d000640 1 -- 172.21.15.144:0/2274456261 learned_addr learned my addr 172.21.15.144:0/2274456261 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:03.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.250+0000 7f068fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06980b6510 0x7f06980d23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:57148/0 (socket says 172.21.15.144:57148) 2024-05-30T16:52:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.251+0000 7f068fe00640 1 -- 172.21.15.144:0/2274456261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 msgr2=0x7f06980b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.251+0000 7f068fe00640 1 --2- 172.21.15.144:0/2274456261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 0x7f06980b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.251+0000 7f068fe00640 1 -- 172.21.15.144:0/2274456261 >> v1:172.21.15.149:6789/0 conn(0x7f06980d2910 legacy=0x7f06980718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.251+0000 7f068fe00640 1 -- 172.21.15.144:0/2274456261 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069806ce50 con 0x7f06980b6510 2024-05-30T16:52:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.251+0000 7f069d000640 1 --2- 172.21.15.144:0/2274456261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 0x7f06980b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.252+0000 7f068fe00640 1 --2- 172.21.15.144:0/2274456261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06980b6510 0x7f06980d23d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06840097a0 tx=0x7f068402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36bb0aca88977979 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.252+0000 7f0697e00640 1 -- 172.21.15.144:0/2274456261 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684037070 con 0x7f06980b6510 2024-05-30T16:52:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.252+0000 7f0697e00640 1 -- 172.21.15.144:0/2274456261 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684032440 con 0x7f06980b6510 2024-05-30T16:52:03.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.252+0000 7f0697e00640 1 -- 172.21.15.144:0/2274456261 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684032810 con 0x7f06980b6510 2024-05-30T16:52:03.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.253+0000 7f069fa00640 1 -- 172.21.15.144:0/2274456261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06980b6510 msgr2=0x7f06980d23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.253+0000 7f069fa00640 1 --2- 172.21.15.144:0/2274456261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06980b6510 0x7f06980d23d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06840097a0 tx=0x7f068402a180 comp rx=0 tx=0).stop 2024-05-30T16:52:03.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.253+0000 7f069fa00640 1 -- 172.21.15.144:0/2274456261 shutdown_connections 2024-05-30T16:52:03.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.253+0000 7f069fa00640 1 --2- 172.21.15.144:0/2274456261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06980b6510 0x7f06980d23d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.253+0000 7f069fa00640 1 --2- 172.21.15.144:0/2274456261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 0x7f06980b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.253+0000 7f069fa00640 1 -- 172.21.15.144:0/2274456261 >> 172.21.15.144:0/2274456261 conn(0x7f0698070260 msgr2=0x7f0698070640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:03.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.253+0000 7f069fa00640 1 -- 172.21.15.144:0/2274456261 shutdown_connections 2024-05-30T16:52:03.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.253+0000 7f069fa00640 1 -- 172.21.15.144:0/2274456261 wait complete. 2024-05-30T16:52:03.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.255+0000 7f069fa00640 1 Processor -- start 2024-05-30T16:52:03.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.255+0000 7f069fa00640 1 -- start start 2024-05-30T16:52:03.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f069fa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06980b6510 0x7f0698145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f069fa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06980d2910 0x7f06981447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f069fa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 0x7f06980cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f069fa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f069806d410 con 0x7f06980d2910 2024-05-30T16:52:03.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f069fa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f069806cc00 con 0x7f06980b6510 2024-05-30T16:52:03.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f069fa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f069806d6f0 con 0x7f0698161e20 2024-05-30T16:52:03.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f068fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06980d2910 0x7f06981447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f068fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06980d2910 0x7f06981447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55582/0 (socket says 172.21.15.144:55582) 2024-05-30T16:52:03.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f068fe00640 1 -- 172.21.15.144:0/1384267150 learned_addr learned my addr 172.21.15.144:0/1384267150 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:03.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f068fe00640 1 -- 172.21.15.144:0/1384267150 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 msgr2=0x7f06980cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f068fe00640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 0x7f06980cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f068fe00640 1 -- 172.21.15.144:0/1384267150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06980b6510 msgr2=0x7f0698145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f068fe00640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06980b6510 0x7f0698145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.256+0000 7f068fe00640 1 -- 172.21.15.144:0/1384267150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06980b50e0 con 0x7f06980d2910 2024-05-30T16:52:03.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.257+0000 7f068fe00640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06980d2910 0x7f06981447f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0684035040 tx=0x7f06840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.257+0000 7f0695600640 1 -- 172.21.15.144:0/1384267150 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684041020 con 0x7f06980d2910 2024-05-30T16:52:03.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.257+0000 7f0695600640 1 -- 172.21.15.144:0/1384267150 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684030700 con 0x7f06980d2910 2024-05-30T16:52:03.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.257+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06980b4e00 con 0x7f06980d2910 2024-05-30T16:52:03.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.257+0000 7f0695600640 1 -- 172.21.15.144:0/1384267150 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684037040 con 0x7f06980d2910 2024-05-30T16:52:03.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.257+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06980ce1b0 con 0x7f06980d2910 2024-05-30T16:52:03.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.258+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0698068b20 con 0x7f06980d2910 2024-05-30T16:52:03.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.259+0000 7f0695600640 1 -- 172.21.15.144:0/1384267150 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f0684044020 con 0x7f06980d2910 2024-05-30T16:52:03.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.260+0000 7f0695600640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f067806d9d0 0x7f067806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.260+0000 7f0695600640 1 -- 172.21.15.144:0/1384267150 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f06840aaf60 con 0x7f06980d2910 2024-05-30T16:52:03.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.260+0000 7f069d000640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f067806d9d0 0x7f067806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.261+0000 7f069d000640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f067806d9d0 0x7f067806fe90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0688006f40 tx=0x7f0688006e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.265+0000 7f0695600640 1 -- 172.21.15.144:0/1384267150 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f068404b030 con 0x7f06980d2910 2024-05-30T16:52:03.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.477+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f06980d13c0 con 0x7f067806d9d0 2024-05-30T16:52:03.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.479+0000 7f0695600640 1 -- 172.21.15.144:0/1384267150 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f06980d13c0 con 0x7f067806d9d0 2024-05-30T16:52:03.480 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-05-30T16:52:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-05-30T16:52:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:03.481 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-05-30T16:52:03.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f067806d9d0 msgr2=0x7f067806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f067806d9d0 0x7f067806fe90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0688006f40 tx=0x7f0688006e90 comp rx=0 tx=0).stop 2024-05-30T16:52:03.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06980d2910 msgr2=0x7f06981447f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06980d2910 0x7f06981447f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0684035040 tx=0x7f06840046c0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 shutdown_connections 2024-05-30T16:52:03.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f067806d9d0 0x7f067806fe90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0698161e20 0x7f06980cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06980d2910 0x7f06981447f0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 --2- 172.21.15.144:0/1384267150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06980b6510 0x7f0698145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.481+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 >> 172.21.15.144:0/1384267150 conn(0x7f0698070260 msgr2=0x7f06980d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:03.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.482+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 shutdown_connections 2024-05-30T16:52:03.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.482+0000 7f069fa00640 1 -- 172.21.15.144:0/1384267150 wait complete. 2024-05-30T16:52:03.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:03.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.687+0000 7f7f12400640 1 Processor -- start 2024-05-30T16:52:03.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.687+0000 7f7f12400640 1 -- start start 2024-05-30T16:52:03.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f12400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7f0c160cf0 0x7f7f0c160150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f12400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f0c160690 0x7f7f0c152d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f12400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f0c06f6e0 con 0x7f7f0c0d0550 2024-05-30T16:52:03.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f12400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7f0c06f9c0 con 0x7f7f0c160690 2024-05-30T16:52:03.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f12400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f7f0c06fca0 con 0x7f7f0c160cf0 2024-05-30T16:52:03.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f11a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f0c160690 0x7f7f0c152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f11a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f0c160690 0x7f7f0c152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55592/0 (socket says 172.21.15.144:55592) 2024-05-30T16:52:03.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f11a00640 1 -- 172.21.15.144:0/1550143727 learned_addr learned my addr 172.21.15.144:0/1550143727 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:03.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f11a00640 1 -- 172.21.15.144:0/1550143727 >> v2:172.21.15.149:3300/0 conn(0x7f7f0c160cf0 msgr2=0x7f7f0c160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:03.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f11a00640 1 --2- 172.21.15.144:0/1550143727 >> v2:172.21.15.149:3300/0 conn(0x7f7f0c160cf0 0x7f7f0c160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f11a00640 1 -- 172.21.15.144:0/1550143727 >> v1:172.21.15.149:6789/0 conn(0x7f7f0c0d0550 legacy=0x7f7f0c06ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:03.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.689+0000 7f7f11a00640 1 -- 172.21.15.144:0/1550143727 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c06ff80 con 0x7f7f0c160690 2024-05-30T16:52:03.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.690+0000 7f7f11a00640 1 --2- 172.21.15.144:0/1550143727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160690 0x7f7f0c152d80 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009e50 tx=0x7f7f0402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b253a4b6597d9d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.691+0000 7f7f0b400640 1 -- 172.21.15.144:0/1550143727 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04036070 con 0x7f7f0c160690 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.691+0000 7f7f0b400640 1 -- 172.21.15.144:0/1550143727 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f04031600 con 0x7f7f0c160690 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.691+0000 7f7f0b400640 1 -- 172.21.15.144:0/1550143727 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0402ae60 con 0x7f7f0c160690 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.691+0000 7f7f12400640 1 -- 172.21.15.144:0/1550143727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160690 msgr2=0x7f7f0c152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.691+0000 7f7f12400640 1 --2- 172.21.15.144:0/1550143727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160690 0x7f7f0c152d80 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009e50 tx=0x7f7f0402a680 comp rx=0 tx=0).stop 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.691+0000 7f7f12400640 1 -- 172.21.15.144:0/1550143727 shutdown_connections 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.691+0000 7f7f12400640 1 --2- 172.21.15.144:0/1550143727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160690 0x7f7f0c152d80 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.691+0000 7f7f12400640 1 --2- 172.21.15.144:0/1550143727 >> v2:172.21.15.149:3300/0 conn(0x7f7f0c160cf0 0x7f7f0c160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.691+0000 7f7f12400640 1 -- 172.21.15.144:0/1550143727 >> 172.21.15.144:0/1550143727 conn(0x7f7f0c073460 msgr2=0x7f7f0c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.692+0000 7f7f12400640 1 -- 172.21.15.144:0/1550143727 shutdown_connections 2024-05-30T16:52:03.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.692+0000 7f7f12400640 1 -- 172.21.15.144:0/1550143727 wait complete. 2024-05-30T16:52:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.693+0000 7f7f12400640 1 Processor -- start 2024-05-30T16:52:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.693+0000 7f7f12400640 1 -- start start 2024-05-30T16:52:03.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.694+0000 7f7f12400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f0c0d0550 0x7f7f0c0adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.694+0000 7f7f12400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f0c160690 0x7f7f0c14bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.694+0000 7f7f12400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160cf0 0x7f7f0c14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.694+0000 7f7f12400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c0d0ab0 con 0x7f7f0c160cf0 2024-05-30T16:52:03.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.694+0000 7f7f12400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c0d0930 con 0x7f7f0c0d0550 2024-05-30T16:52:03.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.694+0000 7f7f12400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0c1532c0 con 0x7f7f0c160690 2024-05-30T16:52:03.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.694+0000 7f7f11a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160cf0 0x7f7f0c14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.694+0000 7f7f11a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160cf0 0x7f7f0c14b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55596/0 (socket says 172.21.15.144:55596) 2024-05-30T16:52:03.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.694+0000 7f7f11a00640 1 -- 172.21.15.144:0/3243598002 learned_addr learned my addr 172.21.15.144:0/3243598002 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:03.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f11a00640 1 -- 172.21.15.144:0/3243598002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f0c160690 msgr2=0x7f7f0c14bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f11a00640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f0c160690 0x7f7f0c14bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f11000640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f0c0d0550 0x7f7f0c0adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f11a00640 1 -- 172.21.15.144:0/3243598002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f0c0d0550 msgr2=0x7f7f0c0adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f11a00640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f0c0d0550 0x7f7f0c0adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f11a00640 1 -- 172.21.15.144:0/3243598002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c14c310 con 0x7f7f0c160cf0 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f11a00640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160cf0 0x7f7f0c14b560 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f7f04034040 tx=0x7f7f04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f08c00640 1 -- 172.21.15.144:0/3243598002 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04041020 con 0x7f7f0c160cf0 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f08c00640 1 -- 172.21.15.144:0/3243598002 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0402ae60 con 0x7f7f0c160cf0 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f08c00640 1 -- 172.21.15.144:0/3243598002 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04036040 con 0x7f7f0c160cf0 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.695+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c0ae5f0 con 0x7f7f0c160cf0 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.696+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c0aebb0 con 0x7f7f0c160cf0 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.697+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0c075570 con 0x7f7f0c160cf0 2024-05-30T16:52:03.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.698+0000 7f7f08c00640 1 -- 172.21.15.144:0/3243598002 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f7f04044020 con 0x7f7f0c160cf0 2024-05-30T16:52:03.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.698+0000 7f7f08c00640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7eec06d9d0 0x7f7eec06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:03.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.699+0000 7f7f08c00640 1 -- 172.21.15.144:0/3243598002 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f7f040ab380 con 0x7f7f0c160cf0 2024-05-30T16:52:03.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.699+0000 7f7f11000640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7eec06d9d0 0x7f7eec06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:03.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.699+0000 7f7f11000640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7eec06d9d0 0x7f7eec06fe90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7f000015d0 tx=0x7f7f00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:03.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.703+0000 7f7f08c00640 1 -- 172.21.15.144:0/3243598002 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7f0404b030 con 0x7f7f0c160cf0 2024-05-30T16:52:03.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.957+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7f0c0b0110 con 0x7f7f0c160cf0 2024-05-30T16:52:03.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.958+0000 7f7f08c00640 1 -- 172.21.15.144:0/3243598002 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2420 (secure 0 0 0) 0x7f7f0c14c310 con 0x7f7f0c160cf0 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 636, 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12671, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 52932745174, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 106183139328, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 666910973952, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 799996111, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 791345335, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 195, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 215 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:03.963 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:03.964 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:03.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.960+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7eec06d9d0 msgr2=0x7f7eec06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.960+0000 7f7f12400640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7eec06d9d0 0x7f7eec06fe90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7f000015d0 tx=0x7f7f00009040 comp rx=0 tx=0).stop 2024-05-30T16:52:03.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160cf0 msgr2=0x7f7f0c14b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:03.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160cf0 0x7f7f0c14b560 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f7f04034040 tx=0x7f7f04004a40 comp rx=0 tx=0).stop 2024-05-30T16:52:03.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 shutdown_connections 2024-05-30T16:52:03.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f7eec06d9d0 0x7f7eec06fe90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c160cf0 0x7f7f0c14b560 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f0c160690 0x7f7f0c14bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 --2- 172.21.15.144:0/3243598002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f0c0d0550 0x7f7f0c0adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:03.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 >> 172.21.15.144:0/3243598002 conn(0x7f7f0c073460 msgr2=0x7f7f0c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:03.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 shutdown_connections 2024-05-30T16:52:03.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:03.961+0000 7f7f12400640 1 -- 172.21.15.144:0/3243598002 wait complete. 2024-05-30T16:52:08.981 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:09.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.186+0000 7f3f44c00640 1 Processor -- start 2024-05-30T16:52:09.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.186+0000 7f3f44c00640 1 -- start start 2024-05-30T16:52:09.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.187+0000 7f3f44c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3f4006b8e0 0x7f3f4006bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.187+0000 7f3f44c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f4006ece0 0x7f3f4006f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.187+0000 7f3f44c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f400ccd20 con 0x7f3f400cc0b0 2024-05-30T16:52:09.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.187+0000 7f3f44c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3f400cd000 con 0x7f3f4006b8e0 2024-05-30T16:52:09.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.187+0000 7f3f44c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3f400cd2e0 con 0x7f3f4006ece0 2024-05-30T16:52:09.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f3f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3f400cc0b0 0x7f3f4015d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35700/0 (socket says 172.21.15.144:35700) 2024-05-30T16:52:09.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f3f400640 1 -- 172.21.15.144:0/3764588152 learned_addr learned my addr 172.21.15.144:0/3764588152 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:52:09.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f36a00640 1 --2- 172.21.15.144:0/3764588152 >> v2:172.21.15.144:3300/0 conn(0x7f3f4006b8e0 0x7f3f4006bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f3fe00640 1 --2- 172.21.15.144:0/3764588152 >> v2:172.21.15.149:3300/0 conn(0x7f3f4006ece0 0x7f3f4006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f36a00640 1 -- 172.21.15.144:0/3764588152 >> v2:172.21.15.149:3300/0 conn(0x7f3f4006ece0 msgr2=0x7f3f4006f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:09.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f36a00640 1 --2- 172.21.15.144:0/3764588152 >> v2:172.21.15.149:3300/0 conn(0x7f3f4006ece0 0x7f3f4006f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f36a00640 1 -- 172.21.15.144:0/3764588152 >> v1:172.21.15.144:6789/0 conn(0x7f3f400cc0b0 legacy=0x7f3f4015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f36a00640 1 -- 172.21.15.144:0/3764588152 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f400cd5c0 con 0x7f3f4006b8e0 2024-05-30T16:52:09.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f3ea00640 1 -- 172.21.15.144:0/3764588152 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577051542 0 0) 0x7f3f400ccd20 con 0x7f3f400cc0b0 2024-05-30T16:52:09.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.188+0000 7f3f3fe00640 1 --2- 172.21.15.144:0/3764588152 >> v2:172.21.15.149:3300/0 conn(0x7f3f4006ece0 0x7f3f4006f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:09.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.189+0000 7f3f36a00640 1 --2- 172.21.15.144:0/3764588152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 0x7f3f4006bd60 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3f4015cab0 tx=0x7f3f2802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7897ea3198c2cac0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.189+0000 7f3f3ea00640 1 -- 172.21.15.144:0/3764588152 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28037070 con 0x7f3f4006b8e0 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.189+0000 7f3f3ea00640 1 -- 172.21.15.144:0/3764588152 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f28032440 con 0x7f3f4006b8e0 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.189+0000 7f3f3ea00640 1 -- 172.21.15.144:0/3764588152 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2802ae60 con 0x7f3f4006b8e0 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.190+0000 7f3f44c00640 1 -- 172.21.15.144:0/3764588152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 msgr2=0x7f3f4006bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.190+0000 7f3f44c00640 1 --2- 172.21.15.144:0/3764588152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 0x7f3f4006bd60 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3f4015cab0 tx=0x7f3f2802a110 comp rx=0 tx=0).stop 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.190+0000 7f3f44c00640 1 -- 172.21.15.144:0/3764588152 shutdown_connections 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.190+0000 7f3f44c00640 1 --2- 172.21.15.144:0/3764588152 >> v2:172.21.15.149:3300/0 conn(0x7f3f4006ece0 0x7f3f4006f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.190+0000 7f3f44c00640 1 --2- 172.21.15.144:0/3764588152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 0x7f3f4006bd60 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.190+0000 7f3f44c00640 1 -- 172.21.15.144:0/3764588152 >> 172.21.15.144:0/3764588152 conn(0x7f3f400b20a0 msgr2=0x7f3f400b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.190+0000 7f3f44c00640 1 -- 172.21.15.144:0/3764588152 shutdown_connections 2024-05-30T16:52:09.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.190+0000 7f3f44c00640 1 -- 172.21.15.144:0/3764588152 wait complete. 2024-05-30T16:52:09.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.192+0000 7f3f44c00640 1 Processor -- start 2024-05-30T16:52:09.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.192+0000 7f3f44c00640 1 -- start start 2024-05-30T16:52:09.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.193+0000 7f3f44c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 0x7f3f40152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.193+0000 7f3f44c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f4006ece0 0x7f3f400ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.193+0000 7f3f44c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f400cc0b0 0x7f3f401585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.193+0000 7f3f44c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400cc490 con 0x7f3f4006b8e0 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.193+0000 7f3f44c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400b4da0 con 0x7f3f400cc0b0 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.193+0000 7f3f44c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3f40157550 con 0x7f3f4006ece0 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f3f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 0x7f3f40152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f3f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 0x7f3f40152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43968/0 (socket says 172.21.15.144:43968) 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f3f400640 1 -- 172.21.15.144:0/406915703 learned_addr learned my addr 172.21.15.144:0/406915703 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f36a00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f4006ece0 0x7f3f400ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f3f400640 1 -- 172.21.15.144:0/406915703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f4006ece0 msgr2=0x7f3f400ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f3f400640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f4006ece0 0x7f3f400ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f3f400640 1 -- 172.21.15.144:0/406915703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f400cc0b0 msgr2=0x7f3f401585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f3f400640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f400cc0b0 0x7f3f401585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f3f400640 1 -- 172.21.15.144:0/406915703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f40157830 con 0x7f3f4006b8e0 2024-05-30T16:52:09.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.194+0000 7f3f3f400640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 0x7f3f40152760 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c430 tx=0x7f3f3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:09.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.195+0000 7f3f37e00640 1 -- 172.21.15.144:0/406915703 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f300074e0 con 0x7f3f4006b8e0 2024-05-30T16:52:09.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.195+0000 7f3f37e00640 1 -- 172.21.15.144:0/406915703 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f300047e0 con 0x7f3f4006b8e0 2024-05-30T16:52:09.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.195+0000 7f3f37e00640 1 -- 172.21.15.144:0/406915703 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30004bd0 con 0x7f3f4006b8e0 2024-05-30T16:52:09.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.195+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f40157b10 con 0x7f3f4006b8e0 2024-05-30T16:52:09.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.195+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f40152ca0 con 0x7f3f4006b8e0 2024-05-30T16:52:09.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.196+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f40075570 con 0x7f3f4006b8e0 2024-05-30T16:52:09.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.197+0000 7f3f37e00640 1 -- 172.21.15.144:0/406915703 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f3f30011070 con 0x7f3f4006b8e0 2024-05-30T16:52:09.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.198+0000 7f3f37e00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f1c06d9d0 0x7f3f1c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:09.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.198+0000 7f3f37e00640 1 -- 172.21.15.144:0/406915703 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f3f3008a7b0 con 0x7f3f4006b8e0 2024-05-30T16:52:09.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.199+0000 7f3f36a00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f1c06d9d0 0x7f3f1c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:09.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.199+0000 7f3f36a00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f1c06d9d0 0x7f3f1c06fe90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3f28034000 tx=0x7f3f2802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:09.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.203+0000 7f3f37e00640 1 -- 172.21.15.144:0/406915703 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3f3005a260 con 0x7f3f4006b8e0 2024-05-30T16:52:09.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.481+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3f400b33c0 con 0x7f3f4006b8e0 2024-05-30T16:52:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.482+0000 7f3f37e00640 1 -- 172.21.15.144:0/406915703 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2418 (secure 0 0 0) 0x7f3f30059b60 con 0x7f3f4006b8e0 2024-05-30T16:52:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:09.483 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 641, 2024-05-30T16:52:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12856, 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 53717205705, 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 108190023680, 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 664904089600, 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:52:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 326642421, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 332268226, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 80, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 93 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:09.490 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f1c06d9d0 msgr2=0x7f3f1c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f1c06d9d0 0x7f3f1c06fe90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3f28034000 tx=0x7f3f2802e000 comp rx=0 tx=0).stop 2024-05-30T16:52:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 msgr2=0x7f3f40152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 0x7f3f40152760 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c430 tx=0x7f3f3000c8f0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 shutdown_connections 2024-05-30T16:52:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3f1c06d9d0 0x7f3f1c06fe90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f400cc0b0 0x7f3f401585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f4006ece0 0x7f3f400ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 --2- 172.21.15.144:0/406915703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f4006b8e0 0x7f3f40152760 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 >> 172.21.15.144:0/406915703 conn(0x7f3f400b20a0 msgr2=0x7f3f400cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.484+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 shutdown_connections 2024-05-30T16:52:09.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:09.485+0000 7f3f44c00640 1 -- 172.21.15.144:0/406915703 wait complete. 2024-05-30T16:52:14.505 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.714+0000 7f48b9400640 1 Processor -- start 2024-05-30T16:52:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.715+0000 7f48b9400640 1 -- start start 2024-05-30T16:52:14.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.716+0000 7f48b9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b40cc0b0 0x7f48b415d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.716+0000 7f48b9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f48b406fcf0 0x7f48b406bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.716+0000 7f48b9400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48b415da70 con 0x7f48b406b8e0 2024-05-30T16:52:14.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.716+0000 7f48b9400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f48b40ccd20 con 0x7f48b406fcf0 2024-05-30T16:52:14.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.716+0000 7f48b9400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f48b40cd000 con 0x7f48b40cc0b0 2024-05-30T16:52:14.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.717+0000 7f48b8a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f48b406fcf0 0x7f48b406bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.717+0000 7f48ab400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f48b406b8e0 0x7f48b41600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35710/0 (socket says 172.21.15.144:35710) 2024-05-30T16:52:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.717+0000 7f48ab400640 1 -- 172.21.15.144:0/1466770316 learned_addr learned my addr 172.21.15.144:0/1466770316 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:52:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.717+0000 7f48b3e00640 1 --2- 172.21.15.144:0/1466770316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b40cc0b0 0x7f48b415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.717+0000 7f48b8a00640 1 -- 172.21.15.144:0/1466770316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b40cc0b0 msgr2=0x7f48b415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.717+0000 7f48b8a00640 1 --2- 172.21.15.144:0/1466770316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b40cc0b0 0x7f48b415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.717+0000 7f48b8a00640 1 -- 172.21.15.144:0/1466770316 >> v1:172.21.15.144:6789/0 conn(0x7f48b406b8e0 legacy=0x7f48b41600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.717+0000 7f48b3400640 1 -- 172.21.15.144:0/1466770316 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830306917 0 0) 0x7f489c001110 con 0x7f48b406b8e0 2024-05-30T16:52:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.717+0000 7f48b8a00640 1 -- 172.21.15.144:0/1466770316 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b40cd2e0 con 0x7f48b406fcf0 2024-05-30T16:52:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.718+0000 7f48b8a00640 1 --2- 172.21.15.144:0/1466770316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b406fcf0 0x7f48b406bd60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009d90 tx=0x7f48ac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b7720b4e6335db server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b3400640 1 -- 172.21.15.144:0/1466770316 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac031600 con 0x7f48b406fcf0 2024-05-30T16:52:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b3400640 1 -- 172.21.15.144:0/1466770316 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac0317a0 con 0x7f48b406fcf0 2024-05-30T16:52:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b3400640 1 -- 172.21.15.144:0/1466770316 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac031b70 con 0x7f48b406fcf0 2024-05-30T16:52:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b9400640 1 -- 172.21.15.144:0/1466770316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b406fcf0 msgr2=0x7f48b406bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b9400640 1 --2- 172.21.15.144:0/1466770316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b406fcf0 0x7f48b406bd60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009d90 tx=0x7f48ac02a5d0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b9400640 1 -- 172.21.15.144:0/1466770316 shutdown_connections 2024-05-30T16:52:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b9400640 1 --2- 172.21.15.144:0/1466770316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b406fcf0 0x7f48b406bd60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b9400640 1 --2- 172.21.15.144:0/1466770316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b40cc0b0 0x7f48b415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b9400640 1 -- 172.21.15.144:0/1466770316 >> 172.21.15.144:0/1466770316 conn(0x7f48b40b20a0 msgr2=0x7f48b40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b9400640 1 -- 172.21.15.144:0/1466770316 shutdown_connections 2024-05-30T16:52:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.719+0000 7f48b9400640 1 -- 172.21.15.144:0/1466770316 wait complete. 2024-05-30T16:52:14.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.721+0000 7f48b9400640 1 Processor -- start 2024-05-30T16:52:14.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.721+0000 7f48b9400640 1 -- start start 2024-05-30T16:52:14.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.722+0000 7f48b9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406b8e0 0x7f48b414e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.722+0000 7f48b9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b406fcf0 0x7f48b4154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.722+0000 7f48b9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b40cc0b0 0x7f48b40c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.722+0000 7f48b9400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f48b40cc490 con 0x7f48b40cc0b0 2024-05-30T16:52:14.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.722+0000 7f48b9400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f48b40cc9e0 con 0x7f48b406fcf0 2024-05-30T16:52:14.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.722+0000 7f48b9400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f48b40ae530 con 0x7f48b406b8e0 2024-05-30T16:52:14.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b40cc0b0 0x7f48b40c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b40cc0b0 0x7f48b40c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43972/0 (socket says 172.21.15.144:43972) 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b8a00640 1 -- 172.21.15.144:0/3546005498 learned_addr learned my addr 172.21.15.144:0/3546005498 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b3e00640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406b8e0 0x7f48b414e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48ab400640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b406fcf0 0x7f48b4154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b8a00640 1 -- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406b8e0 msgr2=0x7f48b414e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b8a00640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406b8e0 0x7f48b414e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b8a00640 1 -- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b406fcf0 msgr2=0x7f48b4154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b8a00640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b406fcf0 0x7f48b4154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b8a00640 1 -- 172.21.15.144:0/3546005498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b4155380 con 0x7f48b40cc0b0 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48b3e00640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406b8e0 0x7f48b414e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.723+0000 7f48ab400640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b406fcf0 0x7f48b4154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.724+0000 7f48b8a00640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b40cc0b0 0x7f48b40c9540 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009eb0 tx=0x7f48ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.724+0000 7f48b0c00640 1 -- 172.21.15.144:0/3546005498 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac040070 con 0x7f48b40cc0b0 2024-05-30T16:52:14.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.724+0000 7f48b0c00640 1 -- 172.21.15.144:0/3546005498 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac030b60 con 0x7f48b40cc0b0 2024-05-30T16:52:14.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.724+0000 7f48b0c00640 1 -- 172.21.15.144:0/3546005498 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac009450 con 0x7f48b40cc0b0 2024-05-30T16:52:14.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.724+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b40ae760 con 0x7f48b40cc0b0 2024-05-30T16:52:14.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.724+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b40aed20 con 0x7f48b40cc0b0 2024-05-30T16:52:14.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.725+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b4075570 con 0x7f48b40cc0b0 2024-05-30T16:52:14.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.726+0000 7f48b0c00640 1 -- 172.21.15.144:0/3546005498 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f48ac039040 con 0x7f48b40cc0b0 2024-05-30T16:52:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.727+0000 7f48b0c00640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f489006d9d0 0x7f489006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.727+0000 7f48b0c00640 1 -- 172.21.15.144:0/3546005498 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f48ac0abe30 con 0x7f48b40cc0b0 2024-05-30T16:52:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.727+0000 7f48b3e00640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f489006d9d0 0x7f489006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:14.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.728+0000 7f48b3e00640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f489006d9d0 0x7f489006fe90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f48a4006fd0 tx=0x7f48a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:14.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:14.732+0000 7f48b0c00640 1 -- 172.21.15.144:0/3546005498 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f48ac07bdd0 con 0x7f48b40cc0b0 2024-05-30T16:52:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.007+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f48b40b4100 con 0x7f48b40cc0b0 2024-05-30T16:52:15.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.008+0000 7f48b0c00640 1 -- 172.21.15.144:0/3546005498 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2418 (secure 0 0 0) 0x7f48ac07b6d0 con 0x7f48b40cc0b0 2024-05-30T16:52:15.009 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:15.010 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 647, 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:15.011 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:15.012 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12855, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 53717258603, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 108190121984, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 664903991296, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 326694576, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 332326310, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 80, 2024-05-30T16:52:15.013 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 94 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:15.014 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:15.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:15.017 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f489006d9d0 msgr2=0x7f489006fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f489006d9d0 0x7f489006fe90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f48a4006fd0 tx=0x7f48a4008040 comp rx=0 tx=0).stop 2024-05-30T16:52:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b40cc0b0 msgr2=0x7f48b40c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b40cc0b0 0x7f48b40c9540 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009eb0 tx=0x7f48ac004a40 comp rx=0 tx=0).stop 2024-05-30T16:52:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 shutdown_connections 2024-05-30T16:52:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f489006d9d0 0x7f489006fe90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b40cc0b0 0x7f48b40c9540 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b406fcf0 0x7f48b4154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 --2- 172.21.15.144:0/3546005498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406b8e0 0x7f48b414e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 >> 172.21.15.144:0/3546005498 conn(0x7f48b40b20a0 msgr2=0x7f48b415b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 shutdown_connections 2024-05-30T16:52:15.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:15.011+0000 7f48b9400640 1 -- 172.21.15.144:0/3546005498 wait complete. 2024-05-30T16:52:18.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:52:18.650 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:52:20.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:20.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.239+0000 7f5545000640 1 Processor -- start 2024-05-30T16:52:20.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.240+0000 7f5545000640 1 -- start start 2024-05-30T16:52:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.241+0000 7f5545000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f55400cc0b0 0x7f554015d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.241+0000 7f5545000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f554006fcf0 0x7f554006bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.241+0000 7f5545000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554015da70 con 0x7f554006b8e0 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.241+0000 7f5545000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f55400ccd20 con 0x7f554006fcf0 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.241+0000 7f5545000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f55400cd000 con 0x7f55400cc0b0 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.241+0000 7f5537e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f554006b8e0 0x7f55401600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:32944/0 (socket says 172.21.15.144:32944) 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.242+0000 7f5537e00640 1 -- 172.21.15.144:0/2556232757 learned_addr learned my addr 172.21.15.144:0/2556232757 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.242+0000 7f553fe00640 1 --2- 172.21.15.144:0/2556232757 >> v2:172.21.15.144:3300/0 conn(0x7f554006fcf0 0x7f554006bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.242+0000 7f553f400640 1 --2- 172.21.15.144:0/2556232757 >> v2:172.21.15.149:3300/0 conn(0x7f55400cc0b0 0x7f554015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.242+0000 7f553ea00640 1 -- 172.21.15.144:0/2556232757 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567731987 0 0) 0x7f5528001110 con 0x7f554006b8e0 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.242+0000 7f553ea00640 1 -- 172.21.15.144:0/2556232757 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5524003520 con 0x7f554006b8e0 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.242+0000 7f553fe00640 1 -- 172.21.15.144:0/2556232757 >> v2:172.21.15.149:3300/0 conn(0x7f55400cc0b0 msgr2=0x7f554015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.242+0000 7f553fe00640 1 --2- 172.21.15.144:0/2556232757 >> v2:172.21.15.149:3300/0 conn(0x7f55400cc0b0 0x7f554015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.242+0000 7f553fe00640 1 -- 172.21.15.144:0/2556232757 >> v1:172.21.15.144:6789/0 conn(0x7f554006b8e0 legacy=0x7f55401600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.242+0000 7f553fe00640 1 -- 172.21.15.144:0/2556232757 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55400cd2e0 con 0x7f554006fcf0 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.243+0000 7f553fe00640 1 --2- 172.21.15.144:0/2556232757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 0x7f554006bd60 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f55400cfff0 tx=0x7f553802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8d2796d2137a67 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f553ea00640 1 -- 172.21.15.144:0/2556232757 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538007740 con 0x7f554006fcf0 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f553ea00640 1 -- 172.21.15.144:0/2556232757 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55380078e0 con 0x7f554006fcf0 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f553ea00640 1 -- 172.21.15.144:0/2556232757 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538007cb0 con 0x7f554006fcf0 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f5545000640 1 -- 172.21.15.144:0/2556232757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 msgr2=0x7f554006bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f5545000640 1 --2- 172.21.15.144:0/2556232757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 0x7f554006bd60 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f55400cfff0 tx=0x7f553802a5f0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f5545000640 1 -- 172.21.15.144:0/2556232757 shutdown_connections 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f5545000640 1 --2- 172.21.15.144:0/2556232757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 0x7f554006bd60 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f5545000640 1 --2- 172.21.15.144:0/2556232757 >> v2:172.21.15.149:3300/0 conn(0x7f55400cc0b0 0x7f554015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f5545000640 1 -- 172.21.15.144:0/2556232757 >> 172.21.15.144:0/2556232757 conn(0x7f55400b20a0 msgr2=0x7f55400b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f5545000640 1 -- 172.21.15.144:0/2556232757 shutdown_connections 2024-05-30T16:52:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.244+0000 7f5545000640 1 -- 172.21.15.144:0/2556232757 wait complete. 2024-05-30T16:52:20.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.246+0000 7f5545000640 1 Processor -- start 2024-05-30T16:52:20.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.246+0000 7f5545000640 1 -- start start 2024-05-30T16:52:20.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.247+0000 7f5545000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f554006b8e0 0x7f554015e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.247+0000 7f5545000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 0x7f5540072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.247+0000 7f5545000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55400cc0b0 0x7f5540151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.247+0000 7f5545000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f55400cc490 con 0x7f554006fcf0 2024-05-30T16:52:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.247+0000 7f5545000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f55400cc9e0 con 0x7f554006b8e0 2024-05-30T16:52:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.247+0000 7f5545000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f554015dcf0 con 0x7f55400cc0b0 2024-05-30T16:52:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.247+0000 7f5537e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 0x7f5540072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.247+0000 7f5537e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 0x7f5540072ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34634/0 (socket says 172.21.15.144:34634) 2024-05-30T16:52:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.247+0000 7f5537e00640 1 -- 172.21.15.144:0/1485343826 learned_addr learned my addr 172.21.15.144:0/1485343826 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f553fe00640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55400cc0b0 0x7f5540151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5537e00640 1 -- 172.21.15.144:0/1485343826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55400cc0b0 msgr2=0x7f5540151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f553f400640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f554006b8e0 0x7f554015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5537e00640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55400cc0b0 0x7f5540151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5537e00640 1 -- 172.21.15.144:0/1485343826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f554006b8e0 msgr2=0x7f554015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5537e00640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f554006b8e0 0x7f554015e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5537e00640 1 -- 172.21.15.144:0/1485343826 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554015df90 con 0x7f554006fcf0 2024-05-30T16:52:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5537e00640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 0x7f5540072ea0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f552800c730 tx=0x7f552800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5537400640 1 -- 172.21.15.144:0/1485343826 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528017070 con 0x7f554006fcf0 2024-05-30T16:52:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5537400640 1 -- 172.21.15.144:0/1485343826 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5528005ad0 con 0x7f554006fcf0 2024-05-30T16:52:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5537400640 1 -- 172.21.15.144:0/1485343826 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528007e20 con 0x7f554006fcf0 2024-05-30T16:52:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.248+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554015e270 con 0x7f554006fcf0 2024-05-30T16:52:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.249+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55401573c0 con 0x7f554006fcf0 2024-05-30T16:52:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.250+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5540075570 con 0x7f554006fcf0 2024-05-30T16:52:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.251+0000 7f5537400640 1 -- 172.21.15.144:0/1485343826 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f552801a070 con 0x7f554006fcf0 2024-05-30T16:52:20.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.252+0000 7f5537400640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f551c06da00 0x7f551c06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:20.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.252+0000 7f5537400640 1 -- 172.21.15.144:0/1485343826 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f5528089e50 con 0x7f554006fcf0 2024-05-30T16:52:20.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.252+0000 7f553f400640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f551c06da00 0x7f551c06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:20.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.252+0000 7f553f400640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f551c06da00 0x7f551c06fec0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5530006fd0 tx=0x7f5530008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.256+0000 7f5537400640 1 -- 172.21.15.144:0/1485343826 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f554015da70 con 0x7f554006fcf0 2024-05-30T16:52:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.526+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f55400b4100 con 0x7f554006fcf0 2024-05-30T16:52:20.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.527+0000 7f5537400640 1 -- 172.21.15.144:0/1485343826 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2404 (secure 0 0 0) 0x7f5528059990 con 0x7f554006fcf0 2024-05-30T16:52:20.528 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:20.528 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:20.528 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:20.528 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:20.528 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:20.528 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:20.528 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:20.529 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 652, 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:20.530 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12855, 2024-05-30T16:52:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 53717283122, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 108190171136, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 664903942144, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "read_bytes_sec": 85, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 7250, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 2 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:20.532 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:20.533 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:20.534 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:20.535 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:20.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f551c06da00 msgr2=0x7f551c06fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:20.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f551c06da00 0x7f551c06fec0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5530006fd0 tx=0x7f5530008040 comp rx=0 tx=0).stop 2024-05-30T16:52:20.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 msgr2=0x7f5540072ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:20.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 0x7f5540072ea0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f552800c730 tx=0x7f552800cbf0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 shutdown_connections 2024-05-30T16:52:20.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f551c06da00 0x7f551c06fec0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55400cc0b0 0x7f5540151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f554006fcf0 0x7f5540072ea0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 --2- 172.21.15.144:0/1485343826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f554006b8e0 0x7f554015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:20.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.530+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 >> 172.21.15.144:0/1485343826 conn(0x7f55400b20a0 msgr2=0x7f554015cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:20.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.531+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 shutdown_connections 2024-05-30T16:52:20.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:20.531+0000 7f5545000640 1 -- 172.21.15.144:0/1485343826 wait complete. 2024-05-30T16:52:25.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.751+0000 7fc60fe00640 1 Processor -- start 2024-05-30T16:52:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.752+0000 7fc60fe00640 1 -- start start 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.753+0000 7fc60fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6100cc0b0 0x7fc61015d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.753+0000 7fc60fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc61006b8e0 0x7fc61006bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.753+0000 7fc60fe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61015da70 con 0x7fc6101600a0 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.753+0000 7fc60fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc6100ccd20 con 0x7fc61006b8e0 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.753+0000 7fc60fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6100cd000 con 0x7fc6100cc0b0 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.754+0000 7fc606000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc61006b8e0 0x7fc61006bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.754+0000 7fc606000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc61006b8e0 0x7fc61006bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53644/0 (socket says 172.21.15.144:53644) 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.754+0000 7fc606000640 1 -- 172.21.15.144:0/2725449185 learned_addr learned my addr 172.21.15.144:0/2725449185 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.754+0000 7fc60ea00640 1 --2- 172.21.15.144:0/2725449185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6100cc0b0 0x7fc61015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.754+0000 7fc606000640 1 -- 172.21.15.144:0/2725449185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6100cc0b0 msgr2=0x7fc61015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.754+0000 7fc606000640 1 --2- 172.21.15.144:0/2725449185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6100cc0b0 0x7fc61015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.755+0000 7fc606000640 1 -- 172.21.15.144:0/2725449185 >> v1:172.21.15.149:6789/0 conn(0x7fc6101600a0 legacy=0x7fc610160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.755+0000 7fc606000640 1 -- 172.21.15.144:0/2725449185 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6100cd2e0 con 0x7fc61006b8e0 2024-05-30T16:52:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.756+0000 7fc606000640 1 --2- 172.21.15.144:0/2725449185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 0x7fc61006bd60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009870 tx=0x7fc5f802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ffd53cee133d8c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.756+0000 7fc60e000640 1 -- 172.21.15.144:0/2725449185 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8037070 con 0x7fc61006b8e0 2024-05-30T16:52:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.756+0000 7fc60e000640 1 -- 172.21.15.144:0/2725449185 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f8032440 con 0x7fc61006b8e0 2024-05-30T16:52:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.756+0000 7fc60e000640 1 -- 172.21.15.144:0/2725449185 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8032810 con 0x7fc61006b8e0 2024-05-30T16:52:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.757+0000 7fc60fe00640 1 -- 172.21.15.144:0/2725449185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 msgr2=0x7fc61006bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.757+0000 7fc60fe00640 1 --2- 172.21.15.144:0/2725449185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 0x7fc61006bd60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009870 tx=0x7fc5f802a1c0 comp rx=0 tx=0).stop 2024-05-30T16:52:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.757+0000 7fc60fe00640 1 -- 172.21.15.144:0/2725449185 shutdown_connections 2024-05-30T16:52:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.757+0000 7fc60fe00640 1 --2- 172.21.15.144:0/2725449185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 0x7fc61006bd60 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.757+0000 7fc60fe00640 1 --2- 172.21.15.144:0/2725449185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6100cc0b0 0x7fc61015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:25.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.757+0000 7fc60fe00640 1 -- 172.21.15.144:0/2725449185 >> 172.21.15.144:0/2725449185 conn(0x7fc6100b20a0 msgr2=0x7fc6100b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:25.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.757+0000 7fc60fe00640 1 -- 172.21.15.144:0/2725449185 shutdown_connections 2024-05-30T16:52:25.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.757+0000 7fc60fe00640 1 -- 172.21.15.144:0/2725449185 wait complete. 2024-05-30T16:52:25.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.759+0000 7fc60fe00640 1 Processor -- start 2024-05-30T16:52:25.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.759+0000 7fc60fe00640 1 -- start start 2024-05-30T16:52:25.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 0x7fc610152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:25.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6100cc0b0 0x7fc610073510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:25.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6101600a0 0x7fc6100cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:25.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6100cc490 con 0x7fc61006b8e0 2024-05-30T16:52:25.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6100cc9e0 con 0x7fc6100cc0b0 2024-05-30T16:52:25.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6101f5450 con 0x7fc6101600a0 2024-05-30T16:52:25.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 0x7fc610152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:25.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 0x7fc610152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53658/0 (socket says 172.21.15.144:53658) 2024-05-30T16:52:25.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60ea00640 1 -- 172.21.15.144:0/577412121 learned_addr learned my addr 172.21.15.144:0/577412121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60ea00640 1 -- 172.21.15.144:0/577412121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6101600a0 msgr2=0x7fc6100cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60ea00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6101600a0 0x7fc6100cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60ea00640 1 -- 172.21.15.144:0/577412121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6100cc0b0 msgr2=0x7fc610073510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60ea00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6100cc0b0 0x7fc610073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.760+0000 7fc60ea00640 1 -- 172.21.15.144:0/577412121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6101f46e0 con 0x7fc61006b8e0 2024-05-30T16:52:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.761+0000 7fc60ea00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 0x7fc610152a80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc60000d800 tx=0x7fc60000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.761+0000 7fc607e00640 1 -- 172.21.15.144:0/577412121 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60000b6c0 con 0x7fc61006b8e0 2024-05-30T16:52:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.761+0000 7fc607e00640 1 -- 172.21.15.144:0/577412121 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc600019070 con 0x7fc61006b8e0 2024-05-30T16:52:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.761+0000 7fc607e00640 1 -- 172.21.15.144:0/577412121 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60000ba80 con 0x7fc61006b8e0 2024-05-30T16:52:25.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.761+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6101f49c0 con 0x7fc61006b8e0 2024-05-30T16:52:25.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.761+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6101f4f80 con 0x7fc61006b8e0 2024-05-30T16:52:25.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.762+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc610075570 con 0x7fc61006b8e0 2024-05-30T16:52:25.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.763+0000 7fc607e00640 1 -- 172.21.15.144:0/577412121 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7fc60000bc20 con 0x7fc61006b8e0 2024-05-30T16:52:25.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.764+0000 7fc607e00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ec06d9d0 0x7fc5ec06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:25.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.764+0000 7fc607e00640 1 -- 172.21.15.144:0/577412121 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fc60008ac00 con 0x7fc61006b8e0 2024-05-30T16:52:25.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.765+0000 7fc606000640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ec06d9d0 0x7fc5ec06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:25.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.765+0000 7fc606000640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ec06d9d0 0x7fc5ec06fe90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8034000 tx=0x7fc5f802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:25.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:25.769+0000 7fc607e00640 1 -- 172.21.15.144:0/577412121 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc60005aa80 con 0x7fc61006b8e0 2024-05-30T16:52:26.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.038+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc6100b4100 con 0x7fc61006b8e0 2024-05-30T16:52:26.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.039+0000 7fc607e00640 1 -- 172.21.15.144:0/577412121 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2374 (secure 0 0 0) 0x7fc60005a380 con 0x7fc61006b8e0 2024-05-30T16:52:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:26.039 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 658, 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12855, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 53717293976, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 108190195712, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 664903917568, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 3156, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:26.046 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ec06d9d0 msgr2=0x7fc5ec06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ec06d9d0 0x7fc5ec06fe90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8034000 tx=0x7fc5f802c000 comp rx=0 tx=0).stop 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 msgr2=0x7fc610152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 0x7fc610152a80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc60000d800 tx=0x7fc60000dcc0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 shutdown_connections 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc5ec06d9d0 0x7fc5ec06fe90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6101600a0 0x7fc6100cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6100cc0b0 0x7fc610073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 --2- 172.21.15.144:0/577412121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc61006b8e0 0x7fc610152a80 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.041+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 >> 172.21.15.144:0/577412121 conn(0x7fc6100b20a0 msgr2=0x7fc6100cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:26.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.042+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 shutdown_connections 2024-05-30T16:52:26.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:26.042+0000 7fc60fe00640 1 -- 172.21.15.144:0/577412121 wait complete. 2024-05-30T16:52:31.062 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:31.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.271+0000 7f6e76400640 1 Processor -- start 2024-05-30T16:52:31.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.271+0000 7f6e76400640 1 -- start start 2024-05-30T16:52:31.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.273+0000 7f6e76400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7015ec60 0x7f6e7006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:31.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.273+0000 7f6e76400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e7006cc70 0x7f6e7006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.273+0000 7f6e76400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e70162670 0x7f6e7009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.273+0000 7f6e76400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6e700d08d0 con 0x7f6e70162670 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.273+0000 7f6e76400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6e7015f5e0 con 0x7f6e7006cc70 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.273+0000 7f6e76400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6e7015f8c0 con 0x7f6e7015ec60 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e70162670 0x7f6e7009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e70162670 0x7f6e7009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53664/0 (socket says 172.21.15.144:53664) 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6fe00640 1 -- 172.21.15.144:0/3544589431 learned_addr learned my addr 172.21.15.144:0/3544589431 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6ea00640 1 --2- 172.21.15.144:0/3544589431 >> v2:172.21.15.149:3300/0 conn(0x7f6e7006cc70 0x7f6e7006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6f400640 1 --2- 172.21.15.144:0/3544589431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7015ec60 0x7f6e7006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6fe00640 1 -- 172.21.15.144:0/3544589431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7015ec60 msgr2=0x7f6e7006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6fe00640 1 --2- 172.21.15.144:0/3544589431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7015ec60 0x7f6e7006d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6fe00640 1 -- 172.21.15.144:0/3544589431 >> v2:172.21.15.149:3300/0 conn(0x7f6e7006cc70 msgr2=0x7f6e7006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:31.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6fe00640 1 --2- 172.21.15.144:0/3544589431 >> v2:172.21.15.149:3300/0 conn(0x7f6e7006cc70 0x7f6e7006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.274+0000 7f6e6fe00640 1 -- 172.21.15.144:0/3544589431 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7015fba0 con 0x7f6e70162670 2024-05-30T16:52:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.275+0000 7f6e6fe00640 1 --2- 172.21.15.144:0/3544589431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 0x7f6e7009aa30 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6e700738a0 tx=0x7f6e6802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea1acf956427d5a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e6e000640 1 -- 172.21.15.144:0/3544589431 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68037070 con 0x7f6e70162670 2024-05-30T16:52:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e6e000640 1 -- 172.21.15.144:0/3544589431 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e6802ae00 con 0x7f6e70162670 2024-05-30T16:52:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e6e000640 1 -- 172.21.15.144:0/3544589431 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68032660 con 0x7f6e70162670 2024-05-30T16:52:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e76400640 1 -- 172.21.15.144:0/3544589431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 msgr2=0x7f6e7009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e76400640 1 --2- 172.21.15.144:0/3544589431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 0x7f6e7009aa30 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6e700738a0 tx=0x7f6e6802a0b0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e76400640 1 -- 172.21.15.144:0/3544589431 shutdown_connections 2024-05-30T16:52:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e76400640 1 --2- 172.21.15.144:0/3544589431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 0x7f6e7009aa30 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e76400640 1 --2- 172.21.15.144:0/3544589431 >> v2:172.21.15.149:3300/0 conn(0x7f6e7006cc70 0x7f6e7006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e76400640 1 --2- 172.21.15.144:0/3544589431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7015ec60 0x7f6e7006d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.276+0000 7f6e76400640 1 -- 172.21.15.144:0/3544589431 >> 172.21.15.144:0/3544589431 conn(0x7f6e700b4180 msgr2=0x7f6e700b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.277+0000 7f6e76400640 1 -- 172.21.15.144:0/3544589431 shutdown_connections 2024-05-30T16:52:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.277+0000 7f6e76400640 1 -- 172.21.15.144:0/3544589431 wait complete. 2024-05-30T16:52:31.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.279+0000 7f6e76400640 1 Processor -- start 2024-05-30T16:52:31.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.279+0000 7f6e76400640 1 -- start start 2024-05-30T16:52:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.280+0000 7f6e76400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7006cc70 0x7f6e700b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.280+0000 7f6e76400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7015ec60 0x7f6e700b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.280+0000 7f6e76400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 0x7f6e701596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.280+0000 7f6e76400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7015f1c0 con 0x7f6e70162670 2024-05-30T16:52:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.280+0000 7f6e76400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7015f040 con 0x7f6e7015ec60 2024-05-30T16:52:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.280+0000 7f6e76400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6e7015f340 con 0x7f6e7006cc70 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 0x7f6e701596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 0x7f6e701596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53670/0 (socket says 172.21.15.144:53670) 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6fe00640 1 -- 172.21.15.144:0/1703058759 learned_addr learned my addr 172.21.15.144:0/1703058759 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6f400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7006cc70 0x7f6e700b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6ea00640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7015ec60 0x7f6e700b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6fe00640 1 -- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7006cc70 msgr2=0x7f6e700b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6fe00640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7006cc70 0x7f6e700b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6fe00640 1 -- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7015ec60 msgr2=0x7f6e700b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6fe00640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7015ec60 0x7f6e700b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6fe00640 1 -- 172.21.15.144:0/1703058759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e700afbd0 con 0x7f6e70162670 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6f400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7006cc70 0x7f6e700b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6ea00640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7015ec60 0x7f6e700b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:31.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.281+0000 7f6e6fe00640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 0x7f6e701596a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6e680090b0 tx=0x7f6e680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:31.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.282+0000 7f6e67400640 1 -- 172.21.15.144:0/1703058759 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68041070 con 0x7f6e70162670 2024-05-30T16:52:31.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.282+0000 7f6e67400640 1 -- 172.21.15.144:0/1703058759 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e6803c670 con 0x7f6e70162670 2024-05-30T16:52:31.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.282+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e700afeb0 con 0x7f6e70162670 2024-05-30T16:52:31.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.282+0000 7f6e67400640 1 -- 172.21.15.144:0/1703058759 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68037040 con 0x7f6e70162670 2024-05-30T16:52:31.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.282+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e700b0470 con 0x7f6e70162670 2024-05-30T16:52:31.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.283+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e70068b90 con 0x7f6e70162670 2024-05-30T16:52:31.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.284+0000 7f6e67400640 1 -- 172.21.15.144:0/1703058759 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 30) ==== 92570+0+0 (secure 0 0 0) 0x7f6e6803a070 con 0x7f6e70162670 2024-05-30T16:52:31.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.285+0000 7f6e67400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e5006da00 0x7f6e5006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:31.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.285+0000 7f6e67400640 1 -- 172.21.15.144:0/1703058759 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f6e680aa6e0 con 0x7f6e70162670 2024-05-30T16:52:31.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.285+0000 7f6e6f400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e5006da00 0x7f6e5006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:31.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.286+0000 7f6e6f400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e5006da00 0x7f6e5006fec0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6e60006fd0 tx=0x7f6e60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:31.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.291+0000 7f6e67400640 1 -- 172.21.15.144:0/1703058759 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e6807a560 con 0x7f6e70162670 2024-05-30T16:52:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.569+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6e700b4ea0 con 0x7f6e70162670 2024-05-30T16:52:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.570+0000 7f6e67400640 1 -- 172.21.15.144:0/1703058759 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2374 (secure 0 0 0) 0x7f6e68079e60 con 0x7f6e70162670 2024-05-30T16:52:31.571 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:31.571 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:31.571 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:31.571 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:31.571 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:31.571 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:31.571 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 663, 2024-05-30T16:52:31.572 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12855, 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 53717293976, 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 108190195712, 2024-05-30T16:52:31.574 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 664903917568, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 1023, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:31.575 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:31.576 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:31.577 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:31.578 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:31.578 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:31.578 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:31.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:31.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:31.578 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e5006da00 msgr2=0x7f6e5006fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e5006da00 0x7f6e5006fec0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6e60006fd0 tx=0x7f6e60008040 comp rx=0 tx=0).stop 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 msgr2=0x7f6e701596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 0x7f6e701596a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6e680090b0 tx=0x7f6e680046c0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 shutdown_connections 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f6e5006da00 0x7f6e5006fec0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e70162670 0x7f6e701596a0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7015ec60 0x7f6e700b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 --2- 172.21.15.144:0/1703058759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7006cc70 0x7f6e700b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 >> 172.21.15.144:0/1703058759 conn(0x7f6e700b4180 msgr2=0x7f6e7015cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 shutdown_connections 2024-05-30T16:52:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:31.572+0000 7f6e76400640 1 -- 172.21.15.144:0/1703058759 wait complete. 2024-05-30T16:52:36.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:36.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.804+0000 7f8efc800640 1 Processor -- start 2024-05-30T16:52:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.804+0000 7f8efc800640 1 -- start start 2024-05-30T16:52:36.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.806+0000 7f8efc800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8ef414c630 0x7f8ef40ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:36.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.806+0000 7f8efc800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 0x7f8ef4072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:36.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.806+0000 7f8efc800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ef406fbf0 con 0x7f8ef4072750 2024-05-30T16:52:36.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.806+0000 7f8efc800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f8ef40cf050 con 0x7f8ef414c630 2024-05-30T16:52:36.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.806+0000 7f8efc800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef40cf330 con 0x7f8ef40cea10 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.807+0000 7f8efa800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8ef4072750 0x7f8ef406dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:36154/0 (socket says 172.21.15.144:36154) 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.807+0000 7f8efa800640 1 -- 172.21.15.144:0/2078375914 learned_addr learned my addr 172.21.15.144:0/2078375914 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.807+0000 7f8ef9e00640 1 --2- 172.21.15.144:0/2078375914 >> v2:172.21.15.149:3300/0 conn(0x7f8ef414c630 0x7f8ef40ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.807+0000 7f8ef9400640 1 --2- 172.21.15.144:0/2078375914 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 0x7f8ef4072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.807+0000 7f8ef8a00640 1 -- 172.21.15.144:0/2078375914 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915485894 0 0) 0x7f8ef406fbf0 con 0x7f8ef4072750 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.807+0000 7f8ef8a00640 1 -- 172.21.15.144:0/2078375914 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8edc003520 con 0x7f8ef4072750 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.808+0000 7f8ef8a00640 1 -- 172.21.15.144:0/2078375914 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 180733258 0 0) 0x7f8edc003520 con 0x7f8ef4072750 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.808+0000 7f8ef9e00640 1 -- 172.21.15.144:0/2078375914 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 msgr2=0x7f8ef4072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.808+0000 7f8ef9e00640 1 --2- 172.21.15.144:0/2078375914 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 0x7f8ef4072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:36.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.808+0000 7f8ef9e00640 1 -- 172.21.15.144:0/2078375914 >> v1:172.21.15.144:6789/0 conn(0x7f8ef4072750 legacy=0x7f8ef406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:36.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.808+0000 7f8ef9e00640 1 -- 172.21.15.144:0/2078375914 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef40cf610 con 0x7f8ef414c630 2024-05-30T16:52:36.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.809+0000 7f8ef9e00640 1 --2- 172.21.15.144:0/2078375914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef414c630 0x7f8ef40ce4d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097a0 tx=0x7f8ee802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c1c70de6dfb3cc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:36.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.809+0000 7f8ef8a00640 1 -- 172.21.15.144:0/2078375914 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8037070 con 0x7f8ef414c630 2024-05-30T16:52:36.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.809+0000 7f8ef8a00640 1 -- 172.21.15.144:0/2078375914 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee802ac30 con 0x7f8ef414c630 2024-05-30T16:52:36.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.809+0000 7f8ef8a00640 1 -- 172.21.15.144:0/2078375914 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0001a10 con 0x7f8ef414c630 2024-05-30T16:52:36.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.810+0000 7f8efc800640 1 -- 172.21.15.144:0/2078375914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef414c630 msgr2=0x7f8ef40ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:36.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.810+0000 7f8efc800640 1 --2- 172.21.15.144:0/2078375914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef414c630 0x7f8ef40ce4d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097a0 tx=0x7f8ee802a1a0 comp rx=0 tx=0).stop 2024-05-30T16:52:36.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.810+0000 7f8efc800640 1 -- 172.21.15.144:0/2078375914 shutdown_connections 2024-05-30T16:52:36.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.810+0000 7f8efc800640 1 --2- 172.21.15.144:0/2078375914 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 0x7f8ef4072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:36.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.810+0000 7f8efc800640 1 --2- 172.21.15.144:0/2078375914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef414c630 0x7f8ef40ce4d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:36.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.810+0000 7f8efc800640 1 -- 172.21.15.144:0/2078375914 >> 172.21.15.144:0/2078375914 conn(0x7f8ef406bd00 msgr2=0x7f8ef406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:36.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.810+0000 7f8efc800640 1 -- 172.21.15.144:0/2078375914 shutdown_connections 2024-05-30T16:52:36.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.810+0000 7f8efc800640 1 -- 172.21.15.144:0/2078375914 wait complete. 2024-05-30T16:52:36.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.812+0000 7f8efc800640 1 Processor -- start 2024-05-30T16:52:36.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.812+0000 7f8efc800640 1 -- start start 2024-05-30T16:52:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8efc800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef4072750 0x7f8ef40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8efc800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 0x7f8ef40adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8efc800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef414c630 0x7f8ef40adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8efc800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef414ca10 con 0x7f8ef4072750 2024-05-30T16:52:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8efc800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef40b3c20 con 0x7f8ef414c630 2024-05-30T16:52:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8efc800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef414cb90 con 0x7f8ef40cea10 2024-05-30T16:52:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8ef9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef4072750 0x7f8ef40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8ef9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef4072750 0x7f8ef40b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45428/0 (socket says 172.21.15.144:45428) 2024-05-30T16:52:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8ef9e00640 1 -- 172.21.15.144:0/3927120803 learned_addr learned my addr 172.21.15.144:0/3927120803 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8efa800640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef414c630 0x7f8ef40adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8ef9400640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 0x7f8ef40adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8ef9e00640 1 -- 172.21.15.144:0/3927120803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 msgr2=0x7f8ef40adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8ef9e00640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 0x7f8ef40adaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.813+0000 7f8ef9e00640 1 -- 172.21.15.144:0/3927120803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef414c630 msgr2=0x7f8ef40adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.814+0000 7f8ef9e00640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef414c630 0x7f8ef40adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.814+0000 7f8ef9e00640 1 -- 172.21.15.144:0/3927120803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef40ae660 con 0x7f8ef4072750 2024-05-30T16:52:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.814+0000 7f8ef9e00640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef4072750 0x7f8ef40b21b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80098c0 tx=0x7f8ee80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:36.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.814+0000 7f8eee000640 1 -- 172.21.15.144:0/3927120803 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8037050 con 0x7f8ef4072750 2024-05-30T16:52:36.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.814+0000 7f8eee000640 1 -- 172.21.15.144:0/3927120803 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee8043070 con 0x7f8ef4072750 2024-05-30T16:52:36.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.814+0000 7f8eee000640 1 -- 172.21.15.144:0/3927120803 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8006e10 con 0x7f8ef4072750 2024-05-30T16:52:36.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.814+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef40ae940 con 0x7f8ef4072750 2024-05-30T16:52:36.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.814+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef40aef00 con 0x7f8ef4072750 2024-05-30T16:52:36.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.816+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef4068b90 con 0x7f8ef4072750 2024-05-30T16:52:36.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.817+0000 7f8eee000640 1 -- 172.21.15.144:0/3927120803 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f8ee803e670 con 0x7f8ef4072750 2024-05-30T16:52:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.817+0000 7f8eee000640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8ed806d940 0x7f8ed806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.818+0000 7f8eee000640 1 -- 172.21.15.144:0/3927120803 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f8ee80ab340 con 0x7f8ef4072750 2024-05-30T16:52:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.818+0000 7f8ef9400640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8ed806d940 0x7f8ed806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.818+0000 7f8ef9400640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8ed806d940 0x7f8ed806fe00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8ef41fbf70 tx=0x7f8ee4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:36.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:36.822+0000 7f8eee000640 1 -- 172.21.15.144:0/3927120803 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ee807aea0 con 0x7f8ef4072750 2024-05-30T16:52:37.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.100+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8ef40af320 con 0x7f8ef4072750 2024-05-30T16:52:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.101+0000 7f8eee000640 1 -- 172.21.15.144:0/3927120803 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2373 (secure 0 0 0) 0x7f8ee807a7a0 con 0x7f8ef4072750 2024-05-30T16:52:37.102 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:37.102 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:37.103 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 669, 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:37.104 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:37.105 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12855, 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 53717296582, 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 108190195712, 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 664903917568, 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 341, 2024-05-30T16:52:37.106 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:37.108 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:37.109 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:37.110 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:37.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:37.110 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:37.110 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:37.110 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:37.110 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:37.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:37.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:37.110 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8ed806d940 msgr2=0x7f8ed806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8ed806d940 0x7f8ed806fe00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8ef41fbf70 tx=0x7f8ee4008040 comp rx=0 tx=0).stop 2024-05-30T16:52:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef4072750 msgr2=0x7f8ef40b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef4072750 0x7f8ef40b21b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80098c0 tx=0x7f8ee80046c0 comp rx=0 tx=0).stop 2024-05-30T16:52:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 shutdown_connections 2024-05-30T16:52:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f8ed806d940 0x7f8ed806fe00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef414c630 0x7f8ef40adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40cea10 0x7f8ef40adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 --2- 172.21.15.144:0/3927120803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef4072750 0x7f8ef40b21b0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.103+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 >> 172.21.15.144:0/3927120803 conn(0x7f8ef406bd00 msgr2=0x7f8ef414b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.104+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 shutdown_connections 2024-05-30T16:52:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:37.104+0000 7f8efc800640 1 -- 172.21.15.144:0/3927120803 wait complete. 2024-05-30T16:52:42.125 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.333+0000 7ff908e00640 1 Processor -- start 2024-05-30T16:52:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.334+0000 7ff908e00640 1 -- start start 2024-05-30T16:52:42.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff908e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff90406b8e0 0x7ff90406bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:42.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff908e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9040ccd20 con 0x7ff9040cc0b0 2024-05-30T16:52:42.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff908e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9040cd000 con 0x7ff90406ece0 2024-05-30T16:52:42.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff908e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff9040cd2e0 con 0x7ff90406b8e0 2024-05-30T16:52:42.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff8faa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff90406b8e0 0x7ff90406bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:42.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff8faa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff90406b8e0 0x7ff90406bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45442/0 (socket says 172.21.15.144:45442) 2024-05-30T16:52:42.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff8faa00640 1 -- 172.21.15.144:0/2886618762 learned_addr learned my addr 172.21.15.144:0/2886618762 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:42.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff8faa00640 1 -- 172.21.15.144:0/2886618762 >> v1:172.21.15.149:6789/0 conn(0x7ff90406ece0 legacy=0x7ff90406f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:42.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff8faa00640 1 -- 172.21.15.144:0/2886618762 >> v1:172.21.15.144:6789/0 conn(0x7ff9040cc0b0 legacy=0x7ff90415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:42.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.335+0000 7ff8faa00640 1 -- 172.21.15.144:0/2886618762 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9040cd5c0 con 0x7ff90406b8e0 2024-05-30T16:52:42.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.337+0000 7ff8faa00640 1 --2- 172.21.15.144:0/2886618762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff90406b8e0 0x7ff90406bd60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009870 tx=0x7ff8ec02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d461b52d63fbeac server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:42.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.337+0000 7ff902a00640 1 -- 172.21.15.144:0/2886618762 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec037070 con 0x7ff90406b8e0 2024-05-30T16:52:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.337+0000 7ff902a00640 1 -- 172.21.15.144:0/2886618762 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec032440 con 0x7ff90406b8e0 2024-05-30T16:52:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.337+0000 7ff902a00640 1 -- 172.21.15.144:0/2886618762 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec032810 con 0x7ff90406b8e0 2024-05-30T16:52:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.337+0000 7ff908e00640 1 -- 172.21.15.144:0/2886618762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff90406b8e0 msgr2=0x7ff90406bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.337+0000 7ff908e00640 1 --2- 172.21.15.144:0/2886618762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff90406b8e0 0x7ff90406bd60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009870 tx=0x7ff8ec02a210 comp rx=0 tx=0).stop 2024-05-30T16:52:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.338+0000 7ff908e00640 1 -- 172.21.15.144:0/2886618762 shutdown_connections 2024-05-30T16:52:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.338+0000 7ff908e00640 1 --2- 172.21.15.144:0/2886618762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff90406b8e0 0x7ff90406bd60 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.338+0000 7ff908e00640 1 -- 172.21.15.144:0/2886618762 >> 172.21.15.144:0/2886618762 conn(0x7ff9040b20a0 msgr2=0x7ff9040b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.338+0000 7ff908e00640 1 -- 172.21.15.144:0/2886618762 shutdown_connections 2024-05-30T16:52:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.338+0000 7ff908e00640 1 -- 172.21.15.144:0/2886618762 wait complete. 2024-05-30T16:52:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.339+0000 7ff908e00640 1 Processor -- start 2024-05-30T16:52:42.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.339+0000 7ff908e00640 1 -- start start 2024-05-30T16:52:42.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.340+0000 7ff908e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff90406b8e0 0x7ff90414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:42.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.340+0000 7ff908e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90406ece0 0x7ff90415e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:42.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.340+0000 7ff908e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9040cc0b0 0x7ff90415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:42.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.340+0000 7ff908e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040cc490 con 0x7ff9040cc0b0 2024-05-30T16:52:42.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.340+0000 7ff908e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040b4da0 con 0x7ff90406b8e0 2024-05-30T16:52:42.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.340+0000 7ff908e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff9040aee30 con 0x7ff90406ece0 2024-05-30T16:52:42.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9040cc0b0 0x7ff90415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:42.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9040cc0b0 0x7ff90415eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45444/0 (socket says 172.21.15.144:45444) 2024-05-30T16:52:42.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903e00640 1 -- 172.21.15.144:0/3076133721 learned_addr learned my addr 172.21.15.144:0/3076133721 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:42.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903400640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff90406b8e0 0x7ff90414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:42.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903e00640 1 -- 172.21.15.144:0/3076133721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90406ece0 msgr2=0x7ff90415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:42.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff8faa00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90406ece0 0x7ff90415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:42.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903e00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90406ece0 0x7ff90415e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:42.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903e00640 1 -- 172.21.15.144:0/3076133721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff90406b8e0 msgr2=0x7ff90414b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:42.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903e00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff90406b8e0 0x7ff90414b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:42.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903e00640 1 -- 172.21.15.144:0/3076133721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9040aeb50 con 0x7ff9040cc0b0 2024-05-30T16:52:42.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903400640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff90406b8e0 0x7ff90414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:42.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.341+0000 7ff903e00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9040cc0b0 0x7ff90415eeb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c780 tx=0x7ff8fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:42.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.342+0000 7ff8fbe00640 1 -- 172.21.15.144:0/3076133721 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc017070 con 0x7ff9040cc0b0 2024-05-30T16:52:42.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.342+0000 7ff8fbe00640 1 -- 172.21.15.144:0/3076133721 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8fc003da0 con 0x7ff9040cc0b0 2024-05-30T16:52:42.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.342+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9040cf2a0 con 0x7ff9040cc0b0 2024-05-30T16:52:42.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.342+0000 7ff8fbe00640 1 -- 172.21.15.144:0/3076133721 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0052b0 con 0x7ff9040cc0b0 2024-05-30T16:52:42.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.342+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9040cf860 con 0x7ff9040cc0b0 2024-05-30T16:52:42.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.343+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff904075570 con 0x7ff9040cc0b0 2024-05-30T16:52:42.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.344+0000 7ff8fbe00640 1 -- 172.21.15.144:0/3076133721 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7ff8fc01a070 con 0x7ff9040cc0b0 2024-05-30T16:52:42.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.345+0000 7ff8fbe00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff8e006d940 0x7ff8e006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:42.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.345+0000 7ff8fbe00640 1 -- 172.21.15.144:0/3076133721 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7ff8fc08a080 con 0x7ff9040cc0b0 2024-05-30T16:52:42.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.345+0000 7ff903400640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff8e006d940 0x7ff8e006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:42.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.346+0000 7ff903400640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff8e006d940 0x7ff8e006fe00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40015e0 tx=0x7ff8f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:42.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.349+0000 7ff8fbe00640 1 -- 172.21.15.144:0/3076133721 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8fc059be0 con 0x7ff9040cc0b0 2024-05-30T16:52:42.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.611+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff9040b4100 con 0x7ff9040cc0b0 2024-05-30T16:52:42.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.612+0000 7ff8fbe00640 1 -- 172.21.15.144:0/3076133721 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2373 (secure 0 0 0) 0x7ff8fc0594e0 con 0x7ff9040cc0b0 2024-05-30T16:52:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:42.613 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 674, 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12855, 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 53717296831, 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 108190195712, 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 664903917568, 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 511, 2024-05-30T16:52:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:42.621 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:42.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.614+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff8e006d940 msgr2=0x7ff8e006fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:42.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.614+0000 7ff908e00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff8e006d940 0x7ff8e006fe00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40015e0 tx=0x7ff8f4009040 comp rx=0 tx=0).stop 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.614+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9040cc0b0 msgr2=0x7ff90415eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.614+0000 7ff908e00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9040cc0b0 0x7ff90415eeb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c780 tx=0x7ff8fc00cc40 comp rx=0 tx=0).stop 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.615+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 shutdown_connections 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.615+0000 7ff908e00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff8e006d940 0x7ff8e006fe00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.615+0000 7ff908e00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9040cc0b0 0x7ff90415eeb0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.615+0000 7ff908e00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90406ece0 0x7ff90415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.615+0000 7ff908e00640 1 --2- 172.21.15.144:0/3076133721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff90406b8e0 0x7ff90414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.615+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 >> 172.21.15.144:0/3076133721 conn(0x7ff9040b20a0 msgr2=0x7ff904071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.615+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 shutdown_connections 2024-05-30T16:52:42.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:42.615+0000 7ff908e00640 1 -- 172.21.15.144:0/3076133721 wait complete. 2024-05-30T16:52:47.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:47.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.843+0000 7f726cc00640 1 Processor -- start 2024-05-30T16:52:47.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.843+0000 7f726cc00640 1 -- start start 2024-05-30T16:52:47.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f726cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0710 0x7f726815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:47.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f726cc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f72680d0af0 0x7f72680d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:47.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f726cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7268160400 0x7f7268160890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:47.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f726cc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f726815ccd0 con 0x7f7268160400 2024-05-30T16:52:47.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f726cc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f726809aa30 con 0x7f72680d0af0 2024-05-30T16:52:47.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f726cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f726809ad10 con 0x7f72680d0710 2024-05-30T16:52:47.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f7266800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7268160400 0x7f7268160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:47.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f7266800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7268160400 0x7f7268160890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38688/0 (socket says 172.21.15.144:38688) 2024-05-30T16:52:47.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f7266800640 1 -- 172.21.15.144:0/916534333 learned_addr learned my addr 172.21.15.144:0/916534333 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:47.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f7265400640 1 --2- 172.21.15.144:0/916534333 >> v2:172.21.15.149:3300/0 conn(0x7f72680d0af0 0x7f72680d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:47.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.845+0000 7f7265e00640 1 --2- 172.21.15.144:0/916534333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0710 0x7f726815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:47.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.846+0000 7f7266800640 1 -- 172.21.15.144:0/916534333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0710 msgr2=0x7f726815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:47.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.846+0000 7f7266800640 1 --2- 172.21.15.144:0/916534333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0710 0x7f726815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:47.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.846+0000 7f7266800640 1 -- 172.21.15.144:0/916534333 >> v2:172.21.15.149:3300/0 conn(0x7f72680d0af0 msgr2=0x7f72680d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:47.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.846+0000 7f7266800640 1 --2- 172.21.15.144:0/916534333 >> v2:172.21.15.149:3300/0 conn(0x7f72680d0af0 0x7f72680d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:47.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.846+0000 7f7266800640 1 -- 172.21.15.144:0/916534333 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726809aff0 con 0x7f7268160400 2024-05-30T16:52:47.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.846+0000 7f7265e00640 1 --2- 172.21.15.144:0/916534333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0710 0x7f726815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:47.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.847+0000 7f7266800640 1 --2- 172.21.15.144:0/916534333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7268160400 0x7f7268160890 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f72680738a0 tx=0x7f726002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab45fdc5531a2877 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:47.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.847+0000 7f7264a00640 1 -- 172.21.15.144:0/916534333 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260036070 con 0x7f7268160400 2024-05-30T16:52:47.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.847+0000 7f7264a00640 1 -- 172.21.15.144:0/916534333 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7260031600 con 0x7f7268160400 2024-05-30T16:52:47.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.847+0000 7f7264a00640 1 -- 172.21.15.144:0/916534333 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72600319d0 con 0x7f7268160400 2024-05-30T16:52:47.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.848+0000 7f726cc00640 1 -- 172.21.15.144:0/916534333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7268160400 msgr2=0x7f7268160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:47.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.848+0000 7f726cc00640 1 --2- 172.21.15.144:0/916534333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7268160400 0x7f7268160890 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f72680738a0 tx=0x7f726002a730 comp rx=0 tx=0).stop 2024-05-30T16:52:47.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.848+0000 7f726cc00640 1 -- 172.21.15.144:0/916534333 shutdown_connections 2024-05-30T16:52:47.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.848+0000 7f726cc00640 1 --2- 172.21.15.144:0/916534333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7268160400 0x7f7268160890 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:47.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.848+0000 7f726cc00640 1 --2- 172.21.15.144:0/916534333 >> v2:172.21.15.149:3300/0 conn(0x7f72680d0af0 0x7f72680d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:47.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.848+0000 7f726cc00640 1 --2- 172.21.15.144:0/916534333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0710 0x7f726815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:47.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.848+0000 7f726cc00640 1 -- 172.21.15.144:0/916534333 >> 172.21.15.144:0/916534333 conn(0x7f72680b4180 msgr2=0x7f72680b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:47.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.848+0000 7f726cc00640 1 -- 172.21.15.144:0/916534333 shutdown_connections 2024-05-30T16:52:47.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.848+0000 7f726cc00640 1 -- 172.21.15.144:0/916534333 wait complete. 2024-05-30T16:52:47.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.850+0000 7f726cc00640 1 Processor -- start 2024-05-30T16:52:47.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.850+0000 7f726cc00640 1 -- start start 2024-05-30T16:52:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f726cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72680d0710 0x7f7268153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f726cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0af0 0x7f72680b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f726cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7268160400 0x7f72680cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f726cc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f72680d1470 con 0x7f72680d0710 2024-05-30T16:52:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f726cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f726809b5b0 con 0x7f7268160400 2024-05-30T16:52:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f726cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f726809bad0 con 0x7f72680d0af0 2024-05-30T16:52:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f7265e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72680d0710 0x7f7268153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f7265e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72680d0710 0x7f7268153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38690/0 (socket says 172.21.15.144:38690) 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f7265e00640 1 -- 172.21.15.144:0/882187073 learned_addr learned my addr 172.21.15.144:0/882187073 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f7266800640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7268160400 0x7f72680cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.851+0000 7f7265400640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0af0 0x7f72680b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f7265e00640 1 -- 172.21.15.144:0/882187073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0af0 msgr2=0x7f72680b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f7265e00640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0af0 0x7f72680b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f7265e00640 1 -- 172.21.15.144:0/882187073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7268160400 msgr2=0x7f72680cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f7265e00640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7268160400 0x7f72680cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f7265e00640 1 -- 172.21.15.144:0/882187073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7268154430 con 0x7f72680d0710 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f7266800640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7268160400 0x7f72680cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f7265e00640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72680d0710 0x7f7268153ef0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f725800c7f0 tx=0x7f725800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f725e000640 1 -- 172.21.15.144:0/882187073 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258015070 con 0x7f72680d0710 2024-05-30T16:52:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f725e000640 1 -- 172.21.15.144:0/882187073 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7258007a30 con 0x7f72680d0710 2024-05-30T16:52:47.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f725e000640 1 -- 172.21.15.144:0/882187073 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258007e00 con 0x7f72680d0710 2024-05-30T16:52:47.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72680b5a20 con 0x7f72680d0710 2024-05-30T16:52:47.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.852+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726806d0b0 con 0x7f72680d0710 2024-05-30T16:52:47.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.854+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7268068b90 con 0x7f72680d0710 2024-05-30T16:52:47.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.855+0000 7f725e000640 1 -- 172.21.15.144:0/882187073 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f7258018070 con 0x7f72680d0710 2024-05-30T16:52:47.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.855+0000 7f725e000640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f724806d940 0x7f724806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.856+0000 7f725e000640 1 -- 172.21.15.144:0/882187073 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f725808a990 con 0x7f72680d0710 2024-05-30T16:52:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.856+0000 7f7265400640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f724806d940 0x7f724806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:47.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.856+0000 7f7265400640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f724806d940 0x7f724806fe00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f72680c8390 tx=0x7f7254008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:47.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:47.860+0000 7f725e000640 1 -- 172.21.15.144:0/882187073 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f725805a4f0 con 0x7f72680d0710 2024-05-30T16:52:48.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.130+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f72680cc790 con 0x7f72680d0710 2024-05-30T16:52:48.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.131+0000 7f725e000640 1 -- 172.21.15.144:0/882187073 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2373 (secure 0 0 0) 0x7f7258059df0 con 0x7f72680d0710 2024-05-30T16:52:48.132 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:48.132 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 680, 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12855, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 53717296831, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 108190195712, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 664903917568, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "write_bytes_sec": 170, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "read_op_per_sec": 0, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "write_op_per_sec": 0 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:48.139 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:48.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f724806d940 msgr2=0x7f724806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:48.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f724806d940 0x7f724806fe00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f72680c8390 tx=0x7f7254008040 comp rx=0 tx=0).stop 2024-05-30T16:52:48.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72680d0710 msgr2=0x7f7268153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:48.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72680d0710 0x7f7268153ef0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f725800c7f0 tx=0x7f725800cbf0 comp rx=0 tx=0).stop 2024-05-30T16:52:48.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 shutdown_connections 2024-05-30T16:52:48.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f724806d940 0x7f724806fe00 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:48.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7268160400 0x7f72680cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:48.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72680d0af0 0x7f72680b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:48.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 --2- 172.21.15.144:0/882187073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72680d0710 0x7f7268153ef0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:48.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.133+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 >> 172.21.15.144:0/882187073 conn(0x7f72680b4180 msgr2=0x7f726815e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:48.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.134+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 shutdown_connections 2024-05-30T16:52:48.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:48.134+0000 7f726cc00640 1 -- 172.21.15.144:0/882187073 wait complete. 2024-05-30T16:52:48.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:52:48.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:52:53.153 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T16:52:53.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.359+0000 7f00b6200640 1 Processor -- start 2024-05-30T16:52:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.359+0000 7f00b6200640 1 -- start start 2024-05-30T16:52:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.361+0000 7f00b6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b0145150 0x7f00b00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.361+0000 7f00b6200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00b00cfa70 0x7f00b006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.361+0000 7f00b6200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b00d00f0 con 0x7f00b006f610 2024-05-30T16:52:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.361+0000 7f00b6200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f00b00cfeb0 con 0x7f00b00cfa70 2024-05-30T16:52:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.361+0000 7f00b6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f00b015f140 con 0x7f00b0145150 2024-05-30T16:52:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.361+0000 7f00a7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00b00cfa70 0x7f00b006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.361+0000 7f00afe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f00b006f610 0x7f00b0072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:36954/0 (socket says 172.21.15.144:36954) 2024-05-30T16:52:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.361+0000 7f00a7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00b00cfa70 0x7f00b006f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38706/0 (socket says 172.21.15.144:38706) 2024-05-30T16:52:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.361+0000 7f00afe00640 1 -- 172.21.15.144:0/572250228 learned_addr learned my addr 172.21.15.144:0/572250228 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:52:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.362+0000 7f00af400640 1 --2- 172.21.15.144:0/572250228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b0145150 0x7f00b00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.362+0000 7f00a7e00640 1 -- 172.21.15.144:0/572250228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b0145150 msgr2=0x7f00b00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.362+0000 7f00a7e00640 1 --2- 172.21.15.144:0/572250228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b0145150 0x7f00b00cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.362+0000 7f00aea00640 1 -- 172.21.15.144:0/572250228 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 775632869 0 0) 0x7f00b00d00f0 con 0x7f00b006f610 2024-05-30T16:52:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.362+0000 7f00a7e00640 1 -- 172.21.15.144:0/572250228 >> v1:172.21.15.144:6789/0 conn(0x7f00b006f610 legacy=0x7f00b0072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.362+0000 7f00a7e00640 1 -- 172.21.15.144:0/572250228 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b015f390 con 0x7f00b00cfa70 2024-05-30T16:52:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.363+0000 7f00a7e00640 1 --2- 172.21.15.144:0/572250228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b00cfa70 0x7f00b006f0d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f00980097a0 tx=0x7f009802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254c12c73599ec14 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.363+0000 7f00aea00640 1 -- 172.21.15.144:0/572250228 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098037070 con 0x7f00b00cfa70 2024-05-30T16:52:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.363+0000 7f00aea00640 1 -- 172.21.15.144:0/572250228 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009802ae50 con 0x7f00b00cfa70 2024-05-30T16:52:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.363+0000 7f00aea00640 1 -- 172.21.15.144:0/572250228 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098032660 con 0x7f00b00cfa70 2024-05-30T16:52:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.364+0000 7f00b6200640 1 -- 172.21.15.144:0/572250228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b00cfa70 msgr2=0x7f00b006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.364+0000 7f00b6200640 1 --2- 172.21.15.144:0/572250228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b00cfa70 0x7f00b006f0d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f00980097a0 tx=0x7f009802a100 comp rx=0 tx=0).stop 2024-05-30T16:52:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.364+0000 7f00b6200640 1 -- 172.21.15.144:0/572250228 shutdown_connections 2024-05-30T16:52:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.364+0000 7f00b6200640 1 --2- 172.21.15.144:0/572250228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b00cfa70 0x7f00b006f0d0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.364+0000 7f00b6200640 1 --2- 172.21.15.144:0/572250228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b0145150 0x7f00b00cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.364+0000 7f00b6200640 1 -- 172.21.15.144:0/572250228 >> 172.21.15.144:0/572250228 conn(0x7f00b006bd00 msgr2=0x7f00b006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.364+0000 7f00b6200640 1 -- 172.21.15.144:0/572250228 shutdown_connections 2024-05-30T16:52:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.364+0000 7f00b6200640 1 -- 172.21.15.144:0/572250228 wait complete. 2024-05-30T16:52:53.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.366+0000 7f00b6200640 1 Processor -- start 2024-05-30T16:52:53.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.366+0000 7f00b6200640 1 -- start start 2024-05-30T16:52:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.367+0000 7f00b6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b006f610 0x7f00b015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.367+0000 7f00b6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b00cfa70 0x7f00b01f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.367+0000 7f00b6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b0145150 0x7f00b00b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.367+0000 7f00b6200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00b00b64f0 con 0x7f00b0145150 2024-05-30T16:52:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.367+0000 7f00b6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f00b015f950 con 0x7f00b006f610 2024-05-30T16:52:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.367+0000 7f00b6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f00b015fe70 con 0x7f00b00cfa70 2024-05-30T16:52:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.367+0000 7f00afe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b0145150 0x7f00b00b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.367+0000 7f00afe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b0145150 0x7f00b00b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38720/0 (socket says 172.21.15.144:38720) 2024-05-30T16:52:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.367+0000 7f00afe00640 1 -- 172.21.15.144:0/2759814636 learned_addr learned my addr 172.21.15.144:0/2759814636 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00a7e00640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b00cfa70 0x7f00b01f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00af400640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b006f610 0x7f00b015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00afe00640 1 -- 172.21.15.144:0/2759814636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b00cfa70 msgr2=0x7f00b01f4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00afe00640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b00cfa70 0x7f00b01f4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00afe00640 1 -- 172.21.15.144:0/2759814636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b006f610 msgr2=0x7f00b015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00afe00640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b006f610 0x7f00b015ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00afe00640 1 -- 172.21.15.144:0/2759814636 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b015bd60 con 0x7f00b0145150 2024-05-30T16:52:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00af400640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b006f610 0x7f00b015ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:52:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00afe00640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b0145150 0x7f00b00b0fb0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c7a0 tx=0x7f00a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00a7400640 1 -- 172.21.15.144:0/2759814636 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8018070 con 0x7f00b0145150 2024-05-30T16:52:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00a7400640 1 -- 172.21.15.144:0/2759814636 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a800a640 con 0x7f00b0145150 2024-05-30T16:52:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.368+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b015c040 con 0x7f00b0145150 2024-05-30T16:52:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.369+0000 7f00a7400640 1 -- 172.21.15.144:0/2759814636 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a800aab0 con 0x7f00b0145150 2024-05-30T16:52:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.369+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b015c600 con 0x7f00b0145150 2024-05-30T16:52:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.370+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b01f7780 con 0x7f00b0145150 2024-05-30T16:52:53.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.371+0000 7f00a7400640 1 -- 172.21.15.144:0/2759814636 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f00a801b070 con 0x7f00b0145150 2024-05-30T16:52:53.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.372+0000 7f00a7400640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f008c06d970 0x7f008c06fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:53.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.372+0000 7f00a7400640 1 -- 172.21.15.144:0/2759814636 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f00a8089fc0 con 0x7f00b0145150 2024-05-30T16:52:53.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.372+0000 7f00af400640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f008c06d970 0x7f008c06fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:53.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.373+0000 7f00af400640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f008c06d970 0x7f008c06fe30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f00a0006fd0 tx=0x7f00a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:53.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.377+0000 7f00a7400640 1 -- 172.21.15.144:0/2759814636 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f00b01f7780 con 0x7f00b0145150 2024-05-30T16:52:53.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.650+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f00b0068b90 con 0x7f00b0145150 2024-05-30T16:52:53.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.651+0000 7f00a7400640 1 -- 172.21.15.144:0/2759814636 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2280 (secure 0 0 0) 0x7f00a8059b80 con 0x7f00b0145150 2024-05-30T16:52:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:53.652 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "fsid": "865cdc9a-e28b-4870-8751-0312b261bc38", 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "health": { 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "HEALTH_OK", 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "checks": {}, 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "mutes": [] 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "election_epoch": 4, 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum": [ 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: 0, 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: 1, 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: 2 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_names": [ 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "a", 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "b", 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "c" 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "quorum_age": 685, 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "monmap": { 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 1, 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "min_mon_release_name": "squid", 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "num_mons": 3 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap": { 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 74, 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "num_osds": 8, 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "num_up_osds": 8, 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_up_since": 1717087300, 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "num_in_osds": 8, 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_in_since": 1717087291, 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "num_remapped_pgs": 0 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap": { 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "pgs_by_state": [ 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "state_name": "active+clean", 2024-05-30T16:52:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "count": 97 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pgs": 97, 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "num_pools": 3, 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "num_objects": 12855, 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "data_bytes": 53717296831, 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 108190195712, 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_avail": 664903917568, 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_total": 773094113280 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "fsmap": { 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 46, 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5, 2024-05-30T16:52:53.656 INFO:teuthology.orchestra.run.smithi144.stdout: "up": 1, 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "in": 1, 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1, 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "by_rank": [ 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "filesystem_id": 5, 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "rank": 0, 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "b", 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "up:active", 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 6447 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "up:standby": 3 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: "mgrmap": { 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "num_standbys": 1, 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "servicemap": { 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 12, 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "modified": "2024-05-30T16:51:09.150351+0000", 2024-05-30T16:52:53.658 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {} 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: "progress_events": { 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: "46be8519-7604-4393-8d97-360d59b2a338": { 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "6 ongoing+pending clones; Avg progress is 12.587% (60s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.1258700042963028, 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: "db1fc475-de45-4c8e-92b3-78f1b62bc0b7": { 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "4 ongoing clones; Avg progress is 14.258% (67s)\n [===.........................] (remaining: 6m)", 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: "progress": 0.14258000254631042, 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: "add_to_ceph_s": true 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-05-30T16:52:53.659 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.653+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f008c06d970 msgr2=0x7f008c06fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.653+0000 7f00b6200640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f008c06d970 0x7f008c06fe30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f00a0006fd0 tx=0x7f00a0008040 comp rx=0 tx=0).stop 2024-05-30T16:52:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.653+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b0145150 msgr2=0x7f00b00b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.653+0000 7f00b6200640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b0145150 0x7f00b00b0fb0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c7a0 tx=0x7f00a800cc60 comp rx=0 tx=0).stop 2024-05-30T16:52:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.654+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 shutdown_connections 2024-05-30T16:52:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.654+0000 7f00b6200640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f008c06d970 0x7f008c06fe30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.654+0000 7f00b6200640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00b0145150 0x7f00b00b0fb0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.654+0000 7f00b6200640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b00cfa70 0x7f00b01f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.654+0000 7f00b6200640 1 --2- 172.21.15.144:0/2759814636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b006f610 0x7f00b015ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.654+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 >> 172.21.15.144:0/2759814636 conn(0x7f00b006bd00 msgr2=0x7f00b0142b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.654+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 shutdown_connections 2024-05-30T16:52:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:53.654+0000 7f00b6200640 1 -- 172.21.15.144:0/2759814636 wait complete. 2024-05-30T16:52:53.675 INFO:tasks.cephfs_test_runner:Test that progress indicated by progress bar for ongoing+pending clones ... ERROR 2024-05-30T16:52:53.675 INFO:tasks.cephfs_test_runner: 2024-05-30T16:52:53.675 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-30T16:52:53.675 INFO:tasks.cephfs_test_runner:ERROR: test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:52:53.675 INFO:tasks.cephfs_test_runner:Test that progress indicated by progress bar for ongoing+pending clones 2024-05-30T16:52:53.675 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-30T16:52:53.675 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs/test_volumes.py", line 7778, in tearDown 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner: self.wait_if_cloning_is_ongoing() 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs/test_volumes.py", line 7759, in wait_if_cloning_is_ongoing 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner: while proceed(): 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/contextutil.py", line 134, in __call__ 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (11) after waiting for 50 seconds 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner: 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner:Ran 4 tests in 631.940s 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner: 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner: 2024-05-30T16:52:53.676 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner:ERROR: test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner:Test that progress indicated by progress bar for ongoing+pending clones 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs/test_volumes.py", line 7778, in tearDown 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner: self.wait_if_cloning_is_ongoing() 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs/test_volumes.py", line 7759, in wait_if_cloning_is_ongoing 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner: while proceed(): 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/contextutil.py", line 134, in __call__ 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (11) after waiting for 50 seconds 2024-05-30T16:52:53.677 INFO:tasks.cephfs_test_runner: 2024-05-30T16:52:53.678 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:52:53.885 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bae215abc9aa4367ab2da5e523b94051 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_019a0d1fdedb1237f85e8a3711761fae4e094286/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T16:52:53.887 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-30T16:52:53.895 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-30T16:52:53.945 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-30T16:52:53.945 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:52:53.945 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:54.003 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:52:54.003 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:54.055 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T16:52:54.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.255+0000 7f4a5d600640 1 Processor -- start 2024-05-30T16:52:54.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.255+0000 7f4a5d600640 1 -- start start 2024-05-30T16:52:54.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.257+0000 7f4a5d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5815e090 0x7f4a5815da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:54.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.257+0000 7f4a5d600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4a581604c0 0x7f4a5806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:54.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.257+0000 7f4a5d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a58160c40 con 0x7f4a580ce390 2024-05-30T16:52:54.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.257+0000 7f4a5d600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f4a58160f20 con 0x7f4a581604c0 2024-05-30T16:52:54.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.257+0000 7f4a5d600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4a58161200 con 0x7f4a5815e090 2024-05-30T16:52:54.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.257+0000 7f4a56a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4a580ce390 0x7f4a580ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:36960/0 (socket says 172.21.15.144:36960) 2024-05-30T16:52:54.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.257+0000 7f4a56a00640 1 -- 172.21.15.144:0/2759083979 learned_addr learned my addr 172.21.15.144:0/2759083979 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:52:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119990597 0 0) 0x7f4a58160c40 con 0x7f4a580ce390 2024-05-30T16:52:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a57400640 1 --2- 172.21.15.144:0/2759083979 >> v2:172.21.15.149:3300/0 conn(0x7f4a581604c0 0x7f4a5806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a3c003520 con 0x7f4a580ce390 2024-05-30T16:52:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a4e000640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5815e090 0x7f4a5815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3436768886 0 0) 0x7f4a3c003520 con 0x7f4a580ce390 2024-05-30T16:52:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5815e090 msgr2=0x7f4a5815da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5815e090 0x7f4a5815da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 >> v2:172.21.15.149:3300/0 conn(0x7f4a581604c0 msgr2=0x7f4a5806ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 --2- 172.21.15.144:0/2759083979 >> v2:172.21.15.149:3300/0 conn(0x7f4a581604c0 0x7f4a5806ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5806e550 con 0x7f4a580ce390 2024-05-30T16:52:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7f4a48001670 con 0x7f4a580ce390 2024-05-30T16:52:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 >> v1:172.21.15.144:6789/0 conn(0x7f4a580ce390 legacy=0x7f4a580ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a3c0039b0 0x7f4a3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3c004800 0x7f4a3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5815e090 0x7f4a3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58160f20 con 0x7f4a3c004800 2024-05-30T16:52:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58161200 con 0x7f4a3c0039b0 2024-05-30T16:52:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.258+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3c00baa0 con 0x7f4a5815e090 2024-05-30T16:52:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.259+0000 7f4a4e000640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3c004800 0x7f4a3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.259+0000 7f4a57400640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5815e090 0x7f4a3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.259+0000 7f4a56a00640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a3c0039b0 0x7f4a3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.259+0000 7f4a4e000640 1 -- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5815e090 msgr2=0x7f4a3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.259+0000 7f4a4e000640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5815e090 0x7f4a3c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.259+0000 7f4a4e000640 1 -- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a3c0039b0 msgr2=0x7f4a3c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:54.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.259+0000 7f4a4e000640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a3c0039b0 0x7f4a3c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.259+0000 7f4a4e000640 1 -- 172.21.15.144:0/2759083979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c003520 con 0x7f4a3c004800 2024-05-30T16:52:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.260+0000 7f4a4e000640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3c004800 0x7f4a3c004c80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000ba00 tx=0x7f4a3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2737f884fa8cd42 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.260+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40030070 con 0x7f4a3c004800 2024-05-30T16:52:54.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.260+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4002ad80 con 0x7f4a3c004800 2024-05-30T16:52:54.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.260+0000 7f4a56000640 1 -- 172.21.15.144:0/2759083979 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000b600 con 0x7f4a3c004800 2024-05-30T16:52:54.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.261+0000 7f4a5d600640 1 -- 172.21.15.144:0/2759083979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3c004800 msgr2=0x7f4a3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:54.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.261+0000 7f4a5d600640 1 --2- 172.21.15.144:0/2759083979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3c004800 0x7f4a3c004c80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000ba00 tx=0x7f4a3c005830 comp rx=0 tx=0).stop 2024-05-30T16:52:54.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.261+0000 7f4a57400640 1 -- 172.21.15.144:0/2759083979 reap_dead start 2024-05-30T16:52:54.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.261+0000 7f4a5d600640 1 -- 172.21.15.144:0/2759083979 shutdown_connections 2024-05-30T16:52:54.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.261+0000 7f4a5d600640 1 -- 172.21.15.144:0/2759083979 >> 172.21.15.144:0/2759083979 conn(0x7f4a580629c0 msgr2=0x7f4a5806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.261+0000 7f4a5d600640 1 -- 172.21.15.144:0/2759083979 shutdown_connections 2024-05-30T16:52:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.261+0000 7f4a5d600640 1 -- 172.21.15.144:0/2759083979 wait complete. 2024-05-30T16:52:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.263+0000 7f4a5d600640 1 Processor -- start 2024-05-30T16:52:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.263+0000 7f4a5d600640 1 -- start start 2024-05-30T16:52:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a5d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a3c004800 0x7f4a58159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a5d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a581e62f0 0x7f4a5813e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a5d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58139bd0 0x7f4a5813a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a5d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4a581432b0 con 0x7f4a58139bd0 2024-05-30T16:52:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a5d600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58143130 con 0x7f4a3c004800 2024-05-30T16:52:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a5d600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5815da50 con 0x7f4a581e62f0 2024-05-30T16:52:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58139bd0 0x7f4a5813a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58139bd0 0x7f4a5813a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38730/0 (socket says 172.21.15.144:38730) 2024-05-30T16:52:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a57400640 1 -- 172.21.15.144:0/1248481405 learned_addr learned my addr 172.21.15.144:0/1248481405 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a56a00640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a3c004800 0x7f4a58159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a4e000640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a581e62f0 0x7f4a5813e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a57400640 1 -- 172.21.15.144:0/1248481405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a581e62f0 msgr2=0x7f4a5813e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a57400640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a581e62f0 0x7f4a5813e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a57400640 1 -- 172.21.15.144:0/1248481405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a3c004800 msgr2=0x7f4a58159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a57400640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a3c004800 0x7f4a58159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.264+0000 7f4a57400640 1 -- 172.21.15.144:0/1248481405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5813ffa0 con 0x7f4a58139bd0 2024-05-30T16:52:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.265+0000 7f4a57400640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58139bd0 0x7f4a5813a050 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f4a580cdda0 tx=0x7f4a50009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.265+0000 7f4a4f400640 1 -- 172.21.15.144:0/1248481405 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50019070 con 0x7f4a58139bd0 2024-05-30T16:52:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.265+0000 7f4a4f400640 1 -- 172.21.15.144:0/1248481405 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a50007ce0 con 0x7f4a58139bd0 2024-05-30T16:52:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.265+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5813ef20 con 0x7f4a58139bd0 2024-05-30T16:52:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.265+0000 7f4a4f400640 1 -- 172.21.15.144:0/1248481405 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50014640 con 0x7f4a58139bd0 2024-05-30T16:52:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.265+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5813f4e0 con 0x7f4a58139bd0 2024-05-30T16:52:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.266+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a5806c870 con 0x7f4a58139bd0 2024-05-30T16:52:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.267+0000 7f4a4f400640 1 -- 172.21.15.144:0/1248481405 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f4a5001c070 con 0x7f4a58139bd0 2024-05-30T16:52:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.268+0000 7f4a4f400640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4a3406d940 0x7f4a3406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.268+0000 7f4a4f400640 1 -- 172.21.15.144:0/1248481405 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f4a5008a590 con 0x7f4a58139bd0 2024-05-30T16:52:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.268+0000 7f4a56a00640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4a3406d940 0x7f4a3406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.269+0000 7f4a56a00640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4a3406d940 0x7f4a3406fe00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4a48007950 tx=0x7f4a48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:54.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.272+0000 7f4a4f400640 1 -- 172.21.15.144:0/1248481405 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a5005a0f0 con 0x7f4a58139bd0 2024-05-30T16:52:54.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.478+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a580b1fb0 con 0x7f4a58139bd0 2024-05-30T16:52:54.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.479+0000 7f4a4f400640 1 -- 172.21.15.144:0/1248481405 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) ==== 80+0+0 (secure 0 0 0) 0x7f4a500599f0 con 0x7f4a58139bd0 2024-05-30T16:52:54.480 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-05-30T16:52:54.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.481+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4a3406d940 msgr2=0x7f4a3406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:54.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.481+0000 7f4a5d600640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4a3406d940 0x7f4a3406fe00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4a48007950 tx=0x7f4a48009040 comp rx=0 tx=0).stop 2024-05-30T16:52:54.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.481+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58139bd0 msgr2=0x7f4a5813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:54.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.481+0000 7f4a5d600640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58139bd0 0x7f4a5813a050 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f4a580cdda0 tx=0x7f4a50009d40 comp rx=0 tx=0).stop 2024-05-30T16:52:54.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.482+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 shutdown_connections 2024-05-30T16:52:54.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.482+0000 7f4a5d600640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4a3406d940 0x7f4a3406fe00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.482+0000 7f4a5d600640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58139bd0 0x7f4a5813a050 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.482+0000 7f4a5d600640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a581e62f0 0x7f4a5813e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.482+0000 7f4a5d600640 1 --2- 172.21.15.144:0/1248481405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a3c004800 0x7f4a58159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:54.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.482+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 >> 172.21.15.144:0/1248481405 conn(0x7f4a580629c0 msgr2=0x7f4a58074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:54.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.482+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 shutdown_connections 2024-05-30T16:52:54.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:54.482+0000 7f4a5d600640 1 -- 172.21.15.144:0/1248481405 wait complete. 2024-05-30T16:52:54.501 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T16:52:54.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:54.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T16:52:54.620 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:52:54.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:54.621 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T16:52:54.669 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-05-30T16:52:54.669 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:54.747 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T16:52:54.748 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:52:54.748 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:54.790 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:52:54.790 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-30T16:52:54.790 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T16:52:54.882 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991423,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599952k,nr_inodes=399988,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T16:52:54.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:54.882 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:52:54.937 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T16:52:54.938 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T16:52:54.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:54.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T16:52:55.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T16:52:55.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-05-30T16:52:55.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.223 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-05-30T16:52:55.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-05-30T16:52:55.393 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-05-30T16:52:55.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:52:55.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.396 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-30T16:52:55.455 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-30T16:52:55.455 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-30T16:52:55.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.456 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T16:52:55.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.552 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T16:52:55.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-05-30T16:52:55.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.745 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-30T16:52:55.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T16:52:55.786 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-05-30T16:52:55.909 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-05-30T16:52:55.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:52:55.913 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-30T16:52:55.922 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T16:52:55.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:52:56.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.134+0000 7f135b200640 1 Processor -- start 2024-05-30T16:52:56.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.135+0000 7f135b200640 1 -- start start 2024-05-30T16:52:56.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.136+0000 7f135b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c15e960 0x7f135c162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.136+0000 7f135b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f135c0cfbe0 0x7f135c0d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.136+0000 7f135b200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f135c15ed40 con 0x7f135c0ba090 2024-05-30T16:52:56.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.136+0000 7f135b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f135c0d2b40 con 0x7f135c0cfbe0 2024-05-30T16:52:56.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.136+0000 7f135b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f135c1629d0 con 0x7f135c15e960 2024-05-30T16:52:56.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.136+0000 7f135a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f135c0cfbe0 0x7f135c0d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.137+0000 7f135a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f135c0cfbe0 0x7f135c0d32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47848/0 (socket says 172.21.15.144:47848) 2024-05-30T16:52:56.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.137+0000 7f135a800640 1 -- 172.21.15.144:0/594408631 learned_addr learned my addr 172.21.15.144:0/594408631 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:56.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.137+0000 7f1359e00640 1 --2- 172.21.15.144:0/594408631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c15e960 0x7f135c162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.137+0000 7f135a800640 1 -- 172.21.15.144:0/594408631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c15e960 msgr2=0x7f135c162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:56.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.137+0000 7f135a800640 1 --2- 172.21.15.144:0/594408631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c15e960 0x7f135c162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.137+0000 7f135a800640 1 -- 172.21.15.144:0/594408631 >> v1:172.21.15.149:6789/0 conn(0x7f135c0ba090 legacy=0x7f135c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:56.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.137+0000 7f135a800640 1 -- 172.21.15.144:0/594408631 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c162ca0 con 0x7f135c0cfbe0 2024-05-30T16:52:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.138+0000 7f135a800640 1 --2- 172.21.15.144:0/594408631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c0cfbe0 0x7f135c0d32b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1354009e50 tx=0x7f135402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d082c34c2fbfbe56 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.138+0000 7f1359400640 1 -- 172.21.15.144:0/594408631 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354036070 con 0x7f135c0cfbe0 2024-05-30T16:52:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.138+0000 7f1359400640 1 -- 172.21.15.144:0/594408631 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1354031600 con 0x7f135c0cfbe0 2024-05-30T16:52:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.138+0000 7f1359400640 1 -- 172.21.15.144:0/594408631 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13540319d0 con 0x7f135c0cfbe0 2024-05-30T16:52:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.139+0000 7f135b200640 1 -- 172.21.15.144:0/594408631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c0cfbe0 msgr2=0x7f135c0d32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.139+0000 7f135b200640 1 --2- 172.21.15.144:0/594408631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c0cfbe0 0x7f135c0d32b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1354009e50 tx=0x7f135402a6c0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.139+0000 7f135b200640 1 -- 172.21.15.144:0/594408631 shutdown_connections 2024-05-30T16:52:56.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.139+0000 7f135b200640 1 --2- 172.21.15.144:0/594408631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c0cfbe0 0x7f135c0d32b0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.139+0000 7f135b200640 1 --2- 172.21.15.144:0/594408631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c15e960 0x7f135c162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.139+0000 7f135b200640 1 -- 172.21.15.144:0/594408631 >> 172.21.15.144:0/594408631 conn(0x7f135c0d1360 msgr2=0x7f135c0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:56.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.139+0000 7f135b200640 1 -- 172.21.15.144:0/594408631 shutdown_connections 2024-05-30T16:52:56.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.139+0000 7f135b200640 1 -- 172.21.15.144:0/594408631 wait complete. 2024-05-30T16:52:56.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.141+0000 7f135b200640 1 Processor -- start 2024-05-30T16:52:56.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.141+0000 7f135b200640 1 -- start start 2024-05-30T16:52:56.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f135b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c0ba090 0x7f135c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f135b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f135c0cfbe0 0x7f135c1615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f135b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c15e960 0x7f135c06c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f135b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f135c0d2d90 con 0x7f135c15e960 2024-05-30T16:52:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f135b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f135c163260 con 0x7f135c0cfbe0 2024-05-30T16:52:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f135b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f135c0b78a0 con 0x7f135c0ba090 2024-05-30T16:52:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f135a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c15e960 0x7f135c06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f135a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c15e960 0x7f135c06c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47862/0 (socket says 172.21.15.144:47862) 2024-05-30T16:52:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f135a800640 1 -- 172.21.15.144:0/3358211542 learned_addr learned my addr 172.21.15.144:0/3358211542 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.142+0000 7f1359e00640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c0ba090 0x7f135c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f1351400640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f135c0cfbe0 0x7f135c1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f135a800640 1 -- 172.21.15.144:0/3358211542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c0ba090 msgr2=0x7f135c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f135a800640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c0ba090 0x7f135c0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f135a800640 1 -- 172.21.15.144:0/3358211542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f135c0cfbe0 msgr2=0x7f135c1615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f135a800640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f135c0cfbe0 0x7f135c1615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f135a800640 1 -- 172.21.15.144:0/3358211542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c0cdda0 con 0x7f135c15e960 2024-05-30T16:52:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f135a800640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c15e960 0x7f135c06c880 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f1354009e50 tx=0x7f1354004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:56.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f1352a00640 1 -- 172.21.15.144:0/3358211542 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354036050 con 0x7f135c15e960 2024-05-30T16:52:56.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f1352a00640 1 -- 172.21.15.144:0/3358211542 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1354042070 con 0x7f135c15e960 2024-05-30T16:52:56.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f1352a00640 1 -- 172.21.15.144:0/3358211542 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354009510 con 0x7f135c15e960 2024-05-30T16:52:56.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135c0ce080 con 0x7f135c15e960 2024-05-30T16:52:56.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.143+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c0caf10 con 0x7f135c15e960 2024-05-30T16:52:56.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.145+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135c0d4400 con 0x7f135c15e960 2024-05-30T16:52:56.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.146+0000 7f1352a00640 1 -- 172.21.15.144:0/3358211542 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f1354007bd0 con 0x7f135c15e960 2024-05-30T16:52:56.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.146+0000 7f1352a00640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f133806d940 0x7f133806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.147+0000 7f1352a00640 1 -- 172.21.15.144:0/3358211542 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f13540ab800 con 0x7f135c15e960 2024-05-30T16:52:56.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.147+0000 7f1359e00640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f133806d940 0x7f133806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.147+0000 7f1359e00640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f133806d940 0x7f133806fe00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f134c006fd0 tx=0x7f134c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.151+0000 7f1352a00640 1 -- 172.21.15.144:0/3358211542 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f135c0d4400 con 0x7f135c15e960 2024-05-30T16:52:56.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.355+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f135c075570 con 0x7f133806d940 2024-05-30T16:52:56.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.365+0000 7f1352a00640 1 -- 172.21.15.144:0/3358211542 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254812 (secure 0 0 0) 0x7f135c075570 con 0x7f133806d940 2024-05-30T16:52:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:52:56.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.371+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f133806d940 msgr2=0x7f133806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.371+0000 7f135b200640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f133806d940 0x7f133806fe00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f134c006fd0 tx=0x7f134c008040 comp rx=0 tx=0).stop 2024-05-30T16:52:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.371+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c15e960 msgr2=0x7f135c06c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.371+0000 7f135b200640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c15e960 0x7f135c06c880 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f1354009e50 tx=0x7f1354004a40 comp rx=0 tx=0).stop 2024-05-30T16:52:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.372+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 shutdown_connections 2024-05-30T16:52:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.372+0000 7f135b200640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f133806d940 0x7f133806fe00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.372+0000 7f135b200640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f135c15e960 0x7f135c06c880 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.372+0000 7f135b200640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f135c0cfbe0 0x7f135c1615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.372+0000 7f135b200640 1 --2- 172.21.15.144:0/3358211542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f135c0ba090 0x7f135c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.372+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 >> 172.21.15.144:0/3358211542 conn(0x7f135c0d1360 msgr2=0x7f135c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.372+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 shutdown_connections 2024-05-30T16:52:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.372+0000 7f135b200640 1 -- 172.21.15.144:0/3358211542 wait complete. 2024-05-30T16:52:56.392 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2024-05-30T16:52:55.224182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53717296831,"num_objects":12855,"num_object_clones":1,"num_object_copies":25710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12855,"num_whiteouts":1,"num_read":12446,"num_read_kb":49496410,"num_write":14634,"num_write_kb":52460853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14976,"ondisk_log_size":14976,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":105654488,"kb_used_data":104923864,"kb_used_omap":12,"kb_used_meta":730547,"kb_avail":649320232,"statfs":{"total":773094113280,"available":664903917568,"internally_reserved":0,"allocated":107442036736,"data_stored":107437676950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":748080691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005284"},"pg_stats":[{"pgid":"11.3f","version":"74'196","reported_seq":432,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.797320+0000","last_change":"2024-05-30T16:50:01.226270+0000","last_active":"2024-05-30T16:52:33.797320+0000","last_peered":"2024-05-30T16:52:33.797320+0000","last_clean":"2024-05-30T16:52:33.797320+0000","last_became_active":"2024-05-30T16:50:01.225529+0000","last_became_peered":"2024-05-30T16:50:01.225529+0000","last_unstale":"2024-05-30T16:52:33.797320+0000","last_undegraded":"2024-05-30T16:52:33.797320+0000","last_fullsized":"2024-05-30T16:52:33.797320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":219,"num_read_kb":897024,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"74'198","reported_seq":422,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.795008+0000","last_change":"2024-05-30T16:50:01.205668+0000","last_active":"2024-05-30T16:52:33.795008+0000","last_peered":"2024-05-30T16:52:33.795008+0000","last_clean":"2024-05-30T16:52:33.795008+0000","last_became_active":"2024-05-30T16:50:01.205240+0000","last_became_peered":"2024-05-30T16:50:01.205240+0000","last_unstale":"2024-05-30T16:52:33.795008+0000","last_undegraded":"2024-05-30T16:52:33.795008+0000","last_fullsized":"2024-05-30T16:52:33.795008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":207,"num_read_kb":847872,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"74'214","reported_seq":433,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.787179+0000","last_change":"2024-05-30T16:50:01.216644+0000","last_active":"2024-05-30T16:52:33.787179+0000","last_peered":"2024-05-30T16:52:33.787179+0000","last_clean":"2024-05-30T16:52:33.787179+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:52:33.787179+0000","last_undegraded":"2024-05-30T16:52:33.787179+0000","last_fullsized":"2024-05-30T16:52:33.787179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:38.132245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":202,"num_read_kb":806917,"num_write":210,"num_write_kb":827396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"74'207","reported_seq":349,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.790896+0000","last_change":"2024-05-30T16:50:01.208510+0000","last_active":"2024-05-30T16:52:33.790896+0000","last_peered":"2024-05-30T16:52:33.790896+0000","last_clean":"2024-05-30T16:52:33.790896+0000","last_became_active":"2024-05-30T16:50:01.207604+0000","last_became_peered":"2024-05-30T16:50:01.207604+0000","last_unstale":"2024-05-30T16:52:33.790896+0000","last_undegraded":"2024-05-30T16:52:33.790896+0000","last_fullsized":"2024-05-30T16:52:33.790896+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:10.540613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830472192,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":125,"num_read_kb":512000,"num_write":198,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"74'207","reported_seq":345,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803064+0000","last_change":"2024-05-30T16:50:01.220341+0000","last_active":"2024-05-30T16:52:33.803064+0000","last_peered":"2024-05-30T16:52:33.803064+0000","last_clean":"2024-05-30T16:52:33.803064+0000","last_became_active":"2024-05-30T16:50:01.219925+0000","last_became_peered":"2024-05-30T16:50:01.219925+0000","last_unstale":"2024-05-30T16:52:33.803064+0000","last_undegraded":"2024-05-30T16:52:33.803064+0000","last_fullsized":"2024-05-30T16:52:33.803064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:48.744105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":121,"num_read_kb":495616,"num_write":197,"num_write_kb":798721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"74'212","reported_seq":483,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.795801+0000","last_change":"2024-05-30T16:50:01.205902+0000","last_active":"2024-05-30T16:52:33.795801+0000","last_peered":"2024-05-30T16:52:33.795801+0000","last_clean":"2024-05-30T16:52:33.795801+0000","last_became_active":"2024-05-30T16:50:01.205620+0000","last_became_peered":"2024-05-30T16:50:01.205620+0000","last_unstale":"2024-05-30T16:52:33.795801+0000","last_undegraded":"2024-05-30T16:52:33.795801+0000","last_fullsized":"2024-05-30T16:52:33.795801+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":254,"num_read_kb":1028099,"num_write":206,"num_write_kb":827394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"74'203","reported_seq":364,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803946+0000","last_change":"2024-05-30T16:50:01.221623+0000","last_active":"2024-05-30T16:52:33.803946+0000","last_peered":"2024-05-30T16:52:33.803946+0000","last_clean":"2024-05-30T16:52:33.803946+0000","last_became_active":"2024-05-30T16:50:01.215828+0000","last_became_peered":"2024-05-30T16:50:01.215828+0000","last_unstale":"2024-05-30T16:52:33.803946+0000","last_undegraded":"2024-05-30T16:52:33.803946+0000","last_fullsized":"2024-05-30T16:52:33.803946+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":144,"num_read_kb":581634,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"74'194","reported_seq":372,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789543+0000","last_change":"2024-05-30T16:50:01.211114+0000","last_active":"2024-05-30T16:52:33.789543+0000","last_peered":"2024-05-30T16:52:33.789543+0000","last_clean":"2024-05-30T16:52:33.789543+0000","last_became_active":"2024-05-30T16:50:01.210863+0000","last_became_peered":"2024-05-30T16:50:01.210863+0000","last_unstale":"2024-05-30T16:52:33.789543+0000","last_undegraded":"2024-05-30T16:52:33.789543+0000","last_fullsized":"2024-05-30T16:52:33.789543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:22.258204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":161,"num_read_kb":655361,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"74'217","reported_seq":401,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.800616+0000","last_change":"2024-05-30T16:50:01.214939+0000","last_active":"2024-05-30T16:52:33.800616+0000","last_peered":"2024-05-30T16:52:33.800616+0000","last_clean":"2024-05-30T16:52:33.800616+0000","last_became_active":"2024-05-30T16:50:01.214609+0000","last_became_peered":"2024-05-30T16:50:01.214609+0000","last_unstale":"2024-05-30T16:52:33.800616+0000","last_undegraded":"2024-05-30T16:52:33.800616+0000","last_fullsized":"2024-05-30T16:52:33.800616+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:09.411468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":167,"num_read_kb":655367,"num_write":209,"num_write_kb":831491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"74'212","reported_seq":414,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789176+0000","last_change":"2024-05-30T16:50:01.217788+0000","last_active":"2024-05-30T16:52:33.789176+0000","last_peered":"2024-05-30T16:52:33.789176+0000","last_clean":"2024-05-30T16:52:33.789176+0000","last_became_active":"2024-05-30T16:50:01.217506+0000","last_became_peered":"2024-05-30T16:50:01.217506+0000","last_unstale":"2024-05-30T16:52:33.789176+0000","last_undegraded":"2024-05-30T16:52:33.789176+0000","last_fullsized":"2024-05-30T16:52:33.789176+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":185,"num_read_kb":745475,"num_write":205,"num_write_kb":831489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"74'226","reported_seq":546,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.807229+0000","last_change":"2024-05-30T16:50:01.218948+0000","last_active":"2024-05-30T16:52:33.807229+0000","last_peered":"2024-05-30T16:52:33.807229+0000","last_clean":"2024-05-30T16:52:33.807229+0000","last_became_active":"2024-05-30T16:50:01.218645+0000","last_became_peered":"2024-05-30T16:50:01.218645+0000","last_unstale":"2024-05-30T16:52:33.807229+0000","last_undegraded":"2024-05-30T16:52:33.807229+0000","last_fullsized":"2024-05-30T16:52:33.807229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:16.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":901775360,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":303,"num_read_kb":1212423,"num_write":221,"num_write_kb":880643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"74'191","reported_seq":491,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789641+0000","last_change":"2024-05-30T16:50:01.217317+0000","last_active":"2024-05-30T16:52:33.789641+0000","last_peered":"2024-05-30T16:52:33.789641+0000","last_clean":"2024-05-30T16:52:33.789641+0000","last_became_active":"2024-05-30T16:50:01.217020+0000","last_became_peered":"2024-05-30T16:50:01.217020+0000","last_unstale":"2024-05-30T16:52:33.789641+0000","last_undegraded":"2024-05-30T16:52:33.789641+0000","last_fullsized":"2024-05-30T16:52:33.789641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:31.180902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":763363328,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":283,"num_read_kb":1146883,"num_write":184,"num_write_kb":745473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"74'224","reported_seq":485,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.794499+0000","last_change":"2024-05-30T16:50:01.213490+0000","last_active":"2024-05-30T16:52:33.794499+0000","last_peered":"2024-05-30T16:52:33.794499+0000","last_clean":"2024-05-30T16:52:33.794499+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:52:33.794499+0000","last_undegraded":"2024-05-30T16:52:33.794499+0000","last_fullsized":"2024-05-30T16:52:33.794499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876609929,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":244,"num_read_kb":983044,"num_write":215,"num_write_kb":856068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"74'218","reported_seq":420,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.792384+0000","last_change":"2024-05-30T16:50:01.229142+0000","last_active":"2024-05-30T16:52:33.792384+0000","last_peered":"2024-05-30T16:52:33.792384+0000","last_clean":"2024-05-30T16:52:33.792384+0000","last_became_active":"2024-05-30T16:50:01.228163+0000","last_became_peered":"2024-05-30T16:50:01.228163+0000","last_unstale":"2024-05-30T16:52:33.792384+0000","last_undegraded":"2024-05-30T16:52:33.792384+0000","last_fullsized":"2024-05-30T16:52:33.792384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:57:34.230448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998144,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":185,"num_read_kb":757760,"num_write":213,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"74'215","reported_seq":327,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.791681+0000","last_change":"2024-05-30T16:50:01.213697+0000","last_active":"2024-05-30T16:52:33.791681+0000","last_peered":"2024-05-30T16:52:33.791681+0000","last_clean":"2024-05-30T16:52:33.791681+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:52:33.791681+0000","last_undegraded":"2024-05-30T16:52:33.791681+0000","last_fullsized":"2024-05-30T16:52:33.791681+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859832320,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":0,"num_read":95,"num_read_kb":368645,"num_write":209,"num_write_kb":839682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"74'225","reported_seq":405,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.798535+0000","last_change":"2024-05-30T16:50:01.215568+0000","last_active":"2024-05-30T16:52:33.798535+0000","last_peered":"2024-05-30T16:52:33.798535+0000","last_clean":"2024-05-30T16:52:33.798535+0000","last_became_active":"2024-05-30T16:50:01.208926+0000","last_became_peered":"2024-05-30T16:50:01.208926+0000","last_unstale":"2024-05-30T16:52:33.798535+0000","last_undegraded":"2024-05-30T16:52:33.798535+0000","last_fullsized":"2024-05-30T16:52:33.798535+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":163,"num_read_kb":651268,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"74'207","reported_seq":349,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.784484+0000","last_change":"2024-05-30T16:50:01.215004+0000","last_active":"2024-05-30T16:52:33.784484+0000","last_peered":"2024-05-30T16:52:33.784484+0000","last_clean":"2024-05-30T16:52:33.784484+0000","last_became_active":"2024-05-30T16:50:01.211267+0000","last_became_peered":"2024-05-30T16:50:01.211267+0000","last_unstale":"2024-05-30T16:52:33.784484+0000","last_undegraded":"2024-05-30T16:52:33.784484+0000","last_fullsized":"2024-05-30T16:52:33.784484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:11.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055366,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":125,"num_read_kb":503810,"num_write":203,"num_write_kb":823298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"74'211","reported_seq":511,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.785809+0000","last_change":"2024-05-30T16:50:36.531061+0000","last_active":"2024-05-30T16:52:33.785809+0000","last_peered":"2024-05-30T16:52:33.785809+0000","last_clean":"2024-05-30T16:52:33.785809+0000","last_became_active":"2024-05-30T16:50:36.235518+0000","last_became_peered":"2024-05-30T16:50:36.235518+0000","last_unstale":"2024-05-30T16:52:33.785809+0000","last_undegraded":"2024-05-30T16:52:33.785809+0000","last_fullsized":"2024-05-30T16:52:33.785809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:21.431308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860932,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":260,"num_read_kb":1056770,"num_write":205,"num_write_kb":819203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"74'216","reported_seq":437,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789328+0000","last_change":"2024-05-30T16:50:01.213913+0000","last_active":"2024-05-30T16:52:33.789328+0000","last_peered":"2024-05-30T16:52:33.789328+0000","last_clean":"2024-05-30T16:52:33.789328+0000","last_became_active":"2024-05-30T16:50:01.213651+0000","last_became_peered":"2024-05-30T16:50:01.213651+0000","last_unstale":"2024-05-30T16:52:33.789328+0000","last_undegraded":"2024-05-30T16:52:33.789328+0000","last_fullsized":"2024-05-30T16:52:33.789328+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880803840,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":204,"num_read_kb":827394,"num_write":214,"num_write_kb":860162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"74'206","reported_seq":397,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789452+0000","last_change":"2024-05-30T16:50:01.223666+0000","last_active":"2024-05-30T16:52:33.789452+0000","last_peered":"2024-05-30T16:52:33.789452+0000","last_clean":"2024-05-30T16:52:33.789452+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:52:33.789452+0000","last_undegraded":"2024-05-30T16:52:33.789452+0000","last_fullsized":"2024-05-30T16:52:33.789452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918152,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"74'231","reported_seq":516,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.775933+0000","last_change":"2024-05-30T16:50:01.209725+0000","last_active":"2024-05-30T16:52:33.775933+0000","last_peered":"2024-05-30T16:52:33.775933+0000","last_clean":"2024-05-30T16:52:33.775933+0000","last_became_active":"2024-05-30T16:50:01.209453+0000","last_became_peered":"2024-05-30T16:50:01.209453+0000","last_unstale":"2024-05-30T16:52:33.775933+0000","last_undegraded":"2024-05-30T16:52:33.775933+0000","last_fullsized":"2024-05-30T16:52:33.775933+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":918552576,"num_objects":219,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":268,"num_read_kb":1081348,"num_write":225,"num_write_kb":897027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"74'223","reported_seq":422,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.785525+0000","last_change":"2024-05-30T16:50:01.217106+0000","last_active":"2024-05-30T16:52:33.785525+0000","last_peered":"2024-05-30T16:52:33.785525+0000","last_clean":"2024-05-30T16:52:33.785525+0000","last_became_active":"2024-05-30T16:50:01.216565+0000","last_became_peered":"2024-05-30T16:50:01.216565+0000","last_unstale":"2024-05-30T16:52:33.785525+0000","last_undegraded":"2024-05-30T16:52:33.785525+0000","last_fullsized":"2024-05-30T16:52:33.785525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415232,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":208,"num_whiteouts":0,"num_read":182,"num_read_kb":724997,"num_write":214,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"74'210","reported_seq":401,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.807430+0000","last_change":"2024-05-30T16:50:01.230645+0000","last_active":"2024-05-30T16:52:33.807430+0000","last_peered":"2024-05-30T16:52:33.807430+0000","last_clean":"2024-05-30T16:52:33.807430+0000","last_became_active":"2024-05-30T16:50:01.230326+0000","last_became_peered":"2024-05-30T16:50:01.230326+0000","last_unstale":"2024-05-30T16:52:33.807430+0000","last_undegraded":"2024-05-30T16:52:33.807430+0000","last_fullsized":"2024-05-30T16:52:33.807430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:34.972283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":805306368,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":786434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"74'202","reported_seq":379,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.797687+0000","last_change":"2024-05-30T16:50:01.222411+0000","last_active":"2024-05-30T16:52:33.797687+0000","last_peered":"2024-05-30T16:52:33.797687+0000","last_clean":"2024-05-30T16:52:33.797687+0000","last_became_active":"2024-05-30T16:50:01.221747+0000","last_became_peered":"2024-05-30T16:50:01.221747+0000","last_unstale":"2024-05-30T16:52:33.797687+0000","last_undegraded":"2024-05-30T16:52:33.797687+0000","last_fullsized":"2024-05-30T16:52:33.797687+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:31:09.263732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":160,"num_read_kb":647170,"num_write":198,"num_write_kb":794626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"74'211","reported_seq":421,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.808301+0000","last_change":"2024-05-30T16:50:01.225335+0000","last_active":"2024-05-30T16:52:33.808301+0000","last_peered":"2024-05-30T16:52:33.808301+0000","last_clean":"2024-05-30T16:52:33.808301+0000","last_became_active":"2024-05-30T16:50:01.224947+0000","last_became_peered":"2024-05-30T16:50:01.224947+0000","last_unstale":"2024-05-30T16:52:33.808301+0000","last_undegraded":"2024-05-30T16:52:33.808301+0000","last_fullsized":"2024-05-30T16:52:33.808301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":193,"num_read_kb":778243,"num_write":201,"num_write_kb":798723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"74'202","reported_seq":418,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.805075+0000","last_change":"2024-05-30T16:50:01.223725+0000","last_active":"2024-05-30T16:52:33.805075+0000","last_peered":"2024-05-30T16:52:33.805075+0000","last_clean":"2024-05-30T16:52:33.805075+0000","last_became_active":"2024-05-30T16:50:01.223128+0000","last_became_peered":"2024-05-30T16:50:01.223128+0000","last_unstale":"2024-05-30T16:52:33.805075+0000","last_undegraded":"2024-05-30T16:52:33.805075+0000","last_fullsized":"2024-05-30T16:52:33.805075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:16:28.027255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":199,"num_read_kb":815104,"num_write":189,"num_write_kb":774144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"74'209","reported_seq":427,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.802979+0000","last_change":"2024-05-30T16:50:01.221359+0000","last_active":"2024-05-30T16:52:33.802979+0000","last_peered":"2024-05-30T16:52:33.802979+0000","last_clean":"2024-05-30T16:52:33.802979+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:52:33.802979+0000","last_undegraded":"2024-05-30T16:52:33.802979+0000","last_fullsized":"2024-05-30T16:52:33.802979+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":201,"num_read_kb":819201,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"74'185","reported_seq":297,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.788833+0000","last_change":"2024-05-30T16:50:01.217815+0000","last_active":"2024-05-30T16:52:33.788833+0000","last_peered":"2024-05-30T16:52:33.788833+0000","last_clean":"2024-05-30T16:52:33.788833+0000","last_became_active":"2024-05-30T16:50:01.217568+0000","last_became_peered":"2024-05-30T16:50:01.217568+0000","last_unstale":"2024-05-30T16:52:33.788833+0000","last_undegraded":"2024-05-30T16:52:33.788833+0000","last_fullsized":"2024-05-30T16:52:33.788833+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":759169024,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":95,"num_read_kb":389120,"num_write":183,"num_write_kb":741377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"74'237","reported_seq":467,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.801038+0000","last_change":"2024-05-30T16:50:01.225500+0000","last_active":"2024-05-30T16:52:33.801038+0000","last_peered":"2024-05-30T16:52:33.801038+0000","last_clean":"2024-05-30T16:52:33.801038+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:52:33.801038+0000","last_undegraded":"2024-05-30T16:52:33.801038+0000","last_fullsized":"2024-05-30T16:52:33.801038+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:24.044660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931135619,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":213,"num_read_kb":868353,"num_write":223,"num_write_kb":909313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"74'234","reported_seq":444,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.799254+0000","last_change":"2024-05-30T16:50:01.227853+0000","last_active":"2024-05-30T16:52:33.799254+0000","last_peered":"2024-05-30T16:52:33.799254+0000","last_clean":"2024-05-30T16:52:33.799254+0000","last_became_active":"2024-05-30T16:50:01.227538+0000","last_became_peered":"2024-05-30T16:50:01.227538+0000","last_unstale":"2024-05-30T16:52:33.799254+0000","last_undegraded":"2024-05-30T16:52:33.799254+0000","last_fullsized":"2024-05-30T16:52:33.799254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910163968,"num_objects":217,"num_object_clones":0,"num_object_copies":434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":193,"num_read_kb":757768,"num_write":225,"num_write_kb":888836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"74'202","reported_seq":504,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.801977+0000","last_change":"2024-05-30T16:50:01.216098+0000","last_active":"2024-05-30T16:52:33.801977+0000","last_peered":"2024-05-30T16:52:33.801977+0000","last_clean":"2024-05-30T16:52:33.801977+0000","last_became_active":"2024-05-30T16:50:01.215541+0000","last_became_peered":"2024-05-30T16:50:01.215541+0000","last_unstale":"2024-05-30T16:52:33.801977+0000","last_undegraded":"2024-05-30T16:52:33.801977+0000","last_fullsized":"2024-05-30T16:52:33.801977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":285,"num_read_kb":1150980,"num_write":192,"num_write_kb":770050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"74'209","reported_seq":440,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.790673+0000","last_change":"2024-05-30T16:50:01.213699+0000","last_active":"2024-05-30T16:52:33.790673+0000","last_peered":"2024-05-30T16:52:33.790673+0000","last_clean":"2024-05-30T16:52:33.790673+0000","last_became_active":"2024-05-30T16:50:01.212747+0000","last_became_peered":"2024-05-30T16:50:01.212747+0000","last_unstale":"2024-05-30T16:52:33.790673+0000","last_undegraded":"2024-05-30T16:52:33.790673+0000","last_fullsized":"2024-05-30T16:52:33.790673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":214,"num_read_kb":876544,"num_write":201,"num_write_kb":823296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"74'203","reported_seq":348,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.804543+0000","last_change":"2024-05-30T16:50:01.222131+0000","last_active":"2024-05-30T16:52:33.804543+0000","last_peered":"2024-05-30T16:52:33.804543+0000","last_clean":"2024-05-30T16:52:33.804543+0000","last_became_active":"2024-05-30T16:50:01.221781+0000","last_became_peered":"2024-05-30T16:50:01.221781+0000","last_unstale":"2024-05-30T16:52:33.804543+0000","last_undegraded":"2024-05-30T16:52:33.804543+0000","last_fullsized":"2024-05-30T16:52:33.804543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:54.069608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826277888,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":197,"num_write_kb":806912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860237+0000","last_change":"2024-05-30T16:50:00.205578+0000","last_active":"2024-05-30T16:50:35.860237+0000","last_peered":"2024-05-30T16:50:35.860237+0000","last_clean":"2024-05-30T16:50:35.860237+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:50:35.860237+0000","last_undegraded":"2024-05-30T16:50:35.860237+0000","last_fullsized":"2024-05-30T16:50:35.860237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:09.041453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'214","reported_seq":436,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.800748+0000","last_change":"2024-05-30T16:50:01.208407+0000","last_active":"2024-05-30T16:52:33.800748+0000","last_peered":"2024-05-30T16:52:33.800748+0000","last_clean":"2024-05-30T16:52:33.800748+0000","last_became_active":"2024-05-30T16:50:01.208076+0000","last_became_peered":"2024-05-30T16:50:01.208076+0000","last_unstale":"2024-05-30T16:52:33.800748+0000","last_undegraded":"2024-05-30T16:52:33.800748+0000","last_fullsized":"2024-05-30T16:52:33.800748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:06.445701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055496,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":205,"num_read_kb":827395,"num_write":205,"num_write_kb":823299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.234188+0000","last_change":"2024-05-30T16:50:00.198543+0000","last_active":"2024-05-30T16:50:36.234188+0000","last_peered":"2024-05-30T16:50:36.234188+0000","last_clean":"2024-05-30T16:50:36.234188+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:50:36.234188+0000","last_undegraded":"2024-05-30T16:50:36.234188+0000","last_fullsized":"2024-05-30T16:50:36.234188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:06.670117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"74'228","reported_seq":451,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.805714+0000","last_change":"2024-05-30T16:50:01.223695+0000","last_active":"2024-05-30T16:52:33.805714+0000","last_peered":"2024-05-30T16:52:33.805714+0000","last_clean":"2024-05-30T16:52:33.805714+0000","last_became_active":"2024-05-30T16:50:01.223375+0000","last_became_peered":"2024-05-30T16:50:01.223375+0000","last_unstale":"2024-05-30T16:52:33.805714+0000","last_undegraded":"2024-05-30T16:52:33.805714+0000","last_fullsized":"2024-05-30T16:52:33.805714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192709,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":206,"num_read_kb":827396,"num_write":219,"num_write_kb":868356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:00.681206+0000","last_change":"2024-05-30T16:50:00.212444+0000","last_active":"2024-05-30T16:52:00.681206+0000","last_peered":"2024-05-30T16:52:00.681206+0000","last_clean":"2024-05-30T16:52:00.681206+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:52:00.681206+0000","last_undegraded":"2024-05-30T16:52:00.681206+0000","last_fullsized":"2024-05-30T16:52:00.681206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'227","reported_seq":498,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.795718+0000","last_change":"2024-05-30T16:50:01.219674+0000","last_active":"2024-05-30T16:52:33.795718+0000","last_peered":"2024-05-30T16:52:33.795718+0000","last_clean":"2024-05-30T16:52:33.795718+0000","last_became_active":"2024-05-30T16:50:01.219382+0000","last_became_peered":"2024-05-30T16:50:01.219382+0000","last_unstale":"2024-05-30T16:52:33.795718+0000","last_undegraded":"2024-05-30T16:52:33.795718+0000","last_fullsized":"2024-05-30T16:52:33.795718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922746880,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":254,"num_read_kb":1040384,"num_write":220,"num_write_kb":901120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863492+0000","last_change":"2024-05-30T16:50:00.210174+0000","last_active":"2024-05-30T16:50:35.863492+0000","last_peered":"2024-05-30T16:50:35.863492+0000","last_clean":"2024-05-30T16:50:35.863492+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:50:35.863492+0000","last_undegraded":"2024-05-30T16:50:35.863492+0000","last_fullsized":"2024-05-30T16:50:35.863492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"74'198","reported_seq":383,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.793375+0000","last_change":"2024-05-30T16:50:01.228355+0000","last_active":"2024-05-30T16:52:33.793375+0000","last_peered":"2024-05-30T16:52:33.793375+0000","last_clean":"2024-05-30T16:52:33.793375+0000","last_became_active":"2024-05-30T16:50:01.225437+0000","last_became_peered":"2024-05-30T16:50:01.225437+0000","last_unstale":"2024-05-30T16:52:33.793375+0000","last_undegraded":"2024-05-30T16:52:33.793375+0000","last_fullsized":"2024-05-30T16:52:33.793375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529413,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":168,"num_read_kb":684033,"num_write":189,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'48","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.733554+0000","last_change":"2024-05-30T16:50:00.205334+0000","last_active":"2024-05-30T16:52:33.733554+0000","last_peered":"2024-05-30T16:52:33.733554+0000","last_clean":"2024-05-30T16:52:33.733554+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:52:33.733554+0000","last_undegraded":"2024-05-30T16:52:33.733554+0000","last_fullsized":"2024-05-30T16:52:33.733554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:53.442543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":237501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"74'213","reported_seq":498,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.807894+0000","last_change":"2024-05-30T16:50:01.213565+0000","last_active":"2024-05-30T16:52:33.807894+0000","last_peered":"2024-05-30T16:52:33.807894+0000","last_clean":"2024-05-30T16:52:33.807894+0000","last_became_active":"2024-05-30T16:50:01.213263+0000","last_became_peered":"2024-05-30T16:50:01.213263+0000","last_unstale":"2024-05-30T16:52:33.807894+0000","last_undegraded":"2024-05-30T16:52:33.807894+0000","last_fullsized":"2024-05-30T16:52:33.807894+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":268,"num_read_kb":1089538,"num_write":204,"num_write_kb":827393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864517+0000","last_change":"2024-05-30T16:50:00.205241+0000","last_active":"2024-05-30T16:50:35.864517+0000","last_peered":"2024-05-30T16:50:35.864517+0000","last_clean":"2024-05-30T16:50:35.864517+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:50:35.864517+0000","last_undegraded":"2024-05-30T16:50:35.864517+0000","last_fullsized":"2024-05-30T16:50:35.864517+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:11.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"74'198","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.778570+0000","last_change":"2024-05-30T16:50:01.217809+0000","last_active":"2024-05-30T16:52:33.778570+0000","last_peered":"2024-05-30T16:52:33.778570+0000","last_clean":"2024-05-30T16:52:33.778570+0000","last_became_active":"2024-05-30T16:50:01.209406+0000","last_became_peered":"2024-05-30T16:50:01.209406+0000","last_unstale":"2024-05-30T16:52:33.778570+0000","last_undegraded":"2024-05-30T16:52:33.778570+0000","last_fullsized":"2024-05-30T16:52:33.778570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:15.778017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":211,"num_read_kb":856066,"num_write":191,"num_write_kb":774145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860895+0000","last_change":"2024-05-30T16:50:00.213769+0000","last_active":"2024-05-30T16:50:35.860895+0000","last_peered":"2024-05-30T16:50:35.860895+0000","last_clean":"2024-05-30T16:50:35.860895+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:50:35.860895+0000","last_undegraded":"2024-05-30T16:50:35.860895+0000","last_fullsized":"2024-05-30T16:50:35.860895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:25.844328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"74'199","reported_seq":409,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803056+0000","last_change":"2024-05-30T16:50:01.214317+0000","last_active":"2024-05-30T16:52:33.803056+0000","last_peered":"2024-05-30T16:52:33.803056+0000","last_clean":"2024-05-30T16:52:33.803056+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:52:33.803056+0000","last_undegraded":"2024-05-30T16:52:33.803056+0000","last_fullsized":"2024-05-30T16:52:33.803056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":738197504,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":193,"num_read_kb":753673,"num_write":186,"num_write_kb":720901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.013341+0000","last_change":"2024-05-30T16:50:00.203638+0000","last_active":"2024-05-30T16:50:36.013341+0000","last_peered":"2024-05-30T16:50:36.013341+0000","last_clean":"2024-05-30T16:50:36.013341+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:50:36.013341+0000","last_undegraded":"2024-05-30T16:50:36.013341+0000","last_fullsized":"2024-05-30T16:50:36.013341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:42:02.981126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"74'199","reported_seq":329,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.806369+0000","last_change":"2024-05-30T16:50:01.223933+0000","last_active":"2024-05-30T16:52:33.806369+0000","last_peered":"2024-05-30T16:52:33.806369+0000","last_clean":"2024-05-30T16:52:33.806369+0000","last_became_active":"2024-05-30T16:50:01.223472+0000","last_became_peered":"2024-05-30T16:50:01.223472+0000","last_unstale":"2024-05-30T16:52:33.806369+0000","last_undegraded":"2024-05-30T16:52:33.806369+0000","last_fullsized":"2024-05-30T16:52:33.806369+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":113,"num_read_kb":446468,"num_write":189,"num_write_kb":757762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:46.307950+0000","last_change":"2024-05-30T16:50:00.206844+0000","last_active":"2024-05-30T16:50:46.307950+0000","last_peered":"2024-05-30T16:50:46.307950+0000","last_clean":"2024-05-30T16:50:46.307950+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:50:46.307950+0000","last_undegraded":"2024-05-30T16:50:46.307950+0000","last_fullsized":"2024-05-30T16:50:46.307950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:52.154456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"74'182","reported_seq":334,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803591+0000","last_change":"2024-05-30T16:50:36.658725+0000","last_active":"2024-05-30T16:52:33.803591+0000","last_peered":"2024-05-30T16:52:33.803591+0000","last_clean":"2024-05-30T16:52:33.803591+0000","last_became_active":"2024-05-30T16:50:36.236903+0000","last_became_peered":"2024-05-30T16:50:36.236903+0000","last_unstale":"2024-05-30T16:52:33.803591+0000","last_undegraded":"2024-05-30T16:52:33.803591+0000","last_fullsized":"2024-05-30T16:52:33.803591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:48.423179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721420288,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":120,"num_read_kb":483330,"num_write":174,"num_write_kb":704513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863781+0000","last_change":"2024-05-30T16:50:00.210985+0000","last_active":"2024-05-30T16:50:35.863781+0000","last_peered":"2024-05-30T16:50:35.863781+0000","last_clean":"2024-05-30T16:50:35.863781+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:50:35.863781+0000","last_undegraded":"2024-05-30T16:50:35.863781+0000","last_fullsized":"2024-05-30T16:50:35.863781+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"74'211","reported_seq":461,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796360+0000","last_change":"2024-05-30T16:50:01.205452+0000","last_active":"2024-05-30T16:52:33.796360+0000","last_peered":"2024-05-30T16:52:33.796360+0000","last_clean":"2024-05-30T16:52:33.796360+0000","last_became_active":"2024-05-30T16:50:01.205079+0000","last_became_peered":"2024-05-30T16:50:01.205079+0000","last_unstale":"2024-05-30T16:52:33.796360+0000","last_undegraded":"2024-05-30T16:52:33.796360+0000","last_fullsized":"2024-05-30T16:52:33.796360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834666496,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":233,"num_read_kb":946178,"num_write":201,"num_write_kb":815105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'55","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:08.483506+0000","last_change":"2024-05-30T16:50:00.206599+0000","last_active":"2024-05-30T16:52:08.483506+0000","last_peered":"2024-05-30T16:52:08.483506+0000","last_clean":"2024-05-30T16:52:08.483506+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:52:08.483506+0000","last_undegraded":"2024-05-30T16:52:08.483506+0000","last_fullsized":"2024-05-30T16:52:08.483506+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:50.078170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'205","reported_seq":406,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.787758+0000","last_change":"2024-05-30T16:50:01.217111+0000","last_active":"2024-05-30T16:52:33.787758+0000","last_peered":"2024-05-30T16:52:33.787758+0000","last_clean":"2024-05-30T16:52:33.787758+0000","last_became_active":"2024-05-30T16:50:01.216841+0000","last_became_peered":"2024-05-30T16:50:01.216841+0000","last_unstale":"2024-05-30T16:52:33.787758+0000","last_undegraded":"2024-05-30T16:52:33.787758+0000","last_fullsized":"2024-05-30T16:52:33.787758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:49.210751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":184,"num_read_kb":737284,"num_write":200,"num_write_kb":794627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'1000","reported_seq":1019,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:21.292591+0000","last_change":"2024-05-30T16:50:00.208913+0000","last_active":"2024-05-30T16:52:21.292591+0000","last_peered":"2024-05-30T16:52:21.292591+0000","last_clean":"2024-05-30T16:52:21.292591+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:52:21.292591+0000","last_undegraded":"2024-05-30T16:52:21.292591+0000","last_fullsized":"2024-05-30T16:52:21.292591+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1000,"log_dups_size":0,"ondisk_log_size":1000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:48.195369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":999,"num_write_kb":4469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"74'206","reported_seq":378,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.805937+0000","last_change":"2024-05-30T16:50:01.218900+0000","last_active":"2024-05-30T16:52:33.805937+0000","last_peered":"2024-05-30T16:52:33.805937+0000","last_clean":"2024-05-30T16:52:33.805937+0000","last_became_active":"2024-05-30T16:50:01.218601+0000","last_became_peered":"2024-05-30T16:50:01.218601+0000","last_unstale":"2024-05-30T16:52:33.805937+0000","last_undegraded":"2024-05-30T16:52:33.805937+0000","last_fullsized":"2024-05-30T16:52:33.805937+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:30.501139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":155,"num_read_kb":626690,"num_write":195,"num_write_kb":790529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860908+0000","last_change":"2024-05-30T16:50:00.207072+0000","last_active":"2024-05-30T16:50:35.860908+0000","last_peered":"2024-05-30T16:50:35.860908+0000","last_clean":"2024-05-30T16:50:35.860908+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:50:35.860908+0000","last_undegraded":"2024-05-30T16:50:35.860908+0000","last_fullsized":"2024-05-30T16:50:35.860908+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:08.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"74'227","reported_seq":395,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.797899+0000","last_change":"2024-05-30T16:50:01.223569+0000","last_active":"2024-05-30T16:52:33.797899+0000","last_peered":"2024-05-30T16:52:33.797899+0000","last_clean":"2024-05-30T16:52:33.797899+0000","last_became_active":"2024-05-30T16:50:01.223101+0000","last_became_peered":"2024-05-30T16:50:01.223101+0000","last_unstale":"2024-05-30T16:52:33.797899+0000","last_undegraded":"2024-05-30T16:52:33.797899+0000","last_fullsized":"2024-05-30T16:52:33.797899+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:15.642014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":151,"num_read_kb":610306,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864714+0000","last_change":"2024-05-30T16:50:00.205457+0000","last_active":"2024-05-30T16:50:35.864714+0000","last_peered":"2024-05-30T16:50:35.864714+0000","last_clean":"2024-05-30T16:50:35.864714+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:50:35.864714+0000","last_undegraded":"2024-05-30T16:50:35.864714+0000","last_fullsized":"2024-05-30T16:50:35.864714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:09.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'193","reported_seq":383,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796441+0000","last_change":"2024-05-30T16:50:01.212311+0000","last_active":"2024-05-30T16:52:33.796441+0000","last_peered":"2024-05-30T16:52:33.796441+0000","last_clean":"2024-05-30T16:52:33.796441+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:52:33.796441+0000","last_undegraded":"2024-05-30T16:52:33.796441+0000","last_fullsized":"2024-05-30T16:52:33.796441+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":185,"num_write_kb":757760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.009845+0000","last_change":"2024-05-30T16:50:00.208941+0000","last_active":"2024-05-30T16:50:36.009845+0000","last_peered":"2024-05-30T16:50:36.009845+0000","last_clean":"2024-05-30T16:50:36.009845+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:50:36.009845+0000","last_undegraded":"2024-05-30T16:50:36.009845+0000","last_fullsized":"2024-05-30T16:50:36.009845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:04.700068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"74'225","reported_seq":438,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.798417+0000","last_change":"2024-05-30T16:50:01.208878+0000","last_active":"2024-05-30T16:52:33.798417+0000","last_peered":"2024-05-30T16:52:33.798417+0000","last_clean":"2024-05-30T16:52:33.798417+0000","last_became_active":"2024-05-30T16:50:01.207140+0000","last_became_peered":"2024-05-30T16:50:01.207140+0000","last_unstale":"2024-05-30T16:52:33.798417+0000","last_undegraded":"2024-05-30T16:52:33.798417+0000","last_fullsized":"2024-05-30T16:52:33.798417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:26.859710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":196,"num_read_kb":782341,"num_write":217,"num_write_kb":872450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.861982+0000","last_change":"2024-05-30T16:50:00.196832+0000","last_active":"2024-05-30T16:50:35.861982+0000","last_peered":"2024-05-30T16:50:35.861982+0000","last_clean":"2024-05-30T16:50:35.861982+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:50:35.861982+0000","last_undegraded":"2024-05-30T16:50:35.861982+0000","last_fullsized":"2024-05-30T16:50:35.861982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"74'222","reported_seq":311,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.788344+0000","last_change":"2024-05-30T16:50:01.215257+0000","last_active":"2024-05-30T16:52:33.788344+0000","last_peered":"2024-05-30T16:52:33.788344+0000","last_clean":"2024-05-30T16:52:33.788344+0000","last_became_active":"2024-05-30T16:50:01.214868+0000","last_became_peered":"2024-05-30T16:50:01.214868+0000","last_unstale":"2024-05-30T16:52:33.788344+0000","last_undegraded":"2024-05-30T16:52:33.788344+0000","last_fullsized":"2024-05-30T16:52:33.788344+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998275,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":72,"num_read_kb":290817,"num_write":212,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.862616+0000","last_change":"2024-05-30T16:50:00.206888+0000","last_active":"2024-05-30T16:50:35.862616+0000","last_peered":"2024-05-30T16:50:35.862616+0000","last_clean":"2024-05-30T16:50:35.862616+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:50:35.862616+0000","last_undegraded":"2024-05-30T16:50:35.862616+0000","last_fullsized":"2024-05-30T16:50:35.862616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:30.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"74'223","reported_seq":474,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.807405+0000","last_change":"2024-05-30T16:50:01.226504+0000","last_active":"2024-05-30T16:52:33.807405+0000","last_peered":"2024-05-30T16:52:33.807405+0000","last_clean":"2024-05-30T16:52:33.807405+0000","last_became_active":"2024-05-30T16:50:01.225825+0000","last_became_peered":"2024-05-30T16:50:01.225825+0000","last_unstale":"2024-05-30T16:52:33.807405+0000","last_undegraded":"2024-05-30T16:52:33.807405+0000","last_fullsized":"2024-05-30T16:52:33.807405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415354,"num_objects":209,"num_object_clones":0,"num_object_copies":418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":234,"num_read_kb":942084,"num_write":213,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863565+0000","last_change":"2024-05-30T16:50:00.201506+0000","last_active":"2024-05-30T16:50:35.863565+0000","last_peered":"2024-05-30T16:50:35.863565+0000","last_clean":"2024-05-30T16:50:35.863565+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:50:35.863565+0000","last_undegraded":"2024-05-30T16:50:35.863565+0000","last_fullsized":"2024-05-30T16:50:35.863565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:47.529393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"74'228","reported_seq":421,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.791103+0000","last_change":"2024-05-30T16:50:01.218092+0000","last_active":"2024-05-30T16:52:33.791103+0000","last_peered":"2024-05-30T16:52:33.791103+0000","last_clean":"2024-05-30T16:52:33.791103+0000","last_became_active":"2024-05-30T16:50:01.217748+0000","last_became_peered":"2024-05-30T16:50:01.217748+0000","last_unstale":"2024-05-30T16:52:33.791103+0000","last_undegraded":"2024-05-30T16:52:33.791103+0000","last_fullsized":"2024-05-30T16:52:33.791103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:12.631874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855638016,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":176,"num_read_kb":679946,"num_write":218,"num_write_kb":835591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863640+0000","last_change":"2024-05-30T16:50:00.201874+0000","last_active":"2024-05-30T16:50:35.863640+0000","last_peered":"2024-05-30T16:50:35.863640+0000","last_clean":"2024-05-30T16:50:35.863640+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:50:35.863640+0000","last_undegraded":"2024-05-30T16:50:35.863640+0000","last_fullsized":"2024-05-30T16:50:35.863640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"74'233","reported_seq":481,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.797854+0000","last_change":"2024-05-30T16:50:01.216958+0000","last_active":"2024-05-30T16:52:33.797854+0000","last_peered":"2024-05-30T16:52:33.797854+0000","last_clean":"2024-05-30T16:52:33.797854+0000","last_became_active":"2024-05-30T16:50:01.216443+0000","last_became_peered":"2024-05-30T16:50:01.216443+0000","last_unstale":"2024-05-30T16:52:33.797854+0000","last_undegraded":"2024-05-30T16:52:33.797854+0000","last_fullsized":"2024-05-30T16:52:33.797854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:13:56.465266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":926941184,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":231,"num_read_kb":933891,"num_write":223,"num_write_kb":905217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.858053+0000","last_change":"2024-05-30T16:50:00.202315+0000","last_active":"2024-05-30T16:50:35.858053+0000","last_peered":"2024-05-30T16:50:35.858053+0000","last_clean":"2024-05-30T16:50:35.858053+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:50:35.858053+0000","last_undegraded":"2024-05-30T16:50:35.858053+0000","last_fullsized":"2024-05-30T16:50:35.858053+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:07.542490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'204","reported_seq":401,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.786579+0000","last_change":"2024-05-30T16:50:01.217916+0000","last_active":"2024-05-30T16:52:33.786579+0000","last_peered":"2024-05-30T16:52:33.786579+0000","last_clean":"2024-05-30T16:52:33.786579+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:52:33.786579+0000","last_undegraded":"2024-05-30T16:52:33.786579+0000","last_fullsized":"2024-05-30T16:52:33.786579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809501194,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":180,"num_read_kb":724995,"num_write":197,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864794+0000","last_change":"2024-05-30T16:50:00.204870+0000","last_active":"2024-05-30T16:50:35.864794+0000","last_peered":"2024-05-30T16:50:35.864794+0000","last_clean":"2024-05-30T16:50:35.864794+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:50:35.864794+0000","last_undegraded":"2024-05-30T16:50:35.864794+0000","last_fullsized":"2024-05-30T16:50:35.864794+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:08.366805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"74'205","reported_seq":353,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796769+0000","last_change":"2024-05-30T16:50:01.219838+0000","last_active":"2024-05-30T16:52:33.796769+0000","last_peered":"2024-05-30T16:52:33.796769+0000","last_clean":"2024-05-30T16:52:33.796769+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:52:33.796769+0000","last_undegraded":"2024-05-30T16:52:33.796769+0000","last_fullsized":"2024-05-30T16:52:33.796769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801112325,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":131,"num_read_kb":532481,"num_write":194,"num_write_kb":782338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.010153+0000","last_change":"2024-05-30T16:50:00.207506+0000","last_active":"2024-05-30T16:50:36.010153+0000","last_peered":"2024-05-30T16:50:36.010153+0000","last_clean":"2024-05-30T16:50:36.010153+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:50:36.010153+0000","last_undegraded":"2024-05-30T16:50:36.010153+0000","last_fullsized":"2024-05-30T16:50:36.010153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:47.941977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"74'204","reported_seq":400,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796558+0000","last_change":"2024-05-30T16:50:01.220513+0000","last_active":"2024-05-30T16:52:33.796558+0000","last_peered":"2024-05-30T16:52:33.796558+0000","last_clean":"2024-05-30T16:52:33.796558+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:52:33.796558+0000","last_undegraded":"2024-05-30T16:52:33.796558+0000","last_fullsized":"2024-05-30T16:52:33.796558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:23.546971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":179,"num_read_kb":716804,"num_write":199,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.233669+0000","last_change":"2024-05-30T16:50:00.199775+0000","last_active":"2024-05-30T16:50:36.233669+0000","last_peered":"2024-05-30T16:50:36.233669+0000","last_clean":"2024-05-30T16:50:36.233669+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:50:36.233669+0000","last_undegraded":"2024-05-30T16:50:36.233669+0000","last_fullsized":"2024-05-30T16:50:36.233669+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:11.926104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"74'214","reported_seq":344,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.792787+0000","last_change":"2024-05-30T16:50:01.212934+0000","last_active":"2024-05-30T16:52:33.792787+0000","last_peered":"2024-05-30T16:52:33.792787+0000","last_clean":"2024-05-30T16:52:33.792787+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:52:33.792787+0000","last_undegraded":"2024-05-30T16:52:33.792787+0000","last_fullsized":"2024-05-30T16:52:33.792787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":113,"num_read_kb":454658,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.862881+0000","last_change":"2024-05-30T16:50:00.206485+0000","last_active":"2024-05-30T16:50:35.862881+0000","last_peered":"2024-05-30T16:50:35.862881+0000","last_clean":"2024-05-30T16:50:35.862881+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:50:35.862881+0000","last_undegraded":"2024-05-30T16:50:35.862881+0000","last_fullsized":"2024-05-30T16:50:35.862881+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:46.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"74'218","reported_seq":479,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.798529+0000","last_change":"2024-05-30T16:50:01.225452+0000","last_active":"2024-05-30T16:52:33.798529+0000","last_peered":"2024-05-30T16:52:33.798529+0000","last_clean":"2024-05-30T16:52:33.798529+0000","last_became_active":"2024-05-30T16:50:01.224834+0000","last_became_peered":"2024-05-30T16:50:01.224834+0000","last_unstale":"2024-05-30T16:52:33.798529+0000","last_undegraded":"2024-05-30T16:52:33.798529+0000","last_fullsized":"2024-05-30T16:52:33.798529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":244,"num_read_kb":999424,"num_write":207,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"74'90","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:09.319052+0000","last_change":"2024-05-30T16:50:00.209889+0000","last_active":"2024-05-30T16:52:09.319052+0000","last_peered":"2024-05-30T16:52:09.319052+0000","last_clean":"2024-05-30T16:52:09.319052+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:52:09.319052+0000","last_undegraded":"2024-05-30T16:52:09.319052+0000","last_fullsized":"2024-05-30T16:52:09.319052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:00.581262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"74'208","reported_seq":500,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.804746+0000","last_change":"2024-05-30T16:50:01.222012+0000","last_active":"2024-05-30T16:52:33.804746+0000","last_peered":"2024-05-30T16:52:33.804746+0000","last_clean":"2024-05-30T16:52:33.804746+0000","last_became_active":"2024-05-30T16:50:01.221622+0000","last_became_peered":"2024-05-30T16:50:01.221622+0000","last_unstale":"2024-05-30T16:52:33.804746+0000","last_undegraded":"2024-05-30T16:52:33.804746+0000","last_fullsized":"2024-05-30T16:52:33.804746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:43.760509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918021,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":275,"num_read_kb":1114115,"num_write":197,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.013901+0000","last_change":"2024-05-30T16:50:00.202834+0000","last_active":"2024-05-30T16:50:36.013901+0000","last_peered":"2024-05-30T16:50:36.013901+0000","last_clean":"2024-05-30T16:50:36.013901+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:50:36.013901+0000","last_undegraded":"2024-05-30T16:50:36.013901+0000","last_fullsized":"2024-05-30T16:50:36.013901+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:19:37.632432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"74'214","reported_seq":378,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.806372+0000","last_change":"2024-05-30T16:50:01.224914+0000","last_active":"2024-05-30T16:52:33.806372+0000","last_peered":"2024-05-30T16:52:33.806372+0000","last_clean":"2024-05-30T16:52:33.806372+0000","last_became_active":"2024-05-30T16:50:01.224600+0000","last_became_peered":"2024-05-30T16:50:01.224600+0000","last_unstale":"2024-05-30T16:52:33.806372+0000","last_undegraded":"2024-05-30T16:52:33.806372+0000","last_fullsized":"2024-05-30T16:52:33.806372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838861053,"num_objects":203,"num_object_clones":1,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":1,"num_read":148,"num_read_kb":602113,"num_write":203,"num_write_kb":819202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.234180+0000","last_change":"2024-05-30T16:50:00.204452+0000","last_active":"2024-05-30T16:50:36.234180+0000","last_peered":"2024-05-30T16:50:36.234180+0000","last_clean":"2024-05-30T16:50:36.234180+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:50:36.234180+0000","last_undegraded":"2024-05-30T16:50:36.234180+0000","last_fullsized":"2024-05-30T16:50:36.234180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:54.227101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"74'208","reported_seq":399,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.792200+0000","last_change":"2024-05-30T16:50:01.214457+0000","last_active":"2024-05-30T16:52:33.792200+0000","last_peered":"2024-05-30T16:52:33.792200+0000","last_clean":"2024-05-30T16:52:33.792200+0000","last_became_active":"2024-05-30T16:50:01.214152+0000","last_became_peered":"2024-05-30T16:50:01.214152+0000","last_unstale":"2024-05-30T16:52:33.792200+0000","last_undegraded":"2024-05-30T16:52:33.792200+0000","last_fullsized":"2024-05-30T16:52:33.792200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:48.139986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860931,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":174,"num_read_kb":708609,"num_write":201,"num_write_kb":819201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.013730+0000","last_change":"2024-05-30T16:50:00.207741+0000","last_active":"2024-05-30T16:50:36.013730+0000","last_peered":"2024-05-30T16:50:36.013730+0000","last_clean":"2024-05-30T16:50:36.013730+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:50:36.013730+0000","last_undegraded":"2024-05-30T16:50:36.013730+0000","last_fullsized":"2024-05-30T16:50:36.013730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:44.907107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"74'212","reported_seq":474,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803323+0000","last_change":"2024-05-30T16:50:01.214782+0000","last_active":"2024-05-30T16:52:33.803323+0000","last_peered":"2024-05-30T16:52:33.803323+0000","last_clean":"2024-05-30T16:52:33.803323+0000","last_became_active":"2024-05-30T16:50:01.214454+0000","last_became_peered":"2024-05-30T16:50:01.214454+0000","last_unstale":"2024-05-30T16:52:33.803323+0000","last_undegraded":"2024-05-30T16:52:33.803323+0000","last_fullsized":"2024-05-30T16:52:33.803323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443843,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":245,"num_read_kb":999425,"num_write":206,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860888+0000","last_change":"2024-05-30T16:50:00.213146+0000","last_active":"2024-05-30T16:50:35.860888+0000","last_peered":"2024-05-30T16:50:35.860888+0000","last_clean":"2024-05-30T16:50:35.860888+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:50:35.860888+0000","last_undegraded":"2024-05-30T16:50:35.860888+0000","last_fullsized":"2024-05-30T16:50:35.860888+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:47.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"74'241","reported_seq":483,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.778586+0000","last_change":"2024-05-30T16:50:01.210290+0000","last_active":"2024-05-30T16:52:33.778586+0000","last_peered":"2024-05-30T16:52:33.778586+0000","last_clean":"2024-05-30T16:52:33.778586+0000","last_became_active":"2024-05-30T16:50:01.209939+0000","last_became_peered":"2024-05-30T16:50:01.209939+0000","last_unstale":"2024-05-30T16:52:33.778586+0000","last_undegraded":"2024-05-30T16:52:33.778586+0000","last_fullsized":"2024-05-30T16:52:33.778586+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:20:05.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977272832,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":225,"num_read_kb":921600,"num_write":233,"num_write_kb":954368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"74'85","reported_seq":188,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:08.473941+0000","last_change":"2024-05-30T16:50:00.203989+0000","last_active":"2024-05-30T16:52:08.473941+0000","last_peered":"2024-05-30T16:52:08.473941+0000","last_clean":"2024-05-30T16:52:08.473941+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:52:08.473941+0000","last_undegraded":"2024-05-30T16:52:08.473941+0000","last_fullsized":"2024-05-30T16:52:08.473941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":84,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"74'219","reported_seq":464,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.790018+0000","last_change":"2024-05-30T16:50:01.212225+0000","last_active":"2024-05-30T16:52:33.790018+0000","last_peered":"2024-05-30T16:52:33.790018+0000","last_clean":"2024-05-30T16:52:33.790018+0000","last_became_active":"2024-05-30T16:50:01.211630+0000","last_became_peered":"2024-05-30T16:50:01.211630+0000","last_unstale":"2024-05-30T16:52:33.790018+0000","last_undegraded":"2024-05-30T16:52:33.790018+0000","last_fullsized":"2024-05-30T16:52:33.790018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":228,"num_read_kb":933888,"num_write":215,"num_write_kb":872449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860937+0000","last_change":"2024-05-30T16:50:00.210481+0000","last_active":"2024-05-30T16:50:35.860937+0000","last_peered":"2024-05-30T16:50:35.860937+0000","last_clean":"2024-05-30T16:50:35.860937+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:50:35.860937+0000","last_undegraded":"2024-05-30T16:50:35.860937+0000","last_fullsized":"2024-05-30T16:50:35.860937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:41:46.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"74'214","reported_seq":466,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796850+0000","last_change":"2024-05-30T16:50:01.218627+0000","last_active":"2024-05-30T16:52:33.796850+0000","last_peered":"2024-05-30T16:52:33.796850+0000","last_clean":"2024-05-30T16:52:33.796850+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:52:33.796850+0000","last_undegraded":"2024-05-30T16:52:33.796850+0000","last_fullsized":"2024-05-30T16:52:33.796850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":235,"num_read_kb":962560,"num_write":203,"num_write_kb":831488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:46.304719+0000","last_change":"2024-05-30T16:50:00.210033+0000","last_active":"2024-05-30T16:50:46.304719+0000","last_peered":"2024-05-30T16:50:46.304719+0000","last_clean":"2024-05-30T16:50:46.304719+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:50:46.304719+0000","last_undegraded":"2024-05-30T16:50:46.304719+0000","last_fullsized":"2024-05-30T16:50:46.304719+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:15.927433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":272,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.857733+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:50:35.857733+0000","last_peered":"2024-05-30T16:50:35.857733+0000","last_clean":"2024-05-30T16:50:35.857733+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:50:35.857733+0000","last_undegraded":"2024-05-30T16:50:35.857733+0000","last_fullsized":"2024-05-30T16:50:35.857733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":53712261060,"num_objects":12829,"num_object_clones":1,"num_object_copies":25658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12829,"num_whiteouts":1,"num_read":12246,"num_read_kb":49496226,"num_write":13027,"num_write_kb":52453497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107424694272,"data_stored":107424522120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13549,"ondisk_log_size":13549,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4445403,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":1448,"num_write_kb":4940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8945664,"data_stored":8890806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1310,"ondisk_log_size":1310,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574985,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15419816,"kb_used_data":15312352,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":78952024,"statfs":{"total":96636764160,"available":80846872576,"internally_reserved":0,"allocated":15679848448,"data_stored":15679297903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17299224,"kb_used_data":17195920,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":77072616,"statfs":{"total":96636764160,"available":78922358784,"internally_reserved":0,"allocated":17608622080,"data_stored":17608075002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10652116,"kb_used_data":10589068,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":83719724,"statfs":{"total":96636764160,"available":85728997376,"internally_reserved":0,"allocated":10843205632,"data_stored":10842662378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11717364,"kb_used_data":11650156,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":82654476,"statfs":{"total":96636764160,"available":84638183424,"internally_reserved":0,"allocated":11929759744,"data_stored":11929235817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14352080,"kb_used_data":14226568,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":80019760,"statfs":{"total":96636764160,"available":81940234240,"internally_reserved":0,"allocated":14568005632,"data_stored":14567442776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16418644,"kb_used_data":16311180,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":77953196,"statfs":{"total":96636764160,"available":79824072704,"internally_reserved":0,"allocated":16702648320,"data_stored":16702105396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10801372,"kb_used_data":10711956,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":83570468,"statfs":{"total":96636764160,"available":85576159232,"internally_reserved":0,"allocated":10969042944,"data_stored":10968492566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574986,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8993872,"kb_used_data":8926664,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":85377968,"statfs":{"total":96636764160,"available":87427039232,"internally_reserved":0,"allocated":9140903936,"data_stored":9140365112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":237613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":249699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":12744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9139408896,"data_stored":9139389333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10963931136,"data_stored":10963911563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16697544704,"data_stored":16697525009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14566858752,"data_stored":14566819752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11928604672,"data_stored":11928600707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10842300416,"data_stored":10842276877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17607712768,"data_stored":17607689499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15678332928,"data_stored":15678309380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:52:56.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:52:56.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.635+0000 7f47bdc00640 1 Processor -- start 2024-05-30T16:52:56.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.635+0000 7f47bdc00640 1 -- start start 2024-05-30T16:52:56.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.637+0000 7f47bdc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b813f760 0x7f47b806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.637+0000 7f47bdc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47b80b5fd0 0x7f47b8142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.637+0000 7f47bdc00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b806ee80 con 0x7f47b80cec70 2024-05-30T16:52:56.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.637+0000 7f47bdc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f47b81612b0 con 0x7f47b80b5fd0 2024-05-30T16:52:56.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.637+0000 7f47bdc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47b813fb40 con 0x7f47b813f760 2024-05-30T16:52:56.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.638+0000 7f47b6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b813f760 0x7f47b806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.638+0000 7f47b7400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47b80b5fd0 0x7f47b8142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.638+0000 7f47b6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b813f760 0x7f47b806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:56244/0 (socket says 172.21.15.144:56244) 2024-05-30T16:52:56.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.638+0000 7f47b6a00640 1 -- 172.21.15.144:0/2841295323 learned_addr learned my addr 172.21.15.144:0/2841295323 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:56.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.639+0000 7f47b7400640 1 -- 172.21.15.144:0/2841295323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b813f760 msgr2=0x7f47b806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:56.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.639+0000 7f47b7400640 1 --2- 172.21.15.144:0/2841295323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b813f760 0x7f47b806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.639+0000 7f47b7400640 1 -- 172.21.15.144:0/2841295323 >> v1:172.21.15.149:6789/0 conn(0x7f47b80cec70 legacy=0x7f47b80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.639+0000 7f47b7400640 1 -- 172.21.15.144:0/2841295323 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b8160730 con 0x7f47b80b5fd0 2024-05-30T16:52:56.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.639+0000 7f47b5600640 1 -- 172.21.15.144:0/2841295323 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1295820400 0 0) 0x7f47b806ee80 con 0x7f47b80cec70 2024-05-30T16:52:56.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.639+0000 7f47b6a00640 1 --2- 172.21.15.144:0/2841295323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b813f760 0x7f47b806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:56.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.640+0000 7f47b7400640 1 --2- 172.21.15.144:0/2841295323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b80b5fd0 0x7f47b8142200 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f47b00097a0 tx=0x7f47b002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e37038a02f18cd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:56.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.641+0000 7f47b5600640 1 -- 172.21.15.144:0/2841295323 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0037070 con 0x7f47b80b5fd0 2024-05-30T16:52:56.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.641+0000 7f47b5600640 1 -- 172.21.15.144:0/2841295323 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0032440 con 0x7f47b80b5fd0 2024-05-30T16:52:56.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.641+0000 7f47b5600640 1 -- 172.21.15.144:0/2841295323 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0032810 con 0x7f47b80b5fd0 2024-05-30T16:52:56.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.641+0000 7f47bdc00640 1 -- 172.21.15.144:0/2841295323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b80b5fd0 msgr2=0x7f47b8142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.641+0000 7f47bdc00640 1 --2- 172.21.15.144:0/2841295323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b80b5fd0 0x7f47b8142200 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f47b00097a0 tx=0x7f47b002a210 comp rx=0 tx=0).stop 2024-05-30T16:52:56.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.642+0000 7f47bdc00640 1 -- 172.21.15.144:0/2841295323 shutdown_connections 2024-05-30T16:52:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.642+0000 7f47bdc00640 1 --2- 172.21.15.144:0/2841295323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b80b5fd0 0x7f47b8142200 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.642+0000 7f47bdc00640 1 --2- 172.21.15.144:0/2841295323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b813f760 0x7f47b806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.642+0000 7f47bdc00640 1 -- 172.21.15.144:0/2841295323 >> 172.21.15.144:0/2841295323 conn(0x7f47b806bd00 msgr2=0x7f47b806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.642+0000 7f47bdc00640 1 -- 172.21.15.144:0/2841295323 shutdown_connections 2024-05-30T16:52:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.642+0000 7f47bdc00640 1 -- 172.21.15.144:0/2841295323 wait complete. 2024-05-30T16:52:56.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.643+0000 7f47bdc00640 1 Processor -- start 2024-05-30T16:52:56.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.643+0000 7f47bdc00640 1 -- start start 2024-05-30T16:52:56.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.644+0000 7f47bdc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b80b5fd0 0x7f47b813ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.644+0000 7f47bdc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b80cec70 0x7f47b8159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.644+0000 7f47bdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b813f760 0x7f47b8159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.644+0000 7f47bdc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8160fd0 con 0x7f47b813f760 2024-05-30T16:52:56.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.644+0000 7f47bdc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8160cf0 con 0x7f47b80cec70 2024-05-30T16:52:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.644+0000 7f47bdc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47b80cf0d0 con 0x7f47b80b5fd0 2024-05-30T16:52:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b813f760 0x7f47b8159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b813f760 0x7f47b8159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47878/0 (socket says 172.21.15.144:47878) 2024-05-30T16:52:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b7400640 1 -- 172.21.15.144:0/1401396667 learned_addr learned my addr 172.21.15.144:0/1401396667 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b6a00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b80b5fd0 0x7f47b813ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b6000640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b80cec70 0x7f47b8159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b7400640 1 -- 172.21.15.144:0/1401396667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b80b5fd0 msgr2=0x7f47b813ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b7400640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b80b5fd0 0x7f47b813ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b7400640 1 -- 172.21.15.144:0/1401396667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b80cec70 msgr2=0x7f47b8159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b7400640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b80cec70 0x7f47b8159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.645+0000 7f47b7400640 1 -- 172.21.15.144:0/1401396667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b80b02d0 con 0x7f47b813f760 2024-05-30T16:52:56.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.646+0000 7f47b7400640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b813f760 0x7f47b8159f60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f47b0035040 tx=0x7f47b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:56.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.646+0000 7f47aea00640 1 -- 172.21.15.144:0/1401396667 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0037050 con 0x7f47b813f760 2024-05-30T16:52:56.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.646+0000 7f47aea00640 1 -- 172.21.15.144:0/1401396667 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0038040 con 0x7f47b813f760 2024-05-30T16:52:56.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.646+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b81582a0 con 0x7f47b813f760 2024-05-30T16:52:56.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.646+0000 7f47aea00640 1 -- 172.21.15.144:0/1401396667 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0004450 con 0x7f47b813f760 2024-05-30T16:52:56.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.646+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b8158860 con 0x7f47b813f760 2024-05-30T16:52:56.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.647+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b8068b90 con 0x7f47b813f760 2024-05-30T16:52:56.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.648+0000 7f47aea00640 1 -- 172.21.15.144:0/1401396667 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f47b003c6d0 con 0x7f47b813f760 2024-05-30T16:52:56.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.649+0000 7f47aea00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f479806d940 0x7f479806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:56.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.649+0000 7f47aea00640 1 -- 172.21.15.144:0/1401396667 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f47b00ab420 con 0x7f47b813f760 2024-05-30T16:52:56.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.649+0000 7f47b6a00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f479806d940 0x7f479806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:56.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.650+0000 7f47b6a00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f479806d940 0x7f479806fe00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009ce0 tx=0x7f47a800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:56.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.654+0000 7f47aea00640 1 -- 172.21.15.144:0/1401396667 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f47b007af80 con 0x7f47b813f760 2024-05-30T16:52:56.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.850+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47b8075f70 con 0x7f479806d940 2024-05-30T16:52:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.861+0000 7f47aea00640 1 -- 172.21.15.144:0/1401396667 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254812 (secure 0 0 0) 0x7f47a8009d10 con 0x7f479806d940 2024-05-30T16:52:56.866 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:52:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.867+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f479806d940 msgr2=0x7f479806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.867+0000 7f47bdc00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f479806d940 0x7f479806fe00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009ce0 tx=0x7f47a800b040 comp rx=0 tx=0).stop 2024-05-30T16:52:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.867+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b813f760 msgr2=0x7f47b8159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.867+0000 7f47bdc00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b813f760 0x7f47b8159f60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f47b0035040 tx=0x7f47b00046c0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.868+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 shutdown_connections 2024-05-30T16:52:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.868+0000 7f47bdc00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f479806d940 0x7f479806fe00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.868+0000 7f47bdc00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b813f760 0x7f47b8159f60 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.868+0000 7f47bdc00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b80cec70 0x7f47b8159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.868+0000 7f47bdc00640 1 --2- 172.21.15.144:0/1401396667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47b80b5fd0 0x7f47b813ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.868+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 >> 172.21.15.144:0/1401396667 conn(0x7f47b806bd00 msgr2=0x7f47b80b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.868+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 shutdown_connections 2024-05-30T16:52:56.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:56.868+0000 7f47bdc00640 1 -- 172.21.15.144:0/1401396667 wait complete. 2024-05-30T16:52:56.890 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2024-05-30T16:52:55.224182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53717296831,"num_objects":12855,"num_object_clones":1,"num_object_copies":25710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12855,"num_whiteouts":1,"num_read":12446,"num_read_kb":49496410,"num_write":14634,"num_write_kb":52460853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14976,"ondisk_log_size":14976,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":105654488,"kb_used_data":104923864,"kb_used_omap":12,"kb_used_meta":730547,"kb_avail":649320232,"statfs":{"total":773094113280,"available":664903917568,"internally_reserved":0,"allocated":107442036736,"data_stored":107437676950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":748080691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005284"},"pg_stats":[{"pgid":"11.3f","version":"74'196","reported_seq":432,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.797320+0000","last_change":"2024-05-30T16:50:01.226270+0000","last_active":"2024-05-30T16:52:33.797320+0000","last_peered":"2024-05-30T16:52:33.797320+0000","last_clean":"2024-05-30T16:52:33.797320+0000","last_became_active":"2024-05-30T16:50:01.225529+0000","last_became_peered":"2024-05-30T16:50:01.225529+0000","last_unstale":"2024-05-30T16:52:33.797320+0000","last_undegraded":"2024-05-30T16:52:33.797320+0000","last_fullsized":"2024-05-30T16:52:33.797320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":219,"num_read_kb":897024,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"74'198","reported_seq":422,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.795008+0000","last_change":"2024-05-30T16:50:01.205668+0000","last_active":"2024-05-30T16:52:33.795008+0000","last_peered":"2024-05-30T16:52:33.795008+0000","last_clean":"2024-05-30T16:52:33.795008+0000","last_became_active":"2024-05-30T16:50:01.205240+0000","last_became_peered":"2024-05-30T16:50:01.205240+0000","last_unstale":"2024-05-30T16:52:33.795008+0000","last_undegraded":"2024-05-30T16:52:33.795008+0000","last_fullsized":"2024-05-30T16:52:33.795008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":207,"num_read_kb":847872,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"74'214","reported_seq":433,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.787179+0000","last_change":"2024-05-30T16:50:01.216644+0000","last_active":"2024-05-30T16:52:33.787179+0000","last_peered":"2024-05-30T16:52:33.787179+0000","last_clean":"2024-05-30T16:52:33.787179+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:52:33.787179+0000","last_undegraded":"2024-05-30T16:52:33.787179+0000","last_fullsized":"2024-05-30T16:52:33.787179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:38.132245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":202,"num_read_kb":806917,"num_write":210,"num_write_kb":827396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"74'207","reported_seq":349,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.790896+0000","last_change":"2024-05-30T16:50:01.208510+0000","last_active":"2024-05-30T16:52:33.790896+0000","last_peered":"2024-05-30T16:52:33.790896+0000","last_clean":"2024-05-30T16:52:33.790896+0000","last_became_active":"2024-05-30T16:50:01.207604+0000","last_became_peered":"2024-05-30T16:50:01.207604+0000","last_unstale":"2024-05-30T16:52:33.790896+0000","last_undegraded":"2024-05-30T16:52:33.790896+0000","last_fullsized":"2024-05-30T16:52:33.790896+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:10.540613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830472192,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":125,"num_read_kb":512000,"num_write":198,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"74'207","reported_seq":345,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803064+0000","last_change":"2024-05-30T16:50:01.220341+0000","last_active":"2024-05-30T16:52:33.803064+0000","last_peered":"2024-05-30T16:52:33.803064+0000","last_clean":"2024-05-30T16:52:33.803064+0000","last_became_active":"2024-05-30T16:50:01.219925+0000","last_became_peered":"2024-05-30T16:50:01.219925+0000","last_unstale":"2024-05-30T16:52:33.803064+0000","last_undegraded":"2024-05-30T16:52:33.803064+0000","last_fullsized":"2024-05-30T16:52:33.803064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:48.744105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":121,"num_read_kb":495616,"num_write":197,"num_write_kb":798721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"74'212","reported_seq":483,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.795801+0000","last_change":"2024-05-30T16:50:01.205902+0000","last_active":"2024-05-30T16:52:33.795801+0000","last_peered":"2024-05-30T16:52:33.795801+0000","last_clean":"2024-05-30T16:52:33.795801+0000","last_became_active":"2024-05-30T16:50:01.205620+0000","last_became_peered":"2024-05-30T16:50:01.205620+0000","last_unstale":"2024-05-30T16:52:33.795801+0000","last_undegraded":"2024-05-30T16:52:33.795801+0000","last_fullsized":"2024-05-30T16:52:33.795801+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":254,"num_read_kb":1028099,"num_write":206,"num_write_kb":827394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"74'203","reported_seq":364,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803946+0000","last_change":"2024-05-30T16:50:01.221623+0000","last_active":"2024-05-30T16:52:33.803946+0000","last_peered":"2024-05-30T16:52:33.803946+0000","last_clean":"2024-05-30T16:52:33.803946+0000","last_became_active":"2024-05-30T16:50:01.215828+0000","last_became_peered":"2024-05-30T16:50:01.215828+0000","last_unstale":"2024-05-30T16:52:33.803946+0000","last_undegraded":"2024-05-30T16:52:33.803946+0000","last_fullsized":"2024-05-30T16:52:33.803946+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":144,"num_read_kb":581634,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"74'194","reported_seq":372,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789543+0000","last_change":"2024-05-30T16:50:01.211114+0000","last_active":"2024-05-30T16:52:33.789543+0000","last_peered":"2024-05-30T16:52:33.789543+0000","last_clean":"2024-05-30T16:52:33.789543+0000","last_became_active":"2024-05-30T16:50:01.210863+0000","last_became_peered":"2024-05-30T16:50:01.210863+0000","last_unstale":"2024-05-30T16:52:33.789543+0000","last_undegraded":"2024-05-30T16:52:33.789543+0000","last_fullsized":"2024-05-30T16:52:33.789543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:22.258204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":161,"num_read_kb":655361,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"74'217","reported_seq":401,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.800616+0000","last_change":"2024-05-30T16:50:01.214939+0000","last_active":"2024-05-30T16:52:33.800616+0000","last_peered":"2024-05-30T16:52:33.800616+0000","last_clean":"2024-05-30T16:52:33.800616+0000","last_became_active":"2024-05-30T16:50:01.214609+0000","last_became_peered":"2024-05-30T16:50:01.214609+0000","last_unstale":"2024-05-30T16:52:33.800616+0000","last_undegraded":"2024-05-30T16:52:33.800616+0000","last_fullsized":"2024-05-30T16:52:33.800616+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:09.411468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":167,"num_read_kb":655367,"num_write":209,"num_write_kb":831491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"74'212","reported_seq":414,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789176+0000","last_change":"2024-05-30T16:50:01.217788+0000","last_active":"2024-05-30T16:52:33.789176+0000","last_peered":"2024-05-30T16:52:33.789176+0000","last_clean":"2024-05-30T16:52:33.789176+0000","last_became_active":"2024-05-30T16:50:01.217506+0000","last_became_peered":"2024-05-30T16:50:01.217506+0000","last_unstale":"2024-05-30T16:52:33.789176+0000","last_undegraded":"2024-05-30T16:52:33.789176+0000","last_fullsized":"2024-05-30T16:52:33.789176+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":185,"num_read_kb":745475,"num_write":205,"num_write_kb":831489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"74'226","reported_seq":546,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.807229+0000","last_change":"2024-05-30T16:50:01.218948+0000","last_active":"2024-05-30T16:52:33.807229+0000","last_peered":"2024-05-30T16:52:33.807229+0000","last_clean":"2024-05-30T16:52:33.807229+0000","last_became_active":"2024-05-30T16:50:01.218645+0000","last_became_peered":"2024-05-30T16:50:01.218645+0000","last_unstale":"2024-05-30T16:52:33.807229+0000","last_undegraded":"2024-05-30T16:52:33.807229+0000","last_fullsized":"2024-05-30T16:52:33.807229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:16.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":901775360,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":303,"num_read_kb":1212423,"num_write":221,"num_write_kb":880643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"74'191","reported_seq":491,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789641+0000","last_change":"2024-05-30T16:50:01.217317+0000","last_active":"2024-05-30T16:52:33.789641+0000","last_peered":"2024-05-30T16:52:33.789641+0000","last_clean":"2024-05-30T16:52:33.789641+0000","last_became_active":"2024-05-30T16:50:01.217020+0000","last_became_peered":"2024-05-30T16:50:01.217020+0000","last_unstale":"2024-05-30T16:52:33.789641+0000","last_undegraded":"2024-05-30T16:52:33.789641+0000","last_fullsized":"2024-05-30T16:52:33.789641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:31.180902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":763363328,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":283,"num_read_kb":1146883,"num_write":184,"num_write_kb":745473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"74'224","reported_seq":485,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.794499+0000","last_change":"2024-05-30T16:50:01.213490+0000","last_active":"2024-05-30T16:52:33.794499+0000","last_peered":"2024-05-30T16:52:33.794499+0000","last_clean":"2024-05-30T16:52:33.794499+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:52:33.794499+0000","last_undegraded":"2024-05-30T16:52:33.794499+0000","last_fullsized":"2024-05-30T16:52:33.794499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876609929,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":244,"num_read_kb":983044,"num_write":215,"num_write_kb":856068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"74'218","reported_seq":420,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.792384+0000","last_change":"2024-05-30T16:50:01.229142+0000","last_active":"2024-05-30T16:52:33.792384+0000","last_peered":"2024-05-30T16:52:33.792384+0000","last_clean":"2024-05-30T16:52:33.792384+0000","last_became_active":"2024-05-30T16:50:01.228163+0000","last_became_peered":"2024-05-30T16:50:01.228163+0000","last_unstale":"2024-05-30T16:52:33.792384+0000","last_undegraded":"2024-05-30T16:52:33.792384+0000","last_fullsized":"2024-05-30T16:52:33.792384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:57:34.230448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998144,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":185,"num_read_kb":757760,"num_write":213,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"74'215","reported_seq":327,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.791681+0000","last_change":"2024-05-30T16:50:01.213697+0000","last_active":"2024-05-30T16:52:33.791681+0000","last_peered":"2024-05-30T16:52:33.791681+0000","last_clean":"2024-05-30T16:52:33.791681+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:52:33.791681+0000","last_undegraded":"2024-05-30T16:52:33.791681+0000","last_fullsized":"2024-05-30T16:52:33.791681+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859832320,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":0,"num_read":95,"num_read_kb":368645,"num_write":209,"num_write_kb":839682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"74'225","reported_seq":405,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.798535+0000","last_change":"2024-05-30T16:50:01.215568+0000","last_active":"2024-05-30T16:52:33.798535+0000","last_peered":"2024-05-30T16:52:33.798535+0000","last_clean":"2024-05-30T16:52:33.798535+0000","last_became_active":"2024-05-30T16:50:01.208926+0000","last_became_peered":"2024-05-30T16:50:01.208926+0000","last_unstale":"2024-05-30T16:52:33.798535+0000","last_undegraded":"2024-05-30T16:52:33.798535+0000","last_fullsized":"2024-05-30T16:52:33.798535+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":163,"num_read_kb":651268,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"74'207","reported_seq":349,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.784484+0000","last_change":"2024-05-30T16:50:01.215004+0000","last_active":"2024-05-30T16:52:33.784484+0000","last_peered":"2024-05-30T16:52:33.784484+0000","last_clean":"2024-05-30T16:52:33.784484+0000","last_became_active":"2024-05-30T16:50:01.211267+0000","last_became_peered":"2024-05-30T16:50:01.211267+0000","last_unstale":"2024-05-30T16:52:33.784484+0000","last_undegraded":"2024-05-30T16:52:33.784484+0000","last_fullsized":"2024-05-30T16:52:33.784484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:11.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055366,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":125,"num_read_kb":503810,"num_write":203,"num_write_kb":823298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"74'211","reported_seq":511,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.785809+0000","last_change":"2024-05-30T16:50:36.531061+0000","last_active":"2024-05-30T16:52:33.785809+0000","last_peered":"2024-05-30T16:52:33.785809+0000","last_clean":"2024-05-30T16:52:33.785809+0000","last_became_active":"2024-05-30T16:50:36.235518+0000","last_became_peered":"2024-05-30T16:50:36.235518+0000","last_unstale":"2024-05-30T16:52:33.785809+0000","last_undegraded":"2024-05-30T16:52:33.785809+0000","last_fullsized":"2024-05-30T16:52:33.785809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:21.431308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860932,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":260,"num_read_kb":1056770,"num_write":205,"num_write_kb":819203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"74'216","reported_seq":437,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789328+0000","last_change":"2024-05-30T16:50:01.213913+0000","last_active":"2024-05-30T16:52:33.789328+0000","last_peered":"2024-05-30T16:52:33.789328+0000","last_clean":"2024-05-30T16:52:33.789328+0000","last_became_active":"2024-05-30T16:50:01.213651+0000","last_became_peered":"2024-05-30T16:50:01.213651+0000","last_unstale":"2024-05-30T16:52:33.789328+0000","last_undegraded":"2024-05-30T16:52:33.789328+0000","last_fullsized":"2024-05-30T16:52:33.789328+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880803840,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":204,"num_read_kb":827394,"num_write":214,"num_write_kb":860162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"74'206","reported_seq":397,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.789452+0000","last_change":"2024-05-30T16:50:01.223666+0000","last_active":"2024-05-30T16:52:33.789452+0000","last_peered":"2024-05-30T16:52:33.789452+0000","last_clean":"2024-05-30T16:52:33.789452+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:52:33.789452+0000","last_undegraded":"2024-05-30T16:52:33.789452+0000","last_fullsized":"2024-05-30T16:52:33.789452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918152,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"74'231","reported_seq":516,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.775933+0000","last_change":"2024-05-30T16:50:01.209725+0000","last_active":"2024-05-30T16:52:33.775933+0000","last_peered":"2024-05-30T16:52:33.775933+0000","last_clean":"2024-05-30T16:52:33.775933+0000","last_became_active":"2024-05-30T16:50:01.209453+0000","last_became_peered":"2024-05-30T16:50:01.209453+0000","last_unstale":"2024-05-30T16:52:33.775933+0000","last_undegraded":"2024-05-30T16:52:33.775933+0000","last_fullsized":"2024-05-30T16:52:33.775933+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":918552576,"num_objects":219,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":268,"num_read_kb":1081348,"num_write":225,"num_write_kb":897027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"74'223","reported_seq":422,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.785525+0000","last_change":"2024-05-30T16:50:01.217106+0000","last_active":"2024-05-30T16:52:33.785525+0000","last_peered":"2024-05-30T16:52:33.785525+0000","last_clean":"2024-05-30T16:52:33.785525+0000","last_became_active":"2024-05-30T16:50:01.216565+0000","last_became_peered":"2024-05-30T16:50:01.216565+0000","last_unstale":"2024-05-30T16:52:33.785525+0000","last_undegraded":"2024-05-30T16:52:33.785525+0000","last_fullsized":"2024-05-30T16:52:33.785525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415232,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":208,"num_whiteouts":0,"num_read":182,"num_read_kb":724997,"num_write":214,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"74'210","reported_seq":401,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.807430+0000","last_change":"2024-05-30T16:50:01.230645+0000","last_active":"2024-05-30T16:52:33.807430+0000","last_peered":"2024-05-30T16:52:33.807430+0000","last_clean":"2024-05-30T16:52:33.807430+0000","last_became_active":"2024-05-30T16:50:01.230326+0000","last_became_peered":"2024-05-30T16:50:01.230326+0000","last_unstale":"2024-05-30T16:52:33.807430+0000","last_undegraded":"2024-05-30T16:52:33.807430+0000","last_fullsized":"2024-05-30T16:52:33.807430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:34.972283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":805306368,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":786434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"74'202","reported_seq":379,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.797687+0000","last_change":"2024-05-30T16:50:01.222411+0000","last_active":"2024-05-30T16:52:33.797687+0000","last_peered":"2024-05-30T16:52:33.797687+0000","last_clean":"2024-05-30T16:52:33.797687+0000","last_became_active":"2024-05-30T16:50:01.221747+0000","last_became_peered":"2024-05-30T16:50:01.221747+0000","last_unstale":"2024-05-30T16:52:33.797687+0000","last_undegraded":"2024-05-30T16:52:33.797687+0000","last_fullsized":"2024-05-30T16:52:33.797687+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:31:09.263732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":160,"num_read_kb":647170,"num_write":198,"num_write_kb":794626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"74'211","reported_seq":421,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.808301+0000","last_change":"2024-05-30T16:50:01.225335+0000","last_active":"2024-05-30T16:52:33.808301+0000","last_peered":"2024-05-30T16:52:33.808301+0000","last_clean":"2024-05-30T16:52:33.808301+0000","last_became_active":"2024-05-30T16:50:01.224947+0000","last_became_peered":"2024-05-30T16:50:01.224947+0000","last_unstale":"2024-05-30T16:52:33.808301+0000","last_undegraded":"2024-05-30T16:52:33.808301+0000","last_fullsized":"2024-05-30T16:52:33.808301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":193,"num_read_kb":778243,"num_write":201,"num_write_kb":798723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"74'202","reported_seq":418,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.805075+0000","last_change":"2024-05-30T16:50:01.223725+0000","last_active":"2024-05-30T16:52:33.805075+0000","last_peered":"2024-05-30T16:52:33.805075+0000","last_clean":"2024-05-30T16:52:33.805075+0000","last_became_active":"2024-05-30T16:50:01.223128+0000","last_became_peered":"2024-05-30T16:50:01.223128+0000","last_unstale":"2024-05-30T16:52:33.805075+0000","last_undegraded":"2024-05-30T16:52:33.805075+0000","last_fullsized":"2024-05-30T16:52:33.805075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:16:28.027255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":199,"num_read_kb":815104,"num_write":189,"num_write_kb":774144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"74'209","reported_seq":427,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.802979+0000","last_change":"2024-05-30T16:50:01.221359+0000","last_active":"2024-05-30T16:52:33.802979+0000","last_peered":"2024-05-30T16:52:33.802979+0000","last_clean":"2024-05-30T16:52:33.802979+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:52:33.802979+0000","last_undegraded":"2024-05-30T16:52:33.802979+0000","last_fullsized":"2024-05-30T16:52:33.802979+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":201,"num_read_kb":819201,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"74'185","reported_seq":297,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.788833+0000","last_change":"2024-05-30T16:50:01.217815+0000","last_active":"2024-05-30T16:52:33.788833+0000","last_peered":"2024-05-30T16:52:33.788833+0000","last_clean":"2024-05-30T16:52:33.788833+0000","last_became_active":"2024-05-30T16:50:01.217568+0000","last_became_peered":"2024-05-30T16:50:01.217568+0000","last_unstale":"2024-05-30T16:52:33.788833+0000","last_undegraded":"2024-05-30T16:52:33.788833+0000","last_fullsized":"2024-05-30T16:52:33.788833+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":759169024,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":95,"num_read_kb":389120,"num_write":183,"num_write_kb":741377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"74'237","reported_seq":467,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.801038+0000","last_change":"2024-05-30T16:50:01.225500+0000","last_active":"2024-05-30T16:52:33.801038+0000","last_peered":"2024-05-30T16:52:33.801038+0000","last_clean":"2024-05-30T16:52:33.801038+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:52:33.801038+0000","last_undegraded":"2024-05-30T16:52:33.801038+0000","last_fullsized":"2024-05-30T16:52:33.801038+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:24.044660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931135619,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":213,"num_read_kb":868353,"num_write":223,"num_write_kb":909313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"74'234","reported_seq":444,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.799254+0000","last_change":"2024-05-30T16:50:01.227853+0000","last_active":"2024-05-30T16:52:33.799254+0000","last_peered":"2024-05-30T16:52:33.799254+0000","last_clean":"2024-05-30T16:52:33.799254+0000","last_became_active":"2024-05-30T16:50:01.227538+0000","last_became_peered":"2024-05-30T16:50:01.227538+0000","last_unstale":"2024-05-30T16:52:33.799254+0000","last_undegraded":"2024-05-30T16:52:33.799254+0000","last_fullsized":"2024-05-30T16:52:33.799254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910163968,"num_objects":217,"num_object_clones":0,"num_object_copies":434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":193,"num_read_kb":757768,"num_write":225,"num_write_kb":888836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"74'202","reported_seq":504,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.801977+0000","last_change":"2024-05-30T16:50:01.216098+0000","last_active":"2024-05-30T16:52:33.801977+0000","last_peered":"2024-05-30T16:52:33.801977+0000","last_clean":"2024-05-30T16:52:33.801977+0000","last_became_active":"2024-05-30T16:50:01.215541+0000","last_became_peered":"2024-05-30T16:50:01.215541+0000","last_unstale":"2024-05-30T16:52:33.801977+0000","last_undegraded":"2024-05-30T16:52:33.801977+0000","last_fullsized":"2024-05-30T16:52:33.801977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":285,"num_read_kb":1150980,"num_write":192,"num_write_kb":770050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"74'209","reported_seq":440,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.790673+0000","last_change":"2024-05-30T16:50:01.213699+0000","last_active":"2024-05-30T16:52:33.790673+0000","last_peered":"2024-05-30T16:52:33.790673+0000","last_clean":"2024-05-30T16:52:33.790673+0000","last_became_active":"2024-05-30T16:50:01.212747+0000","last_became_peered":"2024-05-30T16:50:01.212747+0000","last_unstale":"2024-05-30T16:52:33.790673+0000","last_undegraded":"2024-05-30T16:52:33.790673+0000","last_fullsized":"2024-05-30T16:52:33.790673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":214,"num_read_kb":876544,"num_write":201,"num_write_kb":823296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"74'203","reported_seq":348,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.804543+0000","last_change":"2024-05-30T16:50:01.222131+0000","last_active":"2024-05-30T16:52:33.804543+0000","last_peered":"2024-05-30T16:52:33.804543+0000","last_clean":"2024-05-30T16:52:33.804543+0000","last_became_active":"2024-05-30T16:50:01.221781+0000","last_became_peered":"2024-05-30T16:50:01.221781+0000","last_unstale":"2024-05-30T16:52:33.804543+0000","last_undegraded":"2024-05-30T16:52:33.804543+0000","last_fullsized":"2024-05-30T16:52:33.804543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:54.069608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826277888,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":197,"num_write_kb":806912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860237+0000","last_change":"2024-05-30T16:50:00.205578+0000","last_active":"2024-05-30T16:50:35.860237+0000","last_peered":"2024-05-30T16:50:35.860237+0000","last_clean":"2024-05-30T16:50:35.860237+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:50:35.860237+0000","last_undegraded":"2024-05-30T16:50:35.860237+0000","last_fullsized":"2024-05-30T16:50:35.860237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:09.041453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'214","reported_seq":436,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.800748+0000","last_change":"2024-05-30T16:50:01.208407+0000","last_active":"2024-05-30T16:52:33.800748+0000","last_peered":"2024-05-30T16:52:33.800748+0000","last_clean":"2024-05-30T16:52:33.800748+0000","last_became_active":"2024-05-30T16:50:01.208076+0000","last_became_peered":"2024-05-30T16:50:01.208076+0000","last_unstale":"2024-05-30T16:52:33.800748+0000","last_undegraded":"2024-05-30T16:52:33.800748+0000","last_fullsized":"2024-05-30T16:52:33.800748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:06.445701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055496,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":205,"num_read_kb":827395,"num_write":205,"num_write_kb":823299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.234188+0000","last_change":"2024-05-30T16:50:00.198543+0000","last_active":"2024-05-30T16:50:36.234188+0000","last_peered":"2024-05-30T16:50:36.234188+0000","last_clean":"2024-05-30T16:50:36.234188+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:50:36.234188+0000","last_undegraded":"2024-05-30T16:50:36.234188+0000","last_fullsized":"2024-05-30T16:50:36.234188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:06.670117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"74'228","reported_seq":451,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.805714+0000","last_change":"2024-05-30T16:50:01.223695+0000","last_active":"2024-05-30T16:52:33.805714+0000","last_peered":"2024-05-30T16:52:33.805714+0000","last_clean":"2024-05-30T16:52:33.805714+0000","last_became_active":"2024-05-30T16:50:01.223375+0000","last_became_peered":"2024-05-30T16:50:01.223375+0000","last_unstale":"2024-05-30T16:52:33.805714+0000","last_undegraded":"2024-05-30T16:52:33.805714+0000","last_fullsized":"2024-05-30T16:52:33.805714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192709,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":206,"num_read_kb":827396,"num_write":219,"num_write_kb":868356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:00.681206+0000","last_change":"2024-05-30T16:50:00.212444+0000","last_active":"2024-05-30T16:52:00.681206+0000","last_peered":"2024-05-30T16:52:00.681206+0000","last_clean":"2024-05-30T16:52:00.681206+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:52:00.681206+0000","last_undegraded":"2024-05-30T16:52:00.681206+0000","last_fullsized":"2024-05-30T16:52:00.681206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'227","reported_seq":498,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.795718+0000","last_change":"2024-05-30T16:50:01.219674+0000","last_active":"2024-05-30T16:52:33.795718+0000","last_peered":"2024-05-30T16:52:33.795718+0000","last_clean":"2024-05-30T16:52:33.795718+0000","last_became_active":"2024-05-30T16:50:01.219382+0000","last_became_peered":"2024-05-30T16:50:01.219382+0000","last_unstale":"2024-05-30T16:52:33.795718+0000","last_undegraded":"2024-05-30T16:52:33.795718+0000","last_fullsized":"2024-05-30T16:52:33.795718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922746880,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":254,"num_read_kb":1040384,"num_write":220,"num_write_kb":901120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863492+0000","last_change":"2024-05-30T16:50:00.210174+0000","last_active":"2024-05-30T16:50:35.863492+0000","last_peered":"2024-05-30T16:50:35.863492+0000","last_clean":"2024-05-30T16:50:35.863492+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:50:35.863492+0000","last_undegraded":"2024-05-30T16:50:35.863492+0000","last_fullsized":"2024-05-30T16:50:35.863492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"74'198","reported_seq":383,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.793375+0000","last_change":"2024-05-30T16:50:01.228355+0000","last_active":"2024-05-30T16:52:33.793375+0000","last_peered":"2024-05-30T16:52:33.793375+0000","last_clean":"2024-05-30T16:52:33.793375+0000","last_became_active":"2024-05-30T16:50:01.225437+0000","last_became_peered":"2024-05-30T16:50:01.225437+0000","last_unstale":"2024-05-30T16:52:33.793375+0000","last_undegraded":"2024-05-30T16:52:33.793375+0000","last_fullsized":"2024-05-30T16:52:33.793375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529413,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":168,"num_read_kb":684033,"num_write":189,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'48","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.733554+0000","last_change":"2024-05-30T16:50:00.205334+0000","last_active":"2024-05-30T16:52:33.733554+0000","last_peered":"2024-05-30T16:52:33.733554+0000","last_clean":"2024-05-30T16:52:33.733554+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:52:33.733554+0000","last_undegraded":"2024-05-30T16:52:33.733554+0000","last_fullsized":"2024-05-30T16:52:33.733554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:53.442543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":237501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"74'213","reported_seq":498,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.807894+0000","last_change":"2024-05-30T16:50:01.213565+0000","last_active":"2024-05-30T16:52:33.807894+0000","last_peered":"2024-05-30T16:52:33.807894+0000","last_clean":"2024-05-30T16:52:33.807894+0000","last_became_active":"2024-05-30T16:50:01.213263+0000","last_became_peered":"2024-05-30T16:50:01.213263+0000","last_unstale":"2024-05-30T16:52:33.807894+0000","last_undegraded":"2024-05-30T16:52:33.807894+0000","last_fullsized":"2024-05-30T16:52:33.807894+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":268,"num_read_kb":1089538,"num_write":204,"num_write_kb":827393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864517+0000","last_change":"2024-05-30T16:50:00.205241+0000","last_active":"2024-05-30T16:50:35.864517+0000","last_peered":"2024-05-30T16:50:35.864517+0000","last_clean":"2024-05-30T16:50:35.864517+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:50:35.864517+0000","last_undegraded":"2024-05-30T16:50:35.864517+0000","last_fullsized":"2024-05-30T16:50:35.864517+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:11.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"74'198","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.778570+0000","last_change":"2024-05-30T16:50:01.217809+0000","last_active":"2024-05-30T16:52:33.778570+0000","last_peered":"2024-05-30T16:52:33.778570+0000","last_clean":"2024-05-30T16:52:33.778570+0000","last_became_active":"2024-05-30T16:50:01.209406+0000","last_became_peered":"2024-05-30T16:50:01.209406+0000","last_unstale":"2024-05-30T16:52:33.778570+0000","last_undegraded":"2024-05-30T16:52:33.778570+0000","last_fullsized":"2024-05-30T16:52:33.778570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:15.778017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":211,"num_read_kb":856066,"num_write":191,"num_write_kb":774145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860895+0000","last_change":"2024-05-30T16:50:00.213769+0000","last_active":"2024-05-30T16:50:35.860895+0000","last_peered":"2024-05-30T16:50:35.860895+0000","last_clean":"2024-05-30T16:50:35.860895+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:50:35.860895+0000","last_undegraded":"2024-05-30T16:50:35.860895+0000","last_fullsized":"2024-05-30T16:50:35.860895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:25.844328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"74'199","reported_seq":409,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803056+0000","last_change":"2024-05-30T16:50:01.214317+0000","last_active":"2024-05-30T16:52:33.803056+0000","last_peered":"2024-05-30T16:52:33.803056+0000","last_clean":"2024-05-30T16:52:33.803056+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:52:33.803056+0000","last_undegraded":"2024-05-30T16:52:33.803056+0000","last_fullsized":"2024-05-30T16:52:33.803056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":738197504,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":193,"num_read_kb":753673,"num_write":186,"num_write_kb":720901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.013341+0000","last_change":"2024-05-30T16:50:00.203638+0000","last_active":"2024-05-30T16:50:36.013341+0000","last_peered":"2024-05-30T16:50:36.013341+0000","last_clean":"2024-05-30T16:50:36.013341+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:50:36.013341+0000","last_undegraded":"2024-05-30T16:50:36.013341+0000","last_fullsized":"2024-05-30T16:50:36.013341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:42:02.981126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"74'199","reported_seq":329,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.806369+0000","last_change":"2024-05-30T16:50:01.223933+0000","last_active":"2024-05-30T16:52:33.806369+0000","last_peered":"2024-05-30T16:52:33.806369+0000","last_clean":"2024-05-30T16:52:33.806369+0000","last_became_active":"2024-05-30T16:50:01.223472+0000","last_became_peered":"2024-05-30T16:50:01.223472+0000","last_unstale":"2024-05-30T16:52:33.806369+0000","last_undegraded":"2024-05-30T16:52:33.806369+0000","last_fullsized":"2024-05-30T16:52:33.806369+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":113,"num_read_kb":446468,"num_write":189,"num_write_kb":757762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:46.307950+0000","last_change":"2024-05-30T16:50:00.206844+0000","last_active":"2024-05-30T16:50:46.307950+0000","last_peered":"2024-05-30T16:50:46.307950+0000","last_clean":"2024-05-30T16:50:46.307950+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:50:46.307950+0000","last_undegraded":"2024-05-30T16:50:46.307950+0000","last_fullsized":"2024-05-30T16:50:46.307950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:52.154456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"74'182","reported_seq":334,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803591+0000","last_change":"2024-05-30T16:50:36.658725+0000","last_active":"2024-05-30T16:52:33.803591+0000","last_peered":"2024-05-30T16:52:33.803591+0000","last_clean":"2024-05-30T16:52:33.803591+0000","last_became_active":"2024-05-30T16:50:36.236903+0000","last_became_peered":"2024-05-30T16:50:36.236903+0000","last_unstale":"2024-05-30T16:52:33.803591+0000","last_undegraded":"2024-05-30T16:52:33.803591+0000","last_fullsized":"2024-05-30T16:52:33.803591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:48.423179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721420288,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":120,"num_read_kb":483330,"num_write":174,"num_write_kb":704513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863781+0000","last_change":"2024-05-30T16:50:00.210985+0000","last_active":"2024-05-30T16:50:35.863781+0000","last_peered":"2024-05-30T16:50:35.863781+0000","last_clean":"2024-05-30T16:50:35.863781+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:50:35.863781+0000","last_undegraded":"2024-05-30T16:50:35.863781+0000","last_fullsized":"2024-05-30T16:50:35.863781+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"74'211","reported_seq":461,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796360+0000","last_change":"2024-05-30T16:50:01.205452+0000","last_active":"2024-05-30T16:52:33.796360+0000","last_peered":"2024-05-30T16:52:33.796360+0000","last_clean":"2024-05-30T16:52:33.796360+0000","last_became_active":"2024-05-30T16:50:01.205079+0000","last_became_peered":"2024-05-30T16:50:01.205079+0000","last_unstale":"2024-05-30T16:52:33.796360+0000","last_undegraded":"2024-05-30T16:52:33.796360+0000","last_fullsized":"2024-05-30T16:52:33.796360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834666496,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":233,"num_read_kb":946178,"num_write":201,"num_write_kb":815105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'55","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:08.483506+0000","last_change":"2024-05-30T16:50:00.206599+0000","last_active":"2024-05-30T16:52:08.483506+0000","last_peered":"2024-05-30T16:52:08.483506+0000","last_clean":"2024-05-30T16:52:08.483506+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:52:08.483506+0000","last_undegraded":"2024-05-30T16:52:08.483506+0000","last_fullsized":"2024-05-30T16:52:08.483506+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:50.078170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'205","reported_seq":406,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.787758+0000","last_change":"2024-05-30T16:50:01.217111+0000","last_active":"2024-05-30T16:52:33.787758+0000","last_peered":"2024-05-30T16:52:33.787758+0000","last_clean":"2024-05-30T16:52:33.787758+0000","last_became_active":"2024-05-30T16:50:01.216841+0000","last_became_peered":"2024-05-30T16:50:01.216841+0000","last_unstale":"2024-05-30T16:52:33.787758+0000","last_undegraded":"2024-05-30T16:52:33.787758+0000","last_fullsized":"2024-05-30T16:52:33.787758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:49.210751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":184,"num_read_kb":737284,"num_write":200,"num_write_kb":794627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'1000","reported_seq":1019,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:21.292591+0000","last_change":"2024-05-30T16:50:00.208913+0000","last_active":"2024-05-30T16:52:21.292591+0000","last_peered":"2024-05-30T16:52:21.292591+0000","last_clean":"2024-05-30T16:52:21.292591+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:52:21.292591+0000","last_undegraded":"2024-05-30T16:52:21.292591+0000","last_fullsized":"2024-05-30T16:52:21.292591+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1000,"log_dups_size":0,"ondisk_log_size":1000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:48.195369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":999,"num_write_kb":4469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"74'206","reported_seq":378,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.805937+0000","last_change":"2024-05-30T16:50:01.218900+0000","last_active":"2024-05-30T16:52:33.805937+0000","last_peered":"2024-05-30T16:52:33.805937+0000","last_clean":"2024-05-30T16:52:33.805937+0000","last_became_active":"2024-05-30T16:50:01.218601+0000","last_became_peered":"2024-05-30T16:50:01.218601+0000","last_unstale":"2024-05-30T16:52:33.805937+0000","last_undegraded":"2024-05-30T16:52:33.805937+0000","last_fullsized":"2024-05-30T16:52:33.805937+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:30.501139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":155,"num_read_kb":626690,"num_write":195,"num_write_kb":790529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860908+0000","last_change":"2024-05-30T16:50:00.207072+0000","last_active":"2024-05-30T16:50:35.860908+0000","last_peered":"2024-05-30T16:50:35.860908+0000","last_clean":"2024-05-30T16:50:35.860908+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:50:35.860908+0000","last_undegraded":"2024-05-30T16:50:35.860908+0000","last_fullsized":"2024-05-30T16:50:35.860908+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:08.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"74'227","reported_seq":395,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.797899+0000","last_change":"2024-05-30T16:50:01.223569+0000","last_active":"2024-05-30T16:52:33.797899+0000","last_peered":"2024-05-30T16:52:33.797899+0000","last_clean":"2024-05-30T16:52:33.797899+0000","last_became_active":"2024-05-30T16:50:01.223101+0000","last_became_peered":"2024-05-30T16:50:01.223101+0000","last_unstale":"2024-05-30T16:52:33.797899+0000","last_undegraded":"2024-05-30T16:52:33.797899+0000","last_fullsized":"2024-05-30T16:52:33.797899+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:15.642014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":151,"num_read_kb":610306,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864714+0000","last_change":"2024-05-30T16:50:00.205457+0000","last_active":"2024-05-30T16:50:35.864714+0000","last_peered":"2024-05-30T16:50:35.864714+0000","last_clean":"2024-05-30T16:50:35.864714+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:50:35.864714+0000","last_undegraded":"2024-05-30T16:50:35.864714+0000","last_fullsized":"2024-05-30T16:50:35.864714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:09.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'193","reported_seq":383,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796441+0000","last_change":"2024-05-30T16:50:01.212311+0000","last_active":"2024-05-30T16:52:33.796441+0000","last_peered":"2024-05-30T16:52:33.796441+0000","last_clean":"2024-05-30T16:52:33.796441+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:52:33.796441+0000","last_undegraded":"2024-05-30T16:52:33.796441+0000","last_fullsized":"2024-05-30T16:52:33.796441+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":185,"num_write_kb":757760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.009845+0000","last_change":"2024-05-30T16:50:00.208941+0000","last_active":"2024-05-30T16:50:36.009845+0000","last_peered":"2024-05-30T16:50:36.009845+0000","last_clean":"2024-05-30T16:50:36.009845+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:50:36.009845+0000","last_undegraded":"2024-05-30T16:50:36.009845+0000","last_fullsized":"2024-05-30T16:50:36.009845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:04.700068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"74'225","reported_seq":438,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.798417+0000","last_change":"2024-05-30T16:50:01.208878+0000","last_active":"2024-05-30T16:52:33.798417+0000","last_peered":"2024-05-30T16:52:33.798417+0000","last_clean":"2024-05-30T16:52:33.798417+0000","last_became_active":"2024-05-30T16:50:01.207140+0000","last_became_peered":"2024-05-30T16:50:01.207140+0000","last_unstale":"2024-05-30T16:52:33.798417+0000","last_undegraded":"2024-05-30T16:52:33.798417+0000","last_fullsized":"2024-05-30T16:52:33.798417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:26.859710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":196,"num_read_kb":782341,"num_write":217,"num_write_kb":872450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.861982+0000","last_change":"2024-05-30T16:50:00.196832+0000","last_active":"2024-05-30T16:50:35.861982+0000","last_peered":"2024-05-30T16:50:35.861982+0000","last_clean":"2024-05-30T16:50:35.861982+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:50:35.861982+0000","last_undegraded":"2024-05-30T16:50:35.861982+0000","last_fullsized":"2024-05-30T16:50:35.861982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"74'222","reported_seq":311,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.788344+0000","last_change":"2024-05-30T16:50:01.215257+0000","last_active":"2024-05-30T16:52:33.788344+0000","last_peered":"2024-05-30T16:52:33.788344+0000","last_clean":"2024-05-30T16:52:33.788344+0000","last_became_active":"2024-05-30T16:50:01.214868+0000","last_became_peered":"2024-05-30T16:50:01.214868+0000","last_unstale":"2024-05-30T16:52:33.788344+0000","last_undegraded":"2024-05-30T16:52:33.788344+0000","last_fullsized":"2024-05-30T16:52:33.788344+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998275,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":72,"num_read_kb":290817,"num_write":212,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.862616+0000","last_change":"2024-05-30T16:50:00.206888+0000","last_active":"2024-05-30T16:50:35.862616+0000","last_peered":"2024-05-30T16:50:35.862616+0000","last_clean":"2024-05-30T16:50:35.862616+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:50:35.862616+0000","last_undegraded":"2024-05-30T16:50:35.862616+0000","last_fullsized":"2024-05-30T16:50:35.862616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:30.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"74'223","reported_seq":474,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.807405+0000","last_change":"2024-05-30T16:50:01.226504+0000","last_active":"2024-05-30T16:52:33.807405+0000","last_peered":"2024-05-30T16:52:33.807405+0000","last_clean":"2024-05-30T16:52:33.807405+0000","last_became_active":"2024-05-30T16:50:01.225825+0000","last_became_peered":"2024-05-30T16:50:01.225825+0000","last_unstale":"2024-05-30T16:52:33.807405+0000","last_undegraded":"2024-05-30T16:52:33.807405+0000","last_fullsized":"2024-05-30T16:52:33.807405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415354,"num_objects":209,"num_object_clones":0,"num_object_copies":418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":234,"num_read_kb":942084,"num_write":213,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863565+0000","last_change":"2024-05-30T16:50:00.201506+0000","last_active":"2024-05-30T16:50:35.863565+0000","last_peered":"2024-05-30T16:50:35.863565+0000","last_clean":"2024-05-30T16:50:35.863565+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:50:35.863565+0000","last_undegraded":"2024-05-30T16:50:35.863565+0000","last_fullsized":"2024-05-30T16:50:35.863565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:47.529393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"74'228","reported_seq":421,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.791103+0000","last_change":"2024-05-30T16:50:01.218092+0000","last_active":"2024-05-30T16:52:33.791103+0000","last_peered":"2024-05-30T16:52:33.791103+0000","last_clean":"2024-05-30T16:52:33.791103+0000","last_became_active":"2024-05-30T16:50:01.217748+0000","last_became_peered":"2024-05-30T16:50:01.217748+0000","last_unstale":"2024-05-30T16:52:33.791103+0000","last_undegraded":"2024-05-30T16:52:33.791103+0000","last_fullsized":"2024-05-30T16:52:33.791103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:12.631874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855638016,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":176,"num_read_kb":679946,"num_write":218,"num_write_kb":835591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863640+0000","last_change":"2024-05-30T16:50:00.201874+0000","last_active":"2024-05-30T16:50:35.863640+0000","last_peered":"2024-05-30T16:50:35.863640+0000","last_clean":"2024-05-30T16:50:35.863640+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:50:35.863640+0000","last_undegraded":"2024-05-30T16:50:35.863640+0000","last_fullsized":"2024-05-30T16:50:35.863640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"74'233","reported_seq":481,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.797854+0000","last_change":"2024-05-30T16:50:01.216958+0000","last_active":"2024-05-30T16:52:33.797854+0000","last_peered":"2024-05-30T16:52:33.797854+0000","last_clean":"2024-05-30T16:52:33.797854+0000","last_became_active":"2024-05-30T16:50:01.216443+0000","last_became_peered":"2024-05-30T16:50:01.216443+0000","last_unstale":"2024-05-30T16:52:33.797854+0000","last_undegraded":"2024-05-30T16:52:33.797854+0000","last_fullsized":"2024-05-30T16:52:33.797854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:13:56.465266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":926941184,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":231,"num_read_kb":933891,"num_write":223,"num_write_kb":905217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.858053+0000","last_change":"2024-05-30T16:50:00.202315+0000","last_active":"2024-05-30T16:50:35.858053+0000","last_peered":"2024-05-30T16:50:35.858053+0000","last_clean":"2024-05-30T16:50:35.858053+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:50:35.858053+0000","last_undegraded":"2024-05-30T16:50:35.858053+0000","last_fullsized":"2024-05-30T16:50:35.858053+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:07.542490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'204","reported_seq":401,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.786579+0000","last_change":"2024-05-30T16:50:01.217916+0000","last_active":"2024-05-30T16:52:33.786579+0000","last_peered":"2024-05-30T16:52:33.786579+0000","last_clean":"2024-05-30T16:52:33.786579+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:52:33.786579+0000","last_undegraded":"2024-05-30T16:52:33.786579+0000","last_fullsized":"2024-05-30T16:52:33.786579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809501194,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":180,"num_read_kb":724995,"num_write":197,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864794+0000","last_change":"2024-05-30T16:50:00.204870+0000","last_active":"2024-05-30T16:50:35.864794+0000","last_peered":"2024-05-30T16:50:35.864794+0000","last_clean":"2024-05-30T16:50:35.864794+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:50:35.864794+0000","last_undegraded":"2024-05-30T16:50:35.864794+0000","last_fullsized":"2024-05-30T16:50:35.864794+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:08.366805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"74'205","reported_seq":353,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796769+0000","last_change":"2024-05-30T16:50:01.219838+0000","last_active":"2024-05-30T16:52:33.796769+0000","last_peered":"2024-05-30T16:52:33.796769+0000","last_clean":"2024-05-30T16:52:33.796769+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:52:33.796769+0000","last_undegraded":"2024-05-30T16:52:33.796769+0000","last_fullsized":"2024-05-30T16:52:33.796769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801112325,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":131,"num_read_kb":532481,"num_write":194,"num_write_kb":782338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.010153+0000","last_change":"2024-05-30T16:50:00.207506+0000","last_active":"2024-05-30T16:50:36.010153+0000","last_peered":"2024-05-30T16:50:36.010153+0000","last_clean":"2024-05-30T16:50:36.010153+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:50:36.010153+0000","last_undegraded":"2024-05-30T16:50:36.010153+0000","last_fullsized":"2024-05-30T16:50:36.010153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:47.941977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"74'204","reported_seq":400,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796558+0000","last_change":"2024-05-30T16:50:01.220513+0000","last_active":"2024-05-30T16:52:33.796558+0000","last_peered":"2024-05-30T16:52:33.796558+0000","last_clean":"2024-05-30T16:52:33.796558+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:52:33.796558+0000","last_undegraded":"2024-05-30T16:52:33.796558+0000","last_fullsized":"2024-05-30T16:52:33.796558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:23.546971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":179,"num_read_kb":716804,"num_write":199,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.233669+0000","last_change":"2024-05-30T16:50:00.199775+0000","last_active":"2024-05-30T16:50:36.233669+0000","last_peered":"2024-05-30T16:50:36.233669+0000","last_clean":"2024-05-30T16:50:36.233669+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:50:36.233669+0000","last_undegraded":"2024-05-30T16:50:36.233669+0000","last_fullsized":"2024-05-30T16:50:36.233669+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:11.926104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"74'214","reported_seq":344,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.792787+0000","last_change":"2024-05-30T16:50:01.212934+0000","last_active":"2024-05-30T16:52:33.792787+0000","last_peered":"2024-05-30T16:52:33.792787+0000","last_clean":"2024-05-30T16:52:33.792787+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:52:33.792787+0000","last_undegraded":"2024-05-30T16:52:33.792787+0000","last_fullsized":"2024-05-30T16:52:33.792787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":113,"num_read_kb":454658,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.862881+0000","last_change":"2024-05-30T16:50:00.206485+0000","last_active":"2024-05-30T16:50:35.862881+0000","last_peered":"2024-05-30T16:50:35.862881+0000","last_clean":"2024-05-30T16:50:35.862881+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:50:35.862881+0000","last_undegraded":"2024-05-30T16:50:35.862881+0000","last_fullsized":"2024-05-30T16:50:35.862881+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:46.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"74'218","reported_seq":479,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.798529+0000","last_change":"2024-05-30T16:50:01.225452+0000","last_active":"2024-05-30T16:52:33.798529+0000","last_peered":"2024-05-30T16:52:33.798529+0000","last_clean":"2024-05-30T16:52:33.798529+0000","last_became_active":"2024-05-30T16:50:01.224834+0000","last_became_peered":"2024-05-30T16:50:01.224834+0000","last_unstale":"2024-05-30T16:52:33.798529+0000","last_undegraded":"2024-05-30T16:52:33.798529+0000","last_fullsized":"2024-05-30T16:52:33.798529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":244,"num_read_kb":999424,"num_write":207,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"74'90","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:09.319052+0000","last_change":"2024-05-30T16:50:00.209889+0000","last_active":"2024-05-30T16:52:09.319052+0000","last_peered":"2024-05-30T16:52:09.319052+0000","last_clean":"2024-05-30T16:52:09.319052+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:52:09.319052+0000","last_undegraded":"2024-05-30T16:52:09.319052+0000","last_fullsized":"2024-05-30T16:52:09.319052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:00.581262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"74'208","reported_seq":500,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.804746+0000","last_change":"2024-05-30T16:50:01.222012+0000","last_active":"2024-05-30T16:52:33.804746+0000","last_peered":"2024-05-30T16:52:33.804746+0000","last_clean":"2024-05-30T16:52:33.804746+0000","last_became_active":"2024-05-30T16:50:01.221622+0000","last_became_peered":"2024-05-30T16:50:01.221622+0000","last_unstale":"2024-05-30T16:52:33.804746+0000","last_undegraded":"2024-05-30T16:52:33.804746+0000","last_fullsized":"2024-05-30T16:52:33.804746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:43.760509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918021,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":275,"num_read_kb":1114115,"num_write":197,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.013901+0000","last_change":"2024-05-30T16:50:00.202834+0000","last_active":"2024-05-30T16:50:36.013901+0000","last_peered":"2024-05-30T16:50:36.013901+0000","last_clean":"2024-05-30T16:50:36.013901+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:50:36.013901+0000","last_undegraded":"2024-05-30T16:50:36.013901+0000","last_fullsized":"2024-05-30T16:50:36.013901+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:19:37.632432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"74'214","reported_seq":378,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.806372+0000","last_change":"2024-05-30T16:50:01.224914+0000","last_active":"2024-05-30T16:52:33.806372+0000","last_peered":"2024-05-30T16:52:33.806372+0000","last_clean":"2024-05-30T16:52:33.806372+0000","last_became_active":"2024-05-30T16:50:01.224600+0000","last_became_peered":"2024-05-30T16:50:01.224600+0000","last_unstale":"2024-05-30T16:52:33.806372+0000","last_undegraded":"2024-05-30T16:52:33.806372+0000","last_fullsized":"2024-05-30T16:52:33.806372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838861053,"num_objects":203,"num_object_clones":1,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":1,"num_read":148,"num_read_kb":602113,"num_write":203,"num_write_kb":819202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.234180+0000","last_change":"2024-05-30T16:50:00.204452+0000","last_active":"2024-05-30T16:50:36.234180+0000","last_peered":"2024-05-30T16:50:36.234180+0000","last_clean":"2024-05-30T16:50:36.234180+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:50:36.234180+0000","last_undegraded":"2024-05-30T16:50:36.234180+0000","last_fullsized":"2024-05-30T16:50:36.234180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:54.227101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"74'208","reported_seq":399,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.792200+0000","last_change":"2024-05-30T16:50:01.214457+0000","last_active":"2024-05-30T16:52:33.792200+0000","last_peered":"2024-05-30T16:52:33.792200+0000","last_clean":"2024-05-30T16:52:33.792200+0000","last_became_active":"2024-05-30T16:50:01.214152+0000","last_became_peered":"2024-05-30T16:50:01.214152+0000","last_unstale":"2024-05-30T16:52:33.792200+0000","last_undegraded":"2024-05-30T16:52:33.792200+0000","last_fullsized":"2024-05-30T16:52:33.792200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:48.139986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860931,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":174,"num_read_kb":708609,"num_write":201,"num_write_kb":819201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.013730+0000","last_change":"2024-05-30T16:50:00.207741+0000","last_active":"2024-05-30T16:50:36.013730+0000","last_peered":"2024-05-30T16:50:36.013730+0000","last_clean":"2024-05-30T16:50:36.013730+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:50:36.013730+0000","last_undegraded":"2024-05-30T16:50:36.013730+0000","last_fullsized":"2024-05-30T16:50:36.013730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:44.907107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"74'212","reported_seq":474,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.803323+0000","last_change":"2024-05-30T16:50:01.214782+0000","last_active":"2024-05-30T16:52:33.803323+0000","last_peered":"2024-05-30T16:52:33.803323+0000","last_clean":"2024-05-30T16:52:33.803323+0000","last_became_active":"2024-05-30T16:50:01.214454+0000","last_became_peered":"2024-05-30T16:50:01.214454+0000","last_unstale":"2024-05-30T16:52:33.803323+0000","last_undegraded":"2024-05-30T16:52:33.803323+0000","last_fullsized":"2024-05-30T16:52:33.803323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443843,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":245,"num_read_kb":999425,"num_write":206,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860888+0000","last_change":"2024-05-30T16:50:00.213146+0000","last_active":"2024-05-30T16:50:35.860888+0000","last_peered":"2024-05-30T16:50:35.860888+0000","last_clean":"2024-05-30T16:50:35.860888+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:50:35.860888+0000","last_undegraded":"2024-05-30T16:50:35.860888+0000","last_fullsized":"2024-05-30T16:50:35.860888+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:47.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"74'241","reported_seq":483,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.778586+0000","last_change":"2024-05-30T16:50:01.210290+0000","last_active":"2024-05-30T16:52:33.778586+0000","last_peered":"2024-05-30T16:52:33.778586+0000","last_clean":"2024-05-30T16:52:33.778586+0000","last_became_active":"2024-05-30T16:50:01.209939+0000","last_became_peered":"2024-05-30T16:50:01.209939+0000","last_unstale":"2024-05-30T16:52:33.778586+0000","last_undegraded":"2024-05-30T16:52:33.778586+0000","last_fullsized":"2024-05-30T16:52:33.778586+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:20:05.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977272832,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":225,"num_read_kb":921600,"num_write":233,"num_write_kb":954368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"74'85","reported_seq":188,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:08.473941+0000","last_change":"2024-05-30T16:50:00.203989+0000","last_active":"2024-05-30T16:52:08.473941+0000","last_peered":"2024-05-30T16:52:08.473941+0000","last_clean":"2024-05-30T16:52:08.473941+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:52:08.473941+0000","last_undegraded":"2024-05-30T16:52:08.473941+0000","last_fullsized":"2024-05-30T16:52:08.473941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":84,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"74'219","reported_seq":464,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.790018+0000","last_change":"2024-05-30T16:50:01.212225+0000","last_active":"2024-05-30T16:52:33.790018+0000","last_peered":"2024-05-30T16:52:33.790018+0000","last_clean":"2024-05-30T16:52:33.790018+0000","last_became_active":"2024-05-30T16:50:01.211630+0000","last_became_peered":"2024-05-30T16:50:01.211630+0000","last_unstale":"2024-05-30T16:52:33.790018+0000","last_undegraded":"2024-05-30T16:52:33.790018+0000","last_fullsized":"2024-05-30T16:52:33.790018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":228,"num_read_kb":933888,"num_write":215,"num_write_kb":872449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860937+0000","last_change":"2024-05-30T16:50:00.210481+0000","last_active":"2024-05-30T16:50:35.860937+0000","last_peered":"2024-05-30T16:50:35.860937+0000","last_clean":"2024-05-30T16:50:35.860937+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:50:35.860937+0000","last_undegraded":"2024-05-30T16:50:35.860937+0000","last_fullsized":"2024-05-30T16:50:35.860937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:41:46.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"74'214","reported_seq":466,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:33.796850+0000","last_change":"2024-05-30T16:50:01.218627+0000","last_active":"2024-05-30T16:52:33.796850+0000","last_peered":"2024-05-30T16:52:33.796850+0000","last_clean":"2024-05-30T16:52:33.796850+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:52:33.796850+0000","last_undegraded":"2024-05-30T16:52:33.796850+0000","last_fullsized":"2024-05-30T16:52:33.796850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":235,"num_read_kb":962560,"num_write":203,"num_write_kb":831488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:46.304719+0000","last_change":"2024-05-30T16:50:00.210033+0000","last_active":"2024-05-30T16:50:46.304719+0000","last_peered":"2024-05-30T16:50:46.304719+0000","last_clean":"2024-05-30T16:50:46.304719+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:50:46.304719+0000","last_undegraded":"2024-05-30T16:50:46.304719+0000","last_fullsized":"2024-05-30T16:50:46.304719+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:15.927433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":272,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.857733+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:50:35.857733+0000","last_peered":"2024-05-30T16:50:35.857733+0000","last_clean":"2024-05-30T16:50:35.857733+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:50:35.857733+0000","last_undegraded":"2024-05-30T16:50:35.857733+0000","last_fullsized":"2024-05-30T16:50:35.857733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":53712261060,"num_objects":12829,"num_object_clones":1,"num_object_copies":25658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12829,"num_whiteouts":1,"num_read":12246,"num_read_kb":49496226,"num_write":13027,"num_write_kb":52453497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107424694272,"data_stored":107424522120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13549,"ondisk_log_size":13549,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4445403,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":1448,"num_write_kb":4940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8945664,"data_stored":8890806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1310,"ondisk_log_size":1310,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574985,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15419816,"kb_used_data":15312352,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":78952024,"statfs":{"total":96636764160,"available":80846872576,"internally_reserved":0,"allocated":15679848448,"data_stored":15679297903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17299224,"kb_used_data":17195920,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":77072616,"statfs":{"total":96636764160,"available":78922358784,"internally_reserved":0,"allocated":17608622080,"data_stored":17608075002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10652116,"kb_used_data":10589068,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":83719724,"statfs":{"total":96636764160,"available":85728997376,"internally_reserved":0,"allocated":10843205632,"data_stored":10842662378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11717364,"kb_used_data":11650156,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":82654476,"statfs":{"total":96636764160,"available":84638183424,"internally_reserved":0,"allocated":11929759744,"data_stored":11929235817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14352080,"kb_used_data":14226568,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":80019760,"statfs":{"total":96636764160,"available":81940234240,"internally_reserved":0,"allocated":14568005632,"data_stored":14567442776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16418644,"kb_used_data":16311180,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":77953196,"statfs":{"total":96636764160,"available":79824072704,"internally_reserved":0,"allocated":16702648320,"data_stored":16702105396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10801372,"kb_used_data":10711956,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":83570468,"statfs":{"total":96636764160,"available":85576159232,"internally_reserved":0,"allocated":10969042944,"data_stored":10968492566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574986,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8993872,"kb_used_data":8926664,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":85377968,"statfs":{"total":96636764160,"available":87427039232,"internally_reserved":0,"allocated":9140903936,"data_stored":9140365112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":237613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":249699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":12744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9139408896,"data_stored":9139389333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10963931136,"data_stored":10963911563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16697544704,"data_stored":16697525009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14566858752,"data_stored":14566819752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11928604672,"data_stored":11928600707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10842300416,"data_stored":10842276877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17607712768,"data_stored":17607689499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15678332928,"data_stored":15678309380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:52:56.894 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T16:52:56.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:52:57.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.137+0000 7f3a8a000640 1 Processor -- start 2024-05-30T16:52:57.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.138+0000 7f3a8a000640 1 -- start start 2024-05-30T16:52:57.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.139+0000 7f3a8a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a8413f760 0x7f3a8406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.139+0000 7f3a8a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a840cec70 0x7f3a840b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.139+0000 7f3a8a000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3a840b5e00 0x7f3a84142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.139+0000 7f3a8a000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3a841612b0 con 0x7f3a8413f760 2024-05-30T16:52:57.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.139+0000 7f3a8a000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3a8413fb40 con 0x7f3a840b5e00 2024-05-30T16:52:57.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.139+0000 7f3a8a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8406ee80 con 0x7f3a840cec70 2024-05-30T16:52:57.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a83400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a8413f760 0x7f3a8406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a83400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a8413f760 0x7f3a8406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47882/0 (socket says 172.21.15.144:47882) 2024-05-30T16:52:57.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a83400640 1 -- 172.21.15.144:0/1755622820 learned_addr learned my addr 172.21.15.144:0/1755622820 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:57.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a83e00640 1 --2- 172.21.15.144:0/1755622820 >> v2:172.21.15.149:3300/0 conn(0x7f3a840b5e00 0x7f3a84142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a7aa00640 1 --2- 172.21.15.144:0/1755622820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a840cec70 0x7f3a840b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a83400640 1 -- 172.21.15.144:0/1755622820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a840cec70 msgr2=0x7f3a840b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:57.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a83400640 1 --2- 172.21.15.144:0/1755622820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a840cec70 0x7f3a840b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a83400640 1 -- 172.21.15.144:0/1755622820 >> v2:172.21.15.149:3300/0 conn(0x7f3a840b5e00 msgr2=0x7f3a84142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:57.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a83400640 1 --2- 172.21.15.144:0/1755622820 >> v2:172.21.15.149:3300/0 conn(0x7f3a840b5e00 0x7f3a84142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.140+0000 7f3a83400640 1 -- 172.21.15.144:0/1755622820 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a84160730 con 0x7f3a8413f760 2024-05-30T16:52:57.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.142+0000 7f3a83400640 1 --2- 172.21.15.144:0/1755622820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a8413f760 0x7f3a8406e940 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f3a840cdfe0 tx=0x7f3a7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be888b66f2d0d167 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:57.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.142+0000 7f3a82a00640 1 -- 172.21.15.144:0/1755622820 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74037070 con 0x7f3a8413f760 2024-05-30T16:52:57.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.142+0000 7f3a82a00640 1 -- 172.21.15.144:0/1755622820 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a74032440 con 0x7f3a8413f760 2024-05-30T16:52:57.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.142+0000 7f3a82a00640 1 -- 172.21.15.144:0/1755622820 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74032810 con 0x7f3a8413f760 2024-05-30T16:52:57.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.143+0000 7f3a8a000640 1 -- 172.21.15.144:0/1755622820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a8413f760 msgr2=0x7f3a8406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.143+0000 7f3a8a000640 1 --2- 172.21.15.144:0/1755622820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a8413f760 0x7f3a8406e940 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f3a840cdfe0 tx=0x7f3a7402a270 comp rx=0 tx=0).stop 2024-05-30T16:52:57.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.143+0000 7f3a8a000640 1 -- 172.21.15.144:0/1755622820 shutdown_connections 2024-05-30T16:52:57.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.143+0000 7f3a8a000640 1 --2- 172.21.15.144:0/1755622820 >> v2:172.21.15.149:3300/0 conn(0x7f3a840b5e00 0x7f3a84142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.143+0000 7f3a8a000640 1 --2- 172.21.15.144:0/1755622820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a840cec70 0x7f3a840b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.143+0000 7f3a8a000640 1 --2- 172.21.15.144:0/1755622820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a8413f760 0x7f3a8406e940 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.143+0000 7f3a8a000640 1 -- 172.21.15.144:0/1755622820 >> 172.21.15.144:0/1755622820 conn(0x7f3a8406bd00 msgr2=0x7f3a8406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:57.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.143+0000 7f3a8a000640 1 -- 172.21.15.144:0/1755622820 shutdown_connections 2024-05-30T16:52:57.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.143+0000 7f3a8a000640 1 -- 172.21.15.144:0/1755622820 wait complete. 2024-05-30T16:52:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.145+0000 7f3a8a000640 1 Processor -- start 2024-05-30T16:52:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.145+0000 7f3a8a000640 1 -- start start 2024-05-30T16:52:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a8a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a840b5e00 0x7f3a84139e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a8a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840cec70 0x7f3a8415e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a8a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8413f760 0x7f3a8415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a8a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84160fd0 con 0x7f3a840b5e00 2024-05-30T16:52:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a8a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84160cf0 con 0x7f3a840cec70 2024-05-30T16:52:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a8a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3a840cf0d0 con 0x7f3a8413f760 2024-05-30T16:52:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a840b5e00 0x7f3a84139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a840b5e00 0x7f3a84139e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47888/0 (socket says 172.21.15.144:47888) 2024-05-30T16:52:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a83400640 1 -- 172.21.15.144:0/627573874 learned_addr learned my addr 172.21.15.144:0/627573874 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.146+0000 7f3a7aa00640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840cec70 0x7f3a8415e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a83400640 1 -- 172.21.15.144:0/627573874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8413f760 msgr2=0x7f3a8415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a83400640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8413f760 0x7f3a8415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a83400640 1 -- 172.21.15.144:0/627573874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840cec70 msgr2=0x7f3a8415e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a83400640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840cec70 0x7f3a8415e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a83400640 1 -- 172.21.15.144:0/627573874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a840b13f0 con 0x7f3a840b5e00 2024-05-30T16:52:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a83400640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a840b5e00 0x7f3a84139e00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3a7402a2b0 tx=0x7f3a740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a7be00640 1 -- 172.21.15.144:0/627573874 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74041020 con 0x7f3a840b5e00 2024-05-30T16:52:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a7be00640 1 -- 172.21.15.144:0/627573874 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a740306c0 con 0x7f3a840b5e00 2024-05-30T16:52:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8415f1c0 con 0x7f3a840b5e00 2024-05-30T16:52:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a7be00640 1 -- 172.21.15.144:0/627573874 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74037040 con 0x7f3a840b5e00 2024-05-30T16:52:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.147+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a840b1660 con 0x7f3a840b5e00 2024-05-30T16:52:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.149+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a840b4ac0 con 0x7f3a840b5e00 2024-05-30T16:52:57.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.150+0000 7f3a7be00640 1 -- 172.21.15.144:0/627573874 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f3a74044020 con 0x7f3a840b5e00 2024-05-30T16:52:57.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.150+0000 7f3a7be00640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3a6006d940 0x7f3a6006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.151+0000 7f3a7be00640 1 -- 172.21.15.144:0/627573874 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f3a740aaf20 con 0x7f3a840b5e00 2024-05-30T16:52:57.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.151+0000 7f3a7aa00640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3a6006d940 0x7f3a6006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.151+0000 7f3a7aa00640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3a6006d940 0x7f3a6006fe00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3a84141cc0 tx=0x7f3a6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:57.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.155+0000 7f3a7be00640 1 -- 172.21.15.144:0/627573874 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a840b4ac0 con 0x7f3a840b5e00 2024-05-30T16:52:57.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.381+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a84068b90 con 0x7f3a6006d940 2024-05-30T16:52:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.400+0000 7f3a7be00640 1 -- 172.21.15.144:0/627573874 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254939 (secure 0 0 0) 0x7f3a84068b90 con 0x7f3a6006d940 2024-05-30T16:52:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:57.407 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:52:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3a6006d940 msgr2=0x7f3a6006fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3a6006d940 0x7f3a6006fe00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3a84141cc0 tx=0x7f3a6c008040 comp rx=0 tx=0).stop 2024-05-30T16:52:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a840b5e00 msgr2=0x7f3a84139e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a840b5e00 0x7f3a84139e00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3a7402a2b0 tx=0x7f3a740046c0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 shutdown_connections 2024-05-30T16:52:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3a6006d940 0x7f3a6006fe00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8413f760 0x7f3a8415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840cec70 0x7f3a8415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 --2- 172.21.15.144:0/627573874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a840b5e00 0x7f3a84139e00 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 >> 172.21.15.144:0/627573874 conn(0x7f3a8406bd00 msgr2=0x7f3a8406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:57.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 shutdown_connections 2024-05-30T16:52:57.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.406+0000 7f3a8a000640 1 -- 172.21.15.144:0/627573874 wait complete. 2024-05-30T16:52:57.425 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-05-30T16:52:57.224703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53717297080,"num_objects":12855,"num_object_clones":1,"num_object_copies":25710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12855,"num_whiteouts":1,"num_read":12446,"num_read_kb":49496410,"num_write":14637,"num_write_kb":52460856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15479,"ondisk_log_size":15479,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":105654496,"kb_used_data":104923872,"kb_used_omap":12,"kb_used_meta":730547,"kb_avail":649320224,"statfs":{"total":773094113280,"available":664903909376,"internally_reserved":0,"allocated":107442044928,"data_stored":107437677448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":748080691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004593"},"pg_stats":[{"pgid":"11.3f","version":"74'205","reported_seq":441,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643367+0000","last_change":"2024-05-30T16:50:01.226270+0000","last_active":"2024-05-30T16:52:54.643367+0000","last_peered":"2024-05-30T16:52:54.643367+0000","last_clean":"2024-05-30T16:52:54.643367+0000","last_became_active":"2024-05-30T16:50:01.225529+0000","last_became_peered":"2024-05-30T16:50:01.225529+0000","last_unstale":"2024-05-30T16:52:54.643367+0000","last_undegraded":"2024-05-30T16:52:54.643367+0000","last_fullsized":"2024-05-30T16:52:54.643367+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":219,"num_read_kb":897024,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"74'212","reported_seq":436,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653849+0000","last_change":"2024-05-30T16:50:01.205668+0000","last_active":"2024-05-30T16:52:54.653849+0000","last_peered":"2024-05-30T16:52:54.653849+0000","last_clean":"2024-05-30T16:52:54.653849+0000","last_became_active":"2024-05-30T16:50:01.205240+0000","last_became_peered":"2024-05-30T16:50:01.205240+0000","last_unstale":"2024-05-30T16:52:54.653849+0000","last_undegraded":"2024-05-30T16:52:54.653849+0000","last_fullsized":"2024-05-30T16:52:54.653849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":207,"num_read_kb":847872,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"74'222","reported_seq":441,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.638430+0000","last_change":"2024-05-30T16:50:01.216644+0000","last_active":"2024-05-30T16:52:54.638430+0000","last_peered":"2024-05-30T16:52:54.638430+0000","last_clean":"2024-05-30T16:52:54.638430+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:52:54.638430+0000","last_undegraded":"2024-05-30T16:52:54.638430+0000","last_fullsized":"2024-05-30T16:52:54.638430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:16:38.132245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":202,"num_read_kb":806917,"num_write":210,"num_write_kb":827396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"74'214","reported_seq":356,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.650581+0000","last_change":"2024-05-30T16:50:01.208510+0000","last_active":"2024-05-30T16:52:54.650581+0000","last_peered":"2024-05-30T16:52:54.650581+0000","last_clean":"2024-05-30T16:52:54.650581+0000","last_became_active":"2024-05-30T16:50:01.207604+0000","last_became_peered":"2024-05-30T16:50:01.207604+0000","last_unstale":"2024-05-30T16:52:54.650581+0000","last_undegraded":"2024-05-30T16:52:54.650581+0000","last_fullsized":"2024-05-30T16:52:54.650581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:10.540613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830472192,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":125,"num_read_kb":512000,"num_write":198,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"74'211","reported_seq":349,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.639359+0000","last_change":"2024-05-30T16:50:01.220341+0000","last_active":"2024-05-30T16:52:54.639359+0000","last_peered":"2024-05-30T16:52:54.639359+0000","last_clean":"2024-05-30T16:52:54.639359+0000","last_became_active":"2024-05-30T16:50:01.219925+0000","last_became_peered":"2024-05-30T16:50:01.219925+0000","last_unstale":"2024-05-30T16:52:54.639359+0000","last_undegraded":"2024-05-30T16:52:54.639359+0000","last_fullsized":"2024-05-30T16:52:54.639359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:48.744105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":121,"num_read_kb":495616,"num_write":197,"num_write_kb":798721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"74'221","reported_seq":492,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.647814+0000","last_change":"2024-05-30T16:50:01.205902+0000","last_active":"2024-05-30T16:52:54.647814+0000","last_peered":"2024-05-30T16:52:54.647814+0000","last_clean":"2024-05-30T16:52:54.647814+0000","last_became_active":"2024-05-30T16:50:01.205620+0000","last_became_peered":"2024-05-30T16:50:01.205620+0000","last_unstale":"2024-05-30T16:52:54.647814+0000","last_undegraded":"2024-05-30T16:52:54.647814+0000","last_fullsized":"2024-05-30T16:52:54.647814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":254,"num_read_kb":1028099,"num_write":206,"num_write_kb":827394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"74'217","reported_seq":378,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653701+0000","last_change":"2024-05-30T16:50:01.221623+0000","last_active":"2024-05-30T16:52:54.653701+0000","last_peered":"2024-05-30T16:52:54.653701+0000","last_clean":"2024-05-30T16:52:54.653701+0000","last_became_active":"2024-05-30T16:50:01.215828+0000","last_became_peered":"2024-05-30T16:50:01.215828+0000","last_unstale":"2024-05-30T16:52:54.653701+0000","last_undegraded":"2024-05-30T16:52:54.653701+0000","last_fullsized":"2024-05-30T16:52:54.653701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":144,"num_read_kb":581634,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"74'201","reported_seq":379,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649111+0000","last_change":"2024-05-30T16:50:01.211114+0000","last_active":"2024-05-30T16:52:54.649111+0000","last_peered":"2024-05-30T16:52:54.649111+0000","last_clean":"2024-05-30T16:52:54.649111+0000","last_became_active":"2024-05-30T16:50:01.210863+0000","last_became_peered":"2024-05-30T16:50:01.210863+0000","last_unstale":"2024-05-30T16:52:54.649111+0000","last_undegraded":"2024-05-30T16:52:54.649111+0000","last_fullsized":"2024-05-30T16:52:54.649111+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:22.258204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":161,"num_read_kb":655361,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"74'225","reported_seq":409,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.641674+0000","last_change":"2024-05-30T16:50:01.214939+0000","last_active":"2024-05-30T16:52:54.641674+0000","last_peered":"2024-05-30T16:52:54.641674+0000","last_clean":"2024-05-30T16:52:54.641674+0000","last_became_active":"2024-05-30T16:50:01.214609+0000","last_became_peered":"2024-05-30T16:50:01.214609+0000","last_unstale":"2024-05-30T16:52:54.641674+0000","last_undegraded":"2024-05-30T16:52:54.641674+0000","last_fullsized":"2024-05-30T16:52:54.641674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:09.411468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":167,"num_read_kb":655367,"num_write":209,"num_write_kb":831491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"74'218","reported_seq":420,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655902+0000","last_change":"2024-05-30T16:50:01.217788+0000","last_active":"2024-05-30T16:52:54.655902+0000","last_peered":"2024-05-30T16:52:54.655902+0000","last_clean":"2024-05-30T16:52:54.655902+0000","last_became_active":"2024-05-30T16:50:01.217506+0000","last_became_peered":"2024-05-30T16:50:01.217506+0000","last_unstale":"2024-05-30T16:52:54.655902+0000","last_undegraded":"2024-05-30T16:52:54.655902+0000","last_fullsized":"2024-05-30T16:52:54.655902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":185,"num_read_kb":745475,"num_write":205,"num_write_kb":831489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"74'235","reported_seq":555,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.644214+0000","last_change":"2024-05-30T16:50:01.218948+0000","last_active":"2024-05-30T16:52:54.644214+0000","last_peered":"2024-05-30T16:52:54.644214+0000","last_clean":"2024-05-30T16:52:54.644214+0000","last_became_active":"2024-05-30T16:50:01.218645+0000","last_became_peered":"2024-05-30T16:50:01.218645+0000","last_unstale":"2024-05-30T16:52:54.644214+0000","last_undegraded":"2024-05-30T16:52:54.644214+0000","last_fullsized":"2024-05-30T16:52:54.644214+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:16.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":901775360,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":303,"num_read_kb":1212423,"num_write":221,"num_write_kb":880643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"74'194","reported_seq":494,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.620662+0000","last_change":"2024-05-30T16:50:01.217317+0000","last_active":"2024-05-30T16:52:54.620662+0000","last_peered":"2024-05-30T16:52:54.620662+0000","last_clean":"2024-05-30T16:52:54.620662+0000","last_became_active":"2024-05-30T16:50:01.217020+0000","last_became_peered":"2024-05-30T16:50:01.217020+0000","last_unstale":"2024-05-30T16:52:54.620662+0000","last_undegraded":"2024-05-30T16:52:54.620662+0000","last_fullsized":"2024-05-30T16:52:54.620662+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:31.180902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":763363328,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":283,"num_read_kb":1146883,"num_write":184,"num_write_kb":745473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"74'229","reported_seq":490,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.625153+0000","last_change":"2024-05-30T16:50:01.213490+0000","last_active":"2024-05-30T16:52:54.625153+0000","last_peered":"2024-05-30T16:52:54.625153+0000","last_clean":"2024-05-30T16:52:54.625153+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:52:54.625153+0000","last_undegraded":"2024-05-30T16:52:54.625153+0000","last_fullsized":"2024-05-30T16:52:54.625153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876609929,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":244,"num_read_kb":983044,"num_write":215,"num_write_kb":856068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"74'226","reported_seq":428,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.647608+0000","last_change":"2024-05-30T16:50:01.229142+0000","last_active":"2024-05-30T16:52:54.647608+0000","last_peered":"2024-05-30T16:52:54.647608+0000","last_clean":"2024-05-30T16:52:54.647608+0000","last_became_active":"2024-05-30T16:50:01.228163+0000","last_became_peered":"2024-05-30T16:50:01.228163+0000","last_unstale":"2024-05-30T16:52:54.647608+0000","last_undegraded":"2024-05-30T16:52:54.647608+0000","last_fullsized":"2024-05-30T16:52:54.647608+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:57:34.230448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998144,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":185,"num_read_kb":757760,"num_write":213,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"74'224","reported_seq":336,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.637711+0000","last_change":"2024-05-30T16:50:01.213697+0000","last_active":"2024-05-30T16:52:54.637711+0000","last_peered":"2024-05-30T16:52:54.637711+0000","last_clean":"2024-05-30T16:52:54.637711+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:52:54.637711+0000","last_undegraded":"2024-05-30T16:52:54.637711+0000","last_fullsized":"2024-05-30T16:52:54.637711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859832320,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":0,"num_read":95,"num_read_kb":368645,"num_write":209,"num_write_kb":839682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"74'232","reported_seq":412,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655905+0000","last_change":"2024-05-30T16:50:01.215568+0000","last_active":"2024-05-30T16:52:54.655905+0000","last_peered":"2024-05-30T16:52:54.655905+0000","last_clean":"2024-05-30T16:52:54.655905+0000","last_became_active":"2024-05-30T16:50:01.208926+0000","last_became_peered":"2024-05-30T16:50:01.208926+0000","last_unstale":"2024-05-30T16:52:54.655905+0000","last_undegraded":"2024-05-30T16:52:54.655905+0000","last_fullsized":"2024-05-30T16:52:54.655905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":163,"num_read_kb":651268,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"74'213","reported_seq":355,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.641495+0000","last_change":"2024-05-30T16:50:01.215004+0000","last_active":"2024-05-30T16:52:54.641495+0000","last_peered":"2024-05-30T16:52:54.641495+0000","last_clean":"2024-05-30T16:52:54.641495+0000","last_became_active":"2024-05-30T16:50:01.211267+0000","last_became_peered":"2024-05-30T16:50:01.211267+0000","last_unstale":"2024-05-30T16:52:54.641495+0000","last_undegraded":"2024-05-30T16:52:54.641495+0000","last_fullsized":"2024-05-30T16:52:54.641495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:43:11.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055366,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":125,"num_read_kb":503810,"num_write":203,"num_write_kb":823298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"74'222","reported_seq":522,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.631251+0000","last_change":"2024-05-30T16:50:36.531061+0000","last_active":"2024-05-30T16:52:54.631251+0000","last_peered":"2024-05-30T16:52:54.631251+0000","last_clean":"2024-05-30T16:52:54.631251+0000","last_became_active":"2024-05-30T16:50:36.235518+0000","last_became_peered":"2024-05-30T16:50:36.235518+0000","last_unstale":"2024-05-30T16:52:54.631251+0000","last_undegraded":"2024-05-30T16:52:54.631251+0000","last_fullsized":"2024-05-30T16:52:54.631251+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:21.431308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860932,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":260,"num_read_kb":1056770,"num_write":205,"num_write_kb":819203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"74'223","reported_seq":444,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.646760+0000","last_change":"2024-05-30T16:50:01.213913+0000","last_active":"2024-05-30T16:52:54.646760+0000","last_peered":"2024-05-30T16:52:54.646760+0000","last_clean":"2024-05-30T16:52:54.646760+0000","last_became_active":"2024-05-30T16:50:01.213651+0000","last_became_peered":"2024-05-30T16:50:01.213651+0000","last_unstale":"2024-05-30T16:52:54.646760+0000","last_undegraded":"2024-05-30T16:52:54.646760+0000","last_fullsized":"2024-05-30T16:52:54.646760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880803840,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":204,"num_read_kb":827394,"num_write":214,"num_write_kb":860162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"74'217","reported_seq":408,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.635155+0000","last_change":"2024-05-30T16:50:01.223666+0000","last_active":"2024-05-30T16:52:54.635155+0000","last_peered":"2024-05-30T16:52:54.635155+0000","last_clean":"2024-05-30T16:52:54.635155+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:52:54.635155+0000","last_undegraded":"2024-05-30T16:52:54.635155+0000","last_fullsized":"2024-05-30T16:52:54.635155+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918152,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"74'241","reported_seq":526,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655150+0000","last_change":"2024-05-30T16:50:01.209725+0000","last_active":"2024-05-30T16:52:54.655150+0000","last_peered":"2024-05-30T16:52:54.655150+0000","last_clean":"2024-05-30T16:52:54.655150+0000","last_became_active":"2024-05-30T16:50:01.209453+0000","last_became_peered":"2024-05-30T16:50:01.209453+0000","last_unstale":"2024-05-30T16:52:54.655150+0000","last_undegraded":"2024-05-30T16:52:54.655150+0000","last_fullsized":"2024-05-30T16:52:54.655150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":918552576,"num_objects":219,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":268,"num_read_kb":1081348,"num_write":225,"num_write_kb":897027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"74'229","reported_seq":428,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.656449+0000","last_change":"2024-05-30T16:50:01.217106+0000","last_active":"2024-05-30T16:52:54.656449+0000","last_peered":"2024-05-30T16:52:54.656449+0000","last_clean":"2024-05-30T16:52:54.656449+0000","last_became_active":"2024-05-30T16:50:01.216565+0000","last_became_peered":"2024-05-30T16:50:01.216565+0000","last_unstale":"2024-05-30T16:52:54.656449+0000","last_undegraded":"2024-05-30T16:52:54.656449+0000","last_fullsized":"2024-05-30T16:52:54.656449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415232,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":208,"num_whiteouts":0,"num_read":182,"num_read_kb":724997,"num_write":214,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"74'218","reported_seq":409,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.652563+0000","last_change":"2024-05-30T16:50:01.230645+0000","last_active":"2024-05-30T16:52:54.652563+0000","last_peered":"2024-05-30T16:52:54.652563+0000","last_clean":"2024-05-30T16:52:54.652563+0000","last_became_active":"2024-05-30T16:50:01.230326+0000","last_became_peered":"2024-05-30T16:50:01.230326+0000","last_unstale":"2024-05-30T16:52:54.652563+0000","last_undegraded":"2024-05-30T16:52:54.652563+0000","last_fullsized":"2024-05-30T16:52:54.652563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:34.972283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":805306368,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":786434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"74'210","reported_seq":387,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653554+0000","last_change":"2024-05-30T16:50:01.222411+0000","last_active":"2024-05-30T16:52:54.653554+0000","last_peered":"2024-05-30T16:52:54.653554+0000","last_clean":"2024-05-30T16:52:54.653554+0000","last_became_active":"2024-05-30T16:50:01.221747+0000","last_became_peered":"2024-05-30T16:50:01.221747+0000","last_unstale":"2024-05-30T16:52:54.653554+0000","last_undegraded":"2024-05-30T16:52:54.653554+0000","last_fullsized":"2024-05-30T16:52:54.653554+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:31:09.263732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":160,"num_read_kb":647170,"num_write":198,"num_write_kb":794626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"74'221","reported_seq":431,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655808+0000","last_change":"2024-05-30T16:50:01.225335+0000","last_active":"2024-05-30T16:52:54.655808+0000","last_peered":"2024-05-30T16:52:54.655808+0000","last_clean":"2024-05-30T16:52:54.655808+0000","last_became_active":"2024-05-30T16:50:01.224947+0000","last_became_peered":"2024-05-30T16:50:01.224947+0000","last_unstale":"2024-05-30T16:52:54.655808+0000","last_undegraded":"2024-05-30T16:52:54.655808+0000","last_fullsized":"2024-05-30T16:52:54.655808+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":193,"num_read_kb":778243,"num_write":201,"num_write_kb":798723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"74'210","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.652897+0000","last_change":"2024-05-30T16:50:01.223725+0000","last_active":"2024-05-30T16:52:54.652897+0000","last_peered":"2024-05-30T16:52:54.652897+0000","last_clean":"2024-05-30T16:52:54.652897+0000","last_became_active":"2024-05-30T16:50:01.223128+0000","last_became_peered":"2024-05-30T16:50:01.223128+0000","last_unstale":"2024-05-30T16:52:54.652897+0000","last_undegraded":"2024-05-30T16:52:54.652897+0000","last_fullsized":"2024-05-30T16:52:54.652897+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:16:28.027255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":199,"num_read_kb":815104,"num_write":189,"num_write_kb":774144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"74'214","reported_seq":432,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.629449+0000","last_change":"2024-05-30T16:50:01.221359+0000","last_active":"2024-05-30T16:52:54.629449+0000","last_peered":"2024-05-30T16:52:54.629449+0000","last_clean":"2024-05-30T16:52:54.629449+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:52:54.629449+0000","last_undegraded":"2024-05-30T16:52:54.629449+0000","last_fullsized":"2024-05-30T16:52:54.629449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":201,"num_read_kb":819201,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"74'190","reported_seq":302,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655706+0000","last_change":"2024-05-30T16:50:01.217815+0000","last_active":"2024-05-30T16:52:54.655706+0000","last_peered":"2024-05-30T16:52:54.655706+0000","last_clean":"2024-05-30T16:52:54.655706+0000","last_became_active":"2024-05-30T16:50:01.217568+0000","last_became_peered":"2024-05-30T16:50:01.217568+0000","last_unstale":"2024-05-30T16:52:54.655706+0000","last_undegraded":"2024-05-30T16:52:54.655706+0000","last_fullsized":"2024-05-30T16:52:54.655706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":759169024,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":95,"num_read_kb":389120,"num_write":183,"num_write_kb":741377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"74'244","reported_seq":474,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649466+0000","last_change":"2024-05-30T16:50:01.225500+0000","last_active":"2024-05-30T16:52:54.649466+0000","last_peered":"2024-05-30T16:52:54.649466+0000","last_clean":"2024-05-30T16:52:54.649466+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:52:54.649466+0000","last_undegraded":"2024-05-30T16:52:54.649466+0000","last_fullsized":"2024-05-30T16:52:54.649466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:58:24.044660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931135619,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":213,"num_read_kb":868353,"num_write":223,"num_write_kb":909313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"74'245","reported_seq":455,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653431+0000","last_change":"2024-05-30T16:50:01.227853+0000","last_active":"2024-05-30T16:52:54.653431+0000","last_peered":"2024-05-30T16:52:54.653431+0000","last_clean":"2024-05-30T16:52:54.653431+0000","last_became_active":"2024-05-30T16:50:01.227538+0000","last_became_peered":"2024-05-30T16:50:01.227538+0000","last_unstale":"2024-05-30T16:52:54.653431+0000","last_undegraded":"2024-05-30T16:52:54.653431+0000","last_fullsized":"2024-05-30T16:52:54.653431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910163968,"num_objects":217,"num_object_clones":0,"num_object_copies":434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":193,"num_read_kb":757768,"num_write":225,"num_write_kb":888836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"74'213","reported_seq":515,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653330+0000","last_change":"2024-05-30T16:50:01.216098+0000","last_active":"2024-05-30T16:52:54.653330+0000","last_peered":"2024-05-30T16:52:54.653330+0000","last_clean":"2024-05-30T16:52:54.653330+0000","last_became_active":"2024-05-30T16:50:01.215541+0000","last_became_peered":"2024-05-30T16:50:01.215541+0000","last_unstale":"2024-05-30T16:52:54.653330+0000","last_undegraded":"2024-05-30T16:52:54.653330+0000","last_fullsized":"2024-05-30T16:52:54.653330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":285,"num_read_kb":1150980,"num_write":192,"num_write_kb":770050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"74'219","reported_seq":450,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649407+0000","last_change":"2024-05-30T16:50:01.213699+0000","last_active":"2024-05-30T16:52:54.649407+0000","last_peered":"2024-05-30T16:52:54.649407+0000","last_clean":"2024-05-30T16:52:54.649407+0000","last_became_active":"2024-05-30T16:50:01.212747+0000","last_became_peered":"2024-05-30T16:50:01.212747+0000","last_unstale":"2024-05-30T16:52:54.649407+0000","last_undegraded":"2024-05-30T16:52:54.649407+0000","last_fullsized":"2024-05-30T16:52:54.649407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":214,"num_read_kb":876544,"num_write":201,"num_write_kb":823296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"74'207","reported_seq":352,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.639035+0000","last_change":"2024-05-30T16:50:01.222131+0000","last_active":"2024-05-30T16:52:54.639035+0000","last_peered":"2024-05-30T16:52:54.639035+0000","last_clean":"2024-05-30T16:52:54.639035+0000","last_became_active":"2024-05-30T16:50:01.221781+0000","last_became_peered":"2024-05-30T16:50:01.221781+0000","last_unstale":"2024-05-30T16:52:54.639035+0000","last_undegraded":"2024-05-30T16:52:54.639035+0000","last_fullsized":"2024-05-30T16:52:54.639035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:54.069608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826277888,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":197,"num_write_kb":806912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860237+0000","last_change":"2024-05-30T16:50:00.205578+0000","last_active":"2024-05-30T16:50:35.860237+0000","last_peered":"2024-05-30T16:50:35.860237+0000","last_clean":"2024-05-30T16:50:35.860237+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:50:35.860237+0000","last_undegraded":"2024-05-30T16:50:35.860237+0000","last_fullsized":"2024-05-30T16:50:35.860237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:09.041453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'223","reported_seq":445,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643785+0000","last_change":"2024-05-30T16:50:01.208407+0000","last_active":"2024-05-30T16:52:54.643785+0000","last_peered":"2024-05-30T16:52:54.643785+0000","last_clean":"2024-05-30T16:52:54.643785+0000","last_became_active":"2024-05-30T16:50:01.208076+0000","last_became_peered":"2024-05-30T16:50:01.208076+0000","last_unstale":"2024-05-30T16:52:54.643785+0000","last_undegraded":"2024-05-30T16:52:54.643785+0000","last_fullsized":"2024-05-30T16:52:54.643785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:07:06.445701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055496,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":205,"num_read_kb":827395,"num_write":205,"num_write_kb":823299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.234188+0000","last_change":"2024-05-30T16:50:00.198543+0000","last_active":"2024-05-30T16:50:36.234188+0000","last_peered":"2024-05-30T16:50:36.234188+0000","last_clean":"2024-05-30T16:50:36.234188+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:50:36.234188+0000","last_undegraded":"2024-05-30T16:50:36.234188+0000","last_fullsized":"2024-05-30T16:50:36.234188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:06.670117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"74'235","reported_seq":458,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.648963+0000","last_change":"2024-05-30T16:50:01.223695+0000","last_active":"2024-05-30T16:52:54.648963+0000","last_peered":"2024-05-30T16:52:54.648963+0000","last_clean":"2024-05-30T16:52:54.648963+0000","last_became_active":"2024-05-30T16:50:01.223375+0000","last_became_peered":"2024-05-30T16:50:01.223375+0000","last_unstale":"2024-05-30T16:52:54.648963+0000","last_undegraded":"2024-05-30T16:52:54.648963+0000","last_fullsized":"2024-05-30T16:52:54.648963+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192709,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":206,"num_read_kb":827396,"num_write":219,"num_write_kb":868356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:00.681206+0000","last_change":"2024-05-30T16:50:00.212444+0000","last_active":"2024-05-30T16:52:00.681206+0000","last_peered":"2024-05-30T16:52:00.681206+0000","last_clean":"2024-05-30T16:52:00.681206+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:52:00.681206+0000","last_undegraded":"2024-05-30T16:52:00.681206+0000","last_fullsized":"2024-05-30T16:52:00.681206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'238","reported_seq":509,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.644158+0000","last_change":"2024-05-30T16:50:01.219674+0000","last_active":"2024-05-30T16:52:54.644158+0000","last_peered":"2024-05-30T16:52:54.644158+0000","last_clean":"2024-05-30T16:52:54.644158+0000","last_became_active":"2024-05-30T16:50:01.219382+0000","last_became_peered":"2024-05-30T16:50:01.219382+0000","last_unstale":"2024-05-30T16:52:54.644158+0000","last_undegraded":"2024-05-30T16:52:54.644158+0000","last_fullsized":"2024-05-30T16:52:54.644158+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922746880,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":254,"num_read_kb":1040384,"num_write":220,"num_write_kb":901120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863492+0000","last_change":"2024-05-30T16:50:00.210174+0000","last_active":"2024-05-30T16:50:35.863492+0000","last_peered":"2024-05-30T16:50:35.863492+0000","last_clean":"2024-05-30T16:50:35.863492+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:50:35.863492+0000","last_undegraded":"2024-05-30T16:50:35.863492+0000","last_fullsized":"2024-05-30T16:50:35.863492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"74'205","reported_seq":390,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649988+0000","last_change":"2024-05-30T16:50:01.228355+0000","last_active":"2024-05-30T16:52:54.649988+0000","last_peered":"2024-05-30T16:52:54.649988+0000","last_clean":"2024-05-30T16:52:54.649988+0000","last_became_active":"2024-05-30T16:50:01.225437+0000","last_became_peered":"2024-05-30T16:50:01.225437+0000","last_unstale":"2024-05-30T16:52:54.649988+0000","last_undegraded":"2024-05-30T16:52:54.649988+0000","last_fullsized":"2024-05-30T16:52:54.649988+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529413,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":168,"num_read_kb":684033,"num_write":189,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'50","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.583754+0000","last_change":"2024-05-30T16:50:00.205334+0000","last_active":"2024-05-30T16:52:54.583754+0000","last_peered":"2024-05-30T16:52:54.583754+0000","last_clean":"2024-05-30T16:52:54.583754+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:52:54.583754+0000","last_undegraded":"2024-05-30T16:52:54.583754+0000","last_fullsized":"2024-05-30T16:52:54.583754+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:53.442543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":237750,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"74'225","reported_seq":510,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655822+0000","last_change":"2024-05-30T16:50:01.213565+0000","last_active":"2024-05-30T16:52:54.655822+0000","last_peered":"2024-05-30T16:52:54.655822+0000","last_clean":"2024-05-30T16:52:54.655822+0000","last_became_active":"2024-05-30T16:50:01.213263+0000","last_became_peered":"2024-05-30T16:50:01.213263+0000","last_unstale":"2024-05-30T16:52:54.655822+0000","last_undegraded":"2024-05-30T16:52:54.655822+0000","last_fullsized":"2024-05-30T16:52:54.655822+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":268,"num_read_kb":1089538,"num_write":204,"num_write_kb":827393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864517+0000","last_change":"2024-05-30T16:50:00.205241+0000","last_active":"2024-05-30T16:50:35.864517+0000","last_peered":"2024-05-30T16:50:35.864517+0000","last_clean":"2024-05-30T16:50:35.864517+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:50:35.864517+0000","last_undegraded":"2024-05-30T16:50:35.864517+0000","last_fullsized":"2024-05-30T16:50:35.864517+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:11.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"74'205","reported_seq":433,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.651369+0000","last_change":"2024-05-30T16:50:01.217809+0000","last_active":"2024-05-30T16:52:54.651369+0000","last_peered":"2024-05-30T16:52:54.651369+0000","last_clean":"2024-05-30T16:52:54.651369+0000","last_became_active":"2024-05-30T16:50:01.209406+0000","last_became_peered":"2024-05-30T16:50:01.209406+0000","last_unstale":"2024-05-30T16:52:54.651369+0000","last_undegraded":"2024-05-30T16:52:54.651369+0000","last_fullsized":"2024-05-30T16:52:54.651369+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:03:15.778017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":211,"num_read_kb":856066,"num_write":191,"num_write_kb":774145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860895+0000","last_change":"2024-05-30T16:50:00.213769+0000","last_active":"2024-05-30T16:50:35.860895+0000","last_peered":"2024-05-30T16:50:35.860895+0000","last_clean":"2024-05-30T16:50:35.860895+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:50:35.860895+0000","last_undegraded":"2024-05-30T16:50:35.860895+0000","last_fullsized":"2024-05-30T16:50:35.860895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:25.844328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"74'209","reported_seq":419,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.640752+0000","last_change":"2024-05-30T16:50:01.214317+0000","last_active":"2024-05-30T16:52:54.640752+0000","last_peered":"2024-05-30T16:52:54.640752+0000","last_clean":"2024-05-30T16:52:54.640752+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:52:54.640752+0000","last_undegraded":"2024-05-30T16:52:54.640752+0000","last_fullsized":"2024-05-30T16:52:54.640752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":738197504,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":193,"num_read_kb":753673,"num_write":186,"num_write_kb":720901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.013341+0000","last_change":"2024-05-30T16:50:00.203638+0000","last_active":"2024-05-30T16:50:36.013341+0000","last_peered":"2024-05-30T16:50:36.013341+0000","last_clean":"2024-05-30T16:50:36.013341+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:50:36.013341+0000","last_undegraded":"2024-05-30T16:50:36.013341+0000","last_fullsized":"2024-05-30T16:50:36.013341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:42:02.981126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"74'210","reported_seq":340,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.650421+0000","last_change":"2024-05-30T16:50:01.223933+0000","last_active":"2024-05-30T16:52:54.650421+0000","last_peered":"2024-05-30T16:52:54.650421+0000","last_clean":"2024-05-30T16:52:54.650421+0000","last_became_active":"2024-05-30T16:50:01.223472+0000","last_became_peered":"2024-05-30T16:50:01.223472+0000","last_unstale":"2024-05-30T16:52:54.650421+0000","last_undegraded":"2024-05-30T16:52:54.650421+0000","last_fullsized":"2024-05-30T16:52:54.650421+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":113,"num_read_kb":446468,"num_write":189,"num_write_kb":757762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:46.307950+0000","last_change":"2024-05-30T16:50:00.206844+0000","last_active":"2024-05-30T16:50:46.307950+0000","last_peered":"2024-05-30T16:50:46.307950+0000","last_clean":"2024-05-30T16:50:46.307950+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:50:46.307950+0000","last_undegraded":"2024-05-30T16:50:46.307950+0000","last_fullsized":"2024-05-30T16:50:46.307950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:52.154456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"74'189","reported_seq":341,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643168+0000","last_change":"2024-05-30T16:50:36.658725+0000","last_active":"2024-05-30T16:52:54.643168+0000","last_peered":"2024-05-30T16:52:54.643168+0000","last_clean":"2024-05-30T16:52:54.643168+0000","last_became_active":"2024-05-30T16:50:36.236903+0000","last_became_peered":"2024-05-30T16:50:36.236903+0000","last_unstale":"2024-05-30T16:52:54.643168+0000","last_undegraded":"2024-05-30T16:52:54.643168+0000","last_fullsized":"2024-05-30T16:52:54.643168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:48.423179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721420288,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":120,"num_read_kb":483330,"num_write":174,"num_write_kb":704513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863781+0000","last_change":"2024-05-30T16:50:00.210985+0000","last_active":"2024-05-30T16:50:35.863781+0000","last_peered":"2024-05-30T16:50:35.863781+0000","last_clean":"2024-05-30T16:50:35.863781+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:50:35.863781+0000","last_undegraded":"2024-05-30T16:50:35.863781+0000","last_fullsized":"2024-05-30T16:50:35.863781+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"74'215","reported_seq":465,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.651496+0000","last_change":"2024-05-30T16:50:01.205452+0000","last_active":"2024-05-30T16:52:54.651496+0000","last_peered":"2024-05-30T16:52:54.651496+0000","last_clean":"2024-05-30T16:52:54.651496+0000","last_became_active":"2024-05-30T16:50:01.205079+0000","last_became_peered":"2024-05-30T16:50:01.205079+0000","last_unstale":"2024-05-30T16:52:54.651496+0000","last_undegraded":"2024-05-30T16:52:54.651496+0000","last_fullsized":"2024-05-30T16:52:54.651496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834666496,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":233,"num_read_kb":946178,"num_write":201,"num_write_kb":815105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'55","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:08.483506+0000","last_change":"2024-05-30T16:50:00.206599+0000","last_active":"2024-05-30T16:52:08.483506+0000","last_peered":"2024-05-30T16:52:08.483506+0000","last_clean":"2024-05-30T16:52:08.483506+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:52:08.483506+0000","last_undegraded":"2024-05-30T16:52:08.483506+0000","last_fullsized":"2024-05-30T16:52:08.483506+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:53:50.078170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'213","reported_seq":414,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.625790+0000","last_change":"2024-05-30T16:50:01.217111+0000","last_active":"2024-05-30T16:52:54.625790+0000","last_peered":"2024-05-30T16:52:54.625790+0000","last_clean":"2024-05-30T16:52:54.625790+0000","last_became_active":"2024-05-30T16:50:01.216841+0000","last_became_peered":"2024-05-30T16:50:01.216841+0000","last_unstale":"2024-05-30T16:52:54.625790+0000","last_undegraded":"2024-05-30T16:52:54.625790+0000","last_fullsized":"2024-05-30T16:52:54.625790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:49.210751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":184,"num_read_kb":737284,"num_write":200,"num_write_kb":794627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'1001","reported_seq":1020,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:26.755019+0000","last_change":"2024-05-30T16:50:00.208913+0000","last_active":"2024-05-30T16:52:26.755019+0000","last_peered":"2024-05-30T16:52:26.755019+0000","last_clean":"2024-05-30T16:52:26.755019+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:52:26.755019+0000","last_undegraded":"2024-05-30T16:52:26.755019+0000","last_fullsized":"2024-05-30T16:52:26.755019+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1001,"log_dups_size":0,"ondisk_log_size":1001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:46:48.195369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":4470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"74'211","reported_seq":383,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.639576+0000","last_change":"2024-05-30T16:50:01.218900+0000","last_active":"2024-05-30T16:52:54.639576+0000","last_peered":"2024-05-30T16:52:54.639576+0000","last_clean":"2024-05-30T16:52:54.639576+0000","last_became_active":"2024-05-30T16:50:01.218601+0000","last_became_peered":"2024-05-30T16:50:01.218601+0000","last_unstale":"2024-05-30T16:52:54.639576+0000","last_undegraded":"2024-05-30T16:52:54.639576+0000","last_fullsized":"2024-05-30T16:52:54.639576+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:30.501139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":155,"num_read_kb":626690,"num_write":195,"num_write_kb":790529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860908+0000","last_change":"2024-05-30T16:50:00.207072+0000","last_active":"2024-05-30T16:50:35.860908+0000","last_peered":"2024-05-30T16:50:35.860908+0000","last_clean":"2024-05-30T16:50:35.860908+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:50:35.860908+0000","last_undegraded":"2024-05-30T16:50:35.860908+0000","last_fullsized":"2024-05-30T16:50:35.860908+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:48:08.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"74'233","reported_seq":401,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.631940+0000","last_change":"2024-05-30T16:50:01.223569+0000","last_active":"2024-05-30T16:52:54.631940+0000","last_peered":"2024-05-30T16:52:54.631940+0000","last_clean":"2024-05-30T16:52:54.631940+0000","last_became_active":"2024-05-30T16:50:01.223101+0000","last_became_peered":"2024-05-30T16:50:01.223101+0000","last_unstale":"2024-05-30T16:52:54.631940+0000","last_undegraded":"2024-05-30T16:52:54.631940+0000","last_fullsized":"2024-05-30T16:52:54.631940+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:15.642014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":151,"num_read_kb":610306,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864714+0000","last_change":"2024-05-30T16:50:00.205457+0000","last_active":"2024-05-30T16:50:35.864714+0000","last_peered":"2024-05-30T16:50:35.864714+0000","last_clean":"2024-05-30T16:50:35.864714+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:50:35.864714+0000","last_undegraded":"2024-05-30T16:50:35.864714+0000","last_fullsized":"2024-05-30T16:50:35.864714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:09.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'197","reported_seq":387,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.647706+0000","last_change":"2024-05-30T16:50:01.212311+0000","last_active":"2024-05-30T16:52:54.647706+0000","last_peered":"2024-05-30T16:52:54.647706+0000","last_clean":"2024-05-30T16:52:54.647706+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:52:54.647706+0000","last_undegraded":"2024-05-30T16:52:54.647706+0000","last_fullsized":"2024-05-30T16:52:54.647706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":185,"num_write_kb":757760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.009845+0000","last_change":"2024-05-30T16:50:00.208941+0000","last_active":"2024-05-30T16:50:36.009845+0000","last_peered":"2024-05-30T16:50:36.009845+0000","last_clean":"2024-05-30T16:50:36.009845+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:50:36.009845+0000","last_undegraded":"2024-05-30T16:50:36.009845+0000","last_fullsized":"2024-05-30T16:50:36.009845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:04.700068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"74'230","reported_seq":443,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.637397+0000","last_change":"2024-05-30T16:50:01.208878+0000","last_active":"2024-05-30T16:52:54.637397+0000","last_peered":"2024-05-30T16:52:54.637397+0000","last_clean":"2024-05-30T16:52:54.637397+0000","last_became_active":"2024-05-30T16:50:01.207140+0000","last_became_peered":"2024-05-30T16:50:01.207140+0000","last_unstale":"2024-05-30T16:52:54.637397+0000","last_undegraded":"2024-05-30T16:52:54.637397+0000","last_fullsized":"2024-05-30T16:52:54.637397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:26.859710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":196,"num_read_kb":782341,"num_write":217,"num_write_kb":872450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.861982+0000","last_change":"2024-05-30T16:50:00.196832+0000","last_active":"2024-05-30T16:50:35.861982+0000","last_peered":"2024-05-30T16:50:35.861982+0000","last_clean":"2024-05-30T16:50:35.861982+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:50:35.861982+0000","last_undegraded":"2024-05-30T16:50:35.861982+0000","last_fullsized":"2024-05-30T16:50:35.861982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"74'226","reported_seq":315,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.654893+0000","last_change":"2024-05-30T16:50:01.215257+0000","last_active":"2024-05-30T16:52:54.654893+0000","last_peered":"2024-05-30T16:52:54.654893+0000","last_clean":"2024-05-30T16:52:54.654893+0000","last_became_active":"2024-05-30T16:50:01.214868+0000","last_became_peered":"2024-05-30T16:50:01.214868+0000","last_unstale":"2024-05-30T16:52:54.654893+0000","last_undegraded":"2024-05-30T16:52:54.654893+0000","last_fullsized":"2024-05-30T16:52:54.654893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998275,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":72,"num_read_kb":290817,"num_write":212,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.862616+0000","last_change":"2024-05-30T16:50:00.206888+0000","last_active":"2024-05-30T16:50:35.862616+0000","last_peered":"2024-05-30T16:50:35.862616+0000","last_clean":"2024-05-30T16:50:35.862616+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:50:35.862616+0000","last_undegraded":"2024-05-30T16:50:35.862616+0000","last_fullsized":"2024-05-30T16:50:35.862616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:30.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"74'229","reported_seq":480,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643484+0000","last_change":"2024-05-30T16:50:01.226504+0000","last_active":"2024-05-30T16:52:54.643484+0000","last_peered":"2024-05-30T16:52:54.643484+0000","last_clean":"2024-05-30T16:52:54.643484+0000","last_became_active":"2024-05-30T16:50:01.225825+0000","last_became_peered":"2024-05-30T16:50:01.225825+0000","last_unstale":"2024-05-30T16:52:54.643484+0000","last_undegraded":"2024-05-30T16:52:54.643484+0000","last_fullsized":"2024-05-30T16:52:54.643484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415354,"num_objects":209,"num_object_clones":0,"num_object_copies":418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":234,"num_read_kb":942084,"num_write":213,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863565+0000","last_change":"2024-05-30T16:50:00.201506+0000","last_active":"2024-05-30T16:50:35.863565+0000","last_peered":"2024-05-30T16:50:35.863565+0000","last_clean":"2024-05-30T16:50:35.863565+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:50:35.863565+0000","last_undegraded":"2024-05-30T16:50:35.863565+0000","last_fullsized":"2024-05-30T16:50:35.863565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:47.529393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"74'238","reported_seq":431,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.620891+0000","last_change":"2024-05-30T16:50:01.218092+0000","last_active":"2024-05-30T16:52:54.620891+0000","last_peered":"2024-05-30T16:52:54.620891+0000","last_clean":"2024-05-30T16:52:54.620891+0000","last_became_active":"2024-05-30T16:50:01.217748+0000","last_became_peered":"2024-05-30T16:50:01.217748+0000","last_unstale":"2024-05-30T16:52:54.620891+0000","last_undegraded":"2024-05-30T16:52:54.620891+0000","last_fullsized":"2024-05-30T16:52:54.620891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:12.631874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855638016,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":176,"num_read_kb":679946,"num_write":218,"num_write_kb":835591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863640+0000","last_change":"2024-05-30T16:50:00.201874+0000","last_active":"2024-05-30T16:50:35.863640+0000","last_peered":"2024-05-30T16:50:35.863640+0000","last_clean":"2024-05-30T16:50:35.863640+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:50:35.863640+0000","last_undegraded":"2024-05-30T16:50:35.863640+0000","last_fullsized":"2024-05-30T16:50:35.863640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"74'238","reported_seq":486,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.651877+0000","last_change":"2024-05-30T16:50:01.216958+0000","last_active":"2024-05-30T16:52:54.651877+0000","last_peered":"2024-05-30T16:52:54.651877+0000","last_clean":"2024-05-30T16:52:54.651877+0000","last_became_active":"2024-05-30T16:50:01.216443+0000","last_became_peered":"2024-05-30T16:50:01.216443+0000","last_unstale":"2024-05-30T16:52:54.651877+0000","last_undegraded":"2024-05-30T16:52:54.651877+0000","last_fullsized":"2024-05-30T16:52:54.651877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:13:56.465266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":926941184,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":231,"num_read_kb":933891,"num_write":223,"num_write_kb":905217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.858053+0000","last_change":"2024-05-30T16:50:00.202315+0000","last_active":"2024-05-30T16:50:35.858053+0000","last_peered":"2024-05-30T16:50:35.858053+0000","last_clean":"2024-05-30T16:50:35.858053+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:50:35.858053+0000","last_undegraded":"2024-05-30T16:50:35.858053+0000","last_fullsized":"2024-05-30T16:50:35.858053+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:07.542490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'212","reported_seq":409,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.631855+0000","last_change":"2024-05-30T16:50:01.217916+0000","last_active":"2024-05-30T16:52:54.631855+0000","last_peered":"2024-05-30T16:52:54.631855+0000","last_clean":"2024-05-30T16:52:54.631855+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:52:54.631855+0000","last_undegraded":"2024-05-30T16:52:54.631855+0000","last_fullsized":"2024-05-30T16:52:54.631855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809501194,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":180,"num_read_kb":724995,"num_write":197,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864794+0000","last_change":"2024-05-30T16:50:00.204870+0000","last_active":"2024-05-30T16:50:35.864794+0000","last_peered":"2024-05-30T16:50:35.864794+0000","last_clean":"2024-05-30T16:50:35.864794+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:50:35.864794+0000","last_undegraded":"2024-05-30T16:50:35.864794+0000","last_fullsized":"2024-05-30T16:50:35.864794+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:08.366805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"74'216","reported_seq":364,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.651372+0000","last_change":"2024-05-30T16:50:01.219838+0000","last_active":"2024-05-30T16:52:54.651372+0000","last_peered":"2024-05-30T16:52:54.651372+0000","last_clean":"2024-05-30T16:52:54.651372+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:52:54.651372+0000","last_undegraded":"2024-05-30T16:52:54.651372+0000","last_fullsized":"2024-05-30T16:52:54.651372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801112325,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":131,"num_read_kb":532481,"num_write":194,"num_write_kb":782338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.010153+0000","last_change":"2024-05-30T16:50:00.207506+0000","last_active":"2024-05-30T16:50:36.010153+0000","last_peered":"2024-05-30T16:50:36.010153+0000","last_clean":"2024-05-30T16:50:36.010153+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:50:36.010153+0000","last_undegraded":"2024-05-30T16:50:36.010153+0000","last_fullsized":"2024-05-30T16:50:36.010153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:47.941977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"74'215","reported_seq":411,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649732+0000","last_change":"2024-05-30T16:50:01.220513+0000","last_active":"2024-05-30T16:52:54.649732+0000","last_peered":"2024-05-30T16:52:54.649732+0000","last_clean":"2024-05-30T16:52:54.649732+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:52:54.649732+0000","last_undegraded":"2024-05-30T16:52:54.649732+0000","last_fullsized":"2024-05-30T16:52:54.649732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:08:23.546971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":179,"num_read_kb":716804,"num_write":199,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.233669+0000","last_change":"2024-05-30T16:50:00.199775+0000","last_active":"2024-05-30T16:50:36.233669+0000","last_peered":"2024-05-30T16:50:36.233669+0000","last_clean":"2024-05-30T16:50:36.233669+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:50:36.233669+0000","last_undegraded":"2024-05-30T16:50:36.233669+0000","last_fullsized":"2024-05-30T16:50:36.233669+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:11.926104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"74'223","reported_seq":353,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.624529+0000","last_change":"2024-05-30T16:50:01.212934+0000","last_active":"2024-05-30T16:52:54.624529+0000","last_peered":"2024-05-30T16:52:54.624529+0000","last_clean":"2024-05-30T16:52:54.624529+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:52:54.624529+0000","last_undegraded":"2024-05-30T16:52:54.624529+0000","last_fullsized":"2024-05-30T16:52:54.624529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":113,"num_read_kb":454658,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.862881+0000","last_change":"2024-05-30T16:50:00.206485+0000","last_active":"2024-05-30T16:50:35.862881+0000","last_peered":"2024-05-30T16:50:35.862881+0000","last_clean":"2024-05-30T16:50:35.862881+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:50:35.862881+0000","last_undegraded":"2024-05-30T16:50:35.862881+0000","last_fullsized":"2024-05-30T16:50:35.862881+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:46.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"74'226","reported_seq":487,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.647112+0000","last_change":"2024-05-30T16:50:01.225452+0000","last_active":"2024-05-30T16:52:54.647112+0000","last_peered":"2024-05-30T16:52:54.647112+0000","last_clean":"2024-05-30T16:52:54.647112+0000","last_became_active":"2024-05-30T16:50:01.224834+0000","last_became_peered":"2024-05-30T16:50:01.224834+0000","last_unstale":"2024-05-30T16:52:54.647112+0000","last_undegraded":"2024-05-30T16:52:54.647112+0000","last_fullsized":"2024-05-30T16:52:54.647112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":244,"num_read_kb":999424,"num_write":207,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"74'90","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:09.319052+0000","last_change":"2024-05-30T16:50:00.209889+0000","last_active":"2024-05-30T16:52:09.319052+0000","last_peered":"2024-05-30T16:52:09.319052+0000","last_clean":"2024-05-30T16:52:09.319052+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:52:09.319052+0000","last_undegraded":"2024-05-30T16:52:09.319052+0000","last_fullsized":"2024-05-30T16:52:09.319052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:00.581262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"74'215","reported_seq":507,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649970+0000","last_change":"2024-05-30T16:50:01.222012+0000","last_active":"2024-05-30T16:52:54.649970+0000","last_peered":"2024-05-30T16:52:54.649970+0000","last_clean":"2024-05-30T16:52:54.649970+0000","last_became_active":"2024-05-30T16:50:01.221622+0000","last_became_peered":"2024-05-30T16:50:01.221622+0000","last_unstale":"2024-05-30T16:52:54.649970+0000","last_undegraded":"2024-05-30T16:52:54.649970+0000","last_fullsized":"2024-05-30T16:52:54.649970+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:43.760509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918021,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":275,"num_read_kb":1114115,"num_write":197,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.013901+0000","last_change":"2024-05-30T16:50:00.202834+0000","last_active":"2024-05-30T16:50:36.013901+0000","last_peered":"2024-05-30T16:50:36.013901+0000","last_clean":"2024-05-30T16:50:36.013901+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:50:36.013901+0000","last_undegraded":"2024-05-30T16:50:36.013901+0000","last_fullsized":"2024-05-30T16:50:36.013901+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:19:37.632432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"74'221","reported_seq":385,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.654467+0000","last_change":"2024-05-30T16:50:01.224914+0000","last_active":"2024-05-30T16:52:54.654467+0000","last_peered":"2024-05-30T16:52:54.654467+0000","last_clean":"2024-05-30T16:52:54.654467+0000","last_became_active":"2024-05-30T16:50:01.224600+0000","last_became_peered":"2024-05-30T16:50:01.224600+0000","last_unstale":"2024-05-30T16:52:54.654467+0000","last_undegraded":"2024-05-30T16:52:54.654467+0000","last_fullsized":"2024-05-30T16:52:54.654467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838861053,"num_objects":203,"num_object_clones":1,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":1,"num_read":148,"num_read_kb":602113,"num_write":203,"num_write_kb":819202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.234180+0000","last_change":"2024-05-30T16:50:00.204452+0000","last_active":"2024-05-30T16:50:36.234180+0000","last_peered":"2024-05-30T16:50:36.234180+0000","last_clean":"2024-05-30T16:50:36.234180+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:50:36.234180+0000","last_undegraded":"2024-05-30T16:50:36.234180+0000","last_fullsized":"2024-05-30T16:50:36.234180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:54.227101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"74'220","reported_seq":411,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.635386+0000","last_change":"2024-05-30T16:50:01.214457+0000","last_active":"2024-05-30T16:52:54.635386+0000","last_peered":"2024-05-30T16:52:54.635386+0000","last_clean":"2024-05-30T16:52:54.635386+0000","last_became_active":"2024-05-30T16:50:01.214152+0000","last_became_peered":"2024-05-30T16:50:01.214152+0000","last_unstale":"2024-05-30T16:52:54.635386+0000","last_undegraded":"2024-05-30T16:52:54.635386+0000","last_fullsized":"2024-05-30T16:52:54.635386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:48.139986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860931,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":174,"num_read_kb":708609,"num_write":201,"num_write_kb":819201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.013730+0000","last_change":"2024-05-30T16:50:00.207741+0000","last_active":"2024-05-30T16:50:36.013730+0000","last_peered":"2024-05-30T16:50:36.013730+0000","last_clean":"2024-05-30T16:50:36.013730+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:50:36.013730+0000","last_undegraded":"2024-05-30T16:50:36.013730+0000","last_fullsized":"2024-05-30T16:50:36.013730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:20:44.907107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"74'220","reported_seq":482,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.648837+0000","last_change":"2024-05-30T16:50:01.214782+0000","last_active":"2024-05-30T16:52:54.648837+0000","last_peered":"2024-05-30T16:52:54.648837+0000","last_clean":"2024-05-30T16:52:54.648837+0000","last_became_active":"2024-05-30T16:50:01.214454+0000","last_became_peered":"2024-05-30T16:50:01.214454+0000","last_unstale":"2024-05-30T16:52:54.648837+0000","last_undegraded":"2024-05-30T16:52:54.648837+0000","last_fullsized":"2024-05-30T16:52:54.648837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443843,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":245,"num_read_kb":999425,"num_write":206,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860888+0000","last_change":"2024-05-30T16:50:00.213146+0000","last_active":"2024-05-30T16:50:35.860888+0000","last_peered":"2024-05-30T16:50:35.860888+0000","last_clean":"2024-05-30T16:50:35.860888+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:50:35.860888+0000","last_undegraded":"2024-05-30T16:50:35.860888+0000","last_fullsized":"2024-05-30T16:50:35.860888+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:47:47.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"74'246","reported_seq":488,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.635214+0000","last_change":"2024-05-30T16:50:01.210290+0000","last_active":"2024-05-30T16:52:54.635214+0000","last_peered":"2024-05-30T16:52:54.635214+0000","last_clean":"2024-05-30T16:52:54.635214+0000","last_became_active":"2024-05-30T16:50:01.209939+0000","last_became_peered":"2024-05-30T16:50:01.209939+0000","last_unstale":"2024-05-30T16:52:54.635214+0000","last_undegraded":"2024-05-30T16:52:54.635214+0000","last_fullsized":"2024-05-30T16:52:54.635214+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:20:05.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977272832,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":225,"num_read_kb":921600,"num_write":233,"num_write_kb":954368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"74'85","reported_seq":188,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:08.473941+0000","last_change":"2024-05-30T16:50:00.203989+0000","last_active":"2024-05-30T16:52:08.473941+0000","last_peered":"2024-05-30T16:52:08.473941+0000","last_clean":"2024-05-30T16:52:08.473941+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:52:08.473941+0000","last_undegraded":"2024-05-30T16:52:08.473941+0000","last_fullsized":"2024-05-30T16:52:08.473941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":84,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"74'226","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.650330+0000","last_change":"2024-05-30T16:50:01.212225+0000","last_active":"2024-05-30T16:52:54.650330+0000","last_peered":"2024-05-30T16:52:54.650330+0000","last_clean":"2024-05-30T16:52:54.650330+0000","last_became_active":"2024-05-30T16:50:01.211630+0000","last_became_peered":"2024-05-30T16:50:01.211630+0000","last_unstale":"2024-05-30T16:52:54.650330+0000","last_undegraded":"2024-05-30T16:52:54.650330+0000","last_fullsized":"2024-05-30T16:52:54.650330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":228,"num_read_kb":933888,"num_write":215,"num_write_kb":872449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860937+0000","last_change":"2024-05-30T16:50:00.210481+0000","last_active":"2024-05-30T16:50:35.860937+0000","last_peered":"2024-05-30T16:50:35.860937+0000","last_clean":"2024-05-30T16:50:35.860937+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:50:35.860937+0000","last_undegraded":"2024-05-30T16:50:35.860937+0000","last_fullsized":"2024-05-30T16:50:35.860937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:41:46.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"74'218","reported_seq":470,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649650+0000","last_change":"2024-05-30T16:50:01.218627+0000","last_active":"2024-05-30T16:52:54.649650+0000","last_peered":"2024-05-30T16:52:54.649650+0000","last_clean":"2024-05-30T16:52:54.649650+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:52:54.649650+0000","last_undegraded":"2024-05-30T16:52:54.649650+0000","last_fullsized":"2024-05-30T16:52:54.649650+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":235,"num_read_kb":962560,"num_write":203,"num_write_kb":831488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:46.304719+0000","last_change":"2024-05-30T16:50:00.210033+0000","last_active":"2024-05-30T16:50:46.304719+0000","last_peered":"2024-05-30T16:50:46.304719+0000","last_clean":"2024-05-30T16:50:46.304719+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:50:46.304719+0000","last_undegraded":"2024-05-30T16:50:46.304719+0000","last_fullsized":"2024-05-30T16:50:46.304719+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:15.927433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":272,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.857733+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:50:35.857733+0000","last_peered":"2024-05-30T16:50:35.857733+0000","last_clean":"2024-05-30T16:50:35.857733+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:50:35.857733+0000","last_undegraded":"2024-05-30T16:50:35.857733+0000","last_fullsized":"2024-05-30T16:50:35.857733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":53712261060,"num_objects":12829,"num_object_clones":1,"num_object_copies":25658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12829,"num_whiteouts":1,"num_read":12246,"num_read_kb":49496226,"num_write":13027,"num_write_kb":52453497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107424694272,"data_stored":107424522120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14049,"ondisk_log_size":14049,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4445652,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":1451,"num_write_kb":4943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8953856,"data_stored":8891304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1313,"ondisk_log_size":1313,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15419816,"kb_used_data":15312352,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":78952024,"statfs":{"total":96636764160,"available":80846872576,"internally_reserved":0,"allocated":15679848448,"data_stored":15679297903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17299224,"kb_used_data":17195920,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":77072616,"statfs":{"total":96636764160,"available":78922358784,"internally_reserved":0,"allocated":17608622080,"data_stored":17608075002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10652116,"kb_used_data":10589068,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":83719724,"statfs":{"total":96636764160,"available":85728997376,"internally_reserved":0,"allocated":10843205632,"data_stored":10842662378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574986,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11717368,"kb_used_data":11650160,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":82654472,"statfs":{"total":96636764160,"available":84638179328,"internally_reserved":0,"allocated":11929763840,"data_stored":11929236066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14352084,"kb_used_data":14226572,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":80019756,"statfs":{"total":96636764160,"available":81940230144,"internally_reserved":0,"allocated":14568009728,"data_stored":14567443025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16418644,"kb_used_data":16311180,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":77953196,"statfs":{"total":96636764160,"available":79824072704,"internally_reserved":0,"allocated":16702648320,"data_stored":16702105396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10801372,"kb_used_data":10711956,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":83570468,"statfs":{"total":96636764160,"available":85576159232,"internally_reserved":0,"allocated":10969042944,"data_stored":10968492566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8993872,"kb_used_data":8926664,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":85377968,"statfs":{"total":96636764160,"available":87427039232,"internally_reserved":0,"allocated":9140903936,"data_stored":9140365112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":237862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":249948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":12744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9139408896,"data_stored":9139389333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10963931136,"data_stored":10963911563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16697544704,"data_stored":16697525009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14566858752,"data_stored":14566819752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11928604672,"data_stored":11928600707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10842300416,"data_stored":10842276877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17607712768,"data_stored":17607689499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15678332928,"data_stored":15678309380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:52:57.429 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T16:52:57.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.655+0000 7f4d35e00640 1 Processor -- start 2024-05-30T16:52:57.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.655+0000 7f4d35e00640 1 -- start start 2024-05-30T16:52:57.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.656+0000 7f4d35e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d3015eb80 0x7f4d30162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.657+0000 7f4d35e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4d300ba2b0 0x7f4d300cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.657+0000 7f4d35e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d30163550 con 0x7f4d300cfaa0 2024-05-30T16:52:57.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.657+0000 7f4d35e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f4d3015ef60 con 0x7f4d300ba2b0 2024-05-30T16:52:57.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.657+0000 7f4d35e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d300d4580 con 0x7f4d3015eb80 2024-05-30T16:52:57.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.657+0000 7f4d2ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d3015eb80 0x7f4d30162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.657+0000 7f4d2e000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4d300ba2b0 0x7f4d300cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.658+0000 7f4d2ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d3015eb80 0x7f4d30162640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:56262/0 (socket says 172.21.15.144:56262) 2024-05-30T16:52:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.658+0000 7f4d2ea00640 1 -- 172.21.15.144:0/2203546941 learned_addr learned my addr 172.21.15.144:0/2203546941 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.658+0000 7f4d2e000640 1 -- 172.21.15.144:0/2203546941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d3015eb80 msgr2=0x7f4d30162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.658+0000 7f4d2e000640 1 --2- 172.21.15.144:0/2203546941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d3015eb80 0x7f4d30162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.658+0000 7f4d2e000640 1 -- 172.21.15.144:0/2203546941 >> v1:172.21.15.149:6789/0 conn(0x7f4d300cfaa0 legacy=0x7f4d300b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.658+0000 7f4d2e000640 1 -- 172.21.15.144:0/2203546941 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d30162f90 con 0x7f4d300ba2b0 2024-05-30T16:52:57.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.658+0000 7f4d2ea00640 1 --2- 172.21.15.144:0/2203546941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d3015eb80 0x7f4d30162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:52:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.660+0000 7f4d2e000640 1 --2- 172.21.15.144:0/2203546941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d300ba2b0 0x7f4d300cf560 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097a0 tx=0x7f4d1c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7791cada2af4358e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.660+0000 7f4d2d600640 1 -- 172.21.15.144:0/2203546941 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c037070 con 0x7f4d300ba2b0 2024-05-30T16:52:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.660+0000 7f4d2d600640 1 -- 172.21.15.144:0/2203546941 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c032440 con 0x7f4d300ba2b0 2024-05-30T16:52:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.660+0000 7f4d2d600640 1 -- 172.21.15.144:0/2203546941 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c032810 con 0x7f4d300ba2b0 2024-05-30T16:52:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.661+0000 7f4d35e00640 1 -- 172.21.15.144:0/2203546941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d300ba2b0 msgr2=0x7f4d300cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.661+0000 7f4d35e00640 1 --2- 172.21.15.144:0/2203546941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d300ba2b0 0x7f4d300cf560 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097a0 tx=0x7f4d1c02a180 comp rx=0 tx=0).stop 2024-05-30T16:52:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.661+0000 7f4d35e00640 1 -- 172.21.15.144:0/2203546941 shutdown_connections 2024-05-30T16:52:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.661+0000 7f4d35e00640 1 --2- 172.21.15.144:0/2203546941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d300ba2b0 0x7f4d300cf560 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.661+0000 7f4d35e00640 1 --2- 172.21.15.144:0/2203546941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d3015eb80 0x7f4d30162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.661+0000 7f4d35e00640 1 -- 172.21.15.144:0/2203546941 >> 172.21.15.144:0/2203546941 conn(0x7f4d3006cf40 msgr2=0x7f4d3006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.661+0000 7f4d35e00640 1 -- 172.21.15.144:0/2203546941 shutdown_connections 2024-05-30T16:52:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.661+0000 7f4d35e00640 1 -- 172.21.15.144:0/2203546941 wait complete. 2024-05-30T16:52:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.663+0000 7f4d35e00640 1 Processor -- start 2024-05-30T16:52:57.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.663+0000 7f4d35e00640 1 -- start start 2024-05-30T16:52:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.664+0000 7f4d35e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d300ba2b0 0x7f4d301561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.664+0000 7f4d35e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d300cfaa0 0x7f4d3014d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.664+0000 7f4d35e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d3015eb80 0x7f4d30160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.664+0000 7f4d35e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300d3050 con 0x7f4d300ba2b0 2024-05-30T16:52:57.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.664+0000 7f4d35e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300d2d70 con 0x7f4d3015eb80 2024-05-30T16:52:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.664+0000 7f4d35e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d30162b80 con 0x7f4d300cfaa0 2024-05-30T16:52:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d300ba2b0 0x7f4d301561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d300ba2b0 0x7f4d301561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47894/0 (socket says 172.21.15.144:47894) 2024-05-30T16:52:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2ea00640 1 -- 172.21.15.144:0/1701994492 learned_addr learned my addr 172.21.15.144:0/1701994492 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2e000640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d300cfaa0 0x7f4d3014d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2f400640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d3015eb80 0x7f4d30160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2ea00640 1 -- 172.21.15.144:0/1701994492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d300cfaa0 msgr2=0x7f4d3014d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2ea00640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d300cfaa0 0x7f4d3014d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2ea00640 1 -- 172.21.15.144:0/1701994492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d3015eb80 msgr2=0x7f4d30160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2ea00640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d3015eb80 0x7f4d30160aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.665+0000 7f4d2ea00640 1 -- 172.21.15.144:0/1701994492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d30155810 con 0x7f4d300ba2b0 2024-05-30T16:52:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.666+0000 7f4d2ea00640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d300ba2b0 0x7f4d301561d0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e9b0 tx=0x7f4d2000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.666+0000 7f4d27400640 1 -- 172.21.15.144:0/1701994492 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20017070 con 0x7f4d300ba2b0 2024-05-30T16:52:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.666+0000 7f4d27400640 1 -- 172.21.15.144:0/1701994492 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2000c9a0 con 0x7f4d300ba2b0 2024-05-30T16:52:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.666+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d30158340 con 0x7f4d300ba2b0 2024-05-30T16:52:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.666+0000 7f4d27400640 1 -- 172.21.15.144:0/1701994492 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2000cd50 con 0x7f4d300ba2b0 2024-05-30T16:52:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.666+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d30155d90 con 0x7f4d300ba2b0 2024-05-30T16:52:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.667+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d30068b90 con 0x7f4d300ba2b0 2024-05-30T16:52:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.668+0000 7f4d27400640 1 -- 172.21.15.144:0/1701994492 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f4d2001a070 con 0x7f4d300ba2b0 2024-05-30T16:52:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.670+0000 7f4d27400640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d1006d940 0x7f4d1006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.670+0000 7f4d27400640 1 -- 172.21.15.144:0/1701994492 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f4d2008ac80 con 0x7f4d300ba2b0 2024-05-30T16:52:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.670+0000 7f4d2e000640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d1006d940 0x7f4d1006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:57.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.671+0000 7f4d2e000640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d1006d940 0x7f4d1006fe00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c034000 tx=0x7f4d1c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:57.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.674+0000 7f4d27400640 1 -- 172.21.15.144:0/1701994492 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d2005a7e0 con 0x7f4d300ba2b0 2024-05-30T16:52:57.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.878+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d300d1f20 con 0x7f4d300ba2b0 2024-05-30T16:52:57.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.880+0000 7f4d27400640 1 -- 172.21.15.144:0/1701994492 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16845 (secure 0 0 0) 0x7f4d2005a0e0 con 0x7f4d300ba2b0 2024-05-30T16:52:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:52:57.882 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":74,"fsid":"865cdc9a-e28b-4870-8751-0312b261bc38","created":"2024-05-30T16:41:27.799473+0000","modified":"2024-05-30T16:50:35.841891+0000","last_up_change":"2024-05-30T16:41:40.163384+0000","last_in_change":"2024-05-30T16:41:31.218500+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T16:41:40.927129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T16:49:58.537507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T16:49:59.619855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60f0288d-c086-4142-ae20-b61210ef3b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6817","nonce":2149619239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6819","nonce":2149619239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6823","nonce":2149619239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2149619239},{"type":"v1","addr":"172.21.15.144:6821","nonce":2149619239}]},"public_addr":"172.21.15.144:6817/2149619239","cluster_addr":"172.21.15.144:6819/2149619239","heartbeat_back_addr":"172.21.15.144:6823/2149619239","heartbeat_front_addr":"172.21.15.144:6821/2149619239","state":["exists","up"]},{"osd":1,"uuid":"838a88b8-1093-4b43-b194-16e269ca5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6801","nonce":331457482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6803","nonce":331457482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6807","nonce":331457482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331457482},{"type":"v1","addr":"172.21.15.144:6805","nonce":331457482}]},"public_addr":"172.21.15.144:6801/331457482","cluster_addr":"172.21.15.144:6803/331457482","heartbeat_back_addr":"172.21.15.144:6807/331457482","heartbeat_front_addr":"172.21.15.144:6805/331457482","state":["exists","up"]},{"osd":2,"uuid":"e4dd2d18-ea5a-40c9-a231-9178b930c60f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6809","nonce":4188068943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6811","nonce":4188068943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6815","nonce":4188068943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":4188068943},{"type":"v1","addr":"172.21.15.144:6813","nonce":4188068943}]},"public_addr":"172.21.15.144:6809/4188068943","cluster_addr":"172.21.15.144:6811/4188068943","heartbeat_back_addr":"172.21.15.144:6815/4188068943","heartbeat_front_addr":"172.21.15.144:6813/4188068943","state":["exists","up"]},{"osd":3,"uuid":"5b9666b7-ac43-4b9f-81f0-c620389ed1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6825","nonce":3462006210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6827","nonce":3462006210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6831","nonce":3462006210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3462006210},{"type":"v1","addr":"172.21.15.144:6829","nonce":3462006210}]},"public_addr":"172.21.15.144:6825/3462006210","cluster_addr":"172.21.15.144:6827/3462006210","heartbeat_back_addr":"172.21.15.144:6831/3462006210","heartbeat_front_addr":"172.21.15.144:6829/3462006210","state":["exists","up"]},{"osd":4,"uuid":"561069cb-4cc2-4227-a6f5-d1f2bee387f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6801","nonce":2150238027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6803","nonce":2150238027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6807","nonce":2150238027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2150238027},{"type":"v1","addr":"172.21.15.149:6805","nonce":2150238027}]},"public_addr":"172.21.15.149:6801/2150238027","cluster_addr":"172.21.15.149:6803/2150238027","heartbeat_back_addr":"172.21.15.149:6807/2150238027","heartbeat_front_addr":"172.21.15.149:6805/2150238027","state":["exists","up"]},{"osd":5,"uuid":"da5e4765-2e79-4c6a-b6d2-7f2c1fe18e68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6817","nonce":668470952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6820","nonce":668470952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6829","nonce":668470952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":668470952},{"type":"v1","addr":"172.21.15.149:6824","nonce":668470952}]},"public_addr":"172.21.15.149:6817/668470952","cluster_addr":"172.21.15.149:6820/668470952","heartbeat_back_addr":"172.21.15.149:6829/668470952","heartbeat_front_addr":"172.21.15.149:6824/668470952","state":["exists","up"]},{"osd":6,"uuid":"a0fb6874-8aff-49d4-989b-515bda877687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6809","nonce":1906248048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6811","nonce":1906248048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6815","nonce":1906248048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1906248048},{"type":"v1","addr":"172.21.15.149:6813","nonce":1906248048}]},"public_addr":"172.21.15.149:6809/1906248048","cluster_addr":"172.21.15.149:6811/1906248048","heartbeat_back_addr":"172.21.15.149:6815/1906248048","heartbeat_front_addr":"172.21.15.149:6813/1906248048","state":["exists","up"]},{"osd":7,"uuid":"573db942-5379-437d-b128-bee376048692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6821","nonce":1157548473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6825","nonce":1157548473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6831","nonce":1157548473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1157548473},{"type":"v1","addr":"172.21.15.149:6828","nonce":1157548473}]},"public_addr":"172.21.15.149:6821/1157548473","cluster_addr":"172.21.15.149:6825/1157548473","heartbeat_back_addr":"172.21.15.149:6831/1157548473","heartbeat_front_addr":"172.21.15.149:6828/1157548473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.621093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.512190+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.427901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.605199+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.832365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:35.965000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.371685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T16:41:36.651252+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T16:52:57.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d1006d940 msgr2=0x7f4d1006fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d1006d940 0x7f4d1006fe00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c034000 tx=0x7f4d1c02e000 comp rx=0 tx=0).stop 2024-05-30T16:52:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d300ba2b0 msgr2=0x7f4d301561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d300ba2b0 0x7f4d301561d0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e9b0 tx=0x7f4d2000ee70 comp rx=0 tx=0).stop 2024-05-30T16:52:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 shutdown_connections 2024-05-30T16:52:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f4d1006d940 0x7f4d1006fe00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d3015eb80 0x7f4d30160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d300cfaa0 0x7f4d3014d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 --2- 172.21.15.144:0/1701994492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d300ba2b0 0x7f4d301561d0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 >> 172.21.15.144:0/1701994492 conn(0x7f4d3006cf40 msgr2=0x7f4d300d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 shutdown_connections 2024-05-30T16:52:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:57.883+0000 7f4d35e00640 1 -- 172.21.15.144:0/1701994492 wait complete. 2024-05-30T16:52:58.903 INFO:tasks.ceph:Scrubbing osd.0 2024-05-30T16:52:58.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-30T16:52:59.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.119+0000 7f3c0e600640 1 Processor -- start 2024-05-30T16:52:59.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.120+0000 7f3c0e600640 1 -- start start 2024-05-30T16:52:59.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.121+0000 7f3c0e600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c08145150 0x7f3c080cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.121+0000 7f3c0e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c080cfa70 0x7f3c0806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.121+0000 7f3c0e600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3c0806f610 0x7f3c08072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.121+0000 7f3c0e600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3c080cfeb0 con 0x7f3c08145150 2024-05-30T16:52:59.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.121+0000 7f3c0e600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0815f140 con 0x7f3c0806f610 2024-05-30T16:52:59.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.121+0000 7f3c0e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3c080d00f0 con 0x7f3c080cfa70 2024-05-30T16:52:59.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.121+0000 7f3c07400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c08145150 0x7f3c080cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3c07400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c08145150 0x7f3c080cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47908/0 (socket says 172.21.15.144:47908) 2024-05-30T16:52:59.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3c07400640 1 -- 172.21.15.144:0/3164875801 learned_addr learned my addr 172.21.15.144:0/3164875801 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:59.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3c07400640 1 -- 172.21.15.144:0/3164875801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c080cfa70 msgr2=0x7f3c0806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:59.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3c07e00640 1 --2- 172.21.15.144:0/3164875801 >> v2:172.21.15.149:3300/0 conn(0x7f3c0806f610 0x7f3c08072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3bffe00640 1 --2- 172.21.15.144:0/3164875801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c080cfa70 0x7f3c0806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3c07400640 1 --2- 172.21.15.144:0/3164875801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c080cfa70 0x7f3c0806f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3c07400640 1 -- 172.21.15.144:0/3164875801 >> v2:172.21.15.149:3300/0 conn(0x7f3c0806f610 msgr2=0x7f3c08072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:59.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3c07400640 1 --2- 172.21.15.144:0/3164875801 >> v2:172.21.15.149:3300/0 conn(0x7f3c0806f610 0x7f3c08072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3c07400640 1 -- 172.21.15.144:0/3164875801 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0815f390 con 0x7f3c08145150 2024-05-30T16:52:59.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.122+0000 7f3c07e00640 1 --2- 172.21.15.144:0/3164875801 >> v2:172.21.15.149:3300/0 conn(0x7f3c0806f610 0x7f3c08072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:59.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.123+0000 7f3c07400640 1 --2- 172.21.15.144:0/3164875801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c08145150 0x7f3c080cf530 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f3c080b37d0 tx=0x7f3bf802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead5455d042866e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.123+0000 7f3c06a00640 1 -- 172.21.15.144:0/3164875801 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8037070 con 0x7f3c08145150 2024-05-30T16:52:59.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.123+0000 7f3c06a00640 1 -- 172.21.15.144:0/3164875801 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf8032440 con 0x7f3c08145150 2024-05-30T16:52:59.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.123+0000 7f3c06a00640 1 -- 172.21.15.144:0/3164875801 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8032810 con 0x7f3c08145150 2024-05-30T16:52:59.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.124+0000 7f3c0e600640 1 -- 172.21.15.144:0/3164875801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c08145150 msgr2=0x7f3c080cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.124+0000 7f3c0e600640 1 --2- 172.21.15.144:0/3164875801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c08145150 0x7f3c080cf530 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f3c080b37d0 tx=0x7f3bf802a140 comp rx=0 tx=0).stop 2024-05-30T16:52:59.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.124+0000 7f3c0e600640 1 -- 172.21.15.144:0/3164875801 shutdown_connections 2024-05-30T16:52:59.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.124+0000 7f3c0e600640 1 --2- 172.21.15.144:0/3164875801 >> v2:172.21.15.149:3300/0 conn(0x7f3c0806f610 0x7f3c08072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.124+0000 7f3c0e600640 1 --2- 172.21.15.144:0/3164875801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c080cfa70 0x7f3c0806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.124+0000 7f3c0e600640 1 --2- 172.21.15.144:0/3164875801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c08145150 0x7f3c080cf530 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.124+0000 7f3c0e600640 1 -- 172.21.15.144:0/3164875801 >> 172.21.15.144:0/3164875801 conn(0x7f3c0806bd00 msgr2=0x7f3c0806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:59.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.124+0000 7f3c0e600640 1 -- 172.21.15.144:0/3164875801 shutdown_connections 2024-05-30T16:52:59.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.124+0000 7f3c0e600640 1 -- 172.21.15.144:0/3164875801 wait complete. 2024-05-30T16:52:59.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.126+0000 7f3c0e600640 1 Processor -- start 2024-05-30T16:52:59.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.126+0000 7f3c0e600640 1 -- start start 2024-05-30T16:52:59.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.127+0000 7f3c0e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0806f610 0x7f3c0813cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.127+0000 7f3c0e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080cfa70 0x7f3c080ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.127+0000 7f3c0e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c08145150 0x7f3c080adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.127+0000 7f3c0e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3c080b64f0 con 0x7f3c080cfa70 2024-05-30T16:52:59.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.127+0000 7f3c0e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0815f950 con 0x7f3c08145150 2024-05-30T16:52:59.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.127+0000 7f3c0e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0815fe70 con 0x7f3c0806f610 2024-05-30T16:52:59.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.127+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080cfa70 0x7f3c080ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.127+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080cfa70 0x7f3c080ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47920/0 (socket says 172.21.15.144:47920) 2024-05-30T16:52:59.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.127+0000 7f3bffe00640 1 -- 172.21.15.144:0/643058783 learned_addr learned my addr 172.21.15.144:0/643058783 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:59.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3c07e00640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c08145150 0x7f3c080adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3c07400640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0806f610 0x7f3c0813cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3bffe00640 1 -- 172.21.15.144:0/643058783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0806f610 msgr2=0x7f3c0813cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3bffe00640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0806f610 0x7f3c0813cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3bffe00640 1 -- 172.21.15.144:0/643058783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c08145150 msgr2=0x7f3c080adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3bffe00640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c08145150 0x7f3c080adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3bffe00640 1 -- 172.21.15.144:0/643058783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c080ae4b0 con 0x7f3c080cfa70 2024-05-30T16:52:59.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3c07e00640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c08145150 0x7f3c080adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:52:59.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3bffe00640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080cfa70 0x7f3c080ad8a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c7f0 tx=0x7f3bf000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3bff400640 1 -- 172.21.15.144:0/643058783 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0015070 con 0x7f3c080cfa70 2024-05-30T16:52:59.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3bff400640 1 -- 172.21.15.144:0/643058783 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0004240 con 0x7f3c080cfa70 2024-05-30T16:52:59.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3bff400640 1 -- 172.21.15.144:0/643058783 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0007620 con 0x7f3c080cfa70 2024-05-30T16:52:59.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.128+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c080ae790 con 0x7f3c080cfa70 2024-05-30T16:52:59.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.129+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c080aed50 con 0x7f3c080cfa70 2024-05-30T16:52:59.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.129+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c08075f70 con 0x7f3c080cfa70 2024-05-30T16:52:59.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.131+0000 7f3bff400640 1 -- 172.21.15.144:0/643058783 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f3bf00079d0 con 0x7f3c080cfa70 2024-05-30T16:52:59.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.132+0000 7f3bff400640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3be406d940 0x7f3be406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.132+0000 7f3bff400640 1 -- 172.21.15.144:0/643058783 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f3bf008aea0 con 0x7f3c080cfa70 2024-05-30T16:52:59.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.132+0000 7f3c07400640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3be406d940 0x7f3be406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.132+0000 7f3bff400640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7f3be4075c00 0x7f3be4078060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.132+0000 7f3bff400640 1 -- 172.21.15.144:0/643058783 --> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3be4078730 con 0x7f3be4075c00 2024-05-30T16:52:59.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.132+0000 7f3bff400640 1 -- 172.21.15.144:0/643058783 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f3bf0095050 con 0x7f3c080cfa70 2024-05-30T16:52:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.132+0000 7f3c07e00640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7f3be4075c00 0x7f3be4078060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.133+0000 7f3c07400640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3be406d940 0x7f3be406fe00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8034000 tx=0x7f3bf802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.133+0000 7f3c07e00640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7f3be4075c00 0x7f3be4078060 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.134+0000 7f3bff400640 1 -- 172.21.15.144:0/643058783 <== osd.0 v2:172.21.15.144:6816/2149619239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3be4078730 con 0x7f3be4075c00 2024-05-30T16:52:59.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.148+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 --> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3c08068b90 con 0x7f3be4075c00 2024-05-30T16:52:59.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.148+0000 7f3bff400640 1 -- 172.21.15.144:0/643058783 <== osd.0 v2:172.21.15.144:6816/2149619239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3c08068b90 con 0x7f3be4075c00 2024-05-30T16:52:59.149 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:59.150 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T16:52:59.150 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.148+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7f3be4075c00 msgr2=0x7f3be4078060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.148+0000 7f3c0e600640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6816/2149619239,v1:172.21.15.144:6817/2149619239] conn(0x7f3be4075c00 0x7f3be4078060 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.149+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3be406d940 msgr2=0x7f3be406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.149+0000 7f3c0e600640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f3be406d940 0x7f3be406fe00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8034000 tx=0x7f3bf802e000 comp rx=0 tx=0).stop 2024-05-30T16:52:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.149+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080cfa70 msgr2=0x7f3c080ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.149+0000 7f3c0e600640 1 --2- 172.21.15.144:0/643058783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080cfa70 0x7f3c080ad8a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c7f0 tx=0x7f3bf000ccb0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.149+0000 7f3c07e00640 1 -- 172.21.15.144:0/643058783 reap_dead start 2024-05-30T16:52:59.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.149+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 shutdown_connections 2024-05-30T16:52:59.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.149+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 >> 172.21.15.144:0/643058783 conn(0x7f3c0806bd00 msgr2=0x7f3c08143550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:59.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.149+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 shutdown_connections 2024-05-30T16:52:59.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.149+0000 7f3c0e600640 1 -- 172.21.15.144:0/643058783 wait complete. 2024-05-30T16:52:59.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-30T16:52:59.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.350+0000 7fc579600640 1 Processor -- start 2024-05-30T16:52:59.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.350+0000 7fc579600640 1 -- start start 2024-05-30T16:52:59.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.352+0000 7fc579600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc574158cd0 0x7fc5740cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.352+0000 7fc579600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc57415bf00 0x7fc57406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.352+0000 7fc579600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc574071e80 0x7fc5740722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.352+0000 7fc579600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc574072810 con 0x7fc57415bf00 2024-05-30T16:52:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.352+0000 7fc579600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc57406e420 con 0x7fc574158cd0 2024-05-30T16:52:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.352+0000 7fc579600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5740cf7b0 con 0x7fc574071e80 2024-05-30T16:52:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.352+0000 7fc572000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc57415bf00 0x7fc57406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.352+0000 7fc572000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc57415bf00 0x7fc57406dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47928/0 (socket says 172.21.15.144:47928) 2024-05-30T16:52:59.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.352+0000 7fc572000640 1 -- 172.21.15.144:0/1688656138 learned_addr learned my addr 172.21.15.144:0/1688656138 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:59.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.353+0000 7fc572000640 1 -- 172.21.15.144:0/1688656138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc574071e80 msgr2=0x7fc5740722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:59.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.353+0000 7fc573400640 1 --2- 172.21.15.144:0/1688656138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc574071e80 0x7fc5740722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.353+0000 7fc572a00640 1 --2- 172.21.15.144:0/1688656138 >> v2:172.21.15.149:3300/0 conn(0x7fc574158cd0 0x7fc5740cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.353+0000 7fc572000640 1 --2- 172.21.15.144:0/1688656138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc574071e80 0x7fc5740722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.353+0000 7fc572000640 1 -- 172.21.15.144:0/1688656138 >> v2:172.21.15.149:3300/0 conn(0x7fc574158cd0 msgr2=0x7fc5740cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:59.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.353+0000 7fc572000640 1 --2- 172.21.15.144:0/1688656138 >> v2:172.21.15.149:3300/0 conn(0x7fc574158cd0 0x7fc5740cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.353+0000 7fc572000640 1 -- 172.21.15.144:0/1688656138 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5740cfa90 con 0x7fc57415bf00 2024-05-30T16:52:59.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.354+0000 7fc572000640 1 --2- 172.21.15.144:0/1688656138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57415bf00 0x7fc57406dee0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc574070370 tx=0x7fc56002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1789a9be4029a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.354+0000 7fc571600640 1 -- 172.21.15.144:0/1688656138 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560037070 con 0x7fc57415bf00 2024-05-30T16:52:59.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.354+0000 7fc571600640 1 -- 172.21.15.144:0/1688656138 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560032440 con 0x7fc57415bf00 2024-05-30T16:52:59.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.354+0000 7fc571600640 1 -- 172.21.15.144:0/1688656138 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560032810 con 0x7fc57415bf00 2024-05-30T16:52:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.355+0000 7fc579600640 1 -- 172.21.15.144:0/1688656138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57415bf00 msgr2=0x7fc57406dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.355+0000 7fc579600640 1 --2- 172.21.15.144:0/1688656138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57415bf00 0x7fc57406dee0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc574070370 tx=0x7fc56002a140 comp rx=0 tx=0).stop 2024-05-30T16:52:59.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.355+0000 7fc579600640 1 -- 172.21.15.144:0/1688656138 shutdown_connections 2024-05-30T16:52:59.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.355+0000 7fc579600640 1 --2- 172.21.15.144:0/1688656138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc574071e80 0x7fc5740722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.355+0000 7fc579600640 1 --2- 172.21.15.144:0/1688656138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57415bf00 0x7fc57406dee0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.355+0000 7fc579600640 1 --2- 172.21.15.144:0/1688656138 >> v2:172.21.15.149:3300/0 conn(0x7fc574158cd0 0x7fc5740cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.355+0000 7fc579600640 1 -- 172.21.15.144:0/1688656138 >> 172.21.15.144:0/1688656138 conn(0x7fc5740629c0 msgr2=0x7fc57406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:59.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.355+0000 7fc579600640 1 -- 172.21.15.144:0/1688656138 shutdown_connections 2024-05-30T16:52:59.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.355+0000 7fc579600640 1 -- 172.21.15.144:0/1688656138 wait complete. 2024-05-30T16:52:59.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.357+0000 7fc579600640 1 Processor -- start 2024-05-30T16:52:59.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.357+0000 7fc579600640 1 -- start start 2024-05-30T16:52:59.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.358+0000 7fc579600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc574071e80 0x7fc574150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.358+0000 7fc579600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc574158cd0 0x7fc5741534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.358+0000 7fc579600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc57415bf00 0x7fc5740ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.358+0000 7fc579600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc57415c390 con 0x7fc574158cd0 2024-05-30T16:52:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.358+0000 7fc579600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740b49d0 con 0x7fc574071e80 2024-05-30T16:52:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.358+0000 7fc579600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5740cfd70 con 0x7fc57415bf00 2024-05-30T16:52:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.358+0000 7fc572000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc574158cd0 0x7fc5741534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.358+0000 7fc572000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc574158cd0 0x7fc5741534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47938/0 (socket says 172.21.15.144:47938) 2024-05-30T16:52:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.358+0000 7fc572000640 1 -- 172.21.15.144:0/1495676321 learned_addr learned my addr 172.21.15.144:0/1495676321 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:59.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc572a00640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc574071e80 0x7fc574150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc573400640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc57415bf00 0x7fc5740ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc572000640 1 -- 172.21.15.144:0/1495676321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc57415bf00 msgr2=0x7fc5740ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc572000640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc57415bf00 0x7fc5740ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc572000640 1 -- 172.21.15.144:0/1495676321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc574071e80 msgr2=0x7fc574150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc572000640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc574071e80 0x7fc574150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc572000640 1 -- 172.21.15.144:0/1495676321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc574153db0 con 0x7fc574158cd0 2024-05-30T16:52:59.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc572000640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc574158cd0 0x7fc5741534b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc560000c00 tx=0x7fc5600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc56aa00640 1 -- 172.21.15.144:0/1495676321 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560037040 con 0x7fc574158cd0 2024-05-30T16:52:59.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc56aa00640 1 -- 172.21.15.144:0/1495676321 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560042070 con 0x7fc574158cd0 2024-05-30T16:52:59.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc56aa00640 1 -- 172.21.15.144:0/1495676321 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560030bb0 con 0x7fc574158cd0 2024-05-30T16:52:59.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.359+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57415c6b0 con 0x7fc574158cd0 2024-05-30T16:52:59.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.360+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57415cc70 con 0x7fc574158cd0 2024-05-30T16:52:59.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.361+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc574068b20 con 0x7fc574158cd0 2024-05-30T16:52:59.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.362+0000 7fc56aa00640 1 -- 172.21.15.144:0/1495676321 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7fc560047460 con 0x7fc574158cd0 2024-05-30T16:52:59.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.363+0000 7fc56aa00640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55406d940 0x7fc55406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.363+0000 7fc56aa00640 1 -- 172.21.15.144:0/1495676321 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fc5600ab330 con 0x7fc574158cd0 2024-05-30T16:52:59.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.363+0000 7fc572a00640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55406d940 0x7fc55406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.364+0000 7fc572a00640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55406d940 0x7fc55406fe00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc564006fd0 tx=0x7fc564008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.368+0000 7fc56aa00640 1 -- 172.21.15.144:0/1495676321 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc560045360 con 0x7fc574158cd0 2024-05-30T16:52:59.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.570+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fc5740cda00 con 0x7fc55406d940 2024-05-30T16:52:59.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.571+0000 7fc56aa00640 1 -- 172.21.15.144:0/1495676321 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc5740cda00 con 0x7fc55406d940 2024-05-30T16:52:59.573 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 0 to deep-scrub 2024-05-30T16:52:59.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55406d940 msgr2=0x7fc55406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55406d940 0x7fc55406fe00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc564006fd0 tx=0x7fc564008040 comp rx=0 tx=0).stop 2024-05-30T16:52:59.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc574158cd0 msgr2=0x7fc5741534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc574158cd0 0x7fc5741534b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc560000c00 tx=0x7fc5600046c0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 shutdown_connections 2024-05-30T16:52:59.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc55406d940 0x7fc55406fe00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc57415bf00 0x7fc5740ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc574158cd0 0x7fc5741534b0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 --2- 172.21.15.144:0/1495676321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc574071e80 0x7fc574150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 >> 172.21.15.144:0/1495676321 conn(0x7fc5740629c0 msgr2=0x7fc57406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:59.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 shutdown_connections 2024-05-30T16:52:59.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.574+0000 7fc579600640 1 -- 172.21.15.144:0/1495676321 wait complete. 2024-05-30T16:52:59.593 INFO:tasks.ceph:Scrubbing osd.1 2024-05-30T16:52:59.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-30T16:52:59.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.794+0000 7fbbfa800640 1 Processor -- start 2024-05-30T16:52:59.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.794+0000 7fbbfa800640 1 -- start start 2024-05-30T16:52:59.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.796+0000 7fbbfa800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf406cc70 0x7fbbf40d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.796+0000 7fbbfa800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbf40d08d0 con 0x7fbbf406d7f0 2024-05-30T16:52:59.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.796+0000 7fbbfa800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbf415f5e0 con 0x7fbbf415ec60 2024-05-30T16:52:59.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.796+0000 7fbbfa800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf415f8c0 con 0x7fbbf406cc70 2024-05-30T16:52:59.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.796+0000 7fbbeaa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbbf406d7f0 0x7fbbf40d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41022/0 (socket says 172.21.15.144:41022) 2024-05-30T16:52:59.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.796+0000 7fbbeaa00640 1 -- 172.21.15.144:0/2885277632 learned_addr learned my addr 172.21.15.144:0/2885277632 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:52:59.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481732156 0 0) 0x7fbbf40d08d0 con 0x7fbbf406d7f0 2024-05-30T16:52:59.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbd8003520 con 0x7fbbf406d7f0 2024-05-30T16:52:59.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf3e00640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf406cc70 0x7fbbf40d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2900166714 0 0) 0x7fbbd8003520 con 0x7fbbf406d7f0 2024-05-30T16:52:59.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf406cc70 msgr2=0x7fbbf40d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:59.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf406cc70 0x7fbbf40d14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 >> v1:172.21.15.149:6789/0 conn(0x7fbbf415ec60 legacy=0x7fbbf406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf415fba0 con 0x7fbbf406d7f0 2024-05-30T16:52:59.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7fbbdc001670 con 0x7fbbf406d7f0 2024-05-30T16:52:59.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 >> v1:172.21.15.144:6789/0 conn(0x7fbbf406d7f0 legacy=0x7fbbf40d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbd80039e0 0x7fbbd8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbd8004800 0x7fbbd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf406cc70 0x7fbbd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf415f8c0 con 0x7fbbd80039e0 2024-05-30T16:52:59.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd8005520 con 0x7fbbd8004800 2024-05-30T16:52:59.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd800bf00 con 0x7fbbf406cc70 2024-05-30T16:52:59.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.797+0000 7fbbf3400640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbd80039e0 0x7fbbd8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.798+0000 7fbbf3400640 1 -- 172.21.15.144:0/2885277632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf406cc70 msgr2=0x7fbbd800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:59.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.798+0000 7fbbf3400640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf406cc70 0x7fbbd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.798+0000 7fbbf3400640 1 -- 172.21.15.144:0/2885277632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbd8004800 msgr2=0x7fbbd8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:52:59.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.798+0000 7fbbf3400640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbd8004800 0x7fbbd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.798+0000 7fbbf3400640 1 -- 172.21.15.144:0/2885277632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd8003520 con 0x7fbbd80039e0 2024-05-30T16:52:59.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.799+0000 7fbbf3400640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbd80039e0 0x7fbbd8003e00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4001720 tx=0x7fbbd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73305288063531b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.799+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4001370 con 0x7fbbd80039e0 2024-05-30T16:52:59.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.799+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe40052d0 con 0x7fbbd80039e0 2024-05-30T16:52:59.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.799+0000 7fbbf2a00640 1 -- 172.21.15.144:0/2885277632 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe402abc0 con 0x7fbbd80039e0 2024-05-30T16:52:59.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.800+0000 7fbbfa800640 1 -- 172.21.15.144:0/2885277632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbd80039e0 msgr2=0x7fbbd8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.800+0000 7fbbfa800640 1 --2- 172.21.15.144:0/2885277632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbd80039e0 0x7fbbd8003e00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4001720 tx=0x7fbbd8005830 comp rx=0 tx=0).stop 2024-05-30T16:52:59.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.800+0000 7fbbf3e00640 1 -- 172.21.15.144:0/2885277632 reap_dead start 2024-05-30T16:52:59.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.800+0000 7fbbfa800640 1 -- 172.21.15.144:0/2885277632 shutdown_connections 2024-05-30T16:52:59.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.800+0000 7fbbfa800640 1 -- 172.21.15.144:0/2885277632 >> 172.21.15.144:0/2885277632 conn(0x7fbbf40b4180 msgr2=0x7fbbf40b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:59.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.800+0000 7fbbfa800640 1 -- 172.21.15.144:0/2885277632 shutdown_connections 2024-05-30T16:52:59.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.800+0000 7fbbfa800640 1 -- 172.21.15.144:0/2885277632 wait complete. 2024-05-30T16:52:59.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.802+0000 7fbbfa800640 1 Processor -- start 2024-05-30T16:52:59.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.802+0000 7fbbfa800640 1 -- start start 2024-05-30T16:52:59.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbfa800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbd80039e0 0x7fbbf415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbfa800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4160810 0x7fbbf414f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbfa800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf4161e20 0x7fbbf415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbfa800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf41627f0 con 0x7fbbf4160810 2024-05-30T16:52:59.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbfa800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf4162670 con 0x7fbbd80039e0 2024-05-30T16:52:59.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbfa800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf4162970 con 0x7fbbf4161e20 2024-05-30T16:52:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4160810 0x7fbbf414f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4160810 0x7fbbf414f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47950/0 (socket says 172.21.15.144:47950) 2024-05-30T16:52:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbeaa00640 1 -- 172.21.15.144:0/892070474 learned_addr learned my addr 172.21.15.144:0/892070474 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:52:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.803+0000 7fbbf3400640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbd80039e0 0x7fbbf415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbeaa00640 1 -- 172.21.15.144:0/892070474 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf4161e20 msgr2=0x7fbbf415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbeaa00640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbf4161e20 0x7fbbf415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbeaa00640 1 -- 172.21.15.144:0/892070474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbd80039e0 msgr2=0x7fbbf415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbeaa00640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbd80039e0 0x7fbbf415a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbeaa00640 1 -- 172.21.15.144:0/892070474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf4160d80 con 0x7fbbf4160810 2024-05-30T16:52:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbeaa00640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4160810 0x7fbbf414f6b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c770 tx=0x7fbbdc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbebe00640 1 -- 172.21.15.144:0/892070474 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc018070 con 0x7fbbf4160810 2024-05-30T16:52:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbebe00640 1 -- 172.21.15.144:0/892070474 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbdc007500 con 0x7fbbf4160810 2024-05-30T16:52:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbebe00640 1 -- 172.21.15.144:0/892070474 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc004a20 con 0x7fbbf4160810 2024-05-30T16:52:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf4161060 con 0x7fbbf4160810 2024-05-30T16:52:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.804+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf4161620 con 0x7fbbf4160810 2024-05-30T16:52:59.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.805+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbbf4075f70 con 0x7fbbf4160810 2024-05-30T16:52:59.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.807+0000 7fbbebe00640 1 -- 172.21.15.144:0/892070474 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7fbbdc004bc0 con 0x7fbbf4160810 2024-05-30T16:52:59.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.807+0000 7fbbebe00640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbbd006d940 0x7fbbd006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.808+0000 7fbbebe00640 1 -- 172.21.15.144:0/892070474 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fbbdc089f90 con 0x7fbbf4160810 2024-05-30T16:52:59.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.808+0000 7fbbf3400640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbbd006d940 0x7fbbd006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.808+0000 7fbbebe00640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7fbbd0075c00 0x7fbbd0078060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:52:59.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.808+0000 7fbbebe00640 1 -- 172.21.15.144:0/892070474 --> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbbd0078730 con 0x7fbbd0075c00 2024-05-30T16:52:59.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.808+0000 7fbbebe00640 1 -- 172.21.15.144:0/892070474 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fbbdc094050 con 0x7fbbf4160810 2024-05-30T16:52:59.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.808+0000 7fbbf3e00640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7fbbd0075c00 0x7fbbd0078060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:52:59.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.808+0000 7fbbf3400640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbbd006d940 0x7fbbd006fe00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4032000 tx=0x7fbbe402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.809+0000 7fbbf3e00640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7fbbd0075c00 0x7fbbd0078060 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:52:59.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.809+0000 7fbbebe00640 1 -- 172.21.15.144:0/892070474 <== osd.1 v2:172.21.15.144:6800/331457482 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbbd0078730 con 0x7fbbd0075c00 2024-05-30T16:52:59.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.824+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 --> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbbf4068b90 con 0x7fbbd0075c00 2024-05-30T16:52:59.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.824+0000 7fbbebe00640 1 -- 172.21.15.144:0/892070474 <== osd.1 v2:172.21.15.144:6800/331457482 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbbf4068b90 con 0x7fbbd0075c00 2024-05-30T16:52:59.826 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:52:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T16:52:59.826 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:52:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.824+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7fbbd0075c00 msgr2=0x7fbbd0078060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.824+0000 7fbbfa800640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6800/331457482,v1:172.21.15.144:6801/331457482] conn(0x7fbbd0075c00 0x7fbbd0078060 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:52:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.825+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbbd006d940 msgr2=0x7fbbd006fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.825+0000 7fbbfa800640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fbbd006d940 0x7fbbd006fe00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4032000 tx=0x7fbbe402e000 comp rx=0 tx=0).stop 2024-05-30T16:52:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.825+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4160810 msgr2=0x7fbbf414f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:52:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.825+0000 7fbbfa800640 1 --2- 172.21.15.144:0/892070474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4160810 0x7fbbf414f6b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c770 tx=0x7fbbdc00cc30 comp rx=0 tx=0).stop 2024-05-30T16:52:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.825+0000 7fbbf3e00640 1 -- 172.21.15.144:0/892070474 reap_dead start 2024-05-30T16:52:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.825+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 shutdown_connections 2024-05-30T16:52:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.825+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 >> 172.21.15.144:0/892070474 conn(0x7fbbf40b4180 msgr2=0x7fbbf40cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:52:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.825+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 shutdown_connections 2024-05-30T16:52:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:52:59.825+0000 7fbbfa800640 1 -- 172.21.15.144:0/892070474 wait complete. 2024-05-30T16:52:59.842 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-30T16:53:00.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.034+0000 7f2294600640 1 Processor -- start 2024-05-30T16:53:00.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.034+0000 7f2294600640 1 -- start start 2024-05-30T16:53:00.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.036+0000 7f2294600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f228c159320 0x7f228c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.036+0000 7f2294600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f228c06f770 0x7f228c15f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.036+0000 7f2294600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c15f120 con 0x7f228c15fe40 2024-05-30T16:53:00.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.036+0000 7f2294600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f228c0cee40 con 0x7f228c159320 2024-05-30T16:53:00.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.036+0000 7f2294600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f228c0cf120 con 0x7f228c06f770 2024-05-30T16:53:00.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.036+0000 7f2291c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f228c159320 0x7f228c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.036+0000 7f2292600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f228c15fe40 0x7f228c0ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41032/0 (socket says 172.21.15.144:41032) 2024-05-30T16:53:00.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.036+0000 7f2292600640 1 -- 172.21.15.144:0/135357866 learned_addr learned my addr 172.21.15.144:0/135357866 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:53:00.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.037+0000 7f2291200640 1 --2- 172.21.15.144:0/135357866 >> v2:172.21.15.149:3300/0 conn(0x7f228c06f770 0x7f228c15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.037+0000 7f2291c00640 1 -- 172.21.15.144:0/135357866 >> v2:172.21.15.149:3300/0 conn(0x7f228c06f770 msgr2=0x7f228c15f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:00.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.037+0000 7f2291c00640 1 --2- 172.21.15.144:0/135357866 >> v2:172.21.15.149:3300/0 conn(0x7f228c06f770 0x7f228c15f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.037+0000 7f2291c00640 1 -- 172.21.15.144:0/135357866 >> v1:172.21.15.144:6789/0 conn(0x7f228c15fe40 legacy=0x7f228c0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.037+0000 7f2291c00640 1 -- 172.21.15.144:0/135357866 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c0cf400 con 0x7f228c159320 2024-05-30T16:53:00.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.037+0000 7f228be00640 1 -- 172.21.15.144:0/135357866 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 401317321 0 0) 0x7f228c15f120 con 0x7f228c15fe40 2024-05-30T16:53:00.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.038+0000 7f2291c00640 1 --2- 172.21.15.144:0/135357866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 0x7f228c06efb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f228c0ce1b0 tx=0x7f228002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e343915d454754 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.038+0000 7f228be00640 1 -- 172.21.15.144:0/135357866 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280037070 con 0x7f228c159320 2024-05-30T16:53:00.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.038+0000 7f228be00640 1 -- 172.21.15.144:0/135357866 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2280032440 con 0x7f228c159320 2024-05-30T16:53:00.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.038+0000 7f228be00640 1 -- 172.21.15.144:0/135357866 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228002ae60 con 0x7f228c159320 2024-05-30T16:53:00.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.039+0000 7f2294600640 1 -- 172.21.15.144:0/135357866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 msgr2=0x7f228c06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.039+0000 7f2294600640 1 --2- 172.21.15.144:0/135357866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 0x7f228c06efb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f228c0ce1b0 tx=0x7f228002a110 comp rx=0 tx=0).stop 2024-05-30T16:53:00.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.039+0000 7f2294600640 1 -- 172.21.15.144:0/135357866 shutdown_connections 2024-05-30T16:53:00.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.039+0000 7f2294600640 1 --2- 172.21.15.144:0/135357866 >> v2:172.21.15.149:3300/0 conn(0x7f228c06f770 0x7f228c15f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.039+0000 7f2294600640 1 --2- 172.21.15.144:0/135357866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 0x7f228c06efb0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.039+0000 7f2294600640 1 -- 172.21.15.144:0/135357866 >> 172.21.15.144:0/135357866 conn(0x7f228c0629c0 msgr2=0x7f228c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:00.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.039+0000 7f2294600640 1 -- 172.21.15.144:0/135357866 shutdown_connections 2024-05-30T16:53:00.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.039+0000 7f2294600640 1 -- 172.21.15.144:0/135357866 wait complete. 2024-05-30T16:53:00.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.041+0000 7f2294600640 1 Processor -- start 2024-05-30T16:53:00.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.041+0000 7f2294600640 1 -- start start 2024-05-30T16:53:00.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2294600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f228c06f770 0x7f228c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2294600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 0x7f228c0ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2294600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f228c148d10 0x7f228c145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2294600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0cd2b0 con 0x7f228c159320 2024-05-30T16:53:00.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2294600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f228c06fc00 con 0x7f228c148d10 2024-05-30T16:53:00.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2294600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f228c0cd430 con 0x7f228c06f770 2024-05-30T16:53:00.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2291200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 0x7f228c0ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2291200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 0x7f228c0ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47972/0 (socket says 172.21.15.144:47972) 2024-05-30T16:53:00.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2291200640 1 -- 172.21.15.144:0/943500140 learned_addr learned my addr 172.21.15.144:0/943500140 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:00.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.042+0000 7f2291c00640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f228c06f770 0x7f228c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2291200640 1 -- 172.21.15.144:0/943500140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f228c06f770 msgr2=0x7f228c146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2291200640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f228c06f770 0x7f228c146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2291200640 1 -- 172.21.15.144:0/943500140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f228c148d10 msgr2=0x7f228c145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2291200640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f228c148d10 0x7f228c145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2291200640 1 -- 172.21.15.144:0/943500140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c146310 con 0x7f228c159320 2024-05-30T16:53:00.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2291200640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 0x7f228c0ad8a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f227c007ef0 tx=0x7f227c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2289600640 1 -- 172.21.15.144:0/943500140 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c014620 con 0x7f228c159320 2024-05-30T16:53:00.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2289600640 1 -- 172.21.15.144:0/943500140 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c019070 con 0x7f228c159320 2024-05-30T16:53:00.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2289600640 1 -- 172.21.15.144:0/943500140 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c014a00 con 0x7f228c159320 2024-05-30T16:53:00.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c146e70 con 0x7f228c159320 2024-05-30T16:53:00.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.043+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c147430 con 0x7f228c159320 2024-05-30T16:53:00.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.044+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c06c870 con 0x7f228c159320 2024-05-30T16:53:00.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.045+0000 7f2289600640 1 -- 172.21.15.144:0/943500140 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f227c014ba0 con 0x7f228c159320 2024-05-30T16:53:00.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.046+0000 7f2289600640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f227006d940 0x7f227006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.046+0000 7f2289600640 1 -- 172.21.15.144:0/943500140 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f227c08b350 con 0x7f228c159320 2024-05-30T16:53:00.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.047+0000 7f2291c00640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f227006d940 0x7f227006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.048+0000 7f2291c00640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f227006d940 0x7f227006fe00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2280034000 tx=0x7f228002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.052+0000 7f2289600640 1 -- 172.21.15.144:0/943500140 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f228c146310 con 0x7f228c159320 2024-05-30T16:53:00.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.251+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f228c0adde0 con 0x7f227006d940 2024-05-30T16:53:00.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.252+0000 7f2289600640 1 -- 172.21.15.144:0/943500140 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f228c0adde0 con 0x7f227006d940 2024-05-30T16:53:00.253 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 1 to deep-scrub 2024-05-30T16:53:00.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f227006d940 msgr2=0x7f227006fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f227006d940 0x7f227006fe00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2280034000 tx=0x7f228002e000 comp rx=0 tx=0).stop 2024-05-30T16:53:00.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 msgr2=0x7f228c0ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 0x7f228c0ad8a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f227c007ef0 tx=0x7f227c00e4b0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 shutdown_connections 2024-05-30T16:53:00.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f227006d940 0x7f227006fe00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f228c148d10 0x7f228c145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f228c159320 0x7f228c0ad8a0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 --2- 172.21.15.144:0/943500140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f228c06f770 0x7f228c146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.254+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 >> 172.21.15.144:0/943500140 conn(0x7f228c0629c0 msgr2=0x7f228c0b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:00.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.255+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 shutdown_connections 2024-05-30T16:53:00.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.255+0000 7f2294600640 1 -- 172.21.15.144:0/943500140 wait complete. 2024-05-30T16:53:00.274 INFO:tasks.ceph:Scrubbing osd.2 2024-05-30T16:53:00.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-30T16:53:00.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.473+0000 7f0363a00640 1 Processor -- start 2024-05-30T16:53:00.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.473+0000 7f0363a00640 1 -- start start 2024-05-30T16:53:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.475+0000 7f0363a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f035c0cec70 0x7f035c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.475+0000 7f0363a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f035c0b5e00 0x7f035c142200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.475+0000 7f0363a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f035c160730 con 0x7f035c13f760 2024-05-30T16:53:00.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.475+0000 7f0363a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f035c1612b0 con 0x7f035c0b5e00 2024-05-30T16:53:00.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.475+0000 7f0363a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f035c13fb40 con 0x7f035c0cec70 2024-05-30T16:53:00.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.475+0000 7f0361a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f035c0b5e00 0x7f035c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.475+0000 7f0361a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f035c0b5e00 0x7f035c142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47974/0 (socket says 172.21.15.144:47974) 2024-05-30T16:53:00.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.475+0000 7f0361a00640 1 -- 172.21.15.144:0/2252460607 learned_addr learned my addr 172.21.15.144:0/2252460607 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.476+0000 7f0353e00640 1 --2- 172.21.15.144:0/2252460607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f035c0cec70 0x7f035c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.476+0000 7f0361a00640 1 -- 172.21.15.144:0/2252460607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f035c0cec70 msgr2=0x7f035c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.476+0000 7f0361a00640 1 --2- 172.21.15.144:0/2252460607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f035c0cec70 0x7f035c0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.476+0000 7f0361a00640 1 -- 172.21.15.144:0/2252460607 >> v1:172.21.15.149:6789/0 conn(0x7f035c13f760 legacy=0x7f035c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.476+0000 7f0361a00640 1 -- 172.21.15.144:0/2252460607 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c160a10 con 0x7f035c0b5e00 2024-05-30T16:53:00.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.477+0000 7f0361a00640 1 --2- 172.21.15.144:0/2252460607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 0x7f035c142200 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0354009e50 tx=0x7f035402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381358659bd43aa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.477+0000 7f035be00640 1 -- 172.21.15.144:0/2252460607 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0354036070 con 0x7f035c0b5e00 2024-05-30T16:53:00.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.477+0000 7f035be00640 1 -- 172.21.15.144:0/2252460607 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0354031600 con 0x7f035c0b5e00 2024-05-30T16:53:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.477+0000 7f035be00640 1 -- 172.21.15.144:0/2252460607 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03540319d0 con 0x7f035c0b5e00 2024-05-30T16:53:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.478+0000 7f0363a00640 1 -- 172.21.15.144:0/2252460607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 msgr2=0x7f035c142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.478+0000 7f0363a00640 1 --2- 172.21.15.144:0/2252460607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 0x7f035c142200 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0354009e50 tx=0x7f035402a750 comp rx=0 tx=0).stop 2024-05-30T16:53:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.478+0000 7f0363a00640 1 -- 172.21.15.144:0/2252460607 shutdown_connections 2024-05-30T16:53:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.478+0000 7f0363a00640 1 --2- 172.21.15.144:0/2252460607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 0x7f035c142200 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.478+0000 7f0363a00640 1 --2- 172.21.15.144:0/2252460607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f035c0cec70 0x7f035c0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.478+0000 7f0363a00640 1 -- 172.21.15.144:0/2252460607 >> 172.21.15.144:0/2252460607 conn(0x7f035c06bd00 msgr2=0x7f035c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:00.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.478+0000 7f0363a00640 1 -- 172.21.15.144:0/2252460607 shutdown_connections 2024-05-30T16:53:00.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.478+0000 7f0363a00640 1 -- 172.21.15.144:0/2252460607 wait complete. 2024-05-30T16:53:00.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.480+0000 7f0363a00640 1 Processor -- start 2024-05-30T16:53:00.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.480+0000 7f0363a00640 1 -- start start 2024-05-30T16:53:00.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0363a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 0x7f035c154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0363a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f035c0cec70 0x7f035c1f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0363a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f035c13f760 0x7f035c1f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0363a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f035c0cf0d0 con 0x7f035c0b5e00 2024-05-30T16:53:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0363a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f035c160fd0 con 0x7f035c0cec70 2024-05-30T16:53:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0363a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f035c0cf250 con 0x7f035c13f760 2024-05-30T16:53:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0361000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 0x7f035c154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0361000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 0x7f035c154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47984/0 (socket says 172.21.15.144:47984) 2024-05-30T16:53:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0361000640 1 -- 172.21.15.144:0/370751183 learned_addr learned my addr 172.21.15.144:0/370751183 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0361000640 1 -- 172.21.15.144:0/370751183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f035c13f760 msgr2=0x7f035c1f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0361000640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f035c13f760 0x7f035c1f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0361000640 1 -- 172.21.15.144:0/370751183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f035c0cec70 msgr2=0x7f035c1f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0353e00640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f035c0cec70 0x7f035c1f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0361000640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f035c0cec70 0x7f035c1f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.481+0000 7f0361000640 1 -- 172.21.15.144:0/370751183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c1f6410 con 0x7f035c0b5e00 2024-05-30T16:53:00.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.482+0000 7f0361000640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 0x7f035c154e20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f034c00b3f0 tx=0x7f034c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.482+0000 7f0359600640 1 -- 172.21.15.144:0/370751183 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c015020 con 0x7f035c0b5e00 2024-05-30T16:53:00.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.482+0000 7f0359600640 1 -- 172.21.15.144:0/370751183 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034c011830 con 0x7f035c0b5e00 2024-05-30T16:53:00.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.482+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f035c15c3e0 con 0x7f035c0b5e00 2024-05-30T16:53:00.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.482+0000 7f0359600640 1 -- 172.21.15.144:0/370751183 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c011c20 con 0x7f035c0b5e00 2024-05-30T16:53:00.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.482+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035c158080 con 0x7f035c0b5e00 2024-05-30T16:53:00.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.483+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f035c075f70 con 0x7f035c0b5e00 2024-05-30T16:53:00.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.484+0000 7f0359600640 1 -- 172.21.15.144:0/370751183 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f034c018020 con 0x7f035c0b5e00 2024-05-30T16:53:00.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.485+0000 7f0359600640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f033806d940 0x7f033806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.485+0000 7f0359600640 1 -- 172.21.15.144:0/370751183 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f034c08a5e0 con 0x7f035c0b5e00 2024-05-30T16:53:00.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.486+0000 7f0353e00640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f033806d940 0x7f033806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.486+0000 7f0359600640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f0338075c00 0x7f0338078060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.486+0000 7f0359600640 1 -- 172.21.15.144:0/370751183 --> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f034c01deb0 con 0x7f0338075c00 2024-05-30T16:53:00.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.486+0000 7f0359600640 1 -- 172.21.15.144:0/370751183 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f034c08b1b0 con 0x7f035c0b5e00 2024-05-30T16:53:00.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.486+0000 7f0361a00640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f0338075c00 0x7f0338078060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.486+0000 7f0353e00640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f033806d940 0x7f033806fe00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f035c140b50 tx=0x7f0344008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.487+0000 7f0361a00640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f0338075c00 0x7f0338078060 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.487+0000 7f0359600640 1 -- 172.21.15.144:0/370751183 <== osd.2 v2:172.21.15.144:6808/4188068943 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f034c01deb0 con 0x7f0338075c00 2024-05-30T16:53:00.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.502+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 --> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f035c13e020 con 0x7f0338075c00 2024-05-30T16:53:00.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.502+0000 7f0359600640 1 -- 172.21.15.144:0/370751183 <== osd.2 v2:172.21.15.144:6808/4188068943 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f035c13e020 con 0x7f0338075c00 2024-05-30T16:53:00.503 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:53:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T16:53:00.504 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:53:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.502+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f0338075c00 msgr2=0x7f0338078060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.502+0000 7f0363a00640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6808/4188068943,v1:172.21.15.144:6809/4188068943] conn(0x7f0338075c00 0x7f0338078060 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.503+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f033806d940 msgr2=0x7f033806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.503+0000 7f0363a00640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f033806d940 0x7f033806fe00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f035c140b50 tx=0x7f0344008040 comp rx=0 tx=0).stop 2024-05-30T16:53:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.503+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 msgr2=0x7f035c154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.503+0000 7f0363a00640 1 --2- 172.21.15.144:0/370751183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c0b5e00 0x7f035c154e20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f034c00b3f0 tx=0x7f034c00b8b0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.503+0000 7f0361a00640 1 -- 172.21.15.144:0/370751183 reap_dead start 2024-05-30T16:53:00.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.503+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 shutdown_connections 2024-05-30T16:53:00.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.503+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 >> 172.21.15.144:0/370751183 conn(0x7f035c06bd00 msgr2=0x7f035c13fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:00.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.503+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 shutdown_connections 2024-05-30T16:53:00.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.503+0000 7f0363a00640 1 -- 172.21.15.144:0/370751183 wait complete. 2024-05-30T16:53:00.522 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-30T16:53:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.712+0000 7fe735000640 1 Processor -- start 2024-05-30T16:53:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.712+0000 7fe735000640 1 -- start start 2024-05-30T16:53:00.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.714+0000 7fe735000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7301414d0 0x7fe730141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.714+0000 7fe735000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe7301418b0 0x7fe7300b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.714+0000 7fe735000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7300b2c70 0x7fe7301625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.714+0000 7fe735000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe7301422f0 con 0x7fe7301418b0 2024-05-30T16:53:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.714+0000 7fe735000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe7300b3730 con 0x7fe7301414d0 2024-05-30T16:53:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.714+0000 7fe735000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7300b3a10 con 0x7fe7300b2c70 2024-05-30T16:53:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.714+0000 7fe727e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe7301418b0 0x7fe7300b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.715+0000 7fe727e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe7301418b0 0x7fe7300b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47992/0 (socket says 172.21.15.144:47992) 2024-05-30T16:53:00.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.715+0000 7fe727e00640 1 -- 172.21.15.144:0/755441039 learned_addr learned my addr 172.21.15.144:0/755441039 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:00.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.715+0000 7fe72fe00640 1 --2- 172.21.15.144:0/755441039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7300b2c70 0x7fe7301625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.715+0000 7fe72f400640 1 --2- 172.21.15.144:0/755441039 >> v2:172.21.15.149:3300/0 conn(0x7fe7301414d0 0x7fe730141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.715+0000 7fe727e00640 1 -- 172.21.15.144:0/755441039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7300b2c70 msgr2=0x7fe7301625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:00.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.715+0000 7fe727e00640 1 --2- 172.21.15.144:0/755441039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7300b2c70 0x7fe7301625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.715+0000 7fe727e00640 1 -- 172.21.15.144:0/755441039 >> v2:172.21.15.149:3300/0 conn(0x7fe7301414d0 msgr2=0x7fe730141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:00.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.715+0000 7fe727e00640 1 --2- 172.21.15.144:0/755441039 >> v2:172.21.15.149:3300/0 conn(0x7fe7301414d0 0x7fe730141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.715+0000 7fe727e00640 1 -- 172.21.15.144:0/755441039 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7300b3cf0 con 0x7fe7301418b0 2024-05-30T16:53:00.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.716+0000 7fe727e00640 1 --2- 172.21.15.144:0/755441039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7301418b0 0x7fe7300b2730 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe730062e90 tx=0x7fe71802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a209af0bcca79c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.716+0000 7fe72ea00640 1 -- 172.21.15.144:0/755441039 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718037070 con 0x7fe7301418b0 2024-05-30T16:53:00.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.717+0000 7fe72ea00640 1 -- 172.21.15.144:0/755441039 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe718032440 con 0x7fe7301418b0 2024-05-30T16:53:00.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.717+0000 7fe72ea00640 1 -- 172.21.15.144:0/755441039 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718032810 con 0x7fe7301418b0 2024-05-30T16:53:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.717+0000 7fe735000640 1 -- 172.21.15.144:0/755441039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7301418b0 msgr2=0x7fe7300b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.717+0000 7fe735000640 1 --2- 172.21.15.144:0/755441039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7301418b0 0x7fe7300b2730 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe730062e90 tx=0x7fe71802a1e0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.717+0000 7fe735000640 1 -- 172.21.15.144:0/755441039 shutdown_connections 2024-05-30T16:53:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.717+0000 7fe735000640 1 --2- 172.21.15.144:0/755441039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7300b2c70 0x7fe7301625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.717+0000 7fe735000640 1 --2- 172.21.15.144:0/755441039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7301418b0 0x7fe7300b2730 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.717+0000 7fe735000640 1 --2- 172.21.15.144:0/755441039 >> v2:172.21.15.149:3300/0 conn(0x7fe7301414d0 0x7fe730141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.717+0000 7fe735000640 1 -- 172.21.15.144:0/755441039 >> 172.21.15.144:0/755441039 conn(0x7fe7300627b0 msgr2=0x7fe73006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.718+0000 7fe735000640 1 -- 172.21.15.144:0/755441039 shutdown_connections 2024-05-30T16:53:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.718+0000 7fe735000640 1 -- 172.21.15.144:0/755441039 wait complete. 2024-05-30T16:53:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.719+0000 7fe735000640 1 Processor -- start 2024-05-30T16:53:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.719+0000 7fe735000640 1 -- start start 2024-05-30T16:53:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.720+0000 7fe735000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7300b2c70 0x7fe730149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.720+0000 7fe735000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7301414d0 0x7fe730156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.720+0000 7fe735000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7301418b0 0x7fe730157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.720+0000 7fe735000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe730162ca0 con 0x7fe7300b2c70 2024-05-30T16:53:00.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.720+0000 7fe735000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe730162b20 con 0x7fe7301414d0 2024-05-30T16:53:00.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.720+0000 7fe735000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe730162e20 con 0x7fe7301418b0 2024-05-30T16:53:00.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7300b2c70 0x7fe730149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7300b2c70 0x7fe730149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48000/0 (socket says 172.21.15.144:48000) 2024-05-30T16:53:00.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72f400640 1 -- 172.21.15.144:0/4069307681 learned_addr learned my addr 172.21.15.144:0/4069307681 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:00.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72fe00640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7301418b0 0x7fe730157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe727e00640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7301414d0 0x7fe730156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72f400640 1 -- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7301418b0 msgr2=0x7fe730157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72f400640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7301418b0 0x7fe730157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72f400640 1 -- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7301414d0 msgr2=0x7fe730156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72f400640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7301414d0 0x7fe730156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72f400640 1 -- 172.21.15.144:0/4069307681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe730139b30 con 0x7fe7300b2c70 2024-05-30T16:53:00.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72fe00640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7301418b0 0x7fe730157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:00.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe727e00640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7301414d0 0x7fe730156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:00.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.721+0000 7fe72f400640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7300b2c70 0x7fe730149d70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fe72000d830 tx=0x7fe72000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.722+0000 7fe727400640 1 -- 172.21.15.144:0/4069307681 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72000b6c0 con 0x7fe7300b2c70 2024-05-30T16:53:00.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.722+0000 7fe727400640 1 -- 172.21.15.144:0/4069307681 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720019070 con 0x7fe7300b2c70 2024-05-30T16:53:00.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.722+0000 7fe727400640 1 -- 172.21.15.144:0/4069307681 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72000ba80 con 0x7fe7300b2c70 2024-05-30T16:53:00.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.722+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe730139dd0 con 0x7fe7300b2c70 2024-05-30T16:53:00.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.722+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73013a390 con 0x7fe7300b2c70 2024-05-30T16:53:00.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.723+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe730075570 con 0x7fe7300b2c70 2024-05-30T16:53:00.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.724+0000 7fe727400640 1 -- 172.21.15.144:0/4069307681 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7fe72001e460 con 0x7fe7300b2c70 2024-05-30T16:53:00.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.725+0000 7fe727400640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70c06d940 0x7fe70c06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:00.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.726+0000 7fe727400640 1 -- 172.21.15.144:0/4069307681 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fe72008ad30 con 0x7fe7300b2c70 2024-05-30T16:53:00.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.726+0000 7fe727e00640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70c06d940 0x7fe70c06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:00.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.726+0000 7fe727e00640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70c06d940 0x7fe70c06fe00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe718034000 tx=0x7fe71802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:00.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.730+0000 7fe727400640 1 -- 172.21.15.144:0/4069307681 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe72005abb0 con 0x7fe7300b2c70 2024-05-30T16:53:00.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.928+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe7300b5790 con 0x7fe70c06d940 2024-05-30T16:53:00.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.929+0000 7fe727400640 1 -- 172.21.15.144:0/4069307681 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe7300b5790 con 0x7fe70c06d940 2024-05-30T16:53:00.931 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 2 to deep-scrub 2024-05-30T16:53:00.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70c06d940 msgr2=0x7fe70c06fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70c06d940 0x7fe70c06fe00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe718034000 tx=0x7fe71802e000 comp rx=0 tx=0).stop 2024-05-30T16:53:00.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7300b2c70 msgr2=0x7fe730149d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:00.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7300b2c70 0x7fe730149d70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fe72000d830 tx=0x7fe72000dcf0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 shutdown_connections 2024-05-30T16:53:00.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70c06d940 0x7fe70c06fe00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7301418b0 0x7fe730157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7301414d0 0x7fe730156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 --2- 172.21.15.144:0/4069307681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7300b2c70 0x7fe730149d70 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:00.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 >> 172.21.15.144:0/4069307681 conn(0x7fe7300627b0 msgr2=0x7fe73013d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:00.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 shutdown_connections 2024-05-30T16:53:00.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:00.932+0000 7fe735000640 1 -- 172.21.15.144:0/4069307681 wait complete. 2024-05-30T16:53:00.951 INFO:tasks.ceph:Scrubbing osd.3 2024-05-30T16:53:00.952 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-30T16:53:01.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.138+0000 7faf24a00640 1 Processor -- start 2024-05-30T16:53:01.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.138+0000 7faf24a00640 1 -- start start 2024-05-30T16:53:01.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf24a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf200b4510 0x7faf2015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf24a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf2015f620 0x7faf2015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf24a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2006c310 con 0x7faf200b4130 2024-05-30T16:53:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf24a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faf2006cf20 con 0x7faf2015f620 2024-05-30T16:53:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf24a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faf2006c5f0 con 0x7faf200b4510 2024-05-30T16:53:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf1e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf2015f620 0x7faf2015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf1e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf2015f620 0x7faf2015fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48008/0 (socket says 172.21.15.144:48008) 2024-05-30T16:53:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf1e800640 1 -- 172.21.15.144:0/2873862361 learned_addr learned my addr 172.21.15.144:0/2873862361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:01.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf17e00640 1 --2- 172.21.15.144:0/2873862361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf200b4510 0x7faf2015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf1e800640 1 -- 172.21.15.144:0/2873862361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf200b4510 msgr2=0x7faf2015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:01.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf1e800640 1 --2- 172.21.15.144:0/2873862361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf200b4510 0x7faf2015f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf1e800640 1 -- 172.21.15.144:0/2873862361 >> v1:172.21.15.149:6789/0 conn(0x7faf200b4130 legacy=0x7faf2006b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:01.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.140+0000 7faf1e800640 1 -- 172.21.15.144:0/2873862361 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2006c8d0 con 0x7faf2015f620 2024-05-30T16:53:01.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.141+0000 7faf1e800640 1 --2- 172.21.15.144:0/2873862361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf2015f620 0x7faf2015fab0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e50 tx=0x7faf1802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95162db171cd6e47 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.142+0000 7faf1d400640 1 -- 172.21.15.144:0/2873862361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18036070 con 0x7faf2015f620 2024-05-30T16:53:01.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.142+0000 7faf1d400640 1 -- 172.21.15.144:0/2873862361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf18031600 con 0x7faf2015f620 2024-05-30T16:53:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.142+0000 7faf1d400640 1 -- 172.21.15.144:0/2873862361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf180319d0 con 0x7faf2015f620 2024-05-30T16:53:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.142+0000 7faf24a00640 1 -- 172.21.15.144:0/2873862361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf2015f620 msgr2=0x7faf2015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.142+0000 7faf24a00640 1 --2- 172.21.15.144:0/2873862361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf2015f620 0x7faf2015fab0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e50 tx=0x7faf1802a6c0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.142+0000 7faf24a00640 1 -- 172.21.15.144:0/2873862361 shutdown_connections 2024-05-30T16:53:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.142+0000 7faf24a00640 1 --2- 172.21.15.144:0/2873862361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf2015f620 0x7faf2015fab0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.142+0000 7faf24a00640 1 --2- 172.21.15.144:0/2873862361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf200b4510 0x7faf2015f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.143+0000 7faf24a00640 1 -- 172.21.15.144:0/2873862361 >> 172.21.15.144:0/2873862361 conn(0x7faf200b3150 msgr2=0x7faf200d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.143+0000 7faf24a00640 1 -- 172.21.15.144:0/2873862361 shutdown_connections 2024-05-30T16:53:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.143+0000 7faf24a00640 1 -- 172.21.15.144:0/2873862361 wait complete. 2024-05-30T16:53:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.144+0000 7faf24a00640 1 Processor -- start 2024-05-30T16:53:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.144+0000 7faf24a00640 1 -- start start 2024-05-30T16:53:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.145+0000 7faf24a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf200b4130 0x7faf2006f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.145+0000 7faf24a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf200b4510 0x7faf200b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.145+0000 7faf24a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf2015f620 0x7faf200b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.145+0000 7faf24a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faf20168890 con 0x7faf200b4130 2024-05-30T16:53:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.145+0000 7faf24a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf2006bff0 con 0x7faf200b4510 2024-05-30T16:53:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.145+0000 7faf24a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faf20168a10 con 0x7faf2015f620 2024-05-30T16:53:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.145+0000 7faf1de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf200b4130 0x7faf2006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.145+0000 7faf1de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf200b4130 0x7faf2006f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48024/0 (socket says 172.21.15.144:48024) 2024-05-30T16:53:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.145+0000 7faf1de00640 1 -- 172.21.15.144:0/1393951789 learned_addr learned my addr 172.21.15.144:0/1393951789 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:01.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf1e800640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf2015f620 0x7faf200b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf17e00640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf200b4510 0x7faf200b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf1de00640 1 -- 172.21.15.144:0/1393951789 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf2015f620 msgr2=0x7faf200b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf1de00640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf2015f620 0x7faf200b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf1de00640 1 -- 172.21.15.144:0/1393951789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf200b4510 msgr2=0x7faf200b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf1de00640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf200b4510 0x7faf200b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf1de00640 1 -- 172.21.15.144:0/1393951789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf20153560 con 0x7faf200b4130 2024-05-30T16:53:01.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf1de00640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf200b4130 0x7faf2006f070 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7faf1000c430 tx=0x7faf1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf16000640 1 -- 172.21.15.144:0/1393951789 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10011790 con 0x7faf200b4130 2024-05-30T16:53:01.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf16000640 1 -- 172.21.15.144:0/1393951789 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf10017070 con 0x7faf200b4130 2024-05-30T16:53:01.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf20153840 con 0x7faf200b4130 2024-05-30T16:53:01.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.146+0000 7faf16000640 1 -- 172.21.15.144:0/1393951789 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10011bb0 con 0x7faf200b4130 2024-05-30T16:53:01.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.147+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf20153e00 con 0x7faf200b4130 2024-05-30T16:53:01.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.147+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf20075f70 con 0x7faf200b4130 2024-05-30T16:53:01.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.149+0000 7faf16000640 1 -- 172.21.15.144:0/1393951789 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7faf1001c460 con 0x7faf200b4130 2024-05-30T16:53:01.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.149+0000 7faf16000640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faefc06d940 0x7faefc06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.150+0000 7faf16000640 1 -- 172.21.15.144:0/1393951789 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7faf1008a8b0 con 0x7faf200b4130 2024-05-30T16:53:01.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.150+0000 7faf17e00640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faefc06d940 0x7faefc06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.150+0000 7faf16000640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7faefc075c60 0x7faefc0780c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.150+0000 7faf16000640 1 -- 172.21.15.144:0/1393951789 --> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf10021e50 con 0x7faefc075c60 2024-05-30T16:53:01.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.150+0000 7faf16000640 1 -- 172.21.15.144:0/1393951789 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7faf10095050 con 0x7faf200b4130 2024-05-30T16:53:01.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.150+0000 7faf1e800640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7faefc075c60 0x7faefc0780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.150+0000 7faf17e00640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faefc06d940 0x7faefc06fe00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faf08006fd0 tx=0x7faf08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.151+0000 7faf1e800640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7faefc075c60 0x7faefc0780c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.151+0000 7faf16000640 1 -- 172.21.15.144:0/1393951789 <== osd.3 v2:172.21.15.144:6824/3462006210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf10021e50 con 0x7faefc075c60 2024-05-30T16:53:01.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.165+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 --> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faf2006b8e0 con 0x7faefc075c60 2024-05-30T16:53:01.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.166+0000 7faf16000640 1 -- 172.21.15.144:0/1393951789 <== osd.3 v2:172.21.15.144:6824/3462006210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faf2006b8e0 con 0x7faefc075c60 2024-05-30T16:53:01.167 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:53:01.167 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T16:53:01.168 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:53:01.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.166+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7faefc075c60 msgr2=0x7faefc0780c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.166+0000 7faf24a00640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6824/3462006210,v1:172.21.15.144:6825/3462006210] conn(0x7faefc075c60 0x7faefc0780c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.166+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faefc06d940 msgr2=0x7faefc06fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.166+0000 7faf24a00640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7faefc06d940 0x7faefc06fe00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faf08006fd0 tx=0x7faf08008040 comp rx=0 tx=0).stop 2024-05-30T16:53:01.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.166+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf200b4130 msgr2=0x7faf2006f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.166+0000 7faf24a00640 1 --2- 172.21.15.144:0/1393951789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf200b4130 0x7faf2006f070 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7faf1000c430 tx=0x7faf1000c8f0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.166+0000 7faf1e800640 1 -- 172.21.15.144:0/1393951789 reap_dead start 2024-05-30T16:53:01.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.166+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 shutdown_connections 2024-05-30T16:53:01.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.167+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 >> 172.21.15.144:0/1393951789 conn(0x7faf200b3150 msgr2=0x7faf200b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:01.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.167+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 shutdown_connections 2024-05-30T16:53:01.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.167+0000 7faf24a00640 1 -- 172.21.15.144:0/1393951789 wait complete. 2024-05-30T16:53:01.184 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-30T16:53:01.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.383+0000 7fe581600640 1 Processor -- start 2024-05-30T16:53:01.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.384+0000 7fe581600640 1 -- start start 2024-05-30T16:53:01.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe581600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe57c070e00 0x7fe57c0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe581600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe57c0b61f0 con 0x7fe57c15e9d0 2024-05-30T16:53:01.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe581600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe57c15edb0 con 0x7fe57c06bff0 2024-05-30T16:53:01.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe581600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe57c0ae480 con 0x7fe57c070e00 2024-05-30T16:53:01.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe57aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe57c15e9d0 0x7fe57c06b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41038/0 (socket says 172.21.15.144:41038) 2024-05-30T16:53:01.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe57aa00640 1 -- 172.21.15.144:0/3840035161 learned_addr learned my addr 172.21.15.144:0/3840035161 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:53:01.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe57b400640 1 --2- 172.21.15.144:0/3840035161 >> v2:172.21.15.144:3300/0 conn(0x7fe57c070e00 0x7fe57c0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe579600640 1 -- 172.21.15.144:0/3840035161 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659203928 0 0) 0x7fe57c0b61f0 con 0x7fe57c15e9d0 2024-05-30T16:53:01.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe579600640 1 -- 172.21.15.144:0/3840035161 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe560003520 con 0x7fe57c15e9d0 2024-05-30T16:53:01.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.386+0000 7fe57b400640 1 -- 172.21.15.144:0/3840035161 >> v1:172.21.15.149:6789/0 conn(0x7fe57c06bff0 legacy=0x7fe57c0ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:01.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.387+0000 7fe57b400640 1 -- 172.21.15.144:0/3840035161 >> v1:172.21.15.144:6789/0 conn(0x7fe57c15e9d0 legacy=0x7fe57c06b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.387+0000 7fe57b400640 1 -- 172.21.15.144:0/3840035161 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57c0703b0 con 0x7fe57c070e00 2024-05-30T16:53:01.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.388+0000 7fe57b400640 1 --2- 172.21.15.144:0/3840035161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 0x7fe57c0b0bb0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe574009d90 tx=0x7fe57402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f811e76f5e9ec553 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.388+0000 7fe579600640 1 -- 172.21.15.144:0/3840035161 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574007740 con 0x7fe57c070e00 2024-05-30T16:53:01.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.388+0000 7fe579600640 1 -- 172.21.15.144:0/3840035161 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5740078e0 con 0x7fe57c070e00 2024-05-30T16:53:01.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.388+0000 7fe579600640 1 -- 172.21.15.144:0/3840035161 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574007cb0 con 0x7fe57c070e00 2024-05-30T16:53:01.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.389+0000 7fe581600640 1 -- 172.21.15.144:0/3840035161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 msgr2=0x7fe57c0b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.389+0000 7fe581600640 1 --2- 172.21.15.144:0/3840035161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 0x7fe57c0b0bb0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe574009d90 tx=0x7fe57402a6a0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.389+0000 7fe581600640 1 -- 172.21.15.144:0/3840035161 shutdown_connections 2024-05-30T16:53:01.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.389+0000 7fe581600640 1 --2- 172.21.15.144:0/3840035161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 0x7fe57c0b0bb0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.389+0000 7fe581600640 1 -- 172.21.15.144:0/3840035161 >> 172.21.15.144:0/3840035161 conn(0x7fe57c0734c0 msgr2=0x7fe57c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:01.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.389+0000 7fe581600640 1 -- 172.21.15.144:0/3840035161 shutdown_connections 2024-05-30T16:53:01.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.389+0000 7fe581600640 1 -- 172.21.15.144:0/3840035161 wait complete. 2024-05-30T16:53:01.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.390+0000 7fe581600640 1 Processor -- start 2024-05-30T16:53:01.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.391+0000 7fe581600640 1 -- start start 2024-05-30T16:53:01.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.391+0000 7fe581600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe57c06bff0 0x7fe57c145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.391+0000 7fe581600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 0x7fe57c153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.391+0000 7fe581600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe57c15e9d0 0x7fe57c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.391+0000 7fe581600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c070030 con 0x7fe57c070e00 2024-05-30T16:53:01.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.391+0000 7fe581600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c0b6770 con 0x7fe57c15e9d0 2024-05-30T16:53:01.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.391+0000 7fe581600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe57c0af020 con 0x7fe57c06bff0 2024-05-30T16:53:01.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 0x7fe57c153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 0x7fe57c153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48048/0 (socket says 172.21.15.144:48048) 2024-05-30T16:53:01.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57a000640 1 -- 172.21.15.144:0/853466 learned_addr learned my addr 172.21.15.144:0/853466 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:01.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57aa00640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe57c06bff0 0x7fe57c145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57b400640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe57c15e9d0 0x7fe57c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57a000640 1 -- 172.21.15.144:0/853466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe57c06bff0 msgr2=0x7fe57c145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57a000640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe57c06bff0 0x7fe57c145b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57a000640 1 -- 172.21.15.144:0/853466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe57c15e9d0 msgr2=0x7fe57c153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57a000640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe57c15e9d0 0x7fe57c153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57a000640 1 -- 172.21.15.144:0/853466 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57c146060 con 0x7fe57c070e00 2024-05-30T16:53:01.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.392+0000 7fe57b400640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe57c15e9d0 0x7fe57c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:01.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.393+0000 7fe57a000640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 0x7fe57c153930 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe56800c430 tx=0x7fe56800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.393+0000 7fe572a00640 1 -- 172.21.15.144:0/853466 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568011790 con 0x7fe57c070e00 2024-05-30T16:53:01.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.393+0000 7fe572a00640 1 -- 172.21.15.144:0/853466 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe568017070 con 0x7fe57c070e00 2024-05-30T16:53:01.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.393+0000 7fe572a00640 1 -- 172.21.15.144:0/853466 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568011bb0 con 0x7fe57c070e00 2024-05-30T16:53:01.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.393+0000 7fe581600640 1 -- 172.21.15.144:0/853466 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe57c15c660 con 0x7fe57c070e00 2024-05-30T16:53:01.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.393+0000 7fe581600640 1 -- 172.21.15.144:0/853466 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe57c15cc20 con 0x7fe57c070e00 2024-05-30T16:53:01.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.394+0000 7fe581600640 1 -- 172.21.15.144:0/853466 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe57c0731b0 con 0x7fe57c070e00 2024-05-30T16:53:01.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.395+0000 7fe572a00640 1 -- 172.21.15.144:0/853466 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7fe56801c460 con 0x7fe57c070e00 2024-05-30T16:53:01.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.396+0000 7fe572a00640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe55c06d940 0x7fe55c06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.396+0000 7fe572a00640 1 -- 172.21.15.144:0/853466 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fe56808a930 con 0x7fe57c070e00 2024-05-30T16:53:01.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.396+0000 7fe57aa00640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe55c06d940 0x7fe55c06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.397+0000 7fe57aa00640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe55c06d940 0x7fe55c06fe00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0010e0 tx=0x7fe56c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.401+0000 7fe572a00640 1 -- 172.21.15.144:0/853466 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe57c0731b0 con 0x7fe57c070e00 2024-05-30T16:53:01.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.608+0000 7fe581600640 1 -- 172.21.15.144:0/853466 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe57c09aad0 con 0x7fe55c06d940 2024-05-30T16:53:01.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.609+0000 7fe572a00640 1 -- 172.21.15.144:0/853466 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe57c09aad0 con 0x7fe55c06d940 2024-05-30T16:53:01.611 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 3 to deep-scrub 2024-05-30T16:53:01.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.612+0000 7fe581600640 1 -- 172.21.15.144:0/853466 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe55c06d940 msgr2=0x7fe55c06fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.612+0000 7fe581600640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe55c06d940 0x7fe55c06fe00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0010e0 tx=0x7fe56c009040 comp rx=0 tx=0).stop 2024-05-30T16:53:01.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.612+0000 7fe581600640 1 -- 172.21.15.144:0/853466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 msgr2=0x7fe57c153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.612+0000 7fe581600640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 0x7fe57c153930 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe56800c430 tx=0x7fe56800c8f0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.613+0000 7fe581600640 1 -- 172.21.15.144:0/853466 shutdown_connections 2024-05-30T16:53:01.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.613+0000 7fe581600640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe55c06d940 0x7fe55c06fe00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.613+0000 7fe581600640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe57c15e9d0 0x7fe57c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.613+0000 7fe581600640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe57c070e00 0x7fe57c153930 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.613+0000 7fe581600640 1 --2- 172.21.15.144:0/853466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe57c06bff0 0x7fe57c145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.613+0000 7fe581600640 1 -- 172.21.15.144:0/853466 >> 172.21.15.144:0/853466 conn(0x7fe57c0734c0 msgr2=0x7fe57c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:01.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.613+0000 7fe581600640 1 -- 172.21.15.144:0/853466 shutdown_connections 2024-05-30T16:53:01.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.613+0000 7fe581600640 1 -- 172.21.15.144:0/853466 wait complete. 2024-05-30T16:53:01.632 INFO:tasks.ceph:Scrubbing osd.4 2024-05-30T16:53:01.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-30T16:53:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.838+0000 7fe311800640 1 Processor -- start 2024-05-30T16:53:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.838+0000 7fe311800640 1 -- start start 2024-05-30T16:53:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.840+0000 7fe311800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe30c13f760 0x7fe30c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.840+0000 7fe311800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe30c0cec70 0x7fe30c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.840+0000 7fe311800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30c06ee80 con 0x7fe30c0b5e00 2024-05-30T16:53:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.840+0000 7fe311800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c1612b0 con 0x7fe30c13f760 2024-05-30T16:53:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.840+0000 7fe311800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c13fb40 con 0x7fe30c0cec70 2024-05-30T16:53:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.840+0000 7fe30aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe30c13f760 0x7fe30c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.841+0000 7fe30b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe30c0b5e00 0x7fe30c142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41048/0 (socket says 172.21.15.144:41048) 2024-05-30T16:53:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.841+0000 7fe30aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe30c13f760 0x7fe30c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48058/0 (socket says 172.21.15.144:48058) 2024-05-30T16:53:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.841+0000 7fe30b400640 1 -- 172.21.15.144:0/2342983925 learned_addr learned my addr 172.21.15.144:0/2342983925 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:53:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.841+0000 7fe302000640 1 --2- 172.21.15.144:0/2342983925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe30c0cec70 0x7fe30c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.841+0000 7fe30aa00640 1 -- 172.21.15.144:0/2342983925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe30c0cec70 msgr2=0x7fe30c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.841+0000 7fe30aa00640 1 --2- 172.21.15.144:0/2342983925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe30c0cec70 0x7fe30c0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.841+0000 7fe30aa00640 1 -- 172.21.15.144:0/2342983925 >> v1:172.21.15.144:6789/0 conn(0x7fe30c0b5e00 legacy=0x7fe30c142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.841+0000 7fe30aa00640 1 -- 172.21.15.144:0/2342983925 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c160730 con 0x7fe30c13f760 2024-05-30T16:53:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.841+0000 7fe30a000640 1 -- 172.21.15.144:0/2342983925 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258342881 0 0) 0x7fe30c06ee80 con 0x7fe30c0b5e00 2024-05-30T16:53:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.842+0000 7fe30aa00640 1 --2- 172.21.15.144:0/2342983925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 0x7fe30c06e940 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0097a0 tx=0x7fe2fc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf1f03835e03074 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.843+0000 7fe30a000640 1 -- 172.21.15.144:0/2342983925 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc037070 con 0x7fe30c13f760 2024-05-30T16:53:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.843+0000 7fe30a000640 1 -- 172.21.15.144:0/2342983925 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc032440 con 0x7fe30c13f760 2024-05-30T16:53:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.843+0000 7fe30a000640 1 -- 172.21.15.144:0/2342983925 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc032810 con 0x7fe30c13f760 2024-05-30T16:53:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.843+0000 7fe311800640 1 -- 172.21.15.144:0/2342983925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 msgr2=0x7fe30c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.843+0000 7fe311800640 1 --2- 172.21.15.144:0/2342983925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 0x7fe30c06e940 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0097a0 tx=0x7fe2fc02a210 comp rx=0 tx=0).stop 2024-05-30T16:53:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.844+0000 7fe311800640 1 -- 172.21.15.144:0/2342983925 shutdown_connections 2024-05-30T16:53:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.844+0000 7fe311800640 1 --2- 172.21.15.144:0/2342983925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe30c0cec70 0x7fe30c0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.844+0000 7fe311800640 1 --2- 172.21.15.144:0/2342983925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 0x7fe30c06e940 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.844+0000 7fe311800640 1 -- 172.21.15.144:0/2342983925 >> 172.21.15.144:0/2342983925 conn(0x7fe30c06bd00 msgr2=0x7fe30c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.844+0000 7fe311800640 1 -- 172.21.15.144:0/2342983925 shutdown_connections 2024-05-30T16:53:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.844+0000 7fe311800640 1 -- 172.21.15.144:0/2342983925 wait complete. 2024-05-30T16:53:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.845+0000 7fe311800640 1 Processor -- start 2024-05-30T16:53:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.846+0000 7fe311800640 1 -- start start 2024-05-30T16:53:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.846+0000 7fe311800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c0b5e00 0x7fe30c13ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.846+0000 7fe311800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe30c0cec70 0x7fe30c153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe311800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 0x7fe30c1f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe311800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c160fd0 con 0x7fe30c13f760 2024-05-30T16:53:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe311800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c160cf0 con 0x7fe30c0b5e00 2024-05-30T16:53:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe311800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c0cf0d0 con 0x7fe30c0cec70 2024-05-30T16:53:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe30b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 0x7fe30c1f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe30b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 0x7fe30c1f83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48072/0 (socket says 172.21.15.144:48072) 2024-05-30T16:53:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe30b400640 1 -- 172.21.15.144:0/3178586542 learned_addr learned my addr 172.21.15.144:0/3178586542 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:01.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe302000640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe30c0cec70 0x7fe30c153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe30aa00640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c0b5e00 0x7fe30c13ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe30b400640 1 -- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe30c0cec70 msgr2=0x7fe30c153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe30b400640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe30c0cec70 0x7fe30c153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe30b400640 1 -- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c0b5e00 msgr2=0x7fe30c13ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe30b400640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c0b5e00 0x7fe30c13ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.847+0000 7fe30b400640 1 -- 172.21.15.144:0/3178586542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c154580 con 0x7fe30c13f760 2024-05-30T16:53:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.848+0000 7fe30b400640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 0x7fe30c1f83a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe30400c7a0 tx=0x7fe30400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.848+0000 7fe303400640 1 -- 172.21.15.144:0/3178586542 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304018070 con 0x7fe30c13f760 2024-05-30T16:53:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.848+0000 7fe303400640 1 -- 172.21.15.144:0/3178586542 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30400a640 con 0x7fe30c13f760 2024-05-30T16:53:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.848+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c154860 con 0x7fe30c13f760 2024-05-30T16:53:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.848+0000 7fe303400640 1 -- 172.21.15.144:0/3178586542 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30400aab0 con 0x7fe30c13f760 2024-05-30T16:53:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.848+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1f88e0 con 0x7fe30c13f760 2024-05-30T16:53:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.849+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe30c075f70 con 0x7fe30c13f760 2024-05-30T16:53:01.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.850+0000 7fe303400640 1 -- 172.21.15.144:0/3178586542 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7fe30401b070 con 0x7fe30c13f760 2024-05-30T16:53:01.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.851+0000 7fe303400640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe2e806d970 0x7fe2e806fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.851+0000 7fe303400640 1 -- 172.21.15.144:0/3178586542 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fe304089fc0 con 0x7fe30c13f760 2024-05-30T16:53:01.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.851+0000 7fe30aa00640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe2e806d970 0x7fe2e806fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.851+0000 7fe303400640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7fe2e8075c30 0x7fe2e8078090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:01.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.852+0000 7fe303400640 1 -- 172.21.15.144:0/3178586542 --> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2e8078760 con 0x7fe2e8075c30 2024-05-30T16:53:01.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.852+0000 7fe303400640 1 -- 172.21.15.144:0/3178586542 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fe304094050 con 0x7fe30c13f760 2024-05-30T16:53:01.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.852+0000 7fe30aa00640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe2e806d970 0x7fe2e806fe30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc034000 tx=0x7fe2fc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.852+0000 7fe302000640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7fe2e8075c30 0x7fe2e8078090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:01.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.853+0000 7fe302000640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7fe2e8075c30 0x7fe2e8078090 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:01.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.855+0000 7fe303400640 1 -- 172.21.15.144:0/3178586542 <== osd.4 v2:172.21.15.149:6800/2150238027 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2e8078760 con 0x7fe2e8075c30 2024-05-30T16:53:01.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.870+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 --> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe30c068b90 con 0x7fe2e8075c30 2024-05-30T16:53:01.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.871+0000 7fe303400640 1 -- 172.21.15.144:0/3178586542 <== osd.4 v2:172.21.15.149:6800/2150238027 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe30c068b90 con 0x7fe2e8075c30 2024-05-30T16:53:01.872 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:53:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T16:53:01.873 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:53:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.871+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7fe2e8075c30 msgr2=0x7fe2e8078090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.871+0000 7fe311800640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.149:6800/2150238027,v1:172.21.15.149:6801/2150238027] conn(0x7fe2e8075c30 0x7fe2e8078090 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.871+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe2e806d970 msgr2=0x7fe2e806fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.871+0000 7fe311800640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe2e806d970 0x7fe2e806fe30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc034000 tx=0x7fe2fc02e000 comp rx=0 tx=0).stop 2024-05-30T16:53:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.871+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 msgr2=0x7fe30c1f83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.871+0000 7fe311800640 1 --2- 172.21.15.144:0/3178586542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe30c13f760 0x7fe30c1f83a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe30400c7a0 tx=0x7fe30400cc60 comp rx=0 tx=0).stop 2024-05-30T16:53:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.871+0000 7fe30b400640 1 -- 172.21.15.144:0/3178586542 reap_dead start 2024-05-30T16:53:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.872+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 shutdown_connections 2024-05-30T16:53:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.872+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 >> 172.21.15.144:0/3178586542 conn(0x7fe30c06bd00 msgr2=0x7fe30c13fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.872+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 shutdown_connections 2024-05-30T16:53:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:01.872+0000 7fe311800640 1 -- 172.21.15.144:0/3178586542 wait complete. 2024-05-30T16:53:01.890 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-30T16:53:02.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.080+0000 7fcbf1000640 1 Processor -- start 2024-05-30T16:53:02.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.080+0000 7fcbf1000640 1 -- start start 2024-05-30T16:53:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.082+0000 7fcbf1000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcbec06f370 0x7fcbec0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.082+0000 7fcbf1000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcbec15bdc0 0x7fcbec15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.082+0000 7fcbf1000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec0b4840 con 0x7fcbec06f750 2024-05-30T16:53:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.082+0000 7fcbf1000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcbec0b45f0 con 0x7fcbec06f370 2024-05-30T16:53:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.082+0000 7fcbf1000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fcbec0b5450 con 0x7fcbec15bdc0 2024-05-30T16:53:02.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.082+0000 7fcbe9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcbec06f370 0x7fcbec0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.082+0000 7fcbe9400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcbec06f750 0x7fcbec073540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41052/0 (socket says 172.21.15.144:41052) 2024-05-30T16:53:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.082+0000 7fcbe9400640 1 -- 172.21.15.144:0/2796238042 learned_addr learned my addr 172.21.15.144:0/2796238042 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:53:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.083+0000 7fcbea800640 1 --2- 172.21.15.144:0/2796238042 >> v2:172.21.15.149:3300/0 conn(0x7fcbec15bdc0 0x7fcbec15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.083+0000 7fcbe9e00640 1 -- 172.21.15.144:0/2796238042 >> v2:172.21.15.149:3300/0 conn(0x7fcbec15bdc0 msgr2=0x7fcbec15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.083+0000 7fcbe9e00640 1 --2- 172.21.15.144:0/2796238042 >> v2:172.21.15.149:3300/0 conn(0x7fcbec15bdc0 0x7fcbec15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.083+0000 7fcbe9e00640 1 -- 172.21.15.144:0/2796238042 >> v1:172.21.15.144:6789/0 conn(0x7fcbec06f750 legacy=0x7fcbec073540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.083+0000 7fcbe9e00640 1 -- 172.21.15.144:0/2796238042 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec0b4b20 con 0x7fcbec06f370 2024-05-30T16:53:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.083+0000 7fcbea800640 1 --2- 172.21.15.144:0/2796238042 >> v2:172.21.15.149:3300/0 conn(0x7fcbec15bdc0 0x7fcbec15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.084+0000 7fcbe9e00640 1 --2- 172.21.15.144:0/2796238042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec06f370 0x7fcbec0cf230 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0b4770 tx=0x7fcbdc02c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604b982284b6d67 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.084+0000 7fcbe8a00640 1 -- 172.21.15.144:0/2796238042 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc031710 con 0x7fcbec06f370 2024-05-30T16:53:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.084+0000 7fcbe8a00640 1 -- 172.21.15.144:0/2796238042 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0318b0 con 0x7fcbec06f370 2024-05-30T16:53:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.084+0000 7fcbe8a00640 1 -- 172.21.15.144:0/2796238042 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc031ca0 con 0x7fcbec06f370 2024-05-30T16:53:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.085+0000 7fcbf1000640 1 -- 172.21.15.144:0/2796238042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec06f370 msgr2=0x7fcbec0cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.085+0000 7fcbf1000640 1 --2- 172.21.15.144:0/2796238042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec06f370 0x7fcbec0cf230 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0b4770 tx=0x7fcbdc02c7c0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.085+0000 7fcbf1000640 1 -- 172.21.15.144:0/2796238042 shutdown_connections 2024-05-30T16:53:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.085+0000 7fcbf1000640 1 --2- 172.21.15.144:0/2796238042 >> v2:172.21.15.149:3300/0 conn(0x7fcbec15bdc0 0x7fcbec15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.085+0000 7fcbf1000640 1 --2- 172.21.15.144:0/2796238042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec06f370 0x7fcbec0cf230 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.085+0000 7fcbf1000640 1 -- 172.21.15.144:0/2796238042 >> 172.21.15.144:0/2796238042 conn(0x7fcbec0b6b10 msgr2=0x7fcbec0b6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.085+0000 7fcbf1000640 1 -- 172.21.15.144:0/2796238042 shutdown_connections 2024-05-30T16:53:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.085+0000 7fcbf1000640 1 -- 172.21.15.144:0/2796238042 wait complete. 2024-05-30T16:53:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.087+0000 7fcbf1000640 1 Processor -- start 2024-05-30T16:53:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.087+0000 7fcbf1000640 1 -- start start 2024-05-30T16:53:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbf1000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbec06f370 0x7fcbec0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbf1000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbec06f750 0x7fcbec14e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbf1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec15bdc0 0x7fcbec0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbf1000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec0b50e0 con 0x7fcbec15bdc0 2024-05-30T16:53:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbf1000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec0cf770 con 0x7fcbec06f370 2024-05-30T16:53:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbf1000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcbec1594b0 con 0x7fcbec06f750 2024-05-30T16:53:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbea800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec15bdc0 0x7fcbec0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbea800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec15bdc0 0x7fcbec0c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48078/0 (socket says 172.21.15.144:48078) 2024-05-30T16:53:02.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbea800640 1 -- 172.21.15.144:0/1271643164 learned_addr learned my addr 172.21.15.144:0/1271643164 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbea800640 1 -- 172.21.15.144:0/1271643164 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbec06f750 msgr2=0x7fcbec14e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.088+0000 7fcbea800640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbec06f750 0x7fcbec14e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.089+0000 7fcbea800640 1 -- 172.21.15.144:0/1271643164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbec06f370 msgr2=0x7fcbec0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.089+0000 7fcbea800640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbec06f370 0x7fcbec0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.089+0000 7fcbea800640 1 -- 172.21.15.144:0/1271643164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec0c8c60 con 0x7fcbec15bdc0 2024-05-30T16:53:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.089+0000 7fcbea800640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec15bdc0 0x7fcbec0c9d00 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c7f0 tx=0x7fcbe400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.089+0000 7fcbe2000640 1 -- 172.21.15.144:0/1271643164 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4015070 con 0x7fcbec15bdc0 2024-05-30T16:53:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.089+0000 7fcbe2000640 1 -- 172.21.15.144:0/1271643164 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe4007820 con 0x7fcbec15bdc0 2024-05-30T16:53:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.089+0000 7fcbe2000640 1 -- 172.21.15.144:0/1271643164 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4007c50 con 0x7fcbec15bdc0 2024-05-30T16:53:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.089+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec0c8f40 con 0x7fcbec15bdc0 2024-05-30T16:53:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.089+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec0c9500 con 0x7fcbec15bdc0 2024-05-30T16:53:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.091+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbec0c9940 con 0x7fcbec15bdc0 2024-05-30T16:53:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.092+0000 7fcbe2000640 1 -- 172.21.15.144:0/1271643164 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7fcbe4018070 con 0x7fcbec15bdc0 2024-05-30T16:53:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.092+0000 7fcbe2000640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcbc806d940 0x7fcbc806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.093+0000 7fcbe2000640 1 -- 172.21.15.144:0/1271643164 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fcbe408abf0 con 0x7fcbec15bdc0 2024-05-30T16:53:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.093+0000 7fcbe9e00640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcbc806d940 0x7fcbc806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.093+0000 7fcbe9e00640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcbc806d940 0x7fcbc806fe00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc036000 tx=0x7fcbdc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.097+0000 7fcbe2000640 1 -- 172.21.15.144:0/1271643164 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcbe405a720 con 0x7fcbec15bdc0 2024-05-30T16:53:02.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.305+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcbec0b1300 con 0x7fcbc806d940 2024-05-30T16:53:02.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.306+0000 7fcbe2000640 1 -- 172.21.15.144:0/1271643164 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcbec0b1300 con 0x7fcbc806d940 2024-05-30T16:53:02.307 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 4 to deep-scrub 2024-05-30T16:53:02.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcbc806d940 msgr2=0x7fcbc806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcbc806d940 0x7fcbc806fe00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc036000 tx=0x7fcbdc030000 comp rx=0 tx=0).stop 2024-05-30T16:53:02.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec15bdc0 msgr2=0x7fcbec0c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec15bdc0 0x7fcbec0c9d00 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c7f0 tx=0x7fcbe400ccb0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 shutdown_connections 2024-05-30T16:53:02.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fcbc806d940 0x7fcbc806fe00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbec15bdc0 0x7fcbec0c9d00 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbec06f750 0x7fcbec14e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 --2- 172.21.15.144:0/1271643164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbec06f370 0x7fcbec0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 >> 172.21.15.144:0/1271643164 conn(0x7fcbec0b6b10 msgr2=0x7fcbec06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:02.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 shutdown_connections 2024-05-30T16:53:02.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.309+0000 7fcbf1000640 1 -- 172.21.15.144:0/1271643164 wait complete. 2024-05-30T16:53:02.329 INFO:tasks.ceph:Scrubbing osd.5 2024-05-30T16:53:02.329 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-30T16:53:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.533+0000 7ff297000640 1 Processor -- start 2024-05-30T16:53:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.533+0000 7ff297000640 1 -- start start 2024-05-30T16:53:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.534+0000 7ff297000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2901418f0 0x7ff29015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.535+0000 7ff297000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2900b3fd0 con 0x7ff290141510 2024-05-30T16:53:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.535+0000 7ff297000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff290144790 con 0x7ff290144020 2024-05-30T16:53:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.535+0000 7ff297000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff29006dfc0 con 0x7ff2901418f0 2024-05-30T16:53:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.535+0000 7ff28fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff290141510 0x7ff2900b5440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41054/0 (socket says 172.21.15.144:41054) 2024-05-30T16:53:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.535+0000 7ff28fe00640 1 -- 172.21.15.144:0/4151110507 learned_addr learned my addr 172.21.15.144:0/4151110507 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:53:02.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.535+0000 7ff287400640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2901418f0 0x7ff29015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697860585 0 0) 0x7ff2900b3fd0 con 0x7ff290141510 2024-05-30T16:53:02.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff274003520 con 0x7ff290141510 2024-05-30T16:53:02.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2536337005 0 0) 0x7ff274003520 con 0x7ff290141510 2024-05-30T16:53:02.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2901418f0 msgr2=0x7ff29015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:02.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2901418f0 0x7ff29015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 >> v1:172.21.15.149:6789/0 conn(0x7ff290144020 legacy=0x7ff29006e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff290144a70 con 0x7ff290141510 2024-05-30T16:53:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7ff280001670 con 0x7ff290141510 2024-05-30T16:53:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 >> v1:172.21.15.144:6789/0 conn(0x7ff290141510 legacy=0x7ff2900b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2740039e0 0x7ff274003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2901418f0 0x7ff274004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff274004d40 0x7ff2740051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff29006dfc0 con 0x7ff2740039e0 2024-05-30T16:53:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff27400bc00 con 0x7ff274004d40 2024-05-30T16:53:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff27400be00 con 0x7ff2901418f0 2024-05-30T16:53:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.536+0000 7ff28fe00640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2740039e0 0x7ff274003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.537+0000 7ff295000640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff274004d40 0x7ff2740051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.537+0000 7ff28fe00640 1 -- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2901418f0 msgr2=0x7ff274004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:02.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.537+0000 7ff28fe00640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2901418f0 0x7ff274004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.537+0000 7ff28fe00640 1 -- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff274004d40 msgr2=0x7ff2740051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:02.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.537+0000 7ff28fe00640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff274004d40 0x7ff2740051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.537+0000 7ff28fe00640 1 -- 172.21.15.144:0/4151110507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff274003520 con 0x7ff2740039e0 2024-05-30T16:53:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.537+0000 7ff295000640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff274004d40 0x7ff2740051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.538+0000 7ff28fe00640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2740039e0 0x7ff274003e00 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c110 tx=0x7ff274005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af0624d0bca9103 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.538+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280007c40 con 0x7ff2740039e0 2024-05-30T16:53:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.538+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff280005ad0 con 0x7ff2740039e0 2024-05-30T16:53:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.538+0000 7ff28f400640 1 -- 172.21.15.144:0/4151110507 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280007070 con 0x7ff2740039e0 2024-05-30T16:53:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.539+0000 7ff297000640 1 -- 172.21.15.144:0/4151110507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2740039e0 msgr2=0x7ff274003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.539+0000 7ff297000640 1 --2- 172.21.15.144:0/4151110507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2740039e0 0x7ff274003e00 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c110 tx=0x7ff274005830 comp rx=0 tx=0).stop 2024-05-30T16:53:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.539+0000 7ff295000640 1 -- 172.21.15.144:0/4151110507 reap_dead start 2024-05-30T16:53:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.539+0000 7ff297000640 1 -- 172.21.15.144:0/4151110507 shutdown_connections 2024-05-30T16:53:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.539+0000 7ff297000640 1 -- 172.21.15.144:0/4151110507 >> 172.21.15.144:0/4151110507 conn(0x7ff29006bd00 msgr2=0x7ff29006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.539+0000 7ff297000640 1 -- 172.21.15.144:0/4151110507 shutdown_connections 2024-05-30T16:53:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.539+0000 7ff297000640 1 -- 172.21.15.144:0/4151110507 wait complete. 2024-05-30T16:53:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.541+0000 7ff297000640 1 Processor -- start 2024-05-30T16:53:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.541+0000 7ff297000640 1 -- start start 2024-05-30T16:53:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.542+0000 7ff297000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2740039e0 0x7ff2900b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.542+0000 7ff297000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff290156ae0 0x7ff290156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.542+0000 7ff297000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2901574a0 0x7ff290145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.542+0000 7ff297000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff290144450 con 0x7ff290156ae0 2024-05-30T16:53:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.542+0000 7ff297000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff29006e210 con 0x7ff2901574a0 2024-05-30T16:53:02.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.542+0000 7ff297000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff2900b5b50 con 0x7ff2740039e0 2024-05-30T16:53:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.542+0000 7ff287400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff290156ae0 0x7ff290156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff287400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff290156ae0 0x7ff290156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48100/0 (socket says 172.21.15.144:48100) 2024-05-30T16:53:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff287400640 1 -- 172.21.15.144:0/3811446110 learned_addr learned my addr 172.21.15.144:0/3811446110 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff28fe00640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2740039e0 0x7ff2900b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff295000640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2901574a0 0x7ff290145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff287400640 1 -- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2740039e0 msgr2=0x7ff2900b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff287400640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2740039e0 0x7ff2900b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff287400640 1 -- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2901574a0 msgr2=0x7ff290145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff287400640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2901574a0 0x7ff290145330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff287400640 1 -- 172.21.15.144:0/3811446110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2901383b0 con 0x7ff290156ae0 2024-05-30T16:53:02.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff28fe00640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2740039e0 0x7ff2900b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:02.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff295000640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2901574a0 0x7ff290145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:02.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.543+0000 7ff287400640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff290156ae0 0x7ff290156f60 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7ff27800e7f0 tx=0x7ff27800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.546+0000 7ff28cc00640 1 -- 172.21.15.144:0/3811446110 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278017070 con 0x7ff290156ae0 2024-05-30T16:53:02.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.546+0000 7ff28cc00640 1 -- 172.21.15.144:0/3811446110 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27800c940 con 0x7ff290156ae0 2024-05-30T16:53:02.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.546+0000 7ff28cc00640 1 -- 172.21.15.144:0/3811446110 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27800cd10 con 0x7ff290156ae0 2024-05-30T16:53:02.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.546+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2900b10d0 con 0x7ff290156ae0 2024-05-30T16:53:02.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.546+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2900b1690 con 0x7ff290156ae0 2024-05-30T16:53:02.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.547+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff290075f70 con 0x7ff290156ae0 2024-05-30T16:53:02.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.548+0000 7ff28cc00640 1 -- 172.21.15.144:0/3811446110 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7ff27801a070 con 0x7ff290156ae0 2024-05-30T16:53:02.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.549+0000 7ff28cc00640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff26c06d970 0x7ff26c06fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.549+0000 7ff28cc00640 1 -- 172.21.15.144:0/3811446110 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7ff27808ab70 con 0x7ff290156ae0 2024-05-30T16:53:02.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.549+0000 7ff28fe00640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff26c06d970 0x7ff26c06fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.549+0000 7ff28cc00640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7ff26c075c90 0x7ff26c0780f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.549+0000 7ff28cc00640 1 -- 172.21.15.144:0/3811446110 --> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff278016ec0 con 0x7ff26c075c90 2024-05-30T16:53:02.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.549+0000 7ff28cc00640 1 -- 172.21.15.144:0/3811446110 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7ff278095050 con 0x7ff290156ae0 2024-05-30T16:53:02.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.550+0000 7ff28fe00640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff26c06d970 0x7ff26c06fe30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff280032000 tx=0x7ff28002d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.550+0000 7ff295000640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7ff26c075c90 0x7ff26c0780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.551+0000 7ff295000640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7ff26c075c90 0x7ff26c0780f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.553+0000 7ff28cc00640 1 -- 172.21.15.144:0/3811446110 <== osd.5 v2:172.21.15.149:6816/668470952 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff278016ec0 con 0x7ff26c075c90 2024-05-30T16:53:02.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.568+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 --> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff290068b90 con 0x7ff26c075c90 2024-05-30T16:53:02.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.569+0000 7ff28cc00640 1 -- 172.21.15.144:0/3811446110 <== osd.5 v2:172.21.15.149:6816/668470952 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff290068b90 con 0x7ff26c075c90 2024-05-30T16:53:02.570 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:53:02.570 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T16:53:02.571 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:53:02.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.569+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7ff26c075c90 msgr2=0x7ff26c0780f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.569+0000 7ff297000640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.149:6816/668470952,v1:172.21.15.149:6817/668470952] conn(0x7ff26c075c90 0x7ff26c0780f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.569+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff26c06d970 msgr2=0x7ff26c06fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.569+0000 7ff297000640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff26c06d970 0x7ff26c06fe30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff280032000 tx=0x7ff28002d000 comp rx=0 tx=0).stop 2024-05-30T16:53:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.569+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff290156ae0 msgr2=0x7ff290156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.569+0000 7ff297000640 1 --2- 172.21.15.144:0/3811446110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff290156ae0 0x7ff290156f60 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7ff27800e7f0 tx=0x7ff27800ecb0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.569+0000 7ff295000640 1 -- 172.21.15.144:0/3811446110 reap_dead start 2024-05-30T16:53:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.570+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 shutdown_connections 2024-05-30T16:53:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.570+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 >> 172.21.15.144:0/3811446110 conn(0x7ff29006bd00 msgr2=0x7ff2900721e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.570+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 shutdown_connections 2024-05-30T16:53:02.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.570+0000 7ff297000640 1 -- 172.21.15.144:0/3811446110 wait complete. 2024-05-30T16:53:02.588 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-30T16:53:02.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.793+0000 7ff0df200640 1 Processor -- start 2024-05-30T16:53:02.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.793+0000 7ff0df200640 1 -- start start 2024-05-30T16:53:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.794+0000 7ff0df200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0d80b14c0 0x7ff0d80b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.794+0000 7ff0df200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d80b1a40 con 0x7ff0d806bff0 2024-05-30T16:53:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.794+0000 7ff0df200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d80b1ce0 con 0x7ff0d815c6e0 2024-05-30T16:53:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.794+0000 7ff0df200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d80b1fc0 con 0x7ff0d80b14c0 2024-05-30T16:53:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.795+0000 7ff0de800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0d80b14c0 0x7ff0d80b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.795+0000 7ff0dd400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff0d806bff0 0x7ff0d80b5330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41064/0 (socket says 172.21.15.144:41064) 2024-05-30T16:53:02.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.795+0000 7ff0dd400640 1 -- 172.21.15.144:0/3939954297 learned_addr learned my addr 172.21.15.144:0/3939954297 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:53:02.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.795+0000 7ff0dca00640 1 -- 172.21.15.144:0/3939954297 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757875810 0 0) 0x7ff0d80b1a40 con 0x7ff0d806bff0 2024-05-30T16:53:02.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.795+0000 7ff0dca00640 1 -- 172.21.15.144:0/3939954297 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0c0003520 con 0x7ff0d806bff0 2024-05-30T16:53:02.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.795+0000 7ff0de800640 1 -- 172.21.15.144:0/3939954297 >> v1:172.21.15.149:6789/0 conn(0x7ff0d815c6e0 legacy=0x7ff0d806b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.795+0000 7ff0de800640 1 -- 172.21.15.144:0/3939954297 >> v1:172.21.15.144:6789/0 conn(0x7ff0d806bff0 legacy=0x7ff0d80b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.795+0000 7ff0de800640 1 -- 172.21.15.144:0/3939954297 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d80b4e10 con 0x7ff0d80b14c0 2024-05-30T16:53:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.797+0000 7ff0de800640 1 --2- 172.21.15.144:0/3939954297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80b14c0 0x7ff0d80b5a40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009d90 tx=0x7ff0d402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff16870043e5fb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.797+0000 7ff0dca00640 1 -- 172.21.15.144:0/3939954297 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4007740 con 0x7ff0d80b14c0 2024-05-30T16:53:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.797+0000 7ff0dca00640 1 -- 172.21.15.144:0/3939954297 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d40078e0 con 0x7ff0d80b14c0 2024-05-30T16:53:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.797+0000 7ff0dca00640 1 -- 172.21.15.144:0/3939954297 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4007c90 con 0x7ff0d80b14c0 2024-05-30T16:53:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.798+0000 7ff0df200640 1 -- 172.21.15.144:0/3939954297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80b14c0 msgr2=0x7ff0d80b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.798+0000 7ff0df200640 1 --2- 172.21.15.144:0/3939954297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80b14c0 0x7ff0d80b5a40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009d90 tx=0x7ff0d402a6f0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.798+0000 7ff0df200640 1 -- 172.21.15.144:0/3939954297 shutdown_connections 2024-05-30T16:53:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.798+0000 7ff0df200640 1 --2- 172.21.15.144:0/3939954297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80b14c0 0x7ff0d80b5a40 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.798+0000 7ff0df200640 1 -- 172.21.15.144:0/3939954297 >> 172.21.15.144:0/3939954297 conn(0x7ff0d809aa30 msgr2=0x7ff0d80b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.798+0000 7ff0df200640 1 -- 172.21.15.144:0/3939954297 shutdown_connections 2024-05-30T16:53:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.798+0000 7ff0df200640 1 -- 172.21.15.144:0/3939954297 wait complete. 2024-05-30T16:53:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.800+0000 7ff0df200640 1 Processor -- start 2024-05-30T16:53:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.800+0000 7ff0df200640 1 -- start start 2024-05-30T16:53:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.801+0000 7ff0df200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d806bff0 0x7ff0d814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.801+0000 7ff0df200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0d80b14c0 0x7ff0d80cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.801+0000 7ff0df200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d815c6e0 0x7ff0d80cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.801+0000 7ff0df200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d815cc40 con 0x7ff0d815c6e0 2024-05-30T16:53:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.801+0000 7ff0df200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d815cac0 con 0x7ff0d806bff0 2024-05-30T16:53:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.801+0000 7ff0df200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d80b6fc0 con 0x7ff0d80b14c0 2024-05-30T16:53:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.801+0000 7ff0de800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d815c6e0 0x7ff0d80cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.801+0000 7ff0de800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d815c6e0 0x7ff0d80cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48122/0 (socket says 172.21.15.144:48122) 2024-05-30T16:53:02.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.801+0000 7ff0de800640 1 -- 172.21.15.144:0/1994379843 learned_addr learned my addr 172.21.15.144:0/1994379843 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0dd400640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0d80b14c0 0x7ff0d80cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0dde00640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d806bff0 0x7ff0d814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0de800640 1 -- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0d80b14c0 msgr2=0x7ff0d80cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0de800640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0d80b14c0 0x7ff0d80cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0de800640 1 -- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d806bff0 msgr2=0x7ff0d814bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0de800640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d806bff0 0x7ff0d814bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:02.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0de800640 1 -- 172.21.15.144:0/1994379843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d80cd640 con 0x7ff0d815c6e0 2024-05-30T16:53:02.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0dd400640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0d80b14c0 0x7ff0d80cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:02.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0dde00640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d806bff0 0x7ff0d814bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:02.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.802+0000 7ff0de800640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d815c6e0 0x7ff0d80cc4c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009d90 tx=0x7ff0d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.803+0000 7ff0d2000640 1 -- 172.21.15.144:0/1994379843 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4040070 con 0x7ff0d815c6e0 2024-05-30T16:53:02.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.803+0000 7ff0d2000640 1 -- 172.21.15.144:0/1994379843 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d4031c40 con 0x7ff0d815c6e0 2024-05-30T16:53:02.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.803+0000 7ff0d2000640 1 -- 172.21.15.144:0/1994379843 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4009450 con 0x7ff0d815c6e0 2024-05-30T16:53:02.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.803+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d80cb420 con 0x7ff0d815c6e0 2024-05-30T16:53:02.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.803+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d80cb9e0 con 0x7ff0d815c6e0 2024-05-30T16:53:02.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.804+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d8075570 con 0x7ff0d815c6e0 2024-05-30T16:53:02.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.805+0000 7ff0d2000640 1 -- 172.21.15.144:0/1994379843 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7ff0d4039040 con 0x7ff0d815c6e0 2024-05-30T16:53:02.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.806+0000 7ff0d2000640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff0bc06d940 0x7ff0bc06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:02.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.807+0000 7ff0d2000640 1 -- 172.21.15.144:0/1994379843 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7ff0d40abbb0 con 0x7ff0d815c6e0 2024-05-30T16:53:02.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.807+0000 7ff0dde00640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff0bc06d940 0x7ff0bc06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:02.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.808+0000 7ff0dde00640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff0bc06d940 0x7ff0bc06fe00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000f60 tx=0x7ff0cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:02.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:02.812+0000 7ff0d2000640 1 -- 172.21.15.144:0/1994379843 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0d407b710 con 0x7ff0d815c6e0 2024-05-30T16:53:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.047+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff0d80b7350 con 0x7ff0bc06d940 2024-05-30T16:53:03.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.048+0000 7ff0d2000640 1 -- 172.21.15.144:0/1994379843 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff0d80b7350 con 0x7ff0bc06d940 2024-05-30T16:53:03.049 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 5 to deep-scrub 2024-05-30T16:53:03.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.050+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff0bc06d940 msgr2=0x7ff0bc06fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.050+0000 7ff0df200640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff0bc06d940 0x7ff0bc06fe00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000f60 tx=0x7ff0cc009040 comp rx=0 tx=0).stop 2024-05-30T16:53:03.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.050+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d815c6e0 msgr2=0x7ff0d80cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.050+0000 7ff0df200640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d815c6e0 0x7ff0d80cc4c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009d90 tx=0x7ff0d4004a40 comp rx=0 tx=0).stop 2024-05-30T16:53:03.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.051+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 shutdown_connections 2024-05-30T16:53:03.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.051+0000 7ff0df200640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff0bc06d940 0x7ff0bc06fe00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.051+0000 7ff0df200640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d815c6e0 0x7ff0d80cc4c0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.051+0000 7ff0df200640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0d80b14c0 0x7ff0d80cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.051+0000 7ff0df200640 1 --2- 172.21.15.144:0/1994379843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d806bff0 0x7ff0d814bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.051+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 >> 172.21.15.144:0/1994379843 conn(0x7ff0d809aa30 msgr2=0x7ff0d806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:03.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.051+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 shutdown_connections 2024-05-30T16:53:03.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.051+0000 7ff0df200640 1 -- 172.21.15.144:0/1994379843 wait complete. 2024-05-30T16:53:03.073 INFO:tasks.ceph:Scrubbing osd.6 2024-05-30T16:53:03.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-30T16:53:03.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.264+0000 7ff653200640 1 Processor -- start 2024-05-30T16:53:03.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.264+0000 7ff653200640 1 -- start start 2024-05-30T16:53:03.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.265+0000 7ff653200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff6540721f0 0x7ff6540cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.266+0000 7ff653200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff654160b90 con 0x7ff654071d60 2024-05-30T16:53:03.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.266+0000 7ff653200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff654160e70 con 0x7ff654146010 2024-05-30T16:53:03.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.266+0000 7ff653200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff6540cce00 con 0x7ff6540721f0 2024-05-30T16:53:03.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.266+0000 7ff651400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff654071d60 0x7ff6540cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41076/0 (socket says 172.21.15.144:41076) 2024-05-30T16:53:03.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.266+0000 7ff651400640 1 -- 172.21.15.144:0/680667888 learned_addr learned my addr 172.21.15.144:0/680667888 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:53:03.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.266+0000 7ff652800640 1 --2- 172.21.15.144:0/680667888 >> v2:172.21.15.149:3300/0 conn(0x7ff6540721f0 0x7ff6540cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.266+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 401505890 0 0) 0x7ff654160b90 con 0x7ff654071d60 2024-05-30T16:53:03.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.266+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff634003520 con 0x7ff654071d60 2024-05-30T16:53:03.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2622800060 0 0) 0x7ff634003520 con 0x7ff654071d60 2024-05-30T16:53:03.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 >> v2:172.21.15.149:3300/0 conn(0x7ff6540721f0 msgr2=0x7ff6540cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:03.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 --2- 172.21.15.144:0/680667888 >> v2:172.21.15.149:3300/0 conn(0x7ff6540721f0 0x7ff6540cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 >> v1:172.21.15.149:6789/0 conn(0x7ff654146010 legacy=0x7ff6541600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:03.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6540cd0e0 con 0x7ff654071d60 2024-05-30T16:53:03.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3370898543 0 0) 0x7ff63c0019f0 con 0x7ff654071d60 2024-05-30T16:53:03.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 >> v1:172.21.15.144:6789/0 conn(0x7ff654071d60 legacy=0x7ff6540cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff634003a00 0x7ff634003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004800 0x7ff634004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6340051c0 0x7ff63400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff6540cce00 con 0x7ff6340051c0 2024-05-30T16:53:03.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff63400c090 con 0x7ff634004800 2024-05-30T16:53:03.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff63400c290 con 0x7ff634003a00 2024-05-30T16:53:03.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.267+0000 7ff652800640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6340051c0 0x7ff63400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.268+0000 7ff651400640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004800 0x7ff634004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.268+0000 7ff652800640 1 -- 172.21.15.144:0/680667888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff634003a00 msgr2=0x7ff634003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:03.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.268+0000 7ff652800640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff634003a00 0x7ff634003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.268+0000 7ff652800640 1 -- 172.21.15.144:0/680667888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004800 msgr2=0x7ff634004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:03.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.268+0000 7ff652800640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004800 0x7ff634004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.268+0000 7ff652800640 1 -- 172.21.15.144:0/680667888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff634003520 con 0x7ff6340051c0 2024-05-30T16:53:03.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.269+0000 7ff652800640 1 -- 172.21.15.144:0/680667888 reap_dead start 2024-05-30T16:53:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.269+0000 7ff652800640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6340051c0 0x7ff63400b9c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009ac0 tx=0x7ff634005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30dfa84d93c70455 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.269+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c009690 con 0x7ff6340051c0 2024-05-30T16:53:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.269+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64c004020 con 0x7ff6340051c0 2024-05-30T16:53:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.269+0000 7ff650a00640 1 -- 172.21.15.144:0/680667888 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c004410 con 0x7ff6340051c0 2024-05-30T16:53:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.270+0000 7ff653200640 1 -- 172.21.15.144:0/680667888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6340051c0 msgr2=0x7ff63400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.270+0000 7ff653200640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6340051c0 0x7ff63400b9c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009ac0 tx=0x7ff634005830 comp rx=0 tx=0).stop 2024-05-30T16:53:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.270+0000 7ff653200640 1 -- 172.21.15.144:0/680667888 shutdown_connections 2024-05-30T16:53:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.270+0000 7ff653200640 1 --2- 172.21.15.144:0/680667888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6340051c0 0x7ff63400b9c0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.270+0000 7ff653200640 1 -- 172.21.15.144:0/680667888 >> 172.21.15.144:0/680667888 conn(0x7ff6540b2160 msgr2=0x7ff6540b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.270+0000 7ff653200640 1 -- 172.21.15.144:0/680667888 shutdown_connections 2024-05-30T16:53:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.270+0000 7ff653200640 1 -- 172.21.15.144:0/680667888 wait complete. 2024-05-30T16:53:03.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.272+0000 7ff653200640 1 Processor -- start 2024-05-30T16:53:03.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.272+0000 7ff653200640 1 -- start start 2024-05-30T16:53:03.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff653200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6340051c0 0x7ff65415bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff653200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6540c6230 0x7ff6540c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff653200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6540c73f0 0x7ff6540aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff653200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff65415cd20 con 0x7ff6540c73f0 2024-05-30T16:53:03.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff653200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff654072600 con 0x7ff6340051c0 2024-05-30T16:53:03.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff653200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff65415cea0 con 0x7ff6540c6230 2024-05-30T16:53:03.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff652800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6540c73f0 0x7ff6540aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff652800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6540c73f0 0x7ff6540aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48144/0 (socket says 172.21.15.144:48144) 2024-05-30T16:53:03.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff652800640 1 -- 172.21.15.144:0/4185241236 learned_addr learned my addr 172.21.15.144:0/4185241236 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff652800640 1 -- 172.21.15.144:0/4185241236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6540c6230 msgr2=0x7ff6540c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff652800640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6540c6230 0x7ff6540c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff652800640 1 -- 172.21.15.144:0/4185241236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6340051c0 msgr2=0x7ff65415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff652800640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6340051c0 0x7ff65415bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.273+0000 7ff652800640 1 -- 172.21.15.144:0/4185241236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6540c5470 con 0x7ff6540c73f0 2024-05-30T16:53:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.274+0000 7ff652800640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6540c73f0 0x7ff6540aee00 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009bb0 tx=0x7ff64c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.274+0000 7ff64a000640 1 -- 172.21.15.144:0/4185241236 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c003e50 con 0x7ff6540c73f0 2024-05-30T16:53:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.274+0000 7ff64a000640 1 -- 172.21.15.144:0/4185241236 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64c03e070 con 0x7ff6540c73f0 2024-05-30T16:53:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.274+0000 7ff64a000640 1 -- 172.21.15.144:0/4185241236 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c039400 con 0x7ff6540c73f0 2024-05-30T16:53:03.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.274+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6540c5750 con 0x7ff6540c73f0 2024-05-30T16:53:03.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.274+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6540c5d10 con 0x7ff6540c73f0 2024-05-30T16:53:03.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.275+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff654075570 con 0x7ff6540c73f0 2024-05-30T16:53:03.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.276+0000 7ff64a000640 1 -- 172.21.15.144:0/4185241236 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7ff64c0395a0 con 0x7ff6540c73f0 2024-05-30T16:53:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.277+0000 7ff64a000640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff63006db10 0x7ff63006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.277+0000 7ff64a000640 1 -- 172.21.15.144:0/4185241236 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7ff64c0ab290 con 0x7ff6540c73f0 2024-05-30T16:53:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.277+0000 7ff651e00640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff63006db10 0x7ff63006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.277+0000 7ff64a000640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7ff630075e30 0x7ff630078290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.278+0000 7ff64a000640 1 -- 172.21.15.144:0/4185241236 --> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff64c044e50 con 0x7ff630075e30 2024-05-30T16:53:03.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.278+0000 7ff64a000640 1 -- 172.21.15.144:0/4185241236 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7ff64c0abd70 con 0x7ff6540c73f0 2024-05-30T16:53:03.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.278+0000 7ff651400640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7ff630075e30 0x7ff630078290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.278+0000 7ff651e00640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff63006db10 0x7ff63006ffd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff6540cc9d0 tx=0x7ff6440079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:03.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.279+0000 7ff651400640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7ff630075e30 0x7ff630078290 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:03.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.281+0000 7ff64a000640 1 -- 172.21.15.144:0/4185241236 <== osd.6 v2:172.21.15.149:6808/1906248048 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff64c044e50 con 0x7ff630075e30 2024-05-30T16:53:03.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.296+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 --> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff654072dc0 con 0x7ff630075e30 2024-05-30T16:53:03.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.297+0000 7ff64a000640 1 -- 172.21.15.144:0/4185241236 <== osd.6 v2:172.21.15.149:6808/1906248048 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff654072dc0 con 0x7ff630075e30 2024-05-30T16:53:03.298 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:53:03.298 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T16:53:03.299 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:53:03.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.297+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7ff630075e30 msgr2=0x7ff630078290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.297+0000 7ff653200640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.149:6808/1906248048,v1:172.21.15.149:6809/1906248048] conn(0x7ff630075e30 0x7ff630078290 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.298+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff63006db10 msgr2=0x7ff63006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.298+0000 7ff653200640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7ff63006db10 0x7ff63006ffd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff6540cc9d0 tx=0x7ff6440079b0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.298+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6540c73f0 msgr2=0x7ff6540aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.298+0000 7ff653200640 1 --2- 172.21.15.144:0/4185241236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6540c73f0 0x7ff6540aee00 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009bb0 tx=0x7ff64c004730 comp rx=0 tx=0).stop 2024-05-30T16:53:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.298+0000 7ff652800640 1 -- 172.21.15.144:0/4185241236 reap_dead start 2024-05-30T16:53:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.298+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 shutdown_connections 2024-05-30T16:53:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.298+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 >> 172.21.15.144:0/4185241236 conn(0x7ff6540b2160 msgr2=0x7ff6540b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.298+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 shutdown_connections 2024-05-30T16:53:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.298+0000 7ff653200640 1 -- 172.21.15.144:0/4185241236 wait complete. 2024-05-30T16:53:03.320 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-30T16:53:03.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.508+0000 7fe666200640 1 Processor -- start 2024-05-30T16:53:03.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.508+0000 7fe666200640 1 -- start start 2024-05-30T16:53:03.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.510+0000 7fe666200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe66015e090 0x7fe66015da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.510+0000 7fe666200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe6601604c0 0x7fe66006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.510+0000 7fe666200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe660160c40 con 0x7fe6600ce390 2024-05-30T16:53:03.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.510+0000 7fe666200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe660160f20 con 0x7fe66015e090 2024-05-30T16:53:03.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.510+0000 7fe666200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe660161200 con 0x7fe6601604c0 2024-05-30T16:53:03.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.510+0000 7fe65ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe66015e090 0x7fe66015da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.510+0000 7fe65ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe66015e090 0x7fe66015da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48152/0 (socket says 172.21.15.144:48152) 2024-05-30T16:53:03.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.510+0000 7fe65ea00640 1 -- 172.21.15.144:0/2692089604 learned_addr learned my addr 172.21.15.144:0/2692089604 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:03.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.510+0000 7fe65fe00640 1 --2- 172.21.15.144:0/2692089604 >> v2:172.21.15.149:3300/0 conn(0x7fe6601604c0 0x7fe66006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.511+0000 7fe65ea00640 1 -- 172.21.15.144:0/2692089604 >> v2:172.21.15.149:3300/0 conn(0x7fe6601604c0 msgr2=0x7fe66006ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:03.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.511+0000 7fe65ea00640 1 --2- 172.21.15.144:0/2692089604 >> v2:172.21.15.149:3300/0 conn(0x7fe6601604c0 0x7fe66006ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.511+0000 7fe65ea00640 1 -- 172.21.15.144:0/2692089604 >> v1:172.21.15.144:6789/0 conn(0x7fe6600ce390 legacy=0x7fe6600ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.511+0000 7fe65ea00640 1 -- 172.21.15.144:0/2692089604 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66006e550 con 0x7fe66015e090 2024-05-30T16:53:03.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.511+0000 7fe65e000640 1 -- 172.21.15.144:0/2692089604 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505340940 0 0) 0x7fe660160c40 con 0x7fe6600ce390 2024-05-30T16:53:03.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.512+0000 7fe65ea00640 1 --2- 172.21.15.144:0/2692089604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe66015e090 0x7fe66015da50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe6600a9540 tx=0x7fe64c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1fa2f42f89a059 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.512+0000 7fe65e000640 1 -- 172.21.15.144:0/2692089604 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c037070 con 0x7fe66015e090 2024-05-30T16:53:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.512+0000 7fe65e000640 1 -- 172.21.15.144:0/2692089604 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64c032440 con 0x7fe66015e090 2024-05-30T16:53:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.512+0000 7fe65e000640 1 -- 172.21.15.144:0/2692089604 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c032810 con 0x7fe66015e090 2024-05-30T16:53:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.513+0000 7fe666200640 1 -- 172.21.15.144:0/2692089604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe66015e090 msgr2=0x7fe66015da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.513+0000 7fe666200640 1 --2- 172.21.15.144:0/2692089604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe66015e090 0x7fe66015da50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe6600a9540 tx=0x7fe64c02a270 comp rx=0 tx=0).stop 2024-05-30T16:53:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.513+0000 7fe666200640 1 -- 172.21.15.144:0/2692089604 shutdown_connections 2024-05-30T16:53:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.513+0000 7fe666200640 1 --2- 172.21.15.144:0/2692089604 >> v2:172.21.15.149:3300/0 conn(0x7fe6601604c0 0x7fe66006ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.513+0000 7fe666200640 1 --2- 172.21.15.144:0/2692089604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe66015e090 0x7fe66015da50 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.513+0000 7fe666200640 1 -- 172.21.15.144:0/2692089604 >> 172.21.15.144:0/2692089604 conn(0x7fe6600629c0 msgr2=0x7fe66006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:03.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.513+0000 7fe666200640 1 -- 172.21.15.144:0/2692089604 shutdown_connections 2024-05-30T16:53:03.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.513+0000 7fe666200640 1 -- 172.21.15.144:0/2692089604 wait complete. 2024-05-30T16:53:03.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.515+0000 7fe666200640 1 Processor -- start 2024-05-30T16:53:03.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.515+0000 7fe666200640 1 -- start start 2024-05-30T16:53:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.516+0000 7fe666200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6600ce390 0x7fe660137df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.516+0000 7fe666200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe66015e090 0x7fe660154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.516+0000 7fe666200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6601604c0 0x7fe6600b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.516+0000 7fe666200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601432b0 con 0x7fe6601604c0 2024-05-30T16:53:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.516+0000 7fe666200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe660143130 con 0x7fe6600ce390 2024-05-30T16:53:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.516+0000 7fe666200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe66006efb0 con 0x7fe66015e090 2024-05-30T16:53:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.516+0000 7fe65fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6601604c0 0x7fe6600b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.516+0000 7fe65fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6601604c0 0x7fe6600b4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48162/0 (socket says 172.21.15.144:48162) 2024-05-30T16:53:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.516+0000 7fe65fe00640 1 -- 172.21.15.144:0/1210057297 learned_addr learned my addr 172.21.15.144:0/1210057297 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.517+0000 7fe65ea00640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe66015e090 0x7fe660154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.517+0000 7fe65fe00640 1 -- 172.21.15.144:0/1210057297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe66015e090 msgr2=0x7fe660154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.517+0000 7fe65fe00640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe66015e090 0x7fe660154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.517+0000 7fe65f400640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6600ce390 0x7fe660137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.517+0000 7fe65fe00640 1 -- 172.21.15.144:0/1210057297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6600ce390 msgr2=0x7fe660137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.517+0000 7fe65fe00640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6600ce390 0x7fe660137df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.517+0000 7fe65fe00640 1 -- 172.21.15.144:0/1210057297 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe660157b70 con 0x7fe6601604c0 2024-05-30T16:53:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.517+0000 7fe65fe00640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6601604c0 0x7fe6600b4ad0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe658007e60 tx=0x7fe65800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.517+0000 7fe657400640 1 -- 172.21.15.144:0/1210057297 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658014420 con 0x7fe6601604c0 2024-05-30T16:53:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.518+0000 7fe657400640 1 -- 172.21.15.144:0/1210057297 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe658019070 con 0x7fe6601604c0 2024-05-30T16:53:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.518+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe660157e50 con 0x7fe6601604c0 2024-05-30T16:53:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.518+0000 7fe657400640 1 -- 172.21.15.144:0/1210057297 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658014820 con 0x7fe6601604c0 2024-05-30T16:53:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.518+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6601559f0 con 0x7fe6601604c0 2024-05-30T16:53:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.519+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66006c870 con 0x7fe6601604c0 2024-05-30T16:53:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.520+0000 7fe657400640 1 -- 172.21.15.144:0/1210057297 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7fe6580149c0 con 0x7fe6601604c0 2024-05-30T16:53:03.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.521+0000 7fe657400640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe64006d970 0x7fe64006fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:03.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.521+0000 7fe657400640 1 -- 172.21.15.144:0/1210057297 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fe65808b220 con 0x7fe6601604c0 2024-05-30T16:53:03.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.521+0000 7fe65f400640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe64006d970 0x7fe64006fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:03.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.522+0000 7fe65f400640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe64006d970 0x7fe64006fe30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe650000f60 tx=0x7fe650009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.526+0000 7fe657400640 1 -- 172.21.15.144:0/1210057297 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe65805ad80 con 0x7fe6601604c0 2024-05-30T16:53:03.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.779+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fe66015de70 con 0x7fe64006d970 2024-05-30T16:53:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.780+0000 7fe657400640 1 -- 172.21.15.144:0/1210057297 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe66015de70 con 0x7fe64006d970 2024-05-30T16:53:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 6 to deep-scrub 2024-05-30T16:53:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe64006d970 msgr2=0x7fe64006fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe64006d970 0x7fe64006fe30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe650000f60 tx=0x7fe650009040 comp rx=0 tx=0).stop 2024-05-30T16:53:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6601604c0 msgr2=0x7fe6600b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6601604c0 0x7fe6600b4ad0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe658007e60 tx=0x7fe65800e4b0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 shutdown_connections 2024-05-30T16:53:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe64006d970 0x7fe64006fe30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6601604c0 0x7fe6600b4ad0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe66015e090 0x7fe660154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 --2- 172.21.15.144:0/1210057297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6600ce390 0x7fe660137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:03.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 >> 172.21.15.144:0/1210057297 conn(0x7fe6600629c0 msgr2=0x7fe660071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:03.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 shutdown_connections 2024-05-30T16:53:03.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:03.784+0000 7fe666200640 1 -- 172.21.15.144:0/1210057297 wait complete. 2024-05-30T16:53:03.807 INFO:tasks.ceph:Scrubbing osd.7 2024-05-30T16:53:03.807 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-30T16:53:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.045+0000 7f351b000640 1 Processor -- start 2024-05-30T16:53:04.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.045+0000 7f351b000640 1 -- start start 2024-05-30T16:53:04.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.046+0000 7f351b000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f351415e910 0x7f35140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.046+0000 7f351b000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35140ba540 0x7f35140cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.046+0000 7f351b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140d2dc0 0x7f35140d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.046+0000 7f351b000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f35140d2930 con 0x7f35140ba540 2024-05-30T16:53:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.046+0000 7f351b000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f35140b9360 con 0x7f351415e910 2024-05-30T16:53:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.046+0000 7f351b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f35140b9640 con 0x7f35140d2dc0 2024-05-30T16:53:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.047+0000 7f3513e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f351415e910 0x7f35140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.048+0000 7f3519000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140d2dc0 0x7f35140d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.048+0000 7f3519000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140d2dc0 0x7f35140d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:56484/0 (socket says 172.21.15.144:56484) 2024-05-30T16:53:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.048+0000 7f3519000640 1 -- 172.21.15.144:0/875077747 learned_addr learned my addr 172.21.15.144:0/875077747 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.049+0000 7f3513e00640 1 -- 172.21.15.144:0/875077747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140d2dc0 msgr2=0x7f35140d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.049+0000 7f3513e00640 1 --2- 172.21.15.144:0/875077747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140d2dc0 0x7f35140d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.049+0000 7f3513400640 1 --2- 172.21.15.144:0/875077747 >> v2:172.21.15.144:3300/0 conn(0x7f35140ba540 0x7f35140cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.049+0000 7f3513e00640 1 -- 172.21.15.144:0/875077747 >> v2:172.21.15.144:3300/0 conn(0x7f35140ba540 msgr2=0x7f35140cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:04.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.049+0000 7f3513e00640 1 --2- 172.21.15.144:0/875077747 >> v2:172.21.15.144:3300/0 conn(0x7f35140ba540 0x7f35140cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.049+0000 7f3513e00640 1 -- 172.21.15.144:0/875077747 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35140b9920 con 0x7f351415e910 2024-05-30T16:53:04.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.049+0000 7f3513400640 1 --2- 172.21.15.144:0/875077747 >> v2:172.21.15.144:3300/0 conn(0x7f35140ba540 0x7f35140cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:04.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.051+0000 7f3513e00640 1 --2- 172.21.15.144:0/875077747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f351415e910 0x7f35140cf4f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f35140d58f0 tx=0x7f350402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c18388f23f236dd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.052+0000 7f3512a00640 1 -- 172.21.15.144:0/875077747 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504037070 con 0x7f351415e910 2024-05-30T16:53:04.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.052+0000 7f3512a00640 1 -- 172.21.15.144:0/875077747 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3504032440 con 0x7f351415e910 2024-05-30T16:53:04.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.052+0000 7f3512a00640 1 -- 172.21.15.144:0/875077747 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504032810 con 0x7f351415e910 2024-05-30T16:53:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.053+0000 7f351b000640 1 -- 172.21.15.144:0/875077747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f351415e910 msgr2=0x7f35140cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.053+0000 7f351b000640 1 --2- 172.21.15.144:0/875077747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f351415e910 0x7f35140cf4f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f35140d58f0 tx=0x7f350402a1c0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.053+0000 7f351b000640 1 -- 172.21.15.144:0/875077747 shutdown_connections 2024-05-30T16:53:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.053+0000 7f351b000640 1 --2- 172.21.15.144:0/875077747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140d2dc0 0x7f35140d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.053+0000 7f351b000640 1 --2- 172.21.15.144:0/875077747 >> v2:172.21.15.144:3300/0 conn(0x7f35140ba540 0x7f35140cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.053+0000 7f351b000640 1 --2- 172.21.15.144:0/875077747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f351415e910 0x7f35140cf4f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.053+0000 7f351b000640 1 -- 172.21.15.144:0/875077747 >> 172.21.15.144:0/875077747 conn(0x7f35140627b0 msgr2=0x7f3514062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.054+0000 7f351b000640 1 -- 172.21.15.144:0/875077747 shutdown_connections 2024-05-30T16:53:04.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.054+0000 7f351b000640 1 -- 172.21.15.144:0/875077747 wait complete. 2024-05-30T16:53:04.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.056+0000 7f351b000640 1 Processor -- start 2024-05-30T16:53:04.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.056+0000 7f351b000640 1 -- start start 2024-05-30T16:53:04.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.057+0000 7f351b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140ba540 0x7f35140ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.057+0000 7f351b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35140d2dc0 0x7f35140ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.057+0000 7f351b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f351415e910 0x7f35140c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.057+0000 7f351b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f351415ee70 con 0x7f35140d2dc0 2024-05-30T16:53:04.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.057+0000 7f351b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f351415ecf0 con 0x7f351415e910 2024-05-30T16:53:04.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.057+0000 7f351b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f35140d3770 con 0x7f35140ba540 2024-05-30T16:53:04.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35140d2dc0 0x7f35140ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3519000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f351415e910 0x7f35140c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35140d2dc0 0x7f35140ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48186/0 (socket says 172.21.15.144:48186) 2024-05-30T16:53:04.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513400640 1 -- 172.21.15.144:0/359039668 learned_addr learned my addr 172.21.15.144:0/359039668 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:04.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513e00640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140ba540 0x7f35140ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513400640 1 -- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140ba540 msgr2=0x7f35140ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513400640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35140ba540 0x7f35140ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513400640 1 -- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f351415e910 msgr2=0x7f35140c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513400640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f351415e910 0x7f35140c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513400640 1 -- 172.21.15.144:0/359039668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35140ccfa0 con 0x7f35140d2dc0 2024-05-30T16:53:04.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.058+0000 7f3513400640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35140d2dc0 0x7f35140ca700 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f350000c7f0 tx=0x7f350000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.059+0000 7f350be00640 1 -- 172.21.15.144:0/359039668 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500015070 con 0x7f35140d2dc0 2024-05-30T16:53:04.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.059+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35140cd280 con 0x7f35140d2dc0 2024-05-30T16:53:04.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.059+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35140c6b00 con 0x7f35140d2dc0 2024-05-30T16:53:04.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.059+0000 7f350be00640 1 -- 172.21.15.144:0/359039668 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3500007a30 con 0x7f35140d2dc0 2024-05-30T16:53:04.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.059+0000 7f350be00640 1 -- 172.21.15.144:0/359039668 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500007e00 con 0x7f35140d2dc0 2024-05-30T16:53:04.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.060+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34ec001030 con 0x7f35140d2dc0 2024-05-30T16:53:04.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.063+0000 7f350be00640 1 -- 172.21.15.144:0/359039668 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f3500018070 con 0x7f35140d2dc0 2024-05-30T16:53:04.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.064+0000 7f350be00640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34f406d940 0x7f34f406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.064+0000 7f350be00640 1 -- 172.21.15.144:0/359039668 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f350008a8a0 con 0x7f35140d2dc0 2024-05-30T16:53:04.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.064+0000 7f3513e00640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34f406d940 0x7f34f406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.064+0000 7f350be00640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f34f4075c00 0x7f34f4078060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.064+0000 7f350be00640 1 -- 172.21.15.144:0/359039668 --> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f350001ce50 con 0x7f34f4075c00 2024-05-30T16:53:04.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.064+0000 7f350be00640 1 -- 172.21.15.144:0/359039668 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f3500095050 con 0x7f35140d2dc0 2024-05-30T16:53:04.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.065+0000 7f3519000640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f34f4075c00 0x7f34f4078060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.065+0000 7f3513e00640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34f406d940 0x7f34f406fe00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3504034000 tx=0x7f350402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.065+0000 7f3519000640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f34f4075c00 0x7f34f4078060 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.066+0000 7f350be00640 1 -- 172.21.15.144:0/359039668 <== osd.7 v2:172.21.15.149:6819/1157548473 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f350001ce50 con 0x7f34f4075c00 2024-05-30T16:53:04.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.083+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 --> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f34ec002e30 con 0x7f34f4075c00 2024-05-30T16:53:04.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.084+0000 7f350be00640 1 -- 172.21.15.144:0/359039668 <== osd.7 v2:172.21.15.149:6819/1157548473 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f34ec002e30 con 0x7f34f4075c00 2024-05-30T16:53:04.085 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-05-30T16:53:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T16:53:04.086 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-05-30T16:53:04.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.084+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f34f4075c00 msgr2=0x7f34f4078060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.084+0000 7f351b000640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.149:6819/1157548473,v1:172.21.15.149:6821/1157548473] conn(0x7f34f4075c00 0x7f34f4078060 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.084+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34f406d940 msgr2=0x7f34f406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.084+0000 7f351b000640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f34f406d940 0x7f34f406fe00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3504034000 tx=0x7f350402e000 comp rx=0 tx=0).stop 2024-05-30T16:53:04.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.084+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35140d2dc0 msgr2=0x7f35140ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.084+0000 7f351b000640 1 --2- 172.21.15.144:0/359039668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35140d2dc0 0x7f35140ca700 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f350000c7f0 tx=0x7f350000cbf0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.085+0000 7f3519000640 1 -- 172.21.15.144:0/359039668 reap_dead start 2024-05-30T16:53:04.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.085+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 shutdown_connections 2024-05-30T16:53:04.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.085+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 >> 172.21.15.144:0/359039668 conn(0x7f35140627b0 msgr2=0x7f35140b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:04.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.085+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 shutdown_connections 2024-05-30T16:53:04.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.085+0000 7f351b000640 1 -- 172.21.15.144:0/359039668 wait complete. 2024-05-30T16:53:04.104 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-30T16:53:04.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.317+0000 7f386cc00640 1 Processor -- start 2024-05-30T16:53:04.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.317+0000 7f386cc00640 1 -- start start 2024-05-30T16:53:04.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.319+0000 7f386cc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f38680cd700 0x7f38681425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.319+0000 7f386cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38680b4e90 0x7f38680b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.319+0000 7f386cc00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38680ce510 con 0x7f3868141f20 2024-05-30T16:53:04.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.319+0000 7f386cc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3868142300 con 0x7f38680cd700 2024-05-30T16:53:04.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.319+0000 7f386cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38680cf100 con 0x7f38680b4e90 2024-05-30T16:53:04.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.320+0000 7f385fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f38680cd700 0x7f38681425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.320+0000 7f385fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f38680cd700 0x7f38681425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:36460/0 (socket says 172.21.15.144:36460) 2024-05-30T16:53:04.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.320+0000 7f385fe00640 1 -- 172.21.15.144:0/3640765916 learned_addr learned my addr 172.21.15.144:0/3640765916 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:04.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.320+0000 7f3866800640 1 --2- 172.21.15.144:0/3640765916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38680b4e90 0x7f38680b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.321+0000 7f385fe00640 1 -- 172.21.15.144:0/3640765916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38680b4e90 msgr2=0x7f38680b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:04.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.321+0000 7f385fe00640 1 --2- 172.21.15.144:0/3640765916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38680b4e90 0x7f38680b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.321+0000 7f385fe00640 1 -- 172.21.15.144:0/3640765916 >> v1:172.21.15.149:6789/0 conn(0x7f3868141f20 legacy=0x7f38680ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.321+0000 7f385fe00640 1 -- 172.21.15.144:0/3640765916 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38680ce7d0 con 0x7f38680cd700 2024-05-30T16:53:04.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.322+0000 7f385fe00640 1 --2- 172.21.15.144:0/3640765916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38680cd700 0x7f38681425b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3850009870 tx=0x7f385002c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=640f47fcbe42b35e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.323+0000 7f3865400640 1 -- 172.21.15.144:0/3640765916 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850038070 con 0x7f38680cd700 2024-05-30T16:53:04.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.323+0000 7f3865400640 1 -- 172.21.15.144:0/3640765916 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3850031710 con 0x7f38680cd700 2024-05-30T16:53:04.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.323+0000 7f3865400640 1 -- 172.21.15.144:0/3640765916 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850031ae0 con 0x7f38680cd700 2024-05-30T16:53:04.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.323+0000 7f386cc00640 1 -- 172.21.15.144:0/3640765916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38680cd700 msgr2=0x7f38681425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.323+0000 7f386cc00640 1 --2- 172.21.15.144:0/3640765916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38680cd700 0x7f38681425b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3850009870 tx=0x7f385002c480 comp rx=0 tx=0).stop 2024-05-30T16:53:04.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.324+0000 7f386cc00640 1 -- 172.21.15.144:0/3640765916 shutdown_connections 2024-05-30T16:53:04.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.324+0000 7f386cc00640 1 --2- 172.21.15.144:0/3640765916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38680b4e90 0x7f38680b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.324+0000 7f386cc00640 1 --2- 172.21.15.144:0/3640765916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38680cd700 0x7f38681425b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.324+0000 7f386cc00640 1 -- 172.21.15.144:0/3640765916 >> 172.21.15.144:0/3640765916 conn(0x7f38680629c0 msgr2=0x7f386806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:04.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.324+0000 7f386cc00640 1 -- 172.21.15.144:0/3640765916 shutdown_connections 2024-05-30T16:53:04.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.324+0000 7f386cc00640 1 -- 172.21.15.144:0/3640765916 wait complete. 2024-05-30T16:53:04.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.327+0000 7f386cc00640 1 Processor -- start 2024-05-30T16:53:04.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.327+0000 7f386cc00640 1 -- start start 2024-05-30T16:53:04.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.328+0000 7f386cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38680b4e90 0x7f386815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.328+0000 7f386cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38680cd700 0x7f38681f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.328+0000 7f386cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3868141f20 0x7f38681f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.328+0000 7f386cc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38680b5860 con 0x7f38680b4e90 2024-05-30T16:53:04.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.328+0000 7f386cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38680ced90 con 0x7f38680cd700 2024-05-30T16:53:04.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.328+0000 7f386cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38680cf590 con 0x7f3868141f20 2024-05-30T16:53:04.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.328+0000 7f3865e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38680b4e90 0x7f386815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.328+0000 7f3865e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38680b4e90 0x7f386815b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48190/0 (socket says 172.21.15.144:48190) 2024-05-30T16:53:04.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.328+0000 7f3865e00640 1 -- 172.21.15.144:0/3713126607 learned_addr learned my addr 172.21.15.144:0/3713126607 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:04.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.329+0000 7f385fe00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38680cd700 0x7f38681f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.329+0000 7f3866800640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3868141f20 0x7f38681f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.329+0000 7f3865e00640 1 -- 172.21.15.144:0/3713126607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3868141f20 msgr2=0x7f38681f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.329+0000 7f3865e00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3868141f20 0x7f38681f8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.329+0000 7f3865e00640 1 -- 172.21.15.144:0/3713126607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38680cd700 msgr2=0x7f38681f86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.329+0000 7f3865e00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38680cd700 0x7f38681f86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.329+0000 7f3865e00640 1 -- 172.21.15.144:0/3713126607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38680ae590 con 0x7f38680b4e90 2024-05-30T16:53:04.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.330+0000 7f3866800640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3868141f20 0x7f38681f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:04.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.330+0000 7f3865e00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38680b4e90 0x7f386815b1b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f385800c3f0 tx=0x7f385800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.330+0000 7f385e000640 1 -- 172.21.15.144:0/3713126607 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38580052d0 con 0x7f38680b4e90 2024-05-30T16:53:04.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.330+0000 7f385e000640 1 -- 172.21.15.144:0/3713126607 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3858005470 con 0x7f38680b4e90 2024-05-30T16:53:04.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.330+0000 7f385e000640 1 -- 172.21.15.144:0/3713126607 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858007260 con 0x7f38680b4e90 2024-05-30T16:53:04.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.330+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38680ae870 con 0x7f38680b4e90 2024-05-30T16:53:04.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.330+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38680aee30 con 0x7f38680b4e90 2024-05-30T16:53:04.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.332+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3868068b20 con 0x7f38680b4e90 2024-05-30T16:53:04.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.333+0000 7f385e000640 1 -- 172.21.15.144:0/3713126607 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f3858007400 con 0x7f38680b4e90 2024-05-30T16:53:04.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.334+0000 7f385e000640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f384406d990 0x7f384406fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.335+0000 7f385e000640 1 -- 172.21.15.144:0/3713126607 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f3858089ea0 con 0x7f38680b4e90 2024-05-30T16:53:04.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.335+0000 7f385fe00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f384406d990 0x7f384406fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.337+0000 7f385fe00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f384406d990 0x7f384406fe50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3850035000 tx=0x7f3850008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.339+0000 7f385e000640 1 -- 172.21.15.144:0/3713126607 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3858059320 con 0x7f38680b4e90 2024-05-30T16:53:04.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.631+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f38680b37b0 con 0x7f384406d990 2024-05-30T16:53:04.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.631+0000 7f385e000640 1 -- 172.21.15.144:0/3713126607 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f38680b37b0 con 0x7f384406d990 2024-05-30T16:53:04.633 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 7 to deep-scrub 2024-05-30T16:53:04.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f384406d990 msgr2=0x7f384406fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f384406d990 0x7f384406fe50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3850035000 tx=0x7f3850008030 comp rx=0 tx=0).stop 2024-05-30T16:53:04.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38680b4e90 msgr2=0x7f386815b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38680b4e90 0x7f386815b1b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f385800c3f0 tx=0x7f385800c8b0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 shutdown_connections 2024-05-30T16:53:04.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f384406d990 0x7f384406fe50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3868141f20 0x7f38681f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38680cd700 0x7f38681f86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 --2- 172.21.15.144:0/3713126607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38680b4e90 0x7f386815b1b0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.634+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 >> 172.21.15.144:0/3713126607 conn(0x7f38680629c0 msgr2=0x7f386815ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:04.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.635+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 shutdown_connections 2024-05-30T16:53:04.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.635+0000 7f386cc00640 1 -- 172.21.15.144:0/3713126607 wait complete. 2024-05-30T16:53:04.660 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:53:04.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.961+0000 7f988aa00640 1 Processor -- start 2024-05-30T16:53:04.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.961+0000 7f988aa00640 1 -- start start 2024-05-30T16:53:04.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.962+0000 7f988aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f988415ec60 0x7f988406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.962+0000 7f988aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f988406cc70 0x7f988406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.963+0000 7f988aa00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98840d08d0 con 0x7f9884162670 2024-05-30T16:53:04.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.963+0000 7f988aa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f988415f5e0 con 0x7f988406cc70 2024-05-30T16:53:04.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.963+0000 7f988aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f988415f8c0 con 0x7f988415ec60 2024-05-30T16:53:04.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.963+0000 7f9883e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f988415ec60 0x7f988406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.963+0000 7f9883e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f988415ec60 0x7f988406d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.144:42666/0 (socket says 172.21.15.144:42666) 2024-05-30T16:53:04.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.963+0000 7f9883e00640 1 -- 172.21.15.144:0/389226974 learned_addr learned my addr 172.21.15.144:0/389226974 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:04.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.963+0000 7f9883400640 1 --2- 172.21.15.144:0/389226974 >> v2:172.21.15.144:3300/0 conn(0x7f988406cc70 0x7f988406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.964+0000 7f9883e00640 1 -- 172.21.15.144:0/389226974 >> v2:172.21.15.144:3300/0 conn(0x7f988406cc70 msgr2=0x7f988406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:04.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.964+0000 7f9883e00640 1 --2- 172.21.15.144:0/389226974 >> v2:172.21.15.144:3300/0 conn(0x7f988406cc70 0x7f988406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.964+0000 7f9883e00640 1 -- 172.21.15.144:0/389226974 >> v1:172.21.15.149:6789/0 conn(0x7f9884162670 legacy=0x7f988409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.964+0000 7f9883e00640 1 -- 172.21.15.144:0/389226974 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988415fba0 con 0x7f988415ec60 2024-05-30T16:53:04.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.965+0000 7f9883e00640 1 --2- 172.21.15.144:0/389226974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f988415ec60 0x7f988406d0e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9874009870 tx=0x7f987402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2a3d1ed77c9fb95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.965+0000 7f9882a00640 1 -- 172.21.15.144:0/389226974 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874037070 con 0x7f988415ec60 2024-05-30T16:53:04.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.965+0000 7f9882a00640 1 -- 172.21.15.144:0/389226974 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9874032440 con 0x7f988415ec60 2024-05-30T16:53:04.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.965+0000 7f9882a00640 1 -- 172.21.15.144:0/389226974 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874032810 con 0x7f988415ec60 2024-05-30T16:53:04.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.966+0000 7f988aa00640 1 -- 172.21.15.144:0/389226974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f988415ec60 msgr2=0x7f988406d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.966+0000 7f988aa00640 1 --2- 172.21.15.144:0/389226974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f988415ec60 0x7f988406d0e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9874009870 tx=0x7f987402a140 comp rx=0 tx=0).stop 2024-05-30T16:53:04.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.966+0000 7f988aa00640 1 -- 172.21.15.144:0/389226974 shutdown_connections 2024-05-30T16:53:04.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.966+0000 7f988aa00640 1 --2- 172.21.15.144:0/389226974 >> v2:172.21.15.144:3300/0 conn(0x7f988406cc70 0x7f988406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.966+0000 7f988aa00640 1 --2- 172.21.15.144:0/389226974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f988415ec60 0x7f988406d0e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.966+0000 7f988aa00640 1 -- 172.21.15.144:0/389226974 >> 172.21.15.144:0/389226974 conn(0x7f98840b4180 msgr2=0x7f98840b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:04.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.966+0000 7f988aa00640 1 -- 172.21.15.144:0/389226974 shutdown_connections 2024-05-30T16:53:04.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.966+0000 7f988aa00640 1 -- 172.21.15.144:0/389226974 wait complete. 2024-05-30T16:53:04.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.968+0000 7f988aa00640 1 Processor -- start 2024-05-30T16:53:04.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.969+0000 7f988aa00640 1 -- start start 2024-05-30T16:53:04.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f988aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406cc70 0x7f9884159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f988aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f988415ec60 0x7f9884071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f988aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9884162670 0x7f98840717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f988aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f98840d1f40 con 0x7f988415ec60 2024-05-30T16:53:04.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f988aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f98840d1dc0 con 0x7f988406cc70 2024-05-30T16:53:04.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f988aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f98840d20c0 con 0x7f9884162670 2024-05-30T16:53:04.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f9883e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406cc70 0x7f9884159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f9883e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406cc70 0x7f9884159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:50264/0 (socket says 172.21.15.144:50264) 2024-05-30T16:53:04.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f9883e00640 1 -- 172.21.15.144:0/3355735023 learned_addr learned my addr 172.21.15.144:0/3355735023 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:04.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f9888a00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9884162670 0x7f98840717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.970+0000 7f9883400640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f988415ec60 0x7f9884071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.971+0000 7f9883e00640 1 -- 172.21.15.144:0/3355735023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9884162670 msgr2=0x7f98840717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.971+0000 7f9883e00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9884162670 0x7f98840717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.971+0000 7f9883e00640 1 -- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f988415ec60 msgr2=0x7f9884071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:04.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.971+0000 7f9883e00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f988415ec60 0x7f9884071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:04.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.971+0000 7f9883e00640 1 -- 172.21.15.144:0/3355735023 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98840ca010 con 0x7f988406cc70 2024-05-30T16:53:04.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.971+0000 7f9888a00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9884162670 0x7f98840717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T16:53:04.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.972+0000 7f9883e00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406cc70 0x7f9884159fc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9874000c00 tx=0x7f98740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.972+0000 7f987be00640 1 -- 172.21.15.144:0/3355735023 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874037040 con 0x7f988406cc70 2024-05-30T16:53:04.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.972+0000 7f987be00640 1 -- 172.21.15.144:0/3355735023 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9874042070 con 0x7f988406cc70 2024-05-30T16:53:04.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.972+0000 7f987be00640 1 -- 172.21.15.144:0/3355735023 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874030880 con 0x7f988406cc70 2024-05-30T16:53:04.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.972+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98840ca2b0 con 0x7f988406cc70 2024-05-30T16:53:04.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.972+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98840ca870 con 0x7f988406cc70 2024-05-30T16:53:04.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.974+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9884068b90 con 0x7f988406cc70 2024-05-30T16:53:04.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.975+0000 7f987be00640 1 -- 172.21.15.144:0/3355735023 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 31) ==== 92519+0+0 (secure 0 0 0) 0x7f9874030a20 con 0x7f988406cc70 2024-05-30T16:53:04.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.976+0000 7f987be00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f986406d940 0x7f986406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:04.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.976+0000 7f987be00640 1 -- 172.21.15.144:0/3355735023 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7f98740aadf0 con 0x7f988406cc70 2024-05-30T16:53:04.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.977+0000 7f9883400640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f986406d940 0x7f986406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:04.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.977+0000 7f9883400640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f986406d940 0x7f986406fe00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f988406d090 tx=0x7f9870009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:04.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:04.981+0000 7f987be00640 1 -- 172.21.15.144:0/3355735023 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f987407a620 con 0x7f988406cc70 2024-05-30T16:53:05.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.280+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9884075f70 con 0x7f986406d940 2024-05-30T16:53:05.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.290+0000 7f987be00640 1 -- 172.21.15.144:0/3355735023 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253551 (secure 0 0 0) 0x7f9870011a00 con 0x7f986406d940 2024-05-30T16:53:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:53:05.296 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:53:05.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f986406d940 msgr2=0x7f986406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:05.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f986406d940 0x7f986406fe00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f988406d090 tx=0x7f9870009190 comp rx=0 tx=0).stop 2024-05-30T16:53:05.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406cc70 msgr2=0x7f9884159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:05.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406cc70 0x7f9884159fc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9874000c00 tx=0x7f98740046c0 comp rx=0 tx=0).stop 2024-05-30T16:53:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 shutdown_connections 2024-05-30T16:53:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7f986406d940 0x7f986406fe00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9884162670 0x7f98840717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f988415ec60 0x7f9884071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 --2- 172.21.15.144:0/3355735023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406cc70 0x7f9884159fc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.297+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 >> 172.21.15.144:0/3355735023 conn(0x7f98840b4180 msgr2=0x7f98840ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.298+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 shutdown_connections 2024-05-30T16:53:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:05.298+0000 7f988aa00640 1 -- 172.21.15.144:0/3355735023 wait complete. 2024-05-30T16:53:05.325 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-05-30T16:53:05.227507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53717297080,"num_objects":12855,"num_object_clones":1,"num_object_copies":25710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12855,"num_whiteouts":1,"num_read":12446,"num_read_kb":49496410,"num_write":14637,"num_write_kb":52460856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15481,"ondisk_log_size":15481,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":105654496,"kb_used_data":104923872,"kb_used_omap":12,"kb_used_meta":730547,"kb_avail":649320224,"statfs":{"total":773094113280,"available":664903909376,"internally_reserved":0,"allocated":107442044928,"data_stored":107437677448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":748080691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004349"},"pg_stats":[{"pgid":"11.3f","version":"74'205","reported_seq":441,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643367+0000","last_change":"2024-05-30T16:50:01.226270+0000","last_active":"2024-05-30T16:52:54.643367+0000","last_peered":"2024-05-30T16:52:54.643367+0000","last_clean":"2024-05-30T16:52:54.643367+0000","last_became_active":"2024-05-30T16:50:01.225529+0000","last_became_peered":"2024-05-30T16:50:01.225529+0000","last_unstale":"2024-05-30T16:52:54.643367+0000","last_undegraded":"2024-05-30T16:52:54.643367+0000","last_fullsized":"2024-05-30T16:52:54.643367+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:12:02.405577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":219,"num_read_kb":897024,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"74'212","reported_seq":436,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653849+0000","last_change":"2024-05-30T16:50:01.205668+0000","last_active":"2024-05-30T16:52:54.653849+0000","last_peered":"2024-05-30T16:52:54.653849+0000","last_clean":"2024-05-30T16:52:54.653849+0000","last_became_active":"2024-05-30T16:50:01.205240+0000","last_became_peered":"2024-05-30T16:50:01.205240+0000","last_unstale":"2024-05-30T16:52:54.653849+0000","last_undegraded":"2024-05-30T16:52:54.653849+0000","last_fullsized":"2024-05-30T16:52:54.653849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":207,"num_read_kb":847872,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"74'222","reported_seq":442,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.638552+0000","last_change":"2024-05-30T16:50:01.216644+0000","last_active":"2024-05-30T16:52:54.638552+0000","last_peered":"2024-05-30T16:52:54.638552+0000","last_clean":"2024-05-30T16:52:54.638552+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:52:54.638552+0000","last_undegraded":"2024-05-30T16:52:54.638552+0000","last_fullsized":"2024-05-30T16:52:54.638552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":202,"num_read_kb":806917,"num_write":210,"num_write_kb":827396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"74'214","reported_seq":357,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.650683+0000","last_change":"2024-05-30T16:50:01.208510+0000","last_active":"2024-05-30T16:52:54.650683+0000","last_peered":"2024-05-30T16:52:54.650683+0000","last_clean":"2024-05-30T16:52:54.650683+0000","last_became_active":"2024-05-30T16:50:01.207604+0000","last_became_peered":"2024-05-30T16:50:01.207604+0000","last_unstale":"2024-05-30T16:52:54.650683+0000","last_undegraded":"2024-05-30T16:52:54.650683+0000","last_fullsized":"2024-05-30T16:52:54.650683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830472192,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":125,"num_read_kb":512000,"num_write":198,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"74'211","reported_seq":350,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.639467+0000","last_change":"2024-05-30T16:50:01.220341+0000","last_active":"2024-05-30T16:52:54.639467+0000","last_peered":"2024-05-30T16:52:54.639467+0000","last_clean":"2024-05-30T16:52:54.639467+0000","last_became_active":"2024-05-30T16:50:01.219925+0000","last_became_peered":"2024-05-30T16:50:01.219925+0000","last_unstale":"2024-05-30T16:52:54.639467+0000","last_undegraded":"2024-05-30T16:52:54.639467+0000","last_fullsized":"2024-05-30T16:52:54.639467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":121,"num_read_kb":495616,"num_write":197,"num_write_kb":798721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"74'221","reported_seq":492,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.647814+0000","last_change":"2024-05-30T16:50:01.205902+0000","last_active":"2024-05-30T16:52:54.647814+0000","last_peered":"2024-05-30T16:52:54.647814+0000","last_clean":"2024-05-30T16:52:54.647814+0000","last_became_active":"2024-05-30T16:50:01.205620+0000","last_became_peered":"2024-05-30T16:50:01.205620+0000","last_unstale":"2024-05-30T16:52:54.647814+0000","last_undegraded":"2024-05-30T16:52:54.647814+0000","last_fullsized":"2024-05-30T16:52:54.647814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":254,"num_read_kb":1028099,"num_write":206,"num_write_kb":827394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"74'217","reported_seq":378,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653701+0000","last_change":"2024-05-30T16:50:01.221623+0000","last_active":"2024-05-30T16:52:54.653701+0000","last_peered":"2024-05-30T16:52:54.653701+0000","last_clean":"2024-05-30T16:52:54.653701+0000","last_became_active":"2024-05-30T16:50:01.215828+0000","last_became_peered":"2024-05-30T16:50:01.215828+0000","last_unstale":"2024-05-30T16:52:54.653701+0000","last_undegraded":"2024-05-30T16:52:54.653701+0000","last_fullsized":"2024-05-30T16:52:54.653701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:03.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":144,"num_read_kb":581634,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"74'201","reported_seq":379,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649111+0000","last_change":"2024-05-30T16:50:01.211114+0000","last_active":"2024-05-30T16:52:54.649111+0000","last_peered":"2024-05-30T16:52:54.649111+0000","last_clean":"2024-05-30T16:52:54.649111+0000","last_became_active":"2024-05-30T16:50:01.210863+0000","last_became_peered":"2024-05-30T16:50:01.210863+0000","last_unstale":"2024-05-30T16:52:54.649111+0000","last_undegraded":"2024-05-30T16:52:54.649111+0000","last_fullsized":"2024-05-30T16:52:54.649111+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:22.258204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":161,"num_read_kb":655361,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"74'225","reported_seq":410,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643865+0000","last_change":"2024-05-30T16:50:01.214939+0000","last_active":"2024-05-30T16:52:54.643865+0000","last_peered":"2024-05-30T16:52:54.643865+0000","last_clean":"2024-05-30T16:52:54.643865+0000","last_became_active":"2024-05-30T16:50:01.214609+0000","last_became_peered":"2024-05-30T16:50:01.214609+0000","last_unstale":"2024-05-30T16:52:54.643865+0000","last_undegraded":"2024-05-30T16:52:54.643865+0000","last_fullsized":"2024-05-30T16:52:54.643865+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":167,"num_read_kb":655367,"num_write":209,"num_write_kb":831491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"74'218","reported_seq":420,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655902+0000","last_change":"2024-05-30T16:50:01.217788+0000","last_active":"2024-05-30T16:52:54.655902+0000","last_peered":"2024-05-30T16:52:54.655902+0000","last_clean":"2024-05-30T16:52:54.655902+0000","last_became_active":"2024-05-30T16:50:01.217506+0000","last_became_peered":"2024-05-30T16:50:01.217506+0000","last_unstale":"2024-05-30T16:52:54.655902+0000","last_undegraded":"2024-05-30T16:52:54.655902+0000","last_fullsized":"2024-05-30T16:52:54.655902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":185,"num_read_kb":745475,"num_write":205,"num_write_kb":831489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"74'235","reported_seq":555,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.644214+0000","last_change":"2024-05-30T16:50:01.218948+0000","last_active":"2024-05-30T16:52:54.644214+0000","last_peered":"2024-05-30T16:52:54.644214+0000","last_clean":"2024-05-30T16:52:54.644214+0000","last_became_active":"2024-05-30T16:50:01.218645+0000","last_became_peered":"2024-05-30T16:50:01.218645+0000","last_unstale":"2024-05-30T16:52:54.644214+0000","last_undegraded":"2024-05-30T16:52:54.644214+0000","last_fullsized":"2024-05-30T16:52:54.644214+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:08:16.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":901775360,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":303,"num_read_kb":1212423,"num_write":221,"num_write_kb":880643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"74'194","reported_seq":495,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.621038+0000","last_change":"2024-05-30T16:50:01.217317+0000","last_active":"2024-05-30T16:52:54.621038+0000","last_peered":"2024-05-30T16:52:54.621038+0000","last_clean":"2024-05-30T16:52:54.621038+0000","last_became_active":"2024-05-30T16:50:01.217020+0000","last_became_peered":"2024-05-30T16:50:01.217020+0000","last_unstale":"2024-05-30T16:52:54.621038+0000","last_undegraded":"2024-05-30T16:52:54.621038+0000","last_fullsized":"2024-05-30T16:52:54.621038+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":763363328,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":283,"num_read_kb":1146883,"num_write":184,"num_write_kb":745473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"74'229","reported_seq":491,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.626294+0000","last_change":"2024-05-30T16:50:01.213490+0000","last_active":"2024-05-30T16:52:54.626294+0000","last_peered":"2024-05-30T16:52:54.626294+0000","last_clean":"2024-05-30T16:52:54.626294+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:52:54.626294+0000","last_undegraded":"2024-05-30T16:52:54.626294+0000","last_fullsized":"2024-05-30T16:52:54.626294+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876609929,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":244,"num_read_kb":983044,"num_write":215,"num_write_kb":856068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"74'226","reported_seq":429,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.647740+0000","last_change":"2024-05-30T16:50:01.229142+0000","last_active":"2024-05-30T16:52:54.647740+0000","last_peered":"2024-05-30T16:52:54.647740+0000","last_clean":"2024-05-30T16:52:54.647740+0000","last_became_active":"2024-05-30T16:50:01.228163+0000","last_became_peered":"2024-05-30T16:50:01.228163+0000","last_unstale":"2024-05-30T16:52:54.647740+0000","last_undegraded":"2024-05-30T16:52:54.647740+0000","last_fullsized":"2024-05-30T16:52:54.647740+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998144,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":185,"num_read_kb":757760,"num_write":213,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"74'224","reported_seq":337,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.637819+0000","last_change":"2024-05-30T16:50:01.213697+0000","last_active":"2024-05-30T16:52:54.637819+0000","last_peered":"2024-05-30T16:52:54.637819+0000","last_clean":"2024-05-30T16:52:54.637819+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:52:54.637819+0000","last_undegraded":"2024-05-30T16:52:54.637819+0000","last_fullsized":"2024-05-30T16:52:54.637819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859832320,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":0,"num_read":95,"num_read_kb":368645,"num_write":209,"num_write_kb":839682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"74'232","reported_seq":412,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655905+0000","last_change":"2024-05-30T16:50:01.215568+0000","last_active":"2024-05-30T16:52:54.655905+0000","last_peered":"2024-05-30T16:52:54.655905+0000","last_clean":"2024-05-30T16:52:54.655905+0000","last_became_active":"2024-05-30T16:50:01.208926+0000","last_became_peered":"2024-05-30T16:50:01.208926+0000","last_unstale":"2024-05-30T16:52:54.655905+0000","last_undegraded":"2024-05-30T16:52:54.655905+0000","last_fullsized":"2024-05-30T16:52:54.655905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":163,"num_read_kb":651268,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"74'213","reported_seq":356,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643927+0000","last_change":"2024-05-30T16:50:01.215004+0000","last_active":"2024-05-30T16:52:54.643927+0000","last_peered":"2024-05-30T16:52:54.643927+0000","last_clean":"2024-05-30T16:52:54.643927+0000","last_became_active":"2024-05-30T16:50:01.211267+0000","last_became_peered":"2024-05-30T16:50:01.211267+0000","last_unstale":"2024-05-30T16:52:54.643927+0000","last_undegraded":"2024-05-30T16:52:54.643927+0000","last_fullsized":"2024-05-30T16:52:54.643927+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055366,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":125,"num_read_kb":503810,"num_write":203,"num_write_kb":823298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"74'222","reported_seq":523,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.631353+0000","last_change":"2024-05-30T16:50:36.531061+0000","last_active":"2024-05-30T16:52:54.631353+0000","last_peered":"2024-05-30T16:52:54.631353+0000","last_clean":"2024-05-30T16:52:54.631353+0000","last_became_active":"2024-05-30T16:50:36.235518+0000","last_became_peered":"2024-05-30T16:50:36.235518+0000","last_unstale":"2024-05-30T16:52:54.631353+0000","last_undegraded":"2024-05-30T16:52:54.631353+0000","last_fullsized":"2024-05-30T16:52:54.631353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860932,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":260,"num_read_kb":1056770,"num_write":205,"num_write_kb":819203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"74'223","reported_seq":444,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.646760+0000","last_change":"2024-05-30T16:50:01.213913+0000","last_active":"2024-05-30T16:52:54.646760+0000","last_peered":"2024-05-30T16:52:54.646760+0000","last_clean":"2024-05-30T16:52:54.646760+0000","last_became_active":"2024-05-30T16:50:01.213651+0000","last_became_peered":"2024-05-30T16:50:01.213651+0000","last_unstale":"2024-05-30T16:52:54.646760+0000","last_undegraded":"2024-05-30T16:52:54.646760+0000","last_fullsized":"2024-05-30T16:52:54.646760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880803840,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":204,"num_read_kb":827394,"num_write":214,"num_write_kb":860162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"74'217","reported_seq":409,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.635275+0000","last_change":"2024-05-30T16:50:01.223666+0000","last_active":"2024-05-30T16:52:54.635275+0000","last_peered":"2024-05-30T16:52:54.635275+0000","last_clean":"2024-05-30T16:52:54.635275+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:52:54.635275+0000","last_undegraded":"2024-05-30T16:52:54.635275+0000","last_fullsized":"2024-05-30T16:52:54.635275+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918152,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"74'241","reported_seq":526,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655150+0000","last_change":"2024-05-30T16:50:01.209725+0000","last_active":"2024-05-30T16:52:54.655150+0000","last_peered":"2024-05-30T16:52:54.655150+0000","last_clean":"2024-05-30T16:52:54.655150+0000","last_became_active":"2024-05-30T16:50:01.209453+0000","last_became_peered":"2024-05-30T16:50:01.209453+0000","last_unstale":"2024-05-30T16:52:54.655150+0000","last_undegraded":"2024-05-30T16:52:54.655150+0000","last_fullsized":"2024-05-30T16:52:54.655150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":918552576,"num_objects":219,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":268,"num_read_kb":1081348,"num_write":225,"num_write_kb":897027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"74'229","reported_seq":428,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.656449+0000","last_change":"2024-05-30T16:50:01.217106+0000","last_active":"2024-05-30T16:52:54.656449+0000","last_peered":"2024-05-30T16:52:54.656449+0000","last_clean":"2024-05-30T16:52:54.656449+0000","last_became_active":"2024-05-30T16:50:01.216565+0000","last_became_peered":"2024-05-30T16:50:01.216565+0000","last_unstale":"2024-05-30T16:52:54.656449+0000","last_undegraded":"2024-05-30T16:52:54.656449+0000","last_fullsized":"2024-05-30T16:52:54.656449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415232,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":208,"num_whiteouts":0,"num_read":182,"num_read_kb":724997,"num_write":214,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"74'218","reported_seq":409,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.652563+0000","last_change":"2024-05-30T16:50:01.230645+0000","last_active":"2024-05-30T16:52:54.652563+0000","last_peered":"2024-05-30T16:52:54.652563+0000","last_clean":"2024-05-30T16:52:54.652563+0000","last_became_active":"2024-05-30T16:50:01.230326+0000","last_became_peered":"2024-05-30T16:50:01.230326+0000","last_unstale":"2024-05-30T16:52:54.652563+0000","last_undegraded":"2024-05-30T16:52:54.652563+0000","last_fullsized":"2024-05-30T16:52:54.652563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:34.972283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":805306368,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":786434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"74'210","reported_seq":387,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653554+0000","last_change":"2024-05-30T16:50:01.222411+0000","last_active":"2024-05-30T16:52:54.653554+0000","last_peered":"2024-05-30T16:52:54.653554+0000","last_clean":"2024-05-30T16:52:54.653554+0000","last_became_active":"2024-05-30T16:50:01.221747+0000","last_became_peered":"2024-05-30T16:50:01.221747+0000","last_unstale":"2024-05-30T16:52:54.653554+0000","last_undegraded":"2024-05-30T16:52:54.653554+0000","last_fullsized":"2024-05-30T16:52:54.653554+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:31:09.263732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":160,"num_read_kb":647170,"num_write":198,"num_write_kb":794626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"74'221","reported_seq":431,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655808+0000","last_change":"2024-05-30T16:50:01.225335+0000","last_active":"2024-05-30T16:52:54.655808+0000","last_peered":"2024-05-30T16:52:54.655808+0000","last_clean":"2024-05-30T16:52:54.655808+0000","last_became_active":"2024-05-30T16:50:01.224947+0000","last_became_peered":"2024-05-30T16:50:01.224947+0000","last_unstale":"2024-05-30T16:52:54.655808+0000","last_undegraded":"2024-05-30T16:52:54.655808+0000","last_fullsized":"2024-05-30T16:52:54.655808+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:24:13.419945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":193,"num_read_kb":778243,"num_write":201,"num_write_kb":798723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"74'210","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.652897+0000","last_change":"2024-05-30T16:50:01.223725+0000","last_active":"2024-05-30T16:52:54.652897+0000","last_peered":"2024-05-30T16:52:54.652897+0000","last_clean":"2024-05-30T16:52:54.652897+0000","last_became_active":"2024-05-30T16:50:01.223128+0000","last_became_peered":"2024-05-30T16:50:01.223128+0000","last_unstale":"2024-05-30T16:52:54.652897+0000","last_undegraded":"2024-05-30T16:52:54.652897+0000","last_fullsized":"2024-05-30T16:52:54.652897+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:16:28.027255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":199,"num_read_kb":815104,"num_write":189,"num_write_kb":774144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"74'214","reported_seq":433,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.641897+0000","last_change":"2024-05-30T16:50:01.221359+0000","last_active":"2024-05-30T16:52:54.641897+0000","last_peered":"2024-05-30T16:52:54.641897+0000","last_clean":"2024-05-30T16:52:54.641897+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:52:54.641897+0000","last_undegraded":"2024-05-30T16:52:54.641897+0000","last_fullsized":"2024-05-30T16:52:54.641897+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":201,"num_read_kb":819201,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"74'190","reported_seq":302,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655706+0000","last_change":"2024-05-30T16:50:01.217815+0000","last_active":"2024-05-30T16:52:54.655706+0000","last_peered":"2024-05-30T16:52:54.655706+0000","last_clean":"2024-05-30T16:52:54.655706+0000","last_became_active":"2024-05-30T16:50:01.217568+0000","last_became_peered":"2024-05-30T16:50:01.217568+0000","last_unstale":"2024-05-30T16:52:54.655706+0000","last_undegraded":"2024-05-30T16:52:54.655706+0000","last_fullsized":"2024-05-30T16:52:54.655706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":759169024,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":95,"num_read_kb":389120,"num_write":183,"num_write_kb":741377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"74'244","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649562+0000","last_change":"2024-05-30T16:50:01.225500+0000","last_active":"2024-05-30T16:52:54.649562+0000","last_peered":"2024-05-30T16:52:54.649562+0000","last_clean":"2024-05-30T16:52:54.649562+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:52:54.649562+0000","last_undegraded":"2024-05-30T16:52:54.649562+0000","last_fullsized":"2024-05-30T16:52:54.649562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931135619,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":213,"num_read_kb":868353,"num_write":223,"num_write_kb":909313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"74'245","reported_seq":455,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653431+0000","last_change":"2024-05-30T16:50:01.227853+0000","last_active":"2024-05-30T16:52:54.653431+0000","last_peered":"2024-05-30T16:52:54.653431+0000","last_clean":"2024-05-30T16:52:54.653431+0000","last_became_active":"2024-05-30T16:50:01.227538+0000","last_became_peered":"2024-05-30T16:50:01.227538+0000","last_unstale":"2024-05-30T16:52:54.653431+0000","last_undegraded":"2024-05-30T16:52:54.653431+0000","last_fullsized":"2024-05-30T16:52:54.653431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:40:15.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910163968,"num_objects":217,"num_object_clones":0,"num_object_copies":434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":193,"num_read_kb":757768,"num_write":225,"num_write_kb":888836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"74'213","reported_seq":515,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.653330+0000","last_change":"2024-05-30T16:50:01.216098+0000","last_active":"2024-05-30T16:52:54.653330+0000","last_peered":"2024-05-30T16:52:54.653330+0000","last_clean":"2024-05-30T16:52:54.653330+0000","last_became_active":"2024-05-30T16:50:01.215541+0000","last_became_peered":"2024-05-30T16:50:01.215541+0000","last_unstale":"2024-05-30T16:52:54.653330+0000","last_undegraded":"2024-05-30T16:52:54.653330+0000","last_fullsized":"2024-05-30T16:52:54.653330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:24:21.672636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":285,"num_read_kb":1150980,"num_write":192,"num_write_kb":770050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"74'219","reported_seq":450,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649407+0000","last_change":"2024-05-30T16:50:01.213699+0000","last_active":"2024-05-30T16:52:54.649407+0000","last_peered":"2024-05-30T16:52:54.649407+0000","last_clean":"2024-05-30T16:52:54.649407+0000","last_became_active":"2024-05-30T16:50:01.212747+0000","last_became_peered":"2024-05-30T16:50:01.212747+0000","last_unstale":"2024-05-30T16:52:54.649407+0000","last_undegraded":"2024-05-30T16:52:54.649407+0000","last_fullsized":"2024-05-30T16:52:54.649407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:01.596644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":214,"num_read_kb":876544,"num_write":201,"num_write_kb":823296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"74'207","reported_seq":352,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.639035+0000","last_change":"2024-05-30T16:50:01.222131+0000","last_active":"2024-05-30T16:52:54.639035+0000","last_peered":"2024-05-30T16:52:54.639035+0000","last_clean":"2024-05-30T16:52:54.639035+0000","last_became_active":"2024-05-30T16:50:01.221781+0000","last_became_peered":"2024-05-30T16:50:01.221781+0000","last_unstale":"2024-05-30T16:52:54.639035+0000","last_undegraded":"2024-05-30T16:52:54.639035+0000","last_fullsized":"2024-05-30T16:52:54.639035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:22:54.069608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826277888,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":197,"num_write_kb":806912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860237+0000","last_change":"2024-05-30T16:50:00.205578+0000","last_active":"2024-05-30T16:50:35.860237+0000","last_peered":"2024-05-30T16:50:35.860237+0000","last_clean":"2024-05-30T16:50:35.860237+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:50:35.860237+0000","last_undegraded":"2024-05-30T16:50:35.860237+0000","last_fullsized":"2024-05-30T16:50:35.860237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:09.041453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'223","reported_seq":446,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643880+0000","last_change":"2024-05-30T16:50:01.208407+0000","last_active":"2024-05-30T16:52:54.643880+0000","last_peered":"2024-05-30T16:52:54.643880+0000","last_clean":"2024-05-30T16:52:54.643880+0000","last_became_active":"2024-05-30T16:50:01.208076+0000","last_became_peered":"2024-05-30T16:50:01.208076+0000","last_unstale":"2024-05-30T16:52:54.643880+0000","last_undegraded":"2024-05-30T16:52:54.643880+0000","last_fullsized":"2024-05-30T16:52:54.643880+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055496,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":205,"num_read_kb":827395,"num_write":205,"num_write_kb":823299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:59.754518+0000","last_change":"2024-05-30T16:52:59.754573+0000","last_active":"2024-05-30T16:52:59.754518+0000","last_peered":"2024-05-30T16:52:59.754518+0000","last_clean":"2024-05-30T16:52:59.754518+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:52:59.754518+0000","last_undegraded":"2024-05-30T16:52:59.754518+0000","last_fullsized":"2024-05-30T16:52:59.754518+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'1","last_scrub_stamp":"2024-05-30T16:52:59.754318+0000","last_deep_scrub":"71'1","last_deep_scrub_stamp":"2024-05-30T16:52:59.754318+0000","last_clean_scrub_stamp":"2024-05-30T16:52:59.754318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:19:57.808372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"74'235","reported_seq":458,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.648963+0000","last_change":"2024-05-30T16:50:01.223695+0000","last_active":"2024-05-30T16:52:54.648963+0000","last_peered":"2024-05-30T16:52:54.648963+0000","last_clean":"2024-05-30T16:52:54.648963+0000","last_became_active":"2024-05-30T16:50:01.223375+0000","last_became_peered":"2024-05-30T16:50:01.223375+0000","last_unstale":"2024-05-30T16:52:54.648963+0000","last_undegraded":"2024-05-30T16:52:54.648963+0000","last_fullsized":"2024-05-30T16:52:54.648963+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:50:12.941486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192709,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":206,"num_read_kb":827396,"num_write":219,"num_write_kb":868356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:00.681206+0000","last_change":"2024-05-30T16:50:00.212444+0000","last_active":"2024-05-30T16:52:00.681206+0000","last_peered":"2024-05-30T16:52:00.681206+0000","last_clean":"2024-05-30T16:52:00.681206+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:52:00.681206+0000","last_undegraded":"2024-05-30T16:52:00.681206+0000","last_fullsized":"2024-05-30T16:52:00.681206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'238","reported_seq":509,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.644158+0000","last_change":"2024-05-30T16:50:01.219674+0000","last_active":"2024-05-30T16:52:54.644158+0000","last_peered":"2024-05-30T16:52:54.644158+0000","last_clean":"2024-05-30T16:52:54.644158+0000","last_became_active":"2024-05-30T16:50:01.219382+0000","last_became_peered":"2024-05-30T16:50:01.219382+0000","last_unstale":"2024-05-30T16:52:54.644158+0000","last_undegraded":"2024-05-30T16:52:54.644158+0000","last_fullsized":"2024-05-30T16:52:54.644158+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:13:19.798795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922746880,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":254,"num_read_kb":1040384,"num_write":220,"num_write_kb":901120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863492+0000","last_change":"2024-05-30T16:50:00.210174+0000","last_active":"2024-05-30T16:50:35.863492+0000","last_peered":"2024-05-30T16:50:35.863492+0000","last_clean":"2024-05-30T16:50:35.863492+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:50:35.863492+0000","last_undegraded":"2024-05-30T16:50:35.863492+0000","last_fullsized":"2024-05-30T16:50:35.863492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"74'205","reported_seq":390,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649988+0000","last_change":"2024-05-30T16:50:01.228355+0000","last_active":"2024-05-30T16:52:54.649988+0000","last_peered":"2024-05-30T16:52:54.649988+0000","last_clean":"2024-05-30T16:52:54.649988+0000","last_became_active":"2024-05-30T16:50:01.225437+0000","last_became_peered":"2024-05-30T16:50:01.225437+0000","last_unstale":"2024-05-30T16:52:54.649988+0000","last_undegraded":"2024-05-30T16:52:54.649988+0000","last_fullsized":"2024-05-30T16:52:54.649988+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:40:00.658265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529413,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":168,"num_read_kb":684033,"num_write":189,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'50","reported_seq":70,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.660626+0000","last_change":"2024-05-30T16:50:00.205334+0000","last_active":"2024-05-30T16:52:54.660626+0000","last_peered":"2024-05-30T16:52:54.660626+0000","last_clean":"2024-05-30T16:52:54.660626+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:52:54.660626+0000","last_undegraded":"2024-05-30T16:52:54.660626+0000","last_fullsized":"2024-05-30T16:52:54.660626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":237750,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"74'225","reported_seq":510,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.655822+0000","last_change":"2024-05-30T16:50:01.213565+0000","last_active":"2024-05-30T16:52:54.655822+0000","last_peered":"2024-05-30T16:52:54.655822+0000","last_clean":"2024-05-30T16:52:54.655822+0000","last_became_active":"2024-05-30T16:50:01.213263+0000","last_became_peered":"2024-05-30T16:50:01.213263+0000","last_unstale":"2024-05-30T16:52:54.655822+0000","last_undegraded":"2024-05-30T16:52:54.655822+0000","last_fullsized":"2024-05-30T16:52:54.655822+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:48.957359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":268,"num_read_kb":1089538,"num_write":204,"num_write_kb":827393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864517+0000","last_change":"2024-05-30T16:50:00.205241+0000","last_active":"2024-05-30T16:50:35.864517+0000","last_peered":"2024-05-30T16:50:35.864517+0000","last_clean":"2024-05-30T16:50:35.864517+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:50:35.864517+0000","last_undegraded":"2024-05-30T16:50:35.864517+0000","last_fullsized":"2024-05-30T16:50:35.864517+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:21:11.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"74'205","reported_seq":434,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.651472+0000","last_change":"2024-05-30T16:50:01.217809+0000","last_active":"2024-05-30T16:52:54.651472+0000","last_peered":"2024-05-30T16:52:54.651472+0000","last_clean":"2024-05-30T16:52:54.651472+0000","last_became_active":"2024-05-30T16:50:01.209406+0000","last_became_peered":"2024-05-30T16:50:01.209406+0000","last_unstale":"2024-05-30T16:52:54.651472+0000","last_undegraded":"2024-05-30T16:52:54.651472+0000","last_fullsized":"2024-05-30T16:52:54.651472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":211,"num_read_kb":856066,"num_write":191,"num_write_kb":774145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:26.293441+0000","last_change":"2024-05-30T16:50:00.213769+0000","last_active":"2024-05-30T16:52:26.293441+0000","last_peered":"2024-05-30T16:52:26.293441+0000","last_clean":"2024-05-30T16:52:26.293441+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:52:26.293441+0000","last_undegraded":"2024-05-30T16:52:26.293441+0000","last_fullsized":"2024-05-30T16:52:26.293441+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"74'209","reported_seq":420,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.641069+0000","last_change":"2024-05-30T16:50:01.214317+0000","last_active":"2024-05-30T16:52:54.641069+0000","last_peered":"2024-05-30T16:52:54.641069+0000","last_clean":"2024-05-30T16:52:54.641069+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:52:54.641069+0000","last_undegraded":"2024-05-30T16:52:54.641069+0000","last_fullsized":"2024-05-30T16:52:54.641069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":738197504,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":193,"num_read_kb":753673,"num_write":186,"num_write_kb":720901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:26.705199+0000","last_change":"2024-05-30T16:50:00.203638+0000","last_active":"2024-05-30T16:52:26.705199+0000","last_peered":"2024-05-30T16:52:26.705199+0000","last_clean":"2024-05-30T16:52:26.705199+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:52:26.705199+0000","last_undegraded":"2024-05-30T16:52:26.705199+0000","last_fullsized":"2024-05-30T16:52:26.705199+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"74'210","reported_seq":340,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.650421+0000","last_change":"2024-05-30T16:50:01.223933+0000","last_active":"2024-05-30T16:52:54.650421+0000","last_peered":"2024-05-30T16:52:54.650421+0000","last_clean":"2024-05-30T16:52:54.650421+0000","last_became_active":"2024-05-30T16:50:01.223472+0000","last_became_peered":"2024-05-30T16:50:01.223472+0000","last_unstale":"2024-05-30T16:52:54.650421+0000","last_undegraded":"2024-05-30T16:52:54.650421+0000","last_fullsized":"2024-05-30T16:52:54.650421+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:15:17.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":113,"num_read_kb":446468,"num_write":189,"num_write_kb":757762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:46.307950+0000","last_change":"2024-05-30T16:50:00.206844+0000","last_active":"2024-05-30T16:50:46.307950+0000","last_peered":"2024-05-30T16:50:46.307950+0000","last_clean":"2024-05-30T16:50:46.307950+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:50:46.307950+0000","last_undegraded":"2024-05-30T16:50:46.307950+0000","last_fullsized":"2024-05-30T16:50:46.307950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:52.154456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"74'189","reported_seq":341,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643168+0000","last_change":"2024-05-30T16:50:36.658725+0000","last_active":"2024-05-30T16:52:54.643168+0000","last_peered":"2024-05-30T16:52:54.643168+0000","last_clean":"2024-05-30T16:52:54.643168+0000","last_became_active":"2024-05-30T16:50:36.236903+0000","last_became_peered":"2024-05-30T16:50:36.236903+0000","last_unstale":"2024-05-30T16:52:54.643168+0000","last_undegraded":"2024-05-30T16:52:54.643168+0000","last_fullsized":"2024-05-30T16:52:54.643168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:48.423179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721420288,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":120,"num_read_kb":483330,"num_write":174,"num_write_kb":704513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863781+0000","last_change":"2024-05-30T16:50:00.210985+0000","last_active":"2024-05-30T16:50:35.863781+0000","last_peered":"2024-05-30T16:50:35.863781+0000","last_clean":"2024-05-30T16:50:35.863781+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:50:35.863781+0000","last_undegraded":"2024-05-30T16:50:35.863781+0000","last_fullsized":"2024-05-30T16:50:35.863781+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:59:17.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"74'215","reported_seq":465,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.651496+0000","last_change":"2024-05-30T16:50:01.205452+0000","last_active":"2024-05-30T16:52:54.651496+0000","last_peered":"2024-05-30T16:52:54.651496+0000","last_clean":"2024-05-30T16:52:54.651496+0000","last_became_active":"2024-05-30T16:50:01.205079+0000","last_became_peered":"2024-05-30T16:50:01.205079+0000","last_unstale":"2024-05-30T16:52:54.651496+0000","last_undegraded":"2024-05-30T16:52:54.651496+0000","last_fullsized":"2024-05-30T16:52:54.651496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:43:55.242483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834666496,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":233,"num_read_kb":946178,"num_write":201,"num_write_kb":815105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'55","reported_seq":75,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:26.643992+0000","last_change":"2024-05-30T16:50:00.206599+0000","last_active":"2024-05-30T16:52:26.643992+0000","last_peered":"2024-05-30T16:52:26.643992+0000","last_clean":"2024-05-30T16:52:26.643992+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:52:26.643992+0000","last_undegraded":"2024-05-30T16:52:26.643992+0000","last_fullsized":"2024-05-30T16:52:26.643992+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'213","reported_seq":415,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.625898+0000","last_change":"2024-05-30T16:50:01.217111+0000","last_active":"2024-05-30T16:52:54.625898+0000","last_peered":"2024-05-30T16:52:54.625898+0000","last_clean":"2024-05-30T16:52:54.625898+0000","last_became_active":"2024-05-30T16:50:01.216841+0000","last_became_peered":"2024-05-30T16:50:01.216841+0000","last_unstale":"2024-05-30T16:52:54.625898+0000","last_undegraded":"2024-05-30T16:52:54.625898+0000","last_fullsized":"2024-05-30T16:52:54.625898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":184,"num_read_kb":737284,"num_write":200,"num_write_kb":794627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'1001","reported_seq":1021,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.583116+0000","last_change":"2024-05-30T16:50:00.208913+0000","last_active":"2024-05-30T16:52:54.583116+0000","last_peered":"2024-05-30T16:52:54.583116+0000","last_clean":"2024-05-30T16:52:54.583116+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:52:54.583116+0000","last_undegraded":"2024-05-30T16:52:54.583116+0000","last_fullsized":"2024-05-30T16:52:54.583116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1001,"log_dups_size":0,"ondisk_log_size":1001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":4470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"74'211","reported_seq":383,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.639576+0000","last_change":"2024-05-30T16:50:01.218900+0000","last_active":"2024-05-30T16:52:54.639576+0000","last_peered":"2024-05-30T16:52:54.639576+0000","last_clean":"2024-05-30T16:52:54.639576+0000","last_became_active":"2024-05-30T16:50:01.218601+0000","last_became_peered":"2024-05-30T16:50:01.218601+0000","last_unstale":"2024-05-30T16:52:54.639576+0000","last_undegraded":"2024-05-30T16:52:54.639576+0000","last_fullsized":"2024-05-30T16:52:54.639576+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:30.501139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":155,"num_read_kb":626690,"num_write":195,"num_write_kb":790529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"74'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:01.240100+0000","last_change":"2024-05-30T16:53:01.240136+0000","last_active":"2024-05-30T16:53:01.240100+0000","last_peered":"2024-05-30T16:53:01.240100+0000","last_clean":"2024-05-30T16:53:01.240100+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:53:01.240100+0000","last_undegraded":"2024-05-30T16:53:01.240100+0000","last_fullsized":"2024-05-30T16:53:01.240100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-05-30T16:53:01.240015+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-05-30T16:53:01.240015+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.240015+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:15:03.485036+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"74'233","reported_seq":401,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.631940+0000","last_change":"2024-05-30T16:50:01.223569+0000","last_active":"2024-05-30T16:52:54.631940+0000","last_peered":"2024-05-30T16:52:54.631940+0000","last_clean":"2024-05-30T16:52:54.631940+0000","last_became_active":"2024-05-30T16:50:01.223101+0000","last_became_peered":"2024-05-30T16:50:01.223101+0000","last_unstale":"2024-05-30T16:52:54.631940+0000","last_undegraded":"2024-05-30T16:52:54.631940+0000","last_fullsized":"2024-05-30T16:52:54.631940+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:26:15.642014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":151,"num_read_kb":610306,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864714+0000","last_change":"2024-05-30T16:50:00.205457+0000","last_active":"2024-05-30T16:50:35.864714+0000","last_peered":"2024-05-30T16:50:35.864714+0000","last_clean":"2024-05-30T16:50:35.864714+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:50:35.864714+0000","last_undegraded":"2024-05-30T16:50:35.864714+0000","last_fullsized":"2024-05-30T16:50:35.864714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:37:09.525231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'197","reported_seq":388,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.647851+0000","last_change":"2024-05-30T16:50:01.212311+0000","last_active":"2024-05-30T16:52:54.647851+0000","last_peered":"2024-05-30T16:52:54.647851+0000","last_clean":"2024-05-30T16:52:54.647851+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:52:54.647851+0000","last_undegraded":"2024-05-30T16:52:54.647851+0000","last_fullsized":"2024-05-30T16:52:54.647851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":185,"num_write_kb":757760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.009845+0000","last_change":"2024-05-30T16:50:00.208941+0000","last_active":"2024-05-30T16:50:36.009845+0000","last_peered":"2024-05-30T16:50:36.009845+0000","last_clean":"2024-05-30T16:50:36.009845+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:50:36.009845+0000","last_undegraded":"2024-05-30T16:50:36.009845+0000","last_fullsized":"2024-05-30T16:50:36.009845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:04.700068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"74'230","reported_seq":444,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.637656+0000","last_change":"2024-05-30T16:50:01.208878+0000","last_active":"2024-05-30T16:52:54.637656+0000","last_peered":"2024-05-30T16:52:54.637656+0000","last_clean":"2024-05-30T16:52:54.637656+0000","last_became_active":"2024-05-30T16:50:01.207140+0000","last_became_peered":"2024-05-30T16:50:01.207140+0000","last_unstale":"2024-05-30T16:52:54.637656+0000","last_undegraded":"2024-05-30T16:52:54.637656+0000","last_fullsized":"2024-05-30T16:52:54.637656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":196,"num_read_kb":782341,"num_write":217,"num_write_kb":872450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.861982+0000","last_change":"2024-05-30T16:50:00.196832+0000","last_active":"2024-05-30T16:50:35.861982+0000","last_peered":"2024-05-30T16:50:35.861982+0000","last_clean":"2024-05-30T16:50:35.861982+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:50:35.861982+0000","last_undegraded":"2024-05-30T16:50:35.861982+0000","last_fullsized":"2024-05-30T16:50:35.861982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:05.081685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"74'226","reported_seq":315,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.654893+0000","last_change":"2024-05-30T16:50:01.215257+0000","last_active":"2024-05-30T16:52:54.654893+0000","last_peered":"2024-05-30T16:52:54.654893+0000","last_clean":"2024-05-30T16:52:54.654893+0000","last_became_active":"2024-05-30T16:50:01.214868+0000","last_became_peered":"2024-05-30T16:50:01.214868+0000","last_unstale":"2024-05-30T16:52:54.654893+0000","last_undegraded":"2024-05-30T16:52:54.654893+0000","last_fullsized":"2024-05-30T16:52:54.654893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:27:07.685499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998275,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":72,"num_read_kb":290817,"num_write":212,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.862616+0000","last_change":"2024-05-30T16:50:00.206888+0000","last_active":"2024-05-30T16:50:35.862616+0000","last_peered":"2024-05-30T16:50:35.862616+0000","last_clean":"2024-05-30T16:50:35.862616+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:50:35.862616+0000","last_undegraded":"2024-05-30T16:50:35.862616+0000","last_fullsized":"2024-05-30T16:50:35.862616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:30.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"74'229","reported_seq":480,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.643484+0000","last_change":"2024-05-30T16:50:01.226504+0000","last_active":"2024-05-30T16:52:54.643484+0000","last_peered":"2024-05-30T16:52:54.643484+0000","last_clean":"2024-05-30T16:52:54.643484+0000","last_became_active":"2024-05-30T16:50:01.225825+0000","last_became_peered":"2024-05-30T16:50:01.225825+0000","last_unstale":"2024-05-30T16:52:54.643484+0000","last_undegraded":"2024-05-30T16:52:54.643484+0000","last_fullsized":"2024-05-30T16:52:54.643484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:38:30.272257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415354,"num_objects":209,"num_object_clones":0,"num_object_copies":418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":234,"num_read_kb":942084,"num_write":213,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863565+0000","last_change":"2024-05-30T16:50:00.201506+0000","last_active":"2024-05-30T16:50:35.863565+0000","last_peered":"2024-05-30T16:50:35.863565+0000","last_clean":"2024-05-30T16:50:35.863565+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:50:35.863565+0000","last_undegraded":"2024-05-30T16:50:35.863565+0000","last_fullsized":"2024-05-30T16:50:35.863565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:33:47.529393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"74'238","reported_seq":432,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.620965+0000","last_change":"2024-05-30T16:50:01.218092+0000","last_active":"2024-05-30T16:52:54.620965+0000","last_peered":"2024-05-30T16:52:54.620965+0000","last_clean":"2024-05-30T16:52:54.620965+0000","last_became_active":"2024-05-30T16:50:01.217748+0000","last_became_peered":"2024-05-30T16:50:01.217748+0000","last_unstale":"2024-05-30T16:52:54.620965+0000","last_undegraded":"2024-05-30T16:52:54.620965+0000","last_fullsized":"2024-05-30T16:52:54.620965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855638016,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":176,"num_read_kb":679946,"num_write":218,"num_write_kb":835591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.863640+0000","last_change":"2024-05-30T16:50:00.201874+0000","last_active":"2024-05-30T16:50:35.863640+0000","last_peered":"2024-05-30T16:50:35.863640+0000","last_clean":"2024-05-30T16:50:35.863640+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:50:35.863640+0000","last_undegraded":"2024-05-30T16:50:35.863640+0000","last_fullsized":"2024-05-30T16:50:35.863640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"74'238","reported_seq":487,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.651997+0000","last_change":"2024-05-30T16:50:01.216958+0000","last_active":"2024-05-30T16:52:54.651997+0000","last_peered":"2024-05-30T16:52:54.651997+0000","last_clean":"2024-05-30T16:52:54.651997+0000","last_became_active":"2024-05-30T16:50:01.216443+0000","last_became_peered":"2024-05-30T16:50:01.216443+0000","last_unstale":"2024-05-30T16:52:54.651997+0000","last_undegraded":"2024-05-30T16:52:54.651997+0000","last_fullsized":"2024-05-30T16:52:54.651997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":926941184,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":231,"num_read_kb":933891,"num_write":223,"num_write_kb":905217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.858053+0000","last_change":"2024-05-30T16:50:00.202315+0000","last_active":"2024-05-30T16:50:35.858053+0000","last_peered":"2024-05-30T16:50:35.858053+0000","last_clean":"2024-05-30T16:50:35.858053+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:50:35.858053+0000","last_undegraded":"2024-05-30T16:50:35.858053+0000","last_fullsized":"2024-05-30T16:50:35.858053+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:54:07.542490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'212","reported_seq":410,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.632678+0000","last_change":"2024-05-30T16:50:01.217916+0000","last_active":"2024-05-30T16:52:54.632678+0000","last_peered":"2024-05-30T16:52:54.632678+0000","last_clean":"2024-05-30T16:52:54.632678+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:52:54.632678+0000","last_undegraded":"2024-05-30T16:52:54.632678+0000","last_fullsized":"2024-05-30T16:52:54.632678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809501194,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":180,"num_read_kb":724995,"num_write":197,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.864794+0000","last_change":"2024-05-30T16:50:00.204870+0000","last_active":"2024-05-30T16:50:35.864794+0000","last_peered":"2024-05-30T16:50:35.864794+0000","last_clean":"2024-05-30T16:50:35.864794+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:50:35.864794+0000","last_undegraded":"2024-05-30T16:50:35.864794+0000","last_fullsized":"2024-05-30T16:50:35.864794+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:12:08.366805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"74'216","reported_seq":365,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.651477+0000","last_change":"2024-05-30T16:50:01.219838+0000","last_active":"2024-05-30T16:52:54.651477+0000","last_peered":"2024-05-30T16:52:54.651477+0000","last_clean":"2024-05-30T16:52:54.651477+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:52:54.651477+0000","last_undegraded":"2024-05-30T16:52:54.651477+0000","last_fullsized":"2024-05-30T16:52:54.651477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801112325,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":131,"num_read_kb":532481,"num_write":194,"num_write_kb":782338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:36.010153+0000","last_change":"2024-05-30T16:50:00.207506+0000","last_active":"2024-05-30T16:50:36.010153+0000","last_peered":"2024-05-30T16:50:36.010153+0000","last_clean":"2024-05-30T16:50:36.010153+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:50:36.010153+0000","last_undegraded":"2024-05-30T16:50:36.010153+0000","last_fullsized":"2024-05-30T16:50:36.010153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:26:47.941977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"74'215","reported_seq":412,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649851+0000","last_change":"2024-05-30T16:50:01.220513+0000","last_active":"2024-05-30T16:52:54.649851+0000","last_peered":"2024-05-30T16:52:54.649851+0000","last_clean":"2024-05-30T16:52:54.649851+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:52:54.649851+0000","last_undegraded":"2024-05-30T16:52:54.649851+0000","last_fullsized":"2024-05-30T16:52:54.649851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":179,"num_read_kb":716804,"num_write":199,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:00.757415+0000","last_change":"2024-05-30T16:53:00.757447+0000","last_active":"2024-05-30T16:53:00.757415+0000","last_peered":"2024-05-30T16:53:00.757415+0000","last_clean":"2024-05-30T16:53:00.757415+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:53:00.757415+0000","last_undegraded":"2024-05-30T16:53:00.757415+0000","last_fullsized":"2024-05-30T16:53:00.757415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:00.757342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:00.757342+0000","last_clean_scrub_stamp":"2024-05-30T16:53:00.757342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:06.921548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"74'223","reported_seq":354,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.624648+0000","last_change":"2024-05-30T16:50:01.212934+0000","last_active":"2024-05-30T16:52:54.624648+0000","last_peered":"2024-05-30T16:52:54.624648+0000","last_clean":"2024-05-30T16:52:54.624648+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:52:54.624648+0000","last_undegraded":"2024-05-30T16:52:54.624648+0000","last_fullsized":"2024-05-30T16:52:54.624648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":113,"num_read_kb":454658,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.862881+0000","last_change":"2024-05-30T16:50:00.206485+0000","last_active":"2024-05-30T16:50:35.862881+0000","last_peered":"2024-05-30T16:50:35.862881+0000","last_clean":"2024-05-30T16:50:35.862881+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:50:35.862881+0000","last_undegraded":"2024-05-30T16:50:35.862881+0000","last_fullsized":"2024-05-30T16:50:35.862881+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:40:46.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"74'226","reported_seq":487,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.647112+0000","last_change":"2024-05-30T16:50:01.225452+0000","last_active":"2024-05-30T16:52:54.647112+0000","last_peered":"2024-05-30T16:52:54.647112+0000","last_clean":"2024-05-30T16:52:54.647112+0000","last_became_active":"2024-05-30T16:50:01.224834+0000","last_became_peered":"2024-05-30T16:50:01.224834+0000","last_unstale":"2024-05-30T16:52:54.647112+0000","last_undegraded":"2024-05-30T16:52:54.647112+0000","last_fullsized":"2024-05-30T16:52:54.647112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:08:15.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":244,"num_read_kb":999424,"num_write":207,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"74'90","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:09.319052+0000","last_change":"2024-05-30T16:50:00.209889+0000","last_active":"2024-05-30T16:52:09.319052+0000","last_peered":"2024-05-30T16:52:09.319052+0000","last_clean":"2024-05-30T16:52:09.319052+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:52:09.319052+0000","last_undegraded":"2024-05-30T16:52:09.319052+0000","last_fullsized":"2024-05-30T16:52:09.319052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:57:00.581262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"74'215","reported_seq":507,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649970+0000","last_change":"2024-05-30T16:50:01.222012+0000","last_active":"2024-05-30T16:52:54.649970+0000","last_peered":"2024-05-30T16:52:54.649970+0000","last_clean":"2024-05-30T16:52:54.649970+0000","last_became_active":"2024-05-30T16:50:01.221622+0000","last_became_peered":"2024-05-30T16:50:01.221622+0000","last_unstale":"2024-05-30T16:52:54.649970+0000","last_undegraded":"2024-05-30T16:52:54.649970+0000","last_fullsized":"2024-05-30T16:52:54.649970+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:07:43.760509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918021,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":275,"num_read_kb":1114115,"num_write":197,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:01.328398+0000","last_change":"2024-05-30T16:53:01.328453+0000","last_active":"2024-05-30T16:53:01.328398+0000","last_peered":"2024-05-30T16:53:01.328398+0000","last_clean":"2024-05-30T16:53:01.328398+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:53:01.328398+0000","last_undegraded":"2024-05-30T16:53:01.328398+0000","last_fullsized":"2024-05-30T16:53:01.328398+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:01.328104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:01.328104+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.328104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:27:30.163472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"74'221","reported_seq":385,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.654467+0000","last_change":"2024-05-30T16:50:01.224914+0000","last_active":"2024-05-30T16:52:54.654467+0000","last_peered":"2024-05-30T16:52:54.654467+0000","last_clean":"2024-05-30T16:52:54.654467+0000","last_became_active":"2024-05-30T16:50:01.224600+0000","last_became_peered":"2024-05-30T16:50:01.224600+0000","last_unstale":"2024-05-30T16:52:54.654467+0000","last_undegraded":"2024-05-30T16:52:54.654467+0000","last_fullsized":"2024-05-30T16:52:54.654467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:49:35.280254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838861053,"num_objects":203,"num_object_clones":1,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":1,"num_read":148,"num_read_kb":602113,"num_write":203,"num_write_kb":819202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:06.604373+0000","last_change":"2024-05-30T16:50:00.204452+0000","last_active":"2024-05-30T16:52:06.604373+0000","last_peered":"2024-05-30T16:52:06.604373+0000","last_clean":"2024-05-30T16:52:06.604373+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:52:06.604373+0000","last_undegraded":"2024-05-30T16:52:06.604373+0000","last_fullsized":"2024-05-30T16:52:06.604373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"74'220","reported_seq":412,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.635960+0000","last_change":"2024-05-30T16:50:01.214457+0000","last_active":"2024-05-30T16:52:54.635960+0000","last_peered":"2024-05-30T16:52:54.635960+0000","last_clean":"2024-05-30T16:52:54.635960+0000","last_became_active":"2024-05-30T16:50:01.214152+0000","last_became_peered":"2024-05-30T16:50:01.214152+0000","last_unstale":"2024-05-30T16:52:54.635960+0000","last_undegraded":"2024-05-30T16:52:54.635960+0000","last_fullsized":"2024-05-30T16:52:54.635960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860931,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":174,"num_read_kb":708609,"num_write":201,"num_write_kb":819201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:06.701765+0000","last_change":"2024-05-30T16:50:00.207741+0000","last_active":"2024-05-30T16:52:06.701765+0000","last_peered":"2024-05-30T16:52:06.701765+0000","last_clean":"2024-05-30T16:52:06.701765+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:52:06.701765+0000","last_undegraded":"2024-05-30T16:52:06.701765+0000","last_fullsized":"2024-05-30T16:52:06.701765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"74'220","reported_seq":482,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.648837+0000","last_change":"2024-05-30T16:50:01.214782+0000","last_active":"2024-05-30T16:52:54.648837+0000","last_peered":"2024-05-30T16:52:54.648837+0000","last_clean":"2024-05-30T16:52:54.648837+0000","last_became_active":"2024-05-30T16:50:01.214454+0000","last_became_peered":"2024-05-30T16:50:01.214454+0000","last_unstale":"2024-05-30T16:52:54.648837+0000","last_undegraded":"2024-05-30T16:52:54.648837+0000","last_fullsized":"2024-05-30T16:52:54.648837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:44:14.966362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443843,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":245,"num_read_kb":999425,"num_write":206,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:06.290041+0000","last_change":"2024-05-30T16:50:00.213146+0000","last_active":"2024-05-30T16:52:06.290041+0000","last_peered":"2024-05-30T16:52:06.290041+0000","last_clean":"2024-05-30T16:52:06.290041+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:52:06.290041+0000","last_undegraded":"2024-05-30T16:52:06.290041+0000","last_fullsized":"2024-05-30T16:52:06.290041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"74'246","reported_seq":489,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.635426+0000","last_change":"2024-05-30T16:50:01.210290+0000","last_active":"2024-05-30T16:52:54.635426+0000","last_peered":"2024-05-30T16:52:54.635426+0000","last_clean":"2024-05-30T16:52:54.635426+0000","last_became_active":"2024-05-30T16:50:01.209939+0000","last_became_peered":"2024-05-30T16:50:01.209939+0000","last_unstale":"2024-05-30T16:52:54.635426+0000","last_undegraded":"2024-05-30T16:52:54.635426+0000","last_fullsized":"2024-05-30T16:52:54.635426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977272832,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":225,"num_read_kb":921600,"num_write":233,"num_write_kb":954368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"74'85","reported_seq":188,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:08.473941+0000","last_change":"2024-05-30T16:50:00.203989+0000","last_active":"2024-05-30T16:52:08.473941+0000","last_peered":"2024-05-30T16:52:08.473941+0000","last_clean":"2024-05-30T16:52:08.473941+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:52:08.473941+0000","last_undegraded":"2024-05-30T16:52:08.473941+0000","last_fullsized":"2024-05-30T16:52:08.473941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:13:11.681217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":84,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"74'226","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.650330+0000","last_change":"2024-05-30T16:50:01.212225+0000","last_active":"2024-05-30T16:52:54.650330+0000","last_peered":"2024-05-30T16:52:54.650330+0000","last_clean":"2024-05-30T16:52:54.650330+0000","last_became_active":"2024-05-30T16:50:01.211630+0000","last_became_peered":"2024-05-30T16:50:01.211630+0000","last_unstale":"2024-05-30T16:52:54.650330+0000","last_undegraded":"2024-05-30T16:52:54.650330+0000","last_fullsized":"2024-05-30T16:52:54.650330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:46:05.715450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":228,"num_read_kb":933888,"num_write":215,"num_write_kb":872449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.860937+0000","last_change":"2024-05-30T16:50:00.210481+0000","last_active":"2024-05-30T16:50:35.860937+0000","last_peered":"2024-05-30T16:50:35.860937+0000","last_clean":"2024-05-30T16:50:35.860937+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:50:35.860937+0000","last_undegraded":"2024-05-30T16:50:35.860937+0000","last_fullsized":"2024-05-30T16:50:35.860937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:41:46.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"74'218","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:54.649725+0000","last_change":"2024-05-30T16:50:01.218627+0000","last_active":"2024-05-30T16:52:54.649725+0000","last_peered":"2024-05-30T16:52:54.649725+0000","last_clean":"2024-05-30T16:52:54.649725+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:52:54.649725+0000","last_undegraded":"2024-05-30T16:52:54.649725+0000","last_fullsized":"2024-05-30T16:52:54.649725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":235,"num_read_kb":962560,"num_write":203,"num_write_kb":831488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:46.304719+0000","last_change":"2024-05-30T16:50:00.210033+0000","last_active":"2024-05-30T16:50:46.304719+0000","last_peered":"2024-05-30T16:50:46.304719+0000","last_clean":"2024-05-30T16:50:46.304719+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:50:46.304719+0000","last_undegraded":"2024-05-30T16:50:46.304719+0000","last_fullsized":"2024-05-30T16:50:46.304719+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:49:59.145174+0000","last_clean_scrub_stamp":"2024-05-30T16:49:59.145174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:25:15.927433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":272,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:50:35.857733+0000","last_change":"2024-05-30T16:41:42.537727+0000","last_active":"2024-05-30T16:50:35.857733+0000","last_peered":"2024-05-30T16:50:35.857733+0000","last_clean":"2024-05-30T16:50:35.857733+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:50:35.857733+0000","last_undegraded":"2024-05-30T16:50:35.857733+0000","last_fullsized":"2024-05-30T16:50:35.857733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:41:41.193586+0000","last_clean_scrub_stamp":"2024-05-30T16:41:41.193586+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:06:12.892637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":53712261060,"num_objects":12829,"num_object_clones":1,"num_object_copies":25658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12829,"num_whiteouts":1,"num_read":12246,"num_read_kb":49496226,"num_write":13027,"num_write_kb":52453497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107424694272,"data_stored":107424522120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14049,"ondisk_log_size":14049,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4445652,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":1451,"num_write_kb":4943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8953856,"data_stored":8891304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1315,"ondisk_log_size":1315,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15419816,"kb_used_data":15312352,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":78952024,"statfs":{"total":96636764160,"available":80846872576,"internally_reserved":0,"allocated":15679848448,"data_stored":15679297903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574986,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17299224,"kb_used_data":17195920,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":77072616,"statfs":{"total":96636764160,"available":78922358784,"internally_reserved":0,"allocated":17608622080,"data_stored":17608075002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574986,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10652116,"kb_used_data":10589068,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":83719724,"statfs":{"total":96636764160,"available":85728997376,"internally_reserved":0,"allocated":10843205632,"data_stored":10842662378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574987,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11717368,"kb_used_data":11650160,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":82654472,"statfs":{"total":96636764160,"available":84638179328,"internally_reserved":0,"allocated":11929763840,"data_stored":11929236066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574986,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14352084,"kb_used_data":14226572,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":80019756,"statfs":{"total":96636764160,"available":81940230144,"internally_reserved":0,"allocated":14568009728,"data_stored":14567443025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574988,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16418644,"kb_used_data":16311180,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":77953196,"statfs":{"total":96636764160,"available":79824072704,"internally_reserved":0,"allocated":16702648320,"data_stored":16702105396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10801372,"kb_used_data":10711956,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":83570468,"statfs":{"total":96636764160,"available":85576159232,"internally_reserved":0,"allocated":10969042944,"data_stored":10968492566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574988,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8993872,"kb_used_data":8926664,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":85377968,"statfs":{"total":96636764160,"available":87427039232,"internally_reserved":0,"allocated":9140903936,"data_stored":9140365112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":237862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":249948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":12744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9139408896,"data_stored":9139389333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10963931136,"data_stored":10963911563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16697544704,"data_stored":16697525009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14566858752,"data_stored":14566819752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11928604672,"data_stored":11928600707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10842300416,"data_stored":10842276877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17607712768,"data_stored":17607689499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15678332928,"data_stored":15678309380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:53:05.331 INFO:tasks.ceph:pgid 11.3f last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.331 INFO:tasks.ceph:pgid 11.3e last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.332 INFO:tasks.ceph:pgid 11.3d last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.332 INFO:tasks.ceph:pgid 11.3c last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.332 INFO:tasks.ceph:pgid 11.3b last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.332 INFO:tasks.ceph:pgid 11.3a last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.332 INFO:tasks.ceph:pgid 11.39 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.332 INFO:tasks.ceph:pgid 11.38 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.333 INFO:tasks.ceph:pgid 11.37 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.333 INFO:tasks.ceph:pgid 11.36 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.333 INFO:tasks.ceph:pgid 11.35 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.333 INFO:tasks.ceph:pgid 11.34 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.333 INFO:tasks.ceph:pgid 11.33 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.333 INFO:tasks.ceph:pgid 11.32 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.333 INFO:tasks.ceph:pgid 11.31 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.334 INFO:tasks.ceph:pgid 11.30 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.334 INFO:tasks.ceph:pgid 11.2f last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.334 INFO:tasks.ceph:pgid 11.2e last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.334 INFO:tasks.ceph:pgid 11.2d last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.334 INFO:tasks.ceph:pgid 11.2c last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.334 INFO:tasks.ceph:pgid 11.2b last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.335 INFO:tasks.ceph:pgid 11.2a last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.335 INFO:tasks.ceph:pgid 11.29 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.335 INFO:tasks.ceph:pgid 11.28 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.335 INFO:tasks.ceph:pgid 11.27 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.335 INFO:tasks.ceph:pgid 11.26 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.335 INFO:tasks.ceph:pgid 11.25 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.336 INFO:tasks.ceph:pgid 11.24 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.336 INFO:tasks.ceph:pgid 11.23 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.336 INFO:tasks.ceph:pgid 11.22 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.336 INFO:tasks.ceph:pgid 11.21 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.336 INFO:tasks.ceph:pgid 11.20 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.336 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.337 INFO:tasks.ceph:pgid 10.1f last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.337 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.337 INFO:tasks.ceph:pgid 11.1c last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.337 INFO:tasks.ceph:pgid 10.1d last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.337 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.337 INFO:tasks.ceph:pgid 10.1c last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.338 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.338 INFO:tasks.ceph:pgid 10.1b last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.338 INFO:tasks.ceph:pgid 11.1b last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.338 INFO:tasks.ceph:pgid 10.1a last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.338 INFO:tasks.ceph:pgid 11.18 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.338 INFO:tasks.ceph:pgid 10.19 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.339 INFO:tasks.ceph:pgid 11.19 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.339 INFO:tasks.ceph:pgid 10.18 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.339 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.339 INFO:tasks.ceph:pgid 10.17 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.339 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.339 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.340 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.340 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.340 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.340 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.340 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.340 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.340 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.341 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.341 INFO:tasks.ceph:pgid 10.11 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.341 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.341 INFO:tasks.ceph:pgid 10.10 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.341 INFO:tasks.ceph:pgid 11.e last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.341 INFO:tasks.ceph:pgid 10.f last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.342 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.342 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.342 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.342 INFO:tasks.ceph:pgid 10.d last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.342 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.342 INFO:tasks.ceph:pgid 10.c last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.343 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.343 INFO:tasks.ceph:pgid 10.a last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.343 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.343 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.343 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.343 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.344 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.344 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.344 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.344 INFO:tasks.ceph:pgid 11.4 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.344 INFO:tasks.ceph:pgid 11.5 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.344 INFO:tasks.ceph:pgid 10.4 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.345 INFO:tasks.ceph:pgid 11.2 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.345 INFO:tasks.ceph:pgid 10.3 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.345 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.345 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.345 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.345 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.346 INFO:tasks.ceph:pgid 11.1 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.346 INFO:tasks.ceph:pgid 10.0 last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.346 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.346 INFO:tasks.ceph:pgid 10.b last_scrub_stamp 2024-05-30T16:49:59.145174+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=59, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.346 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-30T16:41:41.193586+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=41, tm_sec=41, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:05.347 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-30T16:53:18.902 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:53:18.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:53:25.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:53:25.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.542+0000 7fe67dc00640 1 Processor -- start 2024-05-30T16:53:25.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.542+0000 7fe67dc00640 1 -- start start 2024-05-30T16:53:25.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.544+0000 7fe67dc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe67813f760 0x7fe67806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:25.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.544+0000 7fe67dc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67806ee80 con 0x7fe6780b5fd0 2024-05-30T16:53:25.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.544+0000 7fe67dc00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe678160730 con 0x7fe6780cec70 2024-05-30T16:53:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.544+0000 7fe67dc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe6781612b0 con 0x7fe67813f760 2024-05-30T16:53:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.544+0000 7fe677400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe6780b5fd0 0x7fe678142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46164/0 (socket says 172.21.15.144:46164) 2024-05-30T16:53:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.544+0000 7fe676a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe67813f760 0x7fe67806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.544+0000 7fe677400640 1 -- 172.21.15.144:0/1295498117 learned_addr learned my addr 172.21.15.144:0/1295498117 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:53:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.545+0000 7fe675600640 1 -- 172.21.15.144:0/1295498117 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263216919 0 0) 0x7fe67806ee80 con 0x7fe6780b5fd0 2024-05-30T16:53:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.545+0000 7fe675600640 1 -- 172.21.15.144:0/1295498117 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe65c003520 con 0x7fe6780b5fd0 2024-05-30T16:53:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.545+0000 7fe676a00640 1 -- 172.21.15.144:0/1295498117 >> v1:172.21.15.149:6789/0 conn(0x7fe6780cec70 legacy=0x7fe6780b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.545+0000 7fe675600640 1 -- 172.21.15.144:0/1295498117 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393262238 0 0) 0x7fe678160730 con 0x7fe6780cec70 2024-05-30T16:53:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.545+0000 7fe676a00640 1 -- 172.21.15.144:0/1295498117 >> v1:172.21.15.144:6789/0 conn(0x7fe6780b5fd0 legacy=0x7fe678142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.545+0000 7fe676a00640 1 -- 172.21.15.144:0/1295498117 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe678160a10 con 0x7fe67813f760 2024-05-30T16:53:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.546+0000 7fe676a00640 1 --2- 172.21.15.144:0/1295498117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe67813f760 0x7fe67806e940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe670009d90 tx=0x7fe67002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b6f2e2e52f057 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.546+0000 7fe675600640 1 -- 172.21.15.144:0/1295498117 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670007740 con 0x7fe67813f760 2024-05-30T16:53:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.547+0000 7fe675600640 1 -- 172.21.15.144:0/1295498117 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6700078e0 con 0x7fe67813f760 2024-05-30T16:53:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.547+0000 7fe675600640 1 -- 172.21.15.144:0/1295498117 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670007cb0 con 0x7fe67813f760 2024-05-30T16:53:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.547+0000 7fe67dc00640 1 -- 172.21.15.144:0/1295498117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe67813f760 msgr2=0x7fe67806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.547+0000 7fe67dc00640 1 --2- 172.21.15.144:0/1295498117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe67813f760 0x7fe67806e940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe670009d90 tx=0x7fe67002a6f0 comp rx=0 tx=0).stop 2024-05-30T16:53:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.547+0000 7fe67dc00640 1 -- 172.21.15.144:0/1295498117 shutdown_connections 2024-05-30T16:53:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.547+0000 7fe67dc00640 1 --2- 172.21.15.144:0/1295498117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe67813f760 0x7fe67806e940 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.547+0000 7fe67dc00640 1 -- 172.21.15.144:0/1295498117 >> 172.21.15.144:0/1295498117 conn(0x7fe67806bd00 msgr2=0x7fe67806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.548+0000 7fe67dc00640 1 -- 172.21.15.144:0/1295498117 shutdown_connections 2024-05-30T16:53:25.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.548+0000 7fe67dc00640 1 -- 172.21.15.144:0/1295498117 wait complete. 2024-05-30T16:53:25.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.550+0000 7fe67dc00640 1 Processor -- start 2024-05-30T16:53:25.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.550+0000 7fe67dc00640 1 -- start start 2024-05-30T16:53:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.551+0000 7fe67dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6780b5fd0 0x7fe678132fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.551+0000 7fe67dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6780cec70 0x7fe6781f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.551+0000 7fe67dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67813f760 0x7fe678131b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.551+0000 7fe67dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe678160fd0 con 0x7fe67813f760 2024-05-30T16:53:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.551+0000 7fe67dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780cf0d0 con 0x7fe6780b5fd0 2024-05-30T16:53:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.551+0000 7fe67dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe6780cf250 con 0x7fe6780cec70 2024-05-30T16:53:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.551+0000 7fe677400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67813f760 0x7fe678131b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.551+0000 7fe677400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67813f760 0x7fe678131b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43898/0 (socket says 172.21.15.144:43898) 2024-05-30T16:53:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.551+0000 7fe677400640 1 -- 172.21.15.144:0/1690467584 learned_addr learned my addr 172.21.15.144:0/1690467584 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:25.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.552+0000 7fe676a00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6780b5fd0 0x7fe678132fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:25.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.552+0000 7fe676000640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6780cec70 0x7fe6781f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:25.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.552+0000 7fe677400640 1 -- 172.21.15.144:0/1690467584 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6780cec70 msgr2=0x7fe6781f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:25.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.552+0000 7fe677400640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6780cec70 0x7fe6781f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:25.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.552+0000 7fe677400640 1 -- 172.21.15.144:0/1690467584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6780b5fd0 msgr2=0x7fe678132fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:25.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.552+0000 7fe677400640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6780b5fd0 0x7fe678132fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:25.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.552+0000 7fe677400640 1 -- 172.21.15.144:0/1690467584 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67812fc50 con 0x7fe67813f760 2024-05-30T16:53:25.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.552+0000 7fe677400640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67813f760 0x7fe678131b60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe66800c420 tx=0x7fe66800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:25.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.553+0000 7fe66ea00640 1 -- 172.21.15.144:0/1690467584 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668017070 con 0x7fe67813f760 2024-05-30T16:53:25.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.553+0000 7fe66ea00640 1 -- 172.21.15.144:0/1690467584 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe668005ce0 con 0x7fe67813f760 2024-05-30T16:53:25.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.553+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67812ff30 con 0x7fe67813f760 2024-05-30T16:53:25.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.553+0000 7fe66ea00640 1 -- 172.21.15.144:0/1690467584 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680072d0 con 0x7fe67813f760 2024-05-30T16:53:25.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.553+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6781304f0 con 0x7fe67813f760 2024-05-30T16:53:25.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.554+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe678068b90 con 0x7fe67813f760 2024-05-30T16:53:25.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.555+0000 7fe66ea00640 1 -- 172.21.15.144:0/1690467584 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 32) ==== 92315+0+0 (secure 0 0 0) 0x7fe66801a070 con 0x7fe67813f760 2024-05-30T16:53:25.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.556+0000 7fe66ea00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65806d700 0x7fe65806fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:25.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.556+0000 7fe66ea00640 1 -- 172.21.15.144:0/1690467584 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fe668089bd0 con 0x7fe67813f760 2024-05-30T16:53:25.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.557+0000 7fe676a00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65806d700 0x7fe65806fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:25.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.557+0000 7fe676a00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65806d700 0x7fe65806fbc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe670034000 tx=0x7fe67002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:25.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.562+0000 7fe66ea00640 1 -- 172.21.15.144:0/1690467584 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe668059140 con 0x7fe67813f760 2024-05-30T16:53:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.808+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe678075f70 con 0x7fe65806d700 2024-05-30T16:53:25.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.820+0000 7fe66ea00640 1 -- 172.21.15.144:0/1690467584 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254884 (secure 0 0 0) 0x7fe670003c90 con 0x7fe65806d700 2024-05-30T16:53:25.824 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:53:25.826 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:53:25.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65806d700 msgr2=0x7fe65806fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:25.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65806d700 0x7fe65806fbc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe670034000 tx=0x7fe67002f000 comp rx=0 tx=0).stop 2024-05-30T16:53:25.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67813f760 msgr2=0x7fe678131b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:25.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67813f760 0x7fe678131b60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe66800c420 tx=0x7fe66800c8e0 comp rx=0 tx=0).stop 2024-05-30T16:53:25.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 shutdown_connections 2024-05-30T16:53:25.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe65806d700 0x7fe65806fbc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:25.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67813f760 0x7fe678131b60 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:25.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6780cec70 0x7fe6781f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:25.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 --2- 172.21.15.144:0/1690467584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6780b5fd0 0x7fe678132fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:25.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 >> 172.21.15.144:0/1690467584 conn(0x7fe67806bd00 msgr2=0x7fe6780b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:25.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 shutdown_connections 2024-05-30T16:53:25.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:25.826+0000 7fe67dc00640 1 -- 172.21.15.144:0/1690467584 wait complete. 2024-05-30T16:53:25.844 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2024-05-30T16:53:25.233249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53717298108,"num_objects":12855,"num_object_clones":1,"num_object_copies":25710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12855,"num_whiteouts":1,"num_read":12446,"num_read_kb":49496410,"num_write":14649,"num_write_kb":52460864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7455,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26924,"ondisk_log_size":26924,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":105729440,"kb_used_data":104923872,"kb_used_omap":12,"kb_used_meta":805491,"kb_avail":649245280,"statfs":{"total":773094113280,"available":664827166720,"internally_reserved":0,"allocated":107442044928,"data_stored":107437679504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":824823347},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,25,0,0,0,25,39,50,10],"upper_bound":2048},"perf_stat":{"commit_latency_ms":2466,"apply_latency_ms":2466,"commit_latency_ns":2466000000,"apply_latency_ns":2466000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003651"},"pg_stats":[{"pgid":"11.3f","version":"74'289","reported_seq":532,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.561993+0000","last_change":"2024-05-30T16:53:15.414780+0000","last_active":"2024-05-30T16:53:20.561993+0000","last_peered":"2024-05-30T16:53:20.561993+0000","last_clean":"2024-05-30T16:53:20.561993+0000","last_became_active":"2024-05-30T16:50:01.225529+0000","last_became_peered":"2024-05-30T16:50:01.225529+0000","last_unstale":"2024-05-30T16:53:20.561993+0000","last_undegraded":"2024-05-30T16:53:20.561993+0000","last_fullsized":"2024-05-30T16:53:20.561993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":49,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":219,"num_read_kb":897024,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"74'292","reported_seq":523,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.876247+0000","last_change":"2024-05-30T16:53:17.388137+0000","last_active":"2024-05-30T16:53:20.876247+0000","last_peered":"2024-05-30T16:53:20.876247+0000","last_clean":"2024-05-30T16:53:20.876247+0000","last_became_active":"2024-05-30T16:50:01.205240+0000","last_became_peered":"2024-05-30T16:50:01.205240+0000","last_unstale":"2024-05-30T16:53:20.876247+0000","last_undegraded":"2024-05-30T16:53:20.876247+0000","last_fullsized":"2024-05-30T16:53:20.876247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":49,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":207,"num_read_kb":847872,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"74'459","reported_seq":697,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:12.130926+0000","last_change":"2024-05-30T16:53:12.130994+0000","last_active":"2024-05-30T16:53:12.130926+0000","last_peered":"2024-05-30T16:53:12.130926+0000","last_clean":"2024-05-30T16:53:12.130926+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:53:12.130926+0000","last_undegraded":"2024-05-30T16:53:12.130926+0000","last_fullsized":"2024-05-30T16:53:12.130926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'459","last_scrub_stamp":"2024-05-30T16:53:12.130821+0000","last_deep_scrub":"74'459","last_deep_scrub_stamp":"2024-05-30T16:53:12.130821+0000","last_clean_scrub_stamp":"2024-05-30T16:53:12.130821+0000","objects_scrubbed":202,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:19.237818+0000","scrub_duration":8256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":202,"num_read_kb":806917,"num_write":210,"num_write_kb":827396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"74'444","reported_seq":603,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:18.331594+0000","last_change":"2024-05-30T16:53:18.331716+0000","last_active":"2024-05-30T16:53:18.331594+0000","last_peered":"2024-05-30T16:53:18.331594+0000","last_clean":"2024-05-30T16:53:18.331594+0000","last_became_active":"2024-05-30T16:50:01.207604+0000","last_became_peered":"2024-05-30T16:50:01.207604+0000","last_unstale":"2024-05-30T16:53:18.331594+0000","last_undegraded":"2024-05-30T16:53:18.331594+0000","last_fullsized":"2024-05-30T16:53:18.331594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'444","last_scrub_stamp":"2024-05-30T16:53:18.331479+0000","last_deep_scrub":"74'444","last_deep_scrub_stamp":"2024-05-30T16:53:18.331479+0000","last_clean_scrub_stamp":"2024-05-30T16:53:18.331479+0000","objects_scrubbed":198,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:16:18.827978+0000","scrub_duration":13007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830472192,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":125,"num_read_kb":512000,"num_write":198,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"74'361","reported_seq":509,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.988524+0000","last_change":"2024-05-30T16:53:12.615144+0000","last_active":"2024-05-30T16:53:20.988524+0000","last_peered":"2024-05-30T16:53:20.988524+0000","last_clean":"2024-05-30T16:53:20.988524+0000","last_became_active":"2024-05-30T16:50:01.219925+0000","last_became_peered":"2024-05-30T16:50:01.219925+0000","last_unstale":"2024-05-30T16:53:20.988524+0000","last_undegraded":"2024-05-30T16:53:20.988524+0000","last_fullsized":"2024-05-30T16:53:20.988524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":124,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 8s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":121,"num_read_kb":495616,"num_write":197,"num_write_kb":798721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"74'299","reported_seq":577,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.900095+0000","last_change":"2024-05-30T16:53:18.424437+0000","last_active":"2024-05-30T16:53:21.900095+0000","last_peered":"2024-05-30T16:53:21.900095+0000","last_clean":"2024-05-30T16:53:21.900095+0000","last_became_active":"2024-05-30T16:50:01.205620+0000","last_became_peered":"2024-05-30T16:50:01.205620+0000","last_unstale":"2024-05-30T16:53:21.900095+0000","last_undegraded":"2024-05-30T16:53:21.900095+0000","last_fullsized":"2024-05-30T16:53:21.900095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":49,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":254,"num_read_kb":1028099,"num_write":206,"num_write_kb":827394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"74'429","reported_seq":607,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:18.326094+0000","last_change":"2024-05-30T16:53:18.326212+0000","last_active":"2024-05-30T16:53:18.326094+0000","last_peered":"2024-05-30T16:53:18.326094+0000","last_clean":"2024-05-30T16:53:18.326094+0000","last_became_active":"2024-05-30T16:50:01.215828+0000","last_became_peered":"2024-05-30T16:50:01.215828+0000","last_unstale":"2024-05-30T16:53:18.326094+0000","last_undegraded":"2024-05-30T16:53:18.326094+0000","last_fullsized":"2024-05-30T16:53:18.326094+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'429","last_scrub_stamp":"2024-05-30T16:53:18.320603+0000","last_deep_scrub":"74'429","last_deep_scrub_stamp":"2024-05-30T16:53:18.320603+0000","last_clean_scrub_stamp":"2024-05-30T16:53:18.320603+0000","objects_scrubbed":188,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:49:25.755605+0000","scrub_duration":11137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":144,"num_read_kb":581634,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"74'249","reported_seq":433,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.887272+0000","last_change":"2024-05-30T16:53:19.400303+0000","last_active":"2024-05-30T16:53:21.887272+0000","last_peered":"2024-05-30T16:53:21.887272+0000","last_clean":"2024-05-30T16:53:21.887272+0000","last_became_active":"2024-05-30T16:50:01.210863+0000","last_became_peered":"2024-05-30T16:50:01.210863+0000","last_unstale":"2024-05-30T16:53:21.887272+0000","last_undegraded":"2024-05-30T16:53:21.887272+0000","last_fullsized":"2024-05-30T16:53:21.887272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":24,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":161,"num_read_kb":655361,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"74'468","reported_seq":670,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:21.592274+0000","last_change":"2024-05-30T16:53:21.592337+0000","last_active":"2024-05-30T16:53:21.592274+0000","last_peered":"2024-05-30T16:53:21.592274+0000","last_clean":"2024-05-30T16:53:21.592274+0000","last_became_active":"2024-05-30T16:50:01.214609+0000","last_became_peered":"2024-05-30T16:50:01.214609+0000","last_unstale":"2024-05-30T16:53:21.592274+0000","last_undegraded":"2024-05-30T16:53:21.592274+0000","last_fullsized":"2024-05-30T16:53:21.592274+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'468","last_scrub_stamp":"2024-05-30T16:53:21.592147+0000","last_deep_scrub":"74'468","last_deep_scrub_stamp":"2024-05-30T16:53:21.592147+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.592147+0000","objects_scrubbed":203,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:14:23.349148+0000","scrub_duration":14201,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":167,"num_read_kb":655367,"num_write":209,"num_write_kb":831491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"74'349","reported_seq":561,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:19.816279+0000","last_change":"2024-05-30T16:53:12.594891+0000","last_active":"2024-05-30T16:53:19.816279+0000","last_peered":"2024-05-30T16:53:19.816279+0000","last_clean":"2024-05-30T16:53:19.816279+0000","last_became_active":"2024-05-30T16:50:01.217506+0000","last_became_peered":"2024-05-30T16:50:01.217506+0000","last_unstale":"2024-05-30T16:53:19.816279+0000","last_undegraded":"2024-05-30T16:53:19.816279+0000","last_fullsized":"2024-05-30T16:53:19.816279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":124,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 8s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":185,"num_read_kb":745475,"num_write":205,"num_write_kb":831489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"74'390","reported_seq":720,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.554493+0000","last_change":"2024-05-30T16:53:09.164821+0000","last_active":"2024-05-30T16:53:20.554493+0000","last_peered":"2024-05-30T16:53:20.554493+0000","last_clean":"2024-05-30T16:53:20.554493+0000","last_became_active":"2024-05-30T16:50:01.218645+0000","last_became_peered":"2024-05-30T16:50:01.218645+0000","last_unstale":"2024-05-30T16:53:20.554493+0000","last_undegraded":"2024-05-30T16:53:20.554493+0000","last_fullsized":"2024-05-30T16:53:20.554493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":124,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 11s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":901775360,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":303,"num_read_kb":1212423,"num_write":221,"num_write_kb":880643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"74'398","reported_seq":715,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:20.986986+0000","last_change":"2024-05-30T16:53:20.987063+0000","last_active":"2024-05-30T16:53:20.986986+0000","last_peered":"2024-05-30T16:53:20.986986+0000","last_clean":"2024-05-30T16:53:20.986986+0000","last_became_active":"2024-05-30T16:50:01.217020+0000","last_became_peered":"2024-05-30T16:50:01.217020+0000","last_unstale":"2024-05-30T16:53:20.986986+0000","last_undegraded":"2024-05-30T16:53:20.986986+0000","last_fullsized":"2024-05-30T16:53:20.986986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'398","last_scrub_stamp":"2024-05-30T16:53:20.986856+0000","last_deep_scrub":"74'398","last_deep_scrub_stamp":"2024-05-30T16:53:20.986856+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.986856+0000","objects_scrubbed":182,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:23.319832+0000","scrub_duration":13670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":763363328,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":283,"num_read_kb":1146883,"num_write":184,"num_write_kb":745473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"74'471","reported_seq":750,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:13.414039+0000","last_change":"2024-05-30T16:53:13.414123+0000","last_active":"2024-05-30T16:53:13.414039+0000","last_peered":"2024-05-30T16:53:13.414039+0000","last_clean":"2024-05-30T16:53:13.414039+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:53:13.414039+0000","last_undegraded":"2024-05-30T16:53:13.414039+0000","last_fullsized":"2024-05-30T16:53:13.414039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'471","last_scrub_stamp":"2024-05-30T16:53:13.413931+0000","last_deep_scrub":"74'471","last_deep_scrub_stamp":"2024-05-30T16:53:13.413931+0000","last_clean_scrub_stamp":"2024-05-30T16:53:13.413931+0000","objects_scrubbed":211,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:38:40.443308+0000","scrub_duration":8631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876609929,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":244,"num_read_kb":983044,"num_write":215,"num_write_kb":856068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"74'332","reported_seq":542,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.572312+0000","last_change":"2024-05-30T16:53:13.699860+0000","last_active":"2024-05-30T16:53:20.572312+0000","last_peered":"2024-05-30T16:53:20.572312+0000","last_clean":"2024-05-30T16:53:20.572312+0000","last_became_active":"2024-05-30T16:50:01.228163+0000","last_became_peered":"2024-05-30T16:50:01.228163+0000","last_unstale":"2024-05-30T16:53:20.572312+0000","last_undegraded":"2024-05-30T16:53:20.572312+0000","last_fullsized":"2024-05-30T16:53:20.572312+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":74,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 6s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998144,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":185,"num_read_kb":757760,"num_write":213,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"74'462","reported_seq":592,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:20.401010+0000","last_change":"2024-05-30T16:53:20.401088+0000","last_active":"2024-05-30T16:53:20.401010+0000","last_peered":"2024-05-30T16:53:20.401010+0000","last_clean":"2024-05-30T16:53:20.401010+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:53:20.401010+0000","last_undegraded":"2024-05-30T16:53:20.401010+0000","last_fullsized":"2024-05-30T16:53:20.401010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'462","last_scrub_stamp":"2024-05-30T16:53:20.400853+0000","last_deep_scrub":"74'462","last_deep_scrub_stamp":"2024-05-30T16:53:20.400853+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.400853+0000","objects_scrubbed":205,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:09.017725+0000","scrub_duration":14596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859832320,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":0,"num_read":95,"num_read_kb":368645,"num_write":209,"num_write_kb":839682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"74'413","reported_seq":604,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.951678+0000","last_change":"2024-05-30T16:53:10.555712+0000","last_active":"2024-05-30T16:53:20.951678+0000","last_peered":"2024-05-30T16:53:20.951678+0000","last_clean":"2024-05-30T16:53:20.951678+0000","last_became_active":"2024-05-30T16:50:01.208926+0000","last_became_peered":"2024-05-30T16:50:01.208926+0000","last_unstale":"2024-05-30T16:53:20.951678+0000","last_undegraded":"2024-05-30T16:53:20.951678+0000","last_fullsized":"2024-05-30T16:53:20.951678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":149,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 10s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":163,"num_read_kb":651268,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"74'444","reported_seq":604,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:21.880883+0000","last_change":"2024-05-30T16:53:21.880942+0000","last_active":"2024-05-30T16:53:21.880883+0000","last_peered":"2024-05-30T16:53:21.880883+0000","last_clean":"2024-05-30T16:53:21.880883+0000","last_became_active":"2024-05-30T16:50:01.211267+0000","last_became_peered":"2024-05-30T16:50:01.211267+0000","last_unstale":"2024-05-30T16:53:21.880883+0000","last_undegraded":"2024-05-30T16:53:21.880883+0000","last_fullsized":"2024-05-30T16:53:21.880883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'444","last_scrub_stamp":"2024-05-30T16:53:21.880656+0000","last_deep_scrub":"74'444","last_deep_scrub_stamp":"2024-05-30T16:53:21.880656+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.880656+0000","objects_scrubbed":203,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:18.639463+0000","scrub_duration":13481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055366,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":125,"num_read_kb":503810,"num_write":203,"num_write_kb":823298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"74'453","reported_seq":771,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:19.574548+0000","last_change":"2024-05-30T16:53:19.574584+0000","last_active":"2024-05-30T16:53:19.574548+0000","last_peered":"2024-05-30T16:53:19.574548+0000","last_clean":"2024-05-30T16:53:19.574548+0000","last_became_active":"2024-05-30T16:50:36.235518+0000","last_became_peered":"2024-05-30T16:50:36.235518+0000","last_unstale":"2024-05-30T16:53:19.574548+0000","last_undegraded":"2024-05-30T16:53:19.574548+0000","last_fullsized":"2024-05-30T16:53:19.574548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'453","last_scrub_stamp":"2024-05-30T16:53:19.574447+0000","last_deep_scrub":"74'453","last_deep_scrub_stamp":"2024-05-30T16:53:19.574447+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.574447+0000","objects_scrubbed":201,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:52:36.194490+0000","scrub_duration":10249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860932,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":260,"num_read_kb":1056770,"num_write":205,"num_write_kb":819203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"74'247","reported_seq":469,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.933420+0000","last_change":"2024-05-30T16:50:01.213913+0000","last_active":"2024-05-30T16:53:04.933420+0000","last_peered":"2024-05-30T16:53:04.933420+0000","last_clean":"2024-05-30T16:53:04.933420+0000","last_became_active":"2024-05-30T16:50:01.213651+0000","last_became_peered":"2024-05-30T16:50:01.213651+0000","last_unstale":"2024-05-30T16:53:04.933420+0000","last_undegraded":"2024-05-30T16:53:04.933420+0000","last_fullsized":"2024-05-30T16:53:04.933420+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880803840,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":204,"num_read_kb":827394,"num_write":214,"num_write_kb":860162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"74'436","reported_seq":644,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:19.465458+0000","last_change":"2024-05-30T16:53:19.465566+0000","last_active":"2024-05-30T16:53:19.465458+0000","last_peered":"2024-05-30T16:53:19.465458+0000","last_clean":"2024-05-30T16:53:19.465458+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:53:19.465458+0000","last_undegraded":"2024-05-30T16:53:19.465458+0000","last_fullsized":"2024-05-30T16:53:19.465458+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'436","last_scrub_stamp":"2024-05-30T16:53:19.465349+0000","last_deep_scrub":"74'436","last_deep_scrub_stamp":"2024-05-30T16:53:19.465349+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.465349+0000","objects_scrubbed":192,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:49:26.900351+0000","scrub_duration":11625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918152,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"74'447","reported_seq":744,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.980153+0000","last_change":"2024-05-30T16:53:07.489864+0000","last_active":"2024-05-30T16:53:20.980153+0000","last_peered":"2024-05-30T16:53:20.980153+0000","last_clean":"2024-05-30T16:53:20.980153+0000","last_became_active":"2024-05-30T16:50:01.209453+0000","last_became_peered":"2024-05-30T16:50:01.209453+0000","last_unstale":"2024-05-30T16:53:20.980153+0000","last_undegraded":"2024-05-30T16:53:20.980153+0000","last_fullsized":"2024-05-30T16:53:20.980153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":174,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 13s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":918552576,"num_objects":219,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":268,"num_read_kb":1081348,"num_write":225,"num_write_kb":897027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"74'356","reported_seq":564,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.556293+0000","last_change":"2024-05-30T16:53:11.561518+0000","last_active":"2024-05-30T16:53:20.556293+0000","last_peered":"2024-05-30T16:53:20.556293+0000","last_clean":"2024-05-30T16:53:20.556293+0000","last_became_active":"2024-05-30T16:50:01.216565+0000","last_became_peered":"2024-05-30T16:50:01.216565+0000","last_unstale":"2024-05-30T16:53:20.556293+0000","last_undegraded":"2024-05-30T16:53:20.556293+0000","last_fullsized":"2024-05-30T16:53:20.556293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":99,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 8s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415232,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":208,"num_whiteouts":0,"num_read":182,"num_read_kb":724997,"num_write":214,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"74'321","reported_seq":520,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.909273+0000","last_change":"2024-05-30T16:53:17.473024+0000","last_active":"2024-05-30T16:53:21.909273+0000","last_peered":"2024-05-30T16:53:21.909273+0000","last_clean":"2024-05-30T16:53:21.909273+0000","last_became_active":"2024-05-30T16:50:01.230326+0000","last_became_peered":"2024-05-30T16:50:01.230326+0000","last_unstale":"2024-05-30T16:53:21.909273+0000","last_undegraded":"2024-05-30T16:53:21.909273+0000","last_fullsized":"2024-05-30T16:53:21.909273+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":74,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":805306368,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":786434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"74'340","reported_seq":526,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.894971+0000","last_change":"2024-05-30T16:53:13.263589+0000","last_active":"2024-05-30T16:53:21.894971+0000","last_peered":"2024-05-30T16:53:21.894971+0000","last_clean":"2024-05-30T16:53:21.894971+0000","last_became_active":"2024-05-30T16:50:01.221747+0000","last_became_peered":"2024-05-30T16:50:01.221747+0000","last_unstale":"2024-05-30T16:53:21.894971+0000","last_undegraded":"2024-05-30T16:53:21.894971+0000","last_fullsized":"2024-05-30T16:53:21.894971+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":99,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 8s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":160,"num_read_kb":647170,"num_write":198,"num_write_kb":794626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"74'331","reported_seq":549,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.566098+0000","last_change":"2024-05-30T16:53:14.622366+0000","last_active":"2024-05-30T16:53:20.566098+0000","last_peered":"2024-05-30T16:53:20.566098+0000","last_clean":"2024-05-30T16:53:20.566098+0000","last_became_active":"2024-05-30T16:50:01.224947+0000","last_became_peered":"2024-05-30T16:50:01.224947+0000","last_unstale":"2024-05-30T16:53:20.566098+0000","last_undegraded":"2024-05-30T16:53:20.566098+0000","last_fullsized":"2024-05-30T16:53:20.566098+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":74,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":193,"num_read_kb":778243,"num_write":201,"num_write_kb":798723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"74'450","reported_seq":683,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:18.246215+0000","last_change":"2024-05-30T16:53:18.246388+0000","last_active":"2024-05-30T16:53:18.246215+0000","last_peered":"2024-05-30T16:53:18.246215+0000","last_clean":"2024-05-30T16:53:18.246215+0000","last_became_active":"2024-05-30T16:50:01.223128+0000","last_became_peered":"2024-05-30T16:50:01.223128+0000","last_unstale":"2024-05-30T16:53:18.246215+0000","last_undegraded":"2024-05-30T16:53:18.246215+0000","last_fullsized":"2024-05-30T16:53:18.246215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'450","last_scrub_stamp":"2024-05-30T16:53:18.246068+0000","last_deep_scrub":"74'450","last_deep_scrub_stamp":"2024-05-30T16:53:18.246068+0000","last_clean_scrub_stamp":"2024-05-30T16:53:18.246068+0000","objects_scrubbed":189,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:21.486448+0000","scrub_duration":9002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":199,"num_read_kb":815104,"num_write":189,"num_write_kb":774144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"74'367","reported_seq":595,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.559964+0000","last_change":"2024-05-30T16:53:08.948620+0000","last_active":"2024-05-30T16:53:20.559964+0000","last_peered":"2024-05-30T16:53:20.559964+0000","last_clean":"2024-05-30T16:53:20.559964+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:53:20.559964+0000","last_undegraded":"2024-05-30T16:53:20.559964+0000","last_fullsized":"2024-05-30T16:53:20.559964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":124,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 11s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":201,"num_read_kb":819201,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"74'314","reported_seq":435,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.992446+0000","last_change":"2024-05-30T16:53:13.590976+0000","last_active":"2024-05-30T16:53:20.992446+0000","last_peered":"2024-05-30T16:53:20.992446+0000","last_clean":"2024-05-30T16:53:20.992446+0000","last_became_active":"2024-05-30T16:50:01.217568+0000","last_became_peered":"2024-05-30T16:50:01.217568+0000","last_unstale":"2024-05-30T16:53:20.992446+0000","last_undegraded":"2024-05-30T16:53:20.992446+0000","last_fullsized":"2024-05-30T16:53:20.992446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":99,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 7s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":759169024,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":95,"num_read_kb":389120,"num_write":183,"num_write_kb":741377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"74'447","reported_seq":689,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.881583+0000","last_change":"2024-05-30T16:53:09.944738+0000","last_active":"2024-05-30T16:53:21.881583+0000","last_peered":"2024-05-30T16:53:21.881583+0000","last_clean":"2024-05-30T16:53:21.881583+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:53:21.881583+0000","last_undegraded":"2024-05-30T16:53:21.881583+0000","last_fullsized":"2024-05-30T16:53:21.881583+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":174,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 11s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931135619,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":213,"num_read_kb":868353,"num_write":223,"num_write_kb":909313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"74'375","reported_seq":594,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.561225+0000","last_change":"2024-05-30T16:53:12.393765+0000","last_active":"2024-05-30T16:53:20.561225+0000","last_peered":"2024-05-30T16:53:20.561225+0000","last_clean":"2024-05-30T16:53:20.561225+0000","last_became_active":"2024-05-30T16:50:01.227538+0000","last_became_peered":"2024-05-30T16:50:01.227538+0000","last_unstale":"2024-05-30T16:53:20.561225+0000","last_undegraded":"2024-05-30T16:53:20.561225+0000","last_fullsized":"2024-05-30T16:53:20.561225+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":99,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 8s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910163968,"num_objects":217,"num_object_clones":0,"num_object_copies":434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":193,"num_read_kb":757768,"num_write":225,"num_write_kb":888836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"74'426","reported_seq":741,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.985838+0000","last_change":"2024-05-30T16:53:06.164284+0000","last_active":"2024-05-30T16:53:20.985838+0000","last_peered":"2024-05-30T16:53:20.985838+0000","last_clean":"2024-05-30T16:53:20.985838+0000","last_became_active":"2024-05-30T16:50:01.215541+0000","last_became_peered":"2024-05-30T16:50:01.215541+0000","last_unstale":"2024-05-30T16:53:20.985838+0000","last_undegraded":"2024-05-30T16:53:20.985838+0000","last_fullsized":"2024-05-30T16:53:20.985838+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":174,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 15s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":285,"num_read_kb":1150980,"num_write":192,"num_write_kb":770050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"74'254","reported_seq":490,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.437191+0000","last_change":"2024-05-30T16:53:21.436867+0000","last_active":"2024-05-30T16:53:21.437191+0000","last_peered":"2024-05-30T16:53:21.437191+0000","last_clean":"2024-05-30T16:53:21.437191+0000","last_became_active":"2024-05-30T16:50:01.212747+0000","last_became_peered":"2024-05-30T16:50:01.212747+0000","last_unstale":"2024-05-30T16:53:21.437191+0000","last_undegraded":"2024-05-30T16:53:21.437191+0000","last_fullsized":"2024-05-30T16:53:21.437191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":214,"num_read_kb":876544,"num_write":201,"num_write_kb":823296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"74'384","reported_seq":540,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.909075+0000","last_change":"2024-05-30T16:53:12.213021+0000","last_active":"2024-05-30T16:53:21.909075+0000","last_peered":"2024-05-30T16:53:21.909075+0000","last_clean":"2024-05-30T16:53:21.909075+0000","last_became_active":"2024-05-30T16:50:01.221781+0000","last_became_peered":"2024-05-30T16:50:01.221781+0000","last_unstale":"2024-05-30T16:53:21.909075+0000","last_undegraded":"2024-05-30T16:53:21.909075+0000","last_fullsized":"2024-05-30T16:53:21.909075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":149,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 9s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826277888,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":197,"num_write_kb":806912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'6","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:07.770490+0000","last_change":"2024-05-30T16:53:07.770552+0000","last_active":"2024-05-30T16:53:07.770490+0000","last_peered":"2024-05-30T16:53:07.770490+0000","last_clean":"2024-05-30T16:53:07.770490+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:53:07.770490+0000","last_undegraded":"2024-05-30T16:53:07.770490+0000","last_fullsized":"2024-05-30T16:53:07.770490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'6","last_scrub_stamp":"2024-05-30T16:53:07.770327+0000","last_deep_scrub":"74'6","last_deep_scrub_stamp":"2024-05-30T16:53:07.770327+0000","last_clean_scrub_stamp":"2024-05-30T16:53:07.770327+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:34.872666+0000","scrub_duration":604,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'450","reported_seq":690,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:14.771570+0000","last_change":"2024-05-30T16:53:14.771695+0000","last_active":"2024-05-30T16:53:14.771570+0000","last_peered":"2024-05-30T16:53:14.771570+0000","last_clean":"2024-05-30T16:53:14.771570+0000","last_became_active":"2024-05-30T16:50:01.208076+0000","last_became_peered":"2024-05-30T16:50:01.208076+0000","last_unstale":"2024-05-30T16:53:14.771570+0000","last_undegraded":"2024-05-30T16:53:14.771570+0000","last_fullsized":"2024-05-30T16:53:14.771570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'450","last_scrub_stamp":"2024-05-30T16:53:14.771433+0000","last_deep_scrub":"74'450","last_deep_scrub_stamp":"2024-05-30T16:53:14.771433+0000","last_clean_scrub_stamp":"2024-05-30T16:53:14.771433+0000","objects_scrubbed":203,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:52.743122+0000","scrub_duration":10412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055496,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":205,"num_read_kb":827395,"num_write":205,"num_write_kb":823299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:59.754518+0000","last_change":"2024-05-30T16:52:59.754573+0000","last_active":"2024-05-30T16:52:59.754518+0000","last_peered":"2024-05-30T16:52:59.754518+0000","last_clean":"2024-05-30T16:52:59.754518+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:52:59.754518+0000","last_undegraded":"2024-05-30T16:52:59.754518+0000","last_fullsized":"2024-05-30T16:52:59.754518+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'1","last_scrub_stamp":"2024-05-30T16:52:59.754318+0000","last_deep_scrub":"71'1","last_deep_scrub_stamp":"2024-05-30T16:52:59.754318+0000","last_clean_scrub_stamp":"2024-05-30T16:52:59.754318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:19:57.808372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"74'476","reported_seq":717,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:10.226658+0000","last_change":"2024-05-30T16:53:10.226780+0000","last_active":"2024-05-30T16:53:10.226658+0000","last_peered":"2024-05-30T16:53:10.226658+0000","last_clean":"2024-05-30T16:53:10.226658+0000","last_became_active":"2024-05-30T16:50:01.223375+0000","last_became_peered":"2024-05-30T16:50:01.223375+0000","last_unstale":"2024-05-30T16:53:10.226658+0000","last_undegraded":"2024-05-30T16:53:10.226658+0000","last_fullsized":"2024-05-30T16:53:10.226658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'476","last_scrub_stamp":"2024-05-30T16:53:10.226538+0000","last_deep_scrub":"74'476","last_deep_scrub_stamp":"2024-05-30T16:53:10.226538+0000","last_clean_scrub_stamp":"2024-05-30T16:53:10.226538+0000","objects_scrubbed":213,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:16.390743+0000","scrub_duration":3988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192709,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":206,"num_read_kb":827396,"num_write":219,"num_write_kb":868356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:06.540873+0000","last_change":"2024-05-30T16:53:06.540918+0000","last_active":"2024-05-30T16:53:06.540873+0000","last_peered":"2024-05-30T16:53:06.540873+0000","last_clean":"2024-05-30T16:53:06.540873+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:53:06.540873+0000","last_undegraded":"2024-05-30T16:53:06.540873+0000","last_fullsized":"2024-05-30T16:53:06.540873+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'5","last_scrub_stamp":"2024-05-30T16:53:06.540757+0000","last_deep_scrub":"74'5","last_deep_scrub_stamp":"2024-05-30T16:53:06.540757+0000","last_clean_scrub_stamp":"2024-05-30T16:53:06.540757+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:36.304089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'396","reported_seq":677,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.556865+0000","last_change":"2024-05-30T16:53:10.124713+0000","last_active":"2024-05-30T16:53:20.556865+0000","last_peered":"2024-05-30T16:53:20.556865+0000","last_clean":"2024-05-30T16:53:20.556865+0000","last_became_active":"2024-05-30T16:50:01.219382+0000","last_became_peered":"2024-05-30T16:50:01.219382+0000","last_unstale":"2024-05-30T16:53:20.556865+0000","last_undegraded":"2024-05-30T16:53:20.556865+0000","last_fullsized":"2024-05-30T16:53:20.556865+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":124,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 10s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922746880,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":254,"num_read_kb":1040384,"num_write":220,"num_write_kb":901120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"74'3","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:17.316151+0000","last_change":"2024-05-30T16:53:17.316200+0000","last_active":"2024-05-30T16:53:17.316151+0000","last_peered":"2024-05-30T16:53:17.316151+0000","last_clean":"2024-05-30T16:53:17.316151+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:53:17.316151+0000","last_undegraded":"2024-05-30T16:53:17.316151+0000","last_fullsized":"2024-05-30T16:53:17.316151+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'3","last_scrub_stamp":"2024-05-30T16:53:17.316008+0000","last_deep_scrub":"74'3","last_deep_scrub_stamp":"2024-05-30T16:53:17.316008+0000","last_clean_scrub_stamp":"2024-05-30T16:53:17.316008+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:04:01.412620+0000","scrub_duration":947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"74'316","reported_seq":509,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.551632+0000","last_change":"2024-05-30T16:53:13.473961+0000","last_active":"2024-05-30T16:53:20.551632+0000","last_peered":"2024-05-30T16:53:20.551632+0000","last_clean":"2024-05-30T16:53:20.551632+0000","last_became_active":"2024-05-30T16:50:01.225437+0000","last_became_peered":"2024-05-30T16:50:01.225437+0000","last_unstale":"2024-05-30T16:53:20.551632+0000","last_undegraded":"2024-05-30T16:53:20.551632+0000","last_fullsized":"2024-05-30T16:53:20.551632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":74,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 7s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529413,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":168,"num_read_kb":684033,"num_write":189,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'58","reported_seq":86,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.942855+0000","last_change":"2024-05-30T16:53:01.923227+0000","last_active":"2024-05-30T16:53:04.942855+0000","last_peered":"2024-05-30T16:53:04.942855+0000","last_clean":"2024-05-30T16:53:04.942855+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:53:04.942855+0000","last_undegraded":"2024-05-30T16:53:04.942855+0000","last_fullsized":"2024-05-30T16:53:04.942855+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'50","last_scrub_stamp":"2024-05-30T16:53:01.923058+0000","last_deep_scrub":"74'50","last_deep_scrub_stamp":"2024-05-30T16:53:01.923058+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.923058+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:06.391784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238778,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"74'453","reported_seq":756,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:19.327449+0000","last_change":"2024-05-30T16:53:19.327520+0000","last_active":"2024-05-30T16:53:19.327449+0000","last_peered":"2024-05-30T16:53:19.327449+0000","last_clean":"2024-05-30T16:53:19.327449+0000","last_became_active":"2024-05-30T16:50:01.213263+0000","last_became_peered":"2024-05-30T16:50:01.213263+0000","last_unstale":"2024-05-30T16:53:19.327449+0000","last_undegraded":"2024-05-30T16:53:19.327449+0000","last_fullsized":"2024-05-30T16:53:19.327449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'453","last_scrub_stamp":"2024-05-30T16:53:19.327329+0000","last_deep_scrub":"74'453","last_deep_scrub_stamp":"2024-05-30T16:53:19.327329+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.327329+0000","objects_scrubbed":202,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:31:38.171957+0000","scrub_duration":10877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":268,"num_read_kb":1089538,"num_write":204,"num_write_kb":827393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:11.388441+0000","last_change":"2024-05-30T16:53:11.388489+0000","last_active":"2024-05-30T16:53:11.388441+0000","last_peered":"2024-05-30T16:53:11.388441+0000","last_clean":"2024-05-30T16:53:11.388441+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:53:11.388441+0000","last_undegraded":"2024-05-30T16:53:11.388441+0000","last_fullsized":"2024-05-30T16:53:11.388441+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'1","last_scrub_stamp":"2024-05-30T16:53:11.388329+0000","last_deep_scrub":"71'1","last_deep_scrub_stamp":"2024-05-30T16:53:11.388329+0000","last_clean_scrub_stamp":"2024-05-30T16:53:11.388329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:07.429914+0000","scrub_duration":69,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"74'394","reported_seq":633,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.987521+0000","last_change":"2024-05-30T16:53:11.540962+0000","last_active":"2024-05-30T16:53:20.987521+0000","last_peered":"2024-05-30T16:53:20.987521+0000","last_clean":"2024-05-30T16:53:20.987521+0000","last_became_active":"2024-05-30T16:50:01.209406+0000","last_became_peered":"2024-05-30T16:50:01.209406+0000","last_unstale":"2024-05-30T16:53:20.987521+0000","last_undegraded":"2024-05-30T16:53:20.987521+0000","last_fullsized":"2024-05-30T16:53:20.987521+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":149,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 9s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":211,"num_read_kb":856066,"num_write":191,"num_write_kb":774145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.286464+0000","last_change":"2024-05-30T16:53:04.286511+0000","last_active":"2024-05-30T16:53:04.286464+0000","last_peered":"2024-05-30T16:53:04.286464+0000","last_clean":"2024-05-30T16:53:04.286464+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:53:04.286464+0000","last_undegraded":"2024-05-30T16:53:04.286464+0000","last_fullsized":"2024-05-30T16:53:04.286464+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:04.286307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:04.286307+0000","last_clean_scrub_stamp":"2024-05-30T16:53:04.286307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:26:45.450381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"74'427","reported_seq":654,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:19.320941+0000","last_change":"2024-05-30T16:53:19.321003+0000","last_active":"2024-05-30T16:53:19.320941+0000","last_peered":"2024-05-30T16:53:19.320941+0000","last_clean":"2024-05-30T16:53:19.320941+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:53:19.320941+0000","last_undegraded":"2024-05-30T16:53:19.320941+0000","last_fullsized":"2024-05-30T16:53:19.320941+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'427","last_scrub_stamp":"2024-05-30T16:53:19.320817+0000","last_deep_scrub":"74'427","last_deep_scrub_stamp":"2024-05-30T16:53:19.320817+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.320817+0000","objects_scrubbed":176,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:22.561197+0000","scrub_duration":12525,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":738197504,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":193,"num_read_kb":753673,"num_write":186,"num_write_kb":720901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:02.375189+0000","last_change":"2024-05-30T16:53:02.375263+0000","last_active":"2024-05-30T16:53:02.375189+0000","last_peered":"2024-05-30T16:53:02.375189+0000","last_clean":"2024-05-30T16:53:02.375189+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:53:02.375189+0000","last_undegraded":"2024-05-30T16:53:02.375189+0000","last_fullsized":"2024-05-30T16:53:02.375189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:02.375062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:02.375062+0000","last_clean_scrub_stamp":"2024-05-30T16:53:02.375062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:29:18.498626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"74'430","reported_seq":577,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:20.564562+0000","last_change":"2024-05-30T16:53:20.564671+0000","last_active":"2024-05-30T16:53:20.564562+0000","last_peered":"2024-05-30T16:53:20.564562+0000","last_clean":"2024-05-30T16:53:20.564562+0000","last_became_active":"2024-05-30T16:50:01.223472+0000","last_became_peered":"2024-05-30T16:50:01.223472+0000","last_unstale":"2024-05-30T16:53:20.564562+0000","last_undegraded":"2024-05-30T16:53:20.564562+0000","last_fullsized":"2024-05-30T16:53:20.564562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'430","last_scrub_stamp":"2024-05-30T16:53:20.564409+0000","last_deep_scrub":"74'430","last_deep_scrub_stamp":"2024-05-30T16:53:20.564409+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.564409+0000","objects_scrubbed":185,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:40.679271+0000","scrub_duration":10264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":113,"num_read_kb":446468,"num_write":189,"num_write_kb":757762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"74'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:05.505565+0000","last_change":"2024-05-30T16:53:05.505609+0000","last_active":"2024-05-30T16:53:05.505565+0000","last_peered":"2024-05-30T16:53:05.505565+0000","last_clean":"2024-05-30T16:53:05.505565+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:53:05.505565+0000","last_undegraded":"2024-05-30T16:53:05.505565+0000","last_fullsized":"2024-05-30T16:53:05.505565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'1","last_scrub_stamp":"2024-05-30T16:53:05.505429+0000","last_deep_scrub":"74'1","last_deep_scrub_stamp":"2024-05-30T16:53:05.505429+0000","last_clean_scrub_stamp":"2024-05-30T16:53:05.505429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:44:57.297092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"74'254","reported_seq":412,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.981445+0000","last_change":"2024-05-30T16:53:18.486862+0000","last_active":"2024-05-30T16:53:20.981445+0000","last_peered":"2024-05-30T16:53:20.981445+0000","last_clean":"2024-05-30T16:53:20.981445+0000","last_became_active":"2024-05-30T16:50:36.236903+0000","last_became_peered":"2024-05-30T16:50:36.236903+0000","last_unstale":"2024-05-30T16:53:20.981445+0000","last_undegraded":"2024-05-30T16:53:20.981445+0000","last_fullsized":"2024-05-30T16:53:20.981445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":24,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721420288,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":120,"num_read_kb":483330,"num_write":174,"num_write_kb":704513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.212031+0000","last_change":"2024-05-30T16:53:04.212139+0000","last_active":"2024-05-30T16:53:04.212031+0000","last_peered":"2024-05-30T16:53:04.212031+0000","last_clean":"2024-05-30T16:53:04.212031+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:53:04.212031+0000","last_undegraded":"2024-05-30T16:53:04.212031+0000","last_fullsized":"2024-05-30T16:53:04.212031+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:04.211804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:04.211804+0000","last_clean_scrub_stamp":"2024-05-30T16:53:04.211804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:08.732064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"74'442","reported_seq":709,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:07.853972+0000","last_change":"2024-05-30T16:53:07.854103+0000","last_active":"2024-05-30T16:53:07.853972+0000","last_peered":"2024-05-30T16:53:07.853972+0000","last_clean":"2024-05-30T16:53:07.853972+0000","last_became_active":"2024-05-30T16:50:01.205079+0000","last_became_peered":"2024-05-30T16:50:01.205079+0000","last_unstale":"2024-05-30T16:53:07.853972+0000","last_undegraded":"2024-05-30T16:53:07.853972+0000","last_fullsized":"2024-05-30T16:53:07.853972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'442","last_scrub_stamp":"2024-05-30T16:53:07.853860+0000","last_deep_scrub":"74'442","last_deep_scrub_stamp":"2024-05-30T16:53:07.853860+0000","last_clean_scrub_stamp":"2024-05-30T16:53:07.853860+0000","objects_scrubbed":199,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:58.219094+0000","scrub_duration":2654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834666496,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":233,"num_read_kb":946178,"num_write":201,"num_write_kb":815105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'57","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:02.917296+0000","last_change":"2024-05-30T16:53:02.917407+0000","last_active":"2024-05-30T16:53:02.917296+0000","last_peered":"2024-05-30T16:53:02.917296+0000","last_clean":"2024-05-30T16:53:02.917296+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:53:02.917296+0000","last_undegraded":"2024-05-30T16:53:02.917296+0000","last_fullsized":"2024-05-30T16:53:02.917296+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'57","last_scrub_stamp":"2024-05-30T16:53:02.917080+0000","last_deep_scrub":"74'57","last_deep_scrub_stamp":"2024-05-30T16:53:02.917080+0000","last_clean_scrub_stamp":"2024-05-30T16:53:02.917080+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:33.815477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'441","reported_seq":659,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:20.987378+0000","last_change":"2024-05-30T16:53:20.987486+0000","last_active":"2024-05-30T16:53:20.987378+0000","last_peered":"2024-05-30T16:53:20.987378+0000","last_clean":"2024-05-30T16:53:20.987378+0000","last_became_active":"2024-05-30T16:50:01.216841+0000","last_became_peered":"2024-05-30T16:50:01.216841+0000","last_unstale":"2024-05-30T16:53:20.987378+0000","last_undegraded":"2024-05-30T16:53:20.987378+0000","last_fullsized":"2024-05-30T16:53:20.987378+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'441","last_scrub_stamp":"2024-05-30T16:53:20.987272+0000","last_deep_scrub":"74'441","last_deep_scrub_stamp":"2024-05-30T16:53:20.987272+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.987272+0000","objects_scrubbed":194,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:01:37.810731+0000","scrub_duration":10519,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":184,"num_read_kb":737284,"num_write":200,"num_write_kb":794627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'1004","reported_seq":1032,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:02.291285+0000","last_change":"2024-05-30T16:53:02.291356+0000","last_active":"2024-05-30T16:53:02.291285+0000","last_peered":"2024-05-30T16:53:02.291285+0000","last_clean":"2024-05-30T16:53:02.291285+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:53:02.291285+0000","last_undegraded":"2024-05-30T16:53:02.291285+0000","last_fullsized":"2024-05-30T16:53:02.291285+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'1004","last_scrub_stamp":"2024-05-30T16:53:02.291057+0000","last_deep_scrub":"74'1004","last_deep_scrub_stamp":"2024-05-30T16:53:02.291057+0000","last_clean_scrub_stamp":"2024-05-30T16:53:02.291057+0000","objects_scrubbed":4,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:37.410755+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":4470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"74'420","reported_seq":604,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.889121+0000","last_change":"2024-05-30T16:53:08.160379+0000","last_active":"2024-05-30T16:53:21.889121+0000","last_peered":"2024-05-30T16:53:21.889121+0000","last_clean":"2024-05-30T16:53:21.889121+0000","last_became_active":"2024-05-30T16:50:01.218601+0000","last_became_peered":"2024-05-30T16:50:01.218601+0000","last_unstale":"2024-05-30T16:53:21.889121+0000","last_undegraded":"2024-05-30T16:53:21.889121+0000","last_fullsized":"2024-05-30T16:53:21.889121+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":174,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 13s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":155,"num_read_kb":626690,"num_write":195,"num_write_kb":790529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"74'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:01.240100+0000","last_change":"2024-05-30T16:53:01.240136+0000","last_active":"2024-05-30T16:53:01.240100+0000","last_peered":"2024-05-30T16:53:01.240100+0000","last_clean":"2024-05-30T16:53:01.240100+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:53:01.240100+0000","last_undegraded":"2024-05-30T16:53:01.240100+0000","last_fullsized":"2024-05-30T16:53:01.240100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-05-30T16:53:01.240015+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-05-30T16:53:01.240015+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.240015+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:15:03.485036+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"74'483","reported_seq":669,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:19.337728+0000","last_change":"2024-05-30T16:53:19.337867+0000","last_active":"2024-05-30T16:53:19.337728+0000","last_peered":"2024-05-30T16:53:19.337728+0000","last_clean":"2024-05-30T16:53:19.337728+0000","last_became_active":"2024-05-30T16:50:01.223101+0000","last_became_peered":"2024-05-30T16:50:01.223101+0000","last_unstale":"2024-05-30T16:53:19.337728+0000","last_undegraded":"2024-05-30T16:53:19.337728+0000","last_fullsized":"2024-05-30T16:53:19.337728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'483","last_scrub_stamp":"2024-05-30T16:53:19.337612+0000","last_deep_scrub":"74'483","last_deep_scrub_stamp":"2024-05-30T16:53:19.337612+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.337612+0000","objects_scrubbed":212,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:07.954484+0000","scrub_duration":11129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":151,"num_read_kb":610306,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:12.364997+0000","last_change":"2024-05-30T16:53:12.365041+0000","last_active":"2024-05-30T16:53:12.364997+0000","last_peered":"2024-05-30T16:53:12.364997+0000","last_clean":"2024-05-30T16:53:12.364997+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:53:12.364997+0000","last_undegraded":"2024-05-30T16:53:12.364997+0000","last_fullsized":"2024-05-30T16:53:12.364997+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:12.364834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:12.364834+0000","last_clean_scrub_stamp":"2024-05-30T16:53:12.364834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:42.823982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'409","reported_seq":616,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:05.914721+0000","last_change":"2024-05-30T16:53:05.914807+0000","last_active":"2024-05-30T16:53:05.914721+0000","last_peered":"2024-05-30T16:53:05.914721+0000","last_clean":"2024-05-30T16:53:05.914721+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:53:05.914721+0000","last_undegraded":"2024-05-30T16:53:05.914721+0000","last_fullsized":"2024-05-30T16:53:05.914721+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'409","last_scrub_stamp":"2024-05-30T16:53:05.914598+0000","last_deep_scrub":"74'409","last_deep_scrub_stamp":"2024-05-30T16:53:05.914598+0000","last_clean_scrub_stamp":"2024-05-30T16:53:05.914598+0000","objects_scrubbed":185,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:26:24.636369+0000","scrub_duration":3161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":185,"num_write_kb":757760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.145955+0000","last_change":"2024-05-30T16:53:04.145980+0000","last_active":"2024-05-30T16:53:04.145955+0000","last_peered":"2024-05-30T16:53:04.145955+0000","last_clean":"2024-05-30T16:53:04.145955+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:53:04.145955+0000","last_undegraded":"2024-05-30T16:53:04.145955+0000","last_fullsized":"2024-05-30T16:53:04.145955+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:04.145859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:04.145859+0000","last_clean_scrub_stamp":"2024-05-30T16:53:04.145859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:27.268894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"74'478","reported_seq":709,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:20.204770+0000","last_change":"2024-05-30T16:53:20.204863+0000","last_active":"2024-05-30T16:53:20.204770+0000","last_peered":"2024-05-30T16:53:20.204770+0000","last_clean":"2024-05-30T16:53:20.204770+0000","last_became_active":"2024-05-30T16:50:01.207140+0000","last_became_peered":"2024-05-30T16:50:01.207140+0000","last_unstale":"2024-05-30T16:53:20.204770+0000","last_undegraded":"2024-05-30T16:53:20.204770+0000","last_fullsized":"2024-05-30T16:53:20.204770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'478","last_scrub_stamp":"2024-05-30T16:53:20.204659+0000","last_deep_scrub":"74'478","last_deep_scrub_stamp":"2024-05-30T16:53:20.204659+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.204659+0000","objects_scrubbed":213,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:10:13.564362+0000","scrub_duration":14828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":196,"num_read_kb":782341,"num_write":217,"num_write_kb":872450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"74'12","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:02.487875+0000","last_change":"2024-05-30T16:53:02.487949+0000","last_active":"2024-05-30T16:53:02.487875+0000","last_peered":"2024-05-30T16:53:02.487875+0000","last_clean":"2024-05-30T16:53:02.487875+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:53:02.487875+0000","last_undegraded":"2024-05-30T16:53:02.487875+0000","last_fullsized":"2024-05-30T16:53:02.487875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'12","last_scrub_stamp":"2024-05-30T16:53:02.487684+0000","last_deep_scrub":"74'12","last_deep_scrub_stamp":"2024-05-30T16:53:02.487684+0000","last_clean_scrub_stamp":"2024-05-30T16:53:02.487684+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:07.007943+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"74'429","reported_seq":531,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:19.814180+0000","last_change":"2024-05-30T16:53:09.505506+0000","last_active":"2024-05-30T16:53:19.814180+0000","last_peered":"2024-05-30T16:53:19.814180+0000","last_clean":"2024-05-30T16:53:19.814180+0000","last_became_active":"2024-05-30T16:50:01.214868+0000","last_became_peered":"2024-05-30T16:50:01.214868+0000","last_unstale":"2024-05-30T16:53:19.814180+0000","last_undegraded":"2024-05-30T16:53:19.814180+0000","last_fullsized":"2024-05-30T16:53:19.814180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":199,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 11s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998275,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":72,"num_read_kb":290817,"num_write":212,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"74'2","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:14.696528+0000","last_change":"2024-05-30T16:53:14.696581+0000","last_active":"2024-05-30T16:53:14.696528+0000","last_peered":"2024-05-30T16:53:14.696528+0000","last_clean":"2024-05-30T16:53:14.696528+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:53:14.696528+0000","last_undegraded":"2024-05-30T16:53:14.696528+0000","last_fullsized":"2024-05-30T16:53:14.696528+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'2","last_scrub_stamp":"2024-05-30T16:53:14.696383+0000","last_deep_scrub":"74'2","last_deep_scrub_stamp":"2024-05-30T16:53:14.696383+0000","last_clean_scrub_stamp":"2024-05-30T16:53:14.696383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:10.423272+0000","scrub_duration":344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"74'307","reported_seq":565,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.984887+0000","last_change":"2024-05-30T16:53:16.395014+0000","last_active":"2024-05-30T16:53:20.984887+0000","last_peered":"2024-05-30T16:53:20.984887+0000","last_clean":"2024-05-30T16:53:20.984887+0000","last_became_active":"2024-05-30T16:50:01.225825+0000","last_became_peered":"2024-05-30T16:50:01.225825+0000","last_unstale":"2024-05-30T16:53:20.984887+0000","last_undegraded":"2024-05-30T16:53:20.984887+0000","last_fullsized":"2024-05-30T16:53:20.984887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":49,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415354,"num_objects":209,"num_object_clones":0,"num_object_copies":418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":234,"num_read_kb":942084,"num_write":213,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:03.494880+0000","last_change":"2024-05-30T16:53:03.494943+0000","last_active":"2024-05-30T16:53:03.494880+0000","last_peered":"2024-05-30T16:53:03.494880+0000","last_clean":"2024-05-30T16:53:03.494880+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:53:03.494880+0000","last_undegraded":"2024-05-30T16:53:03.494880+0000","last_fullsized":"2024-05-30T16:53:03.494880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'3","last_scrub_stamp":"2024-05-30T16:53:03.494691+0000","last_deep_scrub":"74'3","last_deep_scrub_stamp":"2024-05-30T16:53:03.494691+0000","last_clean_scrub_stamp":"2024-05-30T16:53:03.494691+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:22:00.528435+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"74'448","reported_seq":653,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.401864+0000","last_change":"2024-05-30T16:53:08.337244+0000","last_active":"2024-05-30T16:53:21.401864+0000","last_peered":"2024-05-30T16:53:21.401864+0000","last_clean":"2024-05-30T16:53:21.401864+0000","last_became_active":"2024-05-30T16:50:01.217748+0000","last_became_peered":"2024-05-30T16:50:01.217748+0000","last_unstale":"2024-05-30T16:53:21.401864+0000","last_undegraded":"2024-05-30T16:53:21.401864+0000","last_fullsized":"2024-05-30T16:53:21.401864+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":174,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 13s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855638016,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":176,"num_read_kb":679946,"num_write":218,"num_write_kb":835591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"74'2","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:09.491991+0000","last_change":"2024-05-30T16:53:09.492042+0000","last_active":"2024-05-30T16:53:09.491991+0000","last_peered":"2024-05-30T16:53:09.491991+0000","last_clean":"2024-05-30T16:53:09.491991+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:53:09.491991+0000","last_undegraded":"2024-05-30T16:53:09.491991+0000","last_fullsized":"2024-05-30T16:53:09.491991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'2","last_scrub_stamp":"2024-05-30T16:53:09.491870+0000","last_deep_scrub":"74'2","last_deep_scrub_stamp":"2024-05-30T16:53:09.491870+0000","last_clean_scrub_stamp":"2024-05-30T16:53:09.491870+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:39.255201+0000","scrub_duration":222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"74'467","reported_seq":729,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.990590+0000","last_change":"2024-05-30T16:53:09.380780+0000","last_active":"2024-05-30T16:53:20.990590+0000","last_peered":"2024-05-30T16:53:20.990590+0000","last_clean":"2024-05-30T16:53:20.990590+0000","last_became_active":"2024-05-30T16:50:01.216443+0000","last_became_peered":"2024-05-30T16:50:01.216443+0000","last_unstale":"2024-05-30T16:53:20.990590+0000","last_undegraded":"2024-05-30T16:53:20.990590+0000","last_fullsized":"2024-05-30T16:53:20.990590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":221,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 12s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":926941184,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":231,"num_read_kb":933891,"num_write":223,"num_write_kb":905217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:06.126005+0000","last_change":"2024-05-30T16:53:06.126084+0000","last_active":"2024-05-30T16:53:06.126005+0000","last_peered":"2024-05-30T16:53:06.126005+0000","last_clean":"2024-05-30T16:53:06.126005+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:53:06.126005+0000","last_undegraded":"2024-05-30T16:53:06.126005+0000","last_fullsized":"2024-05-30T16:53:06.126005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:06.125773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:06.125773+0000","last_clean_scrub_stamp":"2024-05-30T16:53:06.125773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:37.024170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'448","reported_seq":663,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:14.722681+0000","last_change":"2024-05-30T16:53:14.722761+0000","last_active":"2024-05-30T16:53:14.722681+0000","last_peered":"2024-05-30T16:53:14.722681+0000","last_clean":"2024-05-30T16:53:14.722681+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:53:14.722681+0000","last_undegraded":"2024-05-30T16:53:14.722681+0000","last_fullsized":"2024-05-30T16:53:14.722681+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'448","last_scrub_stamp":"2024-05-30T16:53:14.722565+0000","last_deep_scrub":"74'448","last_deep_scrub_stamp":"2024-05-30T16:53:14.722565+0000","last_clean_scrub_stamp":"2024-05-30T16:53:14.722565+0000","objects_scrubbed":195,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:45.421341+0000","scrub_duration":9855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809501194,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":180,"num_read_kb":724995,"num_write":197,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:10.283307+0000","last_change":"2024-05-30T16:53:10.283346+0000","last_active":"2024-05-30T16:53:10.283307+0000","last_peered":"2024-05-30T16:53:10.283307+0000","last_clean":"2024-05-30T16:53:10.283307+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:53:10.283307+0000","last_undegraded":"2024-05-30T16:53:10.283307+0000","last_fullsized":"2024-05-30T16:53:10.283307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:10.283182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:10.283182+0000","last_clean_scrub_stamp":"2024-05-30T16:53:10.283182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:33.406217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"74'440","reported_seq":605,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:19.469189+0000","last_change":"2024-05-30T16:53:19.469308+0000","last_active":"2024-05-30T16:53:19.469189+0000","last_peered":"2024-05-30T16:53:19.469189+0000","last_clean":"2024-05-30T16:53:19.469189+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:53:19.469189+0000","last_undegraded":"2024-05-30T16:53:19.469189+0000","last_fullsized":"2024-05-30T16:53:19.469189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'440","last_scrub_stamp":"2024-05-30T16:53:19.469048+0000","last_deep_scrub":"74'440","last_deep_scrub_stamp":"2024-05-30T16:53:19.469048+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.469048+0000","objects_scrubbed":192,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:04:50.651535+0000","scrub_duration":12548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801112325,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":131,"num_read_kb":532481,"num_write":194,"num_write_kb":782338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:03.103685+0000","last_change":"2024-05-30T16:53:03.103744+0000","last_active":"2024-05-30T16:53:03.103685+0000","last_peered":"2024-05-30T16:53:03.103685+0000","last_clean":"2024-05-30T16:53:03.103685+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:53:03.103685+0000","last_undegraded":"2024-05-30T16:53:03.103685+0000","last_fullsized":"2024-05-30T16:53:03.103685+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:03.103475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:03.103475+0000","last_clean_scrub_stamp":"2024-05-30T16:53:03.103475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:09.267680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"74'431","reported_seq":644,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:20.564397+0000","last_change":"2024-05-30T16:53:20.564494+0000","last_active":"2024-05-30T16:53:20.564397+0000","last_peered":"2024-05-30T16:53:20.564397+0000","last_clean":"2024-05-30T16:53:20.564397+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:53:20.564397+0000","last_undegraded":"2024-05-30T16:53:20.564397+0000","last_fullsized":"2024-05-30T16:53:20.564397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'431","last_scrub_stamp":"2024-05-30T16:53:20.564265+0000","last_deep_scrub":"74'431","last_deep_scrub_stamp":"2024-05-30T16:53:20.564265+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.564265+0000","objects_scrubbed":193,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:12:16.852199+0000","scrub_duration":12673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":179,"num_read_kb":716804,"num_write":199,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:00.757415+0000","last_change":"2024-05-30T16:53:00.757447+0000","last_active":"2024-05-30T16:53:00.757415+0000","last_peered":"2024-05-30T16:53:00.757415+0000","last_clean":"2024-05-30T16:53:00.757415+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:53:00.757415+0000","last_undegraded":"2024-05-30T16:53:00.757415+0000","last_fullsized":"2024-05-30T16:53:00.757415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:00.757342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:00.757342+0000","last_clean_scrub_stamp":"2024-05-30T16:53:00.757342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:06.921548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"74'452","reported_seq":601,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:12.109085+0000","last_change":"2024-05-30T16:53:12.109159+0000","last_active":"2024-05-30T16:53:12.109085+0000","last_peered":"2024-05-30T16:53:12.109085+0000","last_clean":"2024-05-30T16:53:12.109085+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:53:12.109085+0000","last_undegraded":"2024-05-30T16:53:12.109085+0000","last_fullsized":"2024-05-30T16:53:12.109085+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'452","last_scrub_stamp":"2024-05-30T16:53:12.108986+0000","last_deep_scrub":"74'452","last_deep_scrub_stamp":"2024-05-30T16:53:12.108986+0000","last_clean_scrub_stamp":"2024-05-30T16:53:12.108986+0000","objects_scrubbed":201,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:21:22.025902+0000","scrub_duration":8327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":113,"num_read_kb":454658,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:13.447979+0000","last_change":"2024-05-30T16:53:13.448027+0000","last_active":"2024-05-30T16:53:13.447979+0000","last_peered":"2024-05-30T16:53:13.447979+0000","last_clean":"2024-05-30T16:53:13.447979+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:53:13.447979+0000","last_undegraded":"2024-05-30T16:53:13.447979+0000","last_fullsized":"2024-05-30T16:53:13.447979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'3","last_scrub_stamp":"2024-05-30T16:53:13.447816+0000","last_deep_scrub":"74'3","last_deep_scrub_stamp":"2024-05-30T16:53:13.447816+0000","last_clean_scrub_stamp":"2024-05-30T16:53:13.447816+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:22:06.744688+0000","scrub_duration":137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"74'371","reported_seq":642,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.566104+0000","last_change":"2024-05-30T16:53:11.348523+0000","last_active":"2024-05-30T16:53:20.566104+0000","last_peered":"2024-05-30T16:53:20.566104+0000","last_clean":"2024-05-30T16:53:20.566104+0000","last_became_active":"2024-05-30T16:50:01.224834+0000","last_became_peered":"2024-05-30T16:50:01.224834+0000","last_unstale":"2024-05-30T16:53:20.566104+0000","last_undegraded":"2024-05-30T16:53:20.566104+0000","last_fullsized":"2024-05-30T16:53:20.566104+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":124,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 9s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":244,"num_read_kb":999424,"num_write":207,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"74'92","reported_seq":120,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:05.122949+0000","last_change":"2024-05-30T16:53:05.122949+0000","last_active":"2024-05-30T16:53:05.122949+0000","last_peered":"2024-05-30T16:53:05.122949+0000","last_clean":"2024-05-30T16:53:05.122949+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:53:05.122949+0000","last_undegraded":"2024-05-30T16:53:05.122949+0000","last_fullsized":"2024-05-30T16:53:05.122949+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'91","last_scrub_stamp":"2024-05-30T16:53:05.122619+0000","last_deep_scrub":"74'91","last_deep_scrub_stamp":"2024-05-30T16:53:05.122619+0000","last_clean_scrub_stamp":"2024-05-30T16:53:05.122619+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:30.002675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2455,"num_omap_keys":40,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"74'437","reported_seq":746,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:21.890329+0000","last_change":"2024-05-30T16:53:21.890502+0000","last_active":"2024-05-30T16:53:21.890329+0000","last_peered":"2024-05-30T16:53:21.890329+0000","last_clean":"2024-05-30T16:53:21.890329+0000","last_became_active":"2024-05-30T16:50:01.221622+0000","last_became_peered":"2024-05-30T16:50:01.221622+0000","last_unstale":"2024-05-30T16:53:21.890329+0000","last_undegraded":"2024-05-30T16:53:21.890329+0000","last_fullsized":"2024-05-30T16:53:21.890329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'437","last_scrub_stamp":"2024-05-30T16:53:21.890229+0000","last_deep_scrub":"74'437","last_deep_scrub_stamp":"2024-05-30T16:53:21.890229+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.890229+0000","objects_scrubbed":191,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:46.369588+0000","scrub_duration":10735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918021,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":275,"num_read_kb":1114115,"num_write":197,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:01.328398+0000","last_change":"2024-05-30T16:53:01.328453+0000","last_active":"2024-05-30T16:53:01.328398+0000","last_peered":"2024-05-30T16:53:01.328398+0000","last_clean":"2024-05-30T16:53:01.328398+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:53:01.328398+0000","last_undegraded":"2024-05-30T16:53:01.328398+0000","last_fullsized":"2024-05-30T16:53:01.328398+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:01.328104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:01.328104+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.328104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:27:30.163472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"74'319","reported_seq":491,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:20.613776+0000","last_change":"2024-05-30T16:53:14.347631+0000","last_active":"2024-05-30T16:53:20.613776+0000","last_peered":"2024-05-30T16:53:20.613776+0000","last_clean":"2024-05-30T16:53:20.613776+0000","last_became_active":"2024-05-30T16:50:01.224600+0000","last_became_peered":"2024-05-30T16:50:01.224600+0000","last_unstale":"2024-05-30T16:53:20.613776+0000","last_undegraded":"2024-05-30T16:53:20.613776+0000","last_fullsized":"2024-05-30T16:53:20.613776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":74,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 6s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838861053,"num_objects":203,"num_object_clones":1,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":1,"num_read":148,"num_read_kb":602113,"num_write":203,"num_write_kb":819202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:01.742838+0000","last_change":"2024-05-30T16:53:01.742864+0000","last_active":"2024-05-30T16:53:01.742838+0000","last_peered":"2024-05-30T16:53:01.742838+0000","last_clean":"2024-05-30T16:53:01.742838+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:53:01.742838+0000","last_undegraded":"2024-05-30T16:53:01.742838+0000","last_fullsized":"2024-05-30T16:53:01.742838+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:01.742748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:01.742748+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.742748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:15.106285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"74'454","reported_seq":663,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:21.784370+0000","last_change":"2024-05-30T16:53:21.784404+0000","last_active":"2024-05-30T16:53:21.784370+0000","last_peered":"2024-05-30T16:53:21.784370+0000","last_clean":"2024-05-30T16:53:21.784370+0000","last_became_active":"2024-05-30T16:50:01.214152+0000","last_became_peered":"2024-05-30T16:50:01.214152+0000","last_unstale":"2024-05-30T16:53:21.784370+0000","last_undegraded":"2024-05-30T16:53:21.784370+0000","last_fullsized":"2024-05-30T16:53:21.784370+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'454","last_scrub_stamp":"2024-05-30T16:53:21.784276+0000","last_deep_scrub":"74'454","last_deep_scrub_stamp":"2024-05-30T16:53:21.784276+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.784276+0000","objects_scrubbed":201,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":16,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:38.879887+0000","scrub_duration":15418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860931,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":174,"num_read_kb":708609,"num_write":201,"num_write_kb":819201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:03.340718+0000","last_change":"2024-05-30T16:53:03.340743+0000","last_active":"2024-05-30T16:53:03.340718+0000","last_peered":"2024-05-30T16:53:03.340718+0000","last_clean":"2024-05-30T16:53:03.340718+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:53:03.340718+0000","last_undegraded":"2024-05-30T16:53:03.340718+0000","last_fullsized":"2024-05-30T16:53:03.340718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:03.340597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:03.340597+0000","last_clean_scrub_stamp":"2024-05-30T16:53:03.340597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:57.637967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"74'451","reported_seq":731,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:12.373320+0000","last_change":"2024-05-30T16:53:12.373402+0000","last_active":"2024-05-30T16:53:12.373320+0000","last_peered":"2024-05-30T16:53:12.373320+0000","last_clean":"2024-05-30T16:53:12.373320+0000","last_became_active":"2024-05-30T16:50:01.214454+0000","last_became_peered":"2024-05-30T16:50:01.214454+0000","last_unstale":"2024-05-30T16:53:12.373320+0000","last_undegraded":"2024-05-30T16:53:12.373320+0000","last_fullsized":"2024-05-30T16:53:12.373320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'451","last_scrub_stamp":"2024-05-30T16:53:12.373183+0000","last_deep_scrub":"74'451","last_deep_scrub_stamp":"2024-05-30T16:53:12.373183+0000","last_clean_scrub_stamp":"2024-05-30T16:53:12.373183+0000","objects_scrubbed":204,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:59:05.173576+0000","scrub_duration":5112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443843,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":245,"num_read_kb":999425,"num_write":206,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:03.245968+0000","last_change":"2024-05-30T16:53:03.246019+0000","last_active":"2024-05-30T16:53:03.245968+0000","last_peered":"2024-05-30T16:53:03.245968+0000","last_clean":"2024-05-30T16:53:03.245968+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:53:03.245968+0000","last_undegraded":"2024-05-30T16:53:03.245968+0000","last_fullsized":"2024-05-30T16:53:03.245968+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:03.245781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:03.245781+0000","last_clean_scrub_stamp":"2024-05-30T16:53:03.245781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:41.217470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"74'510","reported_seq":771,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:19.474270+0000","last_change":"2024-05-30T16:53:19.474357+0000","last_active":"2024-05-30T16:53:19.474270+0000","last_peered":"2024-05-30T16:53:19.474270+0000","last_clean":"2024-05-30T16:53:19.474270+0000","last_became_active":"2024-05-30T16:50:01.209939+0000","last_became_peered":"2024-05-30T16:50:01.209939+0000","last_unstale":"2024-05-30T16:53:19.474270+0000","last_undegraded":"2024-05-30T16:53:19.474270+0000","last_fullsized":"2024-05-30T16:53:19.474270+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'510","last_scrub_stamp":"2024-05-30T16:53:19.474100+0000","last_deep_scrub":"74'510","last_deep_scrub_stamp":"2024-05-30T16:53:19.474100+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.474100+0000","objects_scrubbed":233,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:35:56.479219+0000","scrub_duration":13161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977272832,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":225,"num_read_kb":921600,"num_write":233,"num_write_kb":954368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"74'86","reported_seq":198,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.494585+0000","last_change":"2024-05-30T16:53:04.494657+0000","last_active":"2024-05-30T16:53:04.494585+0000","last_peered":"2024-05-30T16:53:04.494585+0000","last_clean":"2024-05-30T16:53:04.494585+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:53:04.494585+0000","last_undegraded":"2024-05-30T16:53:04.494585+0000","last_fullsized":"2024-05-30T16:53:04.494585+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'86","last_scrub_stamp":"2024-05-30T16:53:04.494393+0000","last_deep_scrub":"74'86","last_deep_scrub_stamp":"2024-05-30T16:53:04.494393+0000","last_clean_scrub_stamp":"2024-05-30T16:53:04.494393+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:45:21.166357+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":84,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"74'280","reported_seq":531,"reported_epoch":74,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-30T16:53:21.880298+0000","last_change":"2024-05-30T16:53:20.414210+0000","last_active":"2024-05-30T16:53:21.880298+0000","last_peered":"2024-05-30T16:53:21.880298+0000","last_clean":"2024-05-30T16:53:21.880298+0000","last_became_active":"2024-05-30T16:50:01.211630+0000","last_became_peered":"2024-05-30T16:50:01.211630+0000","last_unstale":"2024-05-30T16:53:21.880298+0000","last_undegraded":"2024-05-30T16:53:21.880298+0000","last_fullsized":"2024-05-30T16:53:21.880298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:50:00.160556+0000","last_clean_scrub_stamp":"2024-05-30T16:50:00.160556+0000","objects_scrubbed":24,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":228,"num_read_kb":933888,"num_write":215,"num_write_kb":872449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:08.269305+0000","last_change":"2024-05-30T16:53:08.269343+0000","last_active":"2024-05-30T16:53:08.269305+0000","last_peered":"2024-05-30T16:53:08.269305+0000","last_clean":"2024-05-30T16:53:08.269305+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:53:08.269305+0000","last_undegraded":"2024-05-30T16:53:08.269305+0000","last_fullsized":"2024-05-30T16:53:08.269305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:08.269175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:08.269175+0000","last_clean_scrub_stamp":"2024-05-30T16:53:08.269175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:00.060838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"74'451","reported_seq":721,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:19.350747+0000","last_change":"2024-05-30T16:53:19.350808+0000","last_active":"2024-05-30T16:53:19.350747+0000","last_peered":"2024-05-30T16:53:19.350747+0000","last_clean":"2024-05-30T16:53:19.350747+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:53:19.350747+0000","last_undegraded":"2024-05-30T16:53:19.350747+0000","last_fullsized":"2024-05-30T16:53:19.350747+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'451","last_scrub_stamp":"2024-05-30T16:53:19.350617+0000","last_deep_scrub":"74'451","last_deep_scrub_stamp":"2024-05-30T16:53:19.350617+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.350617+0000","objects_scrubbed":203,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:56.916761+0000","scrub_duration":13467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":235,"num_read_kb":962560,"num_write":203,"num_write_kb":831488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:16.260220+0000","last_change":"2024-05-30T16:53:16.260278+0000","last_active":"2024-05-30T16:53:16.260220+0000","last_peered":"2024-05-30T16:53:16.260220+0000","last_clean":"2024-05-30T16:53:16.260220+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:53:16.260220+0000","last_undegraded":"2024-05-30T16:53:16.260220+0000","last_fullsized":"2024-05-30T16:53:16.260220+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-05-30T16:53:16.260112+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-05-30T16:53:16.260112+0000","last_clean_scrub_stamp":"2024-05-30T16:53:16.260112+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:43:37.437716+0000","scrub_duration":897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"74'119","reported_seq":283,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:05.220740+0000","last_change":"2024-05-30T16:53:05.220808+0000","last_active":"2024-05-30T16:53:05.220740+0000","last_peered":"2024-05-30T16:53:05.220740+0000","last_clean":"2024-05-30T16:53:05.220740+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:53:05.220740+0000","last_undegraded":"2024-05-30T16:53:05.220740+0000","last_fullsized":"2024-05-30T16:53:05.220740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'119","last_scrub_stamp":"2024-05-30T16:53:05.220474+0000","last_deep_scrub":"74'119","last_deep_scrub_stamp":"2024-05-30T16:53:05.220474+0000","last_clean_scrub_stamp":"2024-05-30T16:53:05.220474+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:09.689200+0000","scrub_duration":60,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":53712261060,"num_objects":12829,"num_object_clones":1,"num_object_copies":25658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12829,"num_whiteouts":1,"num_read":12246,"num_read_kb":49496226,"num_write":13027,"num_write_kb":52453497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107424694272,"data_stored":107424522120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25461,"ondisk_log_size":25461,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4446680,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":1463,"num_write_kb":4951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7455,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8953856,"data_stored":8893360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1344,"ondisk_log_size":1344,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15437864,"kb_used_data":15312352,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":78933976,"statfs":{"total":96636764160,"available":80828391424,"internally_reserved":0,"allocated":15679848448,"data_stored":15679297903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,50,10],"upper_bound":2048},"perf_stat":{"commit_latency_ms":441,"apply_latency_ms":441,"commit_latency_ns":441000000,"apply_latency_ns":441000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17321432,"kb_used_data":17195920,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":77050408,"statfs":{"total":96636764160,"available":78899617792,"internally_reserved":0,"allocated":17608622080,"data_stored":17608075002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":376,"apply_latency_ms":376,"commit_latency_ns":376000000,"apply_latency_ns":376000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10656276,"kb_used_data":10589068,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":83715564,"statfs":{"total":96636764160,"available":85724737536,"internally_reserved":0,"allocated":10843205632,"data_stored":10842662378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,25],"upper_bound":16},"perf_stat":{"commit_latency_ms":277,"apply_latency_ms":277,"commit_latency_ns":277000000,"apply_latency_ns":277000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11721528,"kb_used_data":11650160,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":82650312,"statfs":{"total":96636764160,"available":84633919488,"internally_reserved":0,"allocated":11929763840,"data_stored":11929237094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":332,"apply_latency_ms":332,"commit_latency_ns":332000000,"apply_latency_ns":332000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14356244,"kb_used_data":14226572,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":80015596,"statfs":{"total":96636764160,"available":81935970304,"internally_reserved":0,"allocated":14568009728,"data_stored":14567444053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,14],"upper_bound":512},"perf_stat":{"commit_latency_ms":243,"apply_latency_ms":243,"commit_latency_ns":243000000,"apply_latency_ns":243000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16418644,"kb_used_data":16311180,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":77953196,"statfs":{"total":96636764160,"available":79824072704,"internally_reserved":0,"allocated":16702648320,"data_stored":16702105396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,25],"upper_bound":512},"perf_stat":{"commit_latency_ms":228,"apply_latency_ms":228,"commit_latency_ns":228000000,"apply_latency_ns":228000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10819420,"kb_used_data":10711956,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":83552420,"statfs":{"total":96636764160,"available":85557678080,"internally_reserved":0,"allocated":10969042944,"data_stored":10968492566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":240,"apply_latency_ms":240,"commit_latency_ns":240000000,"apply_latency_ns":240000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8998032,"kb_used_data":8926664,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":85373808,"statfs":{"total":96636764160,"available":87422779392,"internally_reserved":0,"allocated":9140903936,"data_stored":9140365112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,25],"upper_bound":256},"perf_stat":{"commit_latency_ms":329,"apply_latency_ms":329,"commit_latency_ns":329000000,"apply_latency_ns":329000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":238890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":250976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":12744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9139408896,"data_stored":9139389333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10963931136,"data_stored":10963911563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16697544704,"data_stored":16697525009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14566858752,"data_stored":14566819752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11928604672,"data_stored":11928600707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10842300416,"data_stored":10842276877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17607712768,"data_stored":17607689499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15678332928,"data_stored":15678309380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:53:25.849 INFO:tasks.ceph:pgid 11.3f last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.849 INFO:tasks.ceph:pgid 11.3e last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.849 INFO:tasks.ceph:pgid 11.3b last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.849 INFO:tasks.ceph:pgid 11.3a last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.850 INFO:tasks.ceph:pgid 11.38 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.850 INFO:tasks.ceph:pgid 11.36 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.850 INFO:tasks.ceph:pgid 11.35 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.850 INFO:tasks.ceph:pgid 11.32 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.851 INFO:tasks.ceph:pgid 11.30 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.851 INFO:tasks.ceph:pgid 11.2d last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.851 INFO:tasks.ceph:pgid 11.2b last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.851 INFO:tasks.ceph:pgid 11.2a last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.851 INFO:tasks.ceph:pgid 11.29 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.852 INFO:tasks.ceph:pgid 11.28 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.852 INFO:tasks.ceph:pgid 11.27 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.852 INFO:tasks.ceph:pgid 11.25 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.852 INFO:tasks.ceph:pgid 11.24 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.852 INFO:tasks.ceph:pgid 11.23 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.852 INFO:tasks.ceph:pgid 11.22 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.853 INFO:tasks.ceph:pgid 11.21 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.853 INFO:tasks.ceph:pgid 11.20 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.853 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.853 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.853 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.853 INFO:tasks.ceph:pgid 11.18 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.854 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.854 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.854 INFO:tasks.ceph:pgid 11.e last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.855 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.855 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.855 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.855 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.855 INFO:tasks.ceph:pgid 11.5 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.856 INFO:tasks.ceph:pgid 11.1 last_scrub_stamp 2024-05-30T16:50:00.160556+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=50, tm_sec=0, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=16, tm_min=52, tm_sec=57, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T16:53:25.856 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-30T16:53:45.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T16:53:46.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.060+0000 7fc2a3600640 1 Processor -- start 2024-05-30T16:53:46.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.060+0000 7fc2a3600640 1 -- start start 2024-05-30T16:53:46.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.062+0000 7fc2a3600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc29c145150 0x7fc29c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.062+0000 7fc2a3600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc29c06f7e0 0x7fc29c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.062+0000 7fc2a3600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c0d00f0 con 0x7fc29c0cfa70 2024-05-30T16:53:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.062+0000 7fc2a3600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc29c0cfeb0 con 0x7fc29c06f7e0 2024-05-30T16:53:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.062+0000 7fc2a3600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc29c15f140 con 0x7fc29c145150 2024-05-30T16:53:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.062+0000 7fc2a1600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc29c06f7e0 0x7fc29c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.062+0000 7fc29be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc29c0cfa70 0x7fc29c06f0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:59040/0 (socket says 172.21.15.144:59040) 2024-05-30T16:53:46.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.062+0000 7fc29be00640 1 -- 172.21.15.144:0/4135433355 learned_addr learned my addr 172.21.15.144:0/4135433355 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-05-30T16:53:46.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.063+0000 7fc2a0c00640 1 --2- 172.21.15.144:0/4135433355 >> v2:172.21.15.149:3300/0 conn(0x7fc29c145150 0x7fc29c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.063+0000 7fc2a1600640 1 -- 172.21.15.144:0/4135433355 >> v2:172.21.15.149:3300/0 conn(0x7fc29c145150 msgr2=0x7fc29c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.063+0000 7fc2a1600640 1 --2- 172.21.15.144:0/4135433355 >> v2:172.21.15.149:3300/0 conn(0x7fc29c145150 0x7fc29c0cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.063+0000 7fc2a1600640 1 -- 172.21.15.144:0/4135433355 >> v1:172.21.15.144:6789/0 conn(0x7fc29c0cfa70 legacy=0x7fc29c06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.063+0000 7fc2a1600640 1 -- 172.21.15.144:0/4135433355 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c15f390 con 0x7fc29c06f7e0 2024-05-30T16:53:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.063+0000 7fc29b400640 1 -- 172.21.15.144:0/4135433355 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825489859 0 0) 0x7fc29c0d00f0 con 0x7fc29c0cfa70 2024-05-30T16:53:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.064+0000 7fc2a1600640 1 --2- 172.21.15.144:0/4135433355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c06f7e0 0x7fc29c0b4930 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0b3db0 tx=0x7fc29402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada345d0bdee9f11 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:46.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.064+0000 7fc29b400640 1 -- 172.21.15.144:0/4135433355 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294007740 con 0x7fc29c06f7e0 2024-05-30T16:53:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.064+0000 7fc29b400640 1 -- 172.21.15.144:0/4135433355 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2940078e0 con 0x7fc29c06f7e0 2024-05-30T16:53:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.064+0000 7fc29b400640 1 -- 172.21.15.144:0/4135433355 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294007cb0 con 0x7fc29c06f7e0 2024-05-30T16:53:46.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.065+0000 7fc2a3600640 1 -- 172.21.15.144:0/4135433355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c06f7e0 msgr2=0x7fc29c0b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.065+0000 7fc2a3600640 1 --2- 172.21.15.144:0/4135433355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c06f7e0 0x7fc29c0b4930 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0b3db0 tx=0x7fc29402a5f0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.065+0000 7fc2a3600640 1 -- 172.21.15.144:0/4135433355 shutdown_connections 2024-05-30T16:53:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.065+0000 7fc2a3600640 1 --2- 172.21.15.144:0/4135433355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c06f7e0 0x7fc29c0b4930 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.065+0000 7fc2a3600640 1 --2- 172.21.15.144:0/4135433355 >> v2:172.21.15.149:3300/0 conn(0x7fc29c145150 0x7fc29c0cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.065+0000 7fc2a3600640 1 -- 172.21.15.144:0/4135433355 >> 172.21.15.144:0/4135433355 conn(0x7fc29c06bd00 msgr2=0x7fc29c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.065+0000 7fc2a3600640 1 -- 172.21.15.144:0/4135433355 shutdown_connections 2024-05-30T16:53:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.065+0000 7fc2a3600640 1 -- 172.21.15.144:0/4135433355 wait complete. 2024-05-30T16:53:46.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.067+0000 7fc2a3600640 1 Processor -- start 2024-05-30T16:53:46.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.067+0000 7fc2a3600640 1 -- start start 2024-05-30T16:53:46.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.068+0000 7fc2a3600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06f7e0 0x7fc29c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.068+0000 7fc2a3600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc29c0cfa70 0x7fc29c0b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.068+0000 7fc2a3600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c145150 0x7fc29c139760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.068+0000 7fc2a3600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c0b64f0 con 0x7fc29c145150 2024-05-30T16:53:46.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.068+0000 7fc2a3600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c15f950 con 0x7fc29c06f7e0 2024-05-30T16:53:46.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.068+0000 7fc2a3600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc29c15fe70 con 0x7fc29c0cfa70 2024-05-30T16:53:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.068+0000 7fc2a1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c145150 0x7fc29c139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.068+0000 7fc2a1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c145150 0x7fc29c139760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37004/0 (socket says 172.21.15.144:37004) 2024-05-30T16:53:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.068+0000 7fc2a1600640 1 -- 172.21.15.144:0/1119295707 learned_addr learned my addr 172.21.15.144:0/1119295707 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:46.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc2a0c00640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06f7e0 0x7fc29c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc29be00640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc29c0cfa70 0x7fc29c0b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc2a1600640 1 -- 172.21.15.144:0/1119295707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc29c0cfa70 msgr2=0x7fc29c0b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc2a1600640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc29c0cfa70 0x7fc29c0b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc2a1600640 1 -- 172.21.15.144:0/1119295707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06f7e0 msgr2=0x7fc29c0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc2a1600640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06f7e0 0x7fc29c0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc2a1600640 1 -- 172.21.15.144:0/1119295707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c0cd070 con 0x7fc29c145150 2024-05-30T16:53:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc2a0c00640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06f7e0 0x7fc29c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T16:53:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc2a1600640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c145150 0x7fc29c139760 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc29402abe0 tx=0x7fc294004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.069+0000 7fc298c00640 1 -- 172.21.15.144:0/1119295707 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294040070 con 0x7fc29c145150 2024-05-30T16:53:46.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.070+0000 7fc298c00640 1 -- 172.21.15.144:0/1119295707 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc294031c40 con 0x7fc29c145150 2024-05-30T16:53:46.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.070+0000 7fc298c00640 1 -- 172.21.15.144:0/1119295707 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294009450 con 0x7fc29c145150 2024-05-30T16:53:46.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.070+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29c15bcf0 con 0x7fc29c145150 2024-05-30T16:53:46.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.070+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29c15c2b0 con 0x7fc29c145150 2024-05-30T16:53:46.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.071+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29c068b90 con 0x7fc29c145150 2024-05-30T16:53:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.072+0000 7fc298c00640 1 -- 172.21.15.144:0/1119295707 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 33) ==== 92213+0+0 (secure 0 0 0) 0x7fc294039040 con 0x7fc29c145150 2024-05-30T16:53:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.073+0000 7fc298c00640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc28006d610 0x7fc28006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.073+0000 7fc298c00640 1 -- 172.21.15.144:0/1119295707 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fc2940ab810 con 0x7fc29c145150 2024-05-30T16:53:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.073+0000 7fc2a0c00640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc28006d610 0x7fc28006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.073+0000 7fc2a0c00640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc28006d610 0x7fc28006fad0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc290006fd0 tx=0x7fc290008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:46.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.077+0000 7fc298c00640 1 -- 172.21.15.144:0/1119295707 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc29407b690 con 0x7fc29c145150 2024-05-30T16:53:46.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.272+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 --> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc29c06f5a0 con 0x7fc28006d610 2024-05-30T16:53:46.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.279+0000 7fc298c00640 1 -- 172.21.15.144:0/1119295707 <== mgr.4103 v2:172.21.15.144:6832/2157301613 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255785 (secure 0 0 0) 0x7fc29c06f5a0 con 0x7fc28006d610 2024-05-30T16:53:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:53:46.285 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-05-30T16:53:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc28006d610 msgr2=0x7fc28006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc28006d610 0x7fc28006fad0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc290006fd0 tx=0x7fc290008040 comp rx=0 tx=0).stop 2024-05-30T16:53:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c145150 msgr2=0x7fc29c139760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c145150 0x7fc29c139760 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc29402abe0 tx=0x7fc294004a40 comp rx=0 tx=0).stop 2024-05-30T16:53:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 shutdown_connections 2024-05-30T16:53:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fc28006d610 0x7fc28006fad0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc29c145150 0x7fc29c139760 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc29c0cfa70 0x7fc29c0b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 --2- 172.21.15.144:0/1119295707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06f7e0 0x7fc29c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 >> 172.21.15.144:0/1119295707 conn(0x7fc29c06bd00 msgr2=0x7fc29c0b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:46.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 shutdown_connections 2024-05-30T16:53:46.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.285+0000 7fc2a3600640 1 -- 172.21.15.144:0/1119295707 wait complete. 2024-05-30T16:53:46.305 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2024-05-30T16:53:45.241311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53717298638,"num_objects":12855,"num_object_clones":1,"num_object_copies":25710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12855,"num_whiteouts":1,"num_read":12446,"num_read_kb":49496410,"num_write":14658,"num_write_kb":52460869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7455,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31348,"ondisk_log_size":31348,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":105733600,"kb_used_data":104923872,"kb_used_omap":12,"kb_used_meta":809651,"kb_avail":649241120,"statfs":{"total":773094113280,"available":664822906880,"internally_reserved":0,"allocated":107442044928,"data_stored":107437680564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":829083187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":530,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005037"},"pg_stats":[{"pgid":"11.3f","version":"74'447","reported_seq":700,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.876092+0000","last_change":"2024-05-30T16:53:28.537895+0000","last_active":"2024-05-30T16:53:36.876092+0000","last_peered":"2024-05-30T16:53:36.876092+0000","last_clean":"2024-05-30T16:53:36.876092+0000","last_became_active":"2024-05-30T16:50:01.225529+0000","last_became_peered":"2024-05-30T16:50:01.225529+0000","last_unstale":"2024-05-30T16:53:36.876092+0000","last_undegraded":"2024-05-30T16:53:36.876092+0000","last_fullsized":"2024-05-30T16:53:36.876092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'428","last_scrub_stamp":"2024-05-30T16:53:28.537739+0000","last_deep_scrub":"74'428","last_deep_scrub_stamp":"2024-05-30T16:53:28.537739+0000","last_clean_scrub_stamp":"2024-05-30T16:53:28.537739+0000","objects_scrubbed":188,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:34:59.485669+0000","scrub_duration":13123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":219,"num_read_kb":897024,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"74'449","reported_seq":690,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.878179+0000","last_change":"2024-05-30T16:53:27.445789+0000","last_active":"2024-05-30T16:53:36.878179+0000","last_peered":"2024-05-30T16:53:36.878179+0000","last_clean":"2024-05-30T16:53:36.878179+0000","last_became_active":"2024-05-30T16:50:01.205240+0000","last_became_peered":"2024-05-30T16:50:01.205240+0000","last_unstale":"2024-05-30T16:53:36.878179+0000","last_undegraded":"2024-05-30T16:53:36.878179+0000","last_fullsized":"2024-05-30T16:53:36.878179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'433","last_scrub_stamp":"2024-05-30T16:53:27.445465+0000","last_deep_scrub":"74'433","last_deep_scrub_stamp":"2024-05-30T16:53:27.445465+0000","last_clean_scrub_stamp":"2024-05-30T16:53:27.445465+0000","objects_scrubbed":190,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:02:40.377838+0000","scrub_duration":10056,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":207,"num_read_kb":847872,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"74'477","reported_seq":715,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.873914+0000","last_change":"2024-05-30T16:53:12.130994+0000","last_active":"2024-05-30T16:53:36.873914+0000","last_peered":"2024-05-30T16:53:36.873914+0000","last_clean":"2024-05-30T16:53:36.873914+0000","last_became_active":"2024-05-30T16:50:01.216364+0000","last_became_peered":"2024-05-30T16:50:01.216364+0000","last_unstale":"2024-05-30T16:53:36.873914+0000","last_undegraded":"2024-05-30T16:53:36.873914+0000","last_fullsized":"2024-05-30T16:53:36.873914+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'459","last_scrub_stamp":"2024-05-30T16:53:12.130821+0000","last_deep_scrub":"74'459","last_deep_scrub_stamp":"2024-05-30T16:53:12.130821+0000","last_clean_scrub_stamp":"2024-05-30T16:53:12.130821+0000","objects_scrubbed":202,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:57:19.237818+0000","scrub_duration":8256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":202,"num_read_kb":806917,"num_write":210,"num_write_kb":827396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"74'463","reported_seq":622,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.872996+0000","last_change":"2024-05-30T16:53:18.331716+0000","last_active":"2024-05-30T16:53:36.872996+0000","last_peered":"2024-05-30T16:53:36.872996+0000","last_clean":"2024-05-30T16:53:36.872996+0000","last_became_active":"2024-05-30T16:50:01.207604+0000","last_became_peered":"2024-05-30T16:50:01.207604+0000","last_unstale":"2024-05-30T16:53:36.872996+0000","last_undegraded":"2024-05-30T16:53:36.872996+0000","last_fullsized":"2024-05-30T16:53:36.872996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'444","last_scrub_stamp":"2024-05-30T16:53:18.331479+0000","last_deep_scrub":"74'444","last_deep_scrub_stamp":"2024-05-30T16:53:18.331479+0000","last_clean_scrub_stamp":"2024-05-30T16:53:18.331479+0000","objects_scrubbed":198,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:16:18.827978+0000","scrub_duration":13007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830472192,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":125,"num_read_kb":512000,"num_write":198,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"74'448","reported_seq":603,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.868365+0000","last_change":"2024-05-30T16:53:25.095595+0000","last_active":"2024-05-30T16:53:36.868365+0000","last_peered":"2024-05-30T16:53:36.868365+0000","last_clean":"2024-05-30T16:53:36.868365+0000","last_became_active":"2024-05-30T16:50:01.219925+0000","last_became_peered":"2024-05-30T16:50:01.219925+0000","last_unstale":"2024-05-30T16:53:36.868365+0000","last_undegraded":"2024-05-30T16:53:36.868365+0000","last_fullsized":"2024-05-30T16:53:36.868365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'432","last_scrub_stamp":"2024-05-30T16:53:25.095028+0000","last_deep_scrub":"74'432","last_deep_scrub_stamp":"2024-05-30T16:53:25.095028+0000","last_clean_scrub_stamp":"2024-05-30T16:53:25.095028+0000","objects_scrubbed":195,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:16:25.591528+0000","scrub_duration":12479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":121,"num_read_kb":495616,"num_write":197,"num_write_kb":798721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"74'471","reported_seq":760,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.871643+0000","last_change":"2024-05-30T16:53:27.556250+0000","last_active":"2024-05-30T16:53:36.871643+0000","last_peered":"2024-05-30T16:53:36.871643+0000","last_clean":"2024-05-30T16:53:36.871643+0000","last_became_active":"2024-05-30T16:50:01.205620+0000","last_became_peered":"2024-05-30T16:50:01.205620+0000","last_unstale":"2024-05-30T16:53:36.871643+0000","last_undegraded":"2024-05-30T16:53:36.871643+0000","last_fullsized":"2024-05-30T16:53:36.871643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'452","last_scrub_stamp":"2024-05-30T16:53:27.556024+0000","last_deep_scrub":"74'452","last_deep_scrub_stamp":"2024-05-30T16:53:27.556024+0000","last_clean_scrub_stamp":"2024-05-30T16:53:27.556024+0000","objects_scrubbed":202,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:14:15.135299+0000","scrub_duration":9126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":254,"num_read_kb":1028099,"num_write":206,"num_write_kb":827394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"74'450","reported_seq":628,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.857411+0000","last_change":"2024-05-30T16:53:18.326212+0000","last_active":"2024-05-30T16:53:36.857411+0000","last_peered":"2024-05-30T16:53:36.857411+0000","last_clean":"2024-05-30T16:53:36.857411+0000","last_became_active":"2024-05-30T16:50:01.215828+0000","last_became_peered":"2024-05-30T16:50:01.215828+0000","last_unstale":"2024-05-30T16:53:36.857411+0000","last_undegraded":"2024-05-30T16:53:36.857411+0000","last_fullsized":"2024-05-30T16:53:36.857411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'429","last_scrub_stamp":"2024-05-30T16:53:18.320603+0000","last_deep_scrub":"74'429","last_deep_scrub_stamp":"2024-05-30T16:53:18.320603+0000","last_clean_scrub_stamp":"2024-05-30T16:53:18.320603+0000","objects_scrubbed":188,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:49:25.755605+0000","scrub_duration":11137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":144,"num_read_kb":581634,"num_write":190,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"74'425","reported_seq":620,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.872446+0000","last_change":"2024-05-30T16:53:28.676402+0000","last_active":"2024-05-30T16:53:36.872446+0000","last_peered":"2024-05-30T16:53:36.872446+0000","last_clean":"2024-05-30T16:53:36.872446+0000","last_became_active":"2024-05-30T16:50:01.210863+0000","last_became_peered":"2024-05-30T16:50:01.210863+0000","last_unstale":"2024-05-30T16:53:36.872446+0000","last_undegraded":"2024-05-30T16:53:36.872446+0000","last_fullsized":"2024-05-30T16:53:36.872446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'415","last_scrub_stamp":"2024-05-30T16:53:28.676185+0000","last_deep_scrub":"74'415","last_deep_scrub_stamp":"2024-05-30T16:53:28.676185+0000","last_clean_scrub_stamp":"2024-05-30T16:53:28.676185+0000","objects_scrubbed":190,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:15:22.419665+0000","scrub_duration":9273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796917760,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":161,"num_read_kb":655361,"num_write":192,"num_write_kb":778241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"74'484","reported_seq":686,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.874369+0000","last_change":"2024-05-30T16:53:21.592337+0000","last_active":"2024-05-30T16:53:36.874369+0000","last_peered":"2024-05-30T16:53:36.874369+0000","last_clean":"2024-05-30T16:53:36.874369+0000","last_became_active":"2024-05-30T16:50:01.214609+0000","last_became_peered":"2024-05-30T16:50:01.214609+0000","last_unstale":"2024-05-30T16:53:36.874369+0000","last_undegraded":"2024-05-30T16:53:36.874369+0000","last_fullsized":"2024-05-30T16:53:36.874369+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'468","last_scrub_stamp":"2024-05-30T16:53:21.592147+0000","last_deep_scrub":"74'468","last_deep_scrub_stamp":"2024-05-30T16:53:21.592147+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.592147+0000","objects_scrubbed":203,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:14:23.349148+0000","scrub_duration":14201,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":167,"num_read_kb":655367,"num_write":209,"num_write_kb":831491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"74'474","reported_seq":694,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.876519+0000","last_change":"2024-05-30T16:53:25.405130+0000","last_active":"2024-05-30T16:53:36.876519+0000","last_peered":"2024-05-30T16:53:36.876519+0000","last_clean":"2024-05-30T16:53:36.876519+0000","last_became_active":"2024-05-30T16:50:01.217506+0000","last_became_peered":"2024-05-30T16:50:01.217506+0000","last_unstale":"2024-05-30T16:53:36.876519+0000","last_undegraded":"2024-05-30T16:53:36.876519+0000","last_fullsized":"2024-05-30T16:53:36.876519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'453","last_scrub_stamp":"2024-05-30T16:53:25.404970+0000","last_deep_scrub":"74'453","last_deep_scrub_stamp":"2024-05-30T16:53:25.404970+0000","last_clean_scrub_stamp":"2024-05-30T16:53:25.404970+0000","objects_scrubbed":203,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:28.645350+0000","scrub_duration":12810,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":185,"num_read_kb":745475,"num_write":205,"num_write_kb":831489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"74'494","reported_seq":832,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.866672+0000","last_change":"2024-05-30T16:53:26.835445+0000","last_active":"2024-05-30T16:53:36.866672+0000","last_peered":"2024-05-30T16:53:36.866672+0000","last_clean":"2024-05-30T16:53:36.866672+0000","last_became_active":"2024-05-30T16:50:01.218645+0000","last_became_peered":"2024-05-30T16:50:01.218645+0000","last_unstale":"2024-05-30T16:53:36.866672+0000","last_undegraded":"2024-05-30T16:53:36.866672+0000","last_fullsized":"2024-05-30T16:53:36.866672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'481","last_scrub_stamp":"2024-05-30T16:53:26.835208+0000","last_deep_scrub":"74'481","last_deep_scrub_stamp":"2024-05-30T16:53:26.835208+0000","last_clean_scrub_stamp":"2024-05-30T16:53:26.835208+0000","objects_scrubbed":215,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":18,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:12:45.328075+0000","scrub_duration":17671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":901775360,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":303,"num_read_kb":1212423,"num_write":221,"num_write_kb":880643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"74'415","reported_seq":732,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.876641+0000","last_change":"2024-05-30T16:53:20.987063+0000","last_active":"2024-05-30T16:53:36.876641+0000","last_peered":"2024-05-30T16:53:36.876641+0000","last_clean":"2024-05-30T16:53:36.876641+0000","last_became_active":"2024-05-30T16:50:01.217020+0000","last_became_peered":"2024-05-30T16:50:01.217020+0000","last_unstale":"2024-05-30T16:53:36.876641+0000","last_undegraded":"2024-05-30T16:53:36.876641+0000","last_fullsized":"2024-05-30T16:53:36.876641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'398","last_scrub_stamp":"2024-05-30T16:53:20.986856+0000","last_deep_scrub":"74'398","last_deep_scrub_stamp":"2024-05-30T16:53:20.986856+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.986856+0000","objects_scrubbed":182,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:05:23.319832+0000","scrub_duration":13670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":763363328,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":283,"num_read_kb":1146883,"num_write":184,"num_write_kb":745473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"74'481","reported_seq":760,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.872230+0000","last_change":"2024-05-30T16:53:13.414123+0000","last_active":"2024-05-30T16:53:36.872230+0000","last_peered":"2024-05-30T16:53:36.872230+0000","last_clean":"2024-05-30T16:53:36.872230+0000","last_became_active":"2024-05-30T16:50:01.213152+0000","last_became_peered":"2024-05-30T16:50:01.213152+0000","last_unstale":"2024-05-30T16:53:36.872230+0000","last_undegraded":"2024-05-30T16:53:36.872230+0000","last_fullsized":"2024-05-30T16:53:36.872230+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'471","last_scrub_stamp":"2024-05-30T16:53:13.413931+0000","last_deep_scrub":"74'471","last_deep_scrub_stamp":"2024-05-30T16:53:13.413931+0000","last_clean_scrub_stamp":"2024-05-30T16:53:13.413931+0000","objects_scrubbed":211,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:38:40.443308+0000","scrub_duration":8631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876609929,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":244,"num_read_kb":983044,"num_write":215,"num_write_kb":856068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"74'485","reported_seq":705,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.865551+0000","last_change":"2024-05-30T16:53:27.698589+0000","last_active":"2024-05-30T16:53:36.865551+0000","last_peered":"2024-05-30T16:53:36.865551+0000","last_clean":"2024-05-30T16:53:36.865551+0000","last_became_active":"2024-05-30T16:50:01.228163+0000","last_became_peered":"2024-05-30T16:50:01.228163+0000","last_unstale":"2024-05-30T16:53:36.865551+0000","last_undegraded":"2024-05-30T16:53:36.865551+0000","last_fullsized":"2024-05-30T16:53:36.865551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'469","last_scrub_stamp":"2024-05-30T16:53:27.698390+0000","last_deep_scrub":"74'469","last_deep_scrub_stamp":"2024-05-30T16:53:27.698390+0000","last_clean_scrub_stamp":"2024-05-30T16:53:27.698390+0000","objects_scrubbed":211,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:36:04.703509+0000","scrub_duration":13992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998144,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":185,"num_read_kb":757760,"num_write":213,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"74'476","reported_seq":606,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.856491+0000","last_change":"2024-05-30T16:53:20.401088+0000","last_active":"2024-05-30T16:53:36.856491+0000","last_peered":"2024-05-30T16:53:36.856491+0000","last_clean":"2024-05-30T16:53:36.856491+0000","last_became_active":"2024-05-30T16:50:01.213427+0000","last_became_peered":"2024-05-30T16:50:01.213427+0000","last_unstale":"2024-05-30T16:53:36.856491+0000","last_undegraded":"2024-05-30T16:53:36.856491+0000","last_fullsized":"2024-05-30T16:53:36.856491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'462","last_scrub_stamp":"2024-05-30T16:53:20.400853+0000","last_deep_scrub":"74'462","last_deep_scrub_stamp":"2024-05-30T16:53:20.400853+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.400853+0000","objects_scrubbed":205,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:09.017725+0000","scrub_duration":14596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":859832320,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":0,"num_read":95,"num_read_kb":368645,"num_write":209,"num_write_kb":839682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"74'490","reported_seq":688,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.870257+0000","last_change":"2024-05-30T16:53:25.411272+0000","last_active":"2024-05-30T16:53:36.870257+0000","last_peered":"2024-05-30T16:53:36.870257+0000","last_clean":"2024-05-30T16:53:36.870257+0000","last_became_active":"2024-05-30T16:50:01.208926+0000","last_became_peered":"2024-05-30T16:50:01.208926+0000","last_unstale":"2024-05-30T16:53:36.870257+0000","last_undegraded":"2024-05-30T16:53:36.870257+0000","last_fullsized":"2024-05-30T16:53:36.870257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'476","last_scrub_stamp":"2024-05-30T16:53:25.411049+0000","last_deep_scrub":"74'476","last_deep_scrub_stamp":"2024-05-30T16:53:25.411049+0000","last_clean_scrub_stamp":"2024-05-30T16:53:25.411049+0000","objects_scrubbed":212,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:49:32.846051+0000","scrub_duration":14855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":163,"num_read_kb":651268,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"74'462","reported_seq":622,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.874475+0000","last_change":"2024-05-30T16:53:21.880942+0000","last_active":"2024-05-30T16:53:36.874475+0000","last_peered":"2024-05-30T16:53:36.874475+0000","last_clean":"2024-05-30T16:53:36.874475+0000","last_became_active":"2024-05-30T16:50:01.211267+0000","last_became_peered":"2024-05-30T16:50:01.211267+0000","last_unstale":"2024-05-30T16:53:36.874475+0000","last_undegraded":"2024-05-30T16:53:36.874475+0000","last_fullsized":"2024-05-30T16:53:36.874475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'444","last_scrub_stamp":"2024-05-30T16:53:21.880656+0000","last_deep_scrub":"74'444","last_deep_scrub_stamp":"2024-05-30T16:53:21.880656+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.880656+0000","objects_scrubbed":203,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:50:18.639463+0000","scrub_duration":13481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055366,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":125,"num_read_kb":503810,"num_write":203,"num_write_kb":823298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"74'460","reported_seq":778,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:35.831314+0000","last_change":"2024-05-30T16:53:19.574584+0000","last_active":"2024-05-30T16:53:35.831314+0000","last_peered":"2024-05-30T16:53:35.831314+0000","last_clean":"2024-05-30T16:53:35.831314+0000","last_became_active":"2024-05-30T16:50:36.235518+0000","last_became_peered":"2024-05-30T16:50:36.235518+0000","last_unstale":"2024-05-30T16:53:35.831314+0000","last_undegraded":"2024-05-30T16:53:35.831314+0000","last_fullsized":"2024-05-30T16:53:35.831314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'453","last_scrub_stamp":"2024-05-30T16:53:19.574447+0000","last_deep_scrub":"74'453","last_deep_scrub_stamp":"2024-05-30T16:53:19.574447+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.574447+0000","objects_scrubbed":201,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:52:36.194490+0000","scrub_duration":10249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860932,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":260,"num_read_kb":1056770,"num_write":205,"num_write_kb":819203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"74'477","reported_seq":716,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.878462+0000","last_change":"2024-05-30T16:53:28.631047+0000","last_active":"2024-05-30T16:53:36.878462+0000","last_peered":"2024-05-30T16:53:36.878462+0000","last_clean":"2024-05-30T16:53:36.878462+0000","last_became_active":"2024-05-30T16:50:01.213651+0000","last_became_peered":"2024-05-30T16:50:01.213651+0000","last_unstale":"2024-05-30T16:53:36.878462+0000","last_undegraded":"2024-05-30T16:53:36.878462+0000","last_fullsized":"2024-05-30T16:53:36.878462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'457","last_scrub_stamp":"2024-05-30T16:53:28.630873+0000","last_deep_scrub":"74'457","last_deep_scrub_stamp":"2024-05-30T16:53:28.630873+0000","last_clean_scrub_stamp":"2024-05-30T16:53:28.630873+0000","objects_scrubbed":210,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:21:11.326577+0000","scrub_duration":6157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880803840,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":204,"num_read_kb":827394,"num_write":214,"num_write_kb":860162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"74'458","reported_seq":666,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.853343+0000","last_change":"2024-05-30T16:53:19.465566+0000","last_active":"2024-05-30T16:53:36.853343+0000","last_peered":"2024-05-30T16:53:36.853343+0000","last_clean":"2024-05-30T16:53:36.853343+0000","last_became_active":"2024-05-30T16:50:01.223285+0000","last_became_peered":"2024-05-30T16:50:01.223285+0000","last_unstale":"2024-05-30T16:53:36.853343+0000","last_undegraded":"2024-05-30T16:53:36.853343+0000","last_fullsized":"2024-05-30T16:53:36.853343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'436","last_scrub_stamp":"2024-05-30T16:53:19.465349+0000","last_deep_scrub":"74'436","last_deep_scrub_stamp":"2024-05-30T16:53:19.465349+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.465349+0000","objects_scrubbed":192,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:49:26.900351+0000","scrub_duration":11625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918152,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"74'506","reported_seq":809,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.863530+0000","last_change":"2024-05-30T16:53:23.415344+0000","last_active":"2024-05-30T16:53:36.863530+0000","last_peered":"2024-05-30T16:53:36.863530+0000","last_clean":"2024-05-30T16:53:36.863530+0000","last_became_active":"2024-05-30T16:50:01.209453+0000","last_became_peered":"2024-05-30T16:50:01.209453+0000","last_unstale":"2024-05-30T16:53:36.863530+0000","last_undegraded":"2024-05-30T16:53:36.863530+0000","last_fullsized":"2024-05-30T16:53:36.863530+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'492","last_scrub_stamp":"2024-05-30T16:53:23.415072+0000","last_deep_scrub":"74'492","last_deep_scrub_stamp":"2024-05-30T16:53:23.415072+0000","last_clean_scrub_stamp":"2024-05-30T16:53:23.415072+0000","objects_scrubbed":219,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":16,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:43:44.592677+0000","scrub_duration":15925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":918552576,"num_objects":219,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":268,"num_read_kb":1081348,"num_write":225,"num_write_kb":897027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"74'480","reported_seq":697,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.876073+0000","last_change":"2024-05-30T16:53:25.405155+0000","last_active":"2024-05-30T16:53:36.876073+0000","last_peered":"2024-05-30T16:53:36.876073+0000","last_clean":"2024-05-30T16:53:36.876073+0000","last_became_active":"2024-05-30T16:50:01.216565+0000","last_became_peered":"2024-05-30T16:50:01.216565+0000","last_unstale":"2024-05-30T16:53:36.876073+0000","last_undegraded":"2024-05-30T16:53:36.876073+0000","last_fullsized":"2024-05-30T16:53:36.876073+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'465","last_scrub_stamp":"2024-05-30T16:53:25.404945+0000","last_deep_scrub":"74'465","last_deep_scrub_stamp":"2024-05-30T16:53:25.404945+0000","last_clean_scrub_stamp":"2024-05-30T16:53:25.404945+0000","objects_scrubbed":208,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:04:09.501557+0000","scrub_duration":13843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415232,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":208,"num_whiteouts":0,"num_read":182,"num_read_kb":724997,"num_write":214,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"74'453","reported_seq":661,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.868685+0000","last_change":"2024-05-30T16:53:26.778680+0000","last_active":"2024-05-30T16:53:36.868685+0000","last_peered":"2024-05-30T16:53:36.868685+0000","last_clean":"2024-05-30T16:53:36.868685+0000","last_became_active":"2024-05-30T16:50:01.230326+0000","last_became_peered":"2024-05-30T16:50:01.230326+0000","last_unstale":"2024-05-30T16:53:36.868685+0000","last_undegraded":"2024-05-30T16:53:36.868685+0000","last_fullsized":"2024-05-30T16:53:36.868685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'439","last_scrub_stamp":"2024-05-30T16:53:26.778439+0000","last_deep_scrub":"74'439","last_deep_scrub_stamp":"2024-05-30T16:53:26.778439+0000","last_clean_scrub_stamp":"2024-05-30T16:53:26.778439+0000","objects_scrubbed":192,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:45.822620+0000","scrub_duration":9304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":805306368,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":174,"num_read_kb":696324,"num_write":196,"num_write_kb":786434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"74'458","reported_seq":652,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.882447+0000","last_change":"2024-05-30T16:53:27.760616+0000","last_active":"2024-05-30T16:53:36.882447+0000","last_peered":"2024-05-30T16:53:36.882447+0000","last_clean":"2024-05-30T16:53:36.882447+0000","last_became_active":"2024-05-30T16:50:01.221747+0000","last_became_peered":"2024-05-30T16:50:01.221747+0000","last_unstale":"2024-05-30T16:53:36.882447+0000","last_undegraded":"2024-05-30T16:53:36.882447+0000","last_fullsized":"2024-05-30T16:53:36.882447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'435","last_scrub_stamp":"2024-05-30T16:53:27.760340+0000","last_deep_scrub":"74'435","last_deep_scrub_stamp":"2024-05-30T16:53:27.760340+0000","last_clean_scrub_stamp":"2024-05-30T16:53:27.760340+0000","objects_scrubbed":194,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:45:09.281239+0000","scrub_duration":14497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":160,"num_read_kb":647170,"num_write":198,"num_write_kb":794626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"74'466","reported_seq":693,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.877234+0000","last_change":"2024-05-30T16:53:28.239458+0000","last_active":"2024-05-30T16:53:36.877234+0000","last_peered":"2024-05-30T16:53:36.877234+0000","last_clean":"2024-05-30T16:53:36.877234+0000","last_became_active":"2024-05-30T16:50:01.224947+0000","last_became_peered":"2024-05-30T16:50:01.224947+0000","last_unstale":"2024-05-30T16:53:36.877234+0000","last_undegraded":"2024-05-30T16:53:36.877234+0000","last_fullsized":"2024-05-30T16:53:36.877234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'452","last_scrub_stamp":"2024-05-30T16:53:28.239201+0000","last_deep_scrub":"74'452","last_deep_scrub_stamp":"2024-05-30T16:53:28.239201+0000","last_clean_scrub_stamp":"2024-05-30T16:53:28.239201+0000","objects_scrubbed":195,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:48.354064+0000","scrub_duration":13617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817889280,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":193,"num_read_kb":778243,"num_write":201,"num_write_kb":798723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"74'467","reported_seq":700,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.885045+0000","last_change":"2024-05-30T16:53:18.246388+0000","last_active":"2024-05-30T16:53:36.885045+0000","last_peered":"2024-05-30T16:53:36.885045+0000","last_clean":"2024-05-30T16:53:36.885045+0000","last_became_active":"2024-05-30T16:50:01.223128+0000","last_became_peered":"2024-05-30T16:50:01.223128+0000","last_unstale":"2024-05-30T16:53:36.885045+0000","last_undegraded":"2024-05-30T16:53:36.885045+0000","last_fullsized":"2024-05-30T16:53:36.885045+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'450","last_scrub_stamp":"2024-05-30T16:53:18.246068+0000","last_deep_scrub":"74'450","last_deep_scrub_stamp":"2024-05-30T16:53:18.246068+0000","last_clean_scrub_stamp":"2024-05-30T16:53:18.246068+0000","objects_scrubbed":189,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:21.486448+0000","scrub_duration":9002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":199,"num_read_kb":815104,"num_write":189,"num_write_kb":774144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"74'454","reported_seq":690,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.859182+0000","last_change":"2024-05-30T16:53:26.409561+0000","last_active":"2024-05-30T16:53:36.859182+0000","last_peered":"2024-05-30T16:53:36.859182+0000","last_clean":"2024-05-30T16:53:36.859182+0000","last_became_active":"2024-05-30T16:50:01.220973+0000","last_became_peered":"2024-05-30T16:50:01.220973+0000","last_unstale":"2024-05-30T16:53:36.859182+0000","last_undegraded":"2024-05-30T16:53:36.859182+0000","last_fullsized":"2024-05-30T16:53:36.859182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'444","last_scrub_stamp":"2024-05-30T16:53:26.409281+0000","last_deep_scrub":"74'444","last_deep_scrub_stamp":"2024-05-30T16:53:26.409281+0000","last_clean_scrub_stamp":"2024-05-30T16:53:26.409281+0000","objects_scrubbed":201,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":18,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:28:18.424084+0000","scrub_duration":17460,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":201,"num_read_kb":819201,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"74'414","reported_seq":543,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.876352+0000","last_change":"2024-05-30T16:53:24.674708+0000","last_active":"2024-05-30T16:53:36.876352+0000","last_peered":"2024-05-30T16:53:36.876352+0000","last_clean":"2024-05-30T16:53:36.876352+0000","last_became_active":"2024-05-30T16:50:01.217568+0000","last_became_peered":"2024-05-30T16:50:01.217568+0000","last_unstale":"2024-05-30T16:53:36.876352+0000","last_undegraded":"2024-05-30T16:53:36.876352+0000","last_fullsized":"2024-05-30T16:53:36.876352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'396","last_scrub_stamp":"2024-05-30T16:53:24.674448+0000","last_deep_scrub":"74'396","last_deep_scrub_stamp":"2024-05-30T16:53:24.674448+0000","last_clean_scrub_stamp":"2024-05-30T16:53:24.674448+0000","objects_scrubbed":181,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:38:51.703826+0000","scrub_duration":11083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":759169024,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":95,"num_read_kb":389120,"num_write":183,"num_write_kb":741377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"74'509","reported_seq":757,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.857013+0000","last_change":"2024-05-30T16:53:24.137517+0000","last_active":"2024-05-30T16:53:36.857013+0000","last_peered":"2024-05-30T16:53:36.857013+0000","last_clean":"2024-05-30T16:53:36.857013+0000","last_became_active":"2024-05-30T16:50:01.224957+0000","last_became_peered":"2024-05-30T16:50:01.224957+0000","last_unstale":"2024-05-30T16:53:36.857013+0000","last_undegraded":"2024-05-30T16:53:36.857013+0000","last_fullsized":"2024-05-30T16:53:36.857013+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'496","last_scrub_stamp":"2024-05-30T16:53:24.136587+0000","last_deep_scrub":"74'496","last_deep_scrub_stamp":"2024-05-30T16:53:24.136587+0000","last_clean_scrub_stamp":"2024-05-30T16:53:24.136587+0000","objects_scrubbed":223,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:48.615946+0000","scrub_duration":14192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931135619,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":213,"num_read_kb":868353,"num_write":223,"num_write_kb":909313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"74'501","reported_seq":729,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.874744+0000","last_change":"2024-05-30T16:53:27.447843+0000","last_active":"2024-05-30T16:53:36.874744+0000","last_peered":"2024-05-30T16:53:36.874744+0000","last_clean":"2024-05-30T16:53:36.874744+0000","last_became_active":"2024-05-30T16:50:01.227538+0000","last_became_peered":"2024-05-30T16:50:01.227538+0000","last_unstale":"2024-05-30T16:53:36.874744+0000","last_undegraded":"2024-05-30T16:53:36.874744+0000","last_fullsized":"2024-05-30T16:53:36.874744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'493","last_scrub_stamp":"2024-05-30T16:53:27.447641+0000","last_deep_scrub":"74'493","last_deep_scrub_stamp":"2024-05-30T16:53:27.447641+0000","last_clean_scrub_stamp":"2024-05-30T16:53:27.447641+0000","objects_scrubbed":217,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":16,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:32.515967+0000","scrub_duration":15054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910163968,"num_objects":217,"num_object_clones":0,"num_object_copies":434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":193,"num_read_kb":757768,"num_write":225,"num_write_kb":888836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"74'462","reported_seq":782,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.861816+0000","last_change":"2024-05-30T16:53:21.889028+0000","last_active":"2024-05-30T16:53:36.861816+0000","last_peered":"2024-05-30T16:53:36.861816+0000","last_clean":"2024-05-30T16:53:36.861816+0000","last_became_active":"2024-05-30T16:50:01.215541+0000","last_became_peered":"2024-05-30T16:50:01.215541+0000","last_unstale":"2024-05-30T16:53:36.861816+0000","last_undegraded":"2024-05-30T16:53:36.861816+0000","last_fullsized":"2024-05-30T16:53:36.861816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'440","last_scrub_stamp":"2024-05-30T16:53:21.888813+0000","last_deep_scrub":"74'440","last_deep_scrub_stamp":"2024-05-30T16:53:21.888813+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.888813+0000","objects_scrubbed":188,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":16,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:13:58.625897+0000","scrub_duration":15724,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529152,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":285,"num_read_kb":1150980,"num_write":192,"num_write_kb":770050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"74'476","reported_seq":725,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.880722+0000","last_change":"2024-05-30T16:53:29.078621+0000","last_active":"2024-05-30T16:53:36.880722+0000","last_peered":"2024-05-30T16:53:36.880722+0000","last_clean":"2024-05-30T16:53:36.880722+0000","last_became_active":"2024-05-30T16:50:01.212747+0000","last_became_peered":"2024-05-30T16:50:01.212747+0000","last_unstale":"2024-05-30T16:53:36.880722+0000","last_undegraded":"2024-05-30T16:53:36.880722+0000","last_fullsized":"2024-05-30T16:53:36.880722+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'455","last_scrub_stamp":"2024-05-30T16:53:29.078271+0000","last_deep_scrub":"74'455","last_deep_scrub_stamp":"2024-05-30T16:53:29.078271+0000","last_clean_scrub_stamp":"2024-05-30T16:53:29.078271+0000","objects_scrubbed":201,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:50:11.418778+0000","scrub_duration":7641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":214,"num_read_kb":876544,"num_write":201,"num_write_kb":823296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"74'454","reported_seq":616,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.880326+0000","last_change":"2024-05-30T16:53:24.391789+0000","last_active":"2024-05-30T16:53:36.880326+0000","last_peered":"2024-05-30T16:53:36.880326+0000","last_clean":"2024-05-30T16:53:36.880326+0000","last_became_active":"2024-05-30T16:50:01.221781+0000","last_became_peered":"2024-05-30T16:50:01.221781+0000","last_unstale":"2024-05-30T16:53:36.880326+0000","last_undegraded":"2024-05-30T16:53:36.880326+0000","last_fullsized":"2024-05-30T16:53:36.880326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'432","last_scrub_stamp":"2024-05-30T16:53:24.391529+0000","last_deep_scrub":"74'432","last_deep_scrub_stamp":"2024-05-30T16:53:24.391529+0000","last_clean_scrub_stamp":"2024-05-30T16:53:24.391529+0000","objects_scrubbed":197,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:28:16.406333+0000","scrub_duration":12178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826277888,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":197,"num_write_kb":806912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'6","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:07.770490+0000","last_change":"2024-05-30T16:53:07.770552+0000","last_active":"2024-05-30T16:53:07.770490+0000","last_peered":"2024-05-30T16:53:07.770490+0000","last_clean":"2024-05-30T16:53:07.770490+0000","last_became_active":"2024-05-30T16:50:00.204355+0000","last_became_peered":"2024-05-30T16:50:00.204355+0000","last_unstale":"2024-05-30T16:53:07.770490+0000","last_undegraded":"2024-05-30T16:53:07.770490+0000","last_fullsized":"2024-05-30T16:53:07.770490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'6","last_scrub_stamp":"2024-05-30T16:53:07.770327+0000","last_deep_scrub":"74'6","last_deep_scrub_stamp":"2024-05-30T16:53:07.770327+0000","last_clean_scrub_stamp":"2024-05-30T16:53:07.770327+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:34.872666+0000","scrub_duration":604,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'468","reported_seq":708,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.874019+0000","last_change":"2024-05-30T16:53:14.771695+0000","last_active":"2024-05-30T16:53:36.874019+0000","last_peered":"2024-05-30T16:53:36.874019+0000","last_clean":"2024-05-30T16:53:36.874019+0000","last_became_active":"2024-05-30T16:50:01.208076+0000","last_became_peered":"2024-05-30T16:50:01.208076+0000","last_unstale":"2024-05-30T16:53:36.874019+0000","last_undegraded":"2024-05-30T16:53:36.874019+0000","last_fullsized":"2024-05-30T16:53:36.874019+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'450","last_scrub_stamp":"2024-05-30T16:53:14.771433+0000","last_deep_scrub":"74'450","last_deep_scrub_stamp":"2024-05-30T16:53:14.771433+0000","last_clean_scrub_stamp":"2024-05-30T16:53:14.771433+0000","objects_scrubbed":203,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:52.743122+0000","scrub_duration":10412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055496,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":205,"num_read_kb":827395,"num_write":205,"num_write_kb":823299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:52:59.754518+0000","last_change":"2024-05-30T16:52:59.754573+0000","last_active":"2024-05-30T16:52:59.754518+0000","last_peered":"2024-05-30T16:52:59.754518+0000","last_clean":"2024-05-30T16:52:59.754518+0000","last_became_active":"2024-05-30T16:50:00.197621+0000","last_became_peered":"2024-05-30T16:50:00.197621+0000","last_unstale":"2024-05-30T16:52:59.754518+0000","last_undegraded":"2024-05-30T16:52:59.754518+0000","last_fullsized":"2024-05-30T16:52:59.754518+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'1","last_scrub_stamp":"2024-05-30T16:52:59.754318+0000","last_deep_scrub":"71'1","last_deep_scrub_stamp":"2024-05-30T16:52:59.754318+0000","last_clean_scrub_stamp":"2024-05-30T16:52:59.754318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:19:57.808372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"74'495","reported_seq":736,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.886662+0000","last_change":"2024-05-30T16:53:10.226780+0000","last_active":"2024-05-30T16:53:36.886662+0000","last_peered":"2024-05-30T16:53:36.886662+0000","last_clean":"2024-05-30T16:53:36.886662+0000","last_became_active":"2024-05-30T16:50:01.223375+0000","last_became_peered":"2024-05-30T16:50:01.223375+0000","last_unstale":"2024-05-30T16:53:36.886662+0000","last_undegraded":"2024-05-30T16:53:36.886662+0000","last_fullsized":"2024-05-30T16:53:36.886662+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'476","last_scrub_stamp":"2024-05-30T16:53:10.226538+0000","last_deep_scrub":"74'476","last_deep_scrub_stamp":"2024-05-30T16:53:10.226538+0000","last_clean_scrub_stamp":"2024-05-30T16:53:10.226538+0000","objects_scrubbed":213,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:16.390743+0000","scrub_duration":3988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192709,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":206,"num_read_kb":827396,"num_write":219,"num_write_kb":868356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:06.540873+0000","last_change":"2024-05-30T16:53:06.540918+0000","last_active":"2024-05-30T16:53:06.540873+0000","last_peered":"2024-05-30T16:53:06.540873+0000","last_clean":"2024-05-30T16:53:06.540873+0000","last_became_active":"2024-05-30T16:50:00.211786+0000","last_became_peered":"2024-05-30T16:50:00.211786+0000","last_unstale":"2024-05-30T16:53:06.540873+0000","last_undegraded":"2024-05-30T16:53:06.540873+0000","last_fullsized":"2024-05-30T16:53:06.540873+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'5","last_scrub_stamp":"2024-05-30T16:53:06.540757+0000","last_deep_scrub":"74'5","last_deep_scrub_stamp":"2024-05-30T16:53:06.540757+0000","last_clean_scrub_stamp":"2024-05-30T16:53:06.540757+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:36.304089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'502","reported_seq":791,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.853138+0000","last_change":"2024-05-30T16:53:26.968684+0000","last_active":"2024-05-30T16:53:36.853138+0000","last_peered":"2024-05-30T16:53:36.853138+0000","last_clean":"2024-05-30T16:53:36.853138+0000","last_became_active":"2024-05-30T16:50:01.219382+0000","last_became_peered":"2024-05-30T16:50:01.219382+0000","last_unstale":"2024-05-30T16:53:36.853138+0000","last_undegraded":"2024-05-30T16:53:36.853138+0000","last_fullsized":"2024-05-30T16:53:36.853138+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'492","last_scrub_stamp":"2024-05-30T16:53:26.968363+0000","last_deep_scrub":"74'492","last_deep_scrub_stamp":"2024-05-30T16:53:26.968363+0000","last_clean_scrub_stamp":"2024-05-30T16:53:26.968363+0000","objects_scrubbed":220,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":17,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:34:48.374400+0000","scrub_duration":16844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922746880,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":254,"num_read_kb":1040384,"num_write":220,"num_write_kb":901120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"74'3","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:17.316151+0000","last_change":"2024-05-30T16:53:17.316200+0000","last_active":"2024-05-30T16:53:17.316151+0000","last_peered":"2024-05-30T16:53:17.316151+0000","last_clean":"2024-05-30T16:53:17.316151+0000","last_became_active":"2024-05-30T16:50:00.209818+0000","last_became_peered":"2024-05-30T16:50:00.209818+0000","last_unstale":"2024-05-30T16:53:17.316151+0000","last_undegraded":"2024-05-30T16:53:17.316151+0000","last_fullsized":"2024-05-30T16:53:17.316151+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'3","last_scrub_stamp":"2024-05-30T16:53:17.316008+0000","last_deep_scrub":"74'3","last_deep_scrub_stamp":"2024-05-30T16:53:17.316008+0000","last_clean_scrub_stamp":"2024-05-30T16:53:17.316008+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:04:01.412620+0000","scrub_duration":947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"74'445","reported_seq":647,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.873507+0000","last_change":"2024-05-30T16:53:27.104714+0000","last_active":"2024-05-30T16:53:36.873507+0000","last_peered":"2024-05-30T16:53:36.873507+0000","last_clean":"2024-05-30T16:53:36.873507+0000","last_became_active":"2024-05-30T16:50:01.225437+0000","last_became_peered":"2024-05-30T16:50:01.225437+0000","last_unstale":"2024-05-30T16:53:36.873507+0000","last_undegraded":"2024-05-30T16:53:36.873507+0000","last_fullsized":"2024-05-30T16:53:36.873507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'431","last_scrub_stamp":"2024-05-30T16:53:27.104458+0000","last_deep_scrub":"74'431","last_deep_scrub_stamp":"2024-05-30T16:53:27.104458+0000","last_clean_scrub_stamp":"2024-05-30T16:53:27.104458+0000","objects_scrubbed":189,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:19:54.206797+0000","scrub_duration":13630,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788529413,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":168,"num_read_kb":684033,"num_write":189,"num_write_kb":770049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'62","reported_seq":90,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.805920+0000","last_change":"2024-05-30T16:53:01.923227+0000","last_active":"2024-05-30T16:53:36.805920+0000","last_peered":"2024-05-30T16:53:36.805920+0000","last_clean":"2024-05-30T16:53:36.805920+0000","last_became_active":"2024-05-30T16:50:00.204597+0000","last_became_peered":"2024-05-30T16:50:00.204597+0000","last_unstale":"2024-05-30T16:53:36.805920+0000","last_undegraded":"2024-05-30T16:53:36.805920+0000","last_fullsized":"2024-05-30T16:53:36.805920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'50","last_scrub_stamp":"2024-05-30T16:53:01.923058+0000","last_deep_scrub":"74'50","last_deep_scrub_stamp":"2024-05-30T16:53:01.923058+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.923058+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:06.391784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239308,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"74'463","reported_seq":766,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.871685+0000","last_change":"2024-05-30T16:53:19.327520+0000","last_active":"2024-05-30T16:53:36.871685+0000","last_peered":"2024-05-30T16:53:36.871685+0000","last_clean":"2024-05-30T16:53:36.871685+0000","last_became_active":"2024-05-30T16:50:01.213263+0000","last_became_peered":"2024-05-30T16:50:01.213263+0000","last_unstale":"2024-05-30T16:53:36.871685+0000","last_undegraded":"2024-05-30T16:53:36.871685+0000","last_fullsized":"2024-05-30T16:53:36.871685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'453","last_scrub_stamp":"2024-05-30T16:53:19.327329+0000","last_deep_scrub":"74'453","last_deep_scrub_stamp":"2024-05-30T16:53:19.327329+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.327329+0000","objects_scrubbed":202,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:31:38.171957+0000","scrub_duration":10877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847249408,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":268,"num_read_kb":1089538,"num_write":204,"num_write_kb":827393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:11.388441+0000","last_change":"2024-05-30T16:53:11.388489+0000","last_active":"2024-05-30T16:53:11.388441+0000","last_peered":"2024-05-30T16:53:11.388441+0000","last_clean":"2024-05-30T16:53:11.388441+0000","last_became_active":"2024-05-30T16:50:00.204593+0000","last_became_peered":"2024-05-30T16:50:00.204593+0000","last_unstale":"2024-05-30T16:53:11.388441+0000","last_undegraded":"2024-05-30T16:53:11.388441+0000","last_fullsized":"2024-05-30T16:53:11.388441+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'1","last_scrub_stamp":"2024-05-30T16:53:11.388329+0000","last_deep_scrub":"71'1","last_deep_scrub_stamp":"2024-05-30T16:53:11.388329+0000","last_clean_scrub_stamp":"2024-05-30T16:53:11.388329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:02:07.429914+0000","scrub_duration":69,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"74'456","reported_seq":701,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.877304+0000","last_change":"2024-05-30T16:53:23.414498+0000","last_active":"2024-05-30T16:53:36.877304+0000","last_peered":"2024-05-30T16:53:36.877304+0000","last_clean":"2024-05-30T16:53:36.877304+0000","last_became_active":"2024-05-30T16:50:01.209406+0000","last_became_peered":"2024-05-30T16:50:01.209406+0000","last_unstale":"2024-05-30T16:53:36.877304+0000","last_undegraded":"2024-05-30T16:53:36.877304+0000","last_fullsized":"2024-05-30T16:53:36.877304+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'434","last_scrub_stamp":"2024-05-30T16:53:23.414333+0000","last_deep_scrub":"74'434","last_deep_scrub_stamp":"2024-05-30T16:53:23.414333+0000","last_clean_scrub_stamp":"2024-05-30T16:53:23.414333+0000","objects_scrubbed":189,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:45:11.676957+0000","scrub_duration":11874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792723456,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":211,"num_read_kb":856066,"num_write":191,"num_write_kb":774145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.286464+0000","last_change":"2024-05-30T16:53:04.286511+0000","last_active":"2024-05-30T16:53:04.286464+0000","last_peered":"2024-05-30T16:53:04.286464+0000","last_clean":"2024-05-30T16:53:04.286464+0000","last_became_active":"2024-05-30T16:50:00.213529+0000","last_became_peered":"2024-05-30T16:50:00.213529+0000","last_unstale":"2024-05-30T16:53:04.286464+0000","last_undegraded":"2024-05-30T16:53:04.286464+0000","last_fullsized":"2024-05-30T16:53:04.286464+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:04.286307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:04.286307+0000","last_clean_scrub_stamp":"2024-05-30T16:53:04.286307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:26:45.450381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"74'437","reported_seq":664,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.861179+0000","last_change":"2024-05-30T16:53:19.321003+0000","last_active":"2024-05-30T16:53:36.861179+0000","last_peered":"2024-05-30T16:53:36.861179+0000","last_clean":"2024-05-30T16:53:36.861179+0000","last_became_active":"2024-05-30T16:50:01.214046+0000","last_became_peered":"2024-05-30T16:50:01.214046+0000","last_unstale":"2024-05-30T16:53:36.861179+0000","last_undegraded":"2024-05-30T16:53:36.861179+0000","last_fullsized":"2024-05-30T16:53:36.861179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'427","last_scrub_stamp":"2024-05-30T16:53:19.320817+0000","last_deep_scrub":"74'427","last_deep_scrub_stamp":"2024-05-30T16:53:19.320817+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.320817+0000","objects_scrubbed":176,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:36:22.561197+0000","scrub_duration":12525,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":738197504,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":193,"num_read_kb":753673,"num_write":186,"num_write_kb":720901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:02.375189+0000","last_change":"2024-05-30T16:53:02.375263+0000","last_active":"2024-05-30T16:53:02.375189+0000","last_peered":"2024-05-30T16:53:02.375189+0000","last_clean":"2024-05-30T16:53:02.375189+0000","last_became_active":"2024-05-30T16:50:00.203295+0000","last_became_peered":"2024-05-30T16:50:00.203295+0000","last_unstale":"2024-05-30T16:53:02.375189+0000","last_undegraded":"2024-05-30T16:53:02.375189+0000","last_fullsized":"2024-05-30T16:53:02.375189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:02.375062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:02.375062+0000","last_clean_scrub_stamp":"2024-05-30T16:53:02.375062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:29:18.498626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"74'451","reported_seq":598,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.865376+0000","last_change":"2024-05-30T16:53:20.564671+0000","last_active":"2024-05-30T16:53:36.865376+0000","last_peered":"2024-05-30T16:53:36.865376+0000","last_clean":"2024-05-30T16:53:36.865376+0000","last_became_active":"2024-05-30T16:50:01.223472+0000","last_became_peered":"2024-05-30T16:50:01.223472+0000","last_unstale":"2024-05-30T16:53:36.865376+0000","last_undegraded":"2024-05-30T16:53:36.865376+0000","last_fullsized":"2024-05-30T16:53:36.865376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'430","last_scrub_stamp":"2024-05-30T16:53:20.564409+0000","last_deep_scrub":"74'430","last_deep_scrub_stamp":"2024-05-30T16:53:20.564409+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.564409+0000","objects_scrubbed":185,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:03:40.679271+0000","scrub_duration":10264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":113,"num_read_kb":446468,"num_write":189,"num_write_kb":757762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"74'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:05.505565+0000","last_change":"2024-05-30T16:53:05.505609+0000","last_active":"2024-05-30T16:53:05.505565+0000","last_peered":"2024-05-30T16:53:05.505565+0000","last_clean":"2024-05-30T16:53:05.505565+0000","last_became_active":"2024-05-30T16:50:00.206554+0000","last_became_peered":"2024-05-30T16:50:00.206554+0000","last_unstale":"2024-05-30T16:53:05.505565+0000","last_undegraded":"2024-05-30T16:53:05.505565+0000","last_fullsized":"2024-05-30T16:53:05.505565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'1","last_scrub_stamp":"2024-05-30T16:53:05.505429+0000","last_deep_scrub":"74'1","last_deep_scrub_stamp":"2024-05-30T16:53:05.505429+0000","last_clean_scrub_stamp":"2024-05-30T16:53:05.505429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:44:57.297092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"74'418","reported_seq":586,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.874278+0000","last_change":"2024-05-30T16:53:28.652788+0000","last_active":"2024-05-30T16:53:36.874278+0000","last_peered":"2024-05-30T16:53:36.874278+0000","last_clean":"2024-05-30T16:53:36.874278+0000","last_became_active":"2024-05-30T16:50:36.236903+0000","last_became_peered":"2024-05-30T16:50:36.236903+0000","last_unstale":"2024-05-30T16:53:36.874278+0000","last_undegraded":"2024-05-30T16:53:36.874278+0000","last_fullsized":"2024-05-30T16:53:36.874278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'402","last_scrub_stamp":"2024-05-30T16:53:28.652527+0000","last_deep_scrub":"74'402","last_deep_scrub_stamp":"2024-05-30T16:53:28.652527+0000","last_clean_scrub_stamp":"2024-05-30T16:53:28.652527+0000","objects_scrubbed":172,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:10:12.499331+0000","scrub_duration":10162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721420288,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":120,"num_read_kb":483330,"num_write":174,"num_write_kb":704513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.212031+0000","last_change":"2024-05-30T16:53:04.212139+0000","last_active":"2024-05-30T16:53:04.212031+0000","last_peered":"2024-05-30T16:53:04.212031+0000","last_clean":"2024-05-30T16:53:04.212031+0000","last_became_active":"2024-05-30T16:50:00.210701+0000","last_became_peered":"2024-05-30T16:50:00.210701+0000","last_unstale":"2024-05-30T16:53:04.212031+0000","last_undegraded":"2024-05-30T16:53:04.212031+0000","last_fullsized":"2024-05-30T16:53:04.212031+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:04.211804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:04.211804+0000","last_clean_scrub_stamp":"2024-05-30T16:53:04.211804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:08.732064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"74'454","reported_seq":721,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.883878+0000","last_change":"2024-05-30T16:53:07.854103+0000","last_active":"2024-05-30T16:53:36.883878+0000","last_peered":"2024-05-30T16:53:36.883878+0000","last_clean":"2024-05-30T16:53:36.883878+0000","last_became_active":"2024-05-30T16:50:01.205079+0000","last_became_peered":"2024-05-30T16:50:01.205079+0000","last_unstale":"2024-05-30T16:53:36.883878+0000","last_undegraded":"2024-05-30T16:53:36.883878+0000","last_fullsized":"2024-05-30T16:53:36.883878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'442","last_scrub_stamp":"2024-05-30T16:53:07.853860+0000","last_deep_scrub":"74'442","last_deep_scrub_stamp":"2024-05-30T16:53:07.853860+0000","last_clean_scrub_stamp":"2024-05-30T16:53:07.853860+0000","objects_scrubbed":199,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:58:58.219094+0000","scrub_duration":2654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834666496,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":233,"num_read_kb":946178,"num_write":201,"num_write_kb":815105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'57","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:02.917296+0000","last_change":"2024-05-30T16:53:02.917407+0000","last_active":"2024-05-30T16:53:02.917296+0000","last_peered":"2024-05-30T16:53:02.917296+0000","last_clean":"2024-05-30T16:53:02.917296+0000","last_became_active":"2024-05-30T16:50:00.206330+0000","last_became_peered":"2024-05-30T16:50:00.206330+0000","last_unstale":"2024-05-30T16:53:02.917296+0000","last_undegraded":"2024-05-30T16:53:02.917296+0000","last_fullsized":"2024-05-30T16:53:02.917296+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'57","last_scrub_stamp":"2024-05-30T16:53:02.917080+0000","last_deep_scrub":"74'57","last_deep_scrub_stamp":"2024-05-30T16:53:02.917080+0000","last_clean_scrub_stamp":"2024-05-30T16:53:02.917080+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:33.815477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'459","reported_seq":677,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.876487+0000","last_change":"2024-05-30T16:53:20.987486+0000","last_active":"2024-05-30T16:53:36.876487+0000","last_peered":"2024-05-30T16:53:36.876487+0000","last_clean":"2024-05-30T16:53:36.876487+0000","last_became_active":"2024-05-30T16:50:01.216841+0000","last_became_peered":"2024-05-30T16:50:01.216841+0000","last_unstale":"2024-05-30T16:53:36.876487+0000","last_undegraded":"2024-05-30T16:53:36.876487+0000","last_fullsized":"2024-05-30T16:53:36.876487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'441","last_scrub_stamp":"2024-05-30T16:53:20.987272+0000","last_deep_scrub":"74'441","last_deep_scrub_stamp":"2024-05-30T16:53:20.987272+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.987272+0000","objects_scrubbed":194,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:01:37.810731+0000","scrub_duration":10519,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813694976,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":184,"num_read_kb":737284,"num_write":200,"num_write_kb":794627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'1005","reported_seq":1033,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:02.291356+0000","last_change":"2024-05-30T16:53:02.291356+0000","last_active":"2024-05-30T16:53:02.291356+0000","last_peered":"2024-05-30T16:53:02.291356+0000","last_clean":"2024-05-30T16:53:02.291356+0000","last_became_active":"2024-05-30T16:50:00.207935+0000","last_became_peered":"2024-05-30T16:50:00.207935+0000","last_unstale":"2024-05-30T16:53:02.291356+0000","last_undegraded":"2024-05-30T16:53:02.291356+0000","last_fullsized":"2024-05-30T16:53:02.291356+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'1004","last_scrub_stamp":"2024-05-30T16:53:02.291057+0000","last_deep_scrub":"74'1004","last_deep_scrub_stamp":"2024-05-30T16:53:02.291057+0000","last_clean_scrub_stamp":"2024-05-30T16:53:02.291057+0000","objects_scrubbed":4,"log_size":1005,"log_dups_size":0,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:52:37.410755+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1001,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"74'451","reported_seq":640,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.870885+0000","last_change":"2024-05-30T16:53:22.879145+0000","last_active":"2024-05-30T16:53:36.870885+0000","last_peered":"2024-05-30T16:53:36.870885+0000","last_clean":"2024-05-30T16:53:36.870885+0000","last_became_active":"2024-05-30T16:50:01.218601+0000","last_became_peered":"2024-05-30T16:50:01.218601+0000","last_unstale":"2024-05-30T16:53:36.870885+0000","last_undegraded":"2024-05-30T16:53:36.870885+0000","last_fullsized":"2024-05-30T16:53:36.870885+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'439","last_scrub_stamp":"2024-05-30T16:53:22.878895+0000","last_deep_scrub":"74'439","last_deep_scrub_stamp":"2024-05-30T16:53:22.878895+0000","last_clean_scrub_stamp":"2024-05-30T16:53:22.878895+0000","objects_scrubbed":193,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:01:19.866947+0000","scrub_duration":14715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":155,"num_read_kb":626690,"num_write":195,"num_write_kb":790529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"74'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:01.240100+0000","last_change":"2024-05-30T16:53:01.240136+0000","last_active":"2024-05-30T16:53:01.240100+0000","last_peered":"2024-05-30T16:53:01.240100+0000","last_clean":"2024-05-30T16:53:01.240100+0000","last_became_active":"2024-05-30T16:50:00.205173+0000","last_became_peered":"2024-05-30T16:50:00.205173+0000","last_unstale":"2024-05-30T16:53:01.240100+0000","last_undegraded":"2024-05-30T16:53:01.240100+0000","last_fullsized":"2024-05-30T16:53:01.240100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-05-30T16:53:01.240015+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-05-30T16:53:01.240015+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.240015+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:15:03.485036+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"74'499","reported_seq":685,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.860301+0000","last_change":"2024-05-30T16:53:19.337867+0000","last_active":"2024-05-30T16:53:36.860301+0000","last_peered":"2024-05-30T16:53:36.860301+0000","last_clean":"2024-05-30T16:53:36.860301+0000","last_became_active":"2024-05-30T16:50:01.223101+0000","last_became_peered":"2024-05-30T16:50:01.223101+0000","last_unstale":"2024-05-30T16:53:36.860301+0000","last_undegraded":"2024-05-30T16:53:36.860301+0000","last_fullsized":"2024-05-30T16:53:36.860301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'483","last_scrub_stamp":"2024-05-30T16:53:19.337612+0000","last_deep_scrub":"74'483","last_deep_scrub_stamp":"2024-05-30T16:53:19.337612+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.337612+0000","objects_scrubbed":212,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:30:07.954484+0000","scrub_duration":11129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889192448,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":151,"num_read_kb":610306,"num_write":216,"num_write_kb":868354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:12.364997+0000","last_change":"2024-05-30T16:53:12.365041+0000","last_active":"2024-05-30T16:53:12.364997+0000","last_peered":"2024-05-30T16:53:12.364997+0000","last_clean":"2024-05-30T16:53:12.364997+0000","last_became_active":"2024-05-30T16:50:00.204906+0000","last_became_peered":"2024-05-30T16:50:00.204906+0000","last_unstale":"2024-05-30T16:53:12.364997+0000","last_undegraded":"2024-05-30T16:53:12.364997+0000","last_fullsized":"2024-05-30T16:53:12.364997+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:12.364834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:12.364834+0000","last_clean_scrub_stamp":"2024-05-30T16:53:12.364834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T21:34:42.823982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'423","reported_seq":630,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.860811+0000","last_change":"2024-05-30T16:53:05.914807+0000","last_active":"2024-05-30T16:53:36.860811+0000","last_peered":"2024-05-30T16:53:36.860811+0000","last_clean":"2024-05-30T16:53:36.860811+0000","last_became_active":"2024-05-30T16:50:01.212022+0000","last_became_peered":"2024-05-30T16:50:01.212022+0000","last_unstale":"2024-05-30T16:53:36.860811+0000","last_undegraded":"2024-05-30T16:53:36.860811+0000","last_fullsized":"2024-05-30T16:53:36.860811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'409","last_scrub_stamp":"2024-05-30T16:53:05.914598+0000","last_deep_scrub":"74'409","last_deep_scrub_stamp":"2024-05-30T16:53:05.914598+0000","last_clean_scrub_stamp":"2024-05-30T16:53:05.914598+0000","objects_scrubbed":185,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:26:24.636369+0000","scrub_duration":3161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":775946240,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":173,"num_read_kb":708608,"num_write":185,"num_write_kb":757760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.145955+0000","last_change":"2024-05-30T16:53:04.145980+0000","last_active":"2024-05-30T16:53:04.145955+0000","last_peered":"2024-05-30T16:53:04.145955+0000","last_clean":"2024-05-30T16:53:04.145955+0000","last_became_active":"2024-05-30T16:50:00.208657+0000","last_became_peered":"2024-05-30T16:50:00.208657+0000","last_unstale":"2024-05-30T16:53:04.145955+0000","last_undegraded":"2024-05-30T16:53:04.145955+0000","last_fullsized":"2024-05-30T16:53:04.145955+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:04.145859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:04.145859+0000","last_clean_scrub_stamp":"2024-05-30T16:53:04.145859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:27.268894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"74'495","reported_seq":726,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.869654+0000","last_change":"2024-05-30T16:53:20.204863+0000","last_active":"2024-05-30T16:53:36.869654+0000","last_peered":"2024-05-30T16:53:36.869654+0000","last_clean":"2024-05-30T16:53:36.869654+0000","last_became_active":"2024-05-30T16:50:01.207140+0000","last_became_peered":"2024-05-30T16:50:01.207140+0000","last_unstale":"2024-05-30T16:53:36.869654+0000","last_undegraded":"2024-05-30T16:53:36.869654+0000","last_fullsized":"2024-05-30T16:53:36.869654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'478","last_scrub_stamp":"2024-05-30T16:53:20.204659+0000","last_deep_scrub":"74'478","last_deep_scrub_stamp":"2024-05-30T16:53:20.204659+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.204659+0000","objects_scrubbed":213,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:10:13.564362+0000","scrub_duration":14828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":196,"num_read_kb":782341,"num_write":217,"num_write_kb":872450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"74'12","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:02.487875+0000","last_change":"2024-05-30T16:53:02.487949+0000","last_active":"2024-05-30T16:53:02.487875+0000","last_peered":"2024-05-30T16:53:02.487875+0000","last_clean":"2024-05-30T16:53:02.487875+0000","last_became_active":"2024-05-30T16:50:00.196545+0000","last_became_peered":"2024-05-30T16:50:00.196545+0000","last_unstale":"2024-05-30T16:53:02.487875+0000","last_undegraded":"2024-05-30T16:53:02.487875+0000","last_fullsized":"2024-05-30T16:53:02.487875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'12","last_scrub_stamp":"2024-05-30T16:53:02.487684+0000","last_deep_scrub":"74'12","last_deep_scrub_stamp":"2024-05-30T16:53:02.487684+0000","last_clean_scrub_stamp":"2024-05-30T16:53:02.487684+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:19:07.007943+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"74'477","reported_seq":584,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.864375+0000","last_change":"2024-05-30T16:53:22.883641+0000","last_active":"2024-05-30T16:53:36.864375+0000","last_peered":"2024-05-30T16:53:36.864375+0000","last_clean":"2024-05-30T16:53:36.864375+0000","last_became_active":"2024-05-30T16:50:01.214868+0000","last_became_peered":"2024-05-30T16:50:01.214868+0000","last_unstale":"2024-05-30T16:53:36.864375+0000","last_undegraded":"2024-05-30T16:53:36.864375+0000","last_fullsized":"2024-05-30T16:53:36.864375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'467","last_scrub_stamp":"2024-05-30T16:53:22.883442+0000","last_deep_scrub":"74'467","last_deep_scrub_stamp":"2024-05-30T16:53:22.883442+0000","last_clean_scrub_stamp":"2024-05-30T16:53:22.883442+0000","objects_scrubbed":212,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:21:32.800358+0000","scrub_duration":13378,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884998275,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":72,"num_read_kb":290817,"num_write":212,"num_write_kb":864257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"74'2","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:14.696528+0000","last_change":"2024-05-30T16:53:14.696581+0000","last_active":"2024-05-30T16:53:14.696528+0000","last_peered":"2024-05-30T16:53:14.696528+0000","last_clean":"2024-05-30T16:53:14.696528+0000","last_became_active":"2024-05-30T16:50:00.203291+0000","last_became_peered":"2024-05-30T16:50:00.203291+0000","last_unstale":"2024-05-30T16:53:14.696528+0000","last_undegraded":"2024-05-30T16:53:14.696528+0000","last_fullsized":"2024-05-30T16:53:14.696528+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'2","last_scrub_stamp":"2024-05-30T16:53:14.696383+0000","last_deep_scrub":"74'2","last_deep_scrub_stamp":"2024-05-30T16:53:14.696383+0000","last_clean_scrub_stamp":"2024-05-30T16:53:14.696383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T01:09:10.423272+0000","scrub_duration":344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"74'479","reported_seq":748,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.873562+0000","last_change":"2024-05-30T16:53:28.798099+0000","last_active":"2024-05-30T16:53:36.873562+0000","last_peered":"2024-05-30T16:53:36.873562+0000","last_clean":"2024-05-30T16:53:36.873562+0000","last_became_active":"2024-05-30T16:50:01.225825+0000","last_became_peered":"2024-05-30T16:50:01.225825+0000","last_unstale":"2024-05-30T16:53:36.873562+0000","last_undegraded":"2024-05-30T16:53:36.873562+0000","last_fullsized":"2024-05-30T16:53:36.873562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'467","last_scrub_stamp":"2024-05-30T16:53:28.797789+0000","last_deep_scrub":"74'467","last_deep_scrub_stamp":"2024-05-30T16:53:28.797789+0000","last_clean_scrub_stamp":"2024-05-30T16:53:28.797789+0000","objects_scrubbed":209,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:55:41.217085+0000","scrub_duration":12398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872415354,"num_objects":209,"num_object_clones":0,"num_object_copies":418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":234,"num_read_kb":942084,"num_write":213,"num_write_kb":851971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:03.494880+0000","last_change":"2024-05-30T16:53:03.494943+0000","last_active":"2024-05-30T16:53:03.494880+0000","last_peered":"2024-05-30T16:53:03.494880+0000","last_clean":"2024-05-30T16:53:03.494880+0000","last_became_active":"2024-05-30T16:50:00.201028+0000","last_became_peered":"2024-05-30T16:50:00.201028+0000","last_unstale":"2024-05-30T16:53:03.494880+0000","last_undegraded":"2024-05-30T16:53:03.494880+0000","last_fullsized":"2024-05-30T16:53:03.494880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'3","last_scrub_stamp":"2024-05-30T16:53:03.494691+0000","last_deep_scrub":"74'3","last_deep_scrub_stamp":"2024-05-30T16:53:03.494691+0000","last_clean_scrub_stamp":"2024-05-30T16:53:03.494691+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:22:00.528435+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"74'494","reported_seq":705,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.876751+0000","last_change":"2024-05-30T16:53:21.992356+0000","last_active":"2024-05-30T16:53:36.876751+0000","last_peered":"2024-05-30T16:53:36.876751+0000","last_clean":"2024-05-30T16:53:36.876751+0000","last_became_active":"2024-05-30T16:50:01.217748+0000","last_became_peered":"2024-05-30T16:50:01.217748+0000","last_unstale":"2024-05-30T16:53:36.876751+0000","last_undegraded":"2024-05-30T16:53:36.876751+0000","last_fullsized":"2024-05-30T16:53:36.876751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'478","last_scrub_stamp":"2024-05-30T16:53:21.992191+0000","last_deep_scrub":"74'478","last_deep_scrub_stamp":"2024-05-30T16:53:21.992191+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.992191+0000","objects_scrubbed":204,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:22:53.294680+0000","scrub_duration":13653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855638016,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":176,"num_read_kb":679946,"num_write":218,"num_write_kb":835591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"74'2","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:09.491991+0000","last_change":"2024-05-30T16:53:09.492042+0000","last_active":"2024-05-30T16:53:09.491991+0000","last_peered":"2024-05-30T16:53:09.491991+0000","last_clean":"2024-05-30T16:53:09.491991+0000","last_became_active":"2024-05-30T16:50:00.201564+0000","last_became_peered":"2024-05-30T16:50:00.201564+0000","last_unstale":"2024-05-30T16:53:09.491991+0000","last_undegraded":"2024-05-30T16:53:09.491991+0000","last_fullsized":"2024-05-30T16:53:09.491991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'2","last_scrub_stamp":"2024-05-30T16:53:09.491870+0000","last_deep_scrub":"74'2","last_deep_scrub_stamp":"2024-05-30T16:53:09.491870+0000","last_clean_scrub_stamp":"2024-05-30T16:53:09.491870+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:39.255201+0000","scrub_duration":222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"74'503","reported_seq":769,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.879891+0000","last_change":"2024-05-30T16:53:22.443849+0000","last_active":"2024-05-30T16:53:36.879891+0000","last_peered":"2024-05-30T16:53:36.879891+0000","last_clean":"2024-05-30T16:53:36.879891+0000","last_became_active":"2024-05-30T16:50:01.216443+0000","last_became_peered":"2024-05-30T16:50:01.216443+0000","last_unstale":"2024-05-30T16:53:36.879891+0000","last_undegraded":"2024-05-30T16:53:36.879891+0000","last_fullsized":"2024-05-30T16:53:36.879891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'489","last_scrub_stamp":"2024-05-30T16:53:22.443497+0000","last_deep_scrub":"74'489","last_deep_scrub_stamp":"2024-05-30T16:53:22.443497+0000","last_clean_scrub_stamp":"2024-05-30T16:53:22.443497+0000","objects_scrubbed":221,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:27:05.008129+0000","scrub_duration":13063,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":926941184,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":231,"num_read_kb":933891,"num_write":223,"num_write_kb":905217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:06.126005+0000","last_change":"2024-05-30T16:53:06.126084+0000","last_active":"2024-05-30T16:53:06.126005+0000","last_peered":"2024-05-30T16:53:06.126005+0000","last_clean":"2024-05-30T16:53:06.126005+0000","last_became_active":"2024-05-30T16:50:00.201839+0000","last_became_peered":"2024-05-30T16:50:00.201839+0000","last_unstale":"2024-05-30T16:53:06.126005+0000","last_undegraded":"2024-05-30T16:53:06.126005+0000","last_fullsized":"2024-05-30T16:53:06.126005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:06.125773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:06.125773+0000","last_clean_scrub_stamp":"2024-05-30T16:53:06.125773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:37.024170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'463","reported_seq":678,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.871940+0000","last_change":"2024-05-30T16:53:14.722761+0000","last_active":"2024-05-30T16:53:36.871940+0000","last_peered":"2024-05-30T16:53:36.871940+0000","last_clean":"2024-05-30T16:53:36.871940+0000","last_became_active":"2024-05-30T16:50:01.217643+0000","last_became_peered":"2024-05-30T16:50:01.217643+0000","last_unstale":"2024-05-30T16:53:36.871940+0000","last_undegraded":"2024-05-30T16:53:36.871940+0000","last_fullsized":"2024-05-30T16:53:36.871940+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'448","last_scrub_stamp":"2024-05-30T16:53:14.722565+0000","last_deep_scrub":"74'448","last_deep_scrub_stamp":"2024-05-30T16:53:14.722565+0000","last_clean_scrub_stamp":"2024-05-30T16:53:14.722565+0000","objects_scrubbed":195,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:45.421341+0000","scrub_duration":9855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809501194,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":180,"num_read_kb":724995,"num_write":197,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:10.283307+0000","last_change":"2024-05-30T16:53:10.283346+0000","last_active":"2024-05-30T16:53:10.283307+0000","last_peered":"2024-05-30T16:53:10.283307+0000","last_clean":"2024-05-30T16:53:10.283307+0000","last_became_active":"2024-05-30T16:50:00.204496+0000","last_became_peered":"2024-05-30T16:50:00.204496+0000","last_unstale":"2024-05-30T16:53:10.283307+0000","last_undegraded":"2024-05-30T16:53:10.283307+0000","last_fullsized":"2024-05-30T16:53:10.283307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:10.283182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:10.283182+0000","last_clean_scrub_stamp":"2024-05-30T16:53:10.283182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:28:33.406217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"74'453","reported_seq":618,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.875219+0000","last_change":"2024-05-30T16:53:19.469308+0000","last_active":"2024-05-30T16:53:36.875219+0000","last_peered":"2024-05-30T16:53:36.875219+0000","last_clean":"2024-05-30T16:53:36.875219+0000","last_became_active":"2024-05-30T16:50:01.219438+0000","last_became_peered":"2024-05-30T16:50:01.219438+0000","last_unstale":"2024-05-30T16:53:36.875219+0000","last_undegraded":"2024-05-30T16:53:36.875219+0000","last_fullsized":"2024-05-30T16:53:36.875219+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'440","last_scrub_stamp":"2024-05-30T16:53:19.469048+0000","last_deep_scrub":"74'440","last_deep_scrub_stamp":"2024-05-30T16:53:19.469048+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.469048+0000","objects_scrubbed":192,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T02:04:50.651535+0000","scrub_duration":12548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801112325,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":131,"num_read_kb":532481,"num_write":194,"num_write_kb":782338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:03.103685+0000","last_change":"2024-05-30T16:53:03.103744+0000","last_active":"2024-05-30T16:53:03.103685+0000","last_peered":"2024-05-30T16:53:03.103685+0000","last_clean":"2024-05-30T16:53:03.103685+0000","last_became_active":"2024-05-30T16:50:00.206716+0000","last_became_peered":"2024-05-30T16:50:00.206716+0000","last_unstale":"2024-05-30T16:53:03.103685+0000","last_undegraded":"2024-05-30T16:53:03.103685+0000","last_fullsized":"2024-05-30T16:53:03.103685+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:03.103475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:03.103475+0000","last_clean_scrub_stamp":"2024-05-30T16:53:03.103475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:09.267680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"74'452","reported_seq":665,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.877599+0000","last_change":"2024-05-30T16:53:20.564494+0000","last_active":"2024-05-30T16:53:36.877599+0000","last_peered":"2024-05-30T16:53:36.877599+0000","last_clean":"2024-05-30T16:53:36.877599+0000","last_became_active":"2024-05-30T16:50:01.219624+0000","last_became_peered":"2024-05-30T16:50:01.219624+0000","last_unstale":"2024-05-30T16:53:36.877599+0000","last_undegraded":"2024-05-30T16:53:36.877599+0000","last_fullsized":"2024-05-30T16:53:36.877599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'431","last_scrub_stamp":"2024-05-30T16:53:20.564265+0000","last_deep_scrub":"74'431","last_deep_scrub_stamp":"2024-05-30T16:53:20.564265+0000","last_clean_scrub_stamp":"2024-05-30T16:53:20.564265+0000","objects_scrubbed":193,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:12:16.852199+0000","scrub_duration":12673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809500672,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":179,"num_read_kb":716804,"num_write":199,"num_write_kb":790531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:00.757415+0000","last_change":"2024-05-30T16:53:00.757447+0000","last_active":"2024-05-30T16:53:00.757415+0000","last_peered":"2024-05-30T16:53:00.757415+0000","last_clean":"2024-05-30T16:53:00.757415+0000","last_became_active":"2024-05-30T16:50:00.198435+0000","last_became_peered":"2024-05-30T16:50:00.198435+0000","last_unstale":"2024-05-30T16:53:00.757415+0000","last_undegraded":"2024-05-30T16:53:00.757415+0000","last_fullsized":"2024-05-30T16:53:00.757415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:00.757342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:00.757342+0000","last_clean_scrub_stamp":"2024-05-30T16:53:00.757342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:54:06.921548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"74'467","reported_seq":616,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.873167+0000","last_change":"2024-05-30T16:53:12.109159+0000","last_active":"2024-05-30T16:53:36.873167+0000","last_peered":"2024-05-30T16:53:36.873167+0000","last_clean":"2024-05-30T16:53:36.873167+0000","last_became_active":"2024-05-30T16:50:01.212680+0000","last_became_peered":"2024-05-30T16:50:01.212680+0000","last_unstale":"2024-05-30T16:53:36.873167+0000","last_undegraded":"2024-05-30T16:53:36.873167+0000","last_fullsized":"2024-05-30T16:53:36.873167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'452","last_scrub_stamp":"2024-05-30T16:53:12.108986+0000","last_deep_scrub":"74'452","last_deep_scrub_stamp":"2024-05-30T16:53:12.108986+0000","last_clean_scrub_stamp":"2024-05-30T16:53:12.108986+0000","objects_scrubbed":201,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:21:22.025902+0000","scrub_duration":8327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843055104,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":113,"num_read_kb":454658,"num_write":203,"num_write_kb":823297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:13.447979+0000","last_change":"2024-05-30T16:53:13.448027+0000","last_active":"2024-05-30T16:53:13.447979+0000","last_peered":"2024-05-30T16:53:13.447979+0000","last_clean":"2024-05-30T16:53:13.447979+0000","last_became_active":"2024-05-30T16:50:00.202921+0000","last_became_peered":"2024-05-30T16:50:00.202921+0000","last_unstale":"2024-05-30T16:53:13.447979+0000","last_undegraded":"2024-05-30T16:53:13.447979+0000","last_fullsized":"2024-05-30T16:53:13.447979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'3","last_scrub_stamp":"2024-05-30T16:53:13.447816+0000","last_deep_scrub":"74'3","last_deep_scrub_stamp":"2024-05-30T16:53:13.447816+0000","last_clean_scrub_stamp":"2024-05-30T16:53:13.447816+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:22:06.744688+0000","scrub_duration":137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"74'464","reported_seq":743,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.860237+0000","last_change":"2024-05-30T16:53:24.373505+0000","last_active":"2024-05-30T16:53:36.860237+0000","last_peered":"2024-05-30T16:53:36.860237+0000","last_clean":"2024-05-30T16:53:36.860237+0000","last_became_active":"2024-05-30T16:50:01.224834+0000","last_became_peered":"2024-05-30T16:50:01.224834+0000","last_unstale":"2024-05-30T16:53:36.860237+0000","last_undegraded":"2024-05-30T16:53:36.860237+0000","last_fullsized":"2024-05-30T16:53:36.860237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'450","last_scrub_stamp":"2024-05-30T16:53:24.373349+0000","last_deep_scrub":"74'450","last_deep_scrub_stamp":"2024-05-30T16:53:24.373349+0000","last_clean_scrub_stamp":"2024-05-30T16:53:24.373349+0000","objects_scrubbed":203,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:03:55.271746+0000","scrub_duration":13025,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":244,"num_read_kb":999424,"num_write":207,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"74'94","reported_seq":122,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.333711+0000","last_change":"2024-05-30T16:53:05.122949+0000","last_active":"2024-05-30T16:53:36.333711+0000","last_peered":"2024-05-30T16:53:36.333711+0000","last_clean":"2024-05-30T16:53:36.333711+0000","last_became_active":"2024-05-30T16:50:00.209606+0000","last_became_peered":"2024-05-30T16:50:00.209606+0000","last_unstale":"2024-05-30T16:53:36.333711+0000","last_undegraded":"2024-05-30T16:53:36.333711+0000","last_fullsized":"2024-05-30T16:53:36.333711+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'91","last_scrub_stamp":"2024-05-30T16:53:05.122619+0000","last_deep_scrub":"74'91","last_deep_scrub_stamp":"2024-05-30T16:53:05.122619+0000","last_clean_scrub_stamp":"2024-05-30T16:53:05.122619+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T03:49:30.002675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2455,"num_omap_keys":40,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"74'452","reported_seq":761,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.881296+0000","last_change":"2024-05-30T16:53:21.890502+0000","last_active":"2024-05-30T16:53:36.881296+0000","last_peered":"2024-05-30T16:53:36.881296+0000","last_clean":"2024-05-30T16:53:36.881296+0000","last_became_active":"2024-05-30T16:50:01.221622+0000","last_became_peered":"2024-05-30T16:50:01.221622+0000","last_unstale":"2024-05-30T16:53:36.881296+0000","last_undegraded":"2024-05-30T16:53:36.881296+0000","last_fullsized":"2024-05-30T16:53:36.881296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'437","last_scrub_stamp":"2024-05-30T16:53:21.890229+0000","last_deep_scrub":"74'437","last_deep_scrub_stamp":"2024-05-30T16:53:21.890229+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.890229+0000","objects_scrubbed":191,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T04:33:46.369588+0000","scrub_duration":10735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796918021,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":275,"num_read_kb":1114115,"num_write":197,"num_write_kb":778244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:01.328398+0000","last_change":"2024-05-30T16:53:01.328453+0000","last_active":"2024-05-30T16:53:01.328398+0000","last_peered":"2024-05-30T16:53:01.328398+0000","last_clean":"2024-05-30T16:53:01.328398+0000","last_became_active":"2024-05-30T16:50:00.202559+0000","last_became_peered":"2024-05-30T16:50:00.202559+0000","last_unstale":"2024-05-30T16:53:01.328398+0000","last_undegraded":"2024-05-30T16:53:01.328398+0000","last_fullsized":"2024-05-30T16:53:01.328398+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:01.328104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:01.328104+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.328104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:27:30.163472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"74'461","reported_seq":643,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.865615+0000","last_change":"2024-05-30T16:53:27.727086+0000","last_active":"2024-05-30T16:53:36.865615+0000","last_peered":"2024-05-30T16:53:36.865615+0000","last_clean":"2024-05-30T16:53:36.865615+0000","last_became_active":"2024-05-30T16:50:01.224600+0000","last_became_peered":"2024-05-30T16:50:01.224600+0000","last_unstale":"2024-05-30T16:53:36.865615+0000","last_undegraded":"2024-05-30T16:53:36.865615+0000","last_fullsized":"2024-05-30T16:53:36.865615+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'448","last_scrub_stamp":"2024-05-30T16:53:27.726956+0000","last_deep_scrub":"74'448","last_deep_scrub_stamp":"2024-05-30T16:53:27.726956+0000","last_clean_scrub_stamp":"2024-05-30T16:53:27.726956+0000","objects_scrubbed":203,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-06-01T00:49:34.836695+0000","scrub_duration":13374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838861053,"num_objects":203,"num_object_clones":1,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":1,"num_read":148,"num_read_kb":602113,"num_write":203,"num_write_kb":819202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:01.742838+0000","last_change":"2024-05-30T16:53:01.742864+0000","last_active":"2024-05-30T16:53:01.742838+0000","last_peered":"2024-05-30T16:53:01.742838+0000","last_clean":"2024-05-30T16:53:01.742838+0000","last_became_active":"2024-05-30T16:50:00.204174+0000","last_became_peered":"2024-05-30T16:50:00.204174+0000","last_unstale":"2024-05-30T16:53:01.742838+0000","last_undegraded":"2024-05-30T16:53:01.742838+0000","last_fullsized":"2024-05-30T16:53:01.742838+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:01.742748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:01.742748+0000","last_clean_scrub_stamp":"2024-05-30T16:53:01.742748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:15.106285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"74'467","reported_seq":676,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.870070+0000","last_change":"2024-05-30T16:53:21.784404+0000","last_active":"2024-05-30T16:53:36.870070+0000","last_peered":"2024-05-30T16:53:36.870070+0000","last_clean":"2024-05-30T16:53:36.870070+0000","last_became_active":"2024-05-30T16:50:01.214152+0000","last_became_peered":"2024-05-30T16:50:01.214152+0000","last_unstale":"2024-05-30T16:53:36.870070+0000","last_undegraded":"2024-05-30T16:53:36.870070+0000","last_fullsized":"2024-05-30T16:53:36.870070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'454","last_scrub_stamp":"2024-05-30T16:53:21.784276+0000","last_deep_scrub":"74'454","last_deep_scrub_stamp":"2024-05-30T16:53:21.784276+0000","last_clean_scrub_stamp":"2024-05-30T16:53:21.784276+0000","objects_scrubbed":201,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":16,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:52:38.879887+0000","scrub_duration":15418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838860931,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":174,"num_read_kb":708609,"num_write":201,"num_write_kb":819201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:03.340718+0000","last_change":"2024-05-30T16:53:03.340743+0000","last_active":"2024-05-30T16:53:03.340718+0000","last_peered":"2024-05-30T16:53:03.340718+0000","last_clean":"2024-05-30T16:53:03.340718+0000","last_became_active":"2024-05-30T16:50:00.207399+0000","last_became_peered":"2024-05-30T16:50:00.207399+0000","last_unstale":"2024-05-30T16:53:03.340718+0000","last_undegraded":"2024-05-30T16:53:03.340718+0000","last_fullsized":"2024-05-30T16:53:03.340718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:03.340597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:03.340597+0000","last_clean_scrub_stamp":"2024-05-30T16:53:03.340597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:57.637967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"74'476","reported_seq":756,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.884744+0000","last_change":"2024-05-30T16:53:12.373402+0000","last_active":"2024-05-30T16:53:36.884744+0000","last_peered":"2024-05-30T16:53:36.884744+0000","last_clean":"2024-05-30T16:53:36.884744+0000","last_became_active":"2024-05-30T16:50:01.214454+0000","last_became_peered":"2024-05-30T16:50:01.214454+0000","last_unstale":"2024-05-30T16:53:36.884744+0000","last_undegraded":"2024-05-30T16:53:36.884744+0000","last_fullsized":"2024-05-30T16:53:36.884744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'451","last_scrub_stamp":"2024-05-30T16:53:12.373183+0000","last_deep_scrub":"74'451","last_deep_scrub_stamp":"2024-05-30T16:53:12.373183+0000","last_clean_scrub_stamp":"2024-05-30T16:53:12.373183+0000","objects_scrubbed":204,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:59:05.173576+0000","scrub_duration":5112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443843,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":245,"num_read_kb":999425,"num_write":206,"num_write_kb":831490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:03.245968+0000","last_change":"2024-05-30T16:53:03.246019+0000","last_active":"2024-05-30T16:53:03.245968+0000","last_peered":"2024-05-30T16:53:03.245968+0000","last_clean":"2024-05-30T16:53:03.245968+0000","last_became_active":"2024-05-30T16:50:00.212918+0000","last_became_peered":"2024-05-30T16:50:00.212918+0000","last_unstale":"2024-05-30T16:53:03.245968+0000","last_undegraded":"2024-05-30T16:53:03.245968+0000","last_fullsized":"2024-05-30T16:53:03.245968+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:03.245781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:03.245781+0000","last_clean_scrub_stamp":"2024-05-30T16:53:03.245781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:19:41.217470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"74'523","reported_seq":784,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.850374+0000","last_change":"2024-05-30T16:53:19.474357+0000","last_active":"2024-05-30T16:53:36.850374+0000","last_peered":"2024-05-30T16:53:36.850374+0000","last_clean":"2024-05-30T16:53:36.850374+0000","last_became_active":"2024-05-30T16:50:01.209939+0000","last_became_peered":"2024-05-30T16:50:01.209939+0000","last_unstale":"2024-05-30T16:53:36.850374+0000","last_undegraded":"2024-05-30T16:53:36.850374+0000","last_fullsized":"2024-05-30T16:53:36.850374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'510","last_scrub_stamp":"2024-05-30T16:53:19.474100+0000","last_deep_scrub":"74'510","last_deep_scrub_stamp":"2024-05-30T16:53:19.474100+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.474100+0000","objects_scrubbed":233,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T19:35:56.479219+0000","scrub_duration":13161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977272832,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":225,"num_read_kb":921600,"num_write":233,"num_write_kb":954368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"74'86","reported_seq":198,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:04.494585+0000","last_change":"2024-05-30T16:53:04.494657+0000","last_active":"2024-05-30T16:53:04.494585+0000","last_peered":"2024-05-30T16:53:04.494585+0000","last_clean":"2024-05-30T16:53:04.494585+0000","last_became_active":"2024-05-30T16:50:00.203719+0000","last_became_peered":"2024-05-30T16:50:00.203719+0000","last_unstale":"2024-05-30T16:53:04.494585+0000","last_undegraded":"2024-05-30T16:53:04.494585+0000","last_fullsized":"2024-05-30T16:53:04.494585+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'86","last_scrub_stamp":"2024-05-30T16:53:04.494393+0000","last_deep_scrub":"74'86","last_deep_scrub_stamp":"2024-05-30T16:53:04.494393+0000","last_clean_scrub_stamp":"2024-05-30T16:53:04.494393+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:45:21.166357+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":84,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"74'478","reported_seq":741,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.879982+0000","last_change":"2024-05-30T16:53:28.050534+0000","last_active":"2024-05-30T16:53:36.879982+0000","last_peered":"2024-05-30T16:53:36.879982+0000","last_clean":"2024-05-30T16:53:36.879982+0000","last_became_active":"2024-05-30T16:50:01.211630+0000","last_became_peered":"2024-05-30T16:50:01.211630+0000","last_unstale":"2024-05-30T16:53:36.879982+0000","last_undegraded":"2024-05-30T16:53:36.879982+0000","last_fullsized":"2024-05-30T16:53:36.879982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'469","last_scrub_stamp":"2024-05-30T16:53:28.050372+0000","last_deep_scrub":"74'469","last_deep_scrub_stamp":"2024-05-30T16:53:28.050372+0000","last_clean_scrub_stamp":"2024-05-30T16:53:28.050372+0000","objects_scrubbed":213,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:49:31.172752+0000","scrub_duration":7635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893386752,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":228,"num_read_kb":933888,"num_write":215,"num_write_kb":872449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:08.269305+0000","last_change":"2024-05-30T16:53:08.269343+0000","last_active":"2024-05-30T16:53:08.269305+0000","last_peered":"2024-05-30T16:53:08.269305+0000","last_clean":"2024-05-30T16:53:08.269305+0000","last_became_active":"2024-05-30T16:50:00.210165+0000","last_became_peered":"2024-05-30T16:50:00.210165+0000","last_unstale":"2024-05-30T16:53:08.269305+0000","last_undegraded":"2024-05-30T16:53:08.269305+0000","last_fullsized":"2024-05-30T16:53:08.269305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T16:53:08.269175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T16:53:08.269175+0000","last_clean_scrub_stamp":"2024-05-30T16:53:08.269175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T23:45:00.060838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"74'467","reported_seq":737,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:36.880006+0000","last_change":"2024-05-30T16:53:19.350808+0000","last_active":"2024-05-30T16:53:36.880006+0000","last_peered":"2024-05-30T16:53:36.880006+0000","last_clean":"2024-05-30T16:53:36.880006+0000","last_became_active":"2024-05-30T16:50:01.218350+0000","last_became_peered":"2024-05-30T16:50:01.218350+0000","last_unstale":"2024-05-30T16:53:36.880006+0000","last_undegraded":"2024-05-30T16:53:36.880006+0000","last_fullsized":"2024-05-30T16:53:36.880006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'451","last_scrub_stamp":"2024-05-30T16:53:19.350617+0000","last_deep_scrub":"74'451","last_deep_scrub_stamp":"2024-05-30T16:53:19.350617+0000","last_clean_scrub_stamp":"2024-05-30T16:53:19.350617+0000","objects_scrubbed":203,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":14,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T22:38:56.916761+0000","scrub_duration":13467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851443712,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":235,"num_read_kb":962560,"num_write":203,"num_write_kb":831488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:16.260220+0000","last_change":"2024-05-30T16:53:16.260278+0000","last_active":"2024-05-30T16:53:16.260220+0000","last_peered":"2024-05-30T16:53:16.260220+0000","last_clean":"2024-05-30T16:53:16.260220+0000","last_became_active":"2024-05-30T16:50:00.209715+0000","last_became_peered":"2024-05-30T16:50:00.209715+0000","last_unstale":"2024-05-30T16:53:16.260220+0000","last_undegraded":"2024-05-30T16:53:16.260220+0000","last_fullsized":"2024-05-30T16:53:16.260220+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-05-30T16:53:16.260112+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-05-30T16:53:16.260112+0000","last_clean_scrub_stamp":"2024-05-30T16:53:16.260112+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T20:43:37.437716+0000","scrub_duration":897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"74'119","reported_seq":283,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-30T16:53:05.220740+0000","last_change":"2024-05-30T16:53:05.220808+0000","last_active":"2024-05-30T16:53:05.220740+0000","last_peered":"2024-05-30T16:53:05.220740+0000","last_clean":"2024-05-30T16:53:05.220740+0000","last_became_active":"2024-05-30T16:41:42.534687+0000","last_became_peered":"2024-05-30T16:41:42.534687+0000","last_unstale":"2024-05-30T16:53:05.220740+0000","last_undegraded":"2024-05-30T16:53:05.220740+0000","last_fullsized":"2024-05-30T16:53:05.220740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'119","last_scrub_stamp":"2024-05-30T16:53:05.220474+0000","last_deep_scrub":"74'119","last_deep_scrub_stamp":"2024-05-30T16:53:05.220474+0000","last_clean_scrub_stamp":"2024-05-30T16:53:05.220474+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:09.689200+0000","scrub_duration":60,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":53712261060,"num_objects":12829,"num_object_clones":1,"num_object_copies":25658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12829,"num_whiteouts":1,"num_read":12246,"num_read_kb":49496226,"num_write":13027,"num_write_kb":52453497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107424694272,"data_stored":107424522120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29878,"ondisk_log_size":29878,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4447210,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":1472,"num_write_kb":4956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7455,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8953856,"data_stored":8894420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1351,"ondisk_log_size":1351,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15437864,"kb_used_data":15312352,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":78933976,"statfs":{"total":96636764160,"available":80828391424,"internally_reserved":0,"allocated":15679848448,"data_stored":15679297903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17321432,"kb_used_data":17195920,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":77050408,"statfs":{"total":96636764160,"available":78899617792,"internally_reserved":0,"allocated":17608622080,"data_stored":17608075002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10656276,"kb_used_data":10589068,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":83715564,"statfs":{"total":96636764160,"available":85724737536,"internally_reserved":0,"allocated":10843205632,"data_stored":10842662378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11721528,"kb_used_data":11650160,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":82650312,"statfs":{"total":96636764160,"available":84633919488,"internally_reserved":0,"allocated":11929763840,"data_stored":11929237624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14356244,"kb_used_data":14226572,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":80015596,"statfs":{"total":96636764160,"available":81935970304,"internally_reserved":0,"allocated":14568009728,"data_stored":14567444583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16418644,"kb_used_data":16311180,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":77953196,"statfs":{"total":96636764160,"available":79824072704,"internally_reserved":0,"allocated":16702648320,"data_stored":16702105396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10823580,"kb_used_data":10711956,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":83548260,"statfs":{"total":96636764160,"available":85553418240,"internally_reserved":0,"allocated":10969042944,"data_stored":10968492566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8998032,"kb_used_data":8926664,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":85373808,"statfs":{"total":96636764160,"available":87422779392,"internally_reserved":0,"allocated":9140903936,"data_stored":9140365112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":239420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":251506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":12744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9139408896,"data_stored":9139389333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10963931136,"data_stored":10963911563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16697544704,"data_stored":16697525009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14566858752,"data_stored":14566819752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11928604672,"data_stored":11928600707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10842300416,"data_stored":10842276877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17607712768,"data_stored":17607689499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15678332928,"data_stored":15678309380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T16:53:46.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-30T16:53:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.544+0000 7fe733400640 1 Processor -- start 2024-05-30T16:53:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.544+0000 7fe733400640 1 -- start start 2024-05-30T16:53:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe733400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe72c1418f0 0x7fe72c15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe733400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe72c144020 0x7fe72c06e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe733400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c0b3fd0 con 0x7fe72c141510 2024-05-30T16:53:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe733400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe72c06dfc0 con 0x7fe72c144020 2024-05-30T16:53:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe733400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe72c144790 con 0x7fe72c1418f0 2024-05-30T16:53:46.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe731400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe72c144020 0x7fe72c06e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe731400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe72c144020 0x7fe72c06e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37020/0 (socket says 172.21.15.144:37020) 2024-05-30T16:53:46.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe731400640 1 -- 172.21.15.144:0/301642181 learned_addr learned my addr 172.21.15.144:0/301642181 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe731400640 1 -- 172.21.15.144:0/301642181 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe72c1418f0 msgr2=0x7fe72c15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe731400640 1 --2- 172.21.15.144:0/301642181 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe72c1418f0 0x7fe72c15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe731400640 1 -- 172.21.15.144:0/301642181 >> v1:172.21.15.149:6789/0 conn(0x7fe72c141510 legacy=0x7fe72c0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.546+0000 7fe731400640 1 -- 172.21.15.144:0/301642181 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c144a70 con 0x7fe72c144020 2024-05-30T16:53:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.547+0000 7fe731400640 1 --2- 172.21.15.144:0/301642181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c144020 0x7fe72c06e710 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fe724009e50 tx=0x7fe72402a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3738618fd075a15 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.548+0000 7fe72be00640 1 -- 172.21.15.144:0/301642181 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724036070 con 0x7fe72c144020 2024-05-30T16:53:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.548+0000 7fe72be00640 1 -- 172.21.15.144:0/301642181 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe724031600 con 0x7fe72c144020 2024-05-30T16:53:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.548+0000 7fe72be00640 1 -- 172.21.15.144:0/301642181 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7240319d0 con 0x7fe72c144020 2024-05-30T16:53:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.548+0000 7fe733400640 1 -- 172.21.15.144:0/301642181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c144020 msgr2=0x7fe72c06e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.548+0000 7fe733400640 1 --2- 172.21.15.144:0/301642181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c144020 0x7fe72c06e710 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fe724009e50 tx=0x7fe72402a5b0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.549+0000 7fe733400640 1 -- 172.21.15.144:0/301642181 shutdown_connections 2024-05-30T16:53:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.549+0000 7fe733400640 1 --2- 172.21.15.144:0/301642181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c144020 0x7fe72c06e710 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.549+0000 7fe733400640 1 --2- 172.21.15.144:0/301642181 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe72c1418f0 0x7fe72c15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.549+0000 7fe733400640 1 -- 172.21.15.144:0/301642181 >> 172.21.15.144:0/301642181 conn(0x7fe72c06bd00 msgr2=0x7fe72c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.549+0000 7fe733400640 1 -- 172.21.15.144:0/301642181 shutdown_connections 2024-05-30T16:53:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.549+0000 7fe733400640 1 -- 172.21.15.144:0/301642181 wait complete. 2024-05-30T16:53:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.551+0000 7fe733400640 1 Processor -- start 2024-05-30T16:53:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.551+0000 7fe733400640 1 -- start start 2024-05-30T16:53:46.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe733400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe72c141510 0x7fe72c133e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe733400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c1418f0 0x7fe72c161490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe733400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe72c144020 0x7fe72c1619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe733400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c144450 con 0x7fe72c1418f0 2024-05-30T16:53:46.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe733400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c06e210 con 0x7fe72c141510 2024-05-30T16:53:46.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe733400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe72c0b5b50 con 0x7fe72c144020 2024-05-30T16:53:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe723e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c1418f0 0x7fe72c161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe723e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c1418f0 0x7fe72c161490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37034/0 (socket says 172.21.15.144:37034) 2024-05-30T16:53:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe723e00640 1 -- 172.21.15.144:0/280631335 learned_addr learned my addr 172.21.15.144:0/280631335 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe731400640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe72c144020 0x7fe72c1619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe723e00640 1 -- 172.21.15.144:0/280631335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe72c144020 msgr2=0x7fe72c1619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe723e00640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe72c144020 0x7fe72c1619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe723e00640 1 -- 172.21.15.144:0/280631335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe72c141510 msgr2=0x7fe72c133e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe730a00640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe72c141510 0x7fe72c133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe723e00640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe72c141510 0x7fe72c133e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.552+0000 7fe723e00640 1 -- 172.21.15.144:0/280631335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c0b10a0 con 0x7fe72c1418f0 2024-05-30T16:53:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.553+0000 7fe730a00640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe72c141510 0x7fe72c133e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T16:53:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.553+0000 7fe723e00640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c1418f0 0x7fe72c161490 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b4d0 tx=0x7fe71400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.553+0000 7fe729600640 1 -- 172.21.15.144:0/280631335 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714014070 con 0x7fe72c1418f0 2024-05-30T16:53:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.553+0000 7fe729600640 1 -- 172.21.15.144:0/280631335 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe714010870 con 0x7fe72c1418f0 2024-05-30T16:53:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.553+0000 7fe729600640 1 -- 172.21.15.144:0/280631335 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714010c60 con 0x7fe72c1418f0 2024-05-30T16:53:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.553+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72c0b16b0 con 0x7fe72c1418f0 2024-05-30T16:53:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.553+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe72c0b1c70 con 0x7fe72c1418f0 2024-05-30T16:53:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.554+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72c0b14a0 con 0x7fe72c1418f0 2024-05-30T16:53:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.555+0000 7fe729600640 1 -- 172.21.15.144:0/280631335 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 33) ==== 92213+0+0 (secure 0 0 0) 0x7fe714017070 con 0x7fe72c1418f0 2024-05-30T16:53:46.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.556+0000 7fe729600640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70806d5e0 0x7fe70806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.556+0000 7fe729600640 1 -- 172.21.15.144:0/280631335 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fe71408a3e0 con 0x7fe72c1418f0 2024-05-30T16:53:46.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.556+0000 7fe730a00640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70806d5e0 0x7fe70806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.557+0000 7fe730a00640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70806d5e0 0x7fe70806faa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00a830 tx=0x7fe71c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:46.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.561+0000 7fe729600640 1 -- 172.21.15.144:0/280631335 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe71405a260 con 0x7fe72c1418f0 2024-05-30T16:53:46.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.759+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe72c068b90 con 0x7fe72c1418f0 2024-05-30T16:53:46.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.764+0000 7fe729600640 1 -- 172.21.15.144:0/280631335 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v20)=0 v20) ==== 123+0+0 (secure 0 0 0) 0x7fe714059b60 con 0x7fe72c1418f0 2024-05-30T16:53:46.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.766+0000 7fe729600640 1 -- 172.21.15.144:0/280631335 <== mon.0 v2:172.21.15.144:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe71405df10 con 0x7fe72c1418f0 2024-05-30T16:53:46.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70806d5e0 msgr2=0x7fe70806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70806d5e0 0x7fe70806faa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00a830 tx=0x7fe71c008040 comp rx=0 tx=0).stop 2024-05-30T16:53:46.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c1418f0 msgr2=0x7fe72c161490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c1418f0 0x7fe72c161490 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b4d0 tx=0x7fe71400b990 comp rx=0 tx=0).stop 2024-05-30T16:53:46.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 shutdown_connections 2024-05-30T16:53:46.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fe70806d5e0 0x7fe70806faa0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe72c144020 0x7fe72c1619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe72c1418f0 0x7fe72c161490 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 --2- 172.21.15.144:0/280631335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe72c141510 0x7fe72c133e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 >> 172.21.15.144:0/280631335 conn(0x7fe72c06bd00 msgr2=0x7fe72c0add70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:46.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 shutdown_connections 2024-05-30T16:53:46.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.768+0000 7fe733400640 1 -- 172.21.15.144:0/280631335 wait complete. 2024-05-30T16:53:46.787 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T16:53:46.788 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T16:53:46.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.983+0000 7fdf99800640 1 Processor -- start 2024-05-30T16:53:46.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.983+0000 7fdf99800640 1 -- start start 2024-05-30T16:53:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.985+0000 7fdf99800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf940cfc40 0x7fdf9406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.985+0000 7fdf99800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf9406f610 0x7fdf940b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.985+0000 7fdf99800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf940d00f0 con 0x7fdf94145150 2024-05-30T16:53:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.985+0000 7fdf99800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fdf9415f140 con 0x7fdf9406f610 2024-05-30T16:53:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.985+0000 7fdf99800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9415f390 con 0x7fdf940cfc40 2024-05-30T16:53:46.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.985+0000 7fdf93400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf9406f610 0x7fdf940b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.985+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf940cfc40 0x7fdf9406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.986+0000 7fdf93400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf9406f610 0x7fdf940b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.144:53690/0 (socket says 172.21.15.144:53690) 2024-05-30T16:53:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.986+0000 7fdf93400640 1 -- 172.21.15.144:0/1201545065 learned_addr learned my addr 172.21.15.144:0/1201545065 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.986+0000 7fdf93400640 1 -- 172.21.15.144:0/1201545065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf940cfc40 msgr2=0x7fdf9406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T16:53:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.986+0000 7fdf93400640 1 --2- 172.21.15.144:0/1201545065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf940cfc40 0x7fdf9406f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.986+0000 7fdf93400640 1 -- 172.21.15.144:0/1201545065 >> v1:172.21.15.149:6789/0 conn(0x7fdf94145150 legacy=0x7fdf940cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.986+0000 7fdf93400640 1 -- 172.21.15.144:0/1201545065 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9415f670 con 0x7fdf9406f610 2024-05-30T16:53:46.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.988+0000 7fdf93400640 1 --2- 172.21.15.144:0/1201545065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf9406f610 0x7fdf940b4930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009e50 tx=0x7fdf8c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae26e0ac3c3ddd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:46.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.988+0000 7fdf92000640 1 -- 172.21.15.144:0/1201545065 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c036070 con 0x7fdf9406f610 2024-05-30T16:53:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.988+0000 7fdf92000640 1 -- 172.21.15.144:0/1201545065 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdf8c031600 con 0x7fdf9406f610 2024-05-30T16:53:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.988+0000 7fdf92000640 1 -- 172.21.15.144:0/1201545065 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0319f0 con 0x7fdf9406f610 2024-05-30T16:53:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.989+0000 7fdf99800640 1 -- 172.21.15.144:0/1201545065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf9406f610 msgr2=0x7fdf940b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.989+0000 7fdf99800640 1 --2- 172.21.15.144:0/1201545065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf9406f610 0x7fdf940b4930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009e50 tx=0x7fdf8c02a680 comp rx=0 tx=0).stop 2024-05-30T16:53:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.989+0000 7fdf99800640 1 -- 172.21.15.144:0/1201545065 shutdown_connections 2024-05-30T16:53:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.989+0000 7fdf99800640 1 --2- 172.21.15.144:0/1201545065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf9406f610 0x7fdf940b4930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.989+0000 7fdf99800640 1 --2- 172.21.15.144:0/1201545065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf940cfc40 0x7fdf9406f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.989+0000 7fdf99800640 1 -- 172.21.15.144:0/1201545065 >> 172.21.15.144:0/1201545065 conn(0x7fdf9406bd00 msgr2=0x7fdf9406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.989+0000 7fdf99800640 1 -- 172.21.15.144:0/1201545065 shutdown_connections 2024-05-30T16:53:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.989+0000 7fdf99800640 1 -- 172.21.15.144:0/1201545065 wait complete. 2024-05-30T16:53:46.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.991+0000 7fdf99800640 1 Processor -- start 2024-05-30T16:53:46.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.991+0000 7fdf99800640 1 -- start start 2024-05-30T16:53:46.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.992+0000 7fdf99800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf9406f610 0x7fdf9415b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.992+0000 7fdf99800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf940cfc40 0x7fdf94165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.992+0000 7fdf99800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf94145150 0x7fdf94166430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.992+0000 7fdf99800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9415fe70 con 0x7fdf94145150 2024-05-30T16:53:46.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.992+0000 7fdf99800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940b64f0 con 0x7fdf940cfc40 2024-05-30T16:53:46.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.992+0000 7fdf99800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9415fff0 con 0x7fdf9406f610 2024-05-30T16:53:46.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.992+0000 7fdf93400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf94145150 0x7fdf94166430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.992+0000 7fdf93400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf94145150 0x7fdf94166430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37038/0 (socket says 172.21.15.144:37038) 2024-05-30T16:53:46.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.993+0000 7fdf93400640 1 -- 172.21.15.144:0/318488909 learned_addr learned my addr 172.21.15.144:0/318488909 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-05-30T16:53:46.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.993+0000 7fdf92a00640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf9406f610 0x7fdf9415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.993+0000 7fdf8be00640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf940cfc40 0x7fdf94165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.993+0000 7fdf93400640 1 -- 172.21.15.144:0/318488909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf9406f610 msgr2=0x7fdf9415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.993+0000 7fdf93400640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf9406f610 0x7fdf9415b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.993+0000 7fdf93400640 1 -- 172.21.15.144:0/318488909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf940cfc40 msgr2=0x7fdf94165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:46.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.993+0000 7fdf93400640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf940cfc40 0x7fdf94165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:46.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.993+0000 7fdf93400640 1 -- 172.21.15.144:0/318488909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9415d660 con 0x7fdf94145150 2024-05-30T16:53:46.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.993+0000 7fdf93400640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf94145150 0x7fdf94166430 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c034040 tx=0x7fdf8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:46.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.994+0000 7fdf8aa00640 1 -- 172.21.15.144:0/318488909 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c03f020 con 0x7fdf94145150 2024-05-30T16:53:46.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.994+0000 7fdf8aa00640 1 -- 172.21.15.144:0/318488909 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdf8c037040 con 0x7fdf94145150 2024-05-30T16:53:46.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.994+0000 7fdf8aa00640 1 -- 172.21.15.144:0/318488909 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c036070 con 0x7fdf94145150 2024-05-30T16:53:46.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.994+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9415cae0 con 0x7fdf94145150 2024-05-30T16:53:46.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.994+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9415d0a0 con 0x7fdf94145150 2024-05-30T16:53:46.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.995+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf9413e250 con 0x7fdf94145150 2024-05-30T16:53:46.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.996+0000 7fdf8aa00640 1 -- 172.21.15.144:0/318488909 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 33) ==== 92213+0+0 (secure 0 0 0) 0x7fdf8c042020 con 0x7fdf94145150 2024-05-30T16:53:46.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.997+0000 7fdf8aa00640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdf7006d5e0 0x7fdf7006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T16:53:46.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.997+0000 7fdf8aa00640 1 -- 172.21.15.144:0/318488909 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5795+0+0 (secure 0 0 0) 0x7fdf8c0aaaf0 con 0x7fdf94145150 2024-05-30T16:53:46.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.997+0000 7fdf92a00640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdf7006d5e0 0x7fdf7006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T16:53:46.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:46.998+0000 7fdf92a00640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdf7006d5e0 0x7fdf7006faa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdf84007fd0 tx=0x7fdf84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T16:53:47.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.001+0000 7fdf8aa00640 1 -- 172.21.15.144:0/318488909 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdf9413e250 con 0x7fdf94145150 2024-05-30T16:53:47.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.239+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf94068b90 con 0x7fdf94145150 2024-05-30T16:53:47.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.240+0000 7fdf8aa00640 1 -- 172.21.15.144:0/318488909 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5195 (secure 0 0 0) 0x7fdf8c049030 con 0x7fdf94145150 2024-05-30T16:53:47.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-05-30T16:53:47.242 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2114834818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2114834818},{"type":"v1","addr":"172.21.15.149:6835","nonce":2114834818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6435,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1242312372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1242312372},{"type":"v1","addr":"172.21.15.144:6835","nonce":1242312372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3989377290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3989377290},{"type":"v1","addr":"172.21.15.144:6837","nonce":3989377290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T16:50:00.647053+0000","modified":"2024-05-30T16:50:03.707309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6833/1951637959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1951637959},{"type":"v1","addr":"172.21.15.149:6833","nonce":1951637959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6447,"qdb_cluster":[6447]},"id":5}]} 2024-05-30T16:53:47.242 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-05-30T16:53:47.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.242+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdf7006d5e0 msgr2=0x7fdf7006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdf7006d5e0 0x7fdf7006faa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdf84007fd0 tx=0x7fdf84009040 comp rx=0 tx=0).stop 2024-05-30T16:53:47.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf94145150 msgr2=0x7fdf94166430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T16:53:47.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf94145150 0x7fdf94166430 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c034040 tx=0x7fdf8c004a40 comp rx=0 tx=0).stop 2024-05-30T16:53:47.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 shutdown_connections 2024-05-30T16:53:47.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:6832/2157301613,v1:172.21.15.144:6833/2157301613] conn(0x7fdf7006d5e0 0x7fdf7006faa0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf94145150 0x7fdf94166430 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf940cfc40 0x7fdf94165ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 --2- 172.21.15.144:0/318488909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf9406f610 0x7fdf9415b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T16:53:47.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 >> 172.21.15.144:0/318488909 conn(0x7fdf9406bd00 msgr2=0x7fdf9406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T16:53:47.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 shutdown_connections 2024-05-30T16:53:47.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-05-30T16:53:47.243+0000 7fdf99800640 1 -- 172.21.15.144:0/318488909 wait complete. 2024-05-30T16:53:47.263 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-30T16:53:47.263 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-30T16:53:47.264 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T16:53:47.264 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:53:47.280 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T16:53:47.281 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T16:53:47.281 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:53:47.350 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T16:53:47.350 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T16:53:47.350 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:53:47.395 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T16:53:47.396 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T16:53:47.396 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:53:47.425 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T16:53:47.425 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-30T16:53:47.426 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-30T16:53:47.426 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:53:49.034 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:53:49.042 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:53:51.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-30T16:53:53.527 INFO:tasks.ceph.osd.0:Stopped 2024-05-30T16:53:53.528 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-30T16:53:53.528 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:53:53.611 INFO:tasks.ceph.osd.1:Stopped 2024-05-30T16:53:53.611 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-30T16:53:53.611 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:53:53.705 INFO:tasks.ceph.osd.2:Stopped 2024-05-30T16:53:53.706 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-30T16:53:53.706 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:53:57.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-30T16:53:57.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-30T16:53:59.808 INFO:tasks.ceph.osd.3:Stopped 2024-05-30T16:53:59.809 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-30T16:53:59.809 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:53:59.904 INFO:tasks.ceph.osd.4:Stopped 2024-05-30T16:53:59.904 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-30T16:53:59.904 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:02.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-30T16:54:02.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-30T16:54:06.006 INFO:tasks.ceph.osd.5:Stopped 2024-05-30T16:54:06.006 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-30T16:54:06.006 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:06.107 INFO:tasks.ceph.osd.6:Stopped 2024-05-30T16:54:06.107 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-30T16:54:06.107 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:08.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-30T16:54:08.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-30T16:54:12.209 INFO:tasks.ceph.osd.7:Stopped 2024-05-30T16:54:12.209 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-30T16:54:12.210 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-30T16:54:12.210 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:13.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-05-30T16:54:13.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-30T16:54:18.312 INFO:tasks.ceph.mgr.y:Stopped 2024-05-30T16:54:18.313 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-30T16:54:18.313 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:18.397 INFO:tasks.ceph.mgr.x:Stopped 2024-05-30T16:54:18.398 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-30T16:54:18.398 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-30T16:54:18.398 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:18.450 INFO:tasks.ceph.mon.a:Stopped 2024-05-30T16:54:18.451 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-30T16:54:18.451 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:18.493 INFO:tasks.ceph.mon.b:Stopped 2024-05-30T16:54:18.494 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-30T16:54:18.494 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T16:54:18.529 INFO:tasks.ceph.mon.c:Stopped 2024-05-30T16:54:18.529 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-30T16:54:18.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-05-30T16:54:18.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-05-30T16:54:18.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:54:18.642 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-30T16:54:18.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:54:18.920 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-30T16:54:19.095 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:54:19.096 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-30T16:54:19.261 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:54:19.262 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-30T16:54:19.366 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:19.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:19.434 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:54:19.435 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-30T16:54:19.711 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:54:19.711 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-30T16:54:19.887 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:54:19.888 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-30T16:54:20.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:54:20.044 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-30T16:54:20.227 INFO:tasks.ceph:Archiving mon data... 2024-05-30T16:54:20.228 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/data/mon.a.tgz 2024-05-30T16:54:20.229 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-05-30T16:54:20.287 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.EtIkE2n33G 2024-05-30T16:54:20.287 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.EtIkE2n33G 2024-05-30T16:54:20.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.EtIkE2n33G 2024-05-30T16:54:20.725 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.EtIkE2n33G is 1MB 2024-05-30T16:54:20.846 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.EtIkE2n33G 2024-05-30T16:54:20.903 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/data/mon.b.tgz 2024-05-30T16:54:20.903 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-05-30T16:54:20.959 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.7WSJMvUFJi 2024-05-30T16:54:20.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7WSJMvUFJi 2024-05-30T16:54:21.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.7WSJMvUFJi 2024-05-30T16:54:21.400 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.7WSJMvUFJi is 1MB 2024-05-30T16:54:21.520 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.7WSJMvUFJi 2024-05-30T16:54:21.579 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/data/mon.c.tgz 2024-05-30T16:54:21.579 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-05-30T16:54:21.629 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.m7ptgiiy1j 2024-05-30T16:54:21.629 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.m7ptgiiy1j 2024-05-30T16:54:21.922 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.m7ptgiiy1j 2024-05-30T16:54:22.057 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.m7ptgiiy1j is 1MB 2024-05-30T16:54:22.175 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.m7ptgiiy1j 2024-05-30T16:54:22.232 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-30T16:54:22.232 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-30T16:54:22.240 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-30T16:54:22.379 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-30T16:54:22.437 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-30T16:54:22.437 INFO:tasks.ceph:Archiving crash dumps... 2024-05-30T16:54:22.439 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/remote/smithi144/crash 2024-05-30T16:54:22.440 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-30T16:54:22.527 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/remote/smithi149/crash 2024-05-30T16:54:22.528 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-30T16:54:22.614 INFO:tasks.ceph:Shutting down logrotate 2024-05-30T16:54:22.614 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:22.622 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:22.756 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:22.843 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-30T16:54:22.933 INFO:tasks.ceph:Compressing logs... 2024-05-30T16:54:22.933 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-30T16:54:22.941 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-30T16:54:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63611.log 2024-05-30T16:54:23.019 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44303.log 2024-05-30T16:54:23.020 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63611.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63611.log.gz 2024-05-30T16:54:23.020 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59357.log 2024-05-30T16:54:23.021 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37372.log 2024-05-30T16:54:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50117.log 2024-05-30T16:54:23.022 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44303.log.gz 2024-05-30T16:54:23.023 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-30T16:54:23.023 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2024-05-30T16:54:23.023 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59357.log.gz 2024-05-30T16:54:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.37372.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-30T16:54:23.025 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37372.log.gz 2024-05-30T16:54:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-30T16:54:23.026 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55386.log 2024-05-30T16:54:23.026 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50117.log.gz 2024-05-30T16:54:23.026 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55302.log 2024-05-30T16:54:23.026 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2024-05-30T16:54:23.027 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2024-05-30T16:54:23.027 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55386.log.gz 2024-05-30T16:54:23.029 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47156.log 2024-05-30T16:54:23.029 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55302.log.gz 2024-05-30T16:54:23.029 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54398.log 2024-05-30T16:54:23.029 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2024-05-30T16:54:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-30T16:54:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37283.log 2024-05-30T16:54:23.030 INFO:teuthology.orchestra.run.smithi149.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-30T16:54:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-30T16:54:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.37283.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37283.log.gz 2024-05-30T16:54:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-30T16:54:23.031 INFO:teuthology.orchestra.run.smithi149.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-30T16:54:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-30T16:54:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-30T16:54:23.033 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47156.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47156.log.gz 2024-05-30T16:54:23.033 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54440.log 2024-05-30T16:54:23.034 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54398.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54398.log.gz 2024-05-30T16:54:23.034 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53416.log 2024-05-30T16:54:23.034 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43207.log 2024-05-30T16:54:23.034 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54440.log.gz 2024-05-30T16:54:23.034 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46257.log 2024-05-30T16:54:23.034 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53416.log.gz 2024-05-30T16:54:23.034 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49070.log 2024-05-30T16:54:23.035 INFO:teuthology.orchestra.run.smithi144.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43207.log.gz 2024-05-30T16:54:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-30T16:54:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37492.log 2024-05-30T16:54:23.037 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46257.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46257.log.gz -- 2024-05-30T16:54:23.038 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-client.admin.56568.log 2024-05-30T16:54:23.038 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54661.log 2024-05-30T16:54:23.038 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49070.log.gz 2024-05-30T16:54:23.038 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58717.log 2024-05-30T16:54:23.038 INFO:teuthology.orchestra.run.smithi144.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56568.log.gz 2024-05-30T16:54:23.038 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54661.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54661.log.gz 2024-05-30T16:54:23.039 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46215.log 2024-05-30T16:54:23.042 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60706.log 2024-05-30T16:54:23.042 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58717.log.gz 2024-05-30T16:54:23.042 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46215.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46215.log.gz 2024-05-30T16:54:23.042 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49991.log 2024-05-30T16:54:23.043 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60706.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60706.log.gz 2024-05-30T16:54:23.043 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36791.log 2024-05-30T16:54:23.043 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61121.log 2024-05-30T16:54:23.043 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49991.log.gz 2024-05-30T16:54:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.37492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43341.log 2024-05-30T16:54:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.3.43341.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37492.log.gz 2024-05-30T16:54:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37532.log 2024-05-30T16:54:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37332.log 2024-05-30T16:54:23.046 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61500.log 2024-05-30T16:54:23.046 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36791.log.gz 2024-05-30T16:54:23.046 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57399.log 2024-05-30T16:54:23.046 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61121.log.gz 2024-05-30T16:54:23.046 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57801.log 2024-05-30T16:54:23.046 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61500.log.gz 2024-05-30T16:54:23.047 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45013.log 2024-05-30T16:54:23.047 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57399.log.gz 2024-05-30T16:54:23.047 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% 94.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-30T16:54:23.048 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57801.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57801.log.gz 2024-05-30T16:54:23.049 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42302.log 2024-05-30T16:54:23.049 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53020.log 2024-05-30T16:54:23.049 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45013.log.gz 2024-05-30T16:54:23.051 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42302.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42302.log.gz 2024-05-30T16:54:23.052 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46942.log 2024-05-30T16:54:23.052 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53020.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53020.log.gz 2024-05-30T16:54:23.052 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60588.log 2024-05-30T16:54:23.052 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43043.log 2024-05-30T16:54:23.052 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46942.log.gz 2024-05-30T16:54:23.053 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.37332.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37332.log.gz 2024-05-30T16:54:23.053 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42926.log 2024-05-30T16:54:23.054 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.37532.log: -- replaced with /var/log/ceph/ceph-client.3.43341.log.gz 2024-05-30T16:54:23.054 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37532.log.gz 2024-05-30T16:54:23.054 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37241.log 2024-05-30T16:54:23.054 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.42926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42926.log.gz 2024-05-30T16:54:23.055 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37452.log 2024-05-30T16:54:23.055 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.37241.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37241.log.gz 2024-05-30T16:54:23.055 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37412.log 2024-05-30T16:54:23.061 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.37452.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37452.log.gz 2024-05-30T16:54:23.061 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-30T16:54:23.061 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.37412.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37412.log.gz 2024-05-30T16:54:23.062 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-30T16:54:23.063 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-30T16:54:23.065 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46341.log 2024-05-30T16:54:23.065 INFO:teuthology.orchestra.run.smithi144.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.60588.log.gz 2024-05-30T16:54:23.065 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43043.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43043.log.gz 2024-05-30T16:54:23.065 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45763.log 2024-05-30T16:54:23.065 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46341.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46341.log.gz 2024-05-30T16:54:23.065 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57087.log 2024-05-30T16:54:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54482.log 2024-05-30T16:54:23.066 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45763.log.gz 2024-05-30T16:54:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60773.log 2024-05-30T16:54:23.066 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57087.log.gz 2024-05-30T16:54:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54482.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54482.log.gz 2024-05-30T16:54:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53983.log 2024-05-30T16:54:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63703.log 2024-05-30T16:54:23.067 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60773.log.gz 2024-05-30T16:54:23.067 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51123.log 2024-05-30T16:54:23.067 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53983.log.gz 2024-05-30T16:54:23.067 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2024-05-30T16:54:23.067 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63703.log.gz 2024-05-30T16:54:23.067 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51123.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51123.log.gz 2024-05-30T16:54:23.067 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44177.log 2024-05-30T16:54:23.067 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47702.log 2024-05-30T16:54:23.068 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz 2024-05-30T16:54:23.068 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59231.log 2024-05-30T16:54:23.068 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44177.log.gz 2024-05-30T16:54:23.068 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47702.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47702.log.gz 2024-05-30T16:54:23.068 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51165.log 2024-05-30T16:54:23.069 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45511.log 2024-05-30T16:54:23.070 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59231.log.gz 2024-05-30T16:54:23.070 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51165.log: gzip -5 87.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.51165.log.gz -- 2024-05-30T16:54:23.070 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-client.admin.53206.log 2024-05-30T16:54:23.070 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54566.log 2024-05-30T16:54:23.070 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45511.log.gz 2024-05-30T16:54:23.070 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47240.log 2024-05-30T16:54:23.070 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53206.log.gz 2024-05-30T16:54:23.071 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63523.log 2024-05-30T16:54:23.071 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54566.log.gz 2024-05-30T16:54:23.071 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37057.log 2024-05-30T16:54:23.072 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47240.log.gz 2024-05-30T16:54:23.072 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63523.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63523.log.gz 2024-05-30T16:54:23.072 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60630.log 2024-05-30T16:54:23.073 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44525.log 87.3% 2024-05-30T16:54:23.073 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37057.log.gz 2024-05-30T16:54:23.074 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44219.log 2024-05-30T16:54:23.075 INFO:teuthology.orchestra.run.smithi144.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60630.log.gz 2024-05-30T16:54:23.075 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44525.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2024-05-30T16:54:23.075 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-05-30T16:54:23.076 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54151.log 2024-05-30T16:54:23.077 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44219.log.gz 2024-05-30T16:54:23.077 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43225.log 2024-05-30T16:54:23.078 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2024-05-30T16:54:23.079 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48944.log 2024-05-30T16:54:23.079 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54151.log.gz 2024-05-30T16:54:23.080 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43225.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43225.log.gz 2024-05-30T16:54:23.080 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53332.log 2024-05-30T16:54:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55344.log 2024-05-30T16:54:23.081 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48944.log.gz 2024-05-30T16:54:23.082 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62868.log 2024-05-30T16:54:23.082 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53332.log.gz 2024-05-30T16:54:23.083 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55344.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-30T16:54:23.083 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55344.log.gz 2024-05-30T16:54:23.084 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54314.log 2024-05-30T16:54:23.084 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62868.log.gz 2024-05-30T16:54:23.085 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-05-30T16:54:23.086 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50075.log 2024-05-30T16:54:23.086 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54314.log.gz 2024-05-30T16:54:23.087 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43222.log: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-30T16:54:23.087 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-05-30T16:54:23.087 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60429.log 2024-05-30T16:54:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64393.log 2024-05-30T16:54:23.088 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50075.log.gz 2024-05-30T16:54:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60429.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60429.log.gz 2024-05-30T16:54:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62658.log 2024-05-30T16:54:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64393.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64393.log.gz -5 2024-05-30T16:54:23.091 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62257.log 2024-05-30T16:54:23.092 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49697.log 2024-05-30T16:54:23.092 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62658.log.gz 2024-05-30T16:54:23.093 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55130.log 86.8% 2024-05-30T16:54:23.093 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62257.log.gz 2024-05-30T16:54:23.094 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58549.log 2024-05-30T16:54:23.094 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49697.log.gz 2024-05-30T16:54:23.095 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62134.log 87.5% 2024-05-30T16:54:23.095 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55130.log.gz 2024-05-30T16:54:23.096 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2024-05-30T16:54:23.096 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58549.log.gz 2024-05-30T16:54:23.097 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49949.log 2024-05-30T16:54:23.097 INFO:teuthology.orchestra.run.smithi144.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.62134.log.gz 2024-05-30T16:54:23.098 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51750.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2024-05-30T16:54:23.098 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52785.log 2024-05-30T16:54:23.099 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42512.log 2024-05-30T16:54:23.099 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49949.log.gz 2024-05-30T16:54:23.100 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58507.log 2024-05-30T16:54:23.100 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52785.log.gz 2024-05-30T16:54:23.101 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58134.log 2024-05-30T16:54:23.101 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42512.log.gz 2024-05-30T16:54:23.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58507.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58507.log.gz 2024-05-30T16:54:23.102 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46900.log 2024-05-30T16:54:23.103 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49823.log 2024-05-30T16:54:23.103 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58134.log.gz 2024-05-30T16:54:23.104 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46900.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46900.log.gz 2024-05-30T16:54:23.104 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52894.log 2024-05-30T16:54:23.105 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49823.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49823.log.gz 2024-05-30T16:54:23.106 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50849.log 2024-05-30T16:54:23.107 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52894.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-30T16:54:23.107 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52894.log.gz 2024-05-30T16:54:23.108 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47026.log 2024-05-30T16:54:23.108 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50849.log.gz 2024-05-30T16:54:23.109 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63096.log 2024-05-30T16:54:23.110 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61789.log 2024-05-30T16:54:23.110 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47026.log.gz 2024-05-30T16:54:23.111 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63096.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63096.log.gz 2024-05-30T16:54:23.111 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42649.log 2024-05-30T16:54:23.112 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2024-05-30T16:54:23.113 INFO:teuthology.orchestra.run.smithi144.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.61789.log.gz 2024-05-30T16:54:23.113 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58759.log 2024-05-30T16:54:23.113 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42649.log.gz 2024-05-30T16:54:23.114 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49424.log 2024-05-30T16:54:23.115 INFO:teuthology.orchestra.run.smithi144.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2024-05-30T16:54:23.115 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58759.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58759.log.gz 2024-05-30T16:54:23.115 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49154.log 2024-05-30T16:54:23.116 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47112.log 2024-05-30T16:54:23.117 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49424.log.gz 2024-05-30T16:54:23.117 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55803.log 2024-05-30T16:54:23.117 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49154.log.gz 2024-05-30T16:54:23.118 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55046.log 2024-05-30T16:54:23.119 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47112.log.gz 2024-05-30T16:54:23.119 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57998.log 2024-05-30T16:54:23.119 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55803.log.gz 2024-05-30T16:54:23.120 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59483.log 2024-05-30T16:54:23.121 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55046.log.gz 2024-05-30T16:54:23.121 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46299.log 2024-05-30T16:54:23.122 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57998.log.gz 2024-05-30T16:54:23.122 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61205.log 2024-05-30T16:54:23.123 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59483.log.gz 2024-05-30T16:54:23.123 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49490.log 2024-05-30T16:54:23.124 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46299.log.gz 2024-05-30T16:54:23.124 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61205.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61205.log.gz 2024-05-30T16:54:23.125 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62826.log 2024-05-30T16:54:23.125 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46173.log 2024-05-30T16:54:23.126 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49490.log.gz 2024-05-30T16:54:23.126 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48559.log 2024-05-30T16:54:23.126 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62826.log.gz 2024-05-30T16:54:23.127 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49603.log 2024-05-30T16:54:23.127 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46173.log.gz 2024-05-30T16:54:23.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-05-30T16:54:23.128 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48559.log.gz 2024-05-30T16:54:23.129 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42468.log 2024-05-30T16:54:23.129 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49603.log.gz 2024-05-30T16:54:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45595.log 2024-05-30T16:54:23.131 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-05-30T16:54:23.131 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61037.log 88.3% 2024-05-30T16:54:23.131 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42468.log.gz 2024-05-30T16:54:23.132 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55887.log 2024-05-30T16:54:23.132 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45595.log.gz 2024-05-30T16:54:23.133 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64207.log 2024-05-30T16:54:23.133 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61037.log.gz 2024-05-30T16:54:23.134 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43554.log 2024-05-30T16:54:23.134 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55887.log.gz 2024-05-30T16:54:23.135 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51834.log 2024-05-30T16:54:23.135 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64207.log.gz 2024-05-30T16:54:23.136 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51417.log 2024-05-30T16:54:23.136 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43554.log.gz 2024-05-30T16:54:23.137 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57885.log 2024-05-30T16:54:23.137 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51834.log.gz 2024-05-30T16:54:23.138 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58675.log 2024-05-30T16:54:23.139 INFO:teuthology.orchestra.run.smithi144.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51417.log.gz 2024-05-30T16:54:23.139 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62574.log 2024-05-30T16:54:23.139 INFO:teuthology.orchestra.run.smithi144.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57885.log.gz 2024-05-30T16:54:23.140 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58675.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-30T16:54:23.141 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58675.log.gz 2024-05-30T16:54:23.141 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57843.log 2024-05-30T16:54:23.141 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62574.log.gz 2024-05-30T16:54:23.142 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56610.log 2024-05-30T16:54:23.143 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48800.log 2024-05-30T16:54:23.143 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57843.log.gz 2024-05-30T16:54:23.144 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62490.log 2024-05-30T16:54:23.144 INFO:teuthology.orchestra.run.smithi144.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-30T16:54:23.144 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56610.log.gz 2024-05-30T16:54:23.145 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53692.log 2024-05-30T16:54:23.145 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48800.log.gz 2024-05-30T16:54:23.146 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59057.log 2024-05-30T16:54:23.146 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62490.log.gz 2024-05-30T16:54:23.147 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57633.log 2024-05-30T16:54:23.147 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53692.log.gz 2024-05-30T16:54:23.148 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59735.log 2024-05-30T16:54:23.148 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59057.log.gz 2024-05-30T16:54:23.149 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57633.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57633.log.gz 2024-05-30T16:54:23.149 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57591.log 2024-05-30T16:54:23.150 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55929.log 2024-05-30T16:54:23.150 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59735.log.gz 2024-05-30T16:54:23.151 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56970.log 2024-05-30T16:54:23.151 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57591.log.gz 2024-05-30T16:54:23.152 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54356.log 2024-05-30T16:54:23.152 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55929.log.gz 2024-05-30T16:54:23.153 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56970.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56970.log.gz 2024-05-30T16:54:23.153 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2024-05-30T16:54:23.154 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50201.log 2024-05-30T16:54:23.154 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54356.log.gz 2024-05-30T16:54:23.155 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60953.log 2024-05-30T16:54:23.155 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2024-05-30T16:54:23.156 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-05-30T16:54:23.156 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50201.log.gz 2024-05-30T16:54:23.157 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60953.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60953.log.gz 2024-05-30T16:54:23.157 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61415.log 2024-05-30T16:54:23.158 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46984.log 2024-05-30T16:54:23.158 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-05-30T16:54:23.159 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46570.log 2024-05-30T16:54:23.159 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61415.log.gz 2024-05-30T16:54:23.160 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62784.log 2024-05-30T16:54:23.160 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46984.log.gz 2024-05-30T16:54:23.161 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46570.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46570.log.gz 2024-05-30T16:54:23.161 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51792.log 2024-05-30T16:54:23.162 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43553.log 2024-05-30T16:54:23.162 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62784.log.gz 2024-05-30T16:54:23.163 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45553.log 2024-05-30T16:54:23.163 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51792.log.gz 2024-05-30T16:54:23.164 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52743.log 2024-05-30T16:54:23.164 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43553.log.gz 2024-05-30T16:54:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45553.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45553.log.gz 2024-05-30T16:54:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50327.log 2024-05-30T16:54:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52743.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-30T16:54:23.167 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52743.log.gz 2024-05-30T16:54:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51671.log 2024-05-30T16:54:23.167 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50327.log.gz 2024-05-30T16:54:23.168 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48053.log 2024-05-30T16:54:23.169 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.51671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51671.log.gz 2024-05-30T16:54:23.169 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2024-05-30T16:54:23.170 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59777.log 2024-05-30T16:54:23.171 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48053.log.gz 2024-05-30T16:54:23.171 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50937.log 2024-05-30T16:54:23.172 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2024-05-30T16:54:23.173 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59777.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59777.log.gz 2024-05-30T16:54:23.173 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62339.log 2024-05-30T16:54:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52852.log 2024-05-30T16:54:23.174 INFO:teuthology.orchestra.run.smithi144.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50937.log.gz 2024-05-30T16:54:23.175 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62339.log: gzip -5 --verbose 87.9% -- -- replaced with /var/log/ceph/ceph-client.admin.62339.log.gz /var/log/ceph/ceph-client.admin.62004.log 2024-05-30T16:54:23.175 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-05-30T16:54:23.176 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62970.log 2024-05-30T16:54:23.176 INFO:teuthology.orchestra.run.smithi144.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52852.log.gz 2024-05-30T16:54:23.177 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61556.log 2024-05-30T16:54:23.177 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62004.log.gz 2024-05-30T16:54:23.178 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58414.log 2024-05-30T16:54:23.178 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62970.log.gz 2024-05-30T16:54:23.179 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47068.log 2024-05-30T16:54:23.179 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61556.log.gz 2024-05-30T16:54:23.180 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37159.log 2024-05-30T16:54:23.180 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58414.log.gz 2024-05-30T16:54:23.181 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47068.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47068.log.gz 2024-05-30T16:54:23.181 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49382.log 2024-05-30T16:54:23.182 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54823.log 2024-05-30T16:54:23.182 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37159.log.gz 2024-05-30T16:54:23.183 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53374.log 2024-05-30T16:54:23.183 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49382.log.gz 2024-05-30T16:54:23.184 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64435.log 2024-05-30T16:54:23.184 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54823.log.gz 2024-05-30T16:54:23.185 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60195.log 2024-05-30T16:54:23.185 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53374.log.gz 2024-05-30T16:54:23.186 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64435.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.64435.log.gz -5 2024-05-30T16:54:23.186 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57315.log 2024-05-30T16:54:23.187 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60195.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60195.log.gz 2024-05-30T16:54:23.187 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48860.log 2024-05-30T16:54:23.188 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59315.log 2024-05-30T16:54:23.188 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57315.log.gz 2024-05-30T16:54:23.189 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48860.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.48860.log.gz 2024-05-30T16:54:23.189 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45874.log 2024-05-30T16:54:23.190 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61289.log 2024-05-30T16:54:23.190 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59315.log.gz 2024-05-30T16:54:23.191 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45874.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-30T16:54:23.191 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45874.log.gz 2024-05-30T16:54:23.192 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61842.log 2024-05-30T16:54:23.193 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61289.log.gz 2024-05-30T16:54:23.194 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42916.log 2024-05-30T16:54:23.195 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61842.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.61842.log.gz 2024-05-30T16:54:23.195 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48095.log 2024-05-30T16:54:23.196 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61079.log 2024-05-30T16:54:23.197 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42916.log: /var/log/ceph/ceph-client.admin.48095.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42916.log.gz 2024-05-30T16:54:23.198 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64249.log 2024-05-30T16:54:23.198 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48095.log.gz 2024-05-30T16:54:23.199 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61079.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61079.log.gz 2024-05-30T16:54:23.199 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42822.log 2024-05-30T16:54:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51930.log 2024-05-30T16:54:23.201 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64249.log: /var/log/ceph/ceph-client.admin.42822.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64249.log.gz 2024-05-30T16:54:23.201 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42822.log.gz 2024-05-30T16:54:23.201 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46650.log 2024-05-30T16:54:23.202 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48986.log 2024-05-30T16:54:23.203 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51930.log.gz 2024-05-30T16:54:23.204 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61247.log 2024-05-30T16:54:23.204 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46650.log.gz 2024-05-30T16:54:23.205 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48986.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-30T16:54:23.205 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48986.log.gz 2024-05-30T16:54:23.206 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61247.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-30T16:54:23.206 INFO:teuthology.orchestra.run.smithi144.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61247.log.gz 2024-05-30T16:54:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61620.log 2024-05-30T16:54:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46858.log 2024-05-30T16:54:23.210 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64165.log 2024-05-30T16:54:23.210 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61620.log.gz 2024-05-30T16:54:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42096.log 2024-05-30T16:54:23.212 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46858.log.gz 2024-05-30T16:54:23.213 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59651.log 2024-05-30T16:54:23.213 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64165.log.gz 2024-05-30T16:54:23.214 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42096.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42096.log.gz 2024-05-30T16:54:23.214 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-client.admin.43801.log 2024-05-30T16:54:23.216 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59651.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58218.log 2024-05-30T16:54:23.216 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59651.log.gz 2024-05-30T16:54:23.217 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64517.log 2024-05-30T16:54:23.217 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43801.log.gz 2024-05-30T16:54:23.218 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58218.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58218.log.gz 2024-05-30T16:54:23.219 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47510.log 2024-05-30T16:54:23.220 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64517.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64517.log.gz 2024-05-30T16:54:23.221 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45451.log 2024-05-30T16:54:23.222 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47510.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-30T16:54:23.222 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47510.log.gz 2024-05-30T16:54:23.223 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49907.log 2024-05-30T16:54:23.223 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45451.log.gz 2024-05-30T16:54:23.225 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50979.log 2024-05-30T16:54:23.226 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49907.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49907.log.gz 2024-05-30T16:54:23.227 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50979.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50979.log.gz 2024-05-30T16:54:23.227 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59820.log 2024-05-30T16:54:23.229 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48151.log 2024-05-30T16:54:23.231 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59820.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59820.log.gz 2024-05-30T16:54:23.232 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48151.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48151.log.gz 2024-05-30T16:54:23.232 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60839.log 2024-05-30T16:54:23.234 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60116.log 2024-05-30T16:54:23.235 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60839.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60839.log.gz 2024-05-30T16:54:23.236 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.60116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60116.log.gz 2024-05-30T16:54:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62616.log 2024-05-30T16:54:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43919.log 2024-05-30T16:54:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62616.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62616.log.gz 2024-05-30T16:54:23.241 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43919.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43919.log.gz 2024-05-30T16:54:23.241 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48691.log 2024-05-30T16:54:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62216.log 2024-05-30T16:54:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48691.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48691.log.gz 2024-05-30T16:54:23.246 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62216.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.62216.log.gz 2024-05-30T16:54:23.246 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54067.log 2024-05-30T16:54:23.248 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58260.log 2024-05-30T16:54:23.249 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54067.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54067.log.gz 2024-05-30T16:54:23.251 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58260.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58260.log.gz 2024-05-30T16:54:23.251 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53805.log 2024-05-30T16:54:23.253 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44261.log 2024-05-30T16:54:23.254 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53805.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53805.log.gz 2024-05-30T16:54:23.255 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44261.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44261.log.gz 2024-05-30T16:54:23.256 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55428.log 2024-05-30T16:54:23.257 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49781.log 2024-05-30T16:54:23.259 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55428.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55428.log.gz 2024-05-30T16:54:23.260 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49781.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49781.log.gz 2024-05-30T16:54:23.261 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60995.log 2024-05-30T16:54:23.262 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46773.log 2024-05-30T16:54:23.264 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60995.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60995.log.gz 2024-05-30T16:54:23.265 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46773.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46773.log.gz 2024-05-30T16:54:23.265 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60279.log 2024-05-30T16:54:23.267 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61457.log 2024-05-30T16:54:23.269 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60279.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60279.log.gz 2024-05-30T16:54:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62298.log 2024-05-30T16:54:23.270 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61457.log.gz 2024-05-30T16:54:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47969.log 2024-05-30T16:54:23.273 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62298.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.62298.log.gz 2024-05-30T16:54:23.273 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47198.log 2024-05-30T16:54:23.275 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47969.log: 88.2%gzip -5/var/log/ceph/ceph-client.admin.47198.log: --verbose -- /var/log/ceph/ceph-client.admin.42206.log 2024-05-30T16:54:23.276 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47969.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47198.log.gz 2024-05-30T16:54:23.276 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-05-30T16:54:23.277 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46528.log 2024-05-30T16:54:23.278 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42206.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42206.log.gz 2024-05-30T16:54:23.279 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63955.log 2024-05-30T16:54:23.280 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46528.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46528.log.gz 2024-05-30T16:54:23.281 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64475.log 2024-05-30T16:54:23.282 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63955.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63955.log.gz 2024-05-30T16:54:23.283 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54109.log 2024-05-30T16:54:23.284 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64475.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64475.log.gz 2024-05-30T16:54:23.285 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50895.log 2024-05-30T16:54:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54109.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54109.log.gz 2024-05-30T16:54:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61883.log 2024-05-30T16:54:23.288 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50895.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50895.log.gz 2024-05-30T16:54:23.288 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50807.log 2024-05-30T16:54:23.290 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61883.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.61883.log.gz 2024-05-30T16:54:23.291 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42691.log/var/log/ceph/ceph-client.admin.50807.log: 2024-05-30T16:54:23.292 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50807.log.gz 2024-05-30T16:54:23.292 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64039.log 2024-05-30T16:54:23.294 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42691.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42691.log.gz 2024-05-30T16:54:23.294 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56712.log 2024-05-30T16:54:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64039.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64039.log.gz 2024-05-30T16:54:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.56712.log: -- /var/log/ceph/ceph-client.admin.56364.log 2024-05-30T16:54:23.297 INFO:teuthology.orchestra.run.smithi144.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56712.log.gz 2024-05-30T16:54:23.298 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50668.log 2024-05-30T16:54:23.299 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56364.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56364.log.gz 2024-05-30T16:54:23.300 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51021.log 2024-05-30T16:54:23.301 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50668.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50668.log.gz 2024-05-30T16:54:23.302 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56297.log 2024-05-30T16:54:23.303 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51021.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51021.log.gz 2024-05-30T16:54:23.304 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59186.log 2024-05-30T16:54:23.305 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56297.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56297.log.gz 2024-05-30T16:54:23.306 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57129.log 2024-05-30T16:54:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59186.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59186.log.gz 2024-05-30T16:54:23.308 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2024-05-30T16:54:23.309 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57129.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57129.log.gz 2024-05-30T16:54:23.309 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63566.log 2024-05-30T16:54:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43216.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2024-05-30T16:54:23.312 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49739.log 2024-05-30T16:54:23.312 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63566.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63566.log.gz 2024-05-30T16:54:23.314 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2024-05-30T16:54:23.314 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49739.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49739.log.gz 2024-05-30T16:54:23.315 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55845.log 2024-05-30T16:54:23.316 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47282.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2024-05-30T16:54:23.318 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55845.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55845.log.gz 2024-05-30T16:54:23.318 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57045.log 2024-05-30T16:54:23.320 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-30T16:54:23.321 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57045.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57045.log.gz 2024-05-30T16:54:23.322 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30765.log 2024-05-30T16:54:23.324 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph.tmp-client.admin.30765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56928.log 2024-05-30T16:54:23.325 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30765.log.gz 2024-05-30T16:54:23.327 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48615.log 2024-05-30T16:54:23.329 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56928.log: /var/log/ceph/ceph-client.admin.48615.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56928.log.gz 2024-05-30T16:54:23.329 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48615.log.gz 2024-05-30T16:54:23.330 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62742.log 2024-05-30T16:54:23.331 INFO:teuthology.orchestra.run.smithi149.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-30T16:54:23.332 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62045.log 2024-05-30T16:54:23.335 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62742.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53146.log 2024-05-30T16:54:23.335 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62045.log: -- replaced with /var/log/ceph/ceph-client.admin.62742.log.gz 2024-05-30T16:54:23.335 INFO:teuthology.orchestra.run.smithi144.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.62045.log.gz 2024-05-30T16:54:23.338 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53146.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53146.log.gz 2024-05-30T16:54:23.338 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64081.log 2024-05-30T16:54:23.341 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52465.log 2024-05-30T16:54:23.342 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64081.log.gz 2024-05-30T16:54:23.344 INFO:teuthology.orchestra.run.smithi149.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-30T16:54:23.344 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62388.log 2024-05-30T16:54:23.346 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52465.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52465.log.gz 2024-05-30T16:54:23.348 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62532.log 2024-05-30T16:54:23.352 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62388.log: /var/log/ceph/ceph-client.admin.62532.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62388.log.gz 2024-05-30T16:54:23.353 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63913.log 2024-05-30T16:54:23.355 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53062.log 2024-05-30T16:54:23.355 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62532.log.gz 2024-05-30T16:54:23.355 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63913.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63913.log.gz 2024-05-30T16:54:23.359 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53062.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53062.log.gz 2024-05-30T16:54:23.359 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61373.log 2024-05-30T16:54:23.360 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63661.log 2024-05-30T16:54:23.362 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50583.log 2024-05-30T16:54:23.364 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6%/var/log/ceph/ceph-client.admin.63661.log: -- replaced with /var/log/ceph/ceph-client.admin.61373.log.gz 2024-05-30T16:54:23.365 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63661.log.gz 2024-05-30T16:54:23.365 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-client.admin.51291.log 2024-05-30T16:54:23.366 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50583.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50583.log.gz 2024-05-30T16:54:23.367 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58176.log 2024-05-30T16:54:23.369 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51291.log.gz 2024-05-30T16:54:23.370 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58176.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58176.log.gz 2024-05-30T16:54:23.371 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62175.log 2024-05-30T16:54:23.375 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62175.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.62175.log.gz 2024-05-30T16:54:23.375 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55218.log 2024-05-30T16:54:23.377 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56652.log 2024-05-30T16:54:23.379 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55218.log.gz 2024-05-30T16:54:23.380 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53290.log 2024-05-30T16:54:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56652.log: /var/log/ceph/ceph-client.admin.53290.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59928.log 2024-05-30T16:54:23.385 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56652.log.gz 2024-05-30T16:54:23.386 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53290.log.gz 2024-05-30T16:54:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49340.log 2024-05-30T16:54:23.392 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59928.log: /var/log/ceph/ceph-client.admin.49340.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51483.log 2024-05-30T16:54:23.393 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59928.log.gz 2024-05-30T16:54:23.394 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49340.log.gz 2024-05-30T16:54:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63997.log 2024-05-30T16:54:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51483.log: /var/log/ceph/ceph-client.admin.63997.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59441.log 2024-05-30T16:54:23.399 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51483.log.gz 2024-05-30T16:54:23.400 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63997.log.gz 2024-05-30T16:54:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49865.log 2024-05-30T16:54:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59441.log: /var/log/ceph/ceph-client.admin.49865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59441.log.gz 2024-05-30T16:54:23.407 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59862.log 2024-05-30T16:54:23.408 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49865.log.gz 2024-05-30T16:54:23.409 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45679.log 2024-05-30T16:54:23.414 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59862.log: /var/log/ceph/ceph-client.admin.45679.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2024-05-30T16:54:23.415 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59862.log.gz 2024-05-30T16:54:23.415 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45679.log.gz 2024-05-30T16:54:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57357.log 2024-05-30T16:54:23.418 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2024-05-30T16:54:23.419 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55088.log 2024-05-30T16:54:23.420 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2024-05-30T16:54:23.423 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57357.log: /var/log/ceph/ceph-client.admin.55088.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57357.log.gz 2024-05-30T16:54:23.424 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55088.log.gz 2024-05-30T16:54:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52532.log 2024-05-30T16:54:23.428 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1%/var/log/ceph/ceph-client.admin.52532.log: -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2024-05-30T16:54:23.428 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59142.log 2024-05-30T16:54:23.430 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52532.log.gz 2024-05-30T16:54:23.431 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57483.log 2024-05-30T16:54:23.436 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59142.log: /var/log/ceph/ceph-client.admin.57483.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59142.log.gz 2024-05-30T16:54:23.436 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49214.log 2024-05-30T16:54:23.437 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57483.log.gz 2024-05-30T16:54:23.439 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54951.log 2024-05-30T16:54:23.443 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49214.log: /var/log/ceph/ceph-client.admin.54951.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63272.log 2024-05-30T16:54:23.443 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49214.log.gz 2024-05-30T16:54:23.444 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54951.log.gz 2024-05-30T16:54:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58344.log 2024-05-30T16:54:23.449 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63272.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63272.log.gz 2024-05-30T16:54:23.451 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63138.log 2024-05-30T16:54:23.452 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58344.log.gz 2024-05-30T16:54:23.453 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42426.log 2024-05-30T16:54:23.457 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63138.log: /var/log/ceph/ceph-client.admin.42426.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.63138.log.gz 2024-05-30T16:54:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50502.log 2024-05-30T16:54:23.459 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42426.log.gz 2024-05-30T16:54:23.460 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59273.log 2024-05-30T16:54:23.464 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50502.log: /var/log/ceph/ceph-client.admin.59273.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59273.log.gz 2024-05-30T16:54:23.465 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59693.log 2024-05-30T16:54:23.466 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50502.log.gz 2024-05-30T16:54:23.468 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53458.log 2024-05-30T16:54:23.470 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59693.log.gz 2024-05-30T16:54:23.471 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60237.log 2024-05-30T16:54:23.475 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60237.log: /var/log/ceph/ceph-client.admin.53458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46051.log 2024-05-30T16:54:23.477 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53458.log.gz 2024-05-30T16:54:23.477 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60237.log.gz 2024-05-30T16:54:23.479 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60893.log 2024-05-30T16:54:23.483 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46051.log: /var/log/ceph/ceph-client.admin.60893.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56807.log 2024-05-30T16:54:23.484 INFO:teuthology.orchestra.run.smithi144.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46051.log.gz 2024-05-30T16:54:23.484 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60893.log.gz 2024-05-30T16:54:23.486 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43917.log 2024-05-30T16:54:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43917.log: /var/log/ceph/ceph-client.admin.56807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43561.log 2024-05-30T16:54:23.491 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56807.log.gz 2024-05-30T16:54:23.492 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43917.log.gz 2024-05-30T16:54:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61163.log 2024-05-30T16:54:23.496 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61163.log: /var/log/ceph/ceph-client.admin.43561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54907.log 2024-05-30T16:54:23.498 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43561.log.gz 2024-05-30T16:54:23.499 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61163.log.gz 2024-05-30T16:54:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54025.log 2024-05-30T16:54:23.504 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54025.log: /var/log/ceph/ceph-client.admin.54907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63012.log 2024-05-30T16:54:23.505 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57441.log 2024-05-30T16:54:23.506 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54025.log.gz 2024-05-30T16:54:23.506 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54907.log.gz 2024-05-30T16:54:23.509 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57441.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57441.log.gz 2024-05-30T16:54:23.510 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63012.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.63012.log.gz 2024-05-30T16:54:23.511 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42556.log 2024-05-30T16:54:23.513 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61662.log 2024-05-30T16:54:23.514 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42556.log.gz 2024-05-30T16:54:23.516 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64333.log 2024-05-30T16:54:23.520 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61662.log: /var/log/ceph/ceph-client.admin.64333.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54201.log 2024-05-30T16:54:23.520 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61662.log.gz 2024-05-30T16:54:23.521 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64333.log.gz 2024-05-30T16:54:23.523 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48758.log 2024-05-30T16:54:23.527 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54201.log: /var/log/ceph/ceph-client.admin.48758.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43838.log 2024-05-30T16:54:23.528 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54201.log.gz 2024-05-30T16:54:23.529 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48758.log.gz 2024-05-30T16:54:23.530 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46131.log 2024-05-30T16:54:23.535 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43838.log: /var/log/ceph/ceph-client.admin.46131.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55260.log 2024-05-30T16:54:23.535 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43838.log.gz 2024-05-30T16:54:23.536 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46131.log.gz 2024-05-30T16:54:23.537 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46383.log 2024-05-30T16:54:23.539 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53104.log 2024-05-30T16:54:23.541 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8%/var/log/ceph/ceph-client.admin.46383.log: -- replaced with /var/log/ceph/ceph-client.admin.55260.log.gz 2024-05-30T16:54:23.542 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46383.log.gz 2024-05-30T16:54:23.546 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53104.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53104.log.gz 2024-05-30T16:54:23.546 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42607.log 2024-05-30T16:54:23.546 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56766.log 2024-05-30T16:54:23.549 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56766.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56766.log.gz 2024-05-30T16:54:23.549 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56876.log 2024-05-30T16:54:23.552 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56876.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56876.log.gz 2024-05-30T16:54:23.552 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42607.log.gz 2024-05-30T16:54:23.553 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61747.log 2024-05-30T16:54:23.556 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58801.log 2024-05-30T16:54:23.557 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61747.log.gz 2024-05-30T16:54:23.558 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57171.log 2024-05-30T16:54:23.562 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58801.log: /var/log/ceph/ceph-client.admin.57171.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58801.log.gz 2024-05-30T16:54:23.562 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48902.log 2024-05-30T16:54:23.563 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57171.log.gz 2024-05-30T16:54:23.565 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47636.log 2024-05-30T16:54:23.570 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48902.log: /var/log/ceph/ceph-client.admin.47636.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48902.log.gz 2024-05-30T16:54:23.570 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52936.log 2024-05-30T16:54:23.571 INFO:teuthology.orchestra.run.smithi144.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47636.log.gz 2024-05-30T16:54:23.573 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58976.log 2024-05-30T16:54:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52936.log: /var/log/ceph/ceph-client.admin.58976.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56484.log 2024-05-30T16:54:23.577 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52936.log.gz 2024-05-30T16:54:23.579 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63054.log 2024-05-30T16:54:23.579 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58976.log.gz 2024-05-30T16:54:23.581 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56484.log: /var/log/ceph/ceph-client.admin.63054.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56484.log.gz 2024-05-30T16:54:23.582 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose 88.3% -- -- replaced with /var/log/ceph/ceph-client.admin.63054.log.gz 2024-05-30T16:54:23.582 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-client.admin.42737.log 2024-05-30T16:54:23.584 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52978.log 2024-05-30T16:54:23.585 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42737.log.gz 2024-05-30T16:54:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47426.log 2024-05-30T16:54:23.591 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52978.log: /var/log/ceph/ceph-client.admin.47426.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43549.log 2024-05-30T16:54:23.592 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52978.log.gz 2024-05-30T16:54:23.593 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47426.log.gz 2024-05-30T16:54:23.594 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59399.log 2024-05-30T16:54:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43549.log: /var/log/ceph/ceph-client.admin.59399.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46731.log 2024-05-30T16:54:23.599 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43549.log.gz 2024-05-30T16:54:23.600 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59399.log.gz 2024-05-30T16:54:23.600 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48011.log 2024-05-30T16:54:23.602 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46731.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46731.log.gz 2024-05-30T16:54:23.605 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48011.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48011.log.gz 2024-05-30T16:54:23.606 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56238.log 2024-05-30T16:54:23.608 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54741.log 2024-05-30T16:54:23.609 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56238.log.gz 2024-05-30T16:54:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43765.log 2024-05-30T16:54:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54741.log: /var/log/ceph/ceph-client.admin.43765.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57549.log 2024-05-30T16:54:23.616 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54741.log.gz 2024-05-30T16:54:23.617 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43765.log.gz 2024-05-30T16:54:23.618 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57759.log 2024-05-30T16:54:23.622 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57549.log: /var/log/ceph/ceph-client.admin.57759.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52652.log 2024-05-30T16:54:23.622 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57549.log.gz 2024-05-30T16:54:23.623 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57759.log.gz 2024-05-30T16:54:23.625 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53899.log 2024-05-30T16:54:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52652.log: /var/log/ceph/ceph-client.admin.53899.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55536.log 2024-05-30T16:54:23.629 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52652.log.gz 2024-05-30T16:54:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55536.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53899.log.gz 2024-05-30T16:54:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50285.log 2024-05-30T16:54:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50285.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50422.log 2024-05-30T16:54:23.636 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55536.log.gz 2024-05-30T16:54:23.637 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50285.log.gz 2024-05-30T16:54:23.638 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56196.log 2024-05-30T16:54:23.642 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56196.log: /var/log/ceph/ceph-client.admin.50422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51876.log 2024-05-30T16:54:23.645 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51876.log: 88.0% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50422.log.gz 2024-05-30T16:54:23.645 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56196.log.gz 2024-05-30T16:54:23.645 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51249.log 2024-05-30T16:54:23.646 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51876.log.gz 2024-05-30T16:54:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51375.log 2024-05-30T16:54:23.651 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51375.log: /var/log/ceph/ceph-client.admin.51249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63198.log 2024-05-30T16:54:23.653 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51249.log.gz 2024-05-30T16:54:23.654 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51375.log.gz 2024-05-30T16:54:23.655 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59525.log 2024-05-30T16:54:23.659 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59525.log: /var/log/ceph/ceph-client.admin.63198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46425.log 2024-05-30T16:54:23.660 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63198.log.gz 2024-05-30T16:54:23.661 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59525.log.gz 2024-05-30T16:54:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49112.log 2024-05-30T16:54:23.663 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59099.log 2024-05-30T16:54:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46425.log: /var/log/ceph/ceph-client.admin.49112.log: /var/log/ceph/ceph-client.admin.59099.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59099.log.gz 2024-05-30T16:54:23.667 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46425.log.gz 2024-05-30T16:54:23.668 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54272.log 2024-05-30T16:54:23.669 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49112.log.gz/var/log/ceph/ceph-client.admin.54272.log: 2024-05-30T16:54:23.671 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54272.log.gz 2024-05-30T16:54:23.672 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49298.log 2024-05-30T16:54:23.674 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53566.log 2024-05-30T16:54:23.676 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49298.log.gz 2024-05-30T16:54:23.677 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49256.log 2024-05-30T16:54:23.681 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53566.log: /var/log/ceph/ceph-client.admin.49256.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2024-05-30T16:54:23.682 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53566.log.gz 2024-05-30T16:54:23.683 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49256.log.gz 2024-05-30T16:54:23.684 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58092.log 2024-05-30T16:54:23.685 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58896.log 2024-05-30T16:54:23.687 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55724.log 2024-05-30T16:54:23.688 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2024-05-30T16:54:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58092.log: /var/log/ceph/ceph-client.admin.58896.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58896.log.gz 2024-05-30T16:54:23.690 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58092.log.gz 2024-05-30T16:54:23.691 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.55724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55724.log.gz 2024-05-30T16:54:23.692 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52598.log 2024-05-30T16:54:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50712.log 2024-05-30T16:54:23.696 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52598.log.gz 2024-05-30T16:54:23.697 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51207.log 2024-05-30T16:54:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50712.log: /var/log/ceph/ceph-client.admin.51207.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61704.log 2024-05-30T16:54:23.702 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50712.log.gz 2024-05-30T16:54:23.703 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51207.log.gz 2024-05-30T16:54:23.705 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58465.log 2024-05-30T16:54:23.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61704.log: /var/log/ceph/ceph-client.admin.58465.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46816.log 2024-05-30T16:54:23.710 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61704.log.gz 2024-05-30T16:54:23.711 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58465.log.gz 2024-05-30T16:54:23.712 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58302.log 2024-05-30T16:54:23.716 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46816.log: /var/log/ceph/ceph-client.admin.58302.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58633.log 2024-05-30T16:54:23.716 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gz 2024-05-30T16:54:23.717 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58302.log.gz 2024-05-30T16:54:23.719 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2024-05-30T16:54:23.723 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58633.log: /var/log/ceph/ceph-client.admin.42384.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44135.log 2024-05-30T16:54:23.724 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58633.log.gz 2024-05-30T16:54:23.725 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2024-05-30T16:54:23.727 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55470.log 2024-05-30T16:54:23.731 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55470.log: /var/log/ceph/ceph-client.admin.44135.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43219.log 2024-05-30T16:54:23.731 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44135.log.gz 2024-05-30T16:54:23.733 INFO:teuthology.orchestra.run.smithi144.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55470.log.gz 2024-05-30T16:54:23.734 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57213.log 2024-05-30T16:54:23.735 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42779.log 2024-05-30T16:54:23.736 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43219.log.gz 2024-05-30T16:54:23.738 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57213.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57213.log.gz 2024-05-30T16:54:23.739 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47468.log 2024-05-30T16:54:23.743 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42779.log: /var/log/ceph/ceph-client.admin.47468.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50243.log 2024-05-30T16:54:23.744 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42779.log.gz 2024-05-30T16:54:23.745 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47468.log.gz 2024-05-30T16:54:23.746 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54995.log 2024-05-30T16:54:23.750 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50243.log: /var/log/ceph/ceph-client.admin.54995.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63871.log 2024-05-30T16:54:23.750 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50243.log.gz 2024-05-30T16:54:23.752 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54995.log.gz 2024-05-30T16:54:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63481.log 2024-05-30T16:54:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63871.log: /var/log/ceph/ceph-client.admin.63481.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53500.log 2024-05-30T16:54:23.758 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63871.log.gz 2024-05-30T16:54:23.759 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63481.log.gz 2024-05-30T16:54:23.762 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.53500.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62086.log 2024-05-30T16:54:23.765 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62086.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.53500.log.gz 2024-05-30T16:54:23.766 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49028.log 2024-05-30T16:54:23.767 INFO:teuthology.orchestra.run.smithi144.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.62086.log.gz 2024-05-30T16:54:23.767 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47890.log 2024-05-30T16:54:23.769 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-05-30T16:54:23.772 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49028.log: /var/log/ceph/ceph-client.0.47890.log: 88.9%/var/log/ceph/ceph-client.admin.42959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49028.log.gz 2024-05-30T16:54:23.773 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.0.47890.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-05-30T16:54:23.773 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-05-30T16:54:23.773 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45953.log 2024-05-30T16:54:23.776 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45953.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45953.log.gz 2024-05-30T16:54:23.777 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43440.log 2024-05-30T16:54:23.779 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55176.log 2024-05-30T16:54:23.780 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43440.log.gz 2024-05-30T16:54:23.782 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-30T16:54:23.787 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55176.log: /var/log/ceph/ceph-mds.a.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63745.log 2024-05-30T16:54:23.787 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55176.log.gz 2024-05-30T16:54:23.789 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54524.log 2024-05-30T16:54:23.790 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63745.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63745.log.gz 2024-05-30T16:54:23.794 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54524.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54524.log.gz 2024-05-30T16:54:23.796 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54865.log 2024-05-30T16:54:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58591.log 2024-05-30T16:54:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52352.log 2024-05-30T16:54:23.802 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54865.log.gz 2024-05-30T16:54:23.805 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57273.log 2024-05-30T16:54:23.806 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52352.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52352.log.gz 2024-05-30T16:54:23.807 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50625.log 2024-05-30T16:54:23.807 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58591.log.gz 2024-05-30T16:54:23.808 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57273.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57273.log.gz 2024-05-30T16:54:23.810 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45317.log 2024-05-30T16:54:23.812 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50625.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50625.log.gz 2024-05-30T16:54:23.813 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46485.log 2024-05-30T16:54:23.814 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.2.45317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45317.log.gz 2024-05-30T16:54:23.821 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46485.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46485.log.gz 2024-05-30T16:54:23.822 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53248.log 2024-05-30T16:54:23.823 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43915.log 2024-05-30T16:54:23.825 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53248.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53248.log.gz 2024-05-30T16:54:23.828 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57675.log 2024-05-30T16:54:23.830 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43915.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43915.log.gz 2024-05-30T16:54:23.832 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50033.log 2024-05-30T16:54:23.832 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57675.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57675.log.gz 2024-05-30T16:54:23.837 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50033.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50033.log.gz 2024-05-30T16:54:23.839 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57717.log 2024-05-30T16:54:23.840 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47384.log 2024-05-30T16:54:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57717.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57717.log.gz 2024-05-30T16:54:23.842 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61331.log 2024-05-30T16:54:23.844 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47384.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47384.log.gz 2024-05-30T16:54:23.846 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53650.log 2024-05-30T16:54:23.848 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61331.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61331.log.gz 2024-05-30T16:54:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43843.log 2024-05-30T16:54:23.851 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53650.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53650.log.gz 2024-05-30T16:54:23.852 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43221.log 2024-05-30T16:54:23.853 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43843.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43843.log.gz 2024-05-30T16:54:23.857 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43221.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43221.log.gz 2024-05-30T16:54:23.859 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64291.log 2024-05-30T16:54:23.861 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56037.log 2024-05-30T16:54:23.863 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64291.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64291.log.gz 2024-05-30T16:54:23.864 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62928.log 2024-05-30T16:54:23.866 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56037.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56037.log.gz 2024-05-30T16:54:23.868 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62448.log 2024-05-30T16:54:23.870 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62928.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62928.log.gz 2024-05-30T16:54:23.872 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59567.log 2024-05-30T16:54:23.874 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62448.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62448.log.gz 2024-05-30T16:54:23.876 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59609.log 2024-05-30T16:54:23.878 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59567.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59567.log.gz 2024-05-30T16:54:23.879 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64123.log 2024-05-30T16:54:23.881 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59609.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59609.log.gz 2024-05-30T16:54:23.882 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64123.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64123.log.gz 2024-05-30T16:54:23.883 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2024-05-30T16:54:23.887 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60375.log 2024-05-30T16:54:23.888 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45721.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2024-05-30T16:54:23.889 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63829.log 2024-05-30T16:54:23.891 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60375.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60375.log.gz 2024-05-30T16:54:23.892 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51333.log 2024-05-30T16:54:23.894 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63829.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63829.log.gz 2024-05-30T16:54:23.898 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52406.log 2024-05-30T16:54:23.899 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51333.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51333.log.gz 2024-05-30T16:54:23.902 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52406.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52406.log.gz 2024-05-30T16:54:23.902 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43559.log 2024-05-30T16:54:23.903 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44860.log 2024-05-30T16:54:23.907 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56526.log 2024-05-30T16:54:23.908 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.44860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44860.log.gz 2024-05-30T16:54:23.909 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43559.log.gz 2024-05-30T16:54:23.913 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56526.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56526.log.gz 2024-05-30T16:54:23.914 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47324.log 2024-05-30T16:54:23.915 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53608.log 2024-05-30T16:54:23.917 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47324.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47324.log.gz 2024-05-30T16:54:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50159.log 2024-05-30T16:54:23.922 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53608.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53608.log.gz 2024-05-30T16:54:23.924 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62700.log 2024-05-30T16:54:23.926 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50159.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50159.log.gz 2024-05-30T16:54:23.928 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50756.log 2024-05-30T16:54:23.930 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.62700.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62700.log.gz 2024-05-30T16:54:23.934 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50756.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50756.log.gz 2024-05-30T16:54:23.935 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60321.log 2024-05-30T16:54:23.936 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45637.log 2024-05-30T16:54:23.938 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60321.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60321.log.gz 2024-05-30T16:54:23.939 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51063.log 2024-05-30T16:54:23.941 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45637.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45637.log.gz 2024-05-30T16:54:23.943 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55983.log 2024-05-30T16:54:23.945 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51063.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51063.log.gz 2024-05-30T16:54:23.949 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55983.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55983.log.gz 2024-05-30T16:54:23.951 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56430.log 2024-05-30T16:54:23.953 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53941.log 2024-05-30T16:54:23.955 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56430.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56430.log.gz 2024-05-30T16:54:23.956 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63787.log 2024-05-30T16:54:23.960 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53941.log: /var/log/ceph/ceph-client.admin.63787.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63787.log.gz 2024-05-30T16:54:23.961 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53941.log.gz 2024-05-30T16:54:24.213 INFO:teuthology.orchestra.run.smithi144.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-30T16:54:24.807 INFO:teuthology.orchestra.run.smithi144.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-30T16:54:25.031 INFO:teuthology.orchestra.run.smithi144.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-30T16:54:25.662 INFO:teuthology.orchestra.run.smithi149.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-30T16:54:26.757 INFO:teuthology.orchestra.run.smithi149.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-30T16:54:27.019 INFO:teuthology.orchestra.run.smithi144.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-30T16:54:27.345 INFO:teuthology.orchestra.run.smithi149.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-30T16:54:27.423 INFO:teuthology.orchestra.run.smithi149.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-30T16:54:27.528 INFO:teuthology.orchestra.run.smithi144.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-30T16:54:27.730 INFO:teuthology.orchestra.run.smithi144.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-30T16:54:27.831 INFO:teuthology.orchestra.run.smithi144.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-30T16:54:28.431 INFO:teuthology.orchestra.run.smithi149.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-30T16:54:28.435 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-05-30T16:54:28.436 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m5.445s 2024-05-30T16:54:28.436 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m19.437s 2024-05-30T16:54:28.436 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m1.743s 2024-05-30T16:54:28.662 INFO:teuthology.orchestra.run.smithi144.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-30T16:54:28.667 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-05-30T16:54:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m5.679s 2024-05-30T16:54:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m24.579s 2024-05-30T16:54:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m3.112s 2024-05-30T16:54:28.668 INFO:tasks.ceph:Archiving logs... 2024-05-30T16:54:28.668 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/remote/smithi144/log 2024-05-30T16:54:28.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-30T16:54:31.880 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/remote/smithi149/log 2024-05-30T16:54:31.881 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-30T16:54:34.320 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-30T16:54:34.330 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-30T16:54:34.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-30T16:54:34.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-30T16:54:34.490 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-30T16:54:34.499 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-30T16:54:34.500 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T16:54:34.507 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T16:54:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-05-30T16:54:34.562 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-05-30T16:54:34.563 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-30T16:54:34.563 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-05-30T16:54:34.563 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +1611us[+1546us] +/- 58ms 2024-05-30T16:54:34.563 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -1191us[-1191us] +/- 60ms 2024-05-30T16:54:34.563 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -623us[ -623us] +/- 75ms 2024-05-30T16:54:34.563 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:54:34.572 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-30T16:54:34.572 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-05-30T16:54:34.572 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +1605us[+1577us] +/- 58ms 2024-05-30T16:54:34.572 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 -1204us[-1204us] +/- 60ms 2024-05-30T16:54:34.572 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -630us[ -630us] +/- 74ms 2024-05-30T16:54:34.572 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-30T16:54:34.573 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-30T16:54:34.583 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-30T16:54:34.583 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-30T16:54:34.608 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-30T16:54:34.820 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-30T16:54:34.977 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-30T16:54:35.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:54:35.072 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-30T16:54:35.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:54:35.166 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-30T16:54:35.176 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-30T16:54:35.208 INFO:teuthology.task.internal:Duration was 1378.074111 seconds 2024-05-30T16:54:35.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-30T16:54:35.313 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-30T16:54:35.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-30T16:54:35.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-30T16:54:35.448 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-30T16:54:35.454 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-30T16:54:35.899 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-30T16:54:35.899 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-05-30T16:54:35.899 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-30T16:54:35.962 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-05-30T16:54:35.962 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-30T16:54:36.039 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-30T16:54:36.039 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-30T16:54:36.047 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-30T16:54:36.129 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-30T16:54:36.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-30T16:54:36.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-30T16:54:36.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-30T16:54:36.324 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-30T16:54:36.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-30T16:54:36.397 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-30T16:54:36.484 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-30T16:54:36.493 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-30T16:54:36.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-30T16:54:36.594 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-05-30T16:54:36.602 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-05-30T16:54:36.641 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-30T16:54:36.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:54:36.694 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-30T16:54:36.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T16:54:36.749 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-30T16:54:36.759 INFO:teuthology.task.internal:Transferring archived files... 2024-05-30T16:54:36.760 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/remote/smithi144 2024-05-30T16:54:36.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-30T16:54:36.853 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-30_16:10:36-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734141/remote/smithi149 2024-05-30T16:54:36.853 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-30T16:54:36.946 INFO:teuthology.task.internal:Removing archive directory... 2024-05-30T16:54:36.946 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-30T16:54:36.954 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-30T16:54:37.005 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-30T16:54:37.017 INFO:teuthology.task.internal:Not uploading archives. 2024-05-30T16:54:37.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-30T16:54:37.051 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-30T16:54:37.051 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-30T16:54:37.058 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-30T16:54:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: 393724 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 30 16:54 /home/ubuntu/cephtest 2024-05-30T16:54:37.116 INFO:teuthology.orchestra.run.smithi149.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 30 16:54 /home/ubuntu/cephtest 2024-05-30T16:54:37.119 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-30T16:54:37.129 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-30T16:54:37.196 INFO:teuthology.run:Summary data: client.0-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 client.1-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} duration: 1378.0741109848022 failure_reason: 'Test failure: test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bae215abc9aa4367ab2da5e523b94051 status: fail success: false 2024-05-30T16:54:37.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-30T16:54:37.288 INFO:teuthology.run:FAIL